arvados.git
6 years ago14539: Fixes fuse tests.
Lucas Di Pentima [Tue, 18 Dec 2018 00:54:07 +0000 (21:54 -0300)]
14539: Fixes fuse tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14539: Tests that '\056' cannot be used as a file or directory name.
Lucas Di Pentima [Mon, 17 Dec 2018 23:35:31 +0000 (20:35 -0300)]
14539: Tests that '\056' cannot be used as a file or directory name.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14539: Persists empty directories by adding a '\056' empty file.
Lucas Di Pentima [Mon, 17 Dec 2018 21:18:52 +0000 (18:18 -0300)]
14539: Persists empty directories by adding a '\056' empty file.

Also:
* Fixes test
* Errors out when trying to open a file/dir with '\056' on its path.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14640-api-wb-activejob-upgrade'
Lucas Di Pentima [Tue, 18 Dec 2018 17:02:05 +0000 (14:02 -0300)]
Merge branch '14640-api-wb-activejob-upgrade'
Closes #14640

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoFix test_with_arvbox.sh to use https://versions.arvados.org no issue #
Peter Amstutz [Tue, 18 Dec 2018 16:50:51 +0000 (11:50 -0500)]
Fix test_with_arvbox.sh to use https://versions.arvados.org no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14640: Upgrades WB rails to 4.2.11
Lucas Di Pentima [Tue, 18 Dec 2018 16:17:24 +0000 (13:17 -0300)]
14640: Upgrades WB rails to 4.2.11

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14640: Upgrades API to rails 4.2.11
Lucas Di Pentima [Tue, 18 Dec 2018 16:02:41 +0000 (13:02 -0300)]
14640: Upgrades API to rails 4.2.11

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoWe've moved the chat/community support channel from IRC to gitter.im.
Ward Vandewege [Mon, 17 Dec 2018 20:53:43 +0000 (15:53 -0500)]
We've moved the chat/community support channel from IRC to gitter.im.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoUpdate cwltool refs #14510
Peter Amstutz [Mon, 17 Dec 2018 17:46:54 +0000 (12:46 -0500)]
Update cwltool refs #14510

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoUpdate README and community doc page. refs #14617
Peter Amstutz [Mon, 17 Dec 2018 16:31:52 +0000 (11:31 -0500)]
Update README and community doc page.  refs #14617

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago11419: Read JSON files in binary mode.
Tom Clegg [Fri, 14 Dec 2018 20:59:34 +0000 (15:59 -0500)]
11419: Read JSON files in binary mode.

Files opened in text mode do not have a size() method.

refs #11419

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoSet DBName correctly for arvbox demo, hopefully fix ci.commonwl.org
Peter Amstutz [Fri, 14 Dec 2018 21:36:50 +0000 (16:36 -0500)]
Set DBName correctly for arvbox demo, hopefully fix ci.commonwl.org

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14596-check-container-locked'
Tom Clegg [Fri, 14 Dec 2018 17:54:00 +0000 (12:54 -0500)]
Merge branch '14596-check-container-locked'

closes #14596

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agono issue # Fix and update rvm GPG Key signature issue on test dockerfiles
Fernando Monserrat [Fri, 14 Dec 2018 16:17:23 +0000 (13:17 -0300)]
no issue # Fix and update rvm GPG Key signature issue on test dockerfiles
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

6 years agoMerge branch '13006-sync-groups-is_a-filter'
Lucas Di Pentima [Fri, 14 Dec 2018 16:03:29 +0000 (13:03 -0300)]
Merge branch '13006-sync-groups-is_a-filter'
Closes #13006

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '13006-api-is_a-filter'
Lucas Di Pentima [Fri, 14 Dec 2018 16:02:46 +0000 (13:02 -0300)]
Merge branch '13006-api-is_a-filter'
Refs #13006

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '13006-api-is_a-filter' into 13006-sync-groups-is_a-filter
Lucas Di Pentima [Fri, 14 Dec 2018 15:54:49 +0000 (12:54 -0300)]
Merge branch '13006-api-is_a-filter' into 13006-sync-groups-is_a-filter

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13006: Uses 'is_a' filter again because it's being fixed on the API server.
Lucas Di Pentima [Thu, 13 Dec 2018 21:03:24 +0000 (18:03 -0300)]
13006: Uses 'is_a' filter again because it's being fixed on the API server.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agono issue # Fix and update rvm GPG Key signature issue
Fernando Monserrat [Thu, 13 Dec 2018 21:02:53 +0000 (18:02 -0300)]
no issue # Fix and update rvm GPG Key signature issue
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

6 years ago13006: Fail when using is_a filter on uuid attr and prefix_uuid doesn't match.
Lucas Di Pentima [Thu, 13 Dec 2018 20:53:33 +0000 (17:53 -0300)]
13006: Fail when using is_a filter on uuid attr and prefix_uuid doesn't match.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14596: crunch-run: don't do anything unless container is Locked.
Tom Clegg [Thu, 13 Dec 2018 20:16:42 +0000 (15:16 -0500)]
14596: crunch-run: don't do anything unless container is Locked.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14595-leave-modified-at' refs #14595
Peter Amstutz [Thu, 13 Dec 2018 20:09:12 +0000 (15:09 -0500)]
Merge branch '14595-leave-modified-at' refs #14595

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14595: Fix comment.
Peter Amstutz [Thu, 13 Dec 2018 20:08:53 +0000 (15:08 -0500)]
14595: Fix comment.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14595: Add leave_modified_at_alone
Peter Amstutz [Thu, 13 Dec 2018 19:37:29 +0000 (14:37 -0500)]
14595: Add leave_modified_at_alone

leave_modified_by_user_alone does not affect modified_at

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14012-arvput-check-cache'
Lucas Di Pentima [Thu, 13 Dec 2018 19:34:21 +0000 (16:34 -0300)]
Merge branch '14012-arvput-check-cache'
Closes #14012

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13006: Adds expression index on links.[tail|head]_uuid
Lucas Di Pentima [Thu, 13 Dec 2018 19:21:38 +0000 (16:21 -0300)]
13006: Adds expression index on links.[tail|head]_uuid

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14596-no-requeue'
Tom Clegg [Thu, 13 Dec 2018 18:16:29 +0000 (13:16 -0500)]
Merge branch '14596-no-requeue'

fixes #14596

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13006: Changes is_a filter to use a substring query to support remote UUIDs.
Lucas Di Pentima [Thu, 13 Dec 2018 17:28:28 +0000 (14:28 -0300)]
13006: Changes is_a filter to use a substring query to support remote UUIDs.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14596: Use sbatch --no-requeue to avoid bogus container re-runs.
Tom Clegg [Thu, 13 Dec 2018 17:10:52 +0000 (12:10 -0500)]
14596: Use sbatch --no-requeue to avoid bogus container re-runs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13006: Test exposing the bug
Lucas Di Pentima [Thu, 13 Dec 2018 16:11:04 +0000 (13:11 -0300)]
13006: Test exposing the bug

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14495-crunch-docker-space' refs #14495
Peter Amstutz [Thu, 13 Dec 2018 15:38:35 +0000 (10:38 -0500)]
Merge branch '14495-crunch-docker-space' refs #14495

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14495: Add warnings when estimateDockerImageSize gets bad input
Peter Amstutz [Thu, 13 Dec 2018 15:37:26 +0000 (10:37 -0500)]
14495: Add warnings when estimateDockerImageSize gets bad input

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '11419-text-mode'
Tom Clegg [Mon, 10 Dec 2018 21:18:35 +0000 (16:18 -0500)]
Merge branch '11419-text-mode'

closes #11419

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14012: Enhance test coverage on _cached_manifest_valid() method
Lucas Di Pentima [Mon, 10 Dec 2018 20:55:58 +0000 (17:55 -0300)]
14012: Enhance test coverage on _cached_manifest_valid() method

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14012: Split cache file name generation for readability
Lucas Di Pentima [Mon, 10 Dec 2018 20:55:11 +0000 (17:55 -0300)]
14012: Split cache file name generation for readability

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14594-update-cwltool' refs #14594
Peter Amstutz [Mon, 10 Dec 2018 19:06:34 +0000 (14:06 -0500)]
Merge branch '14594-update-cwltool' refs #14594

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14538-async-write'
Tom Clegg [Mon, 10 Dec 2018 16:41:12 +0000 (11:41 -0500)]
Merge branch '14538-async-write'

fixes #14538

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14594: Update to latest cwltool
Peter Amstutz [Mon, 10 Dec 2018 16:40:13 +0000 (11:40 -0500)]
14594: Update to latest cwltool

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14538: Merge branch 'master' into 14538-async-write
Tom Clegg [Mon, 10 Dec 2018 16:38:35 +0000 (11:38 -0500)]
14538: Merge branch 'master' into 14538-async-write

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago11419: Merge branch 'master' into 11419-text-mode
Tom Clegg [Mon, 10 Dec 2018 16:37:40 +0000 (11:37 -0500)]
11419: Merge branch 'master' into 11419-text-mode

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14476-cwl-missing-input' refs #14476
Peter Amstutz [Mon, 10 Dec 2018 16:25:38 +0000 (11:25 -0500)]
Merge branch '14476-cwl-missing-input' refs #14476

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14476: Remove redundant falsey check
Peter Amstutz [Mon, 10 Dec 2018 16:20:41 +0000 (11:20 -0500)]
14476: Remove redundant falsey check

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14495: Add dispatchcloud.EstimateScratchSpace()
Peter Amstutz [Mon, 10 Dec 2018 16:12:28 +0000 (11:12 -0500)]
14495: Add dispatchcloud.EstimateScratchSpace()

Estimate size of Docker image based on collection size, and
incorporate that into disk space requirement.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14012: Fix test
Lucas Di Pentima [Mon, 10 Dec 2018 15:56:45 +0000 (12:56 -0300)]
14012: Fix test

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14476: Add test that submitting with missing parameters correctly gets error.
Peter Amstutz [Fri, 7 Dec 2018 21:26:50 +0000 (16:26 -0500)]
14476: Add test that submitting with missing parameters correctly gets error.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14476: Fix RunnerTemplate
Peter Amstutz [Fri, 7 Dec 2018 19:55:55 +0000 (14:55 -0500)]
14476: Fix RunnerTemplate

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14476: When creating a Runner, check input is valid before submitting
Peter Amstutz [Fri, 7 Dec 2018 19:15:28 +0000 (14:15 -0500)]
14476: When creating a Runner, check input is valid before submitting

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14593-acr-crunch1' refs #14593
Peter Amstutz [Fri, 7 Dec 2018 20:58:34 +0000 (15:58 -0500)]
Merge branch '14593-acr-crunch1' refs #14593

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14593: Fix typo.
Peter Amstutz [Fri, 7 Dec 2018 20:57:45 +0000 (15:57 -0500)]
14593: Fix typo.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14012: Rephrases error message.
Lucas Di Pentima [Fri, 7 Dec 2018 20:48:30 +0000 (17:48 -0300)]
14012: Rephrases error message.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14593: Add note about broken crunch1 to upgrade docs.
Peter Amstutz [Fri, 7 Dec 2018 20:43:16 +0000 (15:43 -0500)]
14593: Add note about broken crunch1 to upgrade docs.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14593: Fix a-c-r when running on the "jobs" API
Peter Amstutz [Fri, 7 Dec 2018 20:03:04 +0000 (15:03 -0500)]
14593: Fix a-c-r when running on the "jobs" API

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoAdd a few upgrade notes for the 1.3.0 release.
Ward Vandewege [Mon, 3 Dec 2018 21:46:11 +0000 (16:46 -0500)]
Add a few upgrade notes for the 1.3.0 release.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoMerge branch '14574-expression-fix' refs #14574
Peter Amstutz [Thu, 6 Dec 2018 21:30:38 +0000 (16:30 -0500)]
Merge branch '14574-expression-fix' refs #14574

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14012: Do HEAD request on the oldest non-expired signature for cache validation
Lucas Di Pentima [Thu, 6 Dec 2018 17:57:48 +0000 (14:57 -0300)]
14012: Do HEAD request on the oldest non-expired signature for cache validation

* Re-added single file expiration check for re-uploads
* Added tests for all cases

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14584-runtime-user-reuse' refs #14584 1.3.0
Peter Amstutz [Wed, 5 Dec 2018 19:59:27 +0000 (14:59 -0500)]
Merge branch '14584-runtime-user-reuse' refs #14584

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14584: Remove runtime_user_uuid and runtime_auth_scopes checks for reuse.
Peter Amstutz [Wed, 5 Dec 2018 19:18:54 +0000 (14:18 -0500)]
14584: Remove runtime_user_uuid and runtime_auth_scopes checks for reuse.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14583-no-dcpdh' refs #14583
Peter Amstutz [Wed, 5 Dec 2018 18:16:33 +0000 (13:16 -0500)]
Merge branch '14583-no-dcpdh' refs #14583

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14583: Delete arv:dockerCollectionPDH from DockerRequirement in RunInSingleContainer
Peter Amstutz [Wed, 5 Dec 2018 16:42:43 +0000 (11:42 -0500)]
14583: Delete arv:dockerCollectionPDH from DockerRequirement in RunInSingleContainer

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14551-wb-login-as-token'
Lucas Di Pentima [Tue, 4 Dec 2018 20:51:13 +0000 (17:51 -0300)]
Merge branch '14551-wb-login-as-token'
Closes #14551

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14574-thread-count-1' refs #14574
Peter Amstutz [Tue, 4 Dec 2018 16:32:59 +0000 (11:32 -0500)]
Merge branch '14574-thread-count-1' refs #14574

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14576-query-perf' refs #14576
Peter Amstutz [Tue, 4 Dec 2018 16:32:49 +0000 (11:32 -0500)]
Merge branch '14576-query-perf' refs #14576

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14576: Use the 'in' test for user queries
Peter Amstutz [Tue, 4 Dec 2018 16:17:12 +0000 (11:17 -0500)]
14576: Use the 'in' test for user queries

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14576: Adjust query for admins that filters out trashed items
Peter Amstutz [Tue, 4 Dec 2018 15:43:01 +0000 (10:43 -0500)]
14576: Adjust query for admins that filters out trashed items

refs #14576

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14576: Adjust query for admins that filters out trashed items
Peter Amstutz [Tue, 4 Dec 2018 15:43:01 +0000 (10:43 -0500)]
14576: Adjust query for admins that filters out trashed items

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoFix docker push command in run-build-docker-jobs-image.sh
Ward Vandewege [Tue, 4 Dec 2018 13:58:36 +0000 (08:58 -0500)]
Fix docker push command in run-build-docker-jobs-image.sh

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14574: Ensure output callbacks take workflow lock
Peter Amstutz [Mon, 3 Dec 2018 22:34:34 +0000 (17:34 -0500)]
14574: Ensure output callbacks take workflow lock

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoIf a version tag is passed to run-build-docker-jobs-image.sh, actually use that
Ward Vandewege [Mon, 3 Dec 2018 21:29:24 +0000 (16:29 -0500)]
If a version tag is passed to run-build-docker-jobs-image.sh, actually use that
version of our codebase for the packages installed in the image.

run-build-docker-jobs-image.sh now also supports our ARVADOS_BUILDING_VERSION
and ARVADOS_BUILDING_ITERATION mechanism, so versions can be overridden that
way.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14574: Default --thread-count=1 until threading is more fully baked.
Peter Amstutz [Mon, 3 Dec 2018 21:23:28 +0000 (16:23 -0500)]
14574: Default --thread-count=1 until threading is more fully baked.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch 'master' into 14012-arvput-check-cache
Lucas Di Pentima [Mon, 3 Dec 2018 19:55:54 +0000 (16:55 -0300)]
Merge branch 'master' into 14012-arvput-check-cache

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14012: Early cached manifest validation by doing HEAD req on first block.
Lucas Di Pentima [Mon, 3 Dec 2018 19:23:04 +0000 (16:23 -0300)]
14012: Early cached manifest validation by doing HEAD req on first block.

* Remove un-needed block expiration check and adapted test for this change
* Add local_store_head to keep client for testing purposes
* Fix failing test

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14560: Limit to_tsvector input to 8K.
Tom Clegg [Mon, 3 Dec 2018 17:00:39 +0000 (12:00 -0500)]
14560: Limit to_tsvector input to 8K.

refs #14560
refs #13752

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14560-tsvector-too-long' refs #14560
Peter Amstutz [Sun, 2 Dec 2018 02:09:40 +0000 (21:09 -0500)]
Merge branch '14560-tsvector-too-long' refs #14560

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14560: Only index the first 1M bytes of ft-searchable data.
Tom Clegg [Sat, 1 Dec 2018 21:11:28 +0000 (16:11 -0500)]
14560: Only index the first 1M bytes of ft-searchable data.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14558-cwl-pkg-deps' refs #14558
Peter Amstutz [Fri, 30 Nov 2018 21:04:06 +0000 (16:04 -0500)]
Merge branch '14558-cwl-pkg-deps' refs #14558

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14558: Version dependency fixes.
Peter Amstutz [Fri, 30 Nov 2018 20:32:27 +0000 (15:32 -0500)]
14558: Version dependency fixes.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago11419: Support text modes in Collection.open().
Tom Clegg [Fri, 30 Nov 2018 20:32:25 +0000 (15:32 -0500)]
11419: Support text modes in Collection.open().

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14510-cwl-perf' refs #14510
Peter Amstutz [Fri, 30 Nov 2018 16:58:20 +0000 (11:58 -0500)]
Merge branch '14510-cwl-perf' refs #14510

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14510: Bugfix order of precedence for setting collection cache size
Peter Amstutz [Fri, 30 Nov 2018 15:50:20 +0000 (10:50 -0500)]
14510: Bugfix order of precedence for setting collection cache size

Fix a couple other buggy tests.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14510: Don't initialize workflow redundantly.
Peter Amstutz [Fri, 30 Nov 2018 14:25:47 +0000 (09:25 -0500)]
14510: Don't initialize workflow redundantly.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMake sure the dev version prefix is based on the latest tag in the repo, not
Ward Vandewege [Fri, 30 Nov 2018 02:08:05 +0000 (21:08 -0500)]
Make sure the dev version prefix is based on the latest tag in the repo, not
the latest tag on the master branch (part 3). Make sure the change also works
in Python 3.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14538: Fix racy tests.
Tom Clegg [Thu, 29 Nov 2018 20:41:50 +0000 (15:41 -0500)]
14538: Fix racy tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14538: Split inline func from sync() into commitBlock().
Tom Clegg [Thu, 29 Nov 2018 20:15:42 +0000 (15:15 -0500)]
14538: Split inline func from sync() into commitBlock().

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14538: Reduce max writeahead to 1.
Tom Clegg [Thu, 29 Nov 2018 20:12:25 +0000 (15:12 -0500)]
14538: Reduce max writeahead to 1.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMake sure the dev version prefix is based on the latest tag in the repo,
Ward Vandewege [Thu, 29 Nov 2018 19:49:31 +0000 (14:49 -0500)]
Make sure the dev version prefix is based on the latest tag in the repo,
not the latest tag on the master branch (part 2).

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14538: Remove redundant condition.
Tom Clegg [Thu, 29 Nov 2018 19:34:25 +0000 (14:34 -0500)]
14538: Remove redundant condition.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14538: Fix test.
Tom Clegg [Thu, 29 Nov 2018 19:33:22 +0000 (14:33 -0500)]
14538: Fix test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14551: Uses v2 token to log in as a user.
Lucas Di Pentima [Thu, 29 Nov 2018 14:06:54 +0000 (11:06 -0300)]
14551: Uses v2 token to log in as a user.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14551: Test exposing the bug.
Lucas Di Pentima [Thu, 29 Nov 2018 16:27:16 +0000 (13:27 -0300)]
14551: Test exposing the bug.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14538: Merge branch 'master' into 14538-async-write
Tom Clegg [Thu, 29 Nov 2018 14:33:53 +0000 (09:33 -0500)]
14538: Merge branch 'master' into 14538-async-write

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMake sure the dev version prefix is based on the latest tag in the repo,
Ward Vandewege [Thu, 29 Nov 2018 14:27:59 +0000 (09:27 -0500)]
Make sure the dev version prefix is based on the latest tag in the repo,
not the latest tag on the master branch.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoWork around ruamel.yaml packaging issue.
Ward Vandewege [Thu, 29 Nov 2018 03:23:34 +0000 (22:23 -0500)]
Work around ruamel.yaml packaging issue.

closes #14552

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14538: Check write concurrency limit.
Tom Clegg [Wed, 28 Nov 2018 21:54:27 +0000 (16:54 -0500)]
14538: Check write concurrency limit.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14538: Use concurrent writers to flush chunks while writing.
Tom Clegg [Wed, 28 Nov 2018 21:41:42 +0000 (16:41 -0500)]
14538: Use concurrent writers to flush chunks while writing.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14538: Move cancel-on-first-error logic to contextGroup.
Tom Clegg [Tue, 27 Nov 2018 21:44:45 +0000 (16:44 -0500)]
14538: Move cancel-on-first-error logic to contextGroup.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14538: Use concurrent writers to sync multiple streams.
Tom Clegg [Mon, 26 Nov 2018 21:31:26 +0000 (16:31 -0500)]
14538: Use concurrent writers to sync multiple streams.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14538: Use concurrent writers to sync a directory.
Tom Clegg [Mon, 26 Nov 2018 20:32:51 +0000 (15:32 -0500)]
14538: Use concurrent writers to sync a directory.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoStop relying on the keyservers during arvbox docker image build, they are too
Ward Vandewege [Wed, 28 Nov 2018 20:12:19 +0000 (15:12 -0500)]
Stop relying on the keyservers during arvbox docker image build, they are too
unreliable.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14510: Set collection metadata cache size as 150% of sum of inputs
Peter Amstutz [Wed, 28 Nov 2018 19:42:06 +0000 (14:42 -0500)]
14510: Set collection metadata cache size as 150% of sum of inputs

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoRelease 1.2.1 does not require special attention when upgrading.
Ward Vandewege [Wed, 28 Nov 2018 19:19:23 +0000 (14:19 -0500)]
Release 1.2.1 does not require special attention when upgrading.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>