arvados.git
6 years agoMerge branch '14360-dispatch-cloud'
Tom Clegg [Thu, 20 Dec 2018 19:02:05 +0000 (14:02 -0500)]
Merge branch '14360-dispatch-cloud'

closes #14360

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Merge branch 'master' into 14360-dispatch-cloud
Tom Clegg [Thu, 20 Dec 2018 18:58:26 +0000 (13:58 -0500)]
14360: Merge branch 'master' into 14360-dispatch-cloud

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Fix error log level on first probe after boot.
Tom Clegg [Thu, 20 Dec 2018 18:57:27 +0000 (13:57 -0500)]
14360: Fix error log level on first probe after boot.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Test for errant Create calls after failure.
Tom Clegg [Thu, 20 Dec 2018 16:00:10 +0000 (11:00 -0500)]
14360: Test for errant Create calls after failure.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Fix test case.
Tom Clegg [Thu, 20 Dec 2018 15:03:19 +0000 (10:03 -0500)]
14360: Fix test case.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Fix instance creation limiting.
Tom Clegg [Thu, 20 Dec 2018 14:44:45 +0000 (09:44 -0500)]
14360: Fix instance creation limiting.

Scheduler was claiming one of its unalloc instances only if the
container could be scheduled, so the "need new instance" condition was
not triggered for lower-priority containers needing the same instance
type.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Fix panic in test when last container is run twice.
Tom Clegg [Thu, 20 Dec 2018 14:42:49 +0000 (09:42 -0500)]
14360: Fix panic in test when last container is run twice.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Debug log when acquiring lock.
Tom Clegg [Thu, 20 Dec 2018 14:27:37 +0000 (09:27 -0500)]
14360: Debug log when acquiring lock.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Shutdown pool between tests to eliminate leaking logs.
Tom Clegg [Thu, 20 Dec 2018 14:25:56 +0000 (09:25 -0500)]
14360: Shutdown pool between tests to eliminate leaking logs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Replace OnComplete/OnCancel with ExecuteContainer callback.
Tom Clegg [Tue, 18 Dec 2018 20:08:57 +0000 (15:08 -0500)]
14360: Replace OnComplete/OnCancel with ExecuteContainer callback.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14327-cwl-unnecessary-collections' refs #14327
Peter Amstutz [Tue, 18 Dec 2018 19:14:58 +0000 (14:14 -0500)]
Merge branch '14327-cwl-unnecessary-collections' refs #14327

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14360: Call ChooseType just once per container.
Tom Clegg [Tue, 18 Dec 2018 19:11:23 +0000 (14:11 -0500)]
14360: Call ChooseType just once per container.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14327: Add comments
Peter Amstutz [Tue, 18 Dec 2018 19:08:58 +0000 (14:08 -0500)]
14327: Add comments

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14360: Remove log spam.
Tom Clegg [Tue, 18 Dec 2018 18:54:40 +0000 (13:54 -0500)]
14360: Remove log spam.

Just don't reserve space for an image if there is no image.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14640-api-wb-activejob-upgrade'
Lucas Di Pentima [Tue, 18 Dec 2018 17:02:05 +0000 (14:02 -0300)]
Merge branch '14640-api-wb-activejob-upgrade'
Closes #14640

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoFix test_with_arvbox.sh to use https://versions.arvados.org no issue #
Peter Amstutz [Tue, 18 Dec 2018 16:50:51 +0000 (11:50 -0500)]
Fix test_with_arvbox.sh to use https://versions.arvados.org no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14640: Upgrades WB rails to 4.2.11
Lucas Di Pentima [Tue, 18 Dec 2018 16:17:24 +0000 (13:17 -0300)]
14640: Upgrades WB rails to 4.2.11

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14640: Upgrades API to rails 4.2.11
Lucas Di Pentima [Tue, 18 Dec 2018 16:02:41 +0000 (13:02 -0300)]
14640: Upgrades API to rails 4.2.11

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch 'master' into 14360-dispatch-cloud
Tom Clegg [Tue, 18 Dec 2018 15:02:55 +0000 (10:02 -0500)]
Merge branch 'master' into 14360-dispatch-cloud

refs #14360

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Shutdown between tests to eliminate leaking logs.
Tom Clegg [Tue, 18 Dec 2018 07:59:05 +0000 (02:59 -0500)]
14360: Shutdown between tests to eliminate leaking logs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Clean up stub driver.
Tom Clegg [Tue, 18 Dec 2018 07:27:27 +0000 (02:27 -0500)]
14360: Clean up stub driver.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Avoid overreporting instances during Create/List race.
Tom Clegg [Tue, 18 Dec 2018 04:37:47 +0000 (23:37 -0500)]
14360: Avoid overreporting instances during Create/List race.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14327: Don't create new collection if source has expected secondaryFiles
Peter Amstutz [Mon, 17 Dec 2018 21:23:07 +0000 (16:23 -0500)]
14327: Don't create new collection if source has expected secondaryFiles

If all secondary files/directories are located in the same collection
as the primary file and the paths and names that are consistent with
staging, don't create a new collection.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoWe've moved the chat/community support channel from IRC to gitter.im.
Ward Vandewege [Mon, 17 Dec 2018 20:53:43 +0000 (15:53 -0500)]
We've moved the chat/community support channel from IRC to gitter.im.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14360: Comment stubServer.
Tom Clegg [Mon, 17 Dec 2018 20:14:11 +0000 (15:14 -0500)]
14360: Comment stubServer.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoUpdate cwltool refs #14510
Peter Amstutz [Mon, 17 Dec 2018 17:46:54 +0000 (12:46 -0500)]
Update cwltool refs #14510

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14360: Locking comment.
Tom Clegg [Mon, 17 Dec 2018 18:49:43 +0000 (13:49 -0500)]
14360: Locking comment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Fix log spam on normal race condition.
Tom Clegg [Mon, 17 Dec 2018 18:47:14 +0000 (13:47 -0500)]
14360: Fix log spam on normal race condition.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoUpdate README and community doc page. refs #14617
Peter Amstutz [Mon, 17 Dec 2018 16:31:52 +0000 (11:31 -0500)]
Update README and community doc page.  refs #14617

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14360: Comment TestDispatchToStubDriver.
Tom Clegg [Mon, 17 Dec 2018 15:57:40 +0000 (10:57 -0500)]
14360: Comment TestDispatchToStubDriver.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago11419: Read JSON files in binary mode.
Tom Clegg [Fri, 14 Dec 2018 20:59:34 +0000 (15:59 -0500)]
11419: Read JSON files in binary mode.

Files opened in text mode do not have a size() method.

refs #11419

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoSet DBName correctly for arvbox demo, hopefully fix ci.commonwl.org
Peter Amstutz [Fri, 14 Dec 2018 21:36:50 +0000 (16:36 -0500)]
Set DBName correctly for arvbox demo, hopefully fix ci.commonwl.org

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14596-check-container-locked'
Tom Clegg [Fri, 14 Dec 2018 17:54:00 +0000 (12:54 -0500)]
Merge branch '14596-check-container-locked'

closes #14596

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agono issue # Fix and update rvm GPG Key signature issue on test dockerfiles
Fernando Monserrat [Fri, 14 Dec 2018 16:17:23 +0000 (13:17 -0300)]
no issue # Fix and update rvm GPG Key signature issue on test dockerfiles
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

6 years agoMerge branch '13006-sync-groups-is_a-filter'
Lucas Di Pentima [Fri, 14 Dec 2018 16:03:29 +0000 (13:03 -0300)]
Merge branch '13006-sync-groups-is_a-filter'
Closes #13006

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '13006-api-is_a-filter'
Lucas Di Pentima [Fri, 14 Dec 2018 16:02:46 +0000 (13:02 -0300)]
Merge branch '13006-api-is_a-filter'
Refs #13006

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '13006-api-is_a-filter' into 13006-sync-groups-is_a-filter
Lucas Di Pentima [Fri, 14 Dec 2018 15:54:49 +0000 (12:54 -0300)]
Merge branch '13006-api-is_a-filter' into 13006-sync-groups-is_a-filter

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13006: Uses 'is_a' filter again because it's being fixed on the API server.
Lucas Di Pentima [Thu, 13 Dec 2018 21:03:24 +0000 (18:03 -0300)]
13006: Uses 'is_a' filter again because it's being fixed on the API server.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agono issue # Fix and update rvm GPG Key signature issue
Fernando Monserrat [Thu, 13 Dec 2018 21:02:53 +0000 (18:02 -0300)]
no issue # Fix and update rvm GPG Key signature issue
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

6 years ago13006: Fail when using is_a filter on uuid attr and prefix_uuid doesn't match.
Lucas Di Pentima [Thu, 13 Dec 2018 20:53:33 +0000 (17:53 -0300)]
13006: Fail when using is_a filter on uuid attr and prefix_uuid doesn't match.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14596: crunch-run: don't do anything unless container is Locked.
Tom Clegg [Thu, 13 Dec 2018 20:16:42 +0000 (15:16 -0500)]
14596: crunch-run: don't do anything unless container is Locked.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14595-leave-modified-at' refs #14595
Peter Amstutz [Thu, 13 Dec 2018 20:09:12 +0000 (15:09 -0500)]
Merge branch '14595-leave-modified-at' refs #14595

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14595: Fix comment.
Peter Amstutz [Thu, 13 Dec 2018 20:08:53 +0000 (15:08 -0500)]
14595: Fix comment.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14595: Add leave_modified_at_alone
Peter Amstutz [Thu, 13 Dec 2018 19:37:29 +0000 (14:37 -0500)]
14595: Add leave_modified_at_alone

leave_modified_by_user_alone does not affect modified_at

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14012-arvput-check-cache'
Lucas Di Pentima [Thu, 13 Dec 2018 19:34:21 +0000 (16:34 -0300)]
Merge branch '14012-arvput-check-cache'
Closes #14012

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13006: Adds expression index on links.[tail|head]_uuid
Lucas Di Pentima [Thu, 13 Dec 2018 19:21:38 +0000 (16:21 -0300)]
13006: Adds expression index on links.[tail|head]_uuid

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14596-no-requeue'
Tom Clegg [Thu, 13 Dec 2018 18:16:29 +0000 (13:16 -0500)]
Merge branch '14596-no-requeue'

fixes #14596

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13006: Changes is_a filter to use a substring query to support remote UUIDs.
Lucas Di Pentima [Thu, 13 Dec 2018 17:28:28 +0000 (14:28 -0300)]
13006: Changes is_a filter to use a substring query to support remote UUIDs.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14596: Use sbatch --no-requeue to avoid bogus container re-runs.
Tom Clegg [Thu, 13 Dec 2018 17:10:52 +0000 (12:10 -0500)]
14596: Use sbatch --no-requeue to avoid bogus container re-runs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13006: Test exposing the bug
Lucas Di Pentima [Thu, 13 Dec 2018 16:11:04 +0000 (13:11 -0300)]
13006: Test exposing the bug

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14495-crunch-docker-space' refs #14495
Peter Amstutz [Thu, 13 Dec 2018 15:38:35 +0000 (10:38 -0500)]
Merge branch '14495-crunch-docker-space' refs #14495

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14495: Add warnings when estimateDockerImageSize gets bad input
Peter Amstutz [Thu, 13 Dec 2018 15:37:26 +0000 (10:37 -0500)]
14495: Add warnings when estimateDockerImageSize gets bad input

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14360: Fix race between per-container lock and garbage collection.
Tom Clegg [Wed, 12 Dec 2018 20:21:51 +0000 (15:21 -0500)]
14360: Fix race between per-container lock and garbage collection.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '11419-text-mode'
Tom Clegg [Mon, 10 Dec 2018 21:18:35 +0000 (16:18 -0500)]
Merge branch '11419-text-mode'

closes #11419

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14012: Enhance test coverage on _cached_manifest_valid() method
Lucas Di Pentima [Mon, 10 Dec 2018 20:55:58 +0000 (17:55 -0300)]
14012: Enhance test coverage on _cached_manifest_valid() method

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14012: Split cache file name generation for readability
Lucas Di Pentima [Mon, 10 Dec 2018 20:55:11 +0000 (17:55 -0300)]
14012: Split cache file name generation for readability

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14594-update-cwltool' refs #14594
Peter Amstutz [Mon, 10 Dec 2018 19:06:34 +0000 (14:06 -0500)]
Merge branch '14594-update-cwltool' refs #14594

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14538-async-write'
Tom Clegg [Mon, 10 Dec 2018 16:41:12 +0000 (11:41 -0500)]
Merge branch '14538-async-write'

fixes #14538

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14594: Update to latest cwltool
Peter Amstutz [Mon, 10 Dec 2018 16:40:13 +0000 (11:40 -0500)]
14594: Update to latest cwltool

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14538: Merge branch 'master' into 14538-async-write
Tom Clegg [Mon, 10 Dec 2018 16:38:35 +0000 (11:38 -0500)]
14538: Merge branch 'master' into 14538-async-write

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago11419: Merge branch 'master' into 11419-text-mode
Tom Clegg [Mon, 10 Dec 2018 16:37:40 +0000 (11:37 -0500)]
11419: Merge branch 'master' into 11419-text-mode

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Merge branch 'master' into 14360-dispatch-cloud
Tom Clegg [Mon, 10 Dec 2018 16:31:14 +0000 (11:31 -0500)]
14360: Merge branch 'master' into 14360-dispatch-cloud

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14476-cwl-missing-input' refs #14476
Peter Amstutz [Mon, 10 Dec 2018 16:25:38 +0000 (11:25 -0500)]
Merge branch '14476-cwl-missing-input' refs #14476

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14360: Kill containers whose priority drops to 0 while running.
Tom Clegg [Mon, 10 Dec 2018 16:21:05 +0000 (11:21 -0500)]
14360: Kill containers whose priority drops to 0 while running.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14476: Remove redundant falsey check
Peter Amstutz [Mon, 10 Dec 2018 16:20:41 +0000 (11:20 -0500)]
14476: Remove redundant falsey check

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14495: Add dispatchcloud.EstimateScratchSpace()
Peter Amstutz [Mon, 10 Dec 2018 16:12:28 +0000 (11:12 -0500)]
14495: Add dispatchcloud.EstimateScratchSpace()

Estimate size of Docker image based on collection size, and
incorporate that into disk space requirement.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14012: Fix test
Lucas Di Pentima [Mon, 10 Dec 2018 15:56:45 +0000 (12:56 -0300)]
14012: Fix test

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14360: Add missing argument to -kill flag.
Tom Clegg [Fri, 7 Dec 2018 22:03:15 +0000 (17:03 -0500)]
14360: Add missing argument to -kill flag.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Rename -detached -> -no-detach.
Tom Clegg [Fri, 7 Dec 2018 21:44:24 +0000 (16:44 -0500)]
14360: Rename -detached -> -no-detach.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14476: Add test that submitting with missing parameters correctly gets error.
Peter Amstutz [Fri, 7 Dec 2018 21:26:50 +0000 (16:26 -0500)]
14476: Add test that submitting with missing parameters correctly gets error.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14360: Disable management APIs if config has no ManagementToken.
Tom Clegg [Fri, 7 Dec 2018 21:20:28 +0000 (16:20 -0500)]
14360: Disable management APIs if config has no ManagementToken.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Rename Workers -> CountWorkers.
Tom Clegg [Fri, 7 Dec 2018 21:01:08 +0000 (16:01 -0500)]
14360: Rename Workers -> CountWorkers.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14476: Fix RunnerTemplate
Peter Amstutz [Fri, 7 Dec 2018 19:55:55 +0000 (14:55 -0500)]
14476: Fix RunnerTemplate

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14476: When creating a Runner, check input is valid before submitting
Peter Amstutz [Fri, 7 Dec 2018 19:15:28 +0000 (14:15 -0500)]
14476: When creating a Runner, check input is valid before submitting

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14593-acr-crunch1' refs #14593
Peter Amstutz [Fri, 7 Dec 2018 20:58:34 +0000 (15:58 -0500)]
Merge branch '14593-acr-crunch1' refs #14593

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14593: Fix typo.
Peter Amstutz [Fri, 7 Dec 2018 20:57:45 +0000 (15:57 -0500)]
14593: Fix typo.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14012: Rephrases error message.
Lucas Di Pentima [Fri, 7 Dec 2018 20:48:30 +0000 (17:48 -0300)]
14012: Rephrases error message.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14593: Add note about broken crunch1 to upgrade docs.
Peter Amstutz [Fri, 7 Dec 2018 20:43:16 +0000 (15:43 -0500)]
14593: Add note about broken crunch1 to upgrade docs.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14360: Merge branch 'master' into 14360-dispatch-cloud
Tom Clegg [Fri, 7 Dec 2018 20:25:39 +0000 (15:25 -0500)]
14360: Merge branch 'master' into 14360-dispatch-cloud

refs #14360

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Notify pool on worker shutdown.
Tom Clegg [Fri, 7 Dec 2018 20:24:52 +0000 (15:24 -0500)]
14360: Notify pool on worker shutdown.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14593: Fix a-c-r when running on the "jobs" API
Peter Amstutz [Fri, 7 Dec 2018 20:03:04 +0000 (15:03 -0500)]
14593: Fix a-c-r when running on the "jobs" API

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14360: Fix container UUID missing in proc info file.
Tom Clegg [Fri, 7 Dec 2018 19:55:36 +0000 (14:55 -0500)]
14360: Fix container UUID missing in proc info file.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Use nonblocking mode when checking for stale lock.
Tom Clegg [Fri, 7 Dec 2018 19:54:08 +0000 (14:54 -0500)]
14360: Use nonblocking mode when checking for stale lock.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoAdd a few upgrade notes for the 1.3.0 release.
Ward Vandewege [Mon, 3 Dec 2018 21:46:11 +0000 (16:46 -0500)]
Add a few upgrade notes for the 1.3.0 release.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoMerge branch '14574-expression-fix' refs #14574
Peter Amstutz [Thu, 6 Dec 2018 21:30:38 +0000 (16:30 -0500)]
Merge branch '14574-expression-fix' refs #14574

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14012: Do HEAD request on the oldest non-expired signature for cache validation
Lucas Di Pentima [Thu, 6 Dec 2018 17:57:48 +0000 (14:57 -0300)]
14012: Do HEAD request on the oldest non-expired signature for cache validation

* Re-added single file expiration check for re-uploads
* Added tests for all cases

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14584-runtime-user-reuse' refs #14584 1.3.0
Peter Amstutz [Wed, 5 Dec 2018 19:59:27 +0000 (14:59 -0500)]
Merge branch '14584-runtime-user-reuse' refs #14584

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14584: Remove runtime_user_uuid and runtime_auth_scopes checks for reuse.
Peter Amstutz [Wed, 5 Dec 2018 19:18:54 +0000 (14:18 -0500)]
14584: Remove runtime_user_uuid and runtime_auth_scopes checks for reuse.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14583-no-dcpdh' refs #14583
Peter Amstutz [Wed, 5 Dec 2018 18:16:33 +0000 (13:16 -0500)]
Merge branch '14583-no-dcpdh' refs #14583

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14583: Delete arv:dockerCollectionPDH from DockerRequirement in RunInSingleContainer
Peter Amstutz [Wed, 5 Dec 2018 16:42:43 +0000 (11:42 -0500)]
14583: Delete arv:dockerCollectionPDH from DockerRequirement in RunInSingleContainer

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14551-wb-login-as-token'
Lucas Di Pentima [Tue, 4 Dec 2018 20:51:13 +0000 (17:51 -0300)]
Merge branch '14551-wb-login-as-token'
Closes #14551

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14574-thread-count-1' refs #14574
Peter Amstutz [Tue, 4 Dec 2018 16:32:59 +0000 (11:32 -0500)]
Merge branch '14574-thread-count-1' refs #14574

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14576-query-perf' refs #14576
Peter Amstutz [Tue, 4 Dec 2018 16:32:49 +0000 (11:32 -0500)]
Merge branch '14576-query-perf' refs #14576

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14576: Use the 'in' test for user queries
Peter Amstutz [Tue, 4 Dec 2018 16:17:12 +0000 (11:17 -0500)]
14576: Use the 'in' test for user queries

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14576: Adjust query for admins that filters out trashed items
Peter Amstutz [Tue, 4 Dec 2018 15:43:01 +0000 (10:43 -0500)]
14576: Adjust query for admins that filters out trashed items

refs #14576

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14576: Adjust query for admins that filters out trashed items
Peter Amstutz [Tue, 4 Dec 2018 15:43:01 +0000 (10:43 -0500)]
14576: Adjust query for admins that filters out trashed items

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoFix docker push command in run-build-docker-jobs-image.sh
Ward Vandewege [Tue, 4 Dec 2018 13:58:36 +0000 (08:58 -0500)]
Fix docker push command in run-build-docker-jobs-image.sh

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14574: Ensure output callbacks take workflow lock
Peter Amstutz [Mon, 3 Dec 2018 22:34:34 +0000 (17:34 -0500)]
14574: Ensure output callbacks take workflow lock

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoIf a version tag is passed to run-build-docker-jobs-image.sh, actually use that
Ward Vandewege [Mon, 3 Dec 2018 21:29:24 +0000 (16:29 -0500)]
If a version tag is passed to run-build-docker-jobs-image.sh, actually use that
version of our codebase for the packages installed in the image.

run-build-docker-jobs-image.sh now also supports our ARVADOS_BUILDING_VERSION
and ARVADOS_BUILDING_ITERATION mechanism, so versions can be overridden that
way.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14574: Default --thread-count=1 until threading is more fully baked.
Peter Amstutz [Mon, 3 Dec 2018 21:23:28 +0000 (16:23 -0500)]
14574: Default --thread-count=1 until threading is more fully baked.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>