arvados.git
4 years agoMerge branch '15713-controller-error-log'
Tom Clegg [Thu, 24 Oct 2019 21:07:59 +0000 (17:07 -0400)]
Merge branch '15713-controller-error-log'

fixes #15713

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '15497-reuse-fix'
Lucas Di Pentima [Thu, 24 Oct 2019 20:51:05 +0000 (17:51 -0300)]
Merge branch '15497-reuse-fix'
Closes #15497

4 years ago15497: Adds issue # to comment.
Lucas Di Pentima [Thu, 24 Oct 2019 20:50:16 +0000 (17:50 -0300)]
15497: Adds issue # to comment.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15713: Log status sent to client if WriteHeader() is called >1x.
Tom Clegg [Thu, 24 Oct 2019 20:16:07 +0000 (16:16 -0400)]
15713: Log status sent to client if WriteHeader() is called >1x.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '15713-controller-error-log'
Tom Clegg [Thu, 24 Oct 2019 19:31:02 +0000 (15:31 -0400)]
Merge branch '15713-controller-error-log'

refs #15713

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15713: Don't sniff non-error response body.
Tom Clegg [Thu, 24 Oct 2019 19:30:13 +0000 (15:30 -0400)]
15713: Don't sniff non-error response body.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '15734-dispatchcloud-node-info'
Tom Clegg [Thu, 24 Oct 2019 18:22:04 +0000 (14:22 -0400)]
Merge branch '15734-dispatchcloud-node-info'

fixes #15734

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15734: Reword crunch-run compatibility comment.
Tom Clegg [Thu, 24 Oct 2019 18:21:18 +0000 (14:21 -0400)]
15734: Reword crunch-run compatibility comment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch 'MajewskiKrzysztof/master' refs #15740
Peter Amstutz [Thu, 24 Oct 2019 15:25:04 +0000 (11:25 -0400)]
Merge branch 'MajewskiKrzysztof/master' refs #15740

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15497: Don't reuse runner containers.
Lucas Di Pentima [Thu, 24 Oct 2019 15:09:28 +0000 (12:09 -0300)]
15497: Don't reuse runner containers.

When using a-c-r with --submit, never reuse the runner container so that
a potential reuse=false hint on a workflow step can be honored.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15497: Fixes tests to confirm that runner containers don't get reused.
Lucas Di Pentima [Thu, 24 Oct 2019 15:07:59 +0000 (12:07 -0300)]
15497: Fixes tests to confirm that runner containers don't get reused.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15713: Include 1K of response body when logging error responses.
Tom Clegg [Wed, 23 Oct 2019 19:57:12 +0000 (15:57 -0400)]
15713: Include 1K of response body when logging error responses.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch 'master' of https://github.com/MajewskiKrzysztof/arvados
Krzysztof Majewski [Wed, 23 Oct 2019 16:45:35 +0000 (18:45 +0200)]
Merge branch 'master' of https://github.com/MajewskiKrzysztof/arvados
Arvados-DCO-1.1-Signed-off-by: Krzysztof Majewski
<majewski.kielce@gmail.com>

4 years agoMerge branch 'master' of https://github.com/MajewskiKrzysztof/arvados
Krzysztof Majewski [Wed, 23 Oct 2019 16:41:32 +0000 (18:41 +0200)]
Merge branch 'master' of https://github.com/MajewskiKrzysztof/arvados

4 years agoMerge branch 'master' of https://github.com/MajewskiKrzysztof/arvados
Krzysztof Majewski [Wed, 23 Oct 2019 16:41:32 +0000 (18:41 +0200)]
Merge branch 'master' of https://github.com/MajewskiKrzysztof/arvados

4 years agoNumberFormatException fix
Krzysztof Majewski [Tue, 22 Oct 2019 09:08:19 +0000 (11:08 +0200)]
NumberFormatException fix

4 years agoMerge branch '15652-crunch-run-memory-use'
Tom Clegg [Tue, 22 Oct 2019 20:09:02 +0000 (16:09 -0400)]
Merge branch '15652-crunch-run-memory-use'

refs #15652

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15652: Eliminate a malloc when writing a one-segment block.
Tom Clegg [Tue, 22 Oct 2019 19:31:12 +0000 (15:31 -0400)]
15652: Eliminate a malloc when writing a one-segment block.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15652: Add concurrency/memory test. Fix missing node lock in Flush.
Tom Clegg [Tue, 22 Oct 2019 19:30:58 +0000 (15:30 -0400)]
15652: Add concurrency/memory test. Fix missing node lock in Flush.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15652: Fix Release() called prematurely before PutB returns.
Tom Clegg [Tue, 22 Oct 2019 17:44:00 +0000 (13:44 -0400)]
15652: Fix Release() called prematurely before PutB returns.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15652: Use BLOCKSIZE const.
Tom Clegg [Tue, 22 Oct 2019 15:41:51 +0000 (11:41 -0400)]
15652: Use BLOCKSIZE const.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15652: Limit concurrent writes per filesystem, not per flush.
Tom Clegg [Tue, 22 Oct 2019 15:04:49 +0000 (11:04 -0400)]
15652: Limit concurrent writes per filesystem, not per flush.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15734: Save dispatcher's InstanceType record in container log.
Tom Clegg [Tue, 22 Oct 2019 13:40:11 +0000 (09:40 -0400)]
15734: Save dispatcher's InstanceType record in container log.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoNumberFormatException fix
Krzysztof Majewski [Tue, 22 Oct 2019 09:08:19 +0000 (11:08 +0200)]
NumberFormatException fix

4 years agoNumberFormatException fix
Krzysztof Majewski [Tue, 22 Oct 2019 09:06:39 +0000 (11:06 +0200)]
NumberFormatException fix

4 years agoMerge branch '15699-update-gem'
Tom Clegg [Mon, 21 Oct 2019 20:59:58 +0000 (16:59 -0400)]
Merge branch '15699-update-gem'

refs #15699

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15699: Avoid latest signet gem, to stay compatible with ruby 2.3.
Tom Clegg [Mon, 21 Oct 2019 20:17:10 +0000 (16:17 -0400)]
15699: Avoid latest signet gem, to stay compatible with ruby 2.3.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '15707-dispatch-onhold-metrics'
Tom Clegg [Mon, 21 Oct 2019 19:41:38 +0000 (15:41 -0400)]
Merge branch '15707-dispatch-onhold-metrics'

fixes #15707

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '15680-arv-put-retry'
Tom Clegg [Mon, 21 Oct 2019 15:42:39 +0000 (11:42 -0400)]
Merge branch '15680-arv-put-retry'

fixes #15680

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15707: Forget about queued containers with priority=0.
Tom Clegg [Mon, 21 Oct 2019 15:41:23 +0000 (11:41 -0400)]
15707: Forget about queued containers with priority=0.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '15699-update-gem'
Tom Clegg [Mon, 21 Oct 2019 14:38:48 +0000 (10:38 -0400)]
Merge branch '15699-update-gem'

refs #15699

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '15716-api-keepservice-list-fix'
Lucas Di Pentima [Mon, 21 Oct 2019 14:28:15 +0000 (11:28 -0300)]
Merge branch '15716-api-keepservice-list-fix'
Closes #15716

4 years agoFix keepclient service discovery race.
Tom Clegg [Mon, 21 Oct 2019 14:04:57 +0000 (10:04 -0400)]
Fix keepclient service discovery race.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15699: Update apiserver and workbench bundles to latest arvados gem.
Tom Clegg [Sat, 19 Oct 2019 02:56:11 +0000 (22:56 -0400)]
15699: Update apiserver and workbench bundles to latest arvados gem.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15699: Fix fencepost error at end of stream.
Tom Clegg [Sat, 19 Oct 2019 02:53:25 +0000 (22:53 -0400)]
15699: Fix fencepost error at end of stream.

refs #15699

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15716: Merge branch 'master' into 15716-api-keepservice-list-fix
Lucas Di Pentima [Fri, 18 Oct 2019 22:04:08 +0000 (19:04 -0300)]
15716: Merge branch 'master' into 15716-api-keepservice-list-fix

4 years ago15716: Fix tests by importing CurrentApiClient module on missing places
Lucas Di Pentima [Fri, 18 Oct 2019 22:01:54 +0000 (19:01 -0300)]
15716: Fix tests by importing CurrentApiClient module on missing places

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15716: Don't include modules on .rake files
Lucas Di Pentima [Fri, 18 Oct 2019 21:44:49 +0000 (18:44 -0300)]
15716: Don't include modules on .rake files

The file symbols.rake used to include CurrentApiClient, making its methods
available to the entire app as Object class methods.
This made several tests to pass successfully while the code they exercised
really fail on production and development environments.

The solution is to make a helper class that works as a namespace of those
methods.

This commit exposes 41 failing tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15680: Update mockkeep.put to accept num_retries arg.
Tom Clegg [Fri, 18 Oct 2019 18:47:36 +0000 (14:47 -0400)]
15680: Update mockkeep.put to accept num_retries arg.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15680: Log # attempts on failure.
Tom Clegg [Fri, 18 Oct 2019 18:20:18 +0000 (14:20 -0400)]
15680: Log # attempts on failure.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15680: Pass arv-put --retries arg to Collection and BlockManager.
Tom Clegg [Thu, 17 Oct 2019 19:39:24 +0000 (15:39 -0400)]
15680: Pass arv-put --retries arg to Collection and BlockManager.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '15429-wb1-use-trigram-search'
Lucas Di Pentima [Thu, 17 Oct 2019 17:41:14 +0000 (14:41 -0300)]
Merge branch '15429-wb1-use-trigram-search'
Closes #15429

4 years ago15699: Update arvados-cli to latest arvados gem.
Tom Clegg [Thu, 17 Oct 2019 14:57:11 +0000 (10:57 -0400)]
15699: Update arvados-cli to latest arvados gem.

refs #15699

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15429: Escapes the underscore char so it can be used as a literal.
Lucas Di Pentima [Thu, 17 Oct 2019 14:09:22 +0000 (11:09 -0300)]
15429: Escapes the underscore char so it can be used as a literal.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15652: Only flush the current dir, and only once per 64 MiB.
Tom Clegg [Thu, 17 Oct 2019 14:01:47 +0000 (10:01 -0400)]
15652: Only flush the current dir, and only once per 64 MiB.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15429: Renames ilike_filters function & file. Fixes comments, tidies up code.
Lucas Di Pentima [Wed, 16 Oct 2019 18:03:01 +0000 (15:03 -0300)]
15429: Renames ilike_filters function & file. Fixes comments, tidies up code.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15652: Fix shadowed variable.
Tom Clegg [Wed, 16 Oct 2019 15:58:52 +0000 (11:58 -0400)]
15652: Fix shadowed variable.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15652: Fix wrong block offset in async case.
Tom Clegg [Wed, 16 Oct 2019 15:55:37 +0000 (11:55 -0400)]
15652: Fix wrong block offset in async case.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15429: Removes unused to_tsquery()
Lucas Di Pentima [Tue, 15 Oct 2019 21:19:55 +0000 (18:19 -0300)]
15429: Removes unused to_tsquery()

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15429: Changes full text searching on wb1 utilizing new trigram indexes.
Lucas Di Pentima [Tue, 15 Oct 2019 20:18:27 +0000 (17:18 -0300)]
15429: Changes full text searching on wb1 utilizing new trigram indexes.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years agoMerge branch '15699-workbench-copy-fail'
Tom Clegg [Tue, 15 Oct 2019 19:21:55 +0000 (15:21 -0400)]
Merge branch '15699-workbench-copy-fail'

refs #15699

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15699: Remove unused variables.
Tom Clegg [Tue, 15 Oct 2019 19:20:23 +0000 (15:20 -0400)]
15699: Remove unused variables.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '15717-svc-select-port' refs #15717
Peter Amstutz [Tue, 15 Oct 2019 18:53:37 +0000 (14:53 -0400)]
Merge branch '15717-svc-select-port' refs #15717

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '15721-config-cors'
Tom Clegg [Tue, 15 Oct 2019 18:46:50 +0000 (14:46 -0400)]
Merge branch '15721-config-cors'

fixes #15721

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15652: Add collectionfs Flush() method to control memory use.
Tom Clegg [Tue, 15 Oct 2019 15:51:25 +0000 (11:51 -0400)]
15652: Add collectionfs Flush() method to control memory use.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15717: If there are several InternalURLs for the same host, try them all
Peter Amstutz [Tue, 15 Oct 2019 15:37:24 +0000 (11:37 -0400)]
15717: If there are several InternalURLs for the same host, try them all

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15721: Fix 503 on API.MaxConcurrentRequests==0 and empty response.
Tom Clegg [Tue, 15 Oct 2019 14:24:02 +0000 (10:24 -0400)]
15721: Fix 503 on API.MaxConcurrentRequests==0 and empty response.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '15424-wb2-welcome-page' refs #15424
Peter Amstutz [Fri, 11 Oct 2019 18:57:31 +0000 (14:57 -0400)]
Merge branch '15424-wb2-welcome-page' refs #15424

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '15694-cwl-hang' closes #15694
Peter Amstutz [Fri, 11 Oct 2019 18:54:44 +0000 (14:54 -0400)]
Merge branch '15694-cwl-hang' closes #15694

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15424: Tweak default WelcomePageHTML
Peter Amstutz [Fri, 11 Oct 2019 18:48:39 +0000 (14:48 -0400)]
15424: Tweak default WelcomePageHTML

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15694: Improve test comments/assertions
Peter Amstutz [Fri, 11 Oct 2019 17:16:23 +0000 (13:16 -0400)]
15694: Improve test comments/assertions

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '15531-logincluster-migrate' refs #15531
Peter Amstutz [Fri, 11 Oct 2019 15:04:42 +0000 (11:04 -0400)]
Merge branch '15531-logincluster-migrate' refs #15531

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15699: Fix handling of streams with multiple refs to a block ID.
Tom Clegg [Fri, 11 Oct 2019 05:11:45 +0000 (01:11 -0400)]
15699: Fix handling of streams with multiple refs to a block ID.

The manifest normalization code in the Ruby SDK (and therefore
Workbench) was based on an incorrect assumption that each block
locator could only appear once in a given stream.

If a manifest referenced the same block more than once, copying a file
from that manifest into a new one would produce a new file with the
correct size, but wrong data.

The new code uses a different strategy that deduplicates block
references in common cases, although not in all possible cases.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15531: Don't activate new user if old user is not active
Peter Amstutz [Thu, 10 Oct 2019 21:55:32 +0000 (17:55 -0400)]
15531: Don't activate new user if old user is not active

Fix Python 2.7

Fix check.py

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoAdd the GOGC=10 environment variable to the Keepstore service file, to make
Ward Vandewege [Thu, 10 Oct 2019 16:47:38 +0000 (12:47 -0400)]
Add the GOGC=10 environment variable to the Keepstore service file, to make
Keepstore memory use tightly coupled to the number of buffers it is
configured to use.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years ago15424: Add WelcomePageHTML to config, with default text
Peter Amstutz [Thu, 10 Oct 2019 15:10:06 +0000 (11:10 -0400)]
15424: Add WelcomePageHTML to config, with default text

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoFix wrong subcommand name.
Tom Clegg [Thu, 10 Oct 2019 13:56:46 +0000 (09:56 -0400)]
Fix wrong subcommand name.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoFix typo.
Tom Clegg [Thu, 10 Oct 2019 13:51:38 +0000 (09:51 -0400)]
Fix typo.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15694: Add test
Peter Amstutz [Wed, 9 Oct 2019 18:56:45 +0000 (14:56 -0400)]
15694: Add test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15694: Catch exception from get_current_container in runtime_status_update
Peter Amstutz [Wed, 9 Oct 2019 18:10:11 +0000 (14:10 -0400)]
15694: Catch exception from get_current_container in runtime_status_update

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '15655-logtail-encoding'
Eric Biagiotti [Wed, 9 Oct 2019 13:31:06 +0000 (09:31 -0400)]
Merge branch '15655-logtail-encoding'

refs #15655

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

4 years ago15655: Fixes logtail encoding
Eric Biagiotti [Wed, 9 Oct 2019 12:40:30 +0000 (08:40 -0400)]
15655: Fixes logtail encoding

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

4 years ago15531: Fix file ownership after git pull as root
Peter Amstutz [Tue, 8 Oct 2019 20:41:22 +0000 (16:41 -0400)]
15531: Fix file ownership after git pull as root

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15531: Moved federation section in admin guide
Peter Amstutz [Tue, 8 Oct 2019 19:22:04 +0000 (15:22 -0400)]
15531: Moved federation section in admin guide

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch 'master' into 15531-logincluster-migrate
Peter Amstutz [Tue, 8 Oct 2019 19:21:32 +0000 (15:21 -0400)]
Merge branch 'master' into 15531-logincluster-migrate

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15531: Fixing up test framework
Peter Amstutz [Tue, 8 Oct 2019 19:16:47 +0000 (15:16 -0400)]
15531: Fixing up test framework

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoarvbox update config.yml when config override is updated refs #15531
Peter Amstutz [Tue, 8 Oct 2019 19:05:54 +0000 (15:05 -0400)]
arvbox update config.yml when config override is updated refs #15531

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15531: Documentation updates
Peter Amstutz [Fri, 4 Oct 2019 19:03:37 +0000 (15:03 -0400)]
15531: Documentation updates

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '15640-cwl-min-ram' refs #15640
Peter Amstutz [Fri, 4 Oct 2019 15:37:03 +0000 (11:37 -0400)]
Merge branch '15640-cwl-min-ram' refs #15640

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15640: RunInSingleContainer needs minimum of 128 MiB RAM
Peter Amstutz [Fri, 4 Oct 2019 14:23:00 +0000 (10:23 -0400)]
15640: RunInSingleContainer needs minimum of 128 MiB RAM

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '15684-package-deps' refs #15684
Peter Amstutz [Thu, 3 Oct 2019 22:01:46 +0000 (18:01 -0400)]
Merge branch '15684-package-deps' refs #15684

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15684: Fix arvados-api-server and arvados-workbench packaging
Peter Amstutz [Thu, 3 Oct 2019 21:57:25 +0000 (17:57 -0400)]
15684: Fix arvados-api-server and arvados-workbench packaging

- Fix test_package_presence to use correct URL to download prebuilt dev debs
- Dev package version of api is now latest(api, arvados-server)
- Dev package version of workbench is now latest(workbench, arvados-server)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '14714-keep-balance-config'
Eric Biagiotti [Thu, 3 Oct 2019 19:33:59 +0000 (15:33 -0400)]
Merge branch '14714-keep-balance-config'

refs #14714

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

4 years ago14714: Corrects keepstore service distinction in the upgrade notes
Eric Biagiotti [Thu, 3 Oct 2019 19:33:14 +0000 (15:33 -0400)]
14714: Corrects keepstore service distinction in the upgrade notes

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

4 years ago14714: Improves error message when using the legacy keep-balance config
Eric Biagiotti [Thu, 3 Oct 2019 18:45:47 +0000 (14:45 -0400)]
14714: Improves error message when using the legacy keep-balance config

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

4 years agoMerge branch '15014-wrong-node-count'
Tom Clegg [Thu, 3 Oct 2019 15:44:22 +0000 (11:44 -0400)]
Merge branch '15014-wrong-node-count'

fixes #15014

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '11016-doc-signing-ttl'
Tom Clegg [Thu, 3 Oct 2019 15:39:18 +0000 (11:39 -0400)]
Merge branch '11016-doc-signing-ttl'

refs #11016

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '14714-keep-balance-config'
Eric Biagiotti [Thu, 3 Oct 2019 15:09:39 +0000 (11:09 -0400)]
Merge branch '14714-keep-balance-config'

refs #14714

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

4 years agoMerge branch '15654-wb-gem-update' refs #15654
Peter Amstutz [Thu, 3 Oct 2019 14:48:19 +0000 (10:48 -0400)]
Merge branch '15654-wb-gem-update' refs #15654

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15654: Update rubyzip gem
Peter Amstutz [Wed, 2 Oct 2019 20:27:40 +0000 (16:27 -0400)]
15654: Update rubyzip gem

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15654: Update nokogiri
Peter Amstutz [Mon, 30 Sep 2019 19:46:22 +0000 (15:46 -0400)]
15654: Update nokogiri

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '15678-pkg-version'
Tom Clegg [Wed, 2 Oct 2019 17:09:42 +0000 (13:09 -0400)]
Merge branch '15678-pkg-version'

closes #15678

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '15599-keepstore-iam-role'
Tom Clegg [Wed, 2 Oct 2019 15:48:55 +0000 (11:48 -0400)]
Merge branch '15599-keepstore-iam-role'

closes #15599

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '15640-cwl-test-mem' refs #15640
Peter Amstutz [Tue, 1 Oct 2019 20:30:52 +0000 (16:30 -0400)]
Merge branch '15640-cwl-test-mem' refs #15640

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago14714: Removes metrics serving
Eric Biagiotti [Tue, 1 Oct 2019 20:23:38 +0000 (16:23 -0400)]
14714: Removes metrics serving

- Updates test gathering of metrics
- Simplifies balancer keep service discovery
- Moves keep-balance info from keepstore install docs to the new admin page
- Keepbalance now exits correctly when using -once

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

4 years agoarvbox pin yarn to 1.17.3 no issue #
Peter Amstutz [Tue, 1 Oct 2019 19:22:58 +0000 (15:22 -0400)]
arvbox pin yarn to 1.17.3 no issue #

Work around for "Incorrect integrity when fetching from the cache"

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15599: Reject configuration with both IAMRole and Access/SecretKey.
Tom Clegg [Tue, 1 Oct 2019 18:52:03 +0000 (14:52 -0400)]
15599: Reject configuration with both IAMRole and Access/SecretKey.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15599: Use default/automatic credentials for example config.
Tom Clegg [Tue, 1 Oct 2019 18:47:25 +0000 (14:47 -0400)]
15599: Use default/automatic credentials for example config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoUpdate workbench bundle.
Tom Clegg [Tue, 1 Oct 2019 18:38:21 +0000 (14:38 -0400)]
Update workbench bundle.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15678: Fix version reporting.
Tom Clegg [Tue, 1 Oct 2019 17:46:14 +0000 (13:46 -0400)]
15678: Fix version reporting.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>