arvados.git
3 years ago17395: Add missing migration file
Peter Amstutz [Thu, 1 Jul 2021 19:37:20 +0000 (15:37 -0400)]
17395: Add missing migration file

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17395: Update docs for newer storage classes behavior.
Peter Amstutz [Thu, 1 Jul 2021 20:10:30 +0000 (16:10 -0400)]
17395: Update docs for newer storage classes behavior.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17395: Update documentation. Add an additional test.
Peter Amstutz [Wed, 30 Jun 2021 14:30:38 +0000 (10:30 -0400)]
17395: Update documentation.  Add an additional test.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17395: Add tests. Don't include storage classes in full text search
Peter Amstutz [Tue, 29 Jun 2021 20:10:47 +0000 (16:10 -0400)]
17395: Add tests.  Don't include storage classes in full text search

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17395: Add OutputStorageClasses support to crunch-run
Peter Amstutz [Tue, 29 Jun 2021 19:24:06 +0000 (15:24 -0400)]
17395: Add OutputStorageClasses support to crunch-run

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17395: Add output_storage_classes to container and container_request
Peter Amstutz [Mon, 28 Jun 2021 19:58:57 +0000 (15:58 -0400)]
17395: Add output_storage_classes to container and container_request

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '17829-remove-omniauth' refs #17829
Peter Amstutz [Mon, 28 Jun 2021 16:17:39 +0000 (12:17 -0400)]
Merge branch '17829-remove-omniauth' refs #17829

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17829: Fix test
Peter Amstutz [Thu, 24 Jun 2021 17:17:06 +0000 (13:17 -0400)]
17829: Fix test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17829: Fix test
Peter Amstutz [Thu, 24 Jun 2021 15:17:04 +0000 (11:17 -0400)]
17829: Fix test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '17833-arvput-cleaner-errors'
Lucas Di Pentima [Thu, 24 Jun 2021 14:58:11 +0000 (11:58 -0300)]
Merge branch '17833-arvput-cleaner-errors'
Closes #17833

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17829: Remove additional references to SSO and omniauth
Peter Amstutz [Thu, 24 Jun 2021 14:46:44 +0000 (10:46 -0400)]
17829: Remove additional references to SSO and omniauth

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17829: Remove more SSO-related configuration
Peter Amstutz [Wed, 23 Jun 2021 14:22:16 +0000 (10:22 -0400)]
17829: Remove more SSO-related configuration

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17829: Remove SSO from config, controller, and tests
Peter Amstutz [Wed, 23 Jun 2021 14:07:19 +0000 (10:07 -0400)]
17829: Remove SSO from config, controller, and tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17829: Fix test
Peter Amstutz [Tue, 22 Jun 2021 21:11:51 +0000 (17:11 -0400)]
17829: Fix test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17829: Update tests to use 'controller' provider
Peter Amstutz [Tue, 22 Jun 2021 20:49:32 +0000 (16:49 -0400)]
17829: Update tests to use 'controller' provider

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17829: Remove omniauth
Peter Amstutz [Tue, 22 Jun 2021 02:19:17 +0000 (22:19 -0400)]
17829: Remove omniauth

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '17828-remove-bootsnap' refs #17828
Peter Amstutz [Thu, 24 Jun 2021 14:07:23 +0000 (10:07 -0400)]
Merge branch '17828-remove-bootsnap' refs #17828

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '17812-provisioning-documentation-improvement'
Javier Bértoli [Wed, 23 Jun 2021 21:51:49 +0000 (18:51 -0300)]
Merge branch '17812-provisioning-documentation-improvement'

closes #17812

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17833: Catches KeepWriteError exceptions to avoid displaying stacktraces.
Lucas Di Pentima [Wed, 23 Jun 2021 21:01:14 +0000 (18:01 -0300)]
17833: Catches KeepWriteError exceptions to avoid displaying stacktraces.

Replication and storage classes errors now won't show the entire stacktrace.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17812: Organize and extend installation documentation
Javier Bértoli [Mon, 21 Jun 2021 21:02:54 +0000 (18:02 -0300)]
17812: Organize and extend installation documentation

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoMerge branch '17572-arvmount-storage-classes'
Lucas Di Pentima [Wed, 23 Jun 2021 19:13:56 +0000 (16:13 -0300)]
Merge branch '17572-arvmount-storage-classes'
Closes #17572

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoMerge branch '17389-keepproxy-storage-classes-confirmed'
Lucas Di Pentima [Wed, 23 Jun 2021 18:12:39 +0000 (15:12 -0300)]
Merge branch '17389-keepproxy-storage-classes-confirmed'
Closes #17389

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17389: Adds clarifying comment.
Lucas Di Pentima [Wed, 23 Jun 2021 18:11:23 +0000 (15:11 -0300)]
17389: Adds clarifying comment.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoMerge branch '17801-runtime-outdir' refs #17801
Peter Amstutz [Wed, 23 Jun 2021 14:11:48 +0000 (10:11 -0400)]
Merge branch '17801-runtime-outdir' refs #17801

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17828: Remove bootsnap, which just seems to cause trouble
Peter Amstutz [Tue, 22 Jun 2021 19:01:18 +0000 (15:01 -0400)]
17828: Remove bootsnap, which just seems to cause trouble

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '17333-cwl-check-project-uuid' refs #17333
Peter Amstutz [Tue, 22 Jun 2021 14:47:20 +0000 (10:47 -0400)]
Merge branch '17333-cwl-check-project-uuid' refs #17333

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17333: Add check for valid project uuid, with test
Peter Amstutz [Mon, 21 Jun 2021 20:12:12 +0000 (16:12 -0400)]
17333: Add check for valid project uuid, with test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17572: Merge branch 'master' into 17572-arvmount-storage-classes
Lucas Di Pentima [Mon, 21 Jun 2021 19:40:42 +0000 (16:40 -0300)]
17572: Merge branch 'master' into 17572-arvmount-storage-classes

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17572: Fixes failing test.
Lucas Di Pentima [Mon, 21 Jun 2021 19:39:40 +0000 (16:39 -0300)]
17572: Fixes failing test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17572: Adds tests.
Lucas Di Pentima [Mon, 21 Jun 2021 19:14:59 +0000 (16:14 -0300)]
17572: Adds tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17572: Adds support for storage classes on new collections.
Lucas Di Pentima [Fri, 11 Jun 2021 20:05:48 +0000 (17:05 -0300)]
17572: Adds support for storage classes on new collections.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17572: Adds documentation related to storage classes.
Lucas Di Pentima [Wed, 9 Jun 2021 22:02:40 +0000 (19:02 -0300)]
17572: Adds documentation related to storage classes.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17801: Handle glob capture of keep URI with a trailing slash
Peter Amstutz [Fri, 18 Jun 2021 21:29:05 +0000 (17:29 -0400)]
17801: Handle glob capture of keep URI with a trailing slash

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '17776-more-throttling'
Ward Vandewege [Fri, 18 Jun 2021 18:50:35 +0000 (14:50 -0400)]
Merge branch '17776-more-throttling'

closes #17776
closes #17777
closes #17783

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17776: Merge branch 'master' into 17776-more-throttling
Ward Vandewege [Fri, 18 Jun 2021 18:47:44 +0000 (14:47 -0400)]
17776: Merge branch 'master' into 17776-more-throttling

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17823-use-saltstack-formulas-nginx-formula'
Javier Bértoli [Fri, 18 Jun 2021 15:45:40 +0000 (12:45 -0300)]
Merge branch '17823-use-saltstack-formulas-nginx-formula'

closes #17823

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17823: change references back to saltstack-formulas' nginx formula
Javier Bértoli [Fri, 18 Jun 2021 15:34:14 +0000 (12:34 -0300)]
17823: change references back to saltstack-formulas' nginx formula

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17464: Fix auto-enable DebugLocksPanicMode.
Tom Clegg [Fri, 18 Jun 2021 15:28:08 +0000 (11:28 -0400)]
17464: Fix auto-enable DebugLocksPanicMode.

refs #17464

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17609-diagnostics-cmd'
Tom Clegg [Fri, 18 Jun 2021 14:58:36 +0000 (10:58 -0400)]
Merge branch '17609-diagnostics-cmd'

closes #17609

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17464: Add DebugLocksPanicMode and fix some missing locks.
Tom Clegg [Fri, 18 Jun 2021 14:11:27 +0000 (10:11 -0400)]
17464: Add DebugLocksPanicMode and fix some missing locks.

refs #17464

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17389: Adds X-Keep-Storage-Classes-Confirmed header to responses on success.
Lucas Di Pentima [Fri, 18 Jun 2021 11:50:07 +0000 (08:50 -0300)]
17389: Adds X-Keep-Storage-Classes-Confirmed header to responses on success.

Also, don't treat partial success (ie: replicas written > 0) as success to
let the client decide what to do, as this would require a GoSDK API change on
Put methods, or the use of a special new method just for keepproxy that
returns fulfilled storage classes information.
In the case of partial successes from the client point of view, the only
thing that a client can do is retry the request with the same keepproxy, and
that would render the same result.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoMerge branch '17800-arvput-no-follow-links'
Lucas Di Pentima [Fri, 18 Jun 2021 11:03:15 +0000 (08:03 -0300)]
Merge branch '17800-arvput-no-follow-links'
Closes #17800

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoMerge branch '17810-s3-escape-non-unreserved-chars'
Tom Clegg [Fri, 18 Jun 2021 02:59:00 +0000 (22:59 -0400)]
Merge branch '17810-s3-escape-non-unreserved-chars'

fixes #17810

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoThe bleeding edge branch in the arvados-formula repository is now called
Ward Vandewege [Thu, 17 Jun 2021 18:42:12 +0000 (14:42 -0400)]
The bleeding edge branch in the arvados-formula repository is now called
'main'.

refs #17817

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17803-config-key-case-warning'
Tom Clegg [Wed, 16 Jun 2021 13:45:00 +0000 (09:45 -0400)]
Merge branch '17803-config-key-case-warning'

fixes #17803

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17803: Note todo's.
Tom Clegg [Tue, 15 Jun 2021 22:31:08 +0000 (18:31 -0400)]
17803: Note todo's.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17803: Fix unnecessarily convoluted test case.
Tom Clegg [Tue, 15 Jun 2021 22:22:51 +0000 (18:22 -0400)]
17803: Fix unnecessarily convoluted test case.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17776: address review comments.
Ward Vandewege [Tue, 15 Jun 2021 19:40:59 +0000 (15:40 -0400)]
17776: address review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17810: Fix S3 signature verification.
Tom Clegg [Tue, 15 Jun 2021 18:57:59 +0000 (14:57 -0400)]
17810: Fix S3 signature verification.

All chars (other than "/") that are not unreserved must be
percent-encoded.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17800: Avoids saving a new empty collection.
Lucas Di Pentima [Mon, 14 Jun 2021 19:49:42 +0000 (16:49 -0300)]
17800: Avoids saving a new empty collection.

Sometimes the specified paths won't be eligible for uploading (ie: all are
symlinks and --no-follow-symlinks is used), in those cases arv-put just
prints a warning message and doesn't save anything to Keep/API.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17803: Ensure keys with mismatched case don't get used.
Tom Clegg [Mon, 14 Jun 2021 18:28:00 +0000 (14:28 -0400)]
17803: Ensure keys with mismatched case don't get used.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17800: Improves help message. Shows warnings when ignoring given paths.
Lucas Di Pentima [Mon, 14 Jun 2021 17:26:21 +0000 (14:26 -0300)]
17800: Improves help message. Shows warnings when ignoring given paths.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17800: Fixes bug.
Lucas Di Pentima [Mon, 14 Jun 2021 14:01:36 +0000 (11:01 -0300)]
17800: Fixes bug.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17800: Exposes bug on test.
Lucas Di Pentima [Mon, 14 Jun 2021 13:38:14 +0000 (10:38 -0300)]
17800: Exposes bug on test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17803: Warn when config keys are ignored due to case mismatch.
Tom Clegg [Sun, 13 Jun 2021 14:00:45 +0000 (10:00 -0400)]
17803: Warn when config keys are ignored due to case mismatch.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Make costanalyzer logging a bit less verbose.
Tom Clegg [Fri, 11 Jun 2021 14:18:19 +0000 (10:18 -0400)]
17609: Make costanalyzer logging a bit less verbose.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Merge branch 'master'
Tom Clegg [Fri, 11 Jun 2021 14:02:58 +0000 (10:02 -0400)]
17609: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17351-arvput-keepclient-storage-support'
Lucas Di Pentima [Thu, 10 Jun 2021 21:54:58 +0000 (18:54 -0300)]
Merge branch '17351-arvput-keepclient-storage-support'
Closes #17351

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17609: Remove extra newlines.
Tom Clegg [Thu, 10 Jun 2021 20:06:22 +0000 (16:06 -0400)]
17609: Remove extra newlines.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Remove duplicate NoPrefixFormatter.
Tom Clegg [Thu, 10 Jun 2021 19:57:44 +0000 (15:57 -0400)]
17609: Remove duplicate NoPrefixFormatter.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17774-fix-cancel-cr'
Tom Clegg [Thu, 10 Jun 2021 19:09:46 +0000 (15:09 -0400)]
Merge branch '17774-fix-cancel-cr'

fixes #17774

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17774: Add non-empty mounts to test fixtures.
Tom Clegg [Thu, 10 Jun 2021 18:46:38 +0000 (14:46 -0400)]
17774: Add non-empty mounts to test fixtures.

Confirmed wb1 integration tests fail if the recent fix (parent of this
commit) is backed out.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17799-rails-upgrade-5.2.6'
Lucas Di Pentima [Thu, 10 Jun 2021 15:06:53 +0000 (12:06 -0300)]
Merge branch '17799-rails-upgrade-5.2.6'
Closes #17799

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17774: Test runtime_constraints and scheduling_parameters, too.
Tom Clegg [Thu, 10 Jun 2021 15:05:03 +0000 (11:05 -0400)]
17774: Test runtime_constraints and scheduling_parameters, too.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17774: Ignore addition of zero/default values to mounts when frozen.
Tom Clegg [Thu, 10 Jun 2021 14:42:30 +0000 (10:42 -0400)]
17774: Ignore addition of zero/default values to mounts when frozen.

Avoids errors when a client reads the CR and includes the resulting
mounts field (to which controller will have added zero/default values)
in a subsequent update request.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17799: Upgrades API & Workbench rails to 5.2.6
Lucas Di Pentima [Wed, 9 Jun 2021 23:26:20 +0000 (20:26 -0300)]
17799: Upgrades API & Workbench rails to 5.2.6

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17776: Basic throttling for VcpuLimitExceeded, MaxSpotInstanceCountExceeded,
Ward Vandewege [Tue, 8 Jun 2021 21:37:13 +0000 (17:37 -0400)]
17776: Basic throttling for VcpuLimitExceeded, MaxSpotInstanceCountExceeded,
InsufficientInstanceCapacity.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17609: Tweak messages.
Tom Clegg [Tue, 8 Jun 2021 06:08:43 +0000 (02:08 -0400)]
17609: Tweak messages.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Behave better when project creation fails.
Tom Clegg [Tue, 8 Jun 2021 05:53:12 +0000 (01:53 -0400)]
17609: Behave better when project creation fails.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Improve output formatting.
Tom Clegg [Tue, 8 Jun 2021 05:45:55 +0000 (01:45 -0400)]
17609: Improve output formatting.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Add "run container" test.
Tom Clegg [Tue, 8 Jun 2021 05:45:40 +0000 (01:45 -0400)]
17609: Add "run container" test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Improve log text alignment.
Tom Clegg [Wed, 2 Jun 2021 19:23:56 +0000 (15:23 -0400)]
17609: Improve log text alignment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Use timeout on all http requests.
Tom Clegg [Wed, 2 Jun 2021 19:17:13 +0000 (15:17 -0400)]
17609: Use timeout on all http requests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Fix limit args to work with older API.
Tom Clegg [Wed, 2 Jun 2021 19:12:58 +0000 (15:12 -0400)]
17609: Fix limit args to work with older API.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Refactor tests to add some structure.
Tom Clegg [Tue, 1 Jun 2021 20:23:08 +0000 (16:23 -0400)]
17609: Refactor tests to add some structure.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Add webshell test.
Tom Clegg [Tue, 1 Jun 2021 15:28:54 +0000 (11:28 -0400)]
17609: Add webshell test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Add diagnostics command.
Tom Clegg [Mon, 31 May 2021 20:52:36 +0000 (16:52 -0400)]
17609: Add diagnostics command.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17717-costanalyzer-date-mode'
Ward Vandewege [Tue, 8 Jun 2021 14:52:47 +0000 (10:52 -0400)]
Merge branch '17717-costanalyzer-date-mode'

closes #17717

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17717: Merge branch 'master' into 17717-costanalyzer-date-mode
Ward Vandewege [Tue, 8 Jun 2021 14:49:38 +0000 (10:49 -0400)]
17717: Merge branch 'master' into 17717-costanalyzer-date-mode

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17717: more changes post review: remove unneeded debug print, switch
Ward Vandewege [Tue, 8 Jun 2021 14:47:31 +0000 (10:47 -0400)]
17717: more changes post review: remove unneeded debug print, switch
       Command to value receiver.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoRemove leftover dead link from the ToC in the 'Set up a shell node'
Ward Vandewege [Tue, 8 Jun 2021 12:55:53 +0000 (08:55 -0400)]
Remove leftover dead link from the ToC in the 'Set up a shell node'
page.

refs #16803

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17706-costanalyzer-uncommitted-container-requests'
Ward Vandewege [Tue, 8 Jun 2021 12:27:54 +0000 (08:27 -0400)]
Merge branch '17706-costanalyzer-uncommitted-container-requests'

closes #17706

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17706: Merge branch 'master' into 17706-costanalyzer-uncommitted-container-requests
Ward Vandewege [Tue, 8 Jun 2021 12:27:25 +0000 (08:27 -0400)]
17706: Merge branch 'master' into 17706-costanalyzer-uncommitted-container-requests

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17717: address further review comments: remove unused code and refactor
Ward Vandewege [Mon, 7 Jun 2021 22:00:46 +0000 (18:00 -0400)]
17717: address further review comments: remove unused code and refactor
       a bit.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17717: address review comments.
Ward Vandewege [Mon, 7 Jun 2021 18:01:10 +0000 (14:01 -0400)]
17717: address review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17465-pysdk-storage-classes-support'
Lucas Di Pentima [Mon, 7 Jun 2021 17:17:37 +0000 (14:17 -0300)]
Merge branch '17465-pysdk-storage-classes-support'
Closes #17465

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17351: Adds support for storage classes while writing blocks to Keep.
Lucas Di Pentima [Thu, 3 Jun 2021 00:23:24 +0000 (21:23 -0300)]
17351: Adds support for storage classes while writing blocks to Keep.

Also, enabled support for multiple storage classes. For some reason it was
limited to just one.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17465: Fixed tests and made the suite less noisy.
Lucas Di Pentima [Mon, 7 Jun 2021 14:02:22 +0000 (11:02 -0300)]
17465: Fixed tests and made the suite less noisy.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoTweak upgrading doc page to reflect the release of 2.2.0.
Ward Vandewege [Sat, 5 Jun 2021 12:12:06 +0000 (08:12 -0400)]
Tweak upgrading doc page to reflect the release of 2.2.0.

refs #17512

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17757-bootprobe-race'
Ward Vandewege [Fri, 4 Jun 2021 21:31:01 +0000 (17:31 -0400)]
Merge branch '17757-bootprobe-race'

closes #17757

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17757: Merge branch 'master' into 17757-bootprobe-race
Ward Vandewege [Fri, 4 Jun 2021 21:30:32 +0000 (17:30 -0400)]
17757: Merge branch 'master' into 17757-bootprobe-race

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17762: Add uuid-dev package
Peter Amstutz [Fri, 4 Jun 2021 19:29:05 +0000 (15:29 -0400)]
17762: Add uuid-dev package

refs #17762

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17757: On our compute node images, Docker should not start by default;
Ward Vandewege [Fri, 4 Jun 2021 15:22:47 +0000 (11:22 -0400)]
17757: On our compute node images, Docker should not start by default;
       ensure-encrypted-partitions.sh takes care of starting it.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17465: Don't repeat warnings when storage classes aren't supported.
Lucas Di Pentima [Thu, 3 Jun 2021 22:34:26 +0000 (19:34 -0300)]
17465: Don't repeat warnings when storage classes aren't supported.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoFix building of metapackages for Ubuntu 18.04 and Ubuntu 20.04.
Ward Vandewege [Thu, 3 Jun 2021 20:18:36 +0000 (16:18 -0400)]
Fix building of metapackages for Ubuntu 18.04 and Ubuntu 20.04.

refs #17498

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoTweak version-at-commit.sh for interim releases (X.Y.Z.A)
Peter Amstutz [Thu, 3 Jun 2021 16:03:02 +0000 (12:03 -0400)]
Tweak version-at-commit.sh for interim releases (X.Y.Z.A)

Assign correct intended dev version when there is a X.Y.Z.A tag (not
just X.Y.Z) in the history.

As of this writing we don't have tags like that in the arvados repo,
but we do have tags like that in the workbench2 repo, so this commit
is just about synchronizing the script for consistency between the two
repos.

refs #17512

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoRemove duplicate rm.
Tom Clegg [Thu, 3 Jun 2021 13:41:50 +0000 (09:41 -0400)]
Remove duplicate rm.

Fixes #17752

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMake our arvados-api and arvados-workbench Gemfiles use the arvados
Ward Vandewege [Wed, 2 Jun 2021 21:28:41 +0000 (17:28 -0400)]
Make our arvados-api and arvados-workbench Gemfiles use the arvados
2.1.5 gem.

refs #17738

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17465: Collection.save() adds storage_classes_desired when set on instance.
Lucas Di Pentima [Wed, 2 Jun 2021 20:24:29 +0000 (17:24 -0300)]
17465: Collection.save() adds storage_classes_desired when set on instance.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17465: Synchronizes storage classes data between Collection & BlockManager.
Lucas Di Pentima [Wed, 2 Jun 2021 19:54:39 +0000 (16:54 -0300)]
17465: Synchronizes storage classes data between Collection & BlockManager.

Storage classes can be set at Collection instantiation time, and BlockManager
used to get that data when being instantiated by Collection, but desired
storage classes can change in the middle of a Collection instance lifetime,
and new blocks should get written on the correct classes, so the solution is
to pass a function for BlockManager to be able to query its parent Collection
instance settings at any time.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>