arvados.git
3 years ago17833: Catches KeepWriteError exceptions to avoid displaying stacktraces.
Lucas Di Pentima [Wed, 23 Jun 2021 21:01:14 +0000 (18:01 -0300)]
17833: Catches KeepWriteError exceptions to avoid displaying stacktraces.

Replication and storage classes errors now won't show the entire stacktrace.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17812: Organize and extend installation documentation
Javier Bértoli [Mon, 21 Jun 2021 21:02:54 +0000 (18:02 -0300)]
17812: Organize and extend installation documentation

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoMerge branch '17572-arvmount-storage-classes'
Lucas Di Pentima [Wed, 23 Jun 2021 19:13:56 +0000 (16:13 -0300)]
Merge branch '17572-arvmount-storage-classes'
Closes #17572

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoMerge branch '17389-keepproxy-storage-classes-confirmed'
Lucas Di Pentima [Wed, 23 Jun 2021 18:12:39 +0000 (15:12 -0300)]
Merge branch '17389-keepproxy-storage-classes-confirmed'
Closes #17389

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17389: Adds clarifying comment.
Lucas Di Pentima [Wed, 23 Jun 2021 18:11:23 +0000 (15:11 -0300)]
17389: Adds clarifying comment.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoMerge branch '17801-runtime-outdir' refs #17801
Peter Amstutz [Wed, 23 Jun 2021 14:11:48 +0000 (10:11 -0400)]
Merge branch '17801-runtime-outdir' refs #17801

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17828: Remove bootsnap, which just seems to cause trouble
Peter Amstutz [Tue, 22 Jun 2021 19:01:18 +0000 (15:01 -0400)]
17828: Remove bootsnap, which just seems to cause trouble

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '17333-cwl-check-project-uuid' refs #17333
Peter Amstutz [Tue, 22 Jun 2021 14:47:20 +0000 (10:47 -0400)]
Merge branch '17333-cwl-check-project-uuid' refs #17333

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17333: Add check for valid project uuid, with test
Peter Amstutz [Mon, 21 Jun 2021 20:12:12 +0000 (16:12 -0400)]
17333: Add check for valid project uuid, with test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17572: Merge branch 'master' into 17572-arvmount-storage-classes
Lucas Di Pentima [Mon, 21 Jun 2021 19:40:42 +0000 (16:40 -0300)]
17572: Merge branch 'master' into 17572-arvmount-storage-classes

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17572: Fixes failing test.
Lucas Di Pentima [Mon, 21 Jun 2021 19:39:40 +0000 (16:39 -0300)]
17572: Fixes failing test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17572: Adds tests.
Lucas Di Pentima [Mon, 21 Jun 2021 19:14:59 +0000 (16:14 -0300)]
17572: Adds tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17464: MakeRESTRouter returns erro instead of panicking
Peter Amstutz [Mon, 21 Jun 2021 15:25:29 +0000 (11:25 -0400)]
17464: MakeRESTRouter returns erro instead of panicking

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17572: Adds support for storage classes on new collections.
Lucas Di Pentima [Fri, 11 Jun 2021 20:05:48 +0000 (17:05 -0300)]
17572: Adds support for storage classes on new collections.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17572: Adds documentation related to storage classes.
Lucas Di Pentima [Wed, 9 Jun 2021 22:02:40 +0000 (19:02 -0300)]
17572: Adds documentation related to storage classes.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17801: Handle glob capture of keep URI with a trailing slash
Peter Amstutz [Fri, 18 Jun 2021 21:29:05 +0000 (17:29 -0400)]
17801: Handle glob capture of keep URI with a trailing slash

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: keep-web handles cases where user is unknown
Peter Amstutz [Fri, 18 Jun 2021 19:58:03 +0000 (15:58 -0400)]
17464: keep-web handles cases where user is unknown

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Unknown user gets "User" permission check instead of failure
Peter Amstutz [Fri, 18 Jun 2021 19:43:26 +0000 (15:43 -0400)]
17464: Unknown user gets "User" permission check instead of failure

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '17776-more-throttling'
Ward Vandewege [Fri, 18 Jun 2021 18:50:35 +0000 (14:50 -0400)]
Merge branch '17776-more-throttling'

closes #17776
closes #17777
closes #17783

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17776: Merge branch 'master' into 17776-more-throttling
Ward Vandewege [Fri, 18 Jun 2021 18:47:44 +0000 (14:47 -0400)]
17776: Merge branch 'master' into 17776-more-throttling

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17464: Fix typo in exported config
Peter Amstutz [Fri, 18 Jun 2021 17:07:39 +0000 (13:07 -0400)]
17464: Fix typo in exported config

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Add note about special case involving sharing links
Peter Amstutz [Fri, 18 Jun 2021 16:58:52 +0000 (12:58 -0400)]
17464: Add note about special case involving sharing links

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Update exported config
Peter Amstutz [Fri, 18 Jun 2021 16:50:52 +0000 (12:50 -0400)]
17464: Update exported config

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Replace cache with LRU cache
Peter Amstutz [Fri, 18 Jun 2021 16:35:38 +0000 (12:35 -0400)]
17464: Replace cache with LRU cache

Error out if API error from users.current

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '17823-use-saltstack-formulas-nginx-formula'
Javier Bértoli [Fri, 18 Jun 2021 15:45:40 +0000 (12:45 -0300)]
Merge branch '17823-use-saltstack-formulas-nginx-formula'

closes #17823

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17823: change references back to saltstack-formulas' nginx formula
Javier Bértoli [Fri, 18 Jun 2021 15:34:14 +0000 (12:34 -0300)]
17823: change references back to saltstack-formulas' nginx formula

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17464: Don't deny or log GET on directories.
Peter Amstutz [Thu, 17 Jun 2021 20:47:33 +0000 (16:47 -0400)]
17464: Don't deny or log GET on directories.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Add tests for paths by /users/ and by PDH
Peter Amstutz [Thu, 17 Jun 2021 19:49:04 +0000 (15:49 -0400)]
17464: Add tests for paths by /users/ and by PDH

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Clean up tests
Peter Amstutz [Thu, 17 Jun 2021 18:48:33 +0000 (14:48 -0400)]
17464: Clean up tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Update config variables & docs from feedback
Peter Amstutz [Thu, 17 Jun 2021 16:27:19 +0000 (12:27 -0400)]
17464: Update config variables & docs from feedback

Change KeepWebPermission -> WebDAVPermission

Add WebDAVLogEvents

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Activity report lists upload/download events
Peter Amstutz [Wed, 16 Jun 2021 21:22:04 +0000 (17:22 -0400)]
17464: Activity report lists upload/download events

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Fix test.
Peter Amstutz [Wed, 16 Jun 2021 20:06:36 +0000 (16:06 -0400)]
17464: Fix test.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Add upload/download logging and permissions to keepproxy
Peter Amstutz [Wed, 16 Jun 2021 20:03:48 +0000 (16:03 -0400)]
17464: Add upload/download logging and permissions to keepproxy

Add tests.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Refactor tests and check that log events are posted
Peter Amstutz [Tue, 15 Jun 2021 20:59:40 +0000 (16:59 -0400)]
17464: Refactor tests and check that log events are posted

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Reset database after upload tests
Peter Amstutz [Tue, 15 Jun 2021 18:54:16 +0000 (14:54 -0400)]
17464: Reset database after upload tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Permission/logging testing WIP
Peter Amstutz [Mon, 14 Jun 2021 21:30:59 +0000 (17:30 -0400)]
17464: Permission/logging testing WIP

The upload tests are messing up the other tests by changing the
contents of the collection, still need to fix it.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Fix shadowed "sess" variable
Peter Amstutz [Fri, 11 Jun 2021 21:19:36 +0000 (17:19 -0400)]
17464: Fix shadowed "sess" variable

Testing WIP

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Log collection uuid for FileSystem requests
Peter Amstutz [Fri, 11 Jun 2021 19:26:05 +0000 (15:26 -0400)]
17464: Log collection uuid for FileSystem requests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Add upload/download permission checks and logging
Peter Amstutz [Thu, 10 Jun 2021 20:50:56 +0000 (16:50 -0400)]
17464: Add upload/download permission checks and logging

Adds extra log line to normal logging that includes user uuid and full
name.

Also posts an event to the logs table.

Adds permission checks to but these haven't been tested yet.

Still need to add testing.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Fix config entry
Peter Amstutz [Mon, 7 Jun 2021 19:42:32 +0000 (15:42 -0400)]
17464: Fix config entry

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Start by writing the documentation page
Peter Amstutz [Mon, 7 Jun 2021 19:23:40 +0000 (15:23 -0400)]
17464: Start by writing the documentation page

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Fix auto-enable DebugLocksPanicMode.
Tom Clegg [Fri, 18 Jun 2021 15:28:08 +0000 (11:28 -0400)]
17464: Fix auto-enable DebugLocksPanicMode.

refs #17464

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17609-diagnostics-cmd'
Tom Clegg [Fri, 18 Jun 2021 14:58:36 +0000 (10:58 -0400)]
Merge branch '17609-diagnostics-cmd'

closes #17609

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17464: Add DebugLocksPanicMode and fix some missing locks.
Tom Clegg [Fri, 18 Jun 2021 14:11:27 +0000 (10:11 -0400)]
17464: Add DebugLocksPanicMode and fix some missing locks.

refs #17464

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17389: Adds X-Keep-Storage-Classes-Confirmed header to responses on success.
Lucas Di Pentima [Fri, 18 Jun 2021 11:50:07 +0000 (08:50 -0300)]
17389: Adds X-Keep-Storage-Classes-Confirmed header to responses on success.

Also, don't treat partial success (ie: replicas written > 0) as success to
let the client decide what to do, as this would require a GoSDK API change on
Put methods, or the use of a special new method just for keepproxy that
returns fulfilled storage classes information.
In the case of partial successes from the client point of view, the only
thing that a client can do is retry the request with the same keepproxy, and
that would render the same result.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoMerge branch '17800-arvput-no-follow-links'
Lucas Di Pentima [Fri, 18 Jun 2021 11:03:15 +0000 (08:03 -0300)]
Merge branch '17800-arvput-no-follow-links'
Closes #17800

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoMerge branch '17810-s3-escape-non-unreserved-chars'
Tom Clegg [Fri, 18 Jun 2021 02:59:00 +0000 (22:59 -0400)]
Merge branch '17810-s3-escape-non-unreserved-chars'

fixes #17810

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoThe bleeding edge branch in the arvados-formula repository is now called
Ward Vandewege [Thu, 17 Jun 2021 18:42:12 +0000 (14:42 -0400)]
The bleeding edge branch in the arvados-formula repository is now called
'main'.

refs #17817

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17803-config-key-case-warning'
Tom Clegg [Wed, 16 Jun 2021 13:45:00 +0000 (09:45 -0400)]
Merge branch '17803-config-key-case-warning'

fixes #17803

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17803: Note todo's.
Tom Clegg [Tue, 15 Jun 2021 22:31:08 +0000 (18:31 -0400)]
17803: Note todo's.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17803: Fix unnecessarily convoluted test case.
Tom Clegg [Tue, 15 Jun 2021 22:22:51 +0000 (18:22 -0400)]
17803: Fix unnecessarily convoluted test case.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17776: address review comments.
Ward Vandewege [Tue, 15 Jun 2021 19:40:59 +0000 (15:40 -0400)]
17776: address review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17810: Fix S3 signature verification.
Tom Clegg [Tue, 15 Jun 2021 18:57:59 +0000 (14:57 -0400)]
17810: Fix S3 signature verification.

All chars (other than "/") that are not unreserved must be
percent-encoded.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17800: Avoids saving a new empty collection.
Lucas Di Pentima [Mon, 14 Jun 2021 19:49:42 +0000 (16:49 -0300)]
17800: Avoids saving a new empty collection.

Sometimes the specified paths won't be eligible for uploading (ie: all are
symlinks and --no-follow-symlinks is used), in those cases arv-put just
prints a warning message and doesn't save anything to Keep/API.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17803: Ensure keys with mismatched case don't get used.
Tom Clegg [Mon, 14 Jun 2021 18:28:00 +0000 (14:28 -0400)]
17803: Ensure keys with mismatched case don't get used.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17800: Improves help message. Shows warnings when ignoring given paths.
Lucas Di Pentima [Mon, 14 Jun 2021 17:26:21 +0000 (14:26 -0300)]
17800: Improves help message. Shows warnings when ignoring given paths.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17800: Fixes bug.
Lucas Di Pentima [Mon, 14 Jun 2021 14:01:36 +0000 (11:01 -0300)]
17800: Fixes bug.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17800: Exposes bug on test.
Lucas Di Pentima [Mon, 14 Jun 2021 13:38:14 +0000 (10:38 -0300)]
17800: Exposes bug on test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17803: Warn when config keys are ignored due to case mismatch.
Tom Clegg [Sun, 13 Jun 2021 14:00:45 +0000 (10:00 -0400)]
17803: Warn when config keys are ignored due to case mismatch.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Make costanalyzer logging a bit less verbose.
Tom Clegg [Fri, 11 Jun 2021 14:18:19 +0000 (10:18 -0400)]
17609: Make costanalyzer logging a bit less verbose.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Merge branch 'master'
Tom Clegg [Fri, 11 Jun 2021 14:02:58 +0000 (10:02 -0400)]
17609: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17351-arvput-keepclient-storage-support'
Lucas Di Pentima [Thu, 10 Jun 2021 21:54:58 +0000 (18:54 -0300)]
Merge branch '17351-arvput-keepclient-storage-support'
Closes #17351

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17609: Remove extra newlines.
Tom Clegg [Thu, 10 Jun 2021 20:06:22 +0000 (16:06 -0400)]
17609: Remove extra newlines.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Remove duplicate NoPrefixFormatter.
Tom Clegg [Thu, 10 Jun 2021 19:57:44 +0000 (15:57 -0400)]
17609: Remove duplicate NoPrefixFormatter.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17774-fix-cancel-cr'
Tom Clegg [Thu, 10 Jun 2021 19:09:46 +0000 (15:09 -0400)]
Merge branch '17774-fix-cancel-cr'

fixes #17774

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17774: Add non-empty mounts to test fixtures.
Tom Clegg [Thu, 10 Jun 2021 18:46:38 +0000 (14:46 -0400)]
17774: Add non-empty mounts to test fixtures.

Confirmed wb1 integration tests fail if the recent fix (parent of this
commit) is backed out.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17799-rails-upgrade-5.2.6'
Lucas Di Pentima [Thu, 10 Jun 2021 15:06:53 +0000 (12:06 -0300)]
Merge branch '17799-rails-upgrade-5.2.6'
Closes #17799

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17774: Test runtime_constraints and scheduling_parameters, too.
Tom Clegg [Thu, 10 Jun 2021 15:05:03 +0000 (11:05 -0400)]
17774: Test runtime_constraints and scheduling_parameters, too.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17774: Ignore addition of zero/default values to mounts when frozen.
Tom Clegg [Thu, 10 Jun 2021 14:42:30 +0000 (10:42 -0400)]
17774: Ignore addition of zero/default values to mounts when frozen.

Avoids errors when a client reads the CR and includes the resulting
mounts field (to which controller will have added zero/default values)
in a subsequent update request.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17778: update docs.
Ward Vandewege [Wed, 9 Jun 2021 23:51:29 +0000 (19:51 -0400)]
17778: update docs.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17799: Upgrades API & Workbench rails to 5.2.6
Lucas Di Pentima [Wed, 9 Jun 2021 23:26:20 +0000 (20:26 -0300)]
17799: Upgrades API & Workbench rails to 5.2.6

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17705: Link install page to arch page.
Tom Clegg [Wed, 9 Jun 2021 13:10:37 +0000 (09:10 -0400)]
17705: Link install page to arch page.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17705: Mention IdleBehavior tag name.
Tom Clegg [Wed, 9 Jun 2021 13:06:45 +0000 (09:06 -0400)]
17705: Mention IdleBehavior tag name.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17705: Add dispatchcloud architecture page.
Tom Clegg [Wed, 9 Jun 2021 13:02:24 +0000 (09:02 -0400)]
17705: Add dispatchcloud architecture page.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17776: Basic throttling for VcpuLimitExceeded, MaxSpotInstanceCountExceeded,
Ward Vandewege [Tue, 8 Jun 2021 21:37:13 +0000 (17:37 -0400)]
17776: Basic throttling for VcpuLimitExceeded, MaxSpotInstanceCountExceeded,
InsufficientInstanceCapacity.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17609: Tweak messages.
Tom Clegg [Tue, 8 Jun 2021 06:08:43 +0000 (02:08 -0400)]
17609: Tweak messages.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Behave better when project creation fails.
Tom Clegg [Tue, 8 Jun 2021 05:53:12 +0000 (01:53 -0400)]
17609: Behave better when project creation fails.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Improve output formatting.
Tom Clegg [Tue, 8 Jun 2021 05:45:55 +0000 (01:45 -0400)]
17609: Improve output formatting.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Add "run container" test.
Tom Clegg [Tue, 8 Jun 2021 05:45:40 +0000 (01:45 -0400)]
17609: Add "run container" test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Improve log text alignment.
Tom Clegg [Wed, 2 Jun 2021 19:23:56 +0000 (15:23 -0400)]
17609: Improve log text alignment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Use timeout on all http requests.
Tom Clegg [Wed, 2 Jun 2021 19:17:13 +0000 (15:17 -0400)]
17609: Use timeout on all http requests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Fix limit args to work with older API.
Tom Clegg [Wed, 2 Jun 2021 19:12:58 +0000 (15:12 -0400)]
17609: Fix limit args to work with older API.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Refactor tests to add some structure.
Tom Clegg [Tue, 1 Jun 2021 20:23:08 +0000 (16:23 -0400)]
17609: Refactor tests to add some structure.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Add webshell test.
Tom Clegg [Tue, 1 Jun 2021 15:28:54 +0000 (11:28 -0400)]
17609: Add webshell test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17609: Add diagnostics command.
Tom Clegg [Mon, 31 May 2021 20:52:36 +0000 (16:52 -0400)]
17609: Add diagnostics command.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17717-costanalyzer-date-mode'
Ward Vandewege [Tue, 8 Jun 2021 14:52:47 +0000 (10:52 -0400)]
Merge branch '17717-costanalyzer-date-mode'

closes #17717

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17717: Merge branch 'master' into 17717-costanalyzer-date-mode
Ward Vandewege [Tue, 8 Jun 2021 14:49:38 +0000 (10:49 -0400)]
17717: Merge branch 'master' into 17717-costanalyzer-date-mode

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17717: more changes post review: remove unneeded debug print, switch
Ward Vandewege [Tue, 8 Jun 2021 14:47:31 +0000 (10:47 -0400)]
17717: more changes post review: remove unneeded debug print, switch
       Command to value receiver.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoRemove leftover dead link from the ToC in the 'Set up a shell node'
Ward Vandewege [Tue, 8 Jun 2021 12:55:53 +0000 (08:55 -0400)]
Remove leftover dead link from the ToC in the 'Set up a shell node'
page.

refs #16803

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17706-costanalyzer-uncommitted-container-requests'
Ward Vandewege [Tue, 8 Jun 2021 12:27:54 +0000 (08:27 -0400)]
Merge branch '17706-costanalyzer-uncommitted-container-requests'

closes #17706

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17706: Merge branch 'master' into 17706-costanalyzer-uncommitted-container-requests
Ward Vandewege [Tue, 8 Jun 2021 12:27:25 +0000 (08:27 -0400)]
17706: Merge branch 'master' into 17706-costanalyzer-uncommitted-container-requests

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17717: address further review comments: remove unused code and refactor
Ward Vandewege [Mon, 7 Jun 2021 22:00:46 +0000 (18:00 -0400)]
17717: address further review comments: remove unused code and refactor
       a bit.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17717: address review comments.
Ward Vandewege [Mon, 7 Jun 2021 18:01:10 +0000 (14:01 -0400)]
17717: address review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17465-pysdk-storage-classes-support'
Lucas Di Pentima [Mon, 7 Jun 2021 17:17:37 +0000 (14:17 -0300)]
Merge branch '17465-pysdk-storage-classes-support'
Closes #17465

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17351: Adds support for storage classes while writing blocks to Keep.
Lucas Di Pentima [Thu, 3 Jun 2021 00:23:24 +0000 (21:23 -0300)]
17351: Adds support for storage classes while writing blocks to Keep.

Also, enabled support for multiple storage classes. For some reason it was
limited to just one.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17465: Fixed tests and made the suite less noisy.
Lucas Di Pentima [Mon, 7 Jun 2021 14:02:22 +0000 (11:02 -0300)]
17465: Fixed tests and made the suite less noisy.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoTweak upgrading doc page to reflect the release of 2.2.0.
Ward Vandewege [Sat, 5 Jun 2021 12:12:06 +0000 (08:12 -0400)]
Tweak upgrading doc page to reflect the release of 2.2.0.

refs #17512

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17757-bootprobe-race'
Ward Vandewege [Fri, 4 Jun 2021 21:31:01 +0000 (17:31 -0400)]
Merge branch '17757-bootprobe-race'

closes #17757

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17757: Merge branch 'master' into 17757-bootprobe-race
Ward Vandewege [Fri, 4 Jun 2021 21:30:32 +0000 (17:30 -0400)]
17757: Merge branch 'master' into 17757-bootprobe-race

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17762: Add uuid-dev package
Peter Amstutz [Fri, 4 Jun 2021 19:29:05 +0000 (15:29 -0400)]
17762: Add uuid-dev package

refs #17762

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>