arvados.git
3 years ago17983: Fix writable fuse deadlock
Peter Amstutz [Mon, 16 Aug 2021 19:33:10 +0000 (15:33 -0400)]
17983: Fix writable fuse deadlock

Resulting from threads competing for llfuse.lock and collection lock
and one code path locking in the wrong order.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18001: address review comments.
Ward Vandewege [Fri, 13 Aug 2021 19:33:17 +0000 (15:33 -0400)]
18001: address review comments.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18001: add Users/UserNotifierEmailBcc configuration option, which is the
Ward Vandewege [Tue, 10 Aug 2021 15:00:02 +0000 (11:00 -0400)]
18001: add Users/UserNotifierEmailBcc configuration option, which is the
       e-mail address that will be bcc'd on the new user welcome e-mail.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17984: Fix tests
Peter Amstutz [Thu, 12 Aug 2021 19:43:18 +0000 (15:43 -0400)]
17984: Fix tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17984: Improve error reporting a bit
Peter Amstutz [Tue, 10 Aug 2021 19:44:27 +0000 (15:44 -0400)]
17984: Improve error reporting a bit

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17984: validation accepts user uuid in --project-uuid
Peter Amstutz [Tue, 10 Aug 2021 19:29:45 +0000 (15:29 -0400)]
17984: validation accepts user uuid in --project-uuid

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17985: fix binstub for cwltool in our arvados-cwl-runner package.
Ward Vandewege [Wed, 11 Aug 2021 15:19:35 +0000 (11:19 -0400)]
17985: fix binstub for cwltool in our arvados-cwl-runner package.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18005: Fixes the bug.
Lucas Di Pentima [Wed, 11 Aug 2021 18:37:46 +0000 (15:37 -0300)]
18005: Fixes the bug.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago18005: Exposes the bug by simulating a keep-balance run a making a new version.
Lucas Di Pentima [Wed, 11 Aug 2021 18:31:11 +0000 (15:31 -0300)]
18005: Exposes the bug by simulating a keep-balance run a making a new version.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17936: Updates arv-keepdocker to call arv-put with --batch argument.
Lucas Di Pentima [Mon, 9 Aug 2021 18:12:48 +0000 (15:12 -0300)]
17936: Updates arv-keepdocker to call arv-put with --batch argument.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17936: Adds --batch implementation, making the new test pass.
Lucas Di Pentima [Mon, 9 Aug 2021 17:58:41 +0000 (14:58 -0300)]
17936: Adds --batch implementation, making the new test pass.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17936: Adds --batch argument to arv-put, updates test.
Lucas Di Pentima [Mon, 9 Aug 2021 16:56:44 +0000 (13:56 -0300)]
17936: Adds --batch argument to arv-put, updates test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17952: Remove tests for presence of nodes / disks menu item
Peter Amstutz [Thu, 5 Aug 2021 14:25:00 +0000 (10:25 -0400)]
17952: Remove tests for presence of nodes / disks menu item

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17952: Remove links to obsolete "nodes" and "keep disks"
Peter Amstutz [Wed, 4 Aug 2021 21:38:09 +0000 (17:38 -0400)]
17952: Remove links to obsolete "nodes" and "keep disks"

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17947: the Arvados python3-* CentOS packages should conflict with the
Ward Vandewege [Wed, 11 Aug 2021 19:29:07 +0000 (15:29 -0400)]
17947: the Arvados python3-* CentOS packages should conflict with the
       corresponding older rh-python36-* version.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17591: address review feedback.
Ward Vandewege [Tue, 3 Aug 2021 21:26:30 +0000 (17:26 -0400)]
17591: address review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17591: be more explicit about the required TLS certificates and DNS
Ward Vandewege [Tue, 3 Aug 2021 15:15:20 +0000 (11:15 -0400)]
17591: be more explicit about the required TLS certificates and DNS
       hostnames.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoRemove tracing mode from provision.sh, it should not be enabled by
Ward Vandewege [Fri, 30 Jul 2021 19:09:22 +0000 (15:09 -0400)]
Remove tracing mode from provision.sh, it should not be enabled by
default.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoAdd extra validation of our package version format in the build scripts,
Ward Vandewege [Fri, 30 Jul 2021 17:27:35 +0000 (13:27 -0400)]
Add extra validation of our package version format in the build scripts,
it must match

  ^[0-9]+\.[0-9]+\.[0-9]+(\.[0-9]+|)(~rc[0-9]+|~dev[0-9]+|)-[0-9]+$

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFix the example AWS InstanceTypes for the installer, none of these node
Ward Vandewege [Wed, 28 Jul 2021 19:28:17 +0000 (15:28 -0400)]
Fix the example AWS InstanceTypes for the installer, none of these node
types come with IncludedScratch.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17903: use more distribution-agnostic commands to add/remove a user
Ward Vandewege [Tue, 27 Jul 2021 18:40:19 +0000 (14:40 -0400)]
17903: use more distribution-agnostic commands to add/remove a user
       to/from a group. This makes arvados-login-sync work on CentOS as
       well as Debian-based distributions.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFix typo in documentation.
Ward Vandewege [Mon, 26 Jul 2021 19:09:44 +0000 (15:09 -0400)]
Fix typo in documentation.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoBump the version of lib/pq to 1.10.2
Ward Vandewege [Wed, 21 Jul 2021 12:47:30 +0000 (08:47 -0400)]
Bump the version of lib/pq to 1.10.2

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

refs #17962

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoAnother doc tweak.
Ward Vandewege [Tue, 20 Jul 2021 17:08:46 +0000 (13:08 -0400)]
Another doc tweak.

refs #17464

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoAdd some more clarifications to the doc page about restricting uploads
Ward Vandewege [Tue, 20 Jul 2021 15:53:27 +0000 (11:53 -0400)]
Add some more clarifications to the doc page about restricting uploads
and downloads.

refs #17464

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFix typos in the documentation.
Ward Vandewege [Tue, 20 Jul 2021 12:47:52 +0000 (08:47 -0400)]
Fix typos in the documentation.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoUpdate salt install doc to link to 2.2 branch.
Peter Amstutz [Wed, 14 Jul 2021 18:08:42 +0000 (14:08 -0400)]
Update salt install doc to link to 2.2 branch.

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoArvbox in 2.2 branch specifies 2.2 branch.
Peter Amstutz [Wed, 14 Jul 2021 18:01:34 +0000 (14:01 -0400)]
Arvbox in 2.2 branch specifies 2.2 branch.

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoAdd ARVADOS_BRANCH and WORKBENCH2_BRANCH to arvbox
Peter Amstutz [Wed, 14 Jul 2021 17:57:37 +0000 (13:57 -0400)]
Add ARVADOS_BRANCH and WORKBENCH2_BRANCH to arvbox

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoChange bundler version in Gemfile.lock to work with arvbox.
Peter Amstutz [Wed, 14 Jul 2021 17:33:52 +0000 (13:33 -0400)]
Change bundler version in Gemfile.lock to work with arvbox.

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoFix "wrong bundler" error starting API server in arvbox
Peter Amstutz [Wed, 14 Jul 2021 15:19:58 +0000 (11:19 -0400)]
Fix "wrong bundler" error starting API server in arvbox

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoUpdate version in provision.sh refs #17877 2.2.1
Peter Amstutz [Fri, 9 Jul 2021 18:34:03 +0000 (14:34 -0400)]
Update version in provision.sh refs #17877

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoPin networkx to avoid new version that pulls in scipy/numpy
Peter Amstutz [Fri, 9 Jul 2021 14:54:30 +0000 (10:54 -0400)]
Pin networkx to avoid new version that pulls in scipy/numpy

refs #17879

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoBack out some undesired test changes refs #17817
Peter Amstutz [Fri, 9 Jul 2021 14:53:39 +0000 (10:53 -0400)]
Back out some undesired test changes refs #17817

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoSmall lib/config load_test.go change to reflect the absense of the
Ward Vandewege [Fri, 9 Jul 2021 14:39:10 +0000 (10:39 -0400)]
Small lib/config load_test.go change to reflect the absense of the
RuntimeEngine config variable in the 2.2 branch.

refs #17803

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17810-s3-escape-non-unreserved-chars'
Tom Clegg [Fri, 18 Jun 2021 02:59:00 +0000 (22:59 -0400)]
Merge branch '17810-s3-escape-non-unreserved-chars'

fixes #17810

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17853: Fix map write when only RLock held.
Tom Clegg [Mon, 5 Jul 2021 18:32:39 +0000 (14:32 -0400)]
17853: Fix map write when only RLock held.

Update DebugLocksPanicMode to check RLock/Lock as appropriate.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoAdd missing link to "restricting-upload-download" to doc refs #17464
Peter Amstutz [Thu, 8 Jul 2021 21:02:36 +0000 (17:02 -0400)]
Add missing link to "restricting-upload-download" to doc refs #17464

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoThe bleeding edge branch is now called 'main'.
Ward Vandewege [Thu, 1 Jul 2021 18:00:01 +0000 (14:00 -0400)]
The bleeding edge branch is now called 'main'.

refs #17817

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17879: Add test that acr doesn't fail on sbg fields
Peter Amstutz [Thu, 8 Jul 2021 19:20:51 +0000 (15:20 -0400)]
17879: Add test that acr doesn't fail on sbg fields

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17879: Default --thread-count=0, upgrade schema-salad
Peter Amstutz [Thu, 8 Jul 2021 18:36:00 +0000 (14:36 -0400)]
17879: Default --thread-count=0, upgrade schema-salad

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17705: Improve InstanceSetID wording, update link to mgmt API docs.
Tom Clegg [Mon, 5 Jul 2021 18:46:03 +0000 (14:46 -0400)]
17705: Improve InstanceSetID wording, update link to mgmt API docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17705: Link install page to arch page.
Tom Clegg [Wed, 9 Jun 2021 13:10:37 +0000 (09:10 -0400)]
17705: Link install page to arch page.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17705: Mention IdleBehavior tag name.
Tom Clegg [Wed, 9 Jun 2021 13:06:45 +0000 (09:06 -0400)]
17705: Mention IdleBehavior tag name.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17705: Add dispatchcloud architecture page.
Tom Clegg [Wed, 9 Jun 2021 13:02:24 +0000 (09:02 -0400)]
17705: Add dispatchcloud architecture page.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17858: Tweak logic to avoid KeyError
Peter Amstutz [Wed, 7 Jul 2021 20:11:54 +0000 (16:11 -0400)]
17858: Tweak logic to avoid KeyError

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17858: Add ExpressionTool to classes checked for ids when visiting
Peter Amstutz [Wed, 7 Jul 2021 14:02:05 +0000 (10:02 -0400)]
17858: Add ExpressionTool to classes checked for ids when visiting

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17858: Integration test passes
Peter Amstutz [Wed, 7 Jul 2021 17:42:13 +0000 (13:42 -0400)]
17858: Integration test passes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17858: Add test to reproduce bug
Peter Amstutz [Wed, 7 Jul 2021 13:51:09 +0000 (09:51 -0400)]
17858: Add test to reproduce bug

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17333: Add check for valid project uuid, with test
Peter Amstutz [Mon, 21 Jun 2021 20:12:12 +0000 (16:12 -0400)]
17333: Add check for valid project uuid, with test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17801: Handle glob capture of keep URI with a trailing slash
Peter Amstutz [Fri, 18 Jun 2021 21:29:05 +0000 (17:29 -0400)]
17801: Handle glob capture of keep URI with a trailing slash

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17776: address review comments.
Ward Vandewege [Tue, 15 Jun 2021 19:40:59 +0000 (15:40 -0400)]
17776: address review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17776: Basic throttling for VcpuLimitExceeded, MaxSpotInstanceCountExceeded,
Ward Vandewege [Tue, 8 Jun 2021 21:37:13 +0000 (17:37 -0400)]
17776: Basic throttling for VcpuLimitExceeded, MaxSpotInstanceCountExceeded,
InsufficientInstanceCapacity.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17810: Fix S3 signature verification.
Tom Clegg [Tue, 15 Jun 2021 18:57:59 +0000 (14:57 -0400)]
17810: Fix S3 signature verification.

All chars (other than "/") that are not unreserved must be
percent-encoded.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17800: Avoids saving a new empty collection.
Lucas Di Pentima [Mon, 14 Jun 2021 19:49:42 +0000 (16:49 -0300)]
17800: Avoids saving a new empty collection.

Sometimes the specified paths won't be eligible for uploading (ie: all are
symlinks and --no-follow-symlinks is used), in those cases arv-put just
prints a warning message and doesn't save anything to Keep/API.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17800: Improves help message. Shows warnings when ignoring given paths.
Lucas Di Pentima [Mon, 14 Jun 2021 17:26:21 +0000 (14:26 -0300)]
17800: Improves help message. Shows warnings when ignoring given paths.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17800: Fixes bug.
Lucas Di Pentima [Mon, 14 Jun 2021 14:01:36 +0000 (11:01 -0300)]
17800: Fixes bug.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17800: Exposes bug on test.
Lucas Di Pentima [Mon, 14 Jun 2021 13:38:14 +0000 (10:38 -0300)]
17800: Exposes bug on test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17803: Note todo's.
Tom Clegg [Tue, 15 Jun 2021 22:31:08 +0000 (18:31 -0400)]
17803: Note todo's.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17803: Fix unnecessarily convoluted test case.
Tom Clegg [Tue, 15 Jun 2021 22:22:51 +0000 (18:22 -0400)]
17803: Fix unnecessarily convoluted test case.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17803: Ensure keys with mismatched case don't get used.
Tom Clegg [Mon, 14 Jun 2021 18:28:00 +0000 (14:28 -0400)]
17803: Ensure keys with mismatched case don't get used.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17803: Warn when config keys are ignored due to case mismatch.
Tom Clegg [Sun, 13 Jun 2021 14:00:45 +0000 (10:00 -0400)]
17803: Warn when config keys are ignored due to case mismatch.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17774: Add non-empty mounts to test fixtures.
Tom Clegg [Thu, 10 Jun 2021 18:46:38 +0000 (14:46 -0400)]
17774: Add non-empty mounts to test fixtures.

Confirmed wb1 integration tests fail if the recent fix (parent of this
commit) is backed out.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17774: Test runtime_constraints and scheduling_parameters, too.
Tom Clegg [Thu, 10 Jun 2021 15:05:03 +0000 (11:05 -0400)]
17774: Test runtime_constraints and scheduling_parameters, too.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17774: Ignore addition of zero/default values to mounts when frozen.
Tom Clegg [Thu, 10 Jun 2021 14:42:30 +0000 (10:42 -0400)]
17774: Ignore addition of zero/default values to mounts when frozen.

Avoids errors when a client reads the CR and includes the resulting
mounts field (to which controller will have added zero/default values)
in a subsequent update request.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17799: Upgrades API & Workbench rails to 5.2.6
Lucas Di Pentima [Wed, 9 Jun 2021 23:26:20 +0000 (20:26 -0300)]
17799: Upgrades API & Workbench rails to 5.2.6

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17464: Couple of doc fixes
Peter Amstutz [Wed, 30 Jun 2021 19:47:16 +0000 (15:47 -0400)]
17464: Couple of doc fixes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: MakeRESTRouter returns erro instead of panicking
Peter Amstutz [Mon, 21 Jun 2021 15:25:29 +0000 (11:25 -0400)]
17464: MakeRESTRouter returns erro instead of panicking

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: keep-web handles cases where user is unknown
Peter Amstutz [Fri, 18 Jun 2021 19:58:03 +0000 (15:58 -0400)]
17464: keep-web handles cases where user is unknown

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Unknown user gets "User" permission check instead of failure
Peter Amstutz [Fri, 18 Jun 2021 19:43:26 +0000 (15:43 -0400)]
17464: Unknown user gets "User" permission check instead of failure

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Fix typo in exported config
Peter Amstutz [Fri, 18 Jun 2021 17:07:39 +0000 (13:07 -0400)]
17464: Fix typo in exported config

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Add note about special case involving sharing links
Peter Amstutz [Fri, 18 Jun 2021 16:58:52 +0000 (12:58 -0400)]
17464: Add note about special case involving sharing links

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Update exported config
Peter Amstutz [Fri, 18 Jun 2021 16:50:52 +0000 (12:50 -0400)]
17464: Update exported config

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Replace cache with LRU cache
Peter Amstutz [Fri, 18 Jun 2021 16:35:38 +0000 (12:35 -0400)]
17464: Replace cache with LRU cache

Error out if API error from users.current

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Don't deny or log GET on directories.
Peter Amstutz [Thu, 17 Jun 2021 20:47:33 +0000 (16:47 -0400)]
17464: Don't deny or log GET on directories.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Add tests for paths by /users/ and by PDH
Peter Amstutz [Thu, 17 Jun 2021 19:49:04 +0000 (15:49 -0400)]
17464: Add tests for paths by /users/ and by PDH

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Clean up tests
Peter Amstutz [Thu, 17 Jun 2021 18:48:33 +0000 (14:48 -0400)]
17464: Clean up tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Update config variables & docs from feedback
Peter Amstutz [Thu, 17 Jun 2021 16:27:19 +0000 (12:27 -0400)]
17464: Update config variables & docs from feedback

Change KeepWebPermission -> WebDAVPermission

Add WebDAVLogEvents

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Activity report lists upload/download events
Peter Amstutz [Wed, 16 Jun 2021 21:22:04 +0000 (17:22 -0400)]
17464: Activity report lists upload/download events

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Fix test.
Peter Amstutz [Wed, 16 Jun 2021 20:06:36 +0000 (16:06 -0400)]
17464: Fix test.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Add upload/download logging and permissions to keepproxy
Peter Amstutz [Wed, 16 Jun 2021 20:03:48 +0000 (16:03 -0400)]
17464: Add upload/download logging and permissions to keepproxy

Add tests.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Refactor tests and check that log events are posted
Peter Amstutz [Tue, 15 Jun 2021 20:59:40 +0000 (16:59 -0400)]
17464: Refactor tests and check that log events are posted

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Reset database after upload tests
Peter Amstutz [Tue, 15 Jun 2021 18:54:16 +0000 (14:54 -0400)]
17464: Reset database after upload tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Permission/logging testing WIP
Peter Amstutz [Mon, 14 Jun 2021 21:30:59 +0000 (17:30 -0400)]
17464: Permission/logging testing WIP

The upload tests are messing up the other tests by changing the
contents of the collection, still need to fix it.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Fix shadowed "sess" variable
Peter Amstutz [Fri, 11 Jun 2021 21:19:36 +0000 (17:19 -0400)]
17464: Fix shadowed "sess" variable

Testing WIP

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Log collection uuid for FileSystem requests
Peter Amstutz [Fri, 11 Jun 2021 19:26:05 +0000 (15:26 -0400)]
17464: Log collection uuid for FileSystem requests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Add upload/download permission checks and logging
Peter Amstutz [Thu, 10 Jun 2021 20:50:56 +0000 (16:50 -0400)]
17464: Add upload/download permission checks and logging

Adds extra log line to normal logging that includes user uuid and full
name.

Also posts an event to the logs table.

Adds permission checks to but these haven't been tested yet.

Still need to add testing.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Fix config entry
Peter Amstutz [Mon, 7 Jun 2021 19:42:32 +0000 (15:42 -0400)]
17464: Fix config entry

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Start by writing the documentation page
Peter Amstutz [Mon, 7 Jun 2021 19:23:40 +0000 (15:23 -0400)]
17464: Start by writing the documentation page

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17464: Fix auto-enable DebugLocksPanicMode.
Tom Clegg [Fri, 18 Jun 2021 15:28:08 +0000 (11:28 -0400)]
17464: Fix auto-enable DebugLocksPanicMode.

refs #17464

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17464: Add DebugLocksPanicMode and fix some missing locks.
Tom Clegg [Fri, 18 Jun 2021 14:11:27 +0000 (10:11 -0400)]
17464: Add DebugLocksPanicMode and fix some missing locks.

refs #17464

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoThe bleeding edge branch for arvados-workbench2 is now called 'main'.
Ward Vandewege [Thu, 1 Jul 2021 16:57:02 +0000 (12:57 -0400)]
The bleeding edge branch for arvados-workbench2 is now called 'main'.

refs #17817

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17778: update docs.
Ward Vandewege [Wed, 9 Jun 2021 23:51:29 +0000 (19:51 -0400)]
17778: update docs.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoRemove leftover dead link from the ToC in the 'Set up a shell node'
Ward Vandewege [Tue, 8 Jun 2021 12:55:53 +0000 (08:55 -0400)]
Remove leftover dead link from the ToC in the 'Set up a shell node'
page.

refs #16803

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoTweak upgrading doc page to reflect the release of 2.2.0.
Ward Vandewege [Sat, 5 Jun 2021 12:01:54 +0000 (08:01 -0400)]
Tweak upgrading doc page to reflect the release of 2.2.0.

refs #17512

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17757: On our compute node images, Docker should not start by default;
Ward Vandewege [Fri, 4 Jun 2021 15:22:47 +0000 (11:22 -0400)]
17757: On our compute node images, Docker should not start by default;
       ensure-encrypted-partitions.sh takes care of starting it.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFix building of metapackages for Ubuntu 18.04 and Ubuntu 20.04.
Ward Vandewege [Thu, 3 Jun 2021 20:18:36 +0000 (16:18 -0400)]
Fix building of metapackages for Ubuntu 18.04 and Ubuntu 20.04.

refs #17498

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMake our arvados-api and arvados-workbench Gemfiles use the arvados 2.2.0
Ward Vandewege [Wed, 2 Jun 2021 21:28:41 +0000 (17:28 -0400)]
Make our arvados-api and arvados-workbench Gemfiles use the arvados
2.1.5 gem.

refs #17738

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoNeed to export ARVADOS_BUILDING_ so arvados_version.py sees them.
Peter Amstutz [Wed, 2 Jun 2021 18:50:16 +0000 (14:50 -0400)]
Need to export ARVADOS_BUILDING_ so arvados_version.py sees them.

refs #17512

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoPin arvados 2.2 version in provision.sh, refs #17703
Peter Amstutz [Wed, 26 May 2021 18:31:40 +0000 (14:31 -0400)]
Pin arvados 2.2 version in provision.sh, refs #17703

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>