arvados.git
2 years ago18842: Initial work adding disk cache option to configuration
Peter Amstutz [Tue, 25 Oct 2022 15:21:47 +0000 (11:21 -0400)]
18842: Initial work adding disk cache option to configuration

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18842: put the file locking back 18842-arv-mount-disk-cache
Peter Amstutz [Thu, 20 Oct 2022 21:37:12 +0000 (17:37 -0400)]
18842: put the file locking back

We don't strictly speaking need file locking for correctness, but it
does prevent a situation of having a bunch of ghost files that take up
space but are not visible on the file system.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18842: When starting up the disk cache, map in everything
Peter Amstutz [Thu, 20 Oct 2022 20:18:00 +0000 (16:18 -0400)]
18842: When starting up the disk cache, map in everything

When a process starts, the first thing it will do is map in the
existing blocks and prune any excess from the cache.

If there are multiple processes using the same cache dir, at worst
you'd end up with N*M usage where N is the number of processes and M
is the cache limit.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18842: Add locking and cachedir cleanup, needs testing
Peter Amstutz [Wed, 19 Oct 2022 21:18:20 +0000 (17:18 -0400)]
18842: Add locking and cachedir cleanup, needs testing

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18842: Add disk cache, test python sdk/fuse disk_cache=true/false
Peter Amstutz [Tue, 18 Oct 2022 00:21:06 +0000 (20:21 -0400)]
18842: Add disk cache, test python sdk/fuse disk_cache=true/false

Off by default in the SDK but enabled by default with arv-mount

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '19603-installer-container-shell-fix'. Closes #19603
Lucas Di Pentima [Mon, 17 Oct 2022 13:16:41 +0000 (10:16 -0300)]
Merge branch '19603-installer-container-shell-fix'. Closes #19603

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19603: Adds upgrade note regarding this fix. 19603-installer-container-shell-fix
Lucas Di Pentima [Fri, 14 Oct 2022 20:54:08 +0000 (17:54 -0300)]
19603: Adds upgrade note regarding this fix.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18368: Add BannerURL config option
Peter Amstutz [Wed, 12 Oct 2022 20:55:06 +0000 (16:55 -0400)]
18368: Add BannerURL config option

refs #18368

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19603: Fixes nginx configs to support container shell access.
Lucas Di Pentima [Fri, 14 Oct 2022 15:17:51 +0000 (12:17 -0300)]
19603: Fixes nginx configs to support container shell access.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '19377-diagnostics-health-check'
Tom Clegg [Fri, 14 Oct 2022 13:52:08 +0000 (09:52 -0400)]
Merge branch '19377-diagnostics-health-check'

refs #19377

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19400-login-sync-logincluster'. Closes #19400
Lucas Di Pentima [Thu, 13 Oct 2022 15:54:15 +0000 (12:54 -0300)]
Merge branch '19400-login-sync-logincluster'. Closes #19400

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19400: Adjusts dependency so this doesn't pull incompatible version 2.4.3. 19400-login-sync-logincluster
Lucas Di Pentima [Thu, 13 Oct 2022 13:56:59 +0000 (10:56 -0300)]
19400: Adjusts dependency so this doesn't pull incompatible version 2.4.3.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19400: Force Ruby SDK installation on login-sync installation before tests.
Lucas Di Pentima [Wed, 12 Oct 2022 21:24:23 +0000 (18:24 -0300)]
19400: Force Ruby SDK installation on login-sync installation before tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19400: Tests adding pre-release dependency on arvados gem.
Lucas Di Pentima [Wed, 12 Oct 2022 19:57:06 +0000 (16:57 -0300)]
19400: Tests adding pre-release dependency on arvados gem.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch 'fs-block-not-found-error'
Tom Clegg [Mon, 10 Oct 2022 15:24:31 +0000 (11:24 -0400)]
Merge branch 'fs-block-not-found-error'

fixes #19600

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoInclude relevant block ID in "block not found" error message. fs-block-not-found-error
Tom Clegg [Sat, 8 Oct 2022 01:35:36 +0000 (21:35 -0400)]
Include relevant block ID in "block not found" error message.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19377: Say "health check OK" on success. 19377-diagnostics-health-check
Tom Clegg [Thu, 6 Oct 2022 18:14:31 +0000 (14:14 -0400)]
19377: Say "health check OK" on success.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19594-user-activity-fix'. Closes #19594
Lucas Di Pentima [Thu, 6 Oct 2022 14:55:29 +0000 (11:55 -0300)]
Merge branch '19594-user-activity-fix'. Closes #19594

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19180: Document how to do various project operations with CLI
Peter Amstutz [Wed, 17 Aug 2022 21:36:11 +0000 (17:36 -0400)]
19180: Document how to do various project operations with CLI

refs #19180

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19594: Fixes len(None) bug, improves code formatting. 19594-user-activity-fix
Lucas Di Pentima [Thu, 6 Oct 2022 13:31:11 +0000 (10:31 -0300)]
19594: Fixes len(None) bug, improves code formatting.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '19418-lsf-unsatisfiable'
Tom Clegg [Wed, 5 Oct 2022 20:28:35 +0000 (16:28 -0400)]
Merge branch '19418-lsf-unsatisfiable'

fixes #19418

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19377-diagnostics-health-check'
Tom Clegg [Wed, 5 Oct 2022 20:26:59 +0000 (16:26 -0400)]
Merge branch '19377-diagnostics-health-check'

fixes #19377

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19377: Include health check in diagnostics report, if appropriate.
Tom Clegg [Tue, 4 Oct 2022 19:04:58 +0000 (15:04 -0400)]
19377: Include health check in diagnostics report, if appropriate.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19418: LSF: use InstanceTypes to detect unsatisfiable constraints. 19418-lsf-unsatisfiable
Tom Clegg [Tue, 4 Oct 2022 15:30:40 +0000 (11:30 -0400)]
19418: LSF: use InstanceTypes to detect unsatisfiable constraints.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19388-activity-logs'
Tom Clegg [Mon, 3 Oct 2022 19:02:03 +0000 (15:02 -0400)]
Merge branch '19388-activity-logs'

closes #19388

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19400: Updates arvados gem dependency.
Lucas Di Pentima [Tue, 27 Sep 2022 17:45:25 +0000 (14:45 -0300)]
19400: Updates arvados gem dependency.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '19400-rubysdk-cluster-config'. Refs #19400
Lucas Di Pentima [Tue, 27 Sep 2022 17:43:53 +0000 (14:43 -0300)]
Merge branch '19400-rubysdk-cluster-config'. Refs #19400

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19388: Trigger activity logs on group contents API, too. 19388-activity-logs
Tom Clegg [Fri, 23 Sep 2022 19:26:55 +0000 (15:26 -0400)]
19388: Trigger activity logs on group contents API, too.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19388: Trigger activity logs on group/project APIs, too.
Tom Clegg [Fri, 23 Sep 2022 19:23:07 +0000 (15:23 -0400)]
19388: Trigger activity logs on group/project APIs, too.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19388: Add tests for activity logs.
Tom Clegg [Fri, 23 Sep 2022 19:10:13 +0000 (15:10 -0400)]
19388: Add tests for activity logs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19388: Log user activity.
Tom Clegg [Fri, 23 Sep 2022 19:09:07 +0000 (15:09 -0400)]
19388: Log user activity.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19388: Remove unneeded import so ctrlctx can import arvadostest.
Tom Clegg [Thu, 22 Sep 2022 19:37:09 +0000 (15:37 -0400)]
19388: Remove unneeded import so ctrlctx can import arvadostest.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoAdd upgrade notes for 2.4.3
Peter Amstutz [Wed, 21 Sep 2022 21:09:02 +0000 (17:09 -0400)]
Add upgrade notes for 2.4.3

refs #19532

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19388: Cache token lookups.
Tom Clegg [Thu, 22 Sep 2022 19:19:48 +0000 (15:19 -0400)]
19388: Cache token lookups.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19388: Add user/auth context to ctrlctx.
Tom Clegg [Thu, 22 Sep 2022 18:03:01 +0000 (14:03 -0400)]
19388: Add user/auth context to ctrlctx.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19362-s3-webdav-sync'
Tom Clegg [Thu, 22 Sep 2022 17:20:26 +0000 (13:20 -0400)]
Merge branch '19362-s3-webdav-sync'

fixes #19362

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Cleanup/comment locking. 19362-s3-webdav-sync
Tom Clegg [Thu, 22 Sep 2022 15:16:38 +0000 (11:16 -0400)]
19362: Cleanup/comment locking.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoImprove getting git branch and git describe refs #19464
Peter Amstutz [Wed, 21 Sep 2022 18:25:12 +0000 (14:25 -0400)]
Improve getting git branch and git describe refs #19464

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19362: Update size test.
Tom Clegg [Wed, 21 Sep 2022 13:28:52 +0000 (09:28 -0400)]
19362: Update size test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Fix unchecked error.
Tom Clegg [Tue, 20 Sep 2022 20:45:22 +0000 (16:45 -0400)]
19362: Fix unchecked error.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19400: Adds upgrade notes for existing login-sync installations.
Lucas Di Pentima [Fri, 26 Aug 2022 20:25:32 +0000 (17:25 -0300)]
19400: Adds upgrade notes for existing login-sync installations.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19400: Adds cluster config request method to the Arvados class. 19400-rubysdk-cluster-config
Lucas Di Pentima [Thu, 25 Aug 2022 21:40:42 +0000 (18:40 -0300)]
19400: Adds cluster config request method to the Arvados class.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19400: Improves login-sync to detect LoginCluster federations on its own.
Lucas Di Pentima [Fri, 26 Aug 2022 20:23:33 +0000 (17:23 -0300)]
19400: Improves login-sync to detect LoginCluster federations on its own.

Updates install documentation.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19362: Fix error when GetCollection arg is neither UUID nor PDH.
Tom Clegg [Thu, 15 Sep 2022 20:24:18 +0000 (16:24 -0400)]
19362: Fix error when GetCollection arg is neither UUID nor PDH.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Sync s3 updates to long-lived session for same token.
Tom Clegg [Thu, 15 Sep 2022 20:24:15 +0000 (16:24 -0400)]
19362: Sync s3 updates to long-lived session for same token.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Use hardlinks to a singleton for each project/collection.
Tom Clegg [Wed, 14 Sep 2022 18:03:48 +0000 (14:03 -0400)]
19362: Use hardlinks to a singleton for each project/collection.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19362-all-webdav-via-sitefs'
Tom Clegg [Tue, 20 Sep 2022 20:09:01 +0000 (16:09 -0400)]
Merge branch '19362-all-webdav-via-sitefs'

refs #19362

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19428: Fix failing request on normal failed user lookup case.
Tom Clegg [Tue, 20 Sep 2022 17:44:12 +0000 (13:44 -0400)]
19428: Fix failing request on normal failed user lookup case.

refs #19428

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Update API docs. 19362-all-webdav-via-sitefs
Tom Clegg [Tue, 20 Sep 2022 13:56:33 +0000 (09:56 -0400)]
19362: Update API docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Remove obsolete config entries.
Tom Clegg [Tue, 20 Sep 2022 13:54:11 +0000 (09:54 -0400)]
19362: Remove obsolete config entries.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Add release note about changed metrics.
Tom Clegg [Mon, 19 Sep 2022 19:15:39 +0000 (15:15 -0400)]
19362: Add release note about changed metrics.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Update comment.
Tom Clegg [Mon, 19 Sep 2022 19:15:25 +0000 (15:15 -0400)]
19362: Update comment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19428-webdav-performance'
Tom Clegg [Mon, 19 Sep 2022 18:03:00 +0000 (14:03 -0400)]
Merge branch '19428-webdav-performance'

refs #19428

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19518-pam-access-check'
Tom Clegg [Fri, 16 Sep 2022 20:01:14 +0000 (16:01 -0400)]
Merge branch '19518-pam-access-check'

fixes #19518

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19437-docker-watchdog'
Tom Clegg [Fri, 16 Sep 2022 15:07:19 +0000 (11:07 -0400)]
Merge branch '19437-docker-watchdog'

fixes #19437

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoUpdate schema-salad dependency for filecache fix
Peter Amstutz [Thu, 15 Sep 2022 21:42:20 +0000 (17:42 -0400)]
Update schema-salad dependency for filecache fix

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '19472-installer-logrotate'. Closes #19472
Lucas Di Pentima [Fri, 16 Sep 2022 13:39:57 +0000 (10:39 -0300)]
Merge branch '19472-installer-logrotate'. Closes #19472

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19518: Check account access permission during pam auth. 19518-pam-access-check
Tom Clegg [Fri, 16 Sep 2022 02:17:15 +0000 (22:17 -0400)]
19518: Check account access permission during pam auth.

Also fix test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19472-logrotate' into 2.4-release 19472-installer-logrotate
Lucas Di Pentima [Mon, 12 Sep 2022 17:50:19 +0000 (14:50 -0300)]
Merge branch '19472-logrotate' into 2.4-release
Refs #19472

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19472: Syncs salt installer's main branch with commit 1e0108e1a
Lucas Di Pentima [Thu, 15 Sep 2022 20:52:31 +0000 (17:52 -0300)]
19472: Syncs salt installer's main branch with commit 1e0108e1a

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '19179-acct-activity' refs #19179
Peter Amstutz [Thu, 15 Sep 2022 15:09:38 +0000 (11:09 -0400)]
Merge branch '19179-acct-activity' refs #19179

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoSet "GITTARGET=.arvados-deploy-config-cluster" so it is hidden
Peter Amstutz [Mon, 12 Sep 2022 20:03:10 +0000 (16:03 -0400)]
Set "GITTARGET=.arvados-deploy-config-cluster" so it is hidden

This is because it's easy to confuse with the origin directory
"setup-arvados-cluster".

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19362: Fix version in status response.
Tom Clegg [Mon, 12 Sep 2022 20:32:24 +0000 (16:32 -0400)]
19362: Fix version in status response.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Remove dead code.
Tom Clegg [Mon, 12 Sep 2022 20:32:12 +0000 (16:32 -0400)]
19362: Remove dead code.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Merge serveSiteFS into main code path.
Tom Clegg [Mon, 12 Sep 2022 20:09:20 +0000 (16:09 -0400)]
19362: Merge serveSiteFS into main code path.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Move non-S3 collection-addressed reqs to sitefs code path.
Tom Clegg [Mon, 12 Sep 2022 18:49:37 +0000 (14:49 -0400)]
19362: Move non-S3 collection-addressed reqs to sitefs code path.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19464-capture-git-info' refs #19464
Peter Amstutz [Fri, 9 Sep 2022 20:59:27 +0000 (16:59 -0400)]
Merge branch '19464-capture-git-info' refs #19464

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19464: Fix tests 19464-capture-git-info
Peter Amstutz [Fri, 9 Sep 2022 15:11:09 +0000 (11:11 -0400)]
19464: Fix tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoTest fixing wip
Peter Amstutz [Fri, 9 Sep 2022 14:30:37 +0000 (10:30 -0400)]
Test fixing wip

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19464: Misspelled items
Peter Amstutz [Thu, 8 Sep 2022 22:42:19 +0000 (18:42 -0400)]
19464: Misspelled items

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19464: Record git info as properties
Peter Amstutz [Thu, 8 Sep 2022 22:37:20 +0000 (18:37 -0400)]
19464: Record git info as properties

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19464: Don't repeat the workflow id
Peter Amstutz [Thu, 8 Sep 2022 21:38:57 +0000 (17:38 -0400)]
19464: Don't repeat the workflow id

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19464: Record the file path in the git repo as well
Peter Amstutz [Thu, 8 Sep 2022 21:34:37 +0000 (17:34 -0400)]
19464: Record the file path in the git repo as well

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19464: Include "git describe" in workflow name
Peter Amstutz [Thu, 8 Sep 2022 21:13:08 +0000 (17:13 -0400)]
19464: Include "git describe" in workflow name

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19464: Fix assignment
Peter Amstutz [Thu, 8 Sep 2022 20:49:35 +0000 (16:49 -0400)]
19464: Fix assignment

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19464: Record & report provenance information from git
Peter Amstutz [Thu, 8 Sep 2022 20:33:38 +0000 (16:33 -0400)]
19464: Record & report provenance information from git

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '19454-cwl-output-json' refs #19454
Peter Amstutz [Thu, 8 Sep 2022 19:05:54 +0000 (15:05 -0400)]
Merge branch '19454-cwl-output-json' refs #19454

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19454: Update cwltool and schema salad 19454-cwl-output-json
Peter Amstutz [Thu, 8 Sep 2022 17:49:43 +0000 (13:49 -0400)]
19454: Update cwltool and schema salad

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '17344-easy-demo'
Tom Clegg [Thu, 8 Sep 2022 15:05:51 +0000 (11:05 -0400)]
Merge branch '17344-easy-demo'

closes #17344

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Merge branch 'main' 17344-easy-demo
Tom Clegg [Thu, 8 Sep 2022 15:04:51 +0000 (11:04 -0400)]
17344: Merge branch 'main'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Run `ls -l newpkg.deb` on host instead of container.
Tom Clegg [Thu, 8 Sep 2022 14:19:01 +0000 (10:19 -0400)]
17344: Run `ls -l newpkg.deb` on host instead of container.

This way the displayed path reflects the final package location on the
host, rather than the path inside the fpm container where the build
command's tempdir is bind-mounted.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Log when removing stale crunch-run-broken file.
Tom Clegg [Tue, 6 Sep 2022 18:25:36 +0000 (14:25 -0400)]
17344: Log when removing stale crunch-run-broken file.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Reset "broken node" flag on loopback instance create/reset.
Tom Clegg [Tue, 6 Sep 2022 16:11:12 +0000 (12:11 -0400)]
17344: Reset "broken node" flag on loopback instance create/reset.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19428: Tidy up pruneSessions, avoid calling MemorySize 2x. 19428-webdav-performance
Tom Clegg [Fri, 2 Sep 2022 14:28:52 +0000 (10:28 -0400)]
19428: Tidy up pruneSessions, avoid calling MemorySize 2x.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19437: Don't cancel until 3 consecutive docker-inspect failures. 19437-docker-watchdog
Tom Clegg [Fri, 2 Sep 2022 14:06:03 +0000 (10:06 -0400)]
19437: Don't cancel until 3 consecutive docker-inspect failures.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoUse "systemctl disable" instead of "service docker stop" refs #19439
Peter Amstutz [Thu, 1 Sep 2022 20:47:02 +0000 (16:47 -0400)]
Use "systemctl disable" instead of "service docker stop" refs #19439

"service docker stop" stops the daemon but it can be restarted from
prematurely by socket activation.  Whoops!

We need to use "systemctl disable" it so that it doesn't wake up
during the scratch space surgery on the /tmp directory.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoDon't include the patch any more, refs #19439
Peter Amstutz [Wed, 31 Aug 2022 16:55:51 +0000 (12:55 -0400)]
Don't include the patch any more, refs #19439

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoPull our fork of amazon-ebs-autoscale for nvme support, refs #19439
Peter Amstutz [Wed, 31 Aug 2022 15:59:40 +0000 (11:59 -0400)]
Pull our fork of amazon-ebs-autoscale for nvme support, refs #19439

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17344: Remove client code setting X-External-Client header.
Tom Clegg [Tue, 30 Aug 2022 15:23:52 +0000 (11:23 -0400)]
17344: Remove client code setting X-External-Client header.

It doesn't do anything: Nginx replaces it with 0 or 1 based on remote
IP address.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19428: Avoid locking entire collection in MemorySize.
Tom Clegg [Tue, 30 Aug 2022 14:35:58 +0000 (10:35 -0400)]
19428: Avoid locking entire collection in MemorySize.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19428: Avoid locking entire filesystem for MemorySize.
Tom Clegg [Mon, 29 Aug 2022 21:01:08 +0000 (17:01 -0400)]
19428: Avoid locking entire filesystem for MemorySize.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19428: Fix unchecked errors.
Tom Clegg [Mon, 29 Aug 2022 21:00:42 +0000 (17:00 -0400)]
19428: Fix unchecked errors.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19428: Fix leading "/" in path, skip the 301 redirect.
Tom Clegg [Mon, 29 Aug 2022 20:59:58 +0000 (16:59 -0400)]
19428: Fix leading "/" in path, skip the 301 redirect.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19428: Skip brand new sessions when pruning.
Tom Clegg [Mon, 29 Aug 2022 20:59:20 +0000 (16:59 -0400)]
19428: Skip brand new sessions when pruning.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19428: Use a larger page size when retrieving project contents.
Tom Clegg [Mon, 29 Aug 2022 20:54:49 +0000 (16:54 -0400)]
19428: Use a larger page size when retrieving project contents.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoFix merge conflict.
Tom Clegg [Mon, 29 Aug 2022 20:51:56 +0000 (16:51 -0400)]
Fix merge conflict.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Fix proxy detection test.
Tom Clegg [Fri, 26 Aug 2022 15:25:47 +0000 (11:25 -0400)]
17344: Fix proxy detection test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Skip test that relies on Nginx not flagging external clients.
Tom Clegg [Fri, 26 Aug 2022 14:14:49 +0000 (10:14 -0400)]
17344: Skip test that relies on Nginx not flagging external clients.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19269-all-users-writable'
Tom Clegg [Thu, 25 Aug 2022 19:50:14 +0000 (15:50 -0400)]
Merge branch '19269-all-users-writable'

fixes #19269

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19269: Document that modifying a role requires can_manage. 19269-all-users-writable
Tom Clegg [Thu, 25 Aug 2022 19:47:43 +0000 (15:47 -0400)]
19269: Document that modifying a role requires can_manage.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>