arvados.git
2 years ago19688: Recognize plain workflow uuid without arvwf: prefix
Peter Amstutz [Fri, 4 Nov 2022 01:49:53 +0000 (21:49 -0400)]
19688: Recognize plain workflow uuid without arvwf: prefix

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19240: Fix url comparison.
Tom Clegg [Fri, 4 Nov 2022 01:33:02 +0000 (21:33 -0400)]
19240: Fix url comparison.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19688: Fix @stubs decorator that was accidentally skipping tests
Peter Amstutz [Thu, 3 Nov 2022 19:44:20 +0000 (15:44 -0400)]
19688: Fix @stubs decorator that was accidentally skipping tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19234: Ignore Region when using custom Endpoint with s3v1 driver. 19234-default-s3-region
Tom Clegg [Wed, 2 Nov 2022 19:41:40 +0000 (15:41 -0400)]
19234: Ignore Region when using custom Endpoint with s3v1 driver.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19234: s3v2 + non-aws: default to us-east-1 signing settings.
Tom Clegg [Wed, 2 Nov 2022 19:01:15 +0000 (15:01 -0400)]
19234: s3v2 + non-aws: default to us-east-1 signing settings.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19683-arvbox-rubysdk-fix'. Closes #19683
Lucas Di Pentima [Wed, 2 Nov 2022 18:20:46 +0000 (15:20 -0300)]
Merge branch '19683-arvbox-rubysdk-fix'. Closes #19683

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19688: Make registered workflows lightweight wrappers
Peter Amstutz [Wed, 2 Nov 2022 03:17:51 +0000 (23:17 -0400)]
19688: Make registered workflows lightweight wrappers

Puts the actual workflow in a collection

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19688: Trying a fast path submit for registered workflows
Peter Amstutz [Wed, 2 Nov 2022 01:34:35 +0000 (21:34 -0400)]
19688: Trying a fast path submit for registered workflows

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18842: Respond to review comments
Peter Amstutz [Tue, 1 Nov 2022 21:05:42 +0000 (17:05 -0400)]
18842: Respond to review comments

* Fix test typo
* Add suffix .keepcache
* Delete tmp file if an error is thrown before it is renamed
* Default disk cache size accounts for both free space and total disk size
* Handle errors and fall back to RAM caching
* Delete old tmp blocks if we find them
* Collection class gets keep client if initialized with ThreadSafeApiCache

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19683: Improves pattern matching on the arvados gem. 19683-arvbox-rubysdk-fix
Lucas Di Pentima [Tue, 1 Nov 2022 17:59:05 +0000 (14:59 -0300)]
19683: Improves pattern matching on the arvados gem.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19683: Improves code style.
Lucas Di Pentima [Tue, 1 Nov 2022 17:30:14 +0000 (14:30 -0300)]
19683: Improves code style.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19683: Builds & installs the arvados gem dev version.
Lucas Di Pentima [Tue, 1 Nov 2022 16:35:42 +0000 (13:35 -0300)]
19683: Builds & installs the arvados gem dev version.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '19582-aws-s3v2-driver'. Closes #19582.
Lucas Di Pentima [Mon, 31 Oct 2022 20:22:40 +0000 (17:22 -0300)]
Merge branch '19582-aws-s3v2-driver'. Closes #19582.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '19678-job-loader' refs #19678
Peter Amstutz [Mon, 31 Oct 2022 20:12:09 +0000 (16:12 -0400)]
Merge branch '19678-job-loader' refs #19678

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch 'main' into 19582-aws-s3v2-driver 19582-aws-s3v2-driver
Lucas Di Pentima [Mon, 31 Oct 2022 19:22:07 +0000 (16:22 -0300)]
Merge branch 'main' into 19582-aws-s3v2-driver

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18071-dblock-keep-balance-and-dispatch'
Tom Clegg [Mon, 31 Oct 2022 17:12:31 +0000 (13:12 -0400)]
Merge branch '18071-dblock-keep-balance-and-dispatch'

closes #18071

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18071: Remove obsolete comment.
Tom Clegg [Mon, 31 Oct 2022 17:11:57 +0000 (13:11 -0400)]
18071: Remove obsolete comment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19678: Fix for parameters called 'name' 19678-job-loader
Peter Amstutz [Fri, 28 Oct 2022 21:30:39 +0000 (17:30 -0400)]
19678: Fix for parameters called 'name'

Also fix regression involving default file references appearing in
nested processes (inline declaration of a tool within a workflow).

Also fixed some dependency issues preventing arvados/jobs developer
image from building.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19678: Use minimal job loader context to expand job order, same as cwltool
Peter Amstutz [Fri, 28 Oct 2022 18:36:32 +0000 (14:36 -0400)]
19678: Use minimal job loader context to expand job order, same as cwltool

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18071: Fix tests. 18071-dblock-keep-balance-and-dispatch
Tom Clegg [Fri, 28 Oct 2022 18:33:45 +0000 (14:33 -0400)]
18071: Fix tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18071: Relax test timeout.
Tom Clegg [Fri, 28 Oct 2022 18:18:59 +0000 (14:18 -0400)]
18071: Relax test timeout.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18071: Improve test timeout.
Tom Clegg [Fri, 28 Oct 2022 15:08:39 +0000 (11:08 -0400)]
18071: Improve test timeout.

Test can take longer when output is going to a terminal. Keep trying
if some progress is made every 3s, rather than giving up after 10s
total.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18071: Use dblock to prevent multiple dispatchers from competing.
Tom Clegg [Fri, 28 Oct 2022 14:35:27 +0000 (10:35 -0400)]
18071: Use dblock to prevent multiple dispatchers from competing.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18071: Log host:port of other process(es) holding lock.
Tom Clegg [Thu, 27 Oct 2022 15:05:42 +0000 (11:05 -0400)]
18071: Log host:port of other process(es) holding lock.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18071: Use dblock to avoid concurrent keep-balance ops.
Tom Clegg [Wed, 26 Oct 2022 21:00:42 +0000 (17:00 -0400)]
18071: Use dblock to avoid concurrent keep-balance ops.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19377-verbose'
Tom Clegg [Thu, 27 Oct 2022 15:01:54 +0000 (11:01 -0400)]
Merge branch '19377-verbose'

closes #19377

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19377: Usage error if config is readable but does not match env. 19377-verbose
Tom Clegg [Thu, 27 Oct 2022 14:07:43 +0000 (10:07 -0400)]
19377: Usage error if config is readable but does not match env.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19563-log-cr-mem'
Tom Clegg [Wed, 26 Oct 2022 21:19:42 +0000 (17:19 -0400)]
Merge branch '19563-log-cr-mem'

refs #19563

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18842: Fix test
Peter Amstutz [Tue, 25 Oct 2022 20:57:17 +0000 (16:57 -0400)]
18842: Fix test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18842: Fix test for default disk cache
Peter Amstutz [Tue, 25 Oct 2022 20:53:45 +0000 (16:53 -0400)]
18842: Fix test for default disk cache

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18842: Fix tests
Peter Amstutz [Tue, 25 Oct 2022 20:12:44 +0000 (16:12 -0400)]
18842: Fix tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19563: Report process size in bytes, not pages. 19563-log-cr-mem
Tom Clegg [Tue, 25 Oct 2022 18:00:38 +0000 (14:00 -0400)]
19563: Report process size in bytes, not pages.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18842: Fix syntax errors & error handling
Peter Amstutz [Tue, 25 Oct 2022 15:58:30 +0000 (11:58 -0400)]
18842: Fix syntax errors & error handling

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18842: Add KeepCacheDisk to EstimateScratchSpace used by dispatchers
Peter Amstutz [Tue, 25 Oct 2022 15:27:53 +0000 (11:27 -0400)]
18842: Add KeepCacheDisk to EstimateScratchSpace used by dispatchers

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18842: Initial work adding disk cache option to configuration
Peter Amstutz [Tue, 25 Oct 2022 15:21:47 +0000 (11:21 -0400)]
18842: Initial work adding disk cache option to configuration

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19377: Improve log message about skipping health check during diags.
Tom Clegg [Tue, 25 Oct 2022 14:45:41 +0000 (10:45 -0400)]
19377: Improve log message about skipping health check during diags.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19563: Clean up tests.
Tom Clegg [Tue, 25 Oct 2022 14:22:53 +0000 (10:22 -0400)]
19563: Clean up tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19466-cwl-io' refs #19466
Peter Amstutz [Mon, 24 Oct 2022 21:05:18 +0000 (17:05 -0400)]
Merge branch '19466-cwl-io' refs #19466

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19466: Add link to section later in the page
Peter Amstutz [Mon, 24 Oct 2022 21:03:52 +0000 (17:03 -0400)]
19466: Add link to section later in the page

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19563: Log memory usage of arv-mount, crunch-run, and keepstore.
Tom Clegg [Mon, 24 Oct 2022 20:45:45 +0000 (16:45 -0400)]
19563: Log memory usage of arv-mount, crunch-run, and keepstore.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19215: Fixes small typo.
Lucas Di Pentima [Mon, 24 Oct 2022 13:31:25 +0000 (10:31 -0300)]
19215: Fixes small typo.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19466: Fix typo and test with cwl_ properties 19466-cwl-io
Peter Amstutz [Fri, 21 Oct 2022 20:57:29 +0000 (16:57 -0400)]
19466: Fix typo and test with cwl_ properties

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19466: Fix properties page typos
Peter Amstutz [Fri, 21 Oct 2022 20:54:45 +0000 (16:54 -0400)]
19466: Fix properties page typos

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19466: Fix incorrect cwl_ properties in table
Peter Amstutz [Fri, 21 Oct 2022 20:31:11 +0000 (16:31 -0400)]
19466: Fix incorrect cwl_ properties in table

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19466: Add an API documentation page about properties
Peter Amstutz [Fri, 21 Oct 2022 20:28:56 +0000 (16:28 -0400)]
19466: Add an API documentation page about properties

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Fixes some typos.
Lucas Di Pentima [Fri, 21 Oct 2022 18:26:46 +0000 (15:26 -0300)]
19215: Fixes some typos.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '19629-nokogiri-upgrade'. Closes #19629
Lucas Di Pentima [Fri, 21 Oct 2022 13:40:07 +0000 (10:40 -0300)]
Merge branch '19629-nokogiri-upgrade'. Closes #19629

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19629: Upgrades nokogiri. 19629-nokogiri-upgrade
Lucas Di Pentima [Fri, 21 Oct 2022 13:14:10 +0000 (10:14 -0300)]
19629: Upgrades nokogiri.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18842: put the file locking back 18842-arv-mount-disk-cache
Peter Amstutz [Thu, 20 Oct 2022 21:37:12 +0000 (17:37 -0400)]
18842: put the file locking back

We don't strictly speaking need file locking for correctness, but it
does prevent a situation of having a bunch of ghost files that take up
space but are not visible on the file system.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18842: When starting up the disk cache, map in everything
Peter Amstutz [Thu, 20 Oct 2022 20:18:00 +0000 (16:18 -0400)]
18842: When starting up the disk cache, map in everything

When a process starts, the first thing it will do is map in the
existing blocks and prune any excess from the cache.

If there are multiple processes using the same cache dir, at worst
you'd end up with N*M usage where N is the number of processes and M
is the cache limit.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Fixes webshell nginx config.
Lucas Di Pentima [Thu, 20 Oct 2022 17:05:12 +0000 (14:05 -0300)]
19215: Fixes webshell nginx config.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18863-delete-old-logs-without-cron'
Tom Clegg [Thu, 20 Oct 2022 15:24:32 +0000 (11:24 -0400)]
Merge branch '18863-delete-old-logs-without-cron'

closes #18863

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18863: Add rest of event_type values used by crunch-run. 18863-delete-old-logs-without-cron
Tom Clegg [Thu, 20 Oct 2022 14:37:24 +0000 (10:37 -0400)]
18863: Add rest of event_type values used by crunch-run.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19501-unsetup-permissions'
Tom Clegg [Wed, 19 Oct 2022 21:19:20 +0000 (17:19 -0400)]
Merge branch '19501-unsetup-permissions'

fixes #19501

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18842: Add locking and cachedir cleanup, needs testing
Peter Amstutz [Wed, 19 Oct 2022 21:18:20 +0000 (17:18 -0400)]
18842: Add locking and cachedir cleanup, needs testing

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18842: Add disk cache, test python sdk/fuse disk_cache=true/false
Peter Amstutz [Tue, 18 Oct 2022 00:21:06 +0000 (20:21 -0400)]
18842: Add disk cache, test python sdk/fuse disk_cache=true/false

Off by default in the SDK but enabled by default with arv-mount

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Uses controller's port when running diagnostics
Lucas Di Pentima [Tue, 18 Oct 2022 17:43:05 +0000 (14:43 -0300)]
19215: Uses controller's port when running diagnostics

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19377: Fix diag sanity check. Suggest "check -yaml" on health fail.
Tom Clegg [Tue, 18 Oct 2022 17:23:26 +0000 (13:23 -0400)]
19377: Fix diag sanity check. Suggest "check -yaml" on health fail.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18863: gofmt
Tom Clegg [Tue, 18 Oct 2022 17:03:36 +0000 (13:03 -0400)]
18863: gofmt

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18863: Add tests for duration 0.
Tom Clegg [Tue, 18 Oct 2022 15:22:23 +0000 (11:22 -0400)]
18863: Add tests for duration 0.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18863: Disable container log sweep in integration test server cfg.
Tom Clegg [Tue, 18 Oct 2022 15:17:02 +0000 (11:17 -0400)]
18863: Disable container log sweep in integration test server cfg.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19215: Formatting fixes
Peter Amstutz [Mon, 17 Oct 2022 20:12:15 +0000 (16:12 -0400)]
19215: Formatting fixes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Fix note about location of keep blocks.
Peter Amstutz [Mon, 17 Oct 2022 19:58:18 +0000 (15:58 -0400)]
19215: Fix note about location of keep blocks.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Fix state creating /var/lib/aravdos/keep
Peter Amstutz [Mon, 17 Oct 2022 19:48:10 +0000 (15:48 -0400)]
19215: Fix state creating /var/lib/aravdos/keep

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Review fixes
Peter Amstutz [Mon, 17 Oct 2022 19:34:25 +0000 (15:34 -0400)]
19215: Review fixes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19582: Really sets the default UseAWSS3v2Driver value to 'true'.
Lucas Di Pentima [Mon, 17 Oct 2022 19:34:11 +0000 (16:34 -0300)]
19582: Really sets the default UseAWSS3v2Driver value to 'true'.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18863: Add upgrade note.
Tom Clegg [Mon, 17 Oct 2022 19:31:14 +0000 (15:31 -0400)]
18863: Add upgrade note.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18863: Remove obsolete test.
Tom Clegg [Mon, 17 Oct 2022 18:49:50 +0000 (14:49 -0400)]
18863: Remove obsolete test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18863: Move container log cleanup from rake task to controller.
Tom Clegg [Mon, 17 Oct 2022 18:34:32 +0000 (14:34 -0400)]
18863: Move container log cleanup from rake task to controller.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18863: Add Log methods to golang API interface.
Tom Clegg [Mon, 17 Oct 2022 18:26:16 +0000 (14:26 -0400)]
18863: Add Log methods to golang API interface.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19501: Remove all sharing permissions during unsetup. 19501-unsetup-permissions
Tom Clegg [Mon, 17 Oct 2022 14:31:37 +0000 (10:31 -0400)]
19501: Remove all sharing permissions during unsetup.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19603-installer-container-shell-fix'. Closes #19603
Lucas Di Pentima [Mon, 17 Oct 2022 13:16:41 +0000 (10:16 -0300)]
Merge branch '19603-installer-container-shell-fix'. Closes #19603

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19603: Adds upgrade note regarding this fix. 19603-installer-container-shell-fix
Lucas Di Pentima [Fri, 14 Oct 2022 20:54:08 +0000 (17:54 -0300)]
19603: Adds upgrade note regarding this fix.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18368: Add BannerURL config option
Peter Amstutz [Wed, 12 Oct 2022 20:55:06 +0000 (16:55 -0400)]
18368: Add BannerURL config option

refs #18368

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19603: Fixes nginx configs to support container shell access.
Lucas Di Pentima [Fri, 14 Oct 2022 15:17:51 +0000 (12:17 -0300)]
19603: Fixes nginx configs to support container shell access.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19377: Add diagnostics -v flag: arvados/nginx/config versions, etc.
Tom Clegg [Fri, 14 Oct 2022 15:04:01 +0000 (11:04 -0400)]
19377: Add diagnostics -v flag: arvados/nginx/config versions, etc.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19377-diagnostics-health-check'
Tom Clegg [Fri, 14 Oct 2022 13:52:08 +0000 (09:52 -0400)]
Merge branch '19377-diagnostics-health-check'

refs #19377

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19582: Enables the new keepstore S3 driver by default, updates documentation.
Lucas Di Pentima [Thu, 13 Oct 2022 20:37:56 +0000 (17:37 -0300)]
19582: Enables the new keepstore S3 driver by default, updates documentation.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '19400-login-sync-logincluster'. Closes #19400
Lucas Di Pentima [Thu, 13 Oct 2022 15:54:15 +0000 (12:54 -0300)]
Merge branch '19400-login-sync-logincluster'. Closes #19400

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19400: Adjusts dependency so this doesn't pull incompatible version 2.4.3. 19400-login-sync-logincluster
Lucas Di Pentima [Thu, 13 Oct 2022 13:56:59 +0000 (10:56 -0300)]
19400: Adjusts dependency so this doesn't pull incompatible version 2.4.3.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19400: Force Ruby SDK installation on login-sync installation before tests.
Lucas Di Pentima [Wed, 12 Oct 2022 21:24:23 +0000 (18:24 -0300)]
19400: Force Ruby SDK installation on login-sync installation before tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19400: Tests adding pre-release dependency on arvados gem.
Lucas Di Pentima [Wed, 12 Oct 2022 19:57:06 +0000 (16:57 -0300)]
19400: Tests adding pre-release dependency on arvados gem.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch 'fs-block-not-found-error'
Tom Clegg [Mon, 10 Oct 2022 15:24:31 +0000 (11:24 -0400)]
Merge branch 'fs-block-not-found-error'

fixes #19600

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoInclude relevant block ID in "block not found" error message. fs-block-not-found-error
Tom Clegg [Sat, 8 Oct 2022 01:35:36 +0000 (21:35 -0400)]
Include relevant block ID in "block not found" error message.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19377: Say "health check OK" on success. 19377-diagnostics-health-check
Tom Clegg [Thu, 6 Oct 2022 18:14:31 +0000 (14:14 -0400)]
19377: Say "health check OK" on success.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19594-user-activity-fix'. Closes #19594
Lucas Di Pentima [Thu, 6 Oct 2022 14:55:29 +0000 (11:55 -0300)]
Merge branch '19594-user-activity-fix'. Closes #19594

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19180: Document how to do various project operations with CLI
Peter Amstutz [Wed, 17 Aug 2022 21:36:11 +0000 (17:36 -0400)]
19180: Document how to do various project operations with CLI

refs #19180

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19466: Fix tests
Peter Amstutz [Thu, 6 Oct 2022 13:45:04 +0000 (09:45 -0400)]
19466: Fix tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19594: Fixes len(None) bug, improves code formatting. 19594-user-activity-fix
Lucas Di Pentima [Thu, 6 Oct 2022 13:31:11 +0000 (10:31 -0300)]
19594: Fixes len(None) bug, improves code formatting.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19466: Fixing tests
Peter Amstutz [Wed, 5 Oct 2022 21:15:45 +0000 (17:15 -0400)]
19466: Fixing tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '19418-lsf-unsatisfiable'
Tom Clegg [Wed, 5 Oct 2022 20:28:35 +0000 (16:28 -0400)]
Merge branch '19418-lsf-unsatisfiable'

fixes #19418

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19377-diagnostics-health-check'
Tom Clegg [Wed, 5 Oct 2022 20:26:59 +0000 (16:26 -0400)]
Merge branch '19377-diagnostics-health-check'

fixes #19377

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19215: Small fixes on the deploy phase.
Lucas Di Pentima [Wed, 5 Oct 2022 19:41:24 +0000 (16:41 -0300)]
19215: Small fixes on the deploy phase.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19377: Include health check in diagnostics report, if appropriate.
Tom Clegg [Tue, 4 Oct 2022 19:04:58 +0000 (15:04 -0400)]
19377: Include health check in diagnostics report, if appropriate.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19418: LSF: use InstanceTypes to detect unsatisfiable constraints. 19418-lsf-unsatisfiable
Tom Clegg [Tue, 4 Oct 2022 15:30:40 +0000 (11:30 -0400)]
19418: LSF: use InstanceTypes to detect unsatisfiable constraints.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19466: Add cwl_input and cwl_output to properties for workflow steps
Peter Amstutz [Mon, 3 Oct 2022 19:49:46 +0000 (15:49 -0400)]
19466: Add cwl_input and cwl_output to properties for workflow steps

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '19388-activity-logs'
Tom Clegg [Mon, 3 Oct 2022 19:02:03 +0000 (15:02 -0400)]
Merge branch '19388-activity-logs'

closes #19388

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19215: Add note that the single-host install isn't usable inside Docker
Peter Amstutz [Fri, 30 Sep 2022 21:27:47 +0000 (17:27 -0400)]
19215: Add note that the single-host install isn't usable inside Docker

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Explicitly use bash for bash-ism in snakeoil state
Peter Amstutz [Fri, 30 Sep 2022 21:16:43 +0000 (17:16 -0400)]
19215: Explicitly use bash for bash-ism in snakeoil state

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Making installer.sh work for single node
Peter Amstutz [Fri, 30 Sep 2022 20:49:08 +0000 (16:49 -0400)]
19215: Making installer.sh work for single node

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>