arvados.git
3 years ago17779: Fix invalid manifest throwing IOError instead of SyntaxError.
Tom Clegg [Wed, 29 Sep 2021 02:05:36 +0000 (22:05 -0400)]
17779: Fix invalid manifest throwing IOError instead of SyntaxError.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17779: Fix misleading "error processing manifest" after IO errors.
Tom Clegg [Tue, 28 Sep 2021 18:25:47 +0000 (14:25 -0400)]
17779: Fix misleading "error processing manifest" after IO errors.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17779: Include request ID in exception messages.
Tom Clegg [Tue, 28 Sep 2021 18:24:55 +0000 (14:24 -0400)]
17779: Include request ID in exception messages.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoUpdate installer and images to Go 1.17.1.
Tom Clegg [Fri, 24 Sep 2021 20:32:34 +0000 (16:32 -0400)]
Update installer and images to Go 1.17.1.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoUpdate go build tags to go1.17.1 gofmt.
Tom Clegg [Fri, 24 Sep 2021 20:29:59 +0000 (16:29 -0400)]
Update go build tags to go1.17.1 gofmt.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoUpdate (unused?) scopes in our discovery doc to have arvados.org URLs.
Ward Vandewege [Fri, 24 Sep 2021 15:22:36 +0000 (11:22 -0400)]
Update (unused?) scopes in our discovery doc to have arvados.org URLs.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoUpdate a few more old domain references.
Ward Vandewege [Fri, 24 Sep 2021 15:21:00 +0000 (11:21 -0400)]
Update a few more old domain references.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '18184-singularity-374'
Tom Clegg [Fri, 24 Sep 2021 15:03:52 +0000 (11:03 -0400)]
Merge branch '18184-singularity-374'

refs #18184

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoUpdate a few remaining Jenkins references to ci.arvados.org.
Ward Vandewege [Fri, 24 Sep 2021 15:02:19 +0000 (11:02 -0400)]
Update a few remaining Jenkins references to ci.arvados.org.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoWe now have the auto-redirect behavior on https://arvadosapi.com/
Ward Vandewege [Fri, 24 Sep 2021 14:52:53 +0000 (10:52 -0400)]
We now have the auto-redirect behavior on https://arvadosapi.com/

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFixes the 'branchname' variable setting used on salt doc pages. Refs #18130
Lucas Di Pentima [Tue, 21 Sep 2021 18:50:42 +0000 (15:50 -0300)]
Fixes the 'branchname' variable setting used on salt doc pages. Refs #18130

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoMerge branch '13697-database-timeout'
Tom Clegg [Thu, 23 Sep 2021 21:01:53 +0000 (17:01 -0400)]
Merge branch '13697-database-timeout'

fixes #13697

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago13967: Add guard comment re timing out large uploads.
Tom Clegg [Thu, 23 Sep 2021 21:01:09 +0000 (17:01 -0400)]
13967: Add guard comment re timing out large uploads.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18184: Install singularity 3.7.4 for dev/test.
Tom Clegg [Thu, 23 Sep 2021 20:53:20 +0000 (16:53 -0400)]
18184: Install singularity 3.7.4 for dev/test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoRemove -x from the salt install provision script.
Ward Vandewege [Thu, 23 Sep 2021 17:21:43 +0000 (13:21 -0400)]
Remove -x from the salt install provision script.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago13697: Do not apply RequestTimeout to hijacked connections.
Tom Clegg [Thu, 23 Sep 2021 14:46:42 +0000 (10:46 -0400)]
13697: Do not apply RequestTimeout to hijacked connections.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago13697: Remove HandlerWithContext.
Tom Clegg [Thu, 23 Sep 2021 13:44:29 +0000 (09:44 -0400)]
13697: Remove HandlerWithContext.

Use http.Server's BaseContext feature instead.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago13697: Cancel request context after API.RequestTimeout.
Tom Clegg [Thu, 23 Sep 2021 13:41:20 +0000 (09:41 -0400)]
13697: Cancel request context after API.RequestTimeout.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17749-s3-prefixes'
Tom Clegg [Thu, 23 Sep 2021 13:54:26 +0000 (09:54 -0400)]
Merge branch '17749-s3-prefixes'

closes #17749

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '8363-fuse-warnings'
Tom Clegg [Thu, 23 Sep 2021 13:49:31 +0000 (09:49 -0400)]
Merge branch '8363-fuse-warnings'

closes #8363

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '18098-log-runtime-engine'
Tom Clegg [Thu, 23 Sep 2021 13:48:56 +0000 (09:48 -0400)]
Merge branch '18098-log-runtime-engine'

closes #18098

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoFix typo.
Ward Vandewege [Thu, 23 Sep 2021 13:21:25 +0000 (09:21 -0400)]
Fix typo.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago13697: Set Rails database timeout to API.RequestTimeout config.
Tom Clegg [Wed, 22 Sep 2021 20:57:57 +0000 (16:57 -0400)]
13697: Set Rails database timeout to API.RequestTimeout config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18098: Mention runtime engine (e.g., docker) in crunch-run log.
Tom Clegg [Wed, 22 Sep 2021 20:08:50 +0000 (16:08 -0400)]
18098: Mention runtime engine (e.g., docker) in crunch-run log.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago8363: Save matching arv-mount log line in warningDetail.
Tom Clegg [Wed, 22 Sep 2021 19:34:15 +0000 (15:34 -0400)]
8363: Save matching arv-mount log line in warningDetail.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago8363: Fix spelling of errorDetail and warningDetail in docs.
Tom Clegg [Wed, 22 Sep 2021 18:32:31 +0000 (14:32 -0400)]
8363: Fix spelling of errorDetail and warningDetail in docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago8363: Update tests.
Tom Clegg [Wed, 22 Sep 2021 18:06:06 +0000 (14:06 -0400)]
8363: Update tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '18164-link-perm-read' refs #18164
Peter Amstutz [Wed, 22 Sep 2021 18:02:36 +0000 (14:02 -0400)]
Merge branch '18164-link-perm-read' refs #18164

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18164: Improve permission query for links
Peter Amstutz [Tue, 21 Sep 2021 21:01:42 +0000 (17:01 -0400)]
18164: Improve permission query for links

* Fixed so that permission links where the user can_manage the head_uuid are
visible to the user

* Add get_permissions to the API documentation for links

* Do not consider 'resource' a permission link class (as far as I know
this has never been used)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18164: Add test for listing permission links
Peter Amstutz [Tue, 21 Sep 2021 20:27:55 +0000 (16:27 -0400)]
18164: Add test for listing permission links

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago8363: Report arv-mount error messages as runtime_status warnings.
Tom Clegg [Tue, 21 Sep 2021 18:16:32 +0000 (14:16 -0400)]
8363: Report arv-mount error messages as runtime_status warnings.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '18051-blob-signing'
Tom Clegg [Tue, 21 Sep 2021 15:34:56 +0000 (11:34 -0400)]
Merge branch '18051-blob-signing'

refs #18051

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18051: Adds SignManifest benchmarking test.
Lucas Di Pentima [Tue, 21 Sep 2021 15:01:43 +0000 (12:01 -0300)]
18051: Adds SignManifest benchmarking test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17749: Document PrefixLength config.
Tom Clegg [Mon, 20 Sep 2021 21:47:07 +0000 (17:47 -0400)]
17749: Document PrefixLength config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17749: Support PrefixLength in old S3 driver.
Tom Clegg [Mon, 20 Sep 2021 21:46:46 +0000 (17:46 -0400)]
17749: Support PrefixLength in old S3 driver.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17749: Support PrefixLength in new S3 driver.
Tom Clegg [Mon, 20 Sep 2021 21:46:43 +0000 (17:46 -0400)]
17749: Support PrefixLength in new S3 driver.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoAdjust version pins on google-auth and ruamel.yaml
Peter Amstutz [Mon, 20 Sep 2021 20:52:33 +0000 (16:52 -0400)]
Adjust version pins on google-auth and ruamel.yaml

refs #18002

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '18122-select-param'
Tom Clegg [Mon, 20 Sep 2021 14:22:39 +0000 (10:22 -0400)]
Merge branch '18122-select-param'

closes #18122

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '18051-webdav-cache'
Tom Clegg [Mon, 20 Sep 2021 14:12:05 +0000 (10:12 -0400)]
Merge branch '18051-webdav-cache'

refs #18051

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18051: Reduce string operations/allocs in blob signing.
Tom Clegg [Mon, 20 Sep 2021 14:10:16 +0000 (10:10 -0400)]
18051: Reduce string operations/allocs in blob signing.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '18097-sync-groups-case-insensitive' into main. Closes #18097
Lucas Di Pentima [Mon, 20 Sep 2021 13:58:44 +0000 (10:58 -0300)]
Merge branch '18097-sync-groups-case-insensitive' into main. Closes #18097

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoRevert "Change upper version bound for ruamel.yaml to <0.18"
Peter Amstutz [Mon, 20 Sep 2021 13:46:35 +0000 (09:46 -0400)]
Revert "Change upper version bound for ruamel.yaml to <0.18"

This reverts commit 1c7420e1ed282e42907b108ce83dc8ce6edef904.

Needs to match cwltool ruamel version spec to avoid breaking arvados-cwl-runner.

refs #18002

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18122: Clarify select param behavior in "get collection by pdh" API.
Tom Clegg [Mon, 20 Sep 2021 13:44:58 +0000 (09:44 -0400)]
18122: Clarify select param behavior in "get collection by pdh" API.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18122: Add descriptions for select params in discovery doc.
Tom Clegg [Mon, 20 Sep 2021 13:37:53 +0000 (09:37 -0400)]
18122: Add descriptions for select params in discovery doc.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18122: Fix stutter in docs.
Tom Clegg [Mon, 20 Sep 2021 13:34:35 +0000 (09:34 -0400)]
18122: Fix stutter in docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18097: Adds more tests.
Lucas Di Pentima [Fri, 17 Sep 2021 14:44:11 +0000 (11:44 -0300)]
18097: Adds more tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoChange upper version bound for ruamel.yaml to <0.18
Peter Amstutz [Fri, 17 Sep 2021 13:16:32 +0000 (09:16 -0400)]
Change upper version bound for ruamel.yaml to <0.18

refs #18002

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18097: Adds logic for the "-case-insensitive" flag. Makes new test pass.
Lucas Di Pentima [Thu, 16 Sep 2021 22:33:26 +0000 (19:33 -0300)]
18097: Adds logic for the "-case-insensitive" flag. Makes new test pass.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoMerge branch '18051-collectionfs'
Tom Clegg [Thu, 16 Sep 2021 20:34:57 +0000 (16:34 -0400)]
Merge branch '18051-collectionfs'

refs #18051

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18097: Accept '-case-insensitive' flag on sync-groups. Adds test.
Lucas Di Pentima [Thu, 16 Sep 2021 18:35:09 +0000 (15:35 -0300)]
18097: Accept '-case-insensitive' flag on sync-groups. Adds test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoMerge branch '17770-fix-logging-while-throttled'
Ward Vandewege [Thu, 16 Sep 2021 17:47:20 +0000 (13:47 -0400)]
Merge branch '17770-fix-logging-while-throttled'

closes #17770

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18122: Fix "get collection by pdh" when manifest_text is unselected.
Tom Clegg [Thu, 16 Sep 2021 17:15:29 +0000 (13:15 -0400)]
18122: Fix "get collection by pdh" when manifest_text is unselected.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18122: Don't fail on PDH mismatch when manifest_text is missing.
Tom Clegg [Thu, 16 Sep 2021 17:11:57 +0000 (13:11 -0400)]
18122: Don't fail on PDH mismatch when manifest_text is missing.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17770: while throttled, do not log that instances are being created when
Ward Vandewege [Thu, 16 Sep 2021 16:48:12 +0000 (12:48 -0400)]
17770: while throttled, do not log that instances are being created when
       they are not.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18122: Update test.
Tom Clegg [Thu, 16 Sep 2021 16:09:30 +0000 (12:09 -0400)]
18122: Update test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18122: Update "distinct" docs (default is false) and tidy up code.
Tom Clegg [Thu, 16 Sep 2021 13:54:38 +0000 (09:54 -0400)]
18122: Update "distinct" docs (default is false) and tidy up code.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18122: Update API docs.
Tom Clegg [Thu, 16 Sep 2021 13:39:18 +0000 (09:39 -0400)]
18122: Update API docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18051: Remove unused MaxPermissionEntries config.
Tom Clegg [Thu, 16 Sep 2021 14:05:08 +0000 (10:05 -0400)]
18051: Remove unused MaxPermissionEntries config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '18002-update-python-deps' into main refs #18002
Peter Amstutz [Thu, 16 Sep 2021 13:35:29 +0000 (09:35 -0400)]
Merge branch '18002-update-python-deps' into main refs #18002

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18002: Remove obsolete extras_require for Python 2
Peter Amstutz [Thu, 16 Sep 2021 13:34:53 +0000 (09:34 -0400)]
18002: Remove obsolete extras_require for Python 2

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18051: Add debug logging for webdav cache.
Tom Clegg [Wed, 15 Sep 2021 20:24:50 +0000 (16:24 -0400)]
18051: Add debug logging for webdav cache.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18051: Add logging capability to webdav cache.
Tom Clegg [Wed, 15 Sep 2021 19:45:40 +0000 (15:45 -0400)]
18051: Add logging capability to webdav cache.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18051: Fix premature ejection from WebDAV collection cache.
Tom Clegg [Wed, 15 Sep 2021 07:21:45 +0000 (03:21 -0400)]
18051: Fix premature ejection from WebDAV collection cache.

Avoid multiple concurrent cache sweeps.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18122: Accept "select" param in get/update/delete calls.
Tom Clegg [Wed, 15 Sep 2021 19:44:21 +0000 (15:44 -0400)]
18122: Accept "select" param in get/update/delete calls.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18002: Fixes for cwltool update
Peter Amstutz [Wed, 15 Sep 2021 19:33:50 +0000 (15:33 -0400)]
18002: Fixes for cwltool update

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18002: Updating Python dependencies WIP
Peter Amstutz [Wed, 15 Sep 2021 17:41:02 +0000 (13:41 -0400)]
18002: Updating Python dependencies WIP

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '14018-acr-set-container-properties' into main
Peter Amstutz [Tue, 14 Sep 2021 20:08:12 +0000 (16:08 -0400)]
Merge branch '14018-acr-set-container-properties' into main

refs #14018

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '18126-unpin-python-rsa' into main. Closes #18126
Lucas Di Pentima [Tue, 14 Sep 2021 14:04:43 +0000 (11:04 -0300)]
Merge branch '18126-unpin-python-rsa' into main. Closes #18126

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago18126: Unpins python-rsa since python2 support is no longer needed.
Lucas Di Pentima [Tue, 14 Sep 2021 13:35:52 +0000 (10:35 -0300)]
18126: Unpins python-rsa since python2 support is no longer needed.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago14018: Add missing file. Remove debug print()
Peter Amstutz [Mon, 13 Sep 2021 16:23:37 +0000 (12:23 -0400)]
14018: Add missing file.  Remove debug print()

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '17960-arv-copy-projects-doc' into main refs #17960
Peter Amstutz [Mon, 13 Sep 2021 15:47:36 +0000 (11:47 -0400)]
Merge branch '17960-arv-copy-projects-doc' into main refs #17960

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '18027-boot-probe-command' into main
Tom Clegg [Mon, 13 Sep 2021 15:40:48 +0000 (11:40 -0400)]
Merge branch '18027-boot-probe-command' into main

fixes #18027

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18051: Optimizations for collections with millions of files.
Tom Clegg [Sat, 11 Sep 2021 17:47:15 +0000 (13:47 -0400)]
18051: Optimizations for collections with millions of files.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18051: Speed up manifest parsing with bytes.Split.
Tom Clegg [Fri, 10 Sep 2021 15:24:52 +0000 (11:24 -0400)]
18051: Speed up manifest parsing with bytes.Split.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18051: Add manifest-parsing / fs-building benchmark.
Tom Clegg [Fri, 10 Sep 2021 15:24:26 +0000 (11:24 -0400)]
18051: Add manifest-parsing / fs-building benchmark.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17960: Fix example uuid.
Peter Amstutz [Fri, 10 Sep 2021 21:07:48 +0000 (17:07 -0400)]
17960: Fix example uuid.

Remove legacy current token screenshot.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '17857-lsf-cpus'
Tom Clegg [Fri, 10 Sep 2021 14:27:27 +0000 (10:27 -0400)]
Merge branch '17857-lsf-cpus'

refs #17857

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17995-filter-by-comparing-attrs'
Tom Clegg [Fri, 10 Sep 2021 14:25:58 +0000 (10:25 -0400)]
Merge branch '17995-filter-by-comparing-attrs'

closes #17995

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '18024-no-docker-snap' into main
Peter Amstutz [Fri, 10 Sep 2021 14:21:26 +0000 (10:21 -0400)]
Merge branch '18024-no-docker-snap' into main

refs #18024

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoReleases have default version of arvbox to pull
Peter Amstutz [Thu, 9 Sep 2021 14:26:47 +0000 (10:26 -0400)]
Releases have default version of arvbox to pull

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '18102-max-dispatch-attempts'
Tom Clegg [Thu, 9 Sep 2021 18:08:13 +0000 (14:08 -0400)]
Merge branch '18102-max-dispatch-attempts'

fixes #18102

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18027: Change default boot probe to `systemctl is-system-running`.
Tom Clegg [Thu, 9 Sep 2021 18:01:59 +0000 (14:01 -0400)]
18027: Change default boot probe to `systemctl is-system-running`.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '18027-unmount-fuse'
Tom Clegg [Thu, 9 Sep 2021 15:35:52 +0000 (11:35 -0400)]
Merge branch '18027-unmount-fuse'

refs #18027

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17857: Fix bsub args so containers can use multiple CPU cores.
Tom Clegg [Thu, 9 Sep 2021 13:24:59 +0000 (09:24 -0400)]
17857: Fix bsub args so containers can use multiple CPU cores.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17960: Update arv-copy documentation about copying projects
Peter Amstutz [Wed, 8 Sep 2021 21:32:35 +0000 (17:32 -0400)]
17960: Update arv-copy documentation about copying projects

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18024: Add a note about snap packages
Peter Amstutz [Wed, 8 Sep 2021 20:09:00 +0000 (16:09 -0400)]
18024: Add a note about snap packages

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '17989-revert-pysdk-default-timeout' into main. Closes #17989
Lucas Di Pentima [Wed, 8 Sep 2021 18:43:27 +0000 (15:43 -0300)]
Merge branch '17989-revert-pysdk-default-timeout' into main. Closes #17989

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17989: Reverts default PySDK timeout to 5 minutes. Updates test.
Lucas Di Pentima [Wed, 8 Sep 2021 18:20:06 +0000 (15:20 -0300)]
17989: Reverts default PySDK timeout to 5 minutes. Updates test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoMerge branch '17989-pysdk-timeout' into main. Refs #17989
Lucas Di Pentima [Wed, 8 Sep 2021 13:55:22 +0000 (10:55 -0300)]
Merge branch '17989-pysdk-timeout' into main. Refs #17989

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17989: Reduces the manifest size limit so that it doesn't fail on extreme cases
Lucas Di Pentima [Tue, 7 Sep 2021 21:19:27 +0000 (18:19 -0300)]
17989: Reduces the manifest size limit so that it doesn't fail on extreme cases

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17989: Passes the given timeout value to api_from_config()
Lucas Di Pentima [Tue, 7 Sep 2021 21:11:30 +0000 (18:11 -0300)]
17989: Passes the given timeout value to api_from_config()

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17989: Adds test exposing the problem.
Lucas Di Pentima [Tue, 7 Sep 2021 21:10:34 +0000 (18:10 -0300)]
17989: Adds test exposing the problem.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoMerge branch '18112-ubuntu1804-bundler-fix'
Ward Vandewege [Tue, 7 Sep 2021 19:03:44 +0000 (15:03 -0400)]
Merge branch '18112-ubuntu1804-bundler-fix'

closes #18112

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18112: Merge branch 'main' into 18112-ubuntu1804-bundler-fix
Ward Vandewege [Tue, 7 Sep 2021 19:03:21 +0000 (15:03 -0400)]
18112: Merge branch 'main' into 18112-ubuntu1804-bundler-fix

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago14018: Add ProcessProperties to documentation
Peter Amstutz [Tue, 7 Sep 2021 18:59:11 +0000 (14:59 -0400)]
14018: Add ProcessProperties to documentation

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18112: add a note to the upgrade log.
Ward Vandewege [Tue, 7 Sep 2021 18:48:42 +0000 (14:48 -0400)]
18112: add a note to the upgrade log.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago14018: Add arv:ProcessProperties to all the extension schemas.
Peter Amstutz [Tue, 7 Sep 2021 18:45:40 +0000 (14:45 -0400)]
14018: Add arv:ProcessProperties to all the extension schemas.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18112: Ubuntu 18.04 comes with bundler version 1.16.1, which doesn't handle our
Ward Vandewege [Tue, 7 Sep 2021 18:06:47 +0000 (14:06 -0400)]
18112: Ubuntu 18.04 comes with bundler version 1.16.1, which doesn't handle our
current Gemfiles properly. Make our Ubuntu 18.04 distribution packages
for arvados-api-server and arvados-workbench conflict with the
ruby-bundler package to work around this issue. Our post-install scripts
install the proper version of bundler.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '18021-sort-mounts'
Tom Clegg [Tue, 7 Sep 2021 17:48:28 +0000 (13:48 -0400)]
Merge branch '18021-sort-mounts'

fixes #18021

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18021: Sort mounts to fix flaky test.
Tom Clegg [Tue, 7 Sep 2021 14:56:04 +0000 (10:56 -0400)]
18021: Sort mounts to fix flaky test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>