arvados.git
3 years agoAdd regexp import to fix merge mistake 2.1.2
Peter Amstutz [Mon, 22 Feb 2021 19:28:52 +0000 (14:28 -0500)]
Add regexp import to fix merge mistake

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoFix author e-mail addresses in our gemspecs.
Ward Vandewege [Fri, 23 Oct 2020 17:01:55 +0000 (13:01 -0400)]
Fix author e-mail addresses in our gemspecs.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17202: Test avoiding redirect for cross-origin inline images.
Tom Clegg [Wed, 9 Dec 2020 20:44:57 +0000 (15:44 -0500)]
17202: Test avoiding redirect for cross-origin inline images.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17202: Use explicit SameSite=Lax for 303-with-cookie.
Tom Clegg [Wed, 9 Dec 2020 14:34:14 +0000 (09:34 -0500)]
17202: Use explicit SameSite=Lax for 303-with-cookie.

This improves XSS protection on some browsers, including Safari and
Firefox for Android.

On most browsers, Lax is already the default.

https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Set-Cookie/SameSite

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17202: Bypass 303-with-token on cross-origin requests.
Tom Clegg [Wed, 9 Dec 2020 00:52:36 +0000 (19:52 -0500)]
17202: Bypass 303-with-token on cross-origin requests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17208: Update test for s3cmd's new console output.
Tom Clegg [Mon, 14 Dec 2020 20:41:33 +0000 (15:41 -0500)]
17208: Update test for s3cmd's new console output.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17208: Add test case.
Tom Clegg [Fri, 11 Dec 2020 05:43:40 +0000 (00:43 -0500)]
17208: Add test case.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17208: Use normalized path to compute signatures.
Tom Clegg [Thu, 10 Dec 2020 21:41:41 +0000 (16:41 -0500)]
17208: Use normalized path to compute signatures.

Transparently clean paths containing "//".

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17118: Changes the way exception raising is done on PySDK's KeepWriterThread.
Lucas Di Pentima [Tue, 22 Dec 2020 15:41:01 +0000 (12:41 -0300)]
17118: Changes the way exception raising is done on PySDK's KeepWriterThread.

This solves the OOM bug where some keepstores fail when uploading data.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago17161: Improve SystemRootToken docs.
Tom Clegg [Wed, 2 Dec 2020 22:14:37 +0000 (17:14 -0500)]
17161: Improve SystemRootToken docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17335: add back in AuthenticationRequestParameters due to merge issue.
Peter Amstutz [Mon, 22 Feb 2021 16:49:29 +0000 (11:49 -0500)]
17335: add back in AuthenticationRequestParameters due to merge issue.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17267: Add integration test for broken link in $schemas
Peter Amstutz [Tue, 19 Jan 2021 21:39:30 +0000 (16:39 -0500)]
17267: Add integration test for broken link in $schemas

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17267: Don't immediately fail if an extension schema is missing
Peter Amstutz [Mon, 18 Jan 2021 19:36:07 +0000 (14:36 -0500)]
17267: Don't immediately fail if an extension schema is missing

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17224: Document LoginCluster configuration for login-sync
Peter Amstutz [Wed, 6 Jan 2021 21:39:19 +0000 (16:39 -0500)]
17224: Document LoginCluster configuration for login-sync

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17224: Provide alternate credentials to use for creating user tokens
Peter Amstutz [Wed, 23 Dec 2020 21:19:39 +0000 (16:19 -0500)]
17224: Provide alternate credentials to use for creating user tokens

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17224: Fix to have multiple clients connected to separate clusters
Peter Amstutz [Sat, 2 Jan 2021 16:59:57 +0000 (11:59 -0500)]
17224: Fix to have multiple clients connected to separate clusters

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoFix arvados-src package version generation.
Ward Vandewege [Wed, 23 Dec 2020 16:58:03 +0000 (11:58 -0500)]
Fix arvados-src package version generation.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoAdd missing file closes #17281
Peter Amstutz [Mon, 25 Jan 2021 20:26:54 +0000 (15:26 -0500)]
Add missing file closes #17281

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17293: Update trash_at/deleted_at even on MarshalManifest error
Peter Amstutz [Fri, 29 Jan 2021 20:54:41 +0000 (15:54 -0500)]
17293: Update trash_at/deleted_at even on MarshalManifest error

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoWarn about missing/short secrets. Delete Rails session key.
Tom Clegg [Mon, 7 Dec 2020 19:53:05 +0000 (14:53 -0500)]
Warn about missing/short secrets. Delete Rails session key.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17295: Adds cluster ID validation on the config file.
Lucas Di Pentima [Fri, 19 Feb 2021 15:48:32 +0000 (12:48 -0300)]
17295: Adds cluster ID validation on the config file.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago17295: Adds tests exposing the bug.
Lucas Di Pentima [Fri, 19 Feb 2021 15:45:11 +0000 (12:45 -0300)]
17295: Adds tests exposing the bug.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago17384: Respect CrunchRunCommand and CrunchRunArgumentsList in a-d-c.
Tom Clegg [Mon, 15 Feb 2021 16:06:35 +0000 (11:06 -0500)]
17384: Respect CrunchRunCommand and CrunchRunArgumentsList in a-d-c.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoUpdate error regexp in test case.
Tom Clegg [Wed, 2 Dec 2020 14:30:55 +0000 (09:30 -0500)]
Update error regexp in test case.

refs #17009

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17335: Fix panic when OIDC provider returns no name claim.
Tom Clegg [Mon, 15 Feb 2021 04:00:40 +0000 (23:00 -0500)]
17335: Fix panic when OIDC provider returns no name claim.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17355: keepstore should take the volume's AccessViaHosts ReadOnly flag
Ward Vandewege [Tue, 9 Feb 2021 20:14:10 +0000 (15:14 -0500)]
17355: keepstore should take the volume's AccessViaHosts ReadOnly flag
       into account when reporting ReadOnly status of a volume on
       startup.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17340: arvados-dispatch-cloud should take the Containers.ReserveExtraRAM
Ward Vandewege [Thu, 4 Feb 2021 19:07:10 +0000 (14:07 -0500)]
17340: arvados-dispatch-cloud should take the Containers.ReserveExtraRAM
       configuration parameter into account when choosing a node size.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agofeat(crunch-dispatch-local): add crunch-run dependency
Javier Bértoli [Mon, 26 Oct 2020 15:28:29 +0000 (12:28 -0300)]
feat(crunch-dispatch-local): add crunch-run dependency

refs #16995
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agofix(crunch-dispatch-local): add missing service file
Javier Bértoli [Mon, 19 Oct 2020 13:06:18 +0000 (10:06 -0300)]
fix(crunch-dispatch-local): add missing service file

refs #16996
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago16774: text/plain response uses crlf. Tests check error codes.
Peter Amstutz [Tue, 24 Nov 2020 18:40:21 +0000 (13:40 -0500)]
16774: text/plain response uses crlf.  Tests check error codes.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16774: Fix tests. Use encoder for xml error response.
Peter Amstutz [Mon, 23 Nov 2020 20:04:48 +0000 (15:04 -0500)]
16774: Fix tests.  Use encoder for xml error response.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16774: Keep-web errors include messages
Peter Amstutz [Fri, 20 Nov 2020 23:03:30 +0000 (18:03 -0500)]
16774: Keep-web errors include messages

Errors on the regular keep-web side return plain text responses.

Errors on the S3 side return XML error responses that S3 clients
expect.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17015: Ensure that containers belong to this cluster
Peter Amstutz [Thu, 19 Nov 2020 20:36:29 +0000 (15:36 -0500)]
17015: Ensure that containers belong to this cluster

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17009: Fix s3 ListObjects endpoint with vhost-style requests.
Tom Clegg [Wed, 2 Dec 2020 22:36:35 +0000 (17:36 -0500)]
17009: Fix s3 ListObjects endpoint with vhost-style requests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17009: Test virtual host-style S3 requests.
Tom Clegg [Thu, 3 Dec 2020 21:24:37 +0000 (16:24 -0500)]
17009: Test virtual host-style S3 requests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17009: Fix bucket-level ops using virtual host-style requests.
Tom Clegg [Wed, 25 Nov 2020 17:14:34 +0000 (12:14 -0500)]
17009: Fix bucket-level ops using virtual host-style requests.

refs #17009

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17009: Mention S3 considerations in keep-web install doc.
Tom Clegg [Thu, 19 Nov 2020 21:48:15 +0000 (16:48 -0500)]
17009: Mention S3 considerations in keep-web install doc.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17009: Support accessing S3 with virtual hosted-style URLs.
Tom Clegg [Wed, 18 Nov 2020 22:35:29 +0000 (17:35 -0500)]
17009: Support accessing S3 with virtual hosted-style URLs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16106: address review comments.
Ward Vandewege [Mon, 11 Jan 2021 14:16:58 +0000 (09:16 -0500)]
16106: address review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16106: update Azure preemptible node code after real world testing. Add
Ward Vandewege [Thu, 7 Jan 2021 18:40:53 +0000 (13:40 -0500)]
16106: update Azure preemptible node code after real world testing. Add
       documentation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16106: add Azure spot instance support.
Ward Vandewege [Sat, 3 Oct 2020 00:49:22 +0000 (20:49 -0400)]
16106: add Azure spot instance support.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17215: add IAM role support to arvados-dispatch-cloud on EC2.
Ward Vandewege [Wed, 20 Jan 2021 21:16:11 +0000 (16:16 -0500)]
17215: add IAM role support to arvados-dispatch-cloud on EC2.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoDocumentation: fix typo.
Ward Vandewege [Fri, 12 Feb 2021 02:53:52 +0000 (21:53 -0500)]
Documentation: fix typo.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17335-backport-2.1' into 2.1-dev
Tom Clegg [Tue, 9 Feb 2021 16:41:47 +0000 (11:41 -0500)]
Merge branch '17335-backport-2.1' into 2.1-dev

refs #17335

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17335: documentation: fix broken link. 17335-backport-2.1
Ward Vandewege [Tue, 9 Feb 2021 14:18:03 +0000 (09:18 -0500)]
17335: documentation: fix broken link.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoDocumentation: add a default base_url to the Rakefile to simplify
Ward Vandewege [Mon, 1 Feb 2021 19:03:01 +0000 (14:03 -0500)]
Documentation: add a default base_url to the Rakefile to simplify
running linkchecker.

refs #17245

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17335: Configurable auth params for OIDC and Google.
Tom Clegg [Thu, 4 Feb 2021 17:11:02 +0000 (12:11 -0500)]
17335: Configurable auth params for OIDC and Google.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoThe configuration parameter is MaxKeepBlobBuffers, not MaxBuffers.
Ward Vandewege [Fri, 5 Feb 2021 00:31:58 +0000 (19:31 -0500)]
The configuration parameter is MaxKeepBlobBuffers, not MaxBuffers.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17255: Document the "can_login" permission link in the API section.
Ward Vandewege [Fri, 29 Jan 2021 22:02:57 +0000 (17:02 -0500)]
17255: Document the "can_login" permission link in the API section.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17245: documenation: re-add a modified version of our Slurm
Ward Vandewege [Fri, 29 Jan 2021 20:49:42 +0000 (15:49 -0500)]
17245: documenation: re-add a modified version of our Slurm
       configuration page to the index. Re-organize the index a bit to
       make the separation between cloud and Slurm dispatching more
       obvious.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoDocumentation: reflect the current state of anonymous token generation.
Ward Vandewege [Thu, 28 Jan 2021 00:36:49 +0000 (19:36 -0500)]
Documentation: reflect the current state of anonymous token generation.

refs #16726

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoDocumentation: the Arvados SSO server is deprecated, it is not the
Ward Vandewege [Wed, 27 Jan 2021 14:49:18 +0000 (09:49 -0500)]
Documentation: the Arvados SSO server is deprecated, it is not the
default anymore.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMake sure that our Python 3 based packages conflict with the older
Ward Vandewege [Fri, 22 Jan 2021 17:29:07 +0000 (12:29 -0500)]
Make sure that our Python 3 based packages conflict with the older
Python 2 based ones.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17222: implement review feedback.
Ward Vandewege [Wed, 20 Jan 2021 21:39:54 +0000 (16:39 -0500)]
17222: implement review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17222: add overview documentation for the components of Keep.
Ward Vandewege [Wed, 20 Jan 2021 18:38:20 +0000 (13:38 -0500)]
17222: add overview documentation for the components of Keep.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoDocumentation: make the arvados-dispatch-cloud installation instructions
Ward Vandewege [Wed, 13 Jan 2021 21:37:48 +0000 (16:37 -0500)]
Documentation: make the arvados-dispatch-cloud installation instructions
a bit more clear.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoDocumentation: fix typos.
Ward Vandewege [Wed, 6 Jan 2021 19:46:06 +0000 (14:46 -0500)]
Documentation: fix typos.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoWe've made a change in the structure of our apt repositories.
Ward Vandewege [Tue, 22 Dec 2020 19:52:26 +0000 (14:52 -0500)]
We've made a change in the structure of our apt repositories.

refs #17218

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoNow that our k8s helm charts retain state, update the documentation
Ward Vandewege [Mon, 30 Nov 2020 16:55:41 +0000 (11:55 -0500)]
Now that our k8s helm charts retain state, update the documentation
accordingly.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoDocumentation cleanups.
Ward Vandewege [Tue, 24 Nov 2020 18:17:44 +0000 (13:17 -0500)]
Documentation cleanups.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17154: Add comment. Use strings.HasPrefix
Peter Amstutz [Mon, 23 Nov 2020 15:59:06 +0000 (10:59 -0500)]
17154: Add comment.  Use strings.HasPrefix

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17154: Copy updates on federated users to local cluster
Peter Amstutz [Fri, 20 Nov 2020 21:01:25 +0000 (16:01 -0500)]
17154: Copy updates on federated users to local cluster

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17154: Make sure most current user record is loaded.
Peter Amstutz [Fri, 20 Nov 2020 20:25:27 +0000 (15:25 -0500)]
17154: Make sure most current user record is loaded.

Convert 'option' items (which are symbols) to strings for value comparison

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMove the handle_python_package() function from run-library.sh to
Ward Vandewege [Sun, 22 Nov 2020 13:35:06 +0000 (08:35 -0500)]
Move the handle_python_package() function from run-library.sh to
run-build-packages-python-and-ruby.sh, it is only used in the latter.
Update it to call python3 instead of just 'python'.

refs #15888

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoRemove one more python2 remnant. This is a fix for the
Ward Vandewege [Fri, 20 Nov 2020 22:31:50 +0000 (17:31 -0500)]
Remove one more python2 remnant. This is a fix for the
python3-arvados-cwl-runner package, it now installs /usr/bin/cwltool
again.

refs #15888

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17111: Deselect unsigned_manifest_text by default in groups#contents. 2.1.1
Tom Clegg [Fri, 13 Nov 2020 20:44:43 +0000 (15:44 -0500)]
17111: Deselect unsigned_manifest_text by default in groups#contents.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoFix require path in the 'script/rails' script for api server.
Ward Vandewege [Fri, 6 Nov 2020 13:34:38 +0000 (08:34 -0500)]
Fix require path in the 'script/rails' script for api server.

closes #17094

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17090: Migration to refresh_permissions
Peter Amstutz [Thu, 5 Nov 2020 19:55:35 +0000 (14:55 -0500)]
17090: Migration to refresh_permissions

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17090: Use EXCLUSIVE lock for permission updates
Peter Amstutz [Thu, 5 Nov 2020 16:09:30 +0000 (11:09 -0500)]
17090: Use EXCLUSIVE lock for permission updates

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17040: Update structure.sql
Peter Amstutz [Tue, 3 Nov 2020 18:01:57 +0000 (13:01 -0500)]
17040: Update structure.sql

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17040: RefreshTrashedGroups migration, clear_permissions calls forget_cached_group_perms
Peter Amstutz [Tue, 3 Nov 2020 17:12:59 +0000 (12:12 -0500)]
17040: RefreshTrashedGroups migration, clear_permissions calls forget_cached_group_perms

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17040: Cache results of User.group_permissions
Peter Amstutz [Mon, 2 Nov 2020 21:20:02 +0000 (16:20 -0500)]
17040: Cache results of User.group_permissions

When requesting a list of groups (either directly, or with the
"shared" endpoint) it calls writable_by for each group.  This
indirectly calls User.group_permissions, which makes a database query.
When it does this for every group (with a database query each time),
which gets very expensive.

To address this, this commit caches the result of group_permissions on
the user object.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17040: Get user_uuids and embed them as a constant in the main query
Peter Amstutz [Mon, 2 Nov 2020 19:25:28 +0000 (14:25 -0500)]
17040: Get user_uuids and embed them as a constant in the main query

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17040: Refactor trash check
Peter Amstutz [Tue, 27 Oct 2020 02:55:46 +0000 (22:55 -0400)]
17040: Refactor trash check

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17040: Swap the order of where clauses in the readable_by query
Peter Amstutz [Fri, 23 Oct 2020 00:44:15 +0000 (20:44 -0400)]
17040: Swap the order of where clauses in the readable_by query

This seems work around a query planner bug in Postgres 9.5.

A hotfix provided to a customer resulted in dramatically better
performance.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agodocumentation: Mention distribution packages on the "Install the Slurm
Ward Vandewege [Tue, 27 Oct 2020 15:23:05 +0000 (11:23 -0400)]
documentation: Mention distribution packages on the "Install the Slurm
dispatcher" page.

closes #16883

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16930: remove local 'latest' tag before pushing.
Ward Vandewege [Fri, 23 Oct 2020 18:31:14 +0000 (14:31 -0400)]
16930: remove local 'latest' tag before pushing.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17010: Use !! instead of (? true : false)
Peter Amstutz [Thu, 22 Oct 2020 18:44:37 +0000 (14:44 -0400)]
17010: Use !! instead of (? true : false)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17010: Don't double up --enable-reuse
Peter Amstutz [Thu, 22 Oct 2020 02:27:14 +0000 (22:27 -0400)]
17010: Don't double up --enable-reuse

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17010: Fix tests. Tests check that --enable-reuse is set
Peter Amstutz [Thu, 22 Oct 2020 02:16:26 +0000 (22:16 -0400)]
17010: Fix tests.  Tests check that --enable-reuse is set

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17010: Fix tests
Peter Amstutz [Wed, 21 Oct 2020 21:19:05 +0000 (17:19 -0400)]
17010: Fix tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17010: Fix debug comment
Peter Amstutz [Wed, 21 Oct 2020 20:37:17 +0000 (16:37 -0400)]
17010: Fix debug comment

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17010: When running workflow from workbench, enable reuse by default
Peter Amstutz [Wed, 21 Oct 2020 20:13:50 +0000 (16:13 -0400)]
17010: When running workflow from workbench, enable reuse by default

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17010: Redesign "Re-run..." button to choose project to run in
Peter Amstutz [Wed, 21 Oct 2020 20:02:12 +0000 (16:02 -0400)]
17010: Redesign "Re-run..." button to choose project to run in

Also move workflow step reuse to the "Inputs" tab instead of a modal.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '16471-install-using-salt' into 2.1-dev
Ward Vandewege [Wed, 21 Oct 2020 16:08:03 +0000 (12:08 -0400)]
Merge branch '16471-install-using-salt' into 2.1-dev

refs #16471

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16930: make run-build-docker-images.sh a little smarter, allow building
Ward Vandewege [Wed, 21 Oct 2020 16:06:26 +0000 (12:06 -0400)]
16930: make run-build-docker-images.sh a little smarter, allow building
           just one type of arvbox images (part 2).

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16930: make run-build-docker-images.sh a little smarter, allow building
Ward Vandewege [Wed, 21 Oct 2020 15:10:00 +0000 (11:10 -0400)]
16930: make run-build-docker-images.sh a little smarter, allow building
       just one type of arvbox images.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16471: documentation: clarify where the Salt scripts can be found.
Ward Vandewege [Tue, 20 Oct 2020 20:31:44 +0000 (16:31 -0400)]
16471: documentation: clarify where the Salt scripts can be found.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agodocs(salt): some minor fixes in the Salt-based installation documentation.
Javier Bértoli [Tue, 20 Oct 2020 11:12:26 +0000 (08:12 -0300)]
docs(salt): some minor fixes in the Salt-based installation documentation.

refs #16471:
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago16471: refactor documentation to reflect different Salt-based
Ward Vandewege [Mon, 19 Oct 2020 17:38:00 +0000 (13:38 -0400)]
16471: refactor documentation to reflect different Salt-based
       installation methods.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16471: fix a few typos.
Ward Vandewege [Mon, 19 Oct 2020 15:40:36 +0000 (11:40 -0400)]
16471: fix a few typos.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoCollection$create returns (vector of) ArvadosFile object
Peter Amstutz [Thu, 15 Oct 2020 16:07:33 +0000 (12:07 -0400)]
Collection$create returns (vector of) ArvadosFile object

Update documentation.

refs #16998

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoUpdate new cluster checklist to reflect the deprecation of the SSO
Ward Vandewege [Mon, 19 Oct 2020 14:24:39 +0000 (10:24 -0400)]
Update new cluster checklist to reflect the deprecation of the SSO
server.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoAdd WebDAV and S3 API documentation
Peter Amstutz [Fri, 9 Oct 2020 22:48:07 +0000 (18:48 -0400)]
Add WebDAV and S3 API documentation

Remove sections of keep-web/doc.go are now part of the API
documentation

refs #16558

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16471: Formatting fixes.
Lucas Di Pentima [Fri, 16 Oct 2020 20:30:08 +0000 (17:30 -0300)]
16471: Formatting fixes.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agodocs(provision): document initial URL
Javier Bértoli [Fri, 16 Oct 2020 19:29:51 +0000 (16:29 -0300)]
docs(provision): document initial URL

refs #16471 and #16992
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agofeat(provision): better testing config and documentation
Javier Bértoli [Fri, 16 Oct 2020 18:30:34 +0000 (15:30 -0300)]
feat(provision): better testing config and documentation

refs #16471 and #16992
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agofeat(provision): example configurations in salt
Javier Bértoli [Fri, 16 Oct 2020 16:25:31 +0000 (13:25 -0300)]
feat(provision): example configurations in salt

refs #16471 and #16992
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoFix heading for "upgrading" no issue #
Peter Amstutz [Wed, 14 Oct 2020 14:29:52 +0000 (10:29 -0400)]
Fix heading for "upgrading" no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agofeat(docs): salt install documentation
Javier Bértoli [Wed, 14 Oct 2020 13:43:32 +0000 (10:43 -0300)]
feat(docs): salt install documentation
refs #16471 and #16992
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>