arvados.git
4 months agoMerge branch '21305-doc-maintenance' refs #21305 2.1-release
Peter Amstutz [Thu, 21 Dec 2023 18:51:09 +0000 (13:51 -0500)]
Merge branch '21305-doc-maintenance' refs #21305

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

22 months ago19201: add a liquid comment that explains what to do when changing the
Ward Vandewege [Fri, 17 Jun 2022 17:02:21 +0000 (13:02 -0400)]
19201: add a liquid comment that explains what to do when changing the
       div with id "old-version-warning"

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

22 months ago19201: add warning when users are viewing documentation for old Arvados
Ward Vandewege [Fri, 17 Jun 2022 13:55:07 +0000 (09:55 -0400)]
19201: add warning when users are viewing documentation for old Arvados
       versions.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agodoc: update google analytics tag, remove old shim for IE6-9.
Ward Vandewege [Thu, 14 Apr 2022 19:01:17 +0000 (15:01 -0400)]
doc: update google analytics tag, remove old shim for IE6-9.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18253: documentation updates around the Arvados GPG package signing key.
Ward Vandewege [Tue, 5 Oct 2021 21:17:48 +0000 (17:17 -0400)]
18253: documentation updates around the Arvados GPG package signing key.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoFix typo.
Ward Vandewege [Thu, 23 Sep 2021 13:21:54 +0000 (09:21 -0400)]
Fix typo.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago17738: Fixes the issue by strip!()ing a mutable version of OS_VERSION.
Lucas Di Pentima [Thu, 27 May 2021 14:28:50 +0000 (11:28 -0300)]
17738: Fixes the issue by strip!()ing a mutable version of OS_VERSION.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoDocumentation: fix typos.
Ward Vandewege [Fri, 14 May 2021 22:12:37 +0000 (18:12 -0400)]
Documentation: fix typos.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMention the 'Rendezvous' parameter on Keepstore's InternalURLs, for
Ward Vandewege [Fri, 14 May 2021 17:40:40 +0000 (13:40 -0400)]
Mention the 'Rendezvous' parameter on Keepstore's InternalURLs, for
migration from old config.

refs #13647

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoFix typo in a comment on the configuration reference.
Ward Vandewege [Wed, 12 May 2021 17:20:56 +0000 (13:20 -0400)]
Fix typo in a comment on the configuration reference.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoThe sks-keyservers network is dying. Update our documentation to use
Ward Vandewege [Thu, 29 Apr 2021 01:28:04 +0000 (21:28 -0400)]
The sks-keyservers network is dying. Update our documentation to use
pgp.mit.edu instead.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoAdd a note about the python 3 package names in the upgrade guide.
Ward Vandewege [Tue, 13 Apr 2021 14:55:24 +0000 (10:55 -0400)]
Add a note about the python 3 package names in the upgrade guide.

refs #17498

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17495: fix typo.
Ward Vandewege [Tue, 23 Mar 2021 20:27:10 +0000 (16:27 -0400)]
17495: fix typo.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17495: document the deduplication report. Fix example invocation in the
Ward Vandewege [Tue, 23 Mar 2021 18:49:46 +0000 (14:49 -0400)]
17495: document the deduplication report. Fix example invocation in the
       cli help.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago10458: implement review feedback.
Ward Vandewege [Fri, 19 Mar 2021 20:01:14 +0000 (16:01 -0400)]
10458: implement review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago10458: add some basic documentation for crunchstat-summary.
Ward Vandewege [Fri, 19 Mar 2021 17:07:52 +0000 (13:07 -0400)]
10458: add some basic documentation for crunchstat-summary.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoDocumentation: fix copy/paste error in keep-web installation
Ward Vandewege [Wed, 10 Mar 2021 22:12:33 +0000 (17:12 -0500)]
Documentation: fix copy/paste error in keep-web installation
instructions. Add missing word in keepproxy installation instructions.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16745: Update test.
Tom Clegg [Wed, 3 Mar 2021 15:05:02 +0000 (10:05 -0500)]
16745: Update test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago16745: Rename session cache size metric.
Tom Clegg [Wed, 3 Mar 2021 03:25:11 +0000 (22:25 -0500)]
16745: Rename session cache size metric.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago16745: Reject unsupported APIs instead of mishandling.
Tom Clegg [Tue, 2 Mar 2021 21:27:18 +0000 (16:27 -0500)]
16745: Reject unsupported APIs instead of mishandling.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago16745: Handle GetBucketLocation API.
Tom Clegg [Tue, 2 Mar 2021 16:12:11 +0000 (11:12 -0500)]
16745: Handle GetBucketLocation API.

Previously misinterpreted as ListObjects with no delimiter, which is
very slow.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago16745: Don't store nil in an atomic.Value (panic).
Tom Clegg [Tue, 2 Mar 2021 14:55:16 +0000 (09:55 -0500)]
16745: Don't store nil in an atomic.Value (panic).

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago16745: Prune enough sessions to reach size limit, not all.
Tom Clegg [Tue, 23 Feb 2021 02:46:27 +0000 (21:46 -0500)]
16745: Prune enough sessions to reach size limit, not all.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago16745: Keep a SiteFileSystem alive for multiple read requests.
Tom Clegg [Mon, 22 Feb 2021 16:10:10 +0000 (11:10 -0500)]
16745: Keep a SiteFileSystem alive for multiple read requests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17256: Changes required nodejs version on package building scripts.
Lucas Di Pentima [Thu, 21 Jan 2021 22:46:22 +0000 (19:46 -0300)]
17256: Changes required nodejs version on package building scripts.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago17256: Makes arvados-server install to ask for node v10.x
Lucas Di Pentima [Thu, 21 Jan 2021 20:39:31 +0000 (17:39 -0300)]
17256: Makes arvados-server install to ask for node v10.x

This is to be able to run wb2 integration tests with Cypress v6.x

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoWhen a compute node comes up, we run `mkfs.xfs` on a newly encrypted
Ward Vandewege [Thu, 25 Feb 2021 22:52:24 +0000 (17:52 -0500)]
When a compute node comes up, we run `mkfs.xfs` on a newly encrypted
partition. Sometimes there are ghost filesystem signatures on those
partitions, make mkfs.xfs ignore partition signatures.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoAdd regexp import to fix merge mistake 2.1.2
Peter Amstutz [Mon, 22 Feb 2021 19:28:52 +0000 (14:28 -0500)]
Add regexp import to fix merge mistake

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoFix author e-mail addresses in our gemspecs.
Ward Vandewege [Fri, 23 Oct 2020 17:01:55 +0000 (13:01 -0400)]
Fix author e-mail addresses in our gemspecs.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17202: Test avoiding redirect for cross-origin inline images.
Tom Clegg [Wed, 9 Dec 2020 20:44:57 +0000 (15:44 -0500)]
17202: Test avoiding redirect for cross-origin inline images.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17202: Use explicit SameSite=Lax for 303-with-cookie.
Tom Clegg [Wed, 9 Dec 2020 14:34:14 +0000 (09:34 -0500)]
17202: Use explicit SameSite=Lax for 303-with-cookie.

This improves XSS protection on some browsers, including Safari and
Firefox for Android.

On most browsers, Lax is already the default.

https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Set-Cookie/SameSite

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17202: Bypass 303-with-token on cross-origin requests.
Tom Clegg [Wed, 9 Dec 2020 00:52:36 +0000 (19:52 -0500)]
17202: Bypass 303-with-token on cross-origin requests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17208: Update test for s3cmd's new console output.
Tom Clegg [Mon, 14 Dec 2020 20:41:33 +0000 (15:41 -0500)]
17208: Update test for s3cmd's new console output.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17208: Add test case.
Tom Clegg [Fri, 11 Dec 2020 05:43:40 +0000 (00:43 -0500)]
17208: Add test case.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17208: Use normalized path to compute signatures.
Tom Clegg [Thu, 10 Dec 2020 21:41:41 +0000 (16:41 -0500)]
17208: Use normalized path to compute signatures.

Transparently clean paths containing "//".

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17118: Changes the way exception raising is done on PySDK's KeepWriterThread.
Lucas Di Pentima [Tue, 22 Dec 2020 15:41:01 +0000 (12:41 -0300)]
17118: Changes the way exception raising is done on PySDK's KeepWriterThread.

This solves the OOM bug where some keepstores fail when uploading data.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago17161: Improve SystemRootToken docs.
Tom Clegg [Wed, 2 Dec 2020 22:14:37 +0000 (17:14 -0500)]
17161: Improve SystemRootToken docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17335: add back in AuthenticationRequestParameters due to merge issue.
Peter Amstutz [Mon, 22 Feb 2021 16:49:29 +0000 (11:49 -0500)]
17335: add back in AuthenticationRequestParameters due to merge issue.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17267: Add integration test for broken link in $schemas
Peter Amstutz [Tue, 19 Jan 2021 21:39:30 +0000 (16:39 -0500)]
17267: Add integration test for broken link in $schemas

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17267: Don't immediately fail if an extension schema is missing
Peter Amstutz [Mon, 18 Jan 2021 19:36:07 +0000 (14:36 -0500)]
17267: Don't immediately fail if an extension schema is missing

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17224: Document LoginCluster configuration for login-sync
Peter Amstutz [Wed, 6 Jan 2021 21:39:19 +0000 (16:39 -0500)]
17224: Document LoginCluster configuration for login-sync

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17224: Provide alternate credentials to use for creating user tokens
Peter Amstutz [Wed, 23 Dec 2020 21:19:39 +0000 (16:19 -0500)]
17224: Provide alternate credentials to use for creating user tokens

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17224: Fix to have multiple clients connected to separate clusters
Peter Amstutz [Sat, 2 Jan 2021 16:59:57 +0000 (11:59 -0500)]
17224: Fix to have multiple clients connected to separate clusters

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoFix arvados-src package version generation.
Ward Vandewege [Wed, 23 Dec 2020 16:58:03 +0000 (11:58 -0500)]
Fix arvados-src package version generation.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoAdd missing file closes #17281
Peter Amstutz [Mon, 25 Jan 2021 20:26:54 +0000 (15:26 -0500)]
Add missing file closes #17281

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17293: Update trash_at/deleted_at even on MarshalManifest error
Peter Amstutz [Fri, 29 Jan 2021 20:54:41 +0000 (15:54 -0500)]
17293: Update trash_at/deleted_at even on MarshalManifest error

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoWarn about missing/short secrets. Delete Rails session key.
Tom Clegg [Mon, 7 Dec 2020 19:53:05 +0000 (14:53 -0500)]
Warn about missing/short secrets. Delete Rails session key.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17295: Adds cluster ID validation on the config file.
Lucas Di Pentima [Fri, 19 Feb 2021 15:48:32 +0000 (12:48 -0300)]
17295: Adds cluster ID validation on the config file.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago17295: Adds tests exposing the bug.
Lucas Di Pentima [Fri, 19 Feb 2021 15:45:11 +0000 (12:45 -0300)]
17295: Adds tests exposing the bug.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago17384: Respect CrunchRunCommand and CrunchRunArgumentsList in a-d-c.
Tom Clegg [Mon, 15 Feb 2021 16:06:35 +0000 (11:06 -0500)]
17384: Respect CrunchRunCommand and CrunchRunArgumentsList in a-d-c.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoUpdate error regexp in test case.
Tom Clegg [Wed, 2 Dec 2020 14:30:55 +0000 (09:30 -0500)]
Update error regexp in test case.

refs #17009

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17335: Fix panic when OIDC provider returns no name claim.
Tom Clegg [Mon, 15 Feb 2021 04:00:40 +0000 (23:00 -0500)]
17335: Fix panic when OIDC provider returns no name claim.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17355: keepstore should take the volume's AccessViaHosts ReadOnly flag
Ward Vandewege [Tue, 9 Feb 2021 20:14:10 +0000 (15:14 -0500)]
17355: keepstore should take the volume's AccessViaHosts ReadOnly flag
       into account when reporting ReadOnly status of a volume on
       startup.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17340: arvados-dispatch-cloud should take the Containers.ReserveExtraRAM
Ward Vandewege [Thu, 4 Feb 2021 19:07:10 +0000 (14:07 -0500)]
17340: arvados-dispatch-cloud should take the Containers.ReserveExtraRAM
       configuration parameter into account when choosing a node size.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agofeat(crunch-dispatch-local): add crunch-run dependency
Javier Bértoli [Mon, 26 Oct 2020 15:28:29 +0000 (12:28 -0300)]
feat(crunch-dispatch-local): add crunch-run dependency

refs #16995
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agofix(crunch-dispatch-local): add missing service file
Javier Bértoli [Mon, 19 Oct 2020 13:06:18 +0000 (10:06 -0300)]
fix(crunch-dispatch-local): add missing service file

refs #16996
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago16774: text/plain response uses crlf. Tests check error codes.
Peter Amstutz [Tue, 24 Nov 2020 18:40:21 +0000 (13:40 -0500)]
16774: text/plain response uses crlf.  Tests check error codes.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16774: Fix tests. Use encoder for xml error response.
Peter Amstutz [Mon, 23 Nov 2020 20:04:48 +0000 (15:04 -0500)]
16774: Fix tests.  Use encoder for xml error response.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16774: Keep-web errors include messages
Peter Amstutz [Fri, 20 Nov 2020 23:03:30 +0000 (18:03 -0500)]
16774: Keep-web errors include messages

Errors on the regular keep-web side return plain text responses.

Errors on the S3 side return XML error responses that S3 clients
expect.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17015: Ensure that containers belong to this cluster
Peter Amstutz [Thu, 19 Nov 2020 20:36:29 +0000 (15:36 -0500)]
17015: Ensure that containers belong to this cluster

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17009: Fix s3 ListObjects endpoint with vhost-style requests.
Tom Clegg [Wed, 2 Dec 2020 22:36:35 +0000 (17:36 -0500)]
17009: Fix s3 ListObjects endpoint with vhost-style requests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17009: Test virtual host-style S3 requests.
Tom Clegg [Thu, 3 Dec 2020 21:24:37 +0000 (16:24 -0500)]
17009: Test virtual host-style S3 requests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17009: Fix bucket-level ops using virtual host-style requests.
Tom Clegg [Wed, 25 Nov 2020 17:14:34 +0000 (12:14 -0500)]
17009: Fix bucket-level ops using virtual host-style requests.

refs #17009

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17009: Mention S3 considerations in keep-web install doc.
Tom Clegg [Thu, 19 Nov 2020 21:48:15 +0000 (16:48 -0500)]
17009: Mention S3 considerations in keep-web install doc.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17009: Support accessing S3 with virtual hosted-style URLs.
Tom Clegg [Wed, 18 Nov 2020 22:35:29 +0000 (17:35 -0500)]
17009: Support accessing S3 with virtual hosted-style URLs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16106: address review comments.
Ward Vandewege [Mon, 11 Jan 2021 14:16:58 +0000 (09:16 -0500)]
16106: address review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16106: update Azure preemptible node code after real world testing. Add
Ward Vandewege [Thu, 7 Jan 2021 18:40:53 +0000 (13:40 -0500)]
16106: update Azure preemptible node code after real world testing. Add
       documentation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16106: add Azure spot instance support.
Ward Vandewege [Sat, 3 Oct 2020 00:49:22 +0000 (20:49 -0400)]
16106: add Azure spot instance support.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17215: add IAM role support to arvados-dispatch-cloud on EC2.
Ward Vandewege [Wed, 20 Jan 2021 21:16:11 +0000 (16:16 -0500)]
17215: add IAM role support to arvados-dispatch-cloud on EC2.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoDocumentation: fix typo.
Ward Vandewege [Fri, 12 Feb 2021 02:53:52 +0000 (21:53 -0500)]
Documentation: fix typo.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17335-backport-2.1' into 2.1-dev
Tom Clegg [Tue, 9 Feb 2021 16:41:47 +0000 (11:41 -0500)]
Merge branch '17335-backport-2.1' into 2.1-dev

refs #17335

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17335: documentation: fix broken link. 17335-backport-2.1
Ward Vandewege [Tue, 9 Feb 2021 14:18:03 +0000 (09:18 -0500)]
17335: documentation: fix broken link.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoDocumentation: add a default base_url to the Rakefile to simplify
Ward Vandewege [Mon, 1 Feb 2021 19:03:01 +0000 (14:03 -0500)]
Documentation: add a default base_url to the Rakefile to simplify
running linkchecker.

refs #17245

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17335: Configurable auth params for OIDC and Google.
Tom Clegg [Thu, 4 Feb 2021 17:11:02 +0000 (12:11 -0500)]
17335: Configurable auth params for OIDC and Google.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoThe configuration parameter is MaxKeepBlobBuffers, not MaxBuffers.
Ward Vandewege [Fri, 5 Feb 2021 00:31:58 +0000 (19:31 -0500)]
The configuration parameter is MaxKeepBlobBuffers, not MaxBuffers.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17255: Document the "can_login" permission link in the API section.
Ward Vandewege [Fri, 29 Jan 2021 22:02:57 +0000 (17:02 -0500)]
17255: Document the "can_login" permission link in the API section.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17245: documenation: re-add a modified version of our Slurm
Ward Vandewege [Fri, 29 Jan 2021 20:49:42 +0000 (15:49 -0500)]
17245: documenation: re-add a modified version of our Slurm
       configuration page to the index. Re-organize the index a bit to
       make the separation between cloud and Slurm dispatching more
       obvious.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoDocumentation: reflect the current state of anonymous token generation.
Ward Vandewege [Thu, 28 Jan 2021 00:36:49 +0000 (19:36 -0500)]
Documentation: reflect the current state of anonymous token generation.

refs #16726

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoDocumentation: the Arvados SSO server is deprecated, it is not the
Ward Vandewege [Wed, 27 Jan 2021 14:49:18 +0000 (09:49 -0500)]
Documentation: the Arvados SSO server is deprecated, it is not the
default anymore.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMake sure that our Python 3 based packages conflict with the older
Ward Vandewege [Fri, 22 Jan 2021 17:29:07 +0000 (12:29 -0500)]
Make sure that our Python 3 based packages conflict with the older
Python 2 based ones.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17222: implement review feedback.
Ward Vandewege [Wed, 20 Jan 2021 21:39:54 +0000 (16:39 -0500)]
17222: implement review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17222: add overview documentation for the components of Keep.
Ward Vandewege [Wed, 20 Jan 2021 18:38:20 +0000 (13:38 -0500)]
17222: add overview documentation for the components of Keep.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoDocumentation: make the arvados-dispatch-cloud installation instructions
Ward Vandewege [Wed, 13 Jan 2021 21:37:48 +0000 (16:37 -0500)]
Documentation: make the arvados-dispatch-cloud installation instructions
a bit more clear.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoDocumentation: fix typos.
Ward Vandewege [Wed, 6 Jan 2021 19:46:06 +0000 (14:46 -0500)]
Documentation: fix typos.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoWe've made a change in the structure of our apt repositories.
Ward Vandewege [Tue, 22 Dec 2020 19:52:26 +0000 (14:52 -0500)]
We've made a change in the structure of our apt repositories.

refs #17218

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoNow that our k8s helm charts retain state, update the documentation
Ward Vandewege [Mon, 30 Nov 2020 16:55:41 +0000 (11:55 -0500)]
Now that our k8s helm charts retain state, update the documentation
accordingly.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoDocumentation cleanups.
Ward Vandewege [Tue, 24 Nov 2020 18:17:44 +0000 (13:17 -0500)]
Documentation cleanups.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17154: Add comment. Use strings.HasPrefix
Peter Amstutz [Mon, 23 Nov 2020 15:59:06 +0000 (10:59 -0500)]
17154: Add comment.  Use strings.HasPrefix

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17154: Copy updates on federated users to local cluster
Peter Amstutz [Fri, 20 Nov 2020 21:01:25 +0000 (16:01 -0500)]
17154: Copy updates on federated users to local cluster

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17154: Make sure most current user record is loaded.
Peter Amstutz [Fri, 20 Nov 2020 20:25:27 +0000 (15:25 -0500)]
17154: Make sure most current user record is loaded.

Convert 'option' items (which are symbols) to strings for value comparison

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMove the handle_python_package() function from run-library.sh to
Ward Vandewege [Sun, 22 Nov 2020 13:35:06 +0000 (08:35 -0500)]
Move the handle_python_package() function from run-library.sh to
run-build-packages-python-and-ruby.sh, it is only used in the latter.
Update it to call python3 instead of just 'python'.

refs #15888

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoRemove one more python2 remnant. This is a fix for the
Ward Vandewege [Fri, 20 Nov 2020 22:31:50 +0000 (17:31 -0500)]
Remove one more python2 remnant. This is a fix for the
python3-arvados-cwl-runner package, it now installs /usr/bin/cwltool
again.

refs #15888

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17111: Deselect unsigned_manifest_text by default in groups#contents. 2.1.1
Tom Clegg [Fri, 13 Nov 2020 20:44:43 +0000 (15:44 -0500)]
17111: Deselect unsigned_manifest_text by default in groups#contents.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoFix require path in the 'script/rails' script for api server.
Ward Vandewege [Fri, 6 Nov 2020 13:34:38 +0000 (08:34 -0500)]
Fix require path in the 'script/rails' script for api server.

closes #17094

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17090: Migration to refresh_permissions
Peter Amstutz [Thu, 5 Nov 2020 19:55:35 +0000 (14:55 -0500)]
17090: Migration to refresh_permissions

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17090: Use EXCLUSIVE lock for permission updates
Peter Amstutz [Thu, 5 Nov 2020 16:09:30 +0000 (11:09 -0500)]
17090: Use EXCLUSIVE lock for permission updates

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17040: Update structure.sql
Peter Amstutz [Tue, 3 Nov 2020 18:01:57 +0000 (13:01 -0500)]
17040: Update structure.sql

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17040: RefreshTrashedGroups migration, clear_permissions calls forget_cached_group_perms
Peter Amstutz [Tue, 3 Nov 2020 17:12:59 +0000 (12:12 -0500)]
17040: RefreshTrashedGroups migration, clear_permissions calls forget_cached_group_perms

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17040: Cache results of User.group_permissions
Peter Amstutz [Mon, 2 Nov 2020 21:20:02 +0000 (16:20 -0500)]
17040: Cache results of User.group_permissions

When requesting a list of groups (either directly, or with the
"shared" endpoint) it calls writable_by for each group.  This
indirectly calls User.group_permissions, which makes a database query.
When it does this for every group (with a database query each time),
which gets very expensive.

To address this, this commit caches the result of group_permissions on
the user object.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17040: Get user_uuids and embed them as a constant in the main query
Peter Amstutz [Mon, 2 Nov 2020 19:25:28 +0000 (14:25 -0500)]
17040: Get user_uuids and embed them as a constant in the main query

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>