arvados.git
2 years ago18600: Implement collection-update API.
Tom Clegg [Mon, 7 Mar 2022 18:53:01 +0000 (13:53 -0500)]
18600: Implement collection-update API.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18600: Fix Snapshot/Splice at collectionfs root.
Tom Clegg [Sun, 6 Mar 2022 07:31:39 +0000 (02:31 -0500)]
18600: Fix Snapshot/Splice at collectionfs root.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18600: Support fs.FS interface.
Tom Clegg [Sun, 6 Mar 2022 07:32:28 +0000 (02:32 -0500)]
18600: Support fs.FS interface.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18600: Add update-files test.
Tom Clegg [Fri, 4 Mar 2022 16:37:45 +0000 (11:37 -0500)]
18600: Add update-files test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18600: De-duplicate test code.
Tom Clegg [Thu, 3 Mar 2022 21:19:19 +0000 (16:19 -0500)]
18600: De-duplicate test code.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoFix arvados-server dependency version in the arvados-workbench package.
Ward Vandewege [Wed, 2 Mar 2022 16:44:14 +0000 (11:44 -0500)]
Fix arvados-server dependency version in the arvados-workbench package.

refs #17417

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18785-single-host-single-name-with-letsencrypt-main'
Ward Vandewege [Wed, 2 Mar 2022 01:12:35 +0000 (20:12 -0500)]
Merge branch '18785-single-host-single-name-with-letsencrypt-main'

closes #18785

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: avoid error when /etc/cloud/cloud.cfg.d does not exist.
Ward Vandewege [Tue, 1 Mar 2022 21:57:07 +0000 (16:57 -0500)]
18785: avoid error when /etc/cloud/cloud.cfg.d does not exist.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: small doc tweak.
Ward Vandewege [Tue, 1 Mar 2022 21:05:55 +0000 (16:05 -0500)]
18785: small doc tweak.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: remove the documentation for the single host, multiple hostnames
Ward Vandewege [Tue, 1 Mar 2022 20:59:19 +0000 (15:59 -0500)]
18785: remove the documentation for the single host, multiple hostnames
       case. This configuration is not very useful, and it should be
       possible to achieve this setup by using the multiple hostname
       installer on a single node.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: update defaults and comments in local.params files.
Ward Vandewege [Tue, 1 Mar 2022 19:22:52 +0000 (14:22 -0500)]
18785: update defaults and comments in local.params files.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: add explicit test that IP_INT is set correctly in the single host
Ward Vandewege [Tue, 1 Mar 2022 17:50:55 +0000 (12:50 -0500)]
18785: add explicit test that IP_INT is set correctly in the single host
       case.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: documentation: mention the possible need for chained certificates
Ward Vandewege [Tue, 1 Mar 2022 17:44:25 +0000 (12:44 -0500)]
18785: documentation: mention the possible need for chained certificates
       in the bring-your-own certificates case.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: fix self-signed single host installation.
Ward Vandewege [Tue, 1 Mar 2022 16:46:25 +0000 (11:46 -0500)]
18785: fix self-signed single host installation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: make sure the user configures IP_INT in the single host case.
Ward Vandewege [Tue, 1 Mar 2022 16:45:42 +0000 (11:45 -0500)]
18785: make sure the user configures IP_INT in the single host case.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: make sure that dnsmasq is present, and make sure that our
Ward Vandewege [Tue, 1 Mar 2022 14:27:50 +0000 (09:27 -0500)]
18785: make sure that dnsmasq is present, and make sure that our
       customized /etc/hosts survives a reboot.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: update documentation, fix run-tests.sh bug in single host/single
Ward Vandewege [Tue, 1 Mar 2022 02:38:19 +0000 (21:38 -0500)]
18785: update documentation, fix run-tests.sh bug in single host/single
       hostname + LE mode, change default workbench port to 443 in
       single host.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: edit documentation, addressing review comments
Javier Bértoli [Mon, 28 Feb 2022 18:34:52 +0000 (15:34 -0300)]
18785: edit documentation, addressing review comments

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: edit documentation, addressing review comments
Javier Bértoli [Mon, 28 Feb 2022 17:41:43 +0000 (14:41 -0300)]
18785: edit documentation, addressing review comments

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: add missing lines addressing review suggestions
Javier Bértoli [Mon, 28 Feb 2022 17:10:46 +0000 (14:10 -0300)]
18785: add missing lines addressing review suggestions

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: add conditional logic for bring-your-own certificates
Javier Bértoli [Mon, 28 Feb 2022 17:04:17 +0000 (14:04 -0300)]
18785: add conditional logic for bring-your-own certificates

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: remove comment addressing review suggestions
Javier Bértoli [Mon, 28 Feb 2022 17:01:08 +0000 (14:01 -0300)]
18785: remove comment addressing review suggestions

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: add missing lines addressing review suggestions
Javier Bértoli [Mon, 28 Feb 2022 16:58:36 +0000 (13:58 -0300)]
18785: add missing lines addressing review suggestions

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: remove unneeded entry in snakeoil certs state
Javier Bértoli [Fri, 25 Feb 2022 22:32:44 +0000 (19:32 -0300)]
18785: remove unneeded entry in snakeoil certs state

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: fix letsencrypt/nginx deployment issues for single-host/single-hostname
Javier Bértoli [Fri, 25 Feb 2022 22:17:25 +0000 (19:17 -0300)]
18785: fix letsencrypt/nginx deployment issues for single-host/single-hostname

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18791: allow single-host-single-hostname to manage LE certs
Javier Bértoli [Fri, 25 Feb 2022 16:40:15 +0000 (13:40 -0300)]
18791: allow single-host-single-hostname to manage LE certs

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18791: make the test hasher workflow work by fixing dns resolution
Ward Vandewege [Fri, 25 Feb 2022 02:08:47 +0000 (21:08 -0500)]
18791: make the test hasher workflow work by fixing dns resolution
       inside docker. Cleanup for the local.params file.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18791: update documentation, fix single host/single hostname installer
Ward Vandewege [Mon, 21 Feb 2022 00:44:24 +0000 (19:44 -0500)]
18791: update documentation, fix single host/single hostname installer
       with self-signed certificates. Fix tests/run-test.sh so it works
       even with just crunch-dispatch-local.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '17754-federated-acct-merge'. Refs #17754.
Lucas Di Pentima [Tue, 1 Mar 2022 22:29:47 +0000 (19:29 -0300)]
Merge branch '17754-federated-acct-merge'. Refs #17754.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18803-empty-identity-url'
Tom Clegg [Tue, 1 Mar 2022 21:13:15 +0000 (16:13 -0500)]
Merge branch '18803-empty-identity-url'

fixes #18803

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18808-new-token-race'
Tom Clegg [Tue, 1 Mar 2022 15:15:26 +0000 (10:15 -0500)]
Merge branch '18808-new-token-race'

fixes #18808

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18805-easy-static-compilation'
Ward Vandewege [Mon, 28 Feb 2022 21:17:42 +0000 (16:17 -0500)]
Merge branch '18805-easy-static-compilation'

closes #18805

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18808: Handle concurrent uses of same previously unseen token.
Tom Clegg [Mon, 28 Feb 2022 17:25:18 +0000 (12:25 -0500)]
18808: Handle concurrent uses of same previously unseen token.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18808: Test concurrent uses of same previously unseen token.
Tom Clegg [Mon, 28 Feb 2022 16:45:46 +0000 (11:45 -0500)]
18808: Test concurrent uses of same previously unseen token.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18805: add a 'static' go build tag that disables the pam login code,
Ward Vandewege [Fri, 25 Feb 2022 21:50:32 +0000 (16:50 -0500)]
18805: add a 'static' go build tag that disables the pam login code,
       because it relies on the shared libraries from the glibc version
       used for linking, at runtime.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18805: replace unnecessary lookup of a constant.
Ward Vandewege [Fri, 25 Feb 2022 21:35:54 +0000 (16:35 -0500)]
18805: replace unnecessary lookup of a constant.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18801-aca-req-select-uuid'. Closes #18801
Lucas Di Pentima [Fri, 25 Feb 2022 19:29:12 +0000 (16:29 -0300)]
Merge branch '18801-aca-req-select-uuid'. Closes #18801

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18801: Fixes the regression by ignoring the case where api_token isn't there.
Lucas Di Pentima [Fri, 25 Feb 2022 18:54:57 +0000 (15:54 -0300)]
18801: Fixes the regression by ignoring the case where api_token isn't there.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18801: Exposes the regression with a test.
Lucas Di Pentima [Fri, 25 Feb 2022 18:54:41 +0000 (15:54 -0300)]
18801: Exposes the regression with a test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18803: Save empty identity_url to database as null.
Tom Clegg [Fri, 25 Feb 2022 17:05:46 +0000 (12:05 -0500)]
18803: Save empty identity_url to database as null.

Allows multiple records to have empty identity_url without hitting
unique constraint.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoThe base.sh script that is run by Packer should abort when it encounters
Ward Vandewege [Wed, 23 Feb 2022 19:06:13 +0000 (14:06 -0500)]
The base.sh script that is run by Packer should abort when it encounters
any errors.

refs #18772

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoBugfix: make the create-ebs-volume patch apply.
Ward Vandewege [Wed, 23 Feb 2022 18:52:29 +0000 (13:52 -0500)]
Bugfix: make the create-ebs-volume patch apply.

refs #18772

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18772-ebs-autoscale-2'
Ward Vandewege [Tue, 22 Feb 2022 18:53:39 +0000 (13:53 -0500)]
Merge branch '18772-ebs-autoscale-2'

closes #18772

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: a few more improvements for the autoscaler script, from the
Ward Vandewege [Tue, 22 Feb 2022 18:52:36 +0000 (13:52 -0500)]
18772: a few more improvements for the autoscaler script, from the
       review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: address review feedback.
Ward Vandewege [Tue, 22 Feb 2022 01:37:47 +0000 (20:37 -0500)]
18772: address review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: document the AWS EBS autoscaler support. Refactor the "Build a
Ward Vandewege [Mon, 21 Feb 2022 14:32:08 +0000 (09:32 -0500)]
18772: document the AWS EBS autoscaler support. Refactor the "Build a
       cloud compute node image" documentation page to improve the flow.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: consistently use bash comparison operators in build.sh
Ward Vandewege [Mon, 21 Feb 2022 14:08:30 +0000 (09:08 -0500)]
18772: consistently use bash comparison operators in build.sh

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: add support for the AWS EBS autoscale script to the compute node
Ward Vandewege [Sat, 19 Feb 2022 00:27:11 +0000 (19:27 -0500)]
18772: add support for the AWS EBS autoscale script to the compute node
       image builder.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: arvados-dispatch-cloud: add IamInstanceProfile field to the ec2
Ward Vandewege [Thu, 17 Feb 2022 21:31:23 +0000 (16:31 -0500)]
18772: arvados-dispatch-cloud: add IamInstanceProfile field to the ec2
       driver.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18773-check-image-id' refs #18773
Peter Amstutz [Fri, 18 Feb 2022 22:52:54 +0000 (17:52 -0500)]
Merge branch '18773-check-image-id' refs #18773

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: Fix tests.test_submit.TestSubmit.test_arvados_jobs_image
Peter Amstutz [Fri, 18 Feb 2022 21:00:15 +0000 (16:00 -0500)]
18773: Fix tests.test_submit.TestSubmit.test_arvados_jobs_image

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: Add --match-submitter-images to docs
Peter Amstutz [Fri, 18 Feb 2022 19:24:14 +0000 (14:24 -0500)]
18773: Add --match-submitter-images to docs

Also update cwltool dependency for a bugfix.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: Add test for match_local_docker behavior
Peter Amstutz [Fri, 18 Feb 2022 16:57:00 +0000 (11:57 -0500)]
18773: Add test for match_local_docker behavior

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: Test WIP
Peter Amstutz [Thu, 17 Feb 2022 20:31:17 +0000 (15:31 -0500)]
18773: Test WIP

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: --match-submitter-images to compare the local docker image with Arvados
Peter Amstutz [Thu, 17 Feb 2022 19:37:51 +0000 (14:37 -0500)]
18773: --match-submitter-images to compare the local docker image with Arvados

Consults local list of Docker images to find the image id and chooses
that exact one, uploading it if necessary.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoFix arvbox-demo refs #18789
Peter Amstutz [Fri, 18 Feb 2022 14:50:16 +0000 (09:50 -0500)]
Fix arvbox-demo refs #18789

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18676-anon-token-support-v2-in-config'
Ward Vandewege [Fri, 18 Feb 2022 14:43:24 +0000 (09:43 -0500)]
Merge branch '18676-anon-token-support-v2-in-config'

closes #18676

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18676: Merge branch 'main' into 18676-anon-token-support-v2-in-config
Ward Vandewege [Fri, 18 Feb 2022 14:42:15 +0000 (09:42 -0500)]
18676: Merge branch 'main' into 18676-anon-token-support-v2-in-config

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18676: make v2 token check more strict, and add the ["GET /"] scope to
Ward Vandewege [Fri, 18 Feb 2022 13:34:02 +0000 (08:34 -0500)]
18676: make v2 token check more strict, and add the ["GET /"] scope to
       the new anonymous token code path.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoReadjust arvbox GEM_HOME to ~/.gem to avoid stepping on base image gems
Peter Amstutz [Fri, 18 Feb 2022 01:36:11 +0000 (20:36 -0500)]
Readjust arvbox GEM_HOME to ~/.gem to avoid stepping on base image gems

Instead of replacing the entire /var/lib/arvados/lib/ruby/gems
directory, mount it in the place of the default user directory that
'gem' already looks for.

refs #18789

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17754: Hides account linking buttons when LoginCluster is configured.
Lucas Di Pentima [Thu, 17 Feb 2022 22:19:26 +0000 (19:19 -0300)]
17754: Hides account linking buttons when LoginCluster is configured.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoUpdate cwltool dependency for restored Python 3.6 compatability
Peter Amstutz [Thu, 17 Feb 2022 20:49:45 +0000 (15:49 -0500)]
Update cwltool dependency for restored Python 3.6 compatability

refs #18766

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17754: Updates documentation.
Lucas Di Pentima [Thu, 17 Feb 2022 20:34:30 +0000 (17:34 -0300)]
17754: Updates documentation.

Self-serve account linking is not supported on LoginCluster federations.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoFix typo.
Ward Vandewege [Thu, 17 Feb 2022 19:35:31 +0000 (14:35 -0500)]
Fix typo.

refs #18702

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18702-document-upgrades'
Ward Vandewege [Thu, 17 Feb 2022 19:06:39 +0000 (14:06 -0500)]
Merge branch '18702-document-upgrades'

closes #18702

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: Merge branch 'main' into 18702-document-upgrades
Ward Vandewege [Thu, 17 Feb 2022 19:05:36 +0000 (14:05 -0500)]
18702: Merge branch 'main' into 18702-document-upgrades

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18676: be a bit more specific in testing for V2 tokens.
Ward Vandewege [Thu, 17 Feb 2022 18:03:33 +0000 (13:03 -0500)]
18676: be a bit more specific in testing for V2 tokens.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18600-copy-by-ref'
Tom Clegg [Thu, 17 Feb 2022 17:52:27 +0000 (12:52 -0500)]
Merge branch '18600-copy-by-ref'

refs #18600

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18600: Update comment.
Tom Clegg [Thu, 17 Feb 2022 16:13:49 +0000 (11:13 -0500)]
18600: Update comment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18676: tolerate V2 anonymous tokens in config.yml, but generate a
Ward Vandewege [Thu, 17 Feb 2022 16:07:20 +0000 (11:07 -0500)]
18676: tolerate V2 anonymous tokens in config.yml, but generate a
       warning.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: consolidate upgrade instructions in one place; move the
Ward Vandewege [Thu, 17 Feb 2022 00:29:34 +0000 (19:29 -0500)]
18702: consolidate upgrade instructions in one place; move the
       "maintenance and upgrading" page to the admin directory, fix a
       few small things on the upgrade notes page.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: fix one more link to the configuration migration page to point at
Ward Vandewege [Thu, 17 Feb 2022 00:16:35 +0000 (19:16 -0500)]
18702: fix one more link to the configuration migration page to point at
       the most recent version.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: remove the old document about upgrading the configuration from
Ward Vandewege [Wed, 16 Feb 2022 18:47:19 +0000 (13:47 -0500)]
18702: remove the old document about upgrading the configuration from
       Arvados versions prior to 2.0, to improve in the install section.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: add documentation for maintaining and upgrading Arvados. Make it
Ward Vandewege [Wed, 16 Feb 2022 15:39:41 +0000 (10:39 -0500)]
18702: add documentation for maintaining and upgrading Arvados. Make it
       clear that the Salt-based installer is only intended for
       installation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18766-python-bump'
Ward Vandewege [Tue, 15 Feb 2022 19:34:18 +0000 (14:34 -0500)]
Merge branch '18766-python-bump'

refs #18766

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18766: Merge branch 'main' into 18766-python-bump
Ward Vandewege [Tue, 15 Feb 2022 19:33:35 +0000 (14:33 -0500)]
18766: Merge branch 'main' into 18766-python-bump

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agore-wrap all bundle invocations with flock refs #18770
Peter Amstutz [Tue, 15 Feb 2022 19:13:07 +0000 (14:13 -0500)]
re-wrap all bundle invocations with flock refs #18770

Apparently "bundle exec" can still mess with global gems, causing
conflicts and broken installs, so it needs to be wrapped with flock.
binstubs are presumably safe.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18766: bump the Python version used by our Ubuntu 18.04 package to
Ward Vandewege [Tue, 15 Feb 2022 18:20:09 +0000 (13:20 -0500)]
18766: bump the Python version used by our Ubuntu 18.04 package to
       version 3.8.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoGet phantomjs pkg from cache.arvados.org.
Tom Clegg [Tue, 15 Feb 2022 18:12:07 +0000 (13:12 -0500)]
Get phantomjs pkg from cache.arvados.org.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18676-anon-token-improvement'
Ward Vandewege [Mon, 14 Feb 2022 19:29:40 +0000 (14:29 -0500)]
Merge branch '18676-anon-token-improvement'

closes #18676

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18676: Merge branch 'main' into 18676-anon-token-improvement
Ward Vandewege [Mon, 14 Feb 2022 19:29:13 +0000 (14:29 -0500)]
18676: Merge branch 'main' into 18676-anon-token-improvement

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18676: more tweaks after review comments: clarify logic in checkToken
Ward Vandewege [Mon, 14 Feb 2022 17:43:15 +0000 (12:43 -0500)]
18676: more tweaks after review comments: clarify logic in checkToken
       (lib/config/load.go), and make sure that we also check the uuid
       when we match the anonymous user token, when it is supplied as
       a V2 token.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18723-cwl-upload' refs #18723
Peter Amstutz [Mon, 14 Feb 2022 18:50:05 +0000 (13:50 -0500)]
Merge branch '18723-cwl-upload' refs #18723

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18723: Use setuptools console entrypoints, fix dev-jobs.dockerfile
Peter Amstutz [Mon, 14 Feb 2022 14:54:26 +0000 (09:54 -0500)]
18723: Use setuptools console entrypoints, fix dev-jobs.dockerfile

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18723: Use setuptools provided entry point
Peter Amstutz [Fri, 11 Feb 2022 22:12:35 +0000 (17:12 -0500)]
18723: Use setuptools provided entry point

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18690-secret-files'
Tom Clegg [Fri, 11 Feb 2022 18:11:43 +0000 (13:11 -0500)]
Merge branch '18690-secret-files'

fixes #18690

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18676: move length check for AnonymousUserToken to lib/config, bring it
Ward Vandewege [Fri, 11 Feb 2022 17:46:00 +0000 (12:46 -0500)]
18676: move length check for AnonymousUserToken to lib/config, bring it
       in line with the other tokens, small tweaks from review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18655-java-prs' refs #18655
Peter Amstutz [Fri, 11 Feb 2022 16:58:50 +0000 (11:58 -0500)]
Merge branch '18655-java-prs' refs #18655

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18690: Use bind mount to avoid writing secrets to output collection.
Tom Clegg [Fri, 11 Feb 2022 08:29:25 +0000 (03:29 -0500)]
18690: Use bind mount to avoid writing secrets to output collection.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18600: Update error message in S3 test.
Tom Clegg [Thu, 10 Feb 2022 21:45:53 +0000 (16:45 -0500)]
18600: Update error message in S3 test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18723: Update cwltool version for scandirs fix
Peter Amstutz [Thu, 10 Feb 2022 21:00:16 +0000 (16:00 -0500)]
18723: Update cwltool version for scandirs fix

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18600: Update tests.
Tom Clegg [Thu, 10 Feb 2022 20:52:49 +0000 (15:52 -0500)]
18600: Update tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18600: Update comment.
Tom Clegg [Thu, 10 Feb 2022 20:29:38 +0000 (15:29 -0500)]
18600: Update comment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18676: remove script/get_anonymous_user_token.rb and update
Ward Vandewege [Thu, 10 Feb 2022 18:47:18 +0000 (13:47 -0500)]
18676: remove script/get_anonymous_user_token.rb and update
       documentation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge remote-tracking branch 'MajewskiKrzysztof/exclude_home_project_parameter' into...
Peter Amstutz [Thu, 10 Feb 2022 18:35:27 +0000 (13:35 -0500)]
Merge remote-tracking branch 'MajewskiKrzysztof/exclude_home_project_parameter' into 18655-java-prs

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge remote-tracking branch 'MajewskiKrzysztof/keep_client_delete_method' into 18655...
Peter Amstutz [Thu, 10 Feb 2022 18:35:03 +0000 (13:35 -0500)]
Merge remote-tracking branch 'MajewskiKrzysztof/keep_client_delete_method' into 18655-java-prs

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18600: Test more snapshot/splice variations and error cases.
Tom Clegg [Thu, 10 Feb 2022 18:06:32 +0000 (13:06 -0500)]
18600: Test more snapshot/splice variations and error cases.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18676: make sure to handle V2 tokens properly.
Ward Vandewege [Thu, 10 Feb 2022 17:42:28 +0000 (12:42 -0500)]
18676: make sure to handle V2 tokens properly.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18600: Support replacing dir with file using Splice().
Tom Clegg [Thu, 10 Feb 2022 16:00:13 +0000 (11:00 -0500)]
18600: Support replacing dir with file using Splice().

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18719-fuse-fixes' refs #18719
Peter Amstutz [Wed, 9 Feb 2022 21:34:54 +0000 (16:34 -0500)]
Merge branch '18719-fuse-fixes' refs #18719

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>