arvados.git
2 years ago18785: fix letsencrypt/nginx deployment issues for single-host/single-hostname
Javier Bértoli [Fri, 25 Feb 2022 22:17:25 +0000 (19:17 -0300)]
18785: fix letsencrypt/nginx deployment issues for single-host/single-hostname

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18791: allow single-host-single-hostname to manage LE certs
Javier Bértoli [Fri, 25 Feb 2022 16:40:15 +0000 (13:40 -0300)]
18791: allow single-host-single-hostname to manage LE certs

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18791: make the test hasher workflow work by fixing dns resolution
Ward Vandewege [Fri, 25 Feb 2022 02:08:47 +0000 (21:08 -0500)]
18791: make the test hasher workflow work by fixing dns resolution
       inside docker. Cleanup for the local.params file.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18791: update documentation, fix single host/single hostname installer
Ward Vandewege [Mon, 21 Feb 2022 00:44:24 +0000 (19:44 -0500)]
18791: update documentation, fix single host/single hostname installer
       with self-signed certificates. Fix tests/run-test.sh so it works
       even with just crunch-dispatch-local.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '17754-federated-acct-merge'. Refs #17754.
Lucas Di Pentima [Tue, 1 Mar 2022 22:29:47 +0000 (19:29 -0300)]
Merge branch '17754-federated-acct-merge'. Refs #17754.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18803-empty-identity-url'
Tom Clegg [Tue, 1 Mar 2022 21:13:15 +0000 (16:13 -0500)]
Merge branch '18803-empty-identity-url'

fixes #18803

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18808-new-token-race'
Tom Clegg [Tue, 1 Mar 2022 15:15:26 +0000 (10:15 -0500)]
Merge branch '18808-new-token-race'

fixes #18808

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18805-easy-static-compilation'
Ward Vandewege [Mon, 28 Feb 2022 21:17:42 +0000 (16:17 -0500)]
Merge branch '18805-easy-static-compilation'

closes #18805

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18808: Handle concurrent uses of same previously unseen token.
Tom Clegg [Mon, 28 Feb 2022 17:25:18 +0000 (12:25 -0500)]
18808: Handle concurrent uses of same previously unseen token.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18808: Test concurrent uses of same previously unseen token.
Tom Clegg [Mon, 28 Feb 2022 16:45:46 +0000 (11:45 -0500)]
18808: Test concurrent uses of same previously unseen token.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18805: add a 'static' go build tag that disables the pam login code,
Ward Vandewege [Fri, 25 Feb 2022 21:50:32 +0000 (16:50 -0500)]
18805: add a 'static' go build tag that disables the pam login code,
       because it relies on the shared libraries from the glibc version
       used for linking, at runtime.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18805: replace unnecessary lookup of a constant.
Ward Vandewege [Fri, 25 Feb 2022 21:35:54 +0000 (16:35 -0500)]
18805: replace unnecessary lookup of a constant.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18801-aca-req-select-uuid'. Closes #18801
Lucas Di Pentima [Fri, 25 Feb 2022 19:29:12 +0000 (16:29 -0300)]
Merge branch '18801-aca-req-select-uuid'. Closes #18801

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18801: Fixes the regression by ignoring the case where api_token isn't there.
Lucas Di Pentima [Fri, 25 Feb 2022 18:54:57 +0000 (15:54 -0300)]
18801: Fixes the regression by ignoring the case where api_token isn't there.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18801: Exposes the regression with a test.
Lucas Di Pentima [Fri, 25 Feb 2022 18:54:41 +0000 (15:54 -0300)]
18801: Exposes the regression with a test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18803: Save empty identity_url to database as null.
Tom Clegg [Fri, 25 Feb 2022 17:05:46 +0000 (12:05 -0500)]
18803: Save empty identity_url to database as null.

Allows multiple records to have empty identity_url without hitting
unique constraint.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoThe base.sh script that is run by Packer should abort when it encounters
Ward Vandewege [Wed, 23 Feb 2022 19:06:13 +0000 (14:06 -0500)]
The base.sh script that is run by Packer should abort when it encounters
any errors.

refs #18772

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoBugfix: make the create-ebs-volume patch apply.
Ward Vandewege [Wed, 23 Feb 2022 18:52:29 +0000 (13:52 -0500)]
Bugfix: make the create-ebs-volume patch apply.

refs #18772

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18772-ebs-autoscale-2'
Ward Vandewege [Tue, 22 Feb 2022 18:53:39 +0000 (13:53 -0500)]
Merge branch '18772-ebs-autoscale-2'

closes #18772

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: a few more improvements for the autoscaler script, from the
Ward Vandewege [Tue, 22 Feb 2022 18:52:36 +0000 (13:52 -0500)]
18772: a few more improvements for the autoscaler script, from the
       review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: address review feedback.
Ward Vandewege [Tue, 22 Feb 2022 01:37:47 +0000 (20:37 -0500)]
18772: address review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: document the AWS EBS autoscaler support. Refactor the "Build a
Ward Vandewege [Mon, 21 Feb 2022 14:32:08 +0000 (09:32 -0500)]
18772: document the AWS EBS autoscaler support. Refactor the "Build a
       cloud compute node image" documentation page to improve the flow.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: consistently use bash comparison operators in build.sh
Ward Vandewege [Mon, 21 Feb 2022 14:08:30 +0000 (09:08 -0500)]
18772: consistently use bash comparison operators in build.sh

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: add support for the AWS EBS autoscale script to the compute node
Ward Vandewege [Sat, 19 Feb 2022 00:27:11 +0000 (19:27 -0500)]
18772: add support for the AWS EBS autoscale script to the compute node
       image builder.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: arvados-dispatch-cloud: add IamInstanceProfile field to the ec2
Ward Vandewege [Thu, 17 Feb 2022 21:31:23 +0000 (16:31 -0500)]
18772: arvados-dispatch-cloud: add IamInstanceProfile field to the ec2
       driver.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18773-check-image-id' refs #18773
Peter Amstutz [Fri, 18 Feb 2022 22:52:54 +0000 (17:52 -0500)]
Merge branch '18773-check-image-id' refs #18773

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: Fix tests.test_submit.TestSubmit.test_arvados_jobs_image
Peter Amstutz [Fri, 18 Feb 2022 21:00:15 +0000 (16:00 -0500)]
18773: Fix tests.test_submit.TestSubmit.test_arvados_jobs_image

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: Add --match-submitter-images to docs
Peter Amstutz [Fri, 18 Feb 2022 19:24:14 +0000 (14:24 -0500)]
18773: Add --match-submitter-images to docs

Also update cwltool dependency for a bugfix.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: Add test for match_local_docker behavior
Peter Amstutz [Fri, 18 Feb 2022 16:57:00 +0000 (11:57 -0500)]
18773: Add test for match_local_docker behavior

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: Test WIP
Peter Amstutz [Thu, 17 Feb 2022 20:31:17 +0000 (15:31 -0500)]
18773: Test WIP

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: --match-submitter-images to compare the local docker image with Arvados
Peter Amstutz [Thu, 17 Feb 2022 19:37:51 +0000 (14:37 -0500)]
18773: --match-submitter-images to compare the local docker image with Arvados

Consults local list of Docker images to find the image id and chooses
that exact one, uploading it if necessary.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoFix arvbox-demo refs #18789
Peter Amstutz [Fri, 18 Feb 2022 14:50:16 +0000 (09:50 -0500)]
Fix arvbox-demo refs #18789

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18676-anon-token-support-v2-in-config'
Ward Vandewege [Fri, 18 Feb 2022 14:43:24 +0000 (09:43 -0500)]
Merge branch '18676-anon-token-support-v2-in-config'

closes #18676

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18676: Merge branch 'main' into 18676-anon-token-support-v2-in-config
Ward Vandewege [Fri, 18 Feb 2022 14:42:15 +0000 (09:42 -0500)]
18676: Merge branch 'main' into 18676-anon-token-support-v2-in-config

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18676: make v2 token check more strict, and add the ["GET /"] scope to
Ward Vandewege [Fri, 18 Feb 2022 13:34:02 +0000 (08:34 -0500)]
18676: make v2 token check more strict, and add the ["GET /"] scope to
       the new anonymous token code path.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoReadjust arvbox GEM_HOME to ~/.gem to avoid stepping on base image gems
Peter Amstutz [Fri, 18 Feb 2022 01:36:11 +0000 (20:36 -0500)]
Readjust arvbox GEM_HOME to ~/.gem to avoid stepping on base image gems

Instead of replacing the entire /var/lib/arvados/lib/ruby/gems
directory, mount it in the place of the default user directory that
'gem' already looks for.

refs #18789

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17754: Hides account linking buttons when LoginCluster is configured.
Lucas Di Pentima [Thu, 17 Feb 2022 22:19:26 +0000 (19:19 -0300)]
17754: Hides account linking buttons when LoginCluster is configured.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoUpdate cwltool dependency for restored Python 3.6 compatability
Peter Amstutz [Thu, 17 Feb 2022 20:49:45 +0000 (15:49 -0500)]
Update cwltool dependency for restored Python 3.6 compatability

refs #18766

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17754: Updates documentation.
Lucas Di Pentima [Thu, 17 Feb 2022 20:34:30 +0000 (17:34 -0300)]
17754: Updates documentation.

Self-serve account linking is not supported on LoginCluster federations.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoFix typo.
Ward Vandewege [Thu, 17 Feb 2022 19:35:31 +0000 (14:35 -0500)]
Fix typo.

refs #18702

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18702-document-upgrades'
Ward Vandewege [Thu, 17 Feb 2022 19:06:39 +0000 (14:06 -0500)]
Merge branch '18702-document-upgrades'

closes #18702

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: Merge branch 'main' into 18702-document-upgrades
Ward Vandewege [Thu, 17 Feb 2022 19:05:36 +0000 (14:05 -0500)]
18702: Merge branch 'main' into 18702-document-upgrades

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18676: be a bit more specific in testing for V2 tokens.
Ward Vandewege [Thu, 17 Feb 2022 18:03:33 +0000 (13:03 -0500)]
18676: be a bit more specific in testing for V2 tokens.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18600-copy-by-ref'
Tom Clegg [Thu, 17 Feb 2022 17:52:27 +0000 (12:52 -0500)]
Merge branch '18600-copy-by-ref'

refs #18600

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18600: Update comment.
Tom Clegg [Thu, 17 Feb 2022 16:13:49 +0000 (11:13 -0500)]
18600: Update comment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18676: tolerate V2 anonymous tokens in config.yml, but generate a
Ward Vandewege [Thu, 17 Feb 2022 16:07:20 +0000 (11:07 -0500)]
18676: tolerate V2 anonymous tokens in config.yml, but generate a
       warning.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: consolidate upgrade instructions in one place; move the
Ward Vandewege [Thu, 17 Feb 2022 00:29:34 +0000 (19:29 -0500)]
18702: consolidate upgrade instructions in one place; move the
       "maintenance and upgrading" page to the admin directory, fix a
       few small things on the upgrade notes page.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: fix one more link to the configuration migration page to point at
Ward Vandewege [Thu, 17 Feb 2022 00:16:35 +0000 (19:16 -0500)]
18702: fix one more link to the configuration migration page to point at
       the most recent version.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: remove the old document about upgrading the configuration from
Ward Vandewege [Wed, 16 Feb 2022 18:47:19 +0000 (13:47 -0500)]
18702: remove the old document about upgrading the configuration from
       Arvados versions prior to 2.0, to improve in the install section.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: add documentation for maintaining and upgrading Arvados. Make it
Ward Vandewege [Wed, 16 Feb 2022 15:39:41 +0000 (10:39 -0500)]
18702: add documentation for maintaining and upgrading Arvados. Make it
       clear that the Salt-based installer is only intended for
       installation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18766-python-bump'
Ward Vandewege [Tue, 15 Feb 2022 19:34:18 +0000 (14:34 -0500)]
Merge branch '18766-python-bump'

refs #18766

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18766: Merge branch 'main' into 18766-python-bump
Ward Vandewege [Tue, 15 Feb 2022 19:33:35 +0000 (14:33 -0500)]
18766: Merge branch 'main' into 18766-python-bump

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agore-wrap all bundle invocations with flock refs #18770
Peter Amstutz [Tue, 15 Feb 2022 19:13:07 +0000 (14:13 -0500)]
re-wrap all bundle invocations with flock refs #18770

Apparently "bundle exec" can still mess with global gems, causing
conflicts and broken installs, so it needs to be wrapped with flock.
binstubs are presumably safe.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18766: bump the Python version used by our Ubuntu 18.04 package to
Ward Vandewege [Tue, 15 Feb 2022 18:20:09 +0000 (13:20 -0500)]
18766: bump the Python version used by our Ubuntu 18.04 package to
       version 3.8.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoGet phantomjs pkg from cache.arvados.org.
Tom Clegg [Tue, 15 Feb 2022 18:12:07 +0000 (13:12 -0500)]
Get phantomjs pkg from cache.arvados.org.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18676-anon-token-improvement'
Ward Vandewege [Mon, 14 Feb 2022 19:29:40 +0000 (14:29 -0500)]
Merge branch '18676-anon-token-improvement'

closes #18676

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18676: Merge branch 'main' into 18676-anon-token-improvement
Ward Vandewege [Mon, 14 Feb 2022 19:29:13 +0000 (14:29 -0500)]
18676: Merge branch 'main' into 18676-anon-token-improvement

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18676: more tweaks after review comments: clarify logic in checkToken
Ward Vandewege [Mon, 14 Feb 2022 17:43:15 +0000 (12:43 -0500)]
18676: more tweaks after review comments: clarify logic in checkToken
       (lib/config/load.go), and make sure that we also check the uuid
       when we match the anonymous user token, when it is supplied as
       a V2 token.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18723-cwl-upload' refs #18723
Peter Amstutz [Mon, 14 Feb 2022 18:50:05 +0000 (13:50 -0500)]
Merge branch '18723-cwl-upload' refs #18723

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18723: Use setuptools console entrypoints, fix dev-jobs.dockerfile
Peter Amstutz [Mon, 14 Feb 2022 14:54:26 +0000 (09:54 -0500)]
18723: Use setuptools console entrypoints, fix dev-jobs.dockerfile

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18723: Use setuptools provided entry point
Peter Amstutz [Fri, 11 Feb 2022 22:12:35 +0000 (17:12 -0500)]
18723: Use setuptools provided entry point

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18690-secret-files'
Tom Clegg [Fri, 11 Feb 2022 18:11:43 +0000 (13:11 -0500)]
Merge branch '18690-secret-files'

fixes #18690

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18676: move length check for AnonymousUserToken to lib/config, bring it
Ward Vandewege [Fri, 11 Feb 2022 17:46:00 +0000 (12:46 -0500)]
18676: move length check for AnonymousUserToken to lib/config, bring it
       in line with the other tokens, small tweaks from review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18655-java-prs' refs #18655
Peter Amstutz [Fri, 11 Feb 2022 16:58:50 +0000 (11:58 -0500)]
Merge branch '18655-java-prs' refs #18655

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18690: Use bind mount to avoid writing secrets to output collection.
Tom Clegg [Fri, 11 Feb 2022 08:29:25 +0000 (03:29 -0500)]
18690: Use bind mount to avoid writing secrets to output collection.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18600: Update error message in S3 test.
Tom Clegg [Thu, 10 Feb 2022 21:45:53 +0000 (16:45 -0500)]
18600: Update error message in S3 test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18723: Update cwltool version for scandirs fix
Peter Amstutz [Thu, 10 Feb 2022 21:00:16 +0000 (16:00 -0500)]
18723: Update cwltool version for scandirs fix

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18600: Update tests.
Tom Clegg [Thu, 10 Feb 2022 20:52:49 +0000 (15:52 -0500)]
18600: Update tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18600: Update comment.
Tom Clegg [Thu, 10 Feb 2022 20:29:38 +0000 (15:29 -0500)]
18600: Update comment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18676: remove script/get_anonymous_user_token.rb and update
Ward Vandewege [Thu, 10 Feb 2022 18:47:18 +0000 (13:47 -0500)]
18676: remove script/get_anonymous_user_token.rb and update
       documentation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge remote-tracking branch 'MajewskiKrzysztof/exclude_home_project_parameter' into...
Peter Amstutz [Thu, 10 Feb 2022 18:35:27 +0000 (13:35 -0500)]
Merge remote-tracking branch 'MajewskiKrzysztof/exclude_home_project_parameter' into 18655-java-prs

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge remote-tracking branch 'MajewskiKrzysztof/keep_client_delete_method' into 18655...
Peter Amstutz [Thu, 10 Feb 2022 18:35:03 +0000 (13:35 -0500)]
Merge remote-tracking branch 'MajewskiKrzysztof/keep_client_delete_method' into 18655-java-prs

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18600: Test more snapshot/splice variations and error cases.
Tom Clegg [Thu, 10 Feb 2022 18:06:32 +0000 (13:06 -0500)]
18600: Test more snapshot/splice variations and error cases.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18676: make sure to handle V2 tokens properly.
Ward Vandewege [Thu, 10 Feb 2022 17:42:28 +0000 (12:42 -0500)]
18676: make sure to handle V2 tokens properly.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18600: Support replacing dir with file using Splice().
Tom Clegg [Thu, 10 Feb 2022 16:00:13 +0000 (11:00 -0500)]
18600: Support replacing dir with file using Splice().

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18719-fuse-fixes' refs #18719
Peter Amstutz [Wed, 9 Feb 2022 21:34:54 +0000 (16:34 -0500)]
Merge branch '18719-fuse-fixes' refs #18719

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: Delete commented out code
Peter Amstutz [Wed, 9 Feb 2022 21:34:26 +0000 (16:34 -0500)]
18719: Delete commented out code

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18657-passenger-binstub' refs #18657
Peter Amstutz [Wed, 9 Feb 2022 21:17:19 +0000 (16:17 -0500)]
Merge branch '18657-passenger-binstub' refs #18657

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18600: Add Snapshot and Splice methods.
Tom Clegg [Tue, 8 Feb 2022 21:28:20 +0000 (16:28 -0500)]
18600: Add Snapshot and Splice methods.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '17492-fix-bundler-install'
Tom Clegg [Tue, 8 Feb 2022 21:18:39 +0000 (16:18 -0500)]
Merge branch '17492-fix-bundler-install'

refs #17492

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '17492-ruby-sdk-req-ids'. Refs #17492
Lucas Di Pentima [Tue, 8 Feb 2022 20:34:01 +0000 (17:34 -0300)]
Merge branch '17492-ruby-sdk-req-ids'. Refs #17492

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago17492: Clean up bundler version check/install.
Tom Clegg [Tue, 8 Feb 2022 19:09:16 +0000 (14:09 -0500)]
17492: Clean up bundler version check/install.

Apparently gem installs bundler in $HOME, not in $GEM_HOME like we
expected.  The broken code continued working as long as it was using a
pre-existing run-tests temp dir that also installed a version of
bundler in $GEM_HOME because bundler was listed in a Gemfile.lock.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17492: Adds test confirming that req-id is added on exceptions.
Lucas Di Pentima [Tue, 8 Feb 2022 15:44:52 +0000 (12:44 -0300)]
17492: Adds test confirming that req-id is added on exceptions.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18657: Still need to use bundle exec rake??? Fix binstubs/passenger
Peter Amstutz [Mon, 7 Feb 2022 20:33:15 +0000 (15:33 -0500)]
18657: Still need to use bundle exec rake???  Fix binstubs/passenger

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Don't install api & wb binstubs into bin/
Peter Amstutz [Mon, 7 Feb 2022 18:59:11 +0000 (13:59 -0500)]
18657: Don't install api & wb binstubs into bin/

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Be less picky about where bundle is installed
Peter Amstutz [Mon, 7 Feb 2022 18:51:16 +0000 (13:51 -0500)]
18657: Be less picky about where bundle is installed

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Can't symlink to binstubs, need to invoke them in place
Peter Amstutz [Mon, 7 Feb 2022 17:02:29 +0000 (12:02 -0500)]
18657: Can't symlink to binstubs, need to invoke them in place

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Bind mount gems dir at new location
Peter Amstutz [Mon, 7 Feb 2022 16:28:48 +0000 (11:28 -0500)]
18657: Bind mount gems dir at new location

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17492: Implements Arvados::ArvadosClient to set a request-id on every call.
Lucas Di Pentima [Fri, 7 Jan 2022 21:58:54 +0000 (18:58 -0300)]
17492: Implements Arvados::ArvadosClient to set a request-id on every call.

Also, add the req-id is not present on response.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18657: Only get lock on gem install / bundle install
Peter Amstutz [Mon, 7 Feb 2022 16:07:22 +0000 (11:07 -0500)]
18657: Only get lock on gem install / bundle install

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: What if we get rid of setting GEM_HOME entirely
Peter Amstutz [Mon, 7 Feb 2022 15:41:06 +0000 (10:41 -0500)]
18657: What if we get rid of setting GEM_HOME entirely

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Almost working again, stupid Ruby
Peter Amstutz [Mon, 7 Feb 2022 15:31:34 +0000 (10:31 -0500)]
18657: Almost working again, stupid Ruby

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17492: Removes unused & deprecated code.
Lucas Di Pentima [Wed, 5 Jan 2022 17:48:25 +0000 (14:48 -0300)]
17492: Removes unused & deprecated code.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18719: Set collection_record_file = None on base class
Peter Amstutz [Sun, 6 Feb 2022 21:29:39 +0000 (16:29 -0500)]
18719: Set collection_record_file = None on base class

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: No flush TmpCollectionDirectory
Peter Amstutz [Sun, 6 Feb 2022 21:22:02 +0000 (16:22 -0500)]
18719: No flush TmpCollectionDirectory

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: Check for None
Peter Amstutz [Sun, 6 Feb 2022 21:17:32 +0000 (16:17 -0500)]
18719: Check for None

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: Fix TmpCollectionDirectory
Peter Amstutz [Sun, 6 Feb 2022 21:12:45 +0000 (16:12 -0500)]
18719: Fix TmpCollectionDirectory

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: Put back some logic to invalidate collection_record_file
Peter Amstutz [Sun, 6 Feb 2022 21:11:02 +0000 (16:11 -0500)]
18719: Put back some logic to invalidate collection_record_file

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: handle updates on flush()
Peter Amstutz [Sun, 6 Feb 2022 21:00:33 +0000 (16:00 -0500)]
18719: handle updates on flush()

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: Don't try to apply incremental updates to parent inode
Peter Amstutz [Sun, 6 Feb 2022 19:58:13 +0000 (14:58 -0500)]
18719: Don't try to apply incremental updates to parent inode

Just invalidate it and update it.

Don't crash commit_all race.

Running "aws s3 sync" seems to be working now.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>