arvados.git
2 years agoBugfix: make the create-ebs-volume patch apply.
Ward Vandewege [Wed, 23 Feb 2022 18:52:29 +0000 (13:52 -0500)]
Bugfix: make the create-ebs-volume patch apply.

refs #18772

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18772-ebs-autoscale-2'
Ward Vandewege [Tue, 22 Feb 2022 18:53:39 +0000 (13:53 -0500)]
Merge branch '18772-ebs-autoscale-2'

closes #18772

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: a few more improvements for the autoscaler script, from the
Ward Vandewege [Tue, 22 Feb 2022 18:52:36 +0000 (13:52 -0500)]
18772: a few more improvements for the autoscaler script, from the
       review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: address review feedback.
Ward Vandewege [Tue, 22 Feb 2022 01:37:47 +0000 (20:37 -0500)]
18772: address review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: document the AWS EBS autoscaler support. Refactor the "Build a
Ward Vandewege [Mon, 21 Feb 2022 14:32:08 +0000 (09:32 -0500)]
18772: document the AWS EBS autoscaler support. Refactor the "Build a
       cloud compute node image" documentation page to improve the flow.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: consistently use bash comparison operators in build.sh
Ward Vandewege [Mon, 21 Feb 2022 14:08:30 +0000 (09:08 -0500)]
18772: consistently use bash comparison operators in build.sh

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: add support for the AWS EBS autoscale script to the compute node
Ward Vandewege [Sat, 19 Feb 2022 00:27:11 +0000 (19:27 -0500)]
18772: add support for the AWS EBS autoscale script to the compute node
       image builder.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: arvados-dispatch-cloud: add IamInstanceProfile field to the ec2
Ward Vandewege [Thu, 17 Feb 2022 21:31:23 +0000 (16:31 -0500)]
18772: arvados-dispatch-cloud: add IamInstanceProfile field to the ec2
       driver.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18773-check-image-id' refs #18773
Peter Amstutz [Fri, 18 Feb 2022 22:52:54 +0000 (17:52 -0500)]
Merge branch '18773-check-image-id' refs #18773

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: Fix tests.test_submit.TestSubmit.test_arvados_jobs_image
Peter Amstutz [Fri, 18 Feb 2022 21:00:15 +0000 (16:00 -0500)]
18773: Fix tests.test_submit.TestSubmit.test_arvados_jobs_image

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: Add --match-submitter-images to docs
Peter Amstutz [Fri, 18 Feb 2022 19:24:14 +0000 (14:24 -0500)]
18773: Add --match-submitter-images to docs

Also update cwltool dependency for a bugfix.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: Add test for match_local_docker behavior
Peter Amstutz [Fri, 18 Feb 2022 16:57:00 +0000 (11:57 -0500)]
18773: Add test for match_local_docker behavior

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: Test WIP
Peter Amstutz [Thu, 17 Feb 2022 20:31:17 +0000 (15:31 -0500)]
18773: Test WIP

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: --match-submitter-images to compare the local docker image with Arvados
Peter Amstutz [Thu, 17 Feb 2022 19:37:51 +0000 (14:37 -0500)]
18773: --match-submitter-images to compare the local docker image with Arvados

Consults local list of Docker images to find the image id and chooses
that exact one, uploading it if necessary.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoFix arvbox-demo refs #18789
Peter Amstutz [Fri, 18 Feb 2022 14:50:16 +0000 (09:50 -0500)]
Fix arvbox-demo refs #18789

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18676-anon-token-support-v2-in-config'
Ward Vandewege [Fri, 18 Feb 2022 14:43:24 +0000 (09:43 -0500)]
Merge branch '18676-anon-token-support-v2-in-config'

closes #18676

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18676: Merge branch 'main' into 18676-anon-token-support-v2-in-config
Ward Vandewege [Fri, 18 Feb 2022 14:42:15 +0000 (09:42 -0500)]
18676: Merge branch 'main' into 18676-anon-token-support-v2-in-config

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18676: make v2 token check more strict, and add the ["GET /"] scope to
Ward Vandewege [Fri, 18 Feb 2022 13:34:02 +0000 (08:34 -0500)]
18676: make v2 token check more strict, and add the ["GET /"] scope to
       the new anonymous token code path.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoReadjust arvbox GEM_HOME to ~/.gem to avoid stepping on base image gems
Peter Amstutz [Fri, 18 Feb 2022 01:36:11 +0000 (20:36 -0500)]
Readjust arvbox GEM_HOME to ~/.gem to avoid stepping on base image gems

Instead of replacing the entire /var/lib/arvados/lib/ruby/gems
directory, mount it in the place of the default user directory that
'gem' already looks for.

refs #18789

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoUpdate cwltool dependency for restored Python 3.6 compatability
Peter Amstutz [Thu, 17 Feb 2022 20:49:45 +0000 (15:49 -0500)]
Update cwltool dependency for restored Python 3.6 compatability

refs #18766

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoFix typo.
Ward Vandewege [Thu, 17 Feb 2022 19:35:31 +0000 (14:35 -0500)]
Fix typo.

refs #18702

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18702-document-upgrades'
Ward Vandewege [Thu, 17 Feb 2022 19:06:39 +0000 (14:06 -0500)]
Merge branch '18702-document-upgrades'

closes #18702

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: Merge branch 'main' into 18702-document-upgrades
Ward Vandewege [Thu, 17 Feb 2022 19:05:36 +0000 (14:05 -0500)]
18702: Merge branch 'main' into 18702-document-upgrades

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18676: be a bit more specific in testing for V2 tokens.
Ward Vandewege [Thu, 17 Feb 2022 18:03:33 +0000 (13:03 -0500)]
18676: be a bit more specific in testing for V2 tokens.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18600-copy-by-ref'
Tom Clegg [Thu, 17 Feb 2022 17:52:27 +0000 (12:52 -0500)]
Merge branch '18600-copy-by-ref'

refs #18600

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18600: Update comment.
Tom Clegg [Thu, 17 Feb 2022 16:13:49 +0000 (11:13 -0500)]
18600: Update comment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18676: tolerate V2 anonymous tokens in config.yml, but generate a
Ward Vandewege [Thu, 17 Feb 2022 16:07:20 +0000 (11:07 -0500)]
18676: tolerate V2 anonymous tokens in config.yml, but generate a
       warning.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: consolidate upgrade instructions in one place; move the
Ward Vandewege [Thu, 17 Feb 2022 00:29:34 +0000 (19:29 -0500)]
18702: consolidate upgrade instructions in one place; move the
       "maintenance and upgrading" page to the admin directory, fix a
       few small things on the upgrade notes page.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: fix one more link to the configuration migration page to point at
Ward Vandewege [Thu, 17 Feb 2022 00:16:35 +0000 (19:16 -0500)]
18702: fix one more link to the configuration migration page to point at
       the most recent version.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: remove the old document about upgrading the configuration from
Ward Vandewege [Wed, 16 Feb 2022 18:47:19 +0000 (13:47 -0500)]
18702: remove the old document about upgrading the configuration from
       Arvados versions prior to 2.0, to improve in the install section.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: add documentation for maintaining and upgrading Arvados. Make it
Ward Vandewege [Wed, 16 Feb 2022 15:39:41 +0000 (10:39 -0500)]
18702: add documentation for maintaining and upgrading Arvados. Make it
       clear that the Salt-based installer is only intended for
       installation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18766-python-bump'
Ward Vandewege [Tue, 15 Feb 2022 19:34:18 +0000 (14:34 -0500)]
Merge branch '18766-python-bump'

refs #18766

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18766: Merge branch 'main' into 18766-python-bump
Ward Vandewege [Tue, 15 Feb 2022 19:33:35 +0000 (14:33 -0500)]
18766: Merge branch 'main' into 18766-python-bump

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agore-wrap all bundle invocations with flock refs #18770
Peter Amstutz [Tue, 15 Feb 2022 19:13:07 +0000 (14:13 -0500)]
re-wrap all bundle invocations with flock refs #18770

Apparently "bundle exec" can still mess with global gems, causing
conflicts and broken installs, so it needs to be wrapped with flock.
binstubs are presumably safe.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18766: bump the Python version used by our Ubuntu 18.04 package to
Ward Vandewege [Tue, 15 Feb 2022 18:20:09 +0000 (13:20 -0500)]
18766: bump the Python version used by our Ubuntu 18.04 package to
       version 3.8.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoGet phantomjs pkg from cache.arvados.org.
Tom Clegg [Tue, 15 Feb 2022 18:12:07 +0000 (13:12 -0500)]
Get phantomjs pkg from cache.arvados.org.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18676-anon-token-improvement'
Ward Vandewege [Mon, 14 Feb 2022 19:29:40 +0000 (14:29 -0500)]
Merge branch '18676-anon-token-improvement'

closes #18676

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18676: Merge branch 'main' into 18676-anon-token-improvement
Ward Vandewege [Mon, 14 Feb 2022 19:29:13 +0000 (14:29 -0500)]
18676: Merge branch 'main' into 18676-anon-token-improvement

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18676: more tweaks after review comments: clarify logic in checkToken
Ward Vandewege [Mon, 14 Feb 2022 17:43:15 +0000 (12:43 -0500)]
18676: more tweaks after review comments: clarify logic in checkToken
       (lib/config/load.go), and make sure that we also check the uuid
       when we match the anonymous user token, when it is supplied as
       a V2 token.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18723-cwl-upload' refs #18723
Peter Amstutz [Mon, 14 Feb 2022 18:50:05 +0000 (13:50 -0500)]
Merge branch '18723-cwl-upload' refs #18723

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18723: Use setuptools console entrypoints, fix dev-jobs.dockerfile
Peter Amstutz [Mon, 14 Feb 2022 14:54:26 +0000 (09:54 -0500)]
18723: Use setuptools console entrypoints, fix dev-jobs.dockerfile

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18723: Use setuptools provided entry point
Peter Amstutz [Fri, 11 Feb 2022 22:12:35 +0000 (17:12 -0500)]
18723: Use setuptools provided entry point

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18690-secret-files'
Tom Clegg [Fri, 11 Feb 2022 18:11:43 +0000 (13:11 -0500)]
Merge branch '18690-secret-files'

fixes #18690

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18676: move length check for AnonymousUserToken to lib/config, bring it
Ward Vandewege [Fri, 11 Feb 2022 17:46:00 +0000 (12:46 -0500)]
18676: move length check for AnonymousUserToken to lib/config, bring it
       in line with the other tokens, small tweaks from review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18655-java-prs' refs #18655
Peter Amstutz [Fri, 11 Feb 2022 16:58:50 +0000 (11:58 -0500)]
Merge branch '18655-java-prs' refs #18655

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18690: Use bind mount to avoid writing secrets to output collection.
Tom Clegg [Fri, 11 Feb 2022 08:29:25 +0000 (03:29 -0500)]
18690: Use bind mount to avoid writing secrets to output collection.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18600: Update error message in S3 test.
Tom Clegg [Thu, 10 Feb 2022 21:45:53 +0000 (16:45 -0500)]
18600: Update error message in S3 test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18723: Update cwltool version for scandirs fix
Peter Amstutz [Thu, 10 Feb 2022 21:00:16 +0000 (16:00 -0500)]
18723: Update cwltool version for scandirs fix

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18600: Update tests.
Tom Clegg [Thu, 10 Feb 2022 20:52:49 +0000 (15:52 -0500)]
18600: Update tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18600: Update comment.
Tom Clegg [Thu, 10 Feb 2022 20:29:38 +0000 (15:29 -0500)]
18600: Update comment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18676: remove script/get_anonymous_user_token.rb and update
Ward Vandewege [Thu, 10 Feb 2022 18:47:18 +0000 (13:47 -0500)]
18676: remove script/get_anonymous_user_token.rb and update
       documentation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge remote-tracking branch 'MajewskiKrzysztof/exclude_home_project_parameter' into...
Peter Amstutz [Thu, 10 Feb 2022 18:35:27 +0000 (13:35 -0500)]
Merge remote-tracking branch 'MajewskiKrzysztof/exclude_home_project_parameter' into 18655-java-prs

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge remote-tracking branch 'MajewskiKrzysztof/keep_client_delete_method' into 18655...
Peter Amstutz [Thu, 10 Feb 2022 18:35:03 +0000 (13:35 -0500)]
Merge remote-tracking branch 'MajewskiKrzysztof/keep_client_delete_method' into 18655-java-prs

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18600: Test more snapshot/splice variations and error cases.
Tom Clegg [Thu, 10 Feb 2022 18:06:32 +0000 (13:06 -0500)]
18600: Test more snapshot/splice variations and error cases.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18676: make sure to handle V2 tokens properly.
Ward Vandewege [Thu, 10 Feb 2022 17:42:28 +0000 (12:42 -0500)]
18676: make sure to handle V2 tokens properly.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18600: Support replacing dir with file using Splice().
Tom Clegg [Thu, 10 Feb 2022 16:00:13 +0000 (11:00 -0500)]
18600: Support replacing dir with file using Splice().

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18719-fuse-fixes' refs #18719
Peter Amstutz [Wed, 9 Feb 2022 21:34:54 +0000 (16:34 -0500)]
Merge branch '18719-fuse-fixes' refs #18719

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: Delete commented out code
Peter Amstutz [Wed, 9 Feb 2022 21:34:26 +0000 (16:34 -0500)]
18719: Delete commented out code

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18657-passenger-binstub' refs #18657
Peter Amstutz [Wed, 9 Feb 2022 21:17:19 +0000 (16:17 -0500)]
Merge branch '18657-passenger-binstub' refs #18657

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18600: Add Snapshot and Splice methods.
Tom Clegg [Tue, 8 Feb 2022 21:28:20 +0000 (16:28 -0500)]
18600: Add Snapshot and Splice methods.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '17492-fix-bundler-install'
Tom Clegg [Tue, 8 Feb 2022 21:18:39 +0000 (16:18 -0500)]
Merge branch '17492-fix-bundler-install'

refs #17492

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '17492-ruby-sdk-req-ids'. Refs #17492
Lucas Di Pentima [Tue, 8 Feb 2022 20:34:01 +0000 (17:34 -0300)]
Merge branch '17492-ruby-sdk-req-ids'. Refs #17492

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago17492: Clean up bundler version check/install.
Tom Clegg [Tue, 8 Feb 2022 19:09:16 +0000 (14:09 -0500)]
17492: Clean up bundler version check/install.

Apparently gem installs bundler in $HOME, not in $GEM_HOME like we
expected.  The broken code continued working as long as it was using a
pre-existing run-tests temp dir that also installed a version of
bundler in $GEM_HOME because bundler was listed in a Gemfile.lock.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17492: Adds test confirming that req-id is added on exceptions.
Lucas Di Pentima [Tue, 8 Feb 2022 15:44:52 +0000 (12:44 -0300)]
17492: Adds test confirming that req-id is added on exceptions.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18657: Still need to use bundle exec rake??? Fix binstubs/passenger
Peter Amstutz [Mon, 7 Feb 2022 20:33:15 +0000 (15:33 -0500)]
18657: Still need to use bundle exec rake???  Fix binstubs/passenger

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Don't install api & wb binstubs into bin/
Peter Amstutz [Mon, 7 Feb 2022 18:59:11 +0000 (13:59 -0500)]
18657: Don't install api & wb binstubs into bin/

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Be less picky about where bundle is installed
Peter Amstutz [Mon, 7 Feb 2022 18:51:16 +0000 (13:51 -0500)]
18657: Be less picky about where bundle is installed

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Can't symlink to binstubs, need to invoke them in place
Peter Amstutz [Mon, 7 Feb 2022 17:02:29 +0000 (12:02 -0500)]
18657: Can't symlink to binstubs, need to invoke them in place

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Bind mount gems dir at new location
Peter Amstutz [Mon, 7 Feb 2022 16:28:48 +0000 (11:28 -0500)]
18657: Bind mount gems dir at new location

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17492: Implements Arvados::ArvadosClient to set a request-id on every call.
Lucas Di Pentima [Fri, 7 Jan 2022 21:58:54 +0000 (18:58 -0300)]
17492: Implements Arvados::ArvadosClient to set a request-id on every call.

Also, add the req-id is not present on response.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18657: Only get lock on gem install / bundle install
Peter Amstutz [Mon, 7 Feb 2022 16:07:22 +0000 (11:07 -0500)]
18657: Only get lock on gem install / bundle install

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: What if we get rid of setting GEM_HOME entirely
Peter Amstutz [Mon, 7 Feb 2022 15:41:06 +0000 (10:41 -0500)]
18657: What if we get rid of setting GEM_HOME entirely

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Almost working again, stupid Ruby
Peter Amstutz [Mon, 7 Feb 2022 15:31:34 +0000 (10:31 -0500)]
18657: Almost working again, stupid Ruby

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17492: Removes unused & deprecated code.
Lucas Di Pentima [Wed, 5 Jan 2022 17:48:25 +0000 (14:48 -0300)]
17492: Removes unused & deprecated code.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18719: Set collection_record_file = None on base class
Peter Amstutz [Sun, 6 Feb 2022 21:29:39 +0000 (16:29 -0500)]
18719: Set collection_record_file = None on base class

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: No flush TmpCollectionDirectory
Peter Amstutz [Sun, 6 Feb 2022 21:22:02 +0000 (16:22 -0500)]
18719: No flush TmpCollectionDirectory

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: Check for None
Peter Amstutz [Sun, 6 Feb 2022 21:17:32 +0000 (16:17 -0500)]
18719: Check for None

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: Fix TmpCollectionDirectory
Peter Amstutz [Sun, 6 Feb 2022 21:12:45 +0000 (16:12 -0500)]
18719: Fix TmpCollectionDirectory

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: Put back some logic to invalidate collection_record_file
Peter Amstutz [Sun, 6 Feb 2022 21:11:02 +0000 (16:11 -0500)]
18719: Put back some logic to invalidate collection_record_file

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: handle updates on flush()
Peter Amstutz [Sun, 6 Feb 2022 21:00:33 +0000 (16:00 -0500)]
18719: handle updates on flush()

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: Don't try to apply incremental updates to parent inode
Peter Amstutz [Sun, 6 Feb 2022 19:58:13 +0000 (14:58 -0500)]
18719: Don't try to apply incremental updates to parent inode

Just invalidate it and update it.

Don't crash commit_all race.

Running "aws s3 sync" seems to be working now.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: Handle collection_record differently
Peter Amstutz [Sun, 6 Feb 2022 03:05:19 +0000 (22:05 -0500)]
18719: Handle collection_record differently

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: Make sure to ignore old versions of collections
Peter Amstutz [Fri, 4 Feb 2022 22:18:58 +0000 (17:18 -0500)]
18719: Make sure to ignore old versions of collections

Simplify websocket events to just call invalidate, don't try to do anything clever.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18713-nvidia-persistenced'
Ward Vandewege [Fri, 4 Feb 2022 16:36:08 +0000 (11:36 -0500)]
Merge branch '18713-nvidia-persistenced'

closes #18713

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18713: Merge branch 'main' into 18713-nvidia-persistenced
Ward Vandewege [Fri, 4 Feb 2022 16:33:44 +0000 (11:33 -0500)]
18713: Merge branch 'main' into 18713-nvidia-persistenced

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoFix typo in documentation.
Ward Vandewege [Thu, 3 Feb 2022 22:05:42 +0000 (17:05 -0500)]
Fix typo in documentation.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18713: expand comment.
Ward Vandewege [Thu, 3 Feb 2022 20:42:18 +0000 (15:42 -0500)]
18713: expand comment.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18676: simplify AnonymousUserToken configuration.
Ward Vandewege [Thu, 3 Feb 2022 18:58:39 +0000 (13:58 -0500)]
18676: simplify AnonymousUserToken configuration.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18713: disable the nvidia-persistenced service in the compute image.
Ward Vandewege [Thu, 3 Feb 2022 18:56:53 +0000 (13:56 -0500)]
18713: disable the nvidia-persistenced service in the compute image.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18703-installer-upgrade-postgres-formula'
Javier Bértoli [Thu, 3 Feb 2022 17:16:25 +0000 (14:16 -0300)]
Merge branch '18703-installer-upgrade-postgres-formula'

closes #18703
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '18679-handle-keys-with-null-values-in-config'
Ward Vandewege [Thu, 3 Feb 2022 16:07:14 +0000 (11:07 -0500)]
Merge branch '18679-handle-keys-with-null-values-in-config'

closes #18679

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18679: if a config file contains a key with a null value, do not
Ward Vandewege [Wed, 2 Feb 2022 22:02:43 +0000 (17:02 -0500)]
18679: if a config file contains a key with a null value, do not
       override the default value for that key.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18703: upgrade Vagrantfile to debian-11
Javier Bértoli [Tue, 1 Feb 2022 23:15:40 +0000 (20:15 -0300)]
18703: upgrade Vagrantfile to debian-11

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18703: upgrade postgres-formula to 0.43.0 for debian-11
Javier Bértoli [Tue, 1 Feb 2022 23:14:59 +0000 (20:14 -0300)]
18703: upgrade postgres-formula to 0.43.0 for debian-11

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '17583-federated-token-reqs'. Closes #17583
Lucas Di Pentima [Tue, 1 Feb 2022 21:51:52 +0000 (18:51 -0300)]
Merge branch '17583-federated-token-reqs'. Closes #17583

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18632-docker-installation-from-packages'
Javier Bértoli [Fri, 28 Jan 2022 20:13:07 +0000 (17:13 -0300)]
Merge branch '18632-docker-installation-from-packages'

closes #18632
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18632: address review comments.
Javier Bértoli [Fri, 28 Jan 2022 18:36:03 +0000 (15:36 -0300)]
18632: address review comments.

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '16727-refresh-signatures'
Tom Clegg [Fri, 28 Jan 2022 16:07:08 +0000 (11:07 -0500)]
Merge branch '16727-refresh-signatures'

closes #16727

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16727: Explain guessSignatureTTL field.
Tom Clegg [Fri, 28 Jan 2022 14:59:06 +0000 (09:59 -0500)]
16727: Explain guessSignatureTTL field.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18632: fix missing docker's pillar in shell node
Javier Bértoli [Thu, 27 Jan 2022 22:06:33 +0000 (19:06 -0300)]
18632: fix missing docker's pillar in shell node

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>