arvados.git
2 years ago18702: add documentation for maintaining and upgrading Arvados. Make it
Ward Vandewege [Wed, 16 Feb 2022 15:39:41 +0000 (10:39 -0500)]
18702: add documentation for maintaining and upgrading Arvados. Make it
       clear that the Salt-based installer is only intended for
       installation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18690-secret-files'
Tom Clegg [Fri, 11 Feb 2022 18:11:43 +0000 (13:11 -0500)]
Merge branch '18690-secret-files'

fixes #18690

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18655-java-prs' refs #18655
Peter Amstutz [Fri, 11 Feb 2022 16:58:50 +0000 (11:58 -0500)]
Merge branch '18655-java-prs' refs #18655

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18690: Use bind mount to avoid writing secrets to output collection.
Tom Clegg [Fri, 11 Feb 2022 08:29:25 +0000 (03:29 -0500)]
18690: Use bind mount to avoid writing secrets to output collection.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge remote-tracking branch 'MajewskiKrzysztof/exclude_home_project_parameter' into...
Peter Amstutz [Thu, 10 Feb 2022 18:35:27 +0000 (13:35 -0500)]
Merge remote-tracking branch 'MajewskiKrzysztof/exclude_home_project_parameter' into 18655-java-prs

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge remote-tracking branch 'MajewskiKrzysztof/keep_client_delete_method' into 18655...
Peter Amstutz [Thu, 10 Feb 2022 18:35:03 +0000 (13:35 -0500)]
Merge remote-tracking branch 'MajewskiKrzysztof/keep_client_delete_method' into 18655-java-prs

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18719-fuse-fixes' refs #18719
Peter Amstutz [Wed, 9 Feb 2022 21:34:54 +0000 (16:34 -0500)]
Merge branch '18719-fuse-fixes' refs #18719

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: Delete commented out code
Peter Amstutz [Wed, 9 Feb 2022 21:34:26 +0000 (16:34 -0500)]
18719: Delete commented out code

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18657-passenger-binstub' refs #18657
Peter Amstutz [Wed, 9 Feb 2022 21:17:19 +0000 (16:17 -0500)]
Merge branch '18657-passenger-binstub' refs #18657

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '17492-fix-bundler-install'
Tom Clegg [Tue, 8 Feb 2022 21:18:39 +0000 (16:18 -0500)]
Merge branch '17492-fix-bundler-install'

refs #17492

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '17492-ruby-sdk-req-ids'. Refs #17492
Lucas Di Pentima [Tue, 8 Feb 2022 20:34:01 +0000 (17:34 -0300)]
Merge branch '17492-ruby-sdk-req-ids'. Refs #17492

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago17492: Clean up bundler version check/install.
Tom Clegg [Tue, 8 Feb 2022 19:09:16 +0000 (14:09 -0500)]
17492: Clean up bundler version check/install.

Apparently gem installs bundler in $HOME, not in $GEM_HOME like we
expected.  The broken code continued working as long as it was using a
pre-existing run-tests temp dir that also installed a version of
bundler in $GEM_HOME because bundler was listed in a Gemfile.lock.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17492: Adds test confirming that req-id is added on exceptions.
Lucas Di Pentima [Tue, 8 Feb 2022 15:44:52 +0000 (12:44 -0300)]
17492: Adds test confirming that req-id is added on exceptions.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18657: Still need to use bundle exec rake??? Fix binstubs/passenger
Peter Amstutz [Mon, 7 Feb 2022 20:33:15 +0000 (15:33 -0500)]
18657: Still need to use bundle exec rake???  Fix binstubs/passenger

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Don't install api & wb binstubs into bin/
Peter Amstutz [Mon, 7 Feb 2022 18:59:11 +0000 (13:59 -0500)]
18657: Don't install api & wb binstubs into bin/

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Be less picky about where bundle is installed
Peter Amstutz [Mon, 7 Feb 2022 18:51:16 +0000 (13:51 -0500)]
18657: Be less picky about where bundle is installed

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Can't symlink to binstubs, need to invoke them in place
Peter Amstutz [Mon, 7 Feb 2022 17:02:29 +0000 (12:02 -0500)]
18657: Can't symlink to binstubs, need to invoke them in place

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Bind mount gems dir at new location
Peter Amstutz [Mon, 7 Feb 2022 16:28:48 +0000 (11:28 -0500)]
18657: Bind mount gems dir at new location

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17492: Implements Arvados::ArvadosClient to set a request-id on every call.
Lucas Di Pentima [Fri, 7 Jan 2022 21:58:54 +0000 (18:58 -0300)]
17492: Implements Arvados::ArvadosClient to set a request-id on every call.

Also, add the req-id is not present on response.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18657: Only get lock on gem install / bundle install
Peter Amstutz [Mon, 7 Feb 2022 16:07:22 +0000 (11:07 -0500)]
18657: Only get lock on gem install / bundle install

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: What if we get rid of setting GEM_HOME entirely
Peter Amstutz [Mon, 7 Feb 2022 15:41:06 +0000 (10:41 -0500)]
18657: What if we get rid of setting GEM_HOME entirely

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Almost working again, stupid Ruby
Peter Amstutz [Mon, 7 Feb 2022 15:31:34 +0000 (10:31 -0500)]
18657: Almost working again, stupid Ruby

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17492: Removes unused & deprecated code.
Lucas Di Pentima [Wed, 5 Jan 2022 17:48:25 +0000 (14:48 -0300)]
17492: Removes unused & deprecated code.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18719: Set collection_record_file = None on base class
Peter Amstutz [Sun, 6 Feb 2022 21:29:39 +0000 (16:29 -0500)]
18719: Set collection_record_file = None on base class

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: No flush TmpCollectionDirectory
Peter Amstutz [Sun, 6 Feb 2022 21:22:02 +0000 (16:22 -0500)]
18719: No flush TmpCollectionDirectory

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: Check for None
Peter Amstutz [Sun, 6 Feb 2022 21:17:32 +0000 (16:17 -0500)]
18719: Check for None

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: Fix TmpCollectionDirectory
Peter Amstutz [Sun, 6 Feb 2022 21:12:45 +0000 (16:12 -0500)]
18719: Fix TmpCollectionDirectory

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: Put back some logic to invalidate collection_record_file
Peter Amstutz [Sun, 6 Feb 2022 21:11:02 +0000 (16:11 -0500)]
18719: Put back some logic to invalidate collection_record_file

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: handle updates on flush()
Peter Amstutz [Sun, 6 Feb 2022 21:00:33 +0000 (16:00 -0500)]
18719: handle updates on flush()

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: Don't try to apply incremental updates to parent inode
Peter Amstutz [Sun, 6 Feb 2022 19:58:13 +0000 (14:58 -0500)]
18719: Don't try to apply incremental updates to parent inode

Just invalidate it and update it.

Don't crash commit_all race.

Running "aws s3 sync" seems to be working now.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: Handle collection_record differently
Peter Amstutz [Sun, 6 Feb 2022 03:05:19 +0000 (22:05 -0500)]
18719: Handle collection_record differently

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18719: Make sure to ignore old versions of collections
Peter Amstutz [Fri, 4 Feb 2022 22:18:58 +0000 (17:18 -0500)]
18719: Make sure to ignore old versions of collections

Simplify websocket events to just call invalidate, don't try to do anything clever.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18713-nvidia-persistenced'
Ward Vandewege [Fri, 4 Feb 2022 16:36:08 +0000 (11:36 -0500)]
Merge branch '18713-nvidia-persistenced'

closes #18713

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18713: Merge branch 'main' into 18713-nvidia-persistenced
Ward Vandewege [Fri, 4 Feb 2022 16:33:44 +0000 (11:33 -0500)]
18713: Merge branch 'main' into 18713-nvidia-persistenced

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoFix typo in documentation.
Ward Vandewege [Thu, 3 Feb 2022 22:05:42 +0000 (17:05 -0500)]
Fix typo in documentation.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18713: expand comment.
Ward Vandewege [Thu, 3 Feb 2022 20:42:18 +0000 (15:42 -0500)]
18713: expand comment.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18713: disable the nvidia-persistenced service in the compute image.
Ward Vandewege [Thu, 3 Feb 2022 18:56:53 +0000 (13:56 -0500)]
18713: disable the nvidia-persistenced service in the compute image.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18703-installer-upgrade-postgres-formula'
Javier Bértoli [Thu, 3 Feb 2022 17:16:25 +0000 (14:16 -0300)]
Merge branch '18703-installer-upgrade-postgres-formula'

closes #18703
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '18679-handle-keys-with-null-values-in-config'
Ward Vandewege [Thu, 3 Feb 2022 16:07:14 +0000 (11:07 -0500)]
Merge branch '18679-handle-keys-with-null-values-in-config'

closes #18679

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18679: if a config file contains a key with a null value, do not
Ward Vandewege [Wed, 2 Feb 2022 22:02:43 +0000 (17:02 -0500)]
18679: if a config file contains a key with a null value, do not
       override the default value for that key.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18703: upgrade Vagrantfile to debian-11
Javier Bértoli [Tue, 1 Feb 2022 23:15:40 +0000 (20:15 -0300)]
18703: upgrade Vagrantfile to debian-11

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18703: upgrade postgres-formula to 0.43.0 for debian-11
Javier Bértoli [Tue, 1 Feb 2022 23:14:59 +0000 (20:14 -0300)]
18703: upgrade postgres-formula to 0.43.0 for debian-11

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '17583-federated-token-reqs'. Closes #17583
Lucas Di Pentima [Tue, 1 Feb 2022 21:51:52 +0000 (18:51 -0300)]
Merge branch '17583-federated-token-reqs'. Closes #17583

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18632-docker-installation-from-packages'
Javier Bértoli [Fri, 28 Jan 2022 20:13:07 +0000 (17:13 -0300)]
Merge branch '18632-docker-installation-from-packages'

closes #18632
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18632: address review comments.
Javier Bértoli [Fri, 28 Jan 2022 18:36:03 +0000 (15:36 -0300)]
18632: address review comments.

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '16727-refresh-signatures'
Tom Clegg [Fri, 28 Jan 2022 16:07:08 +0000 (11:07 -0500)]
Merge branch '16727-refresh-signatures'

closes #16727

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16727: Explain guessSignatureTTL field.
Tom Clegg [Fri, 28 Jan 2022 14:59:06 +0000 (09:59 -0500)]
16727: Explain guessSignatureTTL field.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18632: fix missing docker's pillar in shell node
Javier Bértoli [Thu, 27 Jan 2022 22:06:33 +0000 (19:06 -0300)]
18632: fix missing docker's pillar in shell node

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18632: fix docker pillar in provision script
Javier Bértoli [Thu, 27 Jan 2022 18:31:04 +0000 (15:31 -0300)]
18632: fix docker pillar in provision script

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago16727: Refresh block permission signatures on Sync and Read.
Tom Clegg [Tue, 25 Jan 2022 16:15:51 +0000 (11:15 -0500)]
16727: Refresh block permission signatures on Sync and Read.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18670-flaky-lsf-test'
Tom Clegg [Thu, 27 Jan 2022 14:23:02 +0000 (09:23 -0500)]
Merge branch '18670-flaky-lsf-test'

fixes #18670

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18670: Fix abandoned job tracker during race.
Tom Clegg [Wed, 26 Jan 2022 18:32:13 +0000 (13:32 -0500)]
18670: Fix abandoned job tracker during race.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18678-custom-certs-keepstore-fix'
Ward Vandewege [Tue, 25 Jan 2022 20:11:53 +0000 (15:11 -0500)]
Merge branch '18678-custom-certs-keepstore-fix'

closes #18678

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18678: installer: when custom certs are used, do not abort when a role
Ward Vandewege [Tue, 25 Jan 2022 19:55:38 +0000 (14:55 -0500)]
18678: installer: when custom certs are used, do not abort when a role
       is used that does not require any certificates.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18326-cuda-docs' refs #18326
Peter Amstutz [Tue, 25 Jan 2022 16:26:33 +0000 (11:26 -0500)]
Merge branch '18326-cuda-docs' refs #18326

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18326: Whitespace fixes
Peter Amstutz [Tue, 25 Jan 2022 16:22:44 +0000 (11:22 -0500)]
18326: Whitespace fixes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18487-vocab-config-check'. Closes #18487
Lucas Di Pentima [Tue, 25 Jan 2022 11:37:19 +0000 (08:37 -0300)]
Merge branch '18487-vocab-config-check'. Closes #18487

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18670: Fix unreliable test.
Tom Clegg [Tue, 25 Jan 2022 04:48:17 +0000 (23:48 -0500)]
18670: Fix unreliable test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18487: Logs vocabulary validating error messages along with other checks.
Lucas Di Pentima [Mon, 24 Jan 2022 20:18:07 +0000 (17:18 -0300)]
18487: Logs vocabulary validating error messages along with other checks.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18665-vscode-setup' refs #18665
Peter Amstutz [Mon, 24 Jan 2022 19:00:27 +0000 (14:00 -0500)]
Merge branch '18665-vscode-setup' refs #18665

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18665: Separate Set Host and Set Token steps
Peter Amstutz [Mon, 24 Jan 2022 18:43:30 +0000 (13:43 -0500)]
18665: Separate Set Host and Set Token steps

Being separated because the previous "paste the whole
contents of the dialog box" was actually more confusing than helpful.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Fix passenger-config not found by installing binstub & using that
Peter Amstutz [Mon, 24 Jan 2022 16:43:29 +0000 (11:43 -0500)]
18657: Fix passenger-config not found by installing binstub & using that

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17583: Forwards ApiClientAuthorization list requests to LoginCluster.
Lucas Di Pentima [Fri, 21 Jan 2022 20:27:36 +0000 (17:27 -0300)]
17583: Forwards ApiClientAuthorization list requests to LoginCluster.

Also, honor the bypass_federation parameter.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoDocumentation tweaks for the Salt installer.
Ward Vandewege [Fri, 21 Jan 2022 20:16:32 +0000 (15:16 -0500)]
Documentation tweaks for the Salt installer.

refs #18658

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago17583: Expands test to expose one pending bug.
Lucas Di Pentima [Fri, 21 Jan 2022 20:15:21 +0000 (17:15 -0300)]
17583: Expands test to expose one pending bug.

ApiClientAuthorization LIST requests are not being forwarded on LoginCluster
federations.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18658-fix-custom-certs-deployment-on-multi-host'
Javier Bértoli [Fri, 21 Jan 2022 19:56:04 +0000 (16:56 -0300)]
Merge branch '18658-fix-custom-certs-deployment-on-multi-host'

closes #18658
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18658: address review comments.
Javier Bértoli [Fri, 21 Jan 2022 19:07:00 +0000 (16:07 -0300)]
18658: address review comments.

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18658: ensure custom SSL certs are copied to the correct host dir
Javier Bértoli [Thu, 20 Jan 2022 23:17:26 +0000 (20:17 -0300)]
18658: ensure custom SSL certs are copied to the correct host dir

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18658: update multi-host's nginx pillar to use rvm ruby on Ubuntu-18.04
Javier Bértoli [Thu, 20 Jan 2022 23:16:12 +0000 (20:16 -0300)]
18658: update multi-host's nginx pillar to use rvm ruby on Ubuntu-18.04

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18658: add missing state to deploy custom certs in multi-host env
Javier Bértoli [Thu, 20 Jan 2022 15:22:16 +0000 (12:22 -0300)]
18658: add missing state to deploy custom certs in multi-host env

Also, set the full path to the certs dir if not configured

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoSalt installer fixes:
Ward Vandewege [Thu, 20 Jan 2022 21:34:08 +0000 (16:34 -0500)]
Salt installer fixes:
* documentation: fix formatting
* multi-host aws example: remove AccessViaHosts from the config file, it
  is not necessary. Fix volume identifiers. Fix link to documentation by
  dispatcher key.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18487: Improves vocabulary documentation.
Lucas Di Pentima [Thu, 20 Jan 2022 21:31:51 +0000 (18:31 -0300)]
18487: Improves vocabulary documentation.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18487: Fixes error reporting to include both JSON & vocabulary errors at once.
Lucas Di Pentima [Thu, 20 Jan 2022 20:00:17 +0000 (17:00 -0300)]
18487: Fixes error reporting to include both JSON & vocabulary errors at once.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18659-cast-devnum'
Tom Clegg [Thu, 20 Jan 2022 18:49:52 +0000 (13:49 -0500)]
Merge branch '18659-cast-devnum'

fixes #18659

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18659: Cast OS-specific device number type to uint64.
Tom Clegg [Thu, 20 Jan 2022 17:04:51 +0000 (12:04 -0500)]
18659: Cast OS-specific device number type to uint64.

Fixes compile error on GOOS=darwin.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18487: Fixes error checking on nonexistant vocabulary file. Adds tests.
Lucas Di Pentima [Tue, 18 Jan 2022 15:54:59 +0000 (12:54 -0300)]
18487: Fixes error checking on nonexistant vocabulary file. Adds tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18487: Improves vocabulary error checking, with tests.
Lucas Di Pentima [Tue, 18 Jan 2022 14:29:49 +0000 (11:29 -0300)]
18487: Improves vocabulary error checking, with tests.

* Adds JSON duplicated keys checking (json.Unmarshall silently accepts them).
* Adds line & column numbers to JSON syntax errors.
* Reports all detected non-syntax errors at once instead of returning on the
first one. (so that the site admin doesn't have to do multiple edit+check
cycles)

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18487: Adds vocabulary check to 'arvados-server config-check'
Lucas Di Pentima [Mon, 17 Jan 2022 19:20:01 +0000 (16:20 -0300)]
18487: Adds vocabulary check to 'arvados-server config-check'

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18513-log-signal-exit'
Tom Clegg [Tue, 18 Jan 2022 18:51:16 +0000 (13:51 -0500)]
Merge branch '18513-log-signal-exit'

closes #18513

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18513: Decipher status code in crunch-run.txt log.
Tom Clegg [Tue, 18 Jan 2022 15:13:50 +0000 (10:13 -0500)]
18513: Decipher status code in crunch-run.txt log.

Container exited with status code 137 (signal 9, SIGKILL)

Previously, docker mode just said "exited with code: 137" and
singularity mode didn't mention it at all.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoAdd excludeHomeProject parameter to ListArgument
majewsk6 [Tue, 18 Jan 2022 09:03:40 +0000 (10:03 +0100)]
Add excludeHomeProject parameter to ListArgument
Arvados-DCO-1.1-Signed-off-by: Krzysztof Majewski majewski.kielce@gmail.com

2 years agoAdd DELETE method to Keep Client
majewsk6 [Tue, 18 Jan 2022 08:59:50 +0000 (09:59 +0100)]
Add DELETE method to Keep Client
Arvados-DCO-1.1-Signed-off-by: Krzysztof Majewski majewski.kielce@gmail.com

2 years agoMerge branch '18624-document-compute-image-requirements'
Ward Vandewege [Fri, 14 Jan 2022 20:51:48 +0000 (15:51 -0500)]
Merge branch '18624-document-compute-image-requirements'

closes #18624

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18624: implement review feedback.
Ward Vandewege [Fri, 14 Jan 2022 18:51:44 +0000 (13:51 -0500)]
18624: implement review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18326: Update documentation to cover configuring GPU support
Peter Amstutz [Thu, 13 Jan 2022 22:20:39 +0000 (17:20 -0500)]
18326: Update documentation to cover configuring GPU support

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18624: crunch-run no longer needs to be preinstalled on our cloud
Ward Vandewege [Thu, 13 Jan 2022 13:39:10 +0000 (08:39 -0500)]
18624: crunch-run no longer needs to be preinstalled on our cloud
       compute images, arvados-dispatch-cloud copies it over.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18624: documentation: describe the arvados-dispatch-cloud requirements
Ward Vandewege [Wed, 12 Jan 2022 21:33:47 +0000 (16:33 -0500)]
18624: documentation: describe the arvados-dispatch-cloud requirements
       for compute nodes.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '12630-nvidia-devices' refs #12630
Peter Amstutz [Mon, 10 Jan 2022 22:01:25 +0000 (17:01 -0500)]
Merge branch '12630-nvidia-devices' refs #12630

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago12630: Log command line
Peter Amstutz [Mon, 10 Jan 2022 21:59:51 +0000 (16:59 -0500)]
12630: Log command line

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago12630: Tweak nvidia warnings
Peter Amstutz [Mon, 10 Jan 2022 20:39:26 +0000 (15:39 -0500)]
12630: Tweak nvidia warnings

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoWhen installing the bundler gem in run-tests.sh, always use
Ward Vandewege [Mon, 10 Jan 2022 20:26:29 +0000 (15:26 -0500)]
When installing the bundler gem in run-tests.sh, always use
--no-document

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago12630: Report errors from nvidia-modprobe & use Getenv
Peter Amstutz [Mon, 10 Jan 2022 19:11:37 +0000 (14:11 -0500)]
12630: Report errors from nvidia-modprobe & use Getenv

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18324-lsf-gpu' refs #18324
Peter Amstutz [Mon, 10 Jan 2022 16:26:16 +0000 (11:26 -0500)]
Merge branch '18324-lsf-gpu' refs #18324

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago12630: Fix test
Peter Amstutz [Sat, 8 Jan 2022 19:02:33 +0000 (14:02 -0500)]
12630: Fix test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch 'main' into 18324-lsf-gpu
Peter Amstutz [Fri, 7 Jan 2022 22:19:54 +0000 (17:19 -0500)]
Merge branch 'main' into 18324-lsf-gpu

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago12630: Fix usage of string.Split
Peter Amstutz [Fri, 7 Jan 2022 23:10:29 +0000 (18:10 -0500)]
12630: Fix usage of string.Split

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago12630: request both 'compute' and 'utility' nvidia capabilities
Peter Amstutz [Fri, 7 Jan 2022 22:56:08 +0000 (17:56 -0500)]
12630: request both 'compute' and 'utility' nvidia capabilities

Add note about capabilities.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago12630: Call nvidia-modprobe, support CUDA_VISIBLE_DEVICES
Peter Amstutz [Fri, 7 Jan 2022 22:13:09 +0000 (17:13 -0500)]
12630: Call nvidia-modprobe, support CUDA_VISIBLE_DEVICES

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '17417-add-arm64'
Ward Vandewege [Fri, 7 Jan 2022 19:53:04 +0000 (14:53 -0500)]
Merge branch '17417-add-arm64'

refs #17417

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago17417: Merge branch 'main' into 17417-add-arm64
Ward Vandewege [Fri, 7 Jan 2022 19:52:31 +0000 (14:52 -0500)]
17417: Merge branch 'main' into 17417-add-arm64

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>