arvados.git
2 years agoMerge branch '18657-passenger-binstub' refs #18657
Peter Amstutz [Wed, 9 Feb 2022 21:17:19 +0000 (16:17 -0500)]
Merge branch '18657-passenger-binstub' refs #18657

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '17492-fix-bundler-install'
Tom Clegg [Tue, 8 Feb 2022 21:18:39 +0000 (16:18 -0500)]
Merge branch '17492-fix-bundler-install'

refs #17492

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '17492-ruby-sdk-req-ids'. Refs #17492
Lucas Di Pentima [Tue, 8 Feb 2022 20:34:01 +0000 (17:34 -0300)]
Merge branch '17492-ruby-sdk-req-ids'. Refs #17492

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago17492: Clean up bundler version check/install.
Tom Clegg [Tue, 8 Feb 2022 19:09:16 +0000 (14:09 -0500)]
17492: Clean up bundler version check/install.

Apparently gem installs bundler in $HOME, not in $GEM_HOME like we
expected.  The broken code continued working as long as it was using a
pre-existing run-tests temp dir that also installed a version of
bundler in $GEM_HOME because bundler was listed in a Gemfile.lock.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17492: Adds test confirming that req-id is added on exceptions.
Lucas Di Pentima [Tue, 8 Feb 2022 15:44:52 +0000 (12:44 -0300)]
17492: Adds test confirming that req-id is added on exceptions.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18657: Still need to use bundle exec rake??? Fix binstubs/passenger
Peter Amstutz [Mon, 7 Feb 2022 20:33:15 +0000 (15:33 -0500)]
18657: Still need to use bundle exec rake???  Fix binstubs/passenger

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Don't install api & wb binstubs into bin/
Peter Amstutz [Mon, 7 Feb 2022 18:59:11 +0000 (13:59 -0500)]
18657: Don't install api & wb binstubs into bin/

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Be less picky about where bundle is installed
Peter Amstutz [Mon, 7 Feb 2022 18:51:16 +0000 (13:51 -0500)]
18657: Be less picky about where bundle is installed

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Can't symlink to binstubs, need to invoke them in place
Peter Amstutz [Mon, 7 Feb 2022 17:02:29 +0000 (12:02 -0500)]
18657: Can't symlink to binstubs, need to invoke them in place

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Bind mount gems dir at new location
Peter Amstutz [Mon, 7 Feb 2022 16:28:48 +0000 (11:28 -0500)]
18657: Bind mount gems dir at new location

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17492: Implements Arvados::ArvadosClient to set a request-id on every call.
Lucas Di Pentima [Fri, 7 Jan 2022 21:58:54 +0000 (18:58 -0300)]
17492: Implements Arvados::ArvadosClient to set a request-id on every call.

Also, add the req-id is not present on response.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18657: Only get lock on gem install / bundle install
Peter Amstutz [Mon, 7 Feb 2022 16:07:22 +0000 (11:07 -0500)]
18657: Only get lock on gem install / bundle install

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: What if we get rid of setting GEM_HOME entirely
Peter Amstutz [Mon, 7 Feb 2022 15:41:06 +0000 (10:41 -0500)]
18657: What if we get rid of setting GEM_HOME entirely

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Almost working again, stupid Ruby
Peter Amstutz [Mon, 7 Feb 2022 15:31:34 +0000 (10:31 -0500)]
18657: Almost working again, stupid Ruby

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17492: Removes unused & deprecated code.
Lucas Di Pentima [Wed, 5 Jan 2022 17:48:25 +0000 (14:48 -0300)]
17492: Removes unused & deprecated code.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18713-nvidia-persistenced'
Ward Vandewege [Fri, 4 Feb 2022 16:36:08 +0000 (11:36 -0500)]
Merge branch '18713-nvidia-persistenced'

closes #18713

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18713: Merge branch 'main' into 18713-nvidia-persistenced
Ward Vandewege [Fri, 4 Feb 2022 16:33:44 +0000 (11:33 -0500)]
18713: Merge branch 'main' into 18713-nvidia-persistenced

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoFix typo in documentation.
Ward Vandewege [Thu, 3 Feb 2022 22:05:42 +0000 (17:05 -0500)]
Fix typo in documentation.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18713: expand comment.
Ward Vandewege [Thu, 3 Feb 2022 20:42:18 +0000 (15:42 -0500)]
18713: expand comment.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18713: disable the nvidia-persistenced service in the compute image.
Ward Vandewege [Thu, 3 Feb 2022 18:56:53 +0000 (13:56 -0500)]
18713: disable the nvidia-persistenced service in the compute image.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18703-installer-upgrade-postgres-formula'
Javier Bértoli [Thu, 3 Feb 2022 17:16:25 +0000 (14:16 -0300)]
Merge branch '18703-installer-upgrade-postgres-formula'

closes #18703
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '18679-handle-keys-with-null-values-in-config'
Ward Vandewege [Thu, 3 Feb 2022 16:07:14 +0000 (11:07 -0500)]
Merge branch '18679-handle-keys-with-null-values-in-config'

closes #18679

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18679: if a config file contains a key with a null value, do not
Ward Vandewege [Wed, 2 Feb 2022 22:02:43 +0000 (17:02 -0500)]
18679: if a config file contains a key with a null value, do not
       override the default value for that key.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18703: upgrade Vagrantfile to debian-11
Javier Bértoli [Tue, 1 Feb 2022 23:15:40 +0000 (20:15 -0300)]
18703: upgrade Vagrantfile to debian-11

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18703: upgrade postgres-formula to 0.43.0 for debian-11
Javier Bértoli [Tue, 1 Feb 2022 23:14:59 +0000 (20:14 -0300)]
18703: upgrade postgres-formula to 0.43.0 for debian-11

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '17583-federated-token-reqs'. Closes #17583
Lucas Di Pentima [Tue, 1 Feb 2022 21:51:52 +0000 (18:51 -0300)]
Merge branch '17583-federated-token-reqs'. Closes #17583

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18632-docker-installation-from-packages'
Javier Bértoli [Fri, 28 Jan 2022 20:13:07 +0000 (17:13 -0300)]
Merge branch '18632-docker-installation-from-packages'

closes #18632
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18632: address review comments.
Javier Bértoli [Fri, 28 Jan 2022 18:36:03 +0000 (15:36 -0300)]
18632: address review comments.

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '16727-refresh-signatures'
Tom Clegg [Fri, 28 Jan 2022 16:07:08 +0000 (11:07 -0500)]
Merge branch '16727-refresh-signatures'

closes #16727

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16727: Explain guessSignatureTTL field.
Tom Clegg [Fri, 28 Jan 2022 14:59:06 +0000 (09:59 -0500)]
16727: Explain guessSignatureTTL field.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18632: fix missing docker's pillar in shell node
Javier Bértoli [Thu, 27 Jan 2022 22:06:33 +0000 (19:06 -0300)]
18632: fix missing docker's pillar in shell node

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18632: fix docker pillar in provision script
Javier Bértoli [Thu, 27 Jan 2022 18:31:04 +0000 (15:31 -0300)]
18632: fix docker pillar in provision script

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago16727: Refresh block permission signatures on Sync and Read.
Tom Clegg [Tue, 25 Jan 2022 16:15:51 +0000 (11:15 -0500)]
16727: Refresh block permission signatures on Sync and Read.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18670-flaky-lsf-test'
Tom Clegg [Thu, 27 Jan 2022 14:23:02 +0000 (09:23 -0500)]
Merge branch '18670-flaky-lsf-test'

fixes #18670

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18670: Fix abandoned job tracker during race.
Tom Clegg [Wed, 26 Jan 2022 18:32:13 +0000 (13:32 -0500)]
18670: Fix abandoned job tracker during race.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18678-custom-certs-keepstore-fix'
Ward Vandewege [Tue, 25 Jan 2022 20:11:53 +0000 (15:11 -0500)]
Merge branch '18678-custom-certs-keepstore-fix'

closes #18678

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18678: installer: when custom certs are used, do not abort when a role
Ward Vandewege [Tue, 25 Jan 2022 19:55:38 +0000 (14:55 -0500)]
18678: installer: when custom certs are used, do not abort when a role
       is used that does not require any certificates.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18326-cuda-docs' refs #18326
Peter Amstutz [Tue, 25 Jan 2022 16:26:33 +0000 (11:26 -0500)]
Merge branch '18326-cuda-docs' refs #18326

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18326: Whitespace fixes
Peter Amstutz [Tue, 25 Jan 2022 16:22:44 +0000 (11:22 -0500)]
18326: Whitespace fixes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18487-vocab-config-check'. Closes #18487
Lucas Di Pentima [Tue, 25 Jan 2022 11:37:19 +0000 (08:37 -0300)]
Merge branch '18487-vocab-config-check'. Closes #18487

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18670: Fix unreliable test.
Tom Clegg [Tue, 25 Jan 2022 04:48:17 +0000 (23:48 -0500)]
18670: Fix unreliable test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18487: Logs vocabulary validating error messages along with other checks.
Lucas Di Pentima [Mon, 24 Jan 2022 20:18:07 +0000 (17:18 -0300)]
18487: Logs vocabulary validating error messages along with other checks.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18665-vscode-setup' refs #18665
Peter Amstutz [Mon, 24 Jan 2022 19:00:27 +0000 (14:00 -0500)]
Merge branch '18665-vscode-setup' refs #18665

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18665: Separate Set Host and Set Token steps
Peter Amstutz [Mon, 24 Jan 2022 18:43:30 +0000 (13:43 -0500)]
18665: Separate Set Host and Set Token steps

Being separated because the previous "paste the whole
contents of the dialog box" was actually more confusing than helpful.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18657: Fix passenger-config not found by installing binstub & using that
Peter Amstutz [Mon, 24 Jan 2022 16:43:29 +0000 (11:43 -0500)]
18657: Fix passenger-config not found by installing binstub & using that

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17583: Forwards ApiClientAuthorization list requests to LoginCluster.
Lucas Di Pentima [Fri, 21 Jan 2022 20:27:36 +0000 (17:27 -0300)]
17583: Forwards ApiClientAuthorization list requests to LoginCluster.

Also, honor the bypass_federation parameter.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoDocumentation tweaks for the Salt installer.
Ward Vandewege [Fri, 21 Jan 2022 20:16:32 +0000 (15:16 -0500)]
Documentation tweaks for the Salt installer.

refs #18658

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago17583: Expands test to expose one pending bug.
Lucas Di Pentima [Fri, 21 Jan 2022 20:15:21 +0000 (17:15 -0300)]
17583: Expands test to expose one pending bug.

ApiClientAuthorization LIST requests are not being forwarded on LoginCluster
federations.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18658-fix-custom-certs-deployment-on-multi-host'
Javier Bértoli [Fri, 21 Jan 2022 19:56:04 +0000 (16:56 -0300)]
Merge branch '18658-fix-custom-certs-deployment-on-multi-host'

closes #18658
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18658: address review comments.
Javier Bértoli [Fri, 21 Jan 2022 19:07:00 +0000 (16:07 -0300)]
18658: address review comments.

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18658: ensure custom SSL certs are copied to the correct host dir
Javier Bértoli [Thu, 20 Jan 2022 23:17:26 +0000 (20:17 -0300)]
18658: ensure custom SSL certs are copied to the correct host dir

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18658: update multi-host's nginx pillar to use rvm ruby on Ubuntu-18.04
Javier Bértoli [Thu, 20 Jan 2022 23:16:12 +0000 (20:16 -0300)]
18658: update multi-host's nginx pillar to use rvm ruby on Ubuntu-18.04

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18658: add missing state to deploy custom certs in multi-host env
Javier Bértoli [Thu, 20 Jan 2022 15:22:16 +0000 (12:22 -0300)]
18658: add missing state to deploy custom certs in multi-host env

Also, set the full path to the certs dir if not configured

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoSalt installer fixes:
Ward Vandewege [Thu, 20 Jan 2022 21:34:08 +0000 (16:34 -0500)]
Salt installer fixes:
* documentation: fix formatting
* multi-host aws example: remove AccessViaHosts from the config file, it
  is not necessary. Fix volume identifiers. Fix link to documentation by
  dispatcher key.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18487: Improves vocabulary documentation.
Lucas Di Pentima [Thu, 20 Jan 2022 21:31:51 +0000 (18:31 -0300)]
18487: Improves vocabulary documentation.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18487: Fixes error reporting to include both JSON & vocabulary errors at once.
Lucas Di Pentima [Thu, 20 Jan 2022 20:00:17 +0000 (17:00 -0300)]
18487: Fixes error reporting to include both JSON & vocabulary errors at once.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18659-cast-devnum'
Tom Clegg [Thu, 20 Jan 2022 18:49:52 +0000 (13:49 -0500)]
Merge branch '18659-cast-devnum'

fixes #18659

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18659: Cast OS-specific device number type to uint64.
Tom Clegg [Thu, 20 Jan 2022 17:04:51 +0000 (12:04 -0500)]
18659: Cast OS-specific device number type to uint64.

Fixes compile error on GOOS=darwin.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18487: Fixes error checking on nonexistant vocabulary file. Adds tests.
Lucas Di Pentima [Tue, 18 Jan 2022 15:54:59 +0000 (12:54 -0300)]
18487: Fixes error checking on nonexistant vocabulary file. Adds tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18487: Improves vocabulary error checking, with tests.
Lucas Di Pentima [Tue, 18 Jan 2022 14:29:49 +0000 (11:29 -0300)]
18487: Improves vocabulary error checking, with tests.

* Adds JSON duplicated keys checking (json.Unmarshall silently accepts them).
* Adds line & column numbers to JSON syntax errors.
* Reports all detected non-syntax errors at once instead of returning on the
first one. (so that the site admin doesn't have to do multiple edit+check
cycles)

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18487: Adds vocabulary check to 'arvados-server config-check'
Lucas Di Pentima [Mon, 17 Jan 2022 19:20:01 +0000 (16:20 -0300)]
18487: Adds vocabulary check to 'arvados-server config-check'

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18513-log-signal-exit'
Tom Clegg [Tue, 18 Jan 2022 18:51:16 +0000 (13:51 -0500)]
Merge branch '18513-log-signal-exit'

closes #18513

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18513: Decipher status code in crunch-run.txt log.
Tom Clegg [Tue, 18 Jan 2022 15:13:50 +0000 (10:13 -0500)]
18513: Decipher status code in crunch-run.txt log.

Container exited with status code 137 (signal 9, SIGKILL)

Previously, docker mode just said "exited with code: 137" and
singularity mode didn't mention it at all.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18624-document-compute-image-requirements'
Ward Vandewege [Fri, 14 Jan 2022 20:51:48 +0000 (15:51 -0500)]
Merge branch '18624-document-compute-image-requirements'

closes #18624

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18624: implement review feedback.
Ward Vandewege [Fri, 14 Jan 2022 18:51:44 +0000 (13:51 -0500)]
18624: implement review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18326: Update documentation to cover configuring GPU support
Peter Amstutz [Thu, 13 Jan 2022 22:20:39 +0000 (17:20 -0500)]
18326: Update documentation to cover configuring GPU support

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18624: crunch-run no longer needs to be preinstalled on our cloud
Ward Vandewege [Thu, 13 Jan 2022 13:39:10 +0000 (08:39 -0500)]
18624: crunch-run no longer needs to be preinstalled on our cloud
       compute images, arvados-dispatch-cloud copies it over.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18624: documentation: describe the arvados-dispatch-cloud requirements
Ward Vandewege [Wed, 12 Jan 2022 21:33:47 +0000 (16:33 -0500)]
18624: documentation: describe the arvados-dispatch-cloud requirements
       for compute nodes.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '12630-nvidia-devices' refs #12630
Peter Amstutz [Mon, 10 Jan 2022 22:01:25 +0000 (17:01 -0500)]
Merge branch '12630-nvidia-devices' refs #12630

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago12630: Log command line
Peter Amstutz [Mon, 10 Jan 2022 21:59:51 +0000 (16:59 -0500)]
12630: Log command line

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago12630: Tweak nvidia warnings
Peter Amstutz [Mon, 10 Jan 2022 20:39:26 +0000 (15:39 -0500)]
12630: Tweak nvidia warnings

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoWhen installing the bundler gem in run-tests.sh, always use
Ward Vandewege [Mon, 10 Jan 2022 20:26:29 +0000 (15:26 -0500)]
When installing the bundler gem in run-tests.sh, always use
--no-document

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago12630: Report errors from nvidia-modprobe & use Getenv
Peter Amstutz [Mon, 10 Jan 2022 19:11:37 +0000 (14:11 -0500)]
12630: Report errors from nvidia-modprobe & use Getenv

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18324-lsf-gpu' refs #18324
Peter Amstutz [Mon, 10 Jan 2022 16:26:16 +0000 (11:26 -0500)]
Merge branch '18324-lsf-gpu' refs #18324

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago12630: Fix test
Peter Amstutz [Sat, 8 Jan 2022 19:02:33 +0000 (14:02 -0500)]
12630: Fix test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch 'main' into 18324-lsf-gpu
Peter Amstutz [Fri, 7 Jan 2022 22:19:54 +0000 (17:19 -0500)]
Merge branch 'main' into 18324-lsf-gpu

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago12630: Fix usage of string.Split
Peter Amstutz [Fri, 7 Jan 2022 23:10:29 +0000 (18:10 -0500)]
12630: Fix usage of string.Split

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago12630: request both 'compute' and 'utility' nvidia capabilities
Peter Amstutz [Fri, 7 Jan 2022 22:56:08 +0000 (17:56 -0500)]
12630: request both 'compute' and 'utility' nvidia capabilities

Add note about capabilities.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago12630: Call nvidia-modprobe, support CUDA_VISIBLE_DEVICES
Peter Amstutz [Fri, 7 Jan 2022 22:13:09 +0000 (17:13 -0500)]
12630: Call nvidia-modprobe, support CUDA_VISIBLE_DEVICES

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '17417-add-arm64'
Ward Vandewege [Fri, 7 Jan 2022 19:53:04 +0000 (14:53 -0500)]
Merge branch '17417-add-arm64'

refs #17417

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago17417: Merge branch 'main' into 17417-add-arm64
Ward Vandewege [Fri, 7 Jan 2022 19:52:31 +0000 (14:52 -0500)]
17417: Merge branch 'main' into 17417-add-arm64

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18577-fix-back_url'
Ward Vandewege [Fri, 7 Jan 2022 18:56:25 +0000 (13:56 -0500)]
Merge branch '18577-fix-back_url'

closes #18577

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18577: Merge branch 'main' into 18577-fix-back_url
Ward Vandewege [Fri, 7 Jan 2022 18:55:50 +0000 (13:55 -0500)]
18577: Merge branch 'main' into 18577-fix-back_url

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago17417: address review comments.
Ward Vandewege [Fri, 7 Jan 2022 18:51:39 +0000 (13:51 -0500)]
17417: address review comments.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoRelease branches were renamed.
Ward Vandewege [Thu, 6 Jan 2022 18:00:18 +0000 (13:00 -0500)]
Release branches were renamed.

closes #18249

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoBugfixes: doc: show the correct branch names for all the Salt install
Ward Vandewege [Thu, 6 Jan 2022 17:02:37 +0000 (12:02 -0500)]
Bugfixes: doc: show the correct branch names for all the Salt install
methods.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18323-cwl-gpu2' refs #18323
Peter Amstutz [Wed, 5 Jan 2022 21:50:23 +0000 (16:50 -0500)]
Merge branch '18323-cwl-gpu2' refs #18323

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17417: Merge branch 'main' into 17417-add-arm64
Ward Vandewege [Wed, 5 Jan 2022 21:38:52 +0000 (16:38 -0500)]
17417: Merge branch 'main' into 17417-add-arm64

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago17417: Merge branch 'main' into 17417-add-arm64
Ward Vandewege [Wed, 5 Jan 2022 21:35:02 +0000 (16:35 -0500)]
17417: Merge branch 'main' into 17417-add-arm64

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoRemove one more use of `go get` from run-library.sh.
Ward Vandewege [Wed, 5 Jan 2022 19:56:03 +0000 (14:56 -0500)]
Remove one more use of `go get` from run-library.sh.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18323: Fix test
Peter Amstutz [Wed, 5 Jan 2022 21:06:28 +0000 (16:06 -0500)]
18323: Fix test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18324: Incorporate BsubCUDAArguments. update test
Peter Amstutz [Wed, 5 Jan 2022 20:53:17 +0000 (15:53 -0500)]
18324: Incorporate BsubCUDAArguments.  update test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18323: Fix test
Peter Amstutz [Wed, 5 Jan 2022 20:05:25 +0000 (15:05 -0500)]
18323: Fix test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18323: Fix to use cwltool:CUDARequirement
Peter Amstutz [Wed, 5 Jan 2022 20:03:30 +0000 (15:03 -0500)]
18323: Fix to use cwltool:CUDARequirement

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18577: workbench1: remove references to `redirect_to :back`, this
Ward Vandewege [Wed, 5 Jan 2022 19:34:45 +0000 (14:34 -0500)]
18577: workbench1: remove references to `redirect_to :back`, this
       stopped working in Rails 5.1.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago17417: add --only-build flag to the
Ward Vandewege [Wed, 5 Jan 2022 18:54:16 +0000 (13:54 -0500)]
17417: add --only-build flag to the
       run-build-test-packages-one-target.sh script.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago17417: Because of debian bug #983477, libfuse-dev for arm64 does not
Ward Vandewege [Wed, 5 Jan 2022 16:20:23 +0000 (11:20 -0500)]
17417: Because of debian bug #983477, libfuse-dev for arm64 does not
       install properly beside the amd64 version. This was fixed in
       debian11. Rather than making run-library.sh even more complicated
       by switching out libfuse-dev before every arm64 cross compiled
       build or by building a custom version of libfuse-dev, I disabled
       cross compilation the older Debian-based distributions we support.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago17417: another optimization: instead of building the
Ward Vandewege [Wed, 5 Jan 2022 15:27:02 +0000 (10:27 -0500)]
17417: another optimization: instead of building the
       arvados-python-client sdist regardless of the value of
       $ONLY_BUILD, only do it when it is actually needed.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago17417: fix bug to enable arm64 cross-compilation on amd64 for our go
Ward Vandewege [Wed, 5 Jan 2022 01:11:43 +0000 (20:11 -0500)]
17417: fix bug to enable arm64 cross-compilation on amd64 for our go
       packages. Also make sure package testing works (at least for
       amd64).

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoRemove deprecated use of `go get` from run-tests.sh. This should solve
Ward Vandewege [Wed, 5 Jan 2022 16:56:03 +0000 (11:56 -0500)]
Remove deprecated use of `go get` from run-tests.sh. This should solve
the occasional surprise modifications of go.mod/go.sum.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>