arvados.git
2 years agoMerge branch '18766-fix-ubuntu1804-python3-path'
Ward Vandewege [Wed, 9 Mar 2022 13:16:46 +0000 (08:16 -0500)]
Merge branch '18766-fix-ubuntu1804-python3-path'

closes #18766

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18766: Merge branch 'main' into 18766-fix-ubuntu1804-python3-path
Ward Vandewege [Wed, 9 Mar 2022 13:15:17 +0000 (08:15 -0500)]
18766: Merge branch 'main' into 18766-fix-ubuntu1804-python3-path

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoThe nokogiri bump requires a newer version of Ruby (2.6 minimum). Update
Ward Vandewege [Tue, 8 Mar 2022 18:15:22 +0000 (13:15 -0500)]
The nokogiri bump requires a newer version of Ruby (2.6 minimum). Update
our documentation and the package build/test Dockerfiles.

closes #18838

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18838-bump-nokogiri'
Ward Vandewege [Mon, 7 Mar 2022 20:11:47 +0000 (15:11 -0500)]
Merge branch '18838-bump-nokogiri'

closes #18838

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18838: Merge branch 'main' into 18838-bump-nokogiri
Ward Vandewege [Mon, 7 Mar 2022 20:11:12 +0000 (15:11 -0500)]
18838: Merge branch 'main' into 18838-bump-nokogiri

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18766: because our Ubuntu 18.04 Python packages now depend on
Ward Vandewege [Mon, 7 Mar 2022 18:21:45 +0000 (13:21 -0500)]
18766: because our Ubuntu 18.04 Python packages now depend on
       python-3.8, the path for the Python executables in our packages
       has changed. Put a note in the documentation, make the package
       testing script able to handle that, and for good measure, also
       make sure the arvados/jobs Dockerfile can handle it.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18766: add --force-test and --force-build options to the
Ward Vandewege [Mon, 7 Mar 2022 17:31:45 +0000 (12:31 -0500)]
18766: add --force-test and --force-build options to the
       run-build-test-packages-one-target.sh script.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18682-use-keyrings-instead-of-key-ids'
Javier Bértoli [Fri, 4 Mar 2022 23:15:52 +0000 (20:15 -0300)]
Merge branch '18682-use-keyrings-instead-of-key-ids'

closes #18682
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '18830-fix-centos-7-provisioning'
Javier Bértoli [Fri, 4 Mar 2022 22:55:40 +0000 (19:55 -0300)]
Merge branch '18830-fix-centos-7-provisioning'

closes #18830
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoFix python2-ism
Peter Amstutz [Fri, 4 Mar 2022 22:03:06 +0000 (17:03 -0500)]
Fix python2-ism

refs #18656

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18656-dynamic-gpu-req' refs #18656
Peter Amstutz [Fri, 4 Mar 2022 21:44:28 +0000 (16:44 -0500)]
Merge branch '18656-dynamic-gpu-req' refs #18656

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18830: address review comments
Javier Bértoli [Fri, 4 Mar 2022 20:37:17 +0000 (17:37 -0300)]
18830: address review comments

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '18574-pysdk-vocabulary-support'. Closes #18574
Lucas Di Pentima [Fri, 4 Mar 2022 20:33:40 +0000 (17:33 -0300)]
Merge branch '18574-pysdk-vocabulary-support'. Closes #18574

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18830: fix installer's postgresql pillar for single-host / single-hostname
Javier Bértoli [Thu, 3 Mar 2022 23:27:48 +0000 (20:27 -0300)]
18830: fix installer's postgresql pillar for single-host / single-hostname

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18830: fix nginx parameters for single-host/single-hostname provisioning
Javier Bértoli [Thu, 3 Mar 2022 18:52:24 +0000 (15:52 -0300)]
18830: fix nginx parameters for single-host/single-hostname provisioning

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18574: Adds remaining invalid key/value test cases.
Lucas Di Pentima [Thu, 3 Mar 2022 14:16:53 +0000 (11:16 -0300)]
18574: Adds remaining invalid key/value test cases.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18574: Adds key & value type checking. Improves code layout for readability.
Lucas Di Pentima [Thu, 3 Mar 2022 14:06:13 +0000 (11:06 -0300)]
18574: Adds key & value type checking. Improves code layout for readability.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18574: Fixes documentation formatting.
Lucas Di Pentima [Wed, 2 Mar 2022 21:44:34 +0000 (18:44 -0300)]
18574: Fixes documentation formatting.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18574: Adds some documentation's cookbook examples.
Lucas Di Pentima [Wed, 2 Mar 2022 19:08:18 +0000 (16:08 -0300)]
18574: Adds some documentation's cookbook examples.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18574: Fixes bug for keys without values.
Lucas Di Pentima [Wed, 2 Mar 2022 18:22:28 +0000 (15:22 -0300)]
18574: Fixes bug for keys without values.

It turns out that:

{}.get('something', {}) != {'something':None}.get('something', {})

...and when there's no values member on any given vocabulary key, the
controller fill it with null, so we have to handle the explicit case
of having {value: None} on the exported vocabulary.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoFix arvados-server dependency version in the arvados-workbench package.
Ward Vandewege [Wed, 2 Mar 2022 16:44:14 +0000 (11:44 -0500)]
Fix arvados-server dependency version in the arvados-workbench package.

refs #17417

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18785-single-host-single-name-with-letsencrypt-main'
Ward Vandewege [Wed, 2 Mar 2022 01:12:35 +0000 (20:12 -0500)]
Merge branch '18785-single-host-single-name-with-letsencrypt-main'

closes #18785

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: avoid error when /etc/cloud/cloud.cfg.d does not exist.
Ward Vandewege [Tue, 1 Mar 2022 21:57:07 +0000 (16:57 -0500)]
18785: avoid error when /etc/cloud/cloud.cfg.d does not exist.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: small doc tweak.
Ward Vandewege [Tue, 1 Mar 2022 21:05:55 +0000 (16:05 -0500)]
18785: small doc tweak.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: remove the documentation for the single host, multiple hostnames
Ward Vandewege [Tue, 1 Mar 2022 20:59:19 +0000 (15:59 -0500)]
18785: remove the documentation for the single host, multiple hostnames
       case. This configuration is not very useful, and it should be
       possible to achieve this setup by using the multiple hostname
       installer on a single node.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: update defaults and comments in local.params files.
Ward Vandewege [Tue, 1 Mar 2022 19:22:52 +0000 (14:22 -0500)]
18785: update defaults and comments in local.params files.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: add explicit test that IP_INT is set correctly in the single host
Ward Vandewege [Tue, 1 Mar 2022 17:50:55 +0000 (12:50 -0500)]
18785: add explicit test that IP_INT is set correctly in the single host
       case.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: documentation: mention the possible need for chained certificates
Ward Vandewege [Tue, 1 Mar 2022 17:44:25 +0000 (12:44 -0500)]
18785: documentation: mention the possible need for chained certificates
       in the bring-your-own certificates case.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: fix self-signed single host installation.
Ward Vandewege [Tue, 1 Mar 2022 16:46:25 +0000 (11:46 -0500)]
18785: fix self-signed single host installation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: make sure the user configures IP_INT in the single host case.
Ward Vandewege [Tue, 1 Mar 2022 16:45:42 +0000 (11:45 -0500)]
18785: make sure the user configures IP_INT in the single host case.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: make sure that dnsmasq is present, and make sure that our
Ward Vandewege [Tue, 1 Mar 2022 14:27:50 +0000 (09:27 -0500)]
18785: make sure that dnsmasq is present, and make sure that our
       customized /etc/hosts survives a reboot.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: update documentation, fix run-tests.sh bug in single host/single
Ward Vandewege [Tue, 1 Mar 2022 02:38:19 +0000 (21:38 -0500)]
18785: update documentation, fix run-tests.sh bug in single host/single
       hostname + LE mode, change default workbench port to 443 in
       single host.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: edit documentation, addressing review comments
Javier Bértoli [Mon, 28 Feb 2022 18:34:52 +0000 (15:34 -0300)]
18785: edit documentation, addressing review comments

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: edit documentation, addressing review comments
Javier Bértoli [Mon, 28 Feb 2022 17:41:43 +0000 (14:41 -0300)]
18785: edit documentation, addressing review comments

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: add missing lines addressing review suggestions
Javier Bértoli [Mon, 28 Feb 2022 17:10:46 +0000 (14:10 -0300)]
18785: add missing lines addressing review suggestions

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: add conditional logic for bring-your-own certificates
Javier Bértoli [Mon, 28 Feb 2022 17:04:17 +0000 (14:04 -0300)]
18785: add conditional logic for bring-your-own certificates

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: remove comment addressing review suggestions
Javier Bértoli [Mon, 28 Feb 2022 17:01:08 +0000 (14:01 -0300)]
18785: remove comment addressing review suggestions

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: add missing lines addressing review suggestions
Javier Bértoli [Mon, 28 Feb 2022 16:58:36 +0000 (13:58 -0300)]
18785: add missing lines addressing review suggestions

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: remove unneeded entry in snakeoil certs state
Javier Bértoli [Fri, 25 Feb 2022 22:32:44 +0000 (19:32 -0300)]
18785: remove unneeded entry in snakeoil certs state

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: fix letsencrypt/nginx deployment issues for single-host/single-hostname
Javier Bértoli [Fri, 25 Feb 2022 22:17:25 +0000 (19:17 -0300)]
18785: fix letsencrypt/nginx deployment issues for single-host/single-hostname

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18791: allow single-host-single-hostname to manage LE certs
Javier Bértoli [Fri, 25 Feb 2022 16:40:15 +0000 (13:40 -0300)]
18791: allow single-host-single-hostname to manage LE certs

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18791: make the test hasher workflow work by fixing dns resolution
Ward Vandewege [Fri, 25 Feb 2022 02:08:47 +0000 (21:08 -0500)]
18791: make the test hasher workflow work by fixing dns resolution
       inside docker. Cleanup for the local.params file.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18791: update documentation, fix single host/single hostname installer
Ward Vandewege [Mon, 21 Feb 2022 00:44:24 +0000 (19:44 -0500)]
18791: update documentation, fix single host/single hostname installer
       with self-signed certificates. Fix tests/run-test.sh so it works
       even with just crunch-dispatch-local.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18574: Fixes value list edge cases (with tests). Also avoids duplicated code.
Lucas Di Pentima [Tue, 1 Mar 2022 23:10:14 +0000 (20:10 -0300)]
18574: Fixes value list edge cases (with tests). Also avoids duplicated code.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18574: Adds support for value list conversion.
Lucas Di Pentima [Tue, 1 Mar 2022 22:40:05 +0000 (19:40 -0300)]
18574: Adds support for value list conversion.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoDependabot nokogiri bump for workbench.
Ward Vandewege [Tue, 1 Mar 2022 22:38:08 +0000 (17:38 -0500)]
Dependabot nokogiri bump for workbench.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18574: Adds tests for value list conversions.
Lucas Di Pentima [Tue, 1 Mar 2022 22:36:10 +0000 (19:36 -0300)]
18574: Adds tests for value list conversions.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoDependabot nokogiri bump for api server.
Ward Vandewege [Tue, 1 Mar 2022 22:36:07 +0000 (17:36 -0500)]
Dependabot nokogiri bump for api server.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '17754-federated-acct-merge'. Refs #17754.
Lucas Di Pentima [Tue, 1 Mar 2022 22:29:47 +0000 (19:29 -0300)]
Merge branch '17754-federated-acct-merge'. Refs #17754.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18803-empty-identity-url'
Tom Clegg [Tue, 1 Mar 2022 21:13:15 +0000 (16:13 -0500)]
Merge branch '18803-empty-identity-url'

fixes #18803

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18808-new-token-race'
Tom Clegg [Tue, 1 Mar 2022 15:15:26 +0000 (10:15 -0500)]
Merge branch '18808-new-token-race'

fixes #18808

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18656: Update cwltool version and tests for CUDA extension tweaks
Peter Amstutz [Mon, 28 Feb 2022 22:06:11 +0000 (17:06 -0500)]
18656: Update cwltool version and tests for CUDA extension tweaks

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18574: Fixes doc test failure.
Lucas Di Pentima [Mon, 28 Feb 2022 22:06:55 +0000 (19:06 -0300)]
18574: Fixes doc test failure.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18656: Add missing test files
Peter Amstutz [Mon, 28 Feb 2022 21:40:40 +0000 (16:40 -0500)]
18656: Add missing test files

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18574: Adds some more test cases on convert_to_* methods.
Lucas Di Pentima [Mon, 28 Feb 2022 21:03:02 +0000 (18:03 -0300)]
18574: Adds some more test cases on convert_to_* methods.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18574: Adds strict checking on conversion methods. Adds/updates tests.
Lucas Di Pentima [Mon, 28 Feb 2022 20:51:29 +0000 (17:51 -0300)]
18574: Adds strict checking on conversion methods. Adds/updates tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18574: Adds conversion methods. Improves & adds tests.
Lucas Di Pentima [Mon, 28 Feb 2022 20:20:49 +0000 (17:20 -0300)]
18574: Adds conversion methods. Improves & adds tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18574: Adds 'preferred_label' virtual attribute. Avoids storing the voc twice.
Lucas Di Pentima [Mon, 28 Feb 2022 18:50:37 +0000 (15:50 -0300)]
18574: Adds 'preferred_label' virtual attribute. Avoids storing the voc twice.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18574: Fixes key_aliases/value_aliases indexing. Adds dict-style indexing.
Lucas Di Pentima [Mon, 28 Feb 2022 18:39:49 +0000 (15:39 -0300)]
18574: Fixes key_aliases/value_aliases indexing. Adds dict-style indexing.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18574: Initial vocabulary loading support & tests.
Lucas Di Pentima [Mon, 28 Feb 2022 16:14:32 +0000 (13:14 -0300)]
18574: Initial vocabulary loading support & tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18574: Adds vocabulary endpoint section to the API documentation.
Lucas Di Pentima [Wed, 23 Feb 2022 18:40:12 +0000 (15:40 -0300)]
18574: Adds vocabulary endpoint section to the API documentation.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18574: Adds /arvados/v1/vocabulary to the discovery document.
Lucas Di Pentima [Tue, 22 Feb 2022 17:58:29 +0000 (14:58 -0300)]
18574: Adds /arvados/v1/vocabulary to the discovery document.

Also, adds vocabulary caching on PySDK's API client.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18805-easy-static-compilation'
Ward Vandewege [Mon, 28 Feb 2022 21:17:42 +0000 (16:17 -0500)]
Merge branch '18805-easy-static-compilation'

closes #18805

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18808: Handle concurrent uses of same previously unseen token.
Tom Clegg [Mon, 28 Feb 2022 17:25:18 +0000 (12:25 -0500)]
18808: Handle concurrent uses of same previously unseen token.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18808: Test concurrent uses of same previously unseen token.
Tom Clegg [Mon, 28 Feb 2022 16:45:46 +0000 (11:45 -0500)]
18808: Test concurrent uses of same previously unseen token.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18805: add a 'static' go build tag that disables the pam login code,
Ward Vandewege [Fri, 25 Feb 2022 21:50:32 +0000 (16:50 -0500)]
18805: add a 'static' go build tag that disables the pam login code,
       because it relies on the shared libraries from the glibc version
       used for linking, at runtime.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18805: replace unnecessary lookup of a constant.
Ward Vandewege [Fri, 25 Feb 2022 21:35:54 +0000 (16:35 -0500)]
18805: replace unnecessary lookup of a constant.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18801-aca-req-select-uuid'. Closes #18801
Lucas Di Pentima [Fri, 25 Feb 2022 19:29:12 +0000 (16:29 -0300)]
Merge branch '18801-aca-req-select-uuid'. Closes #18801

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18801: Fixes the regression by ignoring the case where api_token isn't there.
Lucas Di Pentima [Fri, 25 Feb 2022 18:54:57 +0000 (15:54 -0300)]
18801: Fixes the regression by ignoring the case where api_token isn't there.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18801: Exposes the regression with a test.
Lucas Di Pentima [Fri, 25 Feb 2022 18:54:41 +0000 (15:54 -0300)]
18801: Exposes the regression with a test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18803: Save empty identity_url to database as null.
Tom Clegg [Fri, 25 Feb 2022 17:05:46 +0000 (12:05 -0500)]
18803: Save empty identity_url to database as null.

Allows multiple records to have empty identity_url without hitting
unique constraint.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoThe base.sh script that is run by Packer should abort when it encounters
Ward Vandewege [Wed, 23 Feb 2022 19:06:13 +0000 (14:06 -0500)]
The base.sh script that is run by Packer should abort when it encounters
any errors.

refs #18772

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoBugfix: make the create-ebs-volume patch apply.
Ward Vandewege [Wed, 23 Feb 2022 18:52:29 +0000 (13:52 -0500)]
Bugfix: make the create-ebs-volume patch apply.

refs #18772

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18772-ebs-autoscale-2'
Ward Vandewege [Tue, 22 Feb 2022 18:53:39 +0000 (13:53 -0500)]
Merge branch '18772-ebs-autoscale-2'

closes #18772

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: a few more improvements for the autoscaler script, from the
Ward Vandewege [Tue, 22 Feb 2022 18:52:36 +0000 (13:52 -0500)]
18772: a few more improvements for the autoscaler script, from the
       review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: address review feedback.
Ward Vandewege [Tue, 22 Feb 2022 01:37:47 +0000 (20:37 -0500)]
18772: address review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: document the AWS EBS autoscaler support. Refactor the "Build a
Ward Vandewege [Mon, 21 Feb 2022 14:32:08 +0000 (09:32 -0500)]
18772: document the AWS EBS autoscaler support. Refactor the "Build a
       cloud compute node image" documentation page to improve the flow.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: consistently use bash comparison operators in build.sh
Ward Vandewege [Mon, 21 Feb 2022 14:08:30 +0000 (09:08 -0500)]
18772: consistently use bash comparison operators in build.sh

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: add support for the AWS EBS autoscale script to the compute node
Ward Vandewege [Sat, 19 Feb 2022 00:27:11 +0000 (19:27 -0500)]
18772: add support for the AWS EBS autoscale script to the compute node
       image builder.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: arvados-dispatch-cloud: add IamInstanceProfile field to the ec2
Ward Vandewege [Thu, 17 Feb 2022 21:31:23 +0000 (16:31 -0500)]
18772: arvados-dispatch-cloud: add IamInstanceProfile field to the ec2
       driver.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18773-check-image-id' refs #18773
Peter Amstutz [Fri, 18 Feb 2022 22:52:54 +0000 (17:52 -0500)]
Merge branch '18773-check-image-id' refs #18773

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: Fix tests.test_submit.TestSubmit.test_arvados_jobs_image
Peter Amstutz [Fri, 18 Feb 2022 21:00:15 +0000 (16:00 -0500)]
18773: Fix tests.test_submit.TestSubmit.test_arvados_jobs_image

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: Add --match-submitter-images to docs
Peter Amstutz [Fri, 18 Feb 2022 19:24:14 +0000 (14:24 -0500)]
18773: Add --match-submitter-images to docs

Also update cwltool dependency for a bugfix.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: Add test for match_local_docker behavior
Peter Amstutz [Fri, 18 Feb 2022 16:57:00 +0000 (11:57 -0500)]
18773: Add test for match_local_docker behavior

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: Test WIP
Peter Amstutz [Thu, 17 Feb 2022 20:31:17 +0000 (15:31 -0500)]
18773: Test WIP

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18773: --match-submitter-images to compare the local docker image with Arvados
Peter Amstutz [Thu, 17 Feb 2022 19:37:51 +0000 (14:37 -0500)]
18773: --match-submitter-images to compare the local docker image with Arvados

Consults local list of Docker images to find the image id and chooses
that exact one, uploading it if necessary.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoFix arvbox-demo refs #18789
Peter Amstutz [Fri, 18 Feb 2022 14:50:16 +0000 (09:50 -0500)]
Fix arvbox-demo refs #18789

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18676-anon-token-support-v2-in-config'
Ward Vandewege [Fri, 18 Feb 2022 14:43:24 +0000 (09:43 -0500)]
Merge branch '18676-anon-token-support-v2-in-config'

closes #18676

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18676: Merge branch 'main' into 18676-anon-token-support-v2-in-config
Ward Vandewege [Fri, 18 Feb 2022 14:42:15 +0000 (09:42 -0500)]
18676: Merge branch 'main' into 18676-anon-token-support-v2-in-config

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18676: make v2 token check more strict, and add the ["GET /"] scope to
Ward Vandewege [Fri, 18 Feb 2022 13:34:02 +0000 (08:34 -0500)]
18676: make v2 token check more strict, and add the ["GET /"] scope to
       the new anonymous token code path.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoReadjust arvbox GEM_HOME to ~/.gem to avoid stepping on base image gems
Peter Amstutz [Fri, 18 Feb 2022 01:36:11 +0000 (20:36 -0500)]
Readjust arvbox GEM_HOME to ~/.gem to avoid stepping on base image gems

Instead of replacing the entire /var/lib/arvados/lib/ruby/gems
directory, mount it in the place of the default user directory that
'gem' already looks for.

refs #18789

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17754: Hides account linking buttons when LoginCluster is configured.
Lucas Di Pentima [Thu, 17 Feb 2022 22:19:26 +0000 (19:19 -0300)]
17754: Hides account linking buttons when LoginCluster is configured.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoUpdate cwltool dependency for restored Python 3.6 compatability
Peter Amstutz [Thu, 17 Feb 2022 20:49:45 +0000 (15:49 -0500)]
Update cwltool dependency for restored Python 3.6 compatability

refs #18766

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17754: Updates documentation.
Lucas Di Pentima [Thu, 17 Feb 2022 20:34:30 +0000 (17:34 -0300)]
17754: Updates documentation.

Self-serve account linking is not supported on LoginCluster federations.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoFix typo.
Ward Vandewege [Thu, 17 Feb 2022 19:35:31 +0000 (14:35 -0500)]
Fix typo.

refs #18702

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18702-document-upgrades'
Ward Vandewege [Thu, 17 Feb 2022 19:06:39 +0000 (14:06 -0500)]
Merge branch '18702-document-upgrades'

closes #18702

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: Merge branch 'main' into 18702-document-upgrades
Ward Vandewege [Thu, 17 Feb 2022 19:05:36 +0000 (14:05 -0500)]
18702: Merge branch 'main' into 18702-document-upgrades

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18676: be a bit more specific in testing for V2 tokens.
Ward Vandewege [Thu, 17 Feb 2022 18:03:33 +0000 (13:03 -0500)]
18676: be a bit more specific in testing for V2 tokens.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18600-copy-by-ref'
Tom Clegg [Thu, 17 Feb 2022 17:52:27 +0000 (12:52 -0500)]
Merge branch '18600-copy-by-ref'

refs #18600

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18600: Update comment.
Tom Clegg [Thu, 17 Feb 2022 16:13:49 +0000 (11:13 -0500)]
18600: Update comment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>