arvados.git
3 years agoMerge branch '17774-fix-cancel-cr'
Tom Clegg [Thu, 10 Jun 2021 19:09:46 +0000 (15:09 -0400)]
Merge branch '17774-fix-cancel-cr'

fixes #17774

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17774: Add non-empty mounts to test fixtures.
Tom Clegg [Thu, 10 Jun 2021 18:46:38 +0000 (14:46 -0400)]
17774: Add non-empty mounts to test fixtures.

Confirmed wb1 integration tests fail if the recent fix (parent of this
commit) is backed out.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17799-rails-upgrade-5.2.6'
Lucas Di Pentima [Thu, 10 Jun 2021 15:06:53 +0000 (12:06 -0300)]
Merge branch '17799-rails-upgrade-5.2.6'
Closes #17799

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17774: Test runtime_constraints and scheduling_parameters, too.
Tom Clegg [Thu, 10 Jun 2021 15:05:03 +0000 (11:05 -0400)]
17774: Test runtime_constraints and scheduling_parameters, too.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17774: Ignore addition of zero/default values to mounts when frozen.
Tom Clegg [Thu, 10 Jun 2021 14:42:30 +0000 (10:42 -0400)]
17774: Ignore addition of zero/default values to mounts when frozen.

Avoids errors when a client reads the CR and includes the resulting
mounts field (to which controller will have added zero/default values)
in a subsequent update request.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17799: Upgrades API & Workbench rails to 5.2.6
Lucas Di Pentima [Wed, 9 Jun 2021 23:26:20 +0000 (20:26 -0300)]
17799: Upgrades API & Workbench rails to 5.2.6

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoMerge branch '17717-costanalyzer-date-mode'
Ward Vandewege [Tue, 8 Jun 2021 14:52:47 +0000 (10:52 -0400)]
Merge branch '17717-costanalyzer-date-mode'

closes #17717

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17717: Merge branch 'master' into 17717-costanalyzer-date-mode
Ward Vandewege [Tue, 8 Jun 2021 14:49:38 +0000 (10:49 -0400)]
17717: Merge branch 'master' into 17717-costanalyzer-date-mode

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17717: more changes post review: remove unneeded debug print, switch
Ward Vandewege [Tue, 8 Jun 2021 14:47:31 +0000 (10:47 -0400)]
17717: more changes post review: remove unneeded debug print, switch
       Command to value receiver.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoRemove leftover dead link from the ToC in the 'Set up a shell node'
Ward Vandewege [Tue, 8 Jun 2021 12:55:53 +0000 (08:55 -0400)]
Remove leftover dead link from the ToC in the 'Set up a shell node'
page.

refs #16803

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17706-costanalyzer-uncommitted-container-requests'
Ward Vandewege [Tue, 8 Jun 2021 12:27:54 +0000 (08:27 -0400)]
Merge branch '17706-costanalyzer-uncommitted-container-requests'

closes #17706

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17706: Merge branch 'master' into 17706-costanalyzer-uncommitted-container-requests
Ward Vandewege [Tue, 8 Jun 2021 12:27:25 +0000 (08:27 -0400)]
17706: Merge branch 'master' into 17706-costanalyzer-uncommitted-container-requests

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17717: address further review comments: remove unused code and refactor
Ward Vandewege [Mon, 7 Jun 2021 22:00:46 +0000 (18:00 -0400)]
17717: address further review comments: remove unused code and refactor
       a bit.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17717: address review comments.
Ward Vandewege [Mon, 7 Jun 2021 18:01:10 +0000 (14:01 -0400)]
17717: address review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17465-pysdk-storage-classes-support'
Lucas Di Pentima [Mon, 7 Jun 2021 17:17:37 +0000 (14:17 -0300)]
Merge branch '17465-pysdk-storage-classes-support'
Closes #17465

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17465: Fixed tests and made the suite less noisy.
Lucas Di Pentima [Mon, 7 Jun 2021 14:02:22 +0000 (11:02 -0300)]
17465: Fixed tests and made the suite less noisy.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoTweak upgrading doc page to reflect the release of 2.2.0.
Ward Vandewege [Sat, 5 Jun 2021 12:12:06 +0000 (08:12 -0400)]
Tweak upgrading doc page to reflect the release of 2.2.0.

refs #17512

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17757-bootprobe-race'
Ward Vandewege [Fri, 4 Jun 2021 21:31:01 +0000 (17:31 -0400)]
Merge branch '17757-bootprobe-race'

closes #17757

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17757: Merge branch 'master' into 17757-bootprobe-race
Ward Vandewege [Fri, 4 Jun 2021 21:30:32 +0000 (17:30 -0400)]
17757: Merge branch 'master' into 17757-bootprobe-race

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17762: Add uuid-dev package
Peter Amstutz [Fri, 4 Jun 2021 19:29:05 +0000 (15:29 -0400)]
17762: Add uuid-dev package

refs #17762

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17757: On our compute node images, Docker should not start by default;
Ward Vandewege [Fri, 4 Jun 2021 15:22:47 +0000 (11:22 -0400)]
17757: On our compute node images, Docker should not start by default;
       ensure-encrypted-partitions.sh takes care of starting it.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17465: Don't repeat warnings when storage classes aren't supported.
Lucas Di Pentima [Thu, 3 Jun 2021 22:34:26 +0000 (19:34 -0300)]
17465: Don't repeat warnings when storage classes aren't supported.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoFix building of metapackages for Ubuntu 18.04 and Ubuntu 20.04.
Ward Vandewege [Thu, 3 Jun 2021 20:18:36 +0000 (16:18 -0400)]
Fix building of metapackages for Ubuntu 18.04 and Ubuntu 20.04.

refs #17498

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoTweak version-at-commit.sh for interim releases (X.Y.Z.A)
Peter Amstutz [Thu, 3 Jun 2021 16:03:02 +0000 (12:03 -0400)]
Tweak version-at-commit.sh for interim releases (X.Y.Z.A)

Assign correct intended dev version when there is a X.Y.Z.A tag (not
just X.Y.Z) in the history.

As of this writing we don't have tags like that in the arvados repo,
but we do have tags like that in the workbench2 repo, so this commit
is just about synchronizing the script for consistency between the two
repos.

refs #17512

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoRemove duplicate rm.
Tom Clegg [Thu, 3 Jun 2021 13:41:50 +0000 (09:41 -0400)]
Remove duplicate rm.

Fixes #17752

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMake our arvados-api and arvados-workbench Gemfiles use the arvados
Ward Vandewege [Wed, 2 Jun 2021 21:28:41 +0000 (17:28 -0400)]
Make our arvados-api and arvados-workbench Gemfiles use the arvados
2.1.5 gem.

refs #17738

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17465: Collection.save() adds storage_classes_desired when set on instance.
Lucas Di Pentima [Wed, 2 Jun 2021 20:24:29 +0000 (17:24 -0300)]
17465: Collection.save() adds storage_classes_desired when set on instance.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17465: Synchronizes storage classes data between Collection & BlockManager.
Lucas Di Pentima [Wed, 2 Jun 2021 19:54:39 +0000 (16:54 -0300)]
17465: Synchronizes storage classes data between Collection & BlockManager.

Storage classes can be set at Collection instantiation time, and BlockManager
used to get that data when being instantiated by Collection, but desired
storage classes can change in the middle of a Collection instance lifetime,
and new blocks should get written on the correct classes, so the solution is
to pass a function for BlockManager to be able to query its parent Collection
instance settings at any time.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoNeed to export ARVADOS_BUILDING_ so arvados_version.py sees them.
Peter Amstutz [Wed, 2 Jun 2021 18:50:16 +0000 (14:50 -0400)]
Need to export ARVADOS_BUILDING_ so arvados_version.py sees them.

refs #17512

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '17296-singularity'
Tom Clegg [Wed, 2 Jun 2021 17:49:03 +0000 (13:49 -0400)]
Merge branch '17296-singularity'

closes #17296

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17296: Merge branch 'master'
Tom Clegg [Wed, 2 Jun 2021 15:21:18 +0000 (11:21 -0400)]
17296: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17738-pin-gemfiles-to-2.1.4'
Ward Vandewege [Tue, 1 Jun 2021 21:03:05 +0000 (17:03 -0400)]
Merge branch '17738-pin-gemfiles-to-2.1.4'

closes #17738

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17738: Make our arvados-api and arvados-workbench Gemfiles use the arvados
Ward Vandewege [Tue, 1 Jun 2021 19:00:15 +0000 (15:00 -0400)]
17738: Make our arvados-api and arvados-workbench Gemfiles use the arvados
2.1.4 gem.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17738-remove-constant-modification'
Ward Vandewege [Tue, 1 Jun 2021 15:26:57 +0000 (11:26 -0400)]
Merge branch '17738-remove-constant-modification'

refs #17738

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17738: remove the monkey patch of the OS_VERSION constant from the
Ward Vandewege [Tue, 1 Jun 2021 14:55:09 +0000 (10:55 -0400)]
17738: remove the monkey patch of the OS_VERSION constant from the
       google-api-client gem; we run from a forked version of the
       gem which already has the necessary fix.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17465: Adds tests confirming KeepClient storage support on Collection.
Lucas Di Pentima [Tue, 1 Jun 2021 01:02:11 +0000 (22:02 -0300)]
17465: Adds tests confirming KeepClient storage support on Collection.

Also, made storage_classes_desired field be loaded into a Collection from the
API server.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17465: Adds KeepClient storage classes support to Collection class.
Lucas Di Pentima [Mon, 31 May 2021 23:36:00 +0000 (20:36 -0300)]
17465: Adds KeepClient storage classes support to Collection class.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17465: Adds tests for class storage support.
Lucas Di Pentima [Mon, 31 May 2021 20:05:57 +0000 (17:05 -0300)]
17465: Adds tests for class storage support.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoMerge branch '17743-use-git-arvados-org-for-provision'
Javier Bértoli [Fri, 28 May 2021 22:46:04 +0000 (19:46 -0300)]
Merge branch '17743-use-git-arvados-org-for-provision'

closes #17743
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agofeat(provision): moved the arvados-formula to Arvados.org
Javier Bértoli [Thu, 20 May 2021 19:11:52 +0000 (16:11 -0300)]
feat(provision): moved the arvados-formula to Arvados.org

refs #17655
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoMerge branch '17603-nginx-webshell-vhost-fix'
Javier Bértoli [Fri, 28 May 2021 21:21:50 +0000 (18:21 -0300)]
Merge branch '17603-nginx-webshell-vhost-fix'

closes #17603
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoMerge branch '17722-adjust-token-expiry' refs #17722
Peter Amstutz [Fri, 28 May 2021 20:43:13 +0000 (16:43 -0400)]
Merge branch '17722-adjust-token-expiry' refs #17722

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17722: Tweak tests to be clearer about new behavior
Peter Amstutz [Fri, 28 May 2021 20:40:49 +0000 (16:40 -0400)]
17722: Tweak tests to be clearer about new behavior

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '17605-letsencrypt-credentials-for-route53'
Javier Bértoli [Fri, 28 May 2021 20:19:22 +0000 (17:19 -0300)]
Merge branch '17605-letsencrypt-credentials-for-route53'

closes #17605
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17722: Update tests for adjusted MaxTokenLifetime behavior
Peter Amstutz [Fri, 28 May 2021 19:26:03 +0000 (15:26 -0400)]
17722: Update tests for adjusted MaxTokenLifetime behavior

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17722: Adjust token expiry behavior
Peter Amstutz [Tue, 25 May 2021 20:45:19 +0000 (16:45 -0400)]
17722: Adjust token expiry behavior

* Admins tokens have API.MaxTokenLifetime by default, but admins can create
  token which are not restricted by API.MaxTokenLifetime.

* Login.TokenLifetime does no longer implies untrusted tokens

* Added Login.TrustLoginToken to determine whether tokens issued by login are
  considered "trusted"

* Updated documentation page

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '17703-provision-version' refs #17703
Peter Amstutz [Fri, 28 May 2021 18:21:05 +0000 (14:21 -0400)]
Merge branch '17703-provision-version' refs #17703

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17703: Be more explicit about package version.
Peter Amstutz [Fri, 28 May 2021 18:20:25 +0000 (14:20 -0400)]
17703: Be more explicit about package version.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoWhen building compute node images, print the version of packer used.
Ward Vandewege [Fri, 28 May 2021 18:11:22 +0000 (14:11 -0400)]
When building compute node images, print the version of packer used.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17465: Adds storage classes tracking and old cluster support.
Lucas Di Pentima [Thu, 27 May 2021 21:38:30 +0000 (18:38 -0300)]
17465: Adds storage classes tracking and old cluster support.

* Tracks which classes were confirmed and ask for the remaining on following
  retries.
* When receiving a keepstore response without the proper header, it fallbacks
  to only saving the requested number of copies.
* Updates tests to reflect code changes.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoRemove old Go installation when upgrading.
Tom Clegg [Thu, 27 May 2021 05:23:18 +0000 (01:23 -0400)]
Remove old Go installation when upgrading.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17738-frozen-string-error'
Lucas Di Pentima [Thu, 27 May 2021 15:51:42 +0000 (12:51 -0300)]
Merge branch '17738-frozen-string-error'
Closes #17738

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17738: Fixes the issue by strip!()ing a mutable version of OS_VERSION.
Lucas Di Pentima [Thu, 27 May 2021 14:28:50 +0000 (11:28 -0300)]
17738: Fixes the issue by strip!()ing a mutable version of OS_VERSION.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17703: Salt install docs point to versioned branches to get the scripts.
Peter Amstutz [Wed, 26 May 2021 21:19:59 +0000 (17:19 -0400)]
17703: Salt install docs point to versioned branches to get the scripts.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17703: master branch provision.sh is development install
Peter Amstutz [Wed, 26 May 2021 20:35:08 +0000 (16:35 -0400)]
17703: master branch provision.sh is development install

Installs latest development packages from master branch of
arvados-formula.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '17682-fix-stutter'
Tom Clegg [Wed, 26 May 2021 20:01:56 +0000 (16:01 -0400)]
Merge branch '17682-fix-stutter'

fixes #17682

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17605: Update LE collections requirement in nginx
Javier Bértoli [Wed, 26 May 2021 15:19:06 +0000 (12:19 -0300)]
17605: Update LE collections requirement in nginx

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17605: Wildcard needs to be quoted in yaml
Javier Bértoli [Wed, 26 May 2021 15:04:03 +0000 (12:04 -0300)]
17605: Wildcard needs to be quoted in yaml

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17605: Inverse logic
Javier Bértoli [Wed, 26 May 2021 14:48:38 +0000 (11:48 -0300)]
17605: Inverse logic

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17603: Webshell is just a nginx vhost
Javier Bértoli [Wed, 26 May 2021 14:32:26 +0000 (11:32 -0300)]
17603: Webshell is just a nginx vhost

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17605: allow to use a IAM user for letsencrypt
Javier Bértoli [Thu, 20 May 2021 21:52:36 +0000 (18:52 -0300)]
17605: allow to use a IAM user for letsencrypt

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17296: Fix panic in teardown of skipped test.
Tom Clegg [Tue, 25 May 2021 23:31:55 +0000 (19:31 -0400)]
17296: Fix panic in teardown of skipped test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17717: add a timestamp range mode to the costanalyzer. Be more tolerant
Ward Vandewege [Tue, 25 May 2021 21:55:05 +0000 (17:55 -0400)]
17717: add a timestamp range mode to the costanalyzer. Be more tolerant
       of container requests that can't be considered in the cost
       calculation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17296: Avoid memory-limiting feature in tests.
Tom Clegg [Tue, 25 May 2021 21:11:38 +0000 (17:11 -0400)]
17296: Avoid memory-limiting feature in tests.

Tests should pass if the kernel feature is not enabled.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17296: Merge branch 'master'
Tom Clegg [Tue, 25 May 2021 21:05:20 +0000 (17:05 -0400)]
17296: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17296: Skip integration tests if docker is not installed.
Tom Clegg [Tue, 25 May 2021 19:28:49 +0000 (15:28 -0400)]
17296: Skip integration tests if docker is not installed.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17296: Log when/why gateway server is disabled.
Tom Clegg [Tue, 25 May 2021 19:28:44 +0000 (15:28 -0400)]
17296: Log when/why gateway server is disabled.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17296: Document changed handling of unusual image collections.
Tom Clegg [Tue, 25 May 2021 19:27:53 +0000 (15:27 -0400)]
17296: Document changed handling of unusual image collections.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17603: Separate shell's IP from webshell's
Javier Bértoli [Tue, 25 May 2021 17:21:39 +0000 (14:21 -0300)]
17603: Separate shell's IP from webshell's

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17603: Reorder example IPs so they match the documentation
Javier Bértoli [Thu, 20 May 2021 19:37:01 +0000 (16:37 -0300)]
17603: Reorder example IPs so they match the documentation

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoMerge branch '17704-check-token-scope'
Tom Clegg [Mon, 24 May 2021 18:30:21 +0000 (14:30 -0400)]
Merge branch '17704-check-token-scope'

fixes #17704

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17719-keep-web-pdh-cache'
Tom Clegg [Mon, 24 May 2021 18:25:29 +0000 (14:25 -0400)]
Merge branch '17719-keep-web-pdh-cache'

fixes #17719

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17719: Fix incorrect cache update.
Tom Clegg [Mon, 24 May 2021 17:48:29 +0000 (13:48 -0400)]
17719: Fix incorrect cache update.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17702-wb1-bypass-fed' refs #17702
Peter Amstutz [Mon, 24 May 2021 16:58:16 +0000 (12:58 -0400)]
Merge branch '17702-wb1-bypass-fed' refs #17702

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17702: Move check for ClusterID into splitListRequest
Peter Amstutz [Mon, 24 May 2021 15:14:37 +0000 (11:14 -0400)]
17702: Move check for ClusterID into splitListRequest

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17702: Federated lists supports cluster_id parameter
Peter Amstutz [Mon, 24 May 2021 14:33:00 +0000 (10:33 -0400)]
17702: Federated lists supports cluster_id parameter

Use cluster_id parameter to override splitListRequest behavior in controller.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17704: Split access token scope config into 2 keys.
Tom Clegg [Fri, 21 May 2021 18:47:09 +0000 (14:47 -0400)]
17704: Split access token scope config into 2 keys.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17711-nokogiri-upgrade'
Lucas Di Pentima [Fri, 21 May 2021 15:48:18 +0000 (12:48 -0300)]
Merge branch '17711-nokogiri-upgrade'
Closes #17711

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17711: Upgrades nokogiri on railsAPI & workbench1
Lucas Di Pentima [Fri, 21 May 2021 14:18:07 +0000 (11:18 -0300)]
17711: Upgrades nokogiri on railsAPI & workbench1

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoMerge branch '17708-crunch-run-unsupported-file-types'
Ward Vandewege [Fri, 21 May 2021 14:14:56 +0000 (10:14 -0400)]
Merge branch '17708-crunch-run-unsupported-file-types'

closes #17708

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17704: Enable OIDC access tokens for tests.
Tom Clegg [Fri, 21 May 2021 06:38:53 +0000 (02:38 -0400)]
17704: Enable OIDC access tokens for tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17704: Check scope before accepting OIDC access tokens.
Tom Clegg [Thu, 20 May 2021 21:12:36 +0000 (17:12 -0400)]
17704: Check scope before accepting OIDC access tokens.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17708: Test skipping non-regular file in output dir.
Tom Clegg [Fri, 21 May 2021 04:15:28 +0000 (00:15 -0400)]
17708: Test skipping non-regular file in output dir.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17708: when crunch-run encounters an unsupported file type while copying
Ward Vandewege [Fri, 21 May 2021 01:30:31 +0000 (21:30 -0400)]
17708: when crunch-run encounters an unsupported file type while copying
       the output of a job, do not error out, just print a warning and
       skip the offending file.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17465: Adds storage classes support to PySDK put().
Lucas Di Pentima [Fri, 21 May 2021 00:06:43 +0000 (21:06 -0300)]
17465: Adds storage classes support to PySDK put().

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago17706: when a container request has no container associated (e.g. when
Ward Vandewege [Thu, 20 May 2021 20:05:29 +0000 (16:05 -0400)]
17706: when a container request has no container associated (e.g. when
       it is in the Uncommitted state), skip it instead of erroring out.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFix case statement for selection of wb1 login UI, refs #17499
Peter Amstutz [Thu, 20 May 2021 20:02:37 +0000 (16:02 -0400)]
Fix case statement for selection of wb1 login UI, refs #17499

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17603: Enable webshell role pillars in provision script
Javier Bértoli [Tue, 18 May 2021 16:04:56 +0000 (13:04 -0300)]
17603: Enable webshell role pillars in provision script

refs #17603
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17682: Fix stutter in "arvados-client shell" output.
Tom Clegg [Thu, 20 May 2021 14:30:08 +0000 (10:30 -0400)]
17682: Fix stutter in "arvados-client shell" output.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17680-oidctoken-doc'
Tom Clegg [Thu, 20 May 2021 14:01:45 +0000 (10:01 -0400)]
Merge branch '17680-oidctoken-doc'

closes #17680

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17680: Add OIDC access token section to "tokens" page.
Tom Clegg [Wed, 19 May 2021 20:22:54 +0000 (16:22 -0400)]
17680: Add OIDC access token section to "tokens" page.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17680: Document accepting OIDC access tokens.
Tom Clegg [Wed, 19 May 2021 18:36:37 +0000 (14:36 -0400)]
17680: Document accepting OIDC access tokens.

Also update examples to use Bearer instead of OAuth2 in Authorization
header.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17296: Fix docker tests running twice.
Tom Clegg [Wed, 19 May 2021 18:11:27 +0000 (14:11 -0400)]
17296: Fix docker tests running twice.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17296: Use https cache.
Tom Clegg [Wed, 19 May 2021 18:06:11 +0000 (14:06 -0400)]
17296: Use https cache.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17296: Enable memory limit for test.
Tom Clegg [Wed, 19 May 2021 18:05:47 +0000 (14:05 -0400)]
17296: Enable memory limit for test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoChange the default for Collections.WebDAVCache.MaxBlockEntries from 4 to
Ward Vandewege [Wed, 19 May 2021 16:15:17 +0000 (12:15 -0400)]
Change the default for Collections.WebDAVCache.MaxBlockEntries from 4 to
20.

refs #17689

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agofeat(provision): add AWS credentials for letsencrypt
Javier Bértoli [Tue, 18 May 2021 22:41:17 +0000 (19:41 -0300)]
feat(provision): add AWS credentials for letsencrypt

Wildcard certiticates need to be obtained through a DNS-01 challenge

refs #17605
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoUpdate "supported distributions" table no issue #
Peter Amstutz [Wed, 19 May 2021 14:06:12 +0000 (10:06 -0400)]
Update "supported distributions" table no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '17677-authenticate-endpoint' refs #17677
Peter Amstutz [Tue, 18 May 2021 21:16:32 +0000 (17:16 -0400)]
Merge branch '17677-authenticate-endpoint' refs #17677

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17296: Don't use /var/lib/arvados/tmp as a cache dir for tests.
Tom Clegg [Tue, 18 May 2021 21:10:09 +0000 (17:10 -0400)]
17296: Don't use /var/lib/arvados/tmp as a cache dir for tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>