arvados.git
3 years agoMerge branch 'master' into 17014-controller-container-requests-take2 17014-controller-container-requests-take2
Nico Cesar [Thu, 7 Jan 2021 15:34:57 +0000 (10:34 -0500)]
Merge branch 'master' into 17014-controller-container-requests-take2

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years agoDocumentation: fix typos.
Ward Vandewege [Wed, 6 Jan 2021 19:46:06 +0000 (14:46 -0500)]
Documentation: fix typos.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17175-boot-fail-rake-seed'
Tom Clegg [Wed, 6 Jan 2021 14:45:14 +0000 (09:45 -0500)]
Merge branch '17175-boot-fail-rake-seed'

fixes #17175

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17014: Refactor handling of default runtime/scheduling values.
Tom Clegg [Wed, 6 Jan 2021 02:00:53 +0000 (21:00 -0500)]
17014: Refactor handling of default runtime/scheduling values.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoFix typos in the documentation.
Ward Vandewege [Tue, 5 Jan 2021 17:51:26 +0000 (12:51 -0500)]
Fix typos in the documentation.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17225-ruby-sdk' refs #17225
Peter Amstutz [Tue, 5 Jan 2021 16:43:03 +0000 (11:43 -0500)]
Merge branch '17225-ruby-sdk' refs #17225

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agousing getCRfromMockRequest()
Nico Cesar [Tue, 5 Jan 2021 15:49:16 +0000 (10:49 -0500)]
using getCRfromMockRequest()

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years agoThe problem we had in #17014#Note-25 is not there anymore
Nico Cesar [Tue, 5 Jan 2021 15:31:51 +0000 (10:31 -0500)]
The problem we had in #17014#Note-25 is not there anymore

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years agoWe now publish packages for Ubuntu Focal (20.04), and have stopped
Ward Vandewege [Mon, 4 Jan 2021 20:12:25 +0000 (15:12 -0500)]
We now publish packages for Ubuntu Focal (20.04), and have stopped
publishing them for Ubuntu Xenial (16.04).

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoPreemptible related tests fixed to accomodate new defaults
Nico Cesar [Mon, 4 Jan 2021 19:47:35 +0000 (14:47 -0500)]
Preemptible related tests fixed to accomodate new defaults

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years ago17014: Fixes functional tests.
Nico Cesar [Mon, 4 Jan 2021 18:07:40 +0000 (13:07 -0500)]
17014: Fixes functional tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoMaking sure we have no pointers to Preemptible
Nico Cesar [Mon, 4 Jan 2021 17:28:38 +0000 (12:28 -0500)]
Making sure we have no pointers to Preemptible

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years agoRevert "17014: Fixes functional tests."
Nico Cesar [Mon, 4 Jan 2021 17:19:45 +0000 (12:19 -0500)]
Revert "17014: Fixes functional tests."

This reverts commit 22895df84dadaa0c2101443f765a3436b0282643.

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years ago17224: Fix to have multiple clients connected to separate clusters
Peter Amstutz [Sat, 2 Jan 2021 16:59:57 +0000 (11:59 -0500)]
17224: Fix to have multiple clients connected to separate clusters

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agopreemptible is either explicit true or false, or nil (cluster config)
Nico Cesar [Thu, 31 Dec 2020 00:25:31 +0000 (19:25 -0500)]
preemptible is either explicit true or false, or nil (cluster config)

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years agopreemptible is either explicit true or false, or nil (cluster config)
Nico Cesar [Wed, 30 Dec 2020 22:45:05 +0000 (17:45 -0500)]
preemptible is either explicit true or false, or nil (cluster config)

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years ago17014: Fixes functional tests.
Lucas Di Pentima [Wed, 30 Dec 2020 21:02:20 +0000 (18:02 -0300)]
17014: Fixes functional tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago17014: Fixes one last unit test.
Lucas Di Pentima [Wed, 30 Dec 2020 19:20:27 +0000 (16:20 -0300)]
17014: Fixes one last unit test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago17014: Fixes almost all railsapi's unit tests.
Lucas Di Pentima [Wed, 30 Dec 2020 18:43:38 +0000 (15:43 -0300)]
17014: Fixes almost all railsapi's unit tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agotypo
Nico Cesar [Wed, 30 Dec 2020 15:58:24 +0000 (10:58 -0500)]
typo

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years agoAdded set_defaults to arvados_model to handle zero value in attrs
Nico Cesar [Wed, 30 Dec 2020 15:45:00 +0000 (10:45 -0500)]
Added set_defaults to arvados_model to handle zero value in attrs

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years agoAdded set_defaults to arvados_model to handle zero value in attrs
Nico Cesar [Wed, 30 Dec 2020 14:55:11 +0000 (09:55 -0500)]
Added set_defaults to arvados_model to handle zero value in attrs

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years agoMerge branch '17151-system-token-validation'
Tom Clegg [Mon, 28 Dec 2020 21:52:16 +0000 (16:52 -0500)]
Merge branch '17151-system-token-validation'

closes #17151

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17175: Wait for seedDatabase before starting railsapi.
Tom Clegg [Mon, 28 Dec 2020 20:33:33 +0000 (15:33 -0500)]
17175: Wait for seedDatabase before starting railsapi.

If the rake task and the app start concurrently, they both try to set
up the database seeds. The exclusive-locking mechanism in
services/api/app/lib/current_api_client.rb doesn't cover this case
because the rake task and app don't use the same cache. If the app
commits the database seeds between the rake task's "check existing"
and "commit" steps, commit fails and the rake task aborts.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17175: Fix logging label for setuidgid-wrapped procs.
Tom Clegg [Mon, 28 Dec 2020 20:21:04 +0000 (15:21 -0500)]
17175: Fix logging label for setuidgid-wrapped procs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17218-update-apt-repos'
Javier Bértoli [Wed, 23 Dec 2020 21:15:34 +0000 (18:15 -0300)]
Merge branch '17218-update-apt-repos'

closes #17218

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoUpdate the provision script to use the new arvados-formula
Javier Bértoli [Wed, 23 Dec 2020 20:57:03 +0000 (17:57 -0300)]
Update the provision script to use the new arvados-formula

ref #17218

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoFix arvados-src package version generation.
Ward Vandewege [Wed, 23 Dec 2020 16:58:03 +0000 (11:58 -0500)]
Fix arvados-src package version generation.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17118-arvput-fix'
Lucas Di Pentima [Wed, 23 Dec 2020 15:27:35 +0000 (12:27 -0300)]
Merge branch '17118-arvput-fix'
Closes #17118

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoFix detection of packages that were already built.
Ward Vandewege [Wed, 23 Dec 2020 02:16:41 +0000 (21:16 -0500)]
Fix detection of packages that were already built.

refs #17218

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17218-repository-update'
Ward Vandewege [Tue, 22 Dec 2020 22:10:27 +0000 (17:10 -0500)]
Merge branch '17218-repository-update'

closes #17218

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoWe've made a change in the structure of our apt repositories.
Ward Vandewege [Tue, 22 Dec 2020 19:52:26 +0000 (14:52 -0500)]
We've made a change in the structure of our apt repositories.

refs #17218

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17118: Changes the way exception raising is done on PySDK's KeepWriterThread.
Lucas Di Pentima [Tue, 22 Dec 2020 15:41:01 +0000 (12:41 -0300)]
17118: Changes the way exception raising is done on PySDK's KeepWriterThread.

This solves the OOM bug where some keepstores fail when uploading data.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago17014: Un-obfuscate.
Tom Clegg [Tue, 22 Dec 2020 08:25:51 +0000 (03:25 -0500)]
17014: Un-obfuscate.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17014: Fix test.
Tom Clegg [Tue, 22 Dec 2020 08:21:43 +0000 (03:21 -0500)]
17014: Fix test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoaddressing https://dev.arvados.org/issues/17014#note-25
Nico Cesar [Mon, 21 Dec 2020 17:12:31 +0000 (12:12 -0500)]
addressing https://dev.arvados.org/issues/17014#note-25

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years agoFix a few staticcheck warnings.
Ward Vandewege [Mon, 21 Dec 2020 02:55:19 +0000 (21:55 -0500)]
Fix a few staticcheck warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFix a few more golint warnings.
Ward Vandewege [Fri, 18 Dec 2020 22:55:50 +0000 (17:55 -0500)]
Fix a few more golint warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoaddressing https://dev.arvados.org/issues/17014#note-23
Nico Cesar [Fri, 18 Dec 2020 17:56:10 +0000 (12:56 -0500)]
addressing https://dev.arvados.org/issues/17014#note-23

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years agoFix another golint warning.
Ward Vandewege [Fri, 18 Dec 2020 02:38:02 +0000 (21:38 -0500)]
Fix another golint warning.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17014: Remove redundant copy of timestamp/zero-value munging code.
Tom Clegg [Wed, 16 Dec 2020 21:56:31 +0000 (16:56 -0500)]
17014: Remove redundant copy of timestamp/zero-value munging code.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17208-s3-signature-double-slash'
Tom Clegg [Tue, 15 Dec 2020 05:31:48 +0000 (00:31 -0500)]
Merge branch '17208-s3-signature-double-slash'

fixes #17208

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoFix a few more golint warnings.
Ward Vandewege [Tue, 15 Dec 2020 00:42:44 +0000 (19:42 -0500)]
Fix a few more golint warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17152-collection-preserve-version-changes'
Lucas Di Pentima [Mon, 14 Dec 2020 21:35:29 +0000 (18:35 -0300)]
Merge branch '17152-collection-preserve-version-changes'
Refs #17152

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago17208: Update test for s3cmd's new console output.
Tom Clegg [Mon, 14 Dec 2020 20:41:33 +0000 (15:41 -0500)]
17208: Update test for s3cmd's new console output.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17014: controller has container requests
Nico Cesar [Mon, 14 Dec 2020 18:44:06 +0000 (13:44 -0500)]
17014: controller has container requests

This commit has:
  * Container Requests in the new codepath
  * Minimal changes in RailsAPI
  * Adapted Login and Logout so they work for CR
  * Tests in  lib/controller/integration_test.go that take in account
    runtime_token with intermediate clusters
  * Some tests in  lib/controller/federation_test.go had to be addapted,
    but for the most part remained as is to gurantee compatibilty
  * Added the check that SystemRootToken has to be non-empty
  * RoR fixtures that include finalized CR that are used in the tests to
    make sure we return the right object
  * Minimal changes in the documentation to reflect all the user visible
    changes

refs #17014

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years ago17152: Improves modified_at conditional update check.
Lucas Di Pentima [Mon, 14 Dec 2020 13:31:14 +0000 (10:31 -0300)]
17152: Improves modified_at conditional update check.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoFix more golint warnings.
Ward Vandewege [Sun, 13 Dec 2020 19:26:57 +0000 (14:26 -0500)]
Fix more golint warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFix more golint warnings.
Ward Vandewege [Sat, 12 Dec 2020 20:09:48 +0000 (15:09 -0500)]
Fix more golint warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17152: Moves conditional preserve_version disabling to collection's controller.
Lucas Di Pentima [Fri, 11 Dec 2020 15:28:22 +0000 (12:28 -0300)]
17152: Moves conditional preserve_version disabling to collection's controller.

There was a bug that flipped preserve_version to false after creating a new
version even though the update request included preserve_version=true.
This happened because the logic was at model level, and was incorrect because
at that level we cannot know if the client included the attribute on its
request.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago17208: Add test case.
Tom Clegg [Fri, 11 Dec 2020 05:43:40 +0000 (00:43 -0500)]
17208: Add test case.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17208: Merge branch 'master'
Tom Clegg [Fri, 11 Dec 2020 01:32:29 +0000 (20:32 -0500)]
17208: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago17152: Avoids creating audit logs when only 'preserve_version' is updated.
Lucas Di Pentima [Thu, 10 Dec 2020 20:58:58 +0000 (17:58 -0300)]
17152: Avoids creating audit logs when only 'preserve_version' is updated.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago17152: Changes preserve_version semantics, updates related documentation.
Lucas Di Pentima [Thu, 10 Dec 2020 19:53:49 +0000 (16:53 -0300)]
17152: Changes preserve_version semantics, updates related documentation.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago17152: Updates collection tests to reflect the new behavior.
Lucas Di Pentima [Thu, 10 Dec 2020 19:04:52 +0000 (16:04 -0300)]
17152: Updates collection tests to reflect the new behavior.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago17152: Updates API revision number.
Lucas Di Pentima [Thu, 10 Dec 2020 19:04:05 +0000 (16:04 -0300)]
17152: Updates API revision number.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago17208: Use normalized path to compute signatures.
Tom Clegg [Thu, 10 Dec 2020 21:41:41 +0000 (16:41 -0500)]
17208: Use normalized path to compute signatures.

Transparently clean paths containing "//".

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoCostanalyzer bugfix: when a collection uuid is supplied, write the csv
Ward Vandewege [Thu, 10 Dec 2020 15:33:57 +0000 (10:33 -0500)]
Costanalyzer bugfix: when a collection uuid is supplied, write the csv
files with the name of the associated container request uuid, not the
collection uuid. Also change tests to use a proper temporary directory
for the outputs, and do not reuse that directory between tests (which
hid the bug this commit fixed).

refs #17187

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17202-no-redir-crossorigin'
Tom Clegg [Wed, 9 Dec 2020 23:47:15 +0000 (18:47 -0500)]
Merge branch '17202-no-redir-crossorigin'

refs #17202

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoFix ineffassign warning.
Ward Vandewege [Wed, 9 Dec 2020 22:06:06 +0000 (17:06 -0500)]
Fix ineffassign warning.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17152-collection-versions-fixes'
Lucas Di Pentima [Wed, 9 Dec 2020 21:31:33 +0000 (18:31 -0300)]
Merge branch '17152-collection-versions-fixes'
Refs #17152

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago17202: Test avoiding redirect for cross-origin inline images.
Tom Clegg [Wed, 9 Dec 2020 20:44:57 +0000 (15:44 -0500)]
17202: Test avoiding redirect for cross-origin inline images.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '17199-available-port-race'
Tom Clegg [Wed, 9 Dec 2020 14:45:09 +0000 (09:45 -0500)]
Merge branch '17199-available-port-race'

fixes #17199

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17202: Use explicit SameSite=Lax for 303-with-cookie.
Tom Clegg [Wed, 9 Dec 2020 14:34:14 +0000 (09:34 -0500)]
17202: Use explicit SameSite=Lax for 303-with-cookie.

This improves XSS protection on some browsers, including Safari and
Firefox for Android.

On most browsers, Lax is already the default.

https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Set-Cookie/SameSite

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17202: Bypass 303-with-token on cross-origin requests.
Tom Clegg [Wed, 9 Dec 2020 00:52:36 +0000 (19:52 -0500)]
17202: Bypass 303-with-token on cross-origin requests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '17187-costanalyzer-updates'
Ward Vandewege [Tue, 8 Dec 2020 18:05:07 +0000 (13:05 -0500)]
Merge branch '17187-costanalyzer-updates'

closes #17187

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17187: Merge branch 'master' into 17187-costanalyzer-updates
Ward Vandewege [Tue, 8 Dec 2020 18:04:29 +0000 (13:04 -0500)]
17187: Merge branch 'master' into 17187-costanalyzer-updates

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17151: Merge branch 'master'
Tom Clegg [Tue, 8 Dec 2020 16:02:19 +0000 (11:02 -0500)]
17151: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '17161-doc-system-root-token'
Tom Clegg [Tue, 8 Dec 2020 15:59:32 +0000 (10:59 -0500)]
Merge branch '17161-doc-system-root-token'

fixes #17161

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17199: Avoid returning same port twice from find_available_port().
Tom Clegg [Mon, 7 Dec 2020 18:43:23 +0000 (13:43 -0500)]
17199: Avoid returning same port twice from find_available_port().

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoWarn about missing/short secrets. Delete Rails session key.
Tom Clegg [Mon, 7 Dec 2020 19:53:05 +0000 (14:53 -0500)]
Warn about missing/short secrets. Delete Rails session key.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17187: implement review feedback:
Ward Vandewege [Tue, 8 Dec 2020 00:36:54 +0000 (19:36 -0500)]
17187: implement review feedback:

* uuids are now specified at the end of the option list
* invalid uuids will cause the command to error out
* output directory is now optional

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17009-s3-vhost-list'
Tom Clegg [Mon, 7 Dec 2020 20:08:25 +0000 (15:08 -0500)]
Merge branch '17009-s3-vhost-list'

refs #17009

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoFix tests.
Tom Clegg [Mon, 7 Dec 2020 19:20:27 +0000 (14:20 -0500)]
Fix tests.

refs #17022

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '17177-use-newly-created-ca'
Javier Bértoli [Mon, 7 Dec 2020 16:34:37 +0000 (13:34 -0300)]
Merge branch '17177-use-newly-created-ca'

closes #17177

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agofix(provision): update arvados-formula's version
Javier Bértoli [Mon, 7 Dec 2020 15:46:06 +0000 (12:46 -0300)]
fix(provision): update arvados-formula's version

refs #17177

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agofix(provision): pin arvados-formula
Javier Bértoli [Mon, 7 Dec 2020 14:22:08 +0000 (11:22 -0300)]
fix(provision): pin arvados-formula

refs #17177

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agofix(provision): add port to workbench2 nginx's stanza
Javier Bértoli [Mon, 7 Dec 2020 12:20:29 +0000 (09:20 -0300)]
fix(provision): add port to workbench2 nginx's stanza

refs #17177

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17187: costanalyzer: print the total from the aggregate cost accounting
Ward Vandewege [Sun, 6 Dec 2020 15:54:11 +0000 (10:54 -0500)]
17187: costanalyzer: print the total from the aggregate cost accounting
       across all uuids to stdout.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17187: costanalyzer: allow specifying multiple comma-separated uuids via
Ward Vandewege [Sun, 6 Dec 2020 15:26:39 +0000 (10:26 -0500)]
17187: costanalyzer: allow specifying multiple comma-separated uuids via
       one -uuid argument

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17187: costanalyzer: add support for collection uuids.
Ward Vandewege [Sat, 5 Dec 2020 21:37:00 +0000 (16:37 -0500)]
17187: costanalyzer: add support for collection uuids.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agofix(provision): pin formulas' versions
Javier Bértoli [Fri, 4 Dec 2020 16:22:38 +0000 (13:22 -0300)]
fix(provision): pin formulas' versions

* Pin formulas versions, to prevent changes upstream breaking the installer
* Remove verbose/debug flags
* Remove unused entries in the config pillars

refs #17177

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agofix(provision): Document CA certificate purpose and installation
Javier Bértoli [Fri, 4 Dec 2020 12:17:34 +0000 (09:17 -0300)]
fix(provision): Document CA certificate purpose and installation

refs #17177

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agofix(provision): Add a CA and sign certificates with it
Javier Bértoli [Thu, 3 Dec 2020 23:00:46 +0000 (20:00 -0300)]
fix(provision): Add a CA and sign certificates with it

refs #17177

As discussed [here](https://forum.arvados.org/t/debugging-arvados-deployed-with-salt/58/8)
and [here](https://gitter.im/arvados/community?at=5fc65683496ca3372e3474a3), Arvados needs
certs signed by a known CA to work correctly.

This PR adds a CA and leaves a copy of the certificate in the installer directory.

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17009: Fix s3 ListObjects endpoint with vhost-style requests.
Tom Clegg [Wed, 2 Dec 2020 22:36:35 +0000 (17:36 -0500)]
17009: Fix s3 ListObjects endpoint with vhost-style requests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17009: Test virtual host-style S3 requests.
Tom Clegg [Thu, 3 Dec 2020 21:24:37 +0000 (16:24 -0500)]
17009: Test virtual host-style S3 requests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago17152: Adds migration to fix collection versions' modified_at timestamps.
Lucas Di Pentima [Thu, 3 Dec 2020 20:42:22 +0000 (17:42 -0300)]
17152: Adds migration to fix collection versions' modified_at timestamps.

Also, with test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago17152: Publishes the arvbox WebDAV download port.
Lucas Di Pentima [Thu, 3 Dec 2020 18:18:19 +0000 (15:18 -0300)]
17152: Publishes the arvbox WebDAV download port.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoUpgrade script/create_superuser_token.rb in the api server codebase to
Ward Vandewege [Thu, 3 Dec 2020 14:13:36 +0000 (09:13 -0500)]
Upgrade script/create_superuser_token.rb in the api server codebase to
generate v2 tokens.

refs #17022

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoClarify token details for the arv-user-activity tool.
Ward Vandewege [Thu, 3 Dec 2020 01:13:01 +0000 (20:13 -0500)]
Clarify token details for the arv-user-activity tool.

refs #17022

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17161: Improve SystemRootToken docs.
Tom Clegg [Wed, 2 Dec 2020 22:14:37 +0000 (17:14 -0500)]
17161: Improve SystemRootToken docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoUpdate error regexp in test case.
Tom Clegg [Wed, 2 Dec 2020 14:30:55 +0000 (09:30 -0500)]
Update error regexp in test case.

refs #17009

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agofix(docs): broken link
Javier Bértoli [Wed, 2 Dec 2020 13:44:27 +0000 (10:44 -0300)]
fix(docs): broken link

reported on [github](https://github.com/arvados/arvados-formula/issues/3#issuecomment-733019750)

No issue #

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17152: Fixes old collection versions' modified_at handling and test.
Lucas Di Pentima [Tue, 1 Dec 2020 22:17:01 +0000 (19:17 -0300)]
17152: Fixes old collection versions' modified_at handling and test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoMerge branch '17072-update-cwltool' refs #17072
Peter Amstutz [Tue, 1 Dec 2020 21:16:05 +0000 (16:16 -0500)]
Merge branch '17072-update-cwltool' refs #17072

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '17022-user-activity-report' refs #17022
Peter Amstutz [Mon, 30 Nov 2020 22:03:33 +0000 (17:03 -0500)]
Merge branch '17022-user-activity-report' refs #17022

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17022: Update install docs & fix Marc's email.
Peter Amstutz [Mon, 30 Nov 2020 19:16:56 +0000 (14:16 -0500)]
17022: Update install docs & fix Marc's email.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoNow that our k8s helm charts retain state, update the documentation
Ward Vandewege [Mon, 30 Nov 2020 16:55:41 +0000 (11:55 -0500)]
Now that our k8s helm charts retain state, update the documentation
accordingly.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16774-keep-web-errors' refs #16774
Peter Amstutz [Mon, 30 Nov 2020 16:03:53 +0000 (11:03 -0500)]
Merge branch '16774-keep-web-errors' refs #16774

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoFix more golint warnings - update crunchrun tests.
Ward Vandewege [Mon, 30 Nov 2020 01:51:27 +0000 (20:51 -0500)]
Fix more golint warnings - update crunchrun tests.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>