arvados.git
3 years ago16826: Moves configuration set-up to TestCase's setup() method.
Lucas Di Pentima [Mon, 14 Sep 2020 20:36:43 +0000 (17:36 -0300)]
16826: Moves configuration set-up to TestCase's setup() method.

Having a failing assertion on the teardown() method before the config
restoration code has the side effect of failing all the tests following
the one that made an illegal config change. This updates fixes that.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16826: Fixes config maps assignments, mostly on tests.
Lucas Di Pentima [Mon, 14 Sep 2020 20:23:09 +0000 (17:23 -0300)]
16826: Fixes config maps assignments, mostly on tests.

The new config check brought to the spotlight new tests that are setting
configurations incorrectly.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16826: Enhances teardown config check.
Lucas Di Pentima [Mon, 14 Sep 2020 19:19:59 +0000 (16:19 -0300)]
16826: Enhances teardown config check.

It's not enough to check that .keys() returns a list of Symbols, because
ActiveRecord::OrderedOptions behaves somewhat like HashWithIndifferentAccess
so values can need to be accessed by symbol or string. So, we now check that
every hash-like config section is an OrderedOptions object and also returns
its keys as symbols.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16826: Adds catch-all check for any config potentially changed during tests.
Lucas Di Pentima [Mon, 14 Sep 2020 18:42:15 +0000 (15:42 -0300)]
16826: Adds catch-all check for any config potentially changed during tests.

On test suite teardown, check if all config keys are still Symbols, so that
no mistake is made by writing tests that rely on config hashes with string
keys.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16826: Fixes config setting on tests about config maps knobs.
Lucas Di Pentima [Fri, 11 Sep 2020 21:59:54 +0000 (18:59 -0300)]
16826: Fixes config setting on tests about config maps knobs.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16826: Fixes the bug.
Lucas Di Pentima [Fri, 11 Sep 2020 21:44:20 +0000 (18:44 -0300)]
16826: Fixes the bug.

The issue is that the config loading code on Rails uses
ActiveSupport::OrderedOptions on config hashes, and this class always
returns keys as symbols. We were incorrectly testing the feature by
assigning a normal Hash to the config.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16826: Adds test exposing the bug.
Lucas Di Pentima [Fri, 11 Sep 2020 21:42:04 +0000 (18:42 -0300)]
16826: Adds test exposing the bug.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoThe new libpam-arvados-go package should conflict with the old
Ward Vandewege [Wed, 9 Sep 2020 17:50:15 +0000 (13:50 -0400)]
The new libpam-arvados-go package should conflict with the old
libpam-arvados package.

refs #15348

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '15888-pycurl' into master
Nico Cesar [Wed, 9 Sep 2020 14:47:40 +0000 (10:47 -0400)]
Merge branch '15888-pycurl' into master

refs #15888

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years agoAddresses https://dev.arvados.org/issues/15888#note-27
Nico Cesar [Wed, 9 Sep 2020 13:59:22 +0000 (09:59 -0400)]
Addresses https://dev.arvados.org/issues/15888#note-27

refs #15888

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years agoMerge branch '15888-remove-py2-from-test' into master
Nico Cesar [Wed, 9 Sep 2020 13:22:20 +0000 (09:22 -0400)]
Merge branch '15888-remove-py2-from-test' into master

closes #15888

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years agoChanges related to https://dev.arvados.org/issues/15888#note-25
Nico Cesar [Wed, 9 Sep 2020 00:29:30 +0000 (20:29 -0400)]
Changes related to https://dev.arvados.org/issues/15888#note-25

refs #15888

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years ago16679: Unexports Login.TokenLifetime config. Refs #16679.
Lucas Di Pentima [Tue, 8 Sep 2020 21:27:35 +0000 (18:27 -0300)]
16679: Unexports Login.TokenLifetime config. Refs #16679.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agopy3 argparse differs from py2 for action='version'
Nico Cesar [Tue, 8 Sep 2020 19:49:42 +0000 (15:49 -0400)]
py3 argparse differs from py2 for action='version'

refs #15888

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years agoMerge branch '16421-document-collection-deletion-lifecycle'
Ward Vandewege [Tue, 8 Sep 2020 15:41:42 +0000 (11:41 -0400)]
Merge branch '16421-document-collection-deletion-lifecycle'

closes #16421

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16421: Merge branch 'master' into 16421-document-collection-deletion-lifecycle
Ward Vandewege [Tue, 8 Sep 2020 15:41:04 +0000 (11:41 -0400)]
16421: Merge branch 'master' into 16421-document-collection-deletion-lifecycle

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFix some more golint warnings.
Ward Vandewege [Tue, 8 Sep 2020 00:25:25 +0000 (20:25 -0400)]
Fix some more golint warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFix test failure, refs #16689
Peter Amstutz [Fri, 4 Sep 2020 19:19:36 +0000 (15:19 -0400)]
Fix test failure, refs #16689

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16421: improvements based on review comments.
Ward Vandewege [Fri, 4 Sep 2020 15:26:49 +0000 (11:26 -0400)]
16421: improvements based on review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16778-setup-fed-user' refs #16778
Peter Amstutz [Fri, 4 Sep 2020 15:25:42 +0000 (11:25 -0400)]
Merge branch '16778-setup-fed-user' refs #16778

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16778: Make a copy of options
Peter Amstutz [Fri, 4 Sep 2020 15:25:15 +0000 (11:25 -0400)]
16778: Make a copy of options

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16778: Simplify logic
Peter Amstutz [Fri, 4 Sep 2020 14:52:38 +0000 (10:52 -0400)]
16778: Simplify logic

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '16796-arvbox-webshell' refs #16796
Peter Amstutz [Fri, 4 Sep 2020 14:15:40 +0000 (10:15 -0400)]
Merge branch '16796-arvbox-webshell' refs #16796

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '16636-add-time-to-ssh-metric'
Ward Vandewege [Fri, 4 Sep 2020 14:12:53 +0000 (10:12 -0400)]
Merge branch '16636-add-time-to-ssh-metric'

refs #16636

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16636: Merge branch 'master' into 16636-add-time-to-ssh-metric
Ward Vandewege [Fri, 4 Sep 2020 14:12:22 +0000 (10:12 -0400)]
16636: Merge branch 'master' into 16636-add-time-to-ssh-metric

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16796: Publish webshell port
Peter Amstutz [Fri, 4 Sep 2020 14:10:26 +0000 (10:10 -0400)]
16796: Publish webshell port

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16778: Setup federated users with VM and repo with LoginCluster set
Peter Amstutz [Thu, 3 Sep 2020 22:08:29 +0000 (18:08 -0400)]
16778: Setup federated users with VM and repo with LoginCluster set

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16636: Address review comments
Ward Vandewege [Thu, 3 Sep 2020 21:19:29 +0000 (17:19 -0400)]
16636: Address review comments

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16636: a-d-c: add a time-to-ssh and time-to-ready-for-container metrics
Ward Vandewege [Thu, 3 Sep 2020 17:10:42 +0000 (13:10 -0400)]
16636: a-d-c: add a time-to-ssh and time-to-ready-for-container metrics

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16796: Remove reference to support@curoverse.com
Peter Amstutz [Thu, 3 Sep 2020 18:59:58 +0000 (14:59 -0400)]
16796: Remove reference to support@curoverse.com

Tweak a few references to playground.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '16689-shell-sync-groups' refs #16689
Peter Amstutz [Thu, 3 Sep 2020 18:41:59 +0000 (14:41 -0400)]
Merge branch '16689-shell-sync-groups' refs #16689

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16796: Fix webshell logging.
Peter Amstutz [Thu, 3 Sep 2020 18:39:30 +0000 (14:39 -0400)]
16796: Fix webshell logging.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16796: Fix webshell --service
Peter Amstutz [Thu, 3 Sep 2020 18:34:16 +0000 (14:34 -0400)]
16796: Fix webshell --service

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '16803-shell-sync-tokens' refs #16803
Peter Amstutz [Thu, 3 Sep 2020 18:30:48 +0000 (14:30 -0400)]
Merge branch '16803-shell-sync-tokens' refs #16803

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16803: Tweak permission setting on created files/dirs
Peter Amstutz [Thu, 3 Sep 2020 18:29:31 +0000 (14:29 -0400)]
16803: Tweak permission setting on created files/dirs

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16803: Update shell node install instructions
Peter Amstutz [Thu, 3 Sep 2020 16:57:36 +0000 (12:57 -0400)]
16803: Update shell node install instructions

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agomaybe all this should be re-done
Nico Cesar [Thu, 3 Sep 2020 15:05:20 +0000 (11:05 -0400)]
maybe all this should be re-done

refs #15888

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years agocleanup: remove explicit installation of nodejs in our arvados/jobs
Ward Vandewege [Thu, 3 Sep 2020 14:20:26 +0000 (10:20 -0400)]
cleanup: remove explicit installation of nodejs in our arvados/jobs
Dockerfile. It's a dependency of the package now.

refs #16788

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16421: documentation: check in all new files.
Ward Vandewege [Thu, 3 Sep 2020 14:13:37 +0000 (10:13 -0400)]
16421: documentation: check in all new files.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agobugfix: remove unnecessarily dependency on python2 sdk package in our
Ward Vandewege [Thu, 3 Sep 2020 14:09:52 +0000 (10:09 -0400)]
bugfix: remove unnecessarily dependency on python2 sdk package in our
arvados/jobs Docker image.

refs #16580

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16726-anon-user-token' refs #16726
Peter Amstutz [Thu, 3 Sep 2020 13:41:02 +0000 (09:41 -0400)]
Merge branch '16726-anon-user-token' refs #16726

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16689: add/remove users from groups to sync with Arvados
Peter Amstutz [Wed, 2 Sep 2020 22:08:43 +0000 (18:08 -0400)]
16689: add/remove users from groups to sync with Arvados

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoactivate was deleted by mistake
Nico Cesar [Wed, 2 Sep 2020 21:56:05 +0000 (17:56 -0400)]
activate was deleted by mistake

refs #15888

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years ago16421: documentation: reorganize and update Keep documentation. Add
Ward Vandewege [Wed, 2 Sep 2020 21:34:52 +0000 (17:34 -0400)]
16421: documentation: reorganize and update Keep documentation. Add
       collection and data block lifecycle documentation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16803: Create settings.conf for the user.
Peter Amstutz [Wed, 2 Sep 2020 21:24:25 +0000 (17:24 -0400)]
16803: Create settings.conf for the user.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '16679-wb2-idle-timeout-config'. Refs #16679
Lucas Di Pentima [Wed, 2 Sep 2020 19:12:20 +0000 (16:12 -0300)]
Merge branch '16679-wb2-idle-timeout-config'. Refs #16679

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoMerge branch '16795-boot-outcome-aborted'
Tom Clegg [Wed, 2 Sep 2020 17:39:20 +0000 (13:39 -0400)]
Merge branch '16795-boot-outcome-aborted'

fixes #16795

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16795: Update tests.
Tom Clegg [Wed, 2 Sep 2020 17:38:40 +0000 (13:38 -0400)]
16795: Update tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16795: Pin pycurl version.
Tom Clegg [Wed, 2 Sep 2020 14:06:34 +0000 (10:06 -0400)]
16795: Pin pycurl version.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16796: Remove the 'beta' tag from webshell
Peter Amstutz [Wed, 2 Sep 2020 13:44:42 +0000 (09:44 -0400)]
16796: Remove the 'beta' tag from webshell

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16795: Don't shutdown idle nodes just because Create failed.
Tom Clegg [Wed, 2 Sep 2020 12:56:38 +0000 (08:56 -0400)]
16795: Don't shutdown idle nodes just because Create failed.

Previous behavior would prematurely shutdown booting instances when
Create calls were being rate-limited.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16796: Expect password prompt
Peter Amstutz [Wed, 2 Sep 2020 02:40:57 +0000 (22:40 -0400)]
16796: Expect password prompt

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '16773-webshell-js' into 16796-arvbox-webshell
Peter Amstutz [Wed, 2 Sep 2020 02:30:17 +0000 (22:30 -0400)]
Merge branch '16773-webshell-js' into 16796-arvbox-webshell

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16796: Add webshell to arvbox
Peter Amstutz [Wed, 2 Sep 2020 02:07:04 +0000 (22:07 -0400)]
16796: Add webshell to arvbox

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16795: Simplify "kill" behavior in stub driver.
Tom Clegg [Tue, 1 Sep 2020 21:10:09 +0000 (17:10 -0400)]
16795: Simplify "kill" behavior in stub driver.

Now, "kill" just sets a flag, and the "run" stub exits when it notices
the flag.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16726: Integration test using anonymous token to fetch a collection
Peter Amstutz [Tue, 1 Sep 2020 21:04:44 +0000 (17:04 -0400)]
16726: Integration test using anonymous token to fetch a collection

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16795: Fix false-positive bug detection.
Tom Clegg [Tue, 1 Sep 2020 20:22:13 +0000 (16:22 -0400)]
16795: Fix false-positive bug detection.

The dispatcher simulation test occasionally fails with this error when
a crunch-run stub is killed, and the same container is rescheduled on
the same node before the first attempt's startup-phase sleep expires:

    bugf("[test] StubDriver bug or caller bug: pid %d exiting, running[%s]==%d", pid, uuid, svm.running[uuid])
... Error: [test] StubDriver bug or caller bug: pid 9 exiting, running[zzzzz-dz642-000000000000184]==0

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16726-anon-fed' into 16726-anon-user-token
Peter Amstutz [Tue, 1 Sep 2020 19:23:02 +0000 (15:23 -0400)]
Merge branch '16726-anon-fed' into 16726-anon-user-token

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16726: Initialize anonymous user token in arvados-boot
Peter Amstutz [Tue, 1 Sep 2020 19:21:54 +0000 (15:21 -0400)]
16726: Initialize anonymous user token in arvados-boot

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '16790-next-marker-omitempty'
Tom Clegg [Tue, 1 Sep 2020 15:33:25 +0000 (11:33 -0400)]
Merge branch '16790-next-marker-omitempty'

fixes #16790

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16679: Exports Login.TokenLifetime to be used by workbench2.
Lucas Di Pentima [Tue, 1 Sep 2020 15:06:53 +0000 (12:06 -0300)]
16679: Exports Login.TokenLifetime to be used by workbench2.

When not zero, workbench2 will store the token on session storage instead
of local storage for enhanced security.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoCheck Content-Length header in HeadObject response.
Tom Clegg [Tue, 1 Sep 2020 14:47:17 +0000 (10:47 -0400)]
Check Content-Length header in HeadObject response.

refs #16596

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16679: Adds Workbench.IdleTimeout config setting for WB2.
Lucas Di Pentima [Tue, 1 Sep 2020 14:41:04 +0000 (11:41 -0300)]
16679: Adds Workbench.IdleTimeout config setting for WB2.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoMerge branch '16739-concurrent-node-create-throttle'
Ward Vandewege [Tue, 1 Sep 2020 14:34:10 +0000 (10:34 -0400)]
Merge branch '16739-concurrent-node-create-throttle'

closes #16739

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16739: Merge branch 'master' into 16739-concurrent-node-create-throttle
Ward Vandewege [Tue, 1 Sep 2020 14:33:27 +0000 (10:33 -0400)]
16739: Merge branch 'master' into 16739-concurrent-node-create-throttle

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16739: doc update: implement review feedback.
Ward Vandewege [Tue, 1 Sep 2020 14:32:47 +0000 (10:32 -0400)]
16739: doc update: implement review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16739: remove throttle.ResetError, update the err field directly from
Ward Vandewege [Tue, 1 Sep 2020 14:23:33 +0000 (10:23 -0400)]
16739: remove throttle.ResetError, update the err field directly from
       the test.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16790: Avoid returning empty NextMarker tag in list responses.
Tom Clegg [Tue, 1 Sep 2020 14:16:47 +0000 (10:16 -0400)]
16790: Avoid returning empty NextMarker tag in list responses.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16739: implement review feedback.
Ward Vandewege [Tue, 1 Sep 2020 13:43:57 +0000 (09:43 -0400)]
16739: implement review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16779: Create user accounts even if they don't have an ssh key
Peter Amstutz [Mon, 31 Aug 2020 18:22:27 +0000 (14:22 -0400)]
16779: Create user accounts even if they don't have an ssh key

refs #16779

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoFix redundant entry in cluster config, arvbox tells you to use adduser
Peter Amstutz [Mon, 31 Aug 2020 21:37:56 +0000 (17:37 -0400)]
Fix redundant entry in cluster config, arvbox tells you to use adduser

refs #16749

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '16788-add-nodejs-dependency-to-a-c-r-package'
Ward Vandewege [Mon, 31 Aug 2020 19:49:12 +0000 (15:49 -0400)]
Merge branch '16788-add-nodejs-dependency-to-a-c-r-package'

closes #16788

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16788: add package dependency on nodejs to arvados-cwl-runner.
Ward Vandewege [Mon, 31 Aug 2020 19:47:51 +0000 (15:47 -0400)]
16788: add package dependency on nodejs to arvados-cwl-runner.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16739: Fix using two different throttles.
Tom Clegg [Mon, 31 Aug 2020 19:34:22 +0000 (15:34 -0400)]
16739: Fix using two different throttles.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16739: a-d-c: add a concurrent node creation throttle option.
Ward Vandewege [Mon, 31 Aug 2020 18:42:14 +0000 (14:42 -0400)]
16739: a-d-c: add a concurrent node creation throttle option.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoInstalling extra python3 libraries:dist_wheel has to go before PyYAML
Nico Cesar [Mon, 31 Aug 2020 18:28:28 +0000 (14:28 -0400)]
Installing extra python3 libraries:dist_wheel has to go before PyYAML

refs #15888

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years agoMerge branch '16602-wb-acr-version' refs #16602
Peter Amstutz [Mon, 31 Aug 2020 15:29:01 +0000 (11:29 -0400)]
Merge branch '16602-wb-acr-version' refs #16602

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoRevert "Installing extra python3 libraries"
Nico Cesar [Mon, 31 Aug 2020 15:23:58 +0000 (11:23 -0400)]
Revert "Installing extra python3 libraries"

This reverts commit ddae1b57f077d8a7c091b3cdf9ecaa562703fb3c.

setuptools should be done outside pip

refs #15888

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years agoInstalling extra python3 libraries
Nico Cesar [Mon, 31 Aug 2020 15:18:21 +0000 (11:18 -0400)]
Installing extra python3 libraries

refs #15888

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years agoInstalling extra python3 libraries
Nico Cesar [Mon, 31 Aug 2020 15:15:17 +0000 (11:15 -0400)]
Installing extra python3 libraries

refs #15888

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years agoMerge branch '16723-kill-vs-requeue'
Tom Clegg [Mon, 31 Aug 2020 14:30:04 +0000 (10:30 -0400)]
Merge branch '16723-kill-vs-requeue'

closes #16723

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoFix bug introduced with gofmt cleanup yesterday.
Ward Vandewege [Sun, 30 Aug 2020 12:03:19 +0000 (08:03 -0400)]
Fix bug introduced with gofmt cleanup yesterday.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFix some golint warnings.
Ward Vandewege [Sat, 29 Aug 2020 11:20:19 +0000 (07:20 -0400)]
Fix some golint warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16726: Anonymous user is mapped to anonymous. root user is renamed.
Peter Amstutz [Fri, 28 Aug 2020 21:32:07 +0000 (17:32 -0400)]
16726: Anonymous user is mapped to anonymous.  root user is renamed.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16602: fix test
Peter Amstutz [Fri, 28 Aug 2020 20:46:22 +0000 (16:46 -0400)]
16602: fix test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '16535-s3'
Tom Clegg [Fri, 28 Aug 2020 20:17:48 +0000 (16:17 -0400)]
Merge branch '16535-s3'

closes #16535

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16720-arv-mount-exception'
Tom Clegg [Fri, 28 Aug 2020 20:16:51 +0000 (16:16 -0400)]
Merge branch '16720-arv-mount-exception'

fixes #16720

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16602: Tweak fixture 'name' name to fix test
Peter Amstutz [Fri, 28 Aug 2020 20:04:19 +0000 (16:04 -0400)]
16602: Tweak fixture 'name' name to fix test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16602: Test for applying WorkflowRunnerResource
Peter Amstutz [Fri, 28 Aug 2020 01:38:34 +0000 (21:38 -0400)]
16602: Test for applying WorkflowRunnerResource

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16602: Add missing file
Peter Amstutz [Wed, 26 Aug 2020 21:22:44 +0000 (17:22 -0400)]
16602: Add missing file

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16602: Workbench sets container_image from acrContainerImage
Peter Amstutz [Wed, 26 Aug 2020 19:44:59 +0000 (15:44 -0400)]
16602: Workbench sets container_image from acrContainerImage

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16602: Embed the desired workflow runner version in WorkflowRunnerResources
Peter Amstutz [Wed, 26 Aug 2020 19:40:33 +0000 (15:40 -0400)]
16602: Embed the desired workflow runner version in WorkflowRunnerResources

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoAdd missing install page for arvados-cwl-runner refs #15964
Peter Amstutz [Fri, 28 Aug 2020 20:01:39 +0000 (16:01 -0400)]
Add missing install page for arvados-cwl-runner refs #15964

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16773: Fix webshell wait for prompt & asset loading
Peter Amstutz [Fri, 28 Aug 2020 19:19:57 +0000 (15:19 -0400)]
16773: Fix webshell wait for prompt & asset loading

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16535: Avoid including empty CommonPrefixes tag in list response.
Tom Clegg [Fri, 28 Aug 2020 15:28:29 +0000 (11:28 -0400)]
16535: Avoid including empty CommonPrefixes tag in list response.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16749-arvbox-users' refs #16749
Peter Amstutz [Fri, 28 Aug 2020 14:31:15 +0000 (10:31 -0400)]
Merge branch '16749-arvbox-users' refs #16749

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoFix more gofmt warnings.
Ward Vandewege [Fri, 28 Aug 2020 12:29:57 +0000 (08:29 -0400)]
Fix more gofmt warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16749: Put AutoAdminFirstUser back
Peter Amstutz [Fri, 28 Aug 2020 02:17:31 +0000 (22:17 -0400)]
16749: Put AutoAdminFirstUser back

Fix git clone to use git.arvados.org

Fix typo redundant 'InternalURLs' field

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16720: Fix missing import.
Tom Clegg [Thu, 27 Aug 2020 19:50:25 +0000 (15:50 -0400)]
16720: Fix missing import.

Also delete unused inline import (sys), and double import (time).

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16720: Add missing import.
Tom Clegg [Thu, 27 Aug 2020 19:47:28 +0000 (15:47 -0400)]
16720: Add missing import.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>