arvados.git
3 years ago16683: Check that remote cluster id is presumed valid, add test 2.0.4
Peter Amstutz [Thu, 13 Aug 2020 19:22:49 +0000 (15:22 -0400)]
16683: Check that remote cluster id is presumed valid, add test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16683: Permit granting permissions to remote users
Peter Amstutz [Wed, 12 Aug 2020 21:32:06 +0000 (17:32 -0400)]
16683: Permit granting permissions to remote users

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16683: Sharing dialog query is compatible with federated user list
Peter Amstutz [Wed, 12 Aug 2020 20:20:19 +0000 (16:20 -0400)]
16683: Sharing dialog query is compatible with federated user list

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16683: Set and check ForwardedFor on federated list requests
Peter Amstutz [Wed, 12 Aug 2020 20:10:32 +0000 (16:10 -0400)]
16683: Set and check ForwardedFor on federated list requests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge federation-migrate fixes refs #16589
Peter Amstutz [Thu, 13 Aug 2020 21:21:35 +0000 (17:21 -0400)]
Merge federation-migrate fixes refs #16589

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16623: Add NetworkResourceGroup option for Azure
Peter Amstutz [Wed, 22 Jul 2020 18:58:59 +0000 (14:58 -0400)]
16623: Add NetworkResourceGroup option for Azure

refs #16623

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agodocumentation: disable download buffering in our sample nginx config for
Ward Vandewege [Wed, 12 Aug 2020 14:19:07 +0000 (10:19 -0400)]
documentation: disable download buffering in our sample nginx config for
keep-web and keepproxy. This helps when the clients are far away/slow.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoThe arvados k8s repo has changed name.
Ward Vandewege [Mon, 10 Aug 2020 17:53:44 +0000 (13:53 -0400)]
The arvados k8s repo has changed name.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agodocumentation: mention API/MaxKeepBlobBuffers on the Keepstore
Ward Vandewege [Wed, 29 Jul 2020 21:36:30 +0000 (17:36 -0400)]
documentation: mention API/MaxKeepBlobBuffers on the Keepstore
installation page.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agodocumentation: arvados-dispatch-cloud: add missing curl command.
Ward Vandewege [Fri, 24 Jul 2020 21:13:49 +0000 (17:13 -0400)]
documentation: arvados-dispatch-cloud: add missing curl command.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoDocumentation: fix nginx snippets, remove warnings.
Ward Vandewege [Tue, 7 Jul 2020 13:27:43 +0000 (09:27 -0400)]
Documentation: fix nginx snippets, remove warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago6649: Document webshell installation.
Ward Vandewege [Thu, 25 Jun 2020 16:04:20 +0000 (12:04 -0400)]
6649: Document webshell installation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoDocumentation: add missing span in the 'Set up a shell node' page, to
Ward Vandewege [Fri, 26 Jun 2020 00:38:04 +0000 (20:38 -0400)]
Documentation: add missing span in the 'Set up a shell node' page, to
fix coloration bug in the 'Create scoped token' section.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFixes template usage on SSO install page.
Lucas Di Pentima [Tue, 23 Jun 2020 17:09:50 +0000 (14:09 -0300)]
Fixes template usage on SSO install page.

No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoMake it clear that the API token is used by all Arvados command line
Ward Vandewege [Mon, 22 Jun 2020 16:08:24 +0000 (12:08 -0400)]
Make it clear that the API token is used by all Arvados command line
tools, not just the 'arv' tool.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoAdd links to the Arvados forum refs #16521
Peter Amstutz [Fri, 19 Jun 2020 21:20:59 +0000 (17:20 -0400)]
Add links to the Arvados forum refs #16521

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16524: Pin rsa package to < 4.1
Peter Amstutz [Fri, 12 Jun 2020 14:13:24 +0000 (10:13 -0400)]
16524: Pin rsa package to < 4.1

Because >= 4.1 does not support python 2 any more.  refs #16524

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16391: Fix log message. 2.0.3
Tom Clegg [Wed, 13 May 2020 21:07:11 +0000 (17:07 -0400)]
16391: Fix log message.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16492: Upgrades websocket-extensions gem to fix a security alert.
Lucas Di Pentima [Fri, 5 Jun 2020 18:13:44 +0000 (15:13 -0300)]
16492: Upgrades websocket-extensions gem to fix a security alert.

We really don't use this gem as it's requested by actioncable from Rails 5
that we don't even load at runtime. But, as we cannot remove actioncable
from our Gemfile.lock files because of some other gems depending on 'rails',
we upgrade it to make GitHub happy.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16339: Fix $schemas rewriting bug
Peter Amstutz [Mon, 11 May 2020 15:08:01 +0000 (11:08 -0400)]
16339: Fix $schemas rewriting bug

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16328: If config.yml is available, use the keepstores defined there instead of
Ward Vandewege [Mon, 13 Apr 2020 21:57:03 +0000 (17:57 -0400)]
16328: If config.yml is available, use the keepstores defined there instead of
the legacy autodiscover mechanism via the API server.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years ago16341: Upgrades rack on API & Workbench.
Lucas Di Pentima [Tue, 21 Apr 2020 16:55:10 +0000 (13:55 -0300)]
16341: Upgrades rack on API & Workbench.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoFixed FetchAll method for Container queue in order to make use of preemptible instance
Dante Tsang [Mon, 20 Apr 2020 10:23:56 +0000 (18:23 +0800)]
Fixed FetchAll method for Container queue in order to make use of preemptible instance

Updated AUTHORS file

Arvados-DCO-1.1-Signed-off-by: Dante Tsang <dante@dantetsang.com>

3 years ago16393: keepproxy used cluster.API.KeepServiceRequestTimeout (defaults to
Ward Vandewege [Fri, 1 May 2020 20:55:01 +0000 (16:55 -0400)]
16393: keepproxy used cluster.API.KeepServiceRequestTimeout (defaults to
15s) as the timeout on its connection to the keepstores. When a slow client
sends blocks to keepproxy, they get streamed through to keepstore, and
the upload can take more than cluster.API.KeepServiceRequestTimeout
seconds. Update keepproxy to use keepclient.DefaultProxyRequestTimeout
(300s) instead when it connects to the keepstores.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years ago16349: Set time zone to UTC at db connection level.
Tom Clegg [Wed, 29 Apr 2020 19:37:32 +0000 (15:37 -0400)]
16349: Set time zone to UTC at db connection level.

This covers the trash time comparisons in materialized_permission_view
as well as explicit uses of CURRENT_TIMESTAMP in Rails queries.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16349: Skip converting DB timestamps to & from localtime.
Tom Clegg [Mon, 27 Apr 2020 20:57:55 +0000 (16:57 -0400)]
16349: Skip converting DB timestamps to & from localtime.

The previous code already returned the correct time. This change
merely avoids converting the time to the local time zone in
PostgreSQL, and back to UTC again in Rails.

This might also avoid rare problems in unusual edge cases where Rails
and PostgreSQL session use different time zones, like a configuration
mishap or a race during a daylight savings time transition.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16349: Fix TZ-sensitive comparison in token expiry checks.
Tom Clegg [Mon, 27 Apr 2020 20:37:49 +0000 (16:37 -0400)]
16349: Fix TZ-sensitive comparison in token expiry checks.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16343: Fix handling of local CR creation when LoginCluster is used.
Tom Clegg [Wed, 22 Apr 2020 20:50:06 +0000 (16:50 -0400)]
16343: Fix handling of local CR creation when LoginCluster is used.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16343: Add debug logs in token checking code.
Tom Clegg [Wed, 22 Apr 2020 20:31:06 +0000 (16:31 -0400)]
16343: Add debug logs in token checking code.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16366: "InternalURLs" and "AccessViaHosts" are consistent in install
Peter Amstutz [Tue, 28 Apr 2020 20:44:30 +0000 (16:44 -0400)]
16366: "InternalURLs" and "AccessViaHosts" are consistent in install

refs #16366

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16434: the python3-arvados-cwl-runner packages on Debian 10 and Ubuntu
Ward Vandewege [Fri, 15 May 2020 00:39:13 +0000 (20:39 -0400)]
16434: the python3-arvados-cwl-runner packages on Debian 10 and Ubuntu
18.04 (and later, presumably) have a dependency on the
python3-distutils package.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years agoFix comment typos in run-library.sh
Ward Vandewege [Fri, 15 May 2020 00:40:14 +0000 (20:40 -0400)]
Fix comment typos in run-library.sh

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years ago16434: add a basic execution test for the python3-arvados-cwl-runner packages
Ward Vandewege [Fri, 15 May 2020 00:40:55 +0000 (20:40 -0400)]
16434: add a basic execution test for the python3-arvados-cwl-runner packages

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years ago16387: Allow setting is_active=false only on LoginCluster users.
Tom Clegg [Wed, 6 May 2020 19:39:30 +0000 (15:39 -0400)]
16387: Allow setting is_active=false only on LoginCluster users.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16387: Allow batch update to set is_active=false for a remote user.
Tom Clegg [Mon, 4 May 2020 14:53:21 +0000 (10:53 -0400)]
16387: Allow batch update to set is_active=false for a remote user.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoAdd StartedAt and FinishedAt fields to arvados.Container.
Tom Clegg [Fri, 1 May 2020 19:58:58 +0000 (15:58 -0400)]
Add StartedAt and FinishedAt fields to arvados.Container.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agobugfix: fix arvados-node-manager package build
Ward Vandewege [Fri, 15 May 2020 00:57:49 +0000 (20:57 -0400)]
bugfix: fix arvados-node-manager package build

refs #16373

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years agoBugfix: make the arvados-docker-cleaner packages install their systemd
Ward Vandewege [Thu, 7 May 2020 14:20:50 +0000 (10:20 -0400)]
Bugfix: make the arvados-docker-cleaner packages install their systemd
unit file in the correct directory.

closes #16373

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years ago16435: Updates the documentation.
Lucas Di Pentima [Thu, 21 May 2020 23:08:40 +0000 (20:08 -0300)]
16435: Updates the documentation.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16435: Adds & updates tests.
Lucas Di Pentima [Thu, 21 May 2020 22:00:37 +0000 (19:00 -0300)]
16435: Adds & updates tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16435: Avoids creating duplicated group->user links.
Lucas Di Pentima [Thu, 21 May 2020 21:11:10 +0000 (18:11 -0300)]
16435: Avoids creating duplicated group->user links.

When a user needs a permission change, the g->u link already exists.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16435: Adds support for different permission levels: read, write & manage.
Lucas Di Pentima [Thu, 21 May 2020 19:21:12 +0000 (16:21 -0300)]
16435: Adds support for different permission levels: read, write & manage.

If the 3rd field isn't present on any record, it will fallback to 'can_write'
to maintain backwards compatibility.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16435: Allows 2 or 3 fields per record on the CSV file.
Lucas Di Pentima [Wed, 20 May 2020 21:23:08 +0000 (18:23 -0300)]
16435: Allows 2 or 3 fields per record on the CSV file.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16419: Use CAINFO instead of CAPATH
Peter Amstutz [Thu, 21 May 2020 13:51:03 +0000 (09:51 -0400)]
16419: Use CAINFO instead of CAPATH

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agokeep.py: python-api https certificate align pycurl with httplib2 certificate finder
Pjotr Prins [Wed, 20 May 2020 19:35:54 +0000 (14:35 -0500)]
keep.py: python-api https certificate align pycurl with httplib2 certificate finder

Arvados-DCO-1.1-Signed-off-by: Pjotr Prins <pjotr.public01@thebird.nl>

3 years agoutil.py: python-api https certificate openssl override as is used in GNU Guix
Pjotr Prins [Wed, 20 May 2020 16:12:20 +0000 (11:12 -0500)]
util.py: python-api https certificate openssl override as is used in GNU Guix

Arvados-DCO-1.1-Signed-off-by: Pjotr Prins <pjotr.public01@thebird.nl>

3 years agoArvados on Kubernetes now has workbench2 as well.
Ward Vandewege [Thu, 30 Apr 2020 19:32:57 +0000 (15:32 -0400)]
Arvados on Kubernetes now has workbench2 as well.

closes #16384

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years agoUpdated Arvados on Kubernetes documentation.
Ward Vandewege [Mon, 27 Apr 2020 19:58:34 +0000 (15:58 -0400)]
Updated Arvados on Kubernetes documentation.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years agoPin version of launchy gem while we still support Ruby 2.3 2.0.2
Peter Amstutz [Thu, 5 Mar 2020 23:00:15 +0000 (18:00 -0500)]
Pin version of launchy gem while we still support Ruby 2.3

refs #16215

Need to do it for login-sync too.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoPin version of launchy gem while we still support Ruby 2.3
Peter Amstutz [Thu, 5 Mar 2020 21:27:33 +0000 (16:27 -0500)]
Pin version of launchy gem while we still support Ruby 2.3

refs #16215

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16313: Updates minimum requestd ram on docker containers from 4 to 16 MB.
Lucas Di Pentima [Mon, 13 Apr 2020 18:34:12 +0000 (15:34 -0300)]
16313: Updates minimum requestd ram on docker containers from 4 to 16 MB.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoBump mithril for advisory https://www.npmjs.com/advisories/1094
Peter Amstutz [Mon, 13 Apr 2020 18:38:15 +0000 (14:38 -0400)]
Bump mithril for advisory https://npmjs.com/advisories/1094

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoPin jssha to 2.4.2
Peter Amstutz [Mon, 13 Apr 2020 18:00:32 +0000 (14:00 -0400)]
Pin jssha to 2.4.2

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Add test for BypassFederation
Peter Amstutz [Mon, 13 Apr 2020 14:25:11 +0000 (10:25 -0400)]
16263: Add test for BypassFederation

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Pulls from official git repo when running federation tests.
Lucas Di Pentima [Mon, 6 Apr 2020 14:01:18 +0000 (11:01 -0300)]
16263: Pulls from official git repo when running federation tests.

This is helpful to ask for specific branches that aren't published on github.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16263: User migration test also checks federated user behavior
Peter Amstutz [Thu, 2 Apr 2020 14:52:44 +0000 (10:52 -0400)]
16263: User migration test also checks federated user behavior

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Tweak federation tests, use CWL 1.1
Peter Amstutz [Wed, 1 Apr 2020 01:03:42 +0000 (21:03 -0400)]
16263: Tweak federation tests, use CWL 1.1

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Add bypass_federation test
Peter Amstutz [Tue, 31 Mar 2020 21:42:03 +0000 (17:42 -0400)]
16263: Add bypass_federation test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Fix no_federation -> bypass_federation in boolParms
Peter Amstutz [Tue, 31 Mar 2020 21:16:57 +0000 (17:16 -0400)]
16263: Fix no_federation -> bypass_federation in boolParms

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Fix only_admin_can_bypass_federation
Peter Amstutz [Tue, 31 Mar 2020 21:12:31 +0000 (17:12 -0400)]
16263: Fix only_admin_can_bypass_federation

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Missed rename
Peter Amstutz [Tue, 31 Mar 2020 20:45:49 +0000 (16:45 -0400)]
16263: Missed rename

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Rename no_federation -> bypass_federation
Peter Amstutz [Tue, 31 Mar 2020 20:33:27 +0000 (16:33 -0400)]
16263: Rename no_federation -> bypass_federation

Enforce if bypass_federation is true that user is admin.

Update API revision and make federation migrate check for it.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Add no_federation to user update
Peter Amstutz [Tue, 31 Mar 2020 18:42:46 +0000 (14:42 -0400)]
16263: Add no_federation to user update

We might agree on a different API but try this and see if it helps
pass the test.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: local_user_list -> no_federation in boolParams
Peter Amstutz [Tue, 31 Mar 2020 02:30:10 +0000 (22:30 -0400)]
16263: local_user_list -> no_federation in boolParams

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Generalize "local_user_list" flag to "no_federation"
Peter Amstutz [Tue, 31 Mar 2020 02:14:23 +0000 (22:14 -0400)]
16263: Generalize "local_user_list" flag to "no_federation"

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: UserMerge shouldn't be federated
Peter Amstutz [Mon, 30 Mar 2020 21:12:17 +0000 (17:12 -0400)]
16263: UserMerge shouldn't be federated

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Fix omitempty placement
Peter Amstutz [Mon, 30 Mar 2020 18:50:06 +0000 (14:50 -0400)]
16263: Fix omitempty placement

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Add omitempty to GetOptions
Peter Amstutz [Mon, 30 Mar 2020 18:43:36 +0000 (14:43 -0400)]
16263: Add omitempty to GetOptions

Don't try to migrate if activate_remote_user fails.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Add local_user_list to boolParams
Peter Amstutz [Sat, 28 Mar 2020 01:36:09 +0000 (21:36 -0400)]
16263: Add local_user_list to boolParams

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Add local_user_list flag to bypass LoginCluster behavior
Peter Amstutz [Fri, 27 Mar 2020 21:08:48 +0000 (17:08 -0400)]
16263: Add local_user_list flag to bypass LoginCluster behavior

Required by federation migrate script.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Decodes JSON numbers as strings instead of float64.
Lucas Di Pentima [Thu, 26 Mar 2020 14:46:34 +0000 (11:46 -0300)]
16263: Decodes JSON numbers as strings instead of float64.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16263: Adds unit test case confirming 'limit' bug.
Lucas Di Pentima [Wed, 25 Mar 2020 19:35:18 +0000 (16:35 -0300)]
16263: Adds unit test case confirming 'limit' bug.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16263: Adds test exposing a bug when using 'limit' with the max int64 value.
Lucas Di Pentima [Wed, 25 Mar 2020 14:26:55 +0000 (11:26 -0300)]
16263: Adds test exposing a bug when using 'limit' with the max int64 value.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16263: Bool filter bug fix.
Lucas Di Pentima [Tue, 24 Mar 2020 20:39:01 +0000 (17:39 -0300)]
16263: Bool filter bug fix.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16263: Adds test exposing a bug on filter unmarshalling.
Lucas Di Pentima [Tue, 24 Mar 2020 21:03:34 +0000 (18:03 -0300)]
16263: Adds test exposing a bug on filter unmarshalling.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16263: Makes gofmt happy.
Lucas Di Pentima [Mon, 23 Mar 2020 19:20:41 +0000 (16:20 -0300)]
16263: Makes gofmt happy.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16263: Don't cache modified_by_*_uuid fields when using LoginCluster.
Lucas Di Pentima [Mon, 23 Mar 2020 18:32:59 +0000 (15:32 -0300)]
16263: Don't cache modified_by_*_uuid fields when using LoginCluster.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16263: Adds nullify behavior to users's batch_update endpoint.
Lucas Di Pentima [Mon, 23 Mar 2020 15:27:18 +0000 (12:27 -0300)]
16263: Adds nullify behavior to users's batch_update endpoint.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16263: Assigns nil to select attributes when receiving empty values.
Lucas Di Pentima [Thu, 19 Mar 2020 21:15:52 +0000 (18:15 -0300)]
16263: Assigns nil to select attributes when receiving empty values.

Controller may translate NULL values to "" on certain object string fields.
The same with integers, NULLs are converted to 0.
When controller retrieves objects from railsAPI and uses the data to create
or update objects, some of those fields should get converted back to NULL.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoFix tests.
Ward Vandewege [Fri, 10 Apr 2020 12:56:56 +0000 (08:56 -0400)]
Fix tests.

refs #16326

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years agodocumentation: update descriptions for MaxKeepBlobBuffers and MaxConcurrentRequests
Ward Vandewege [Thu, 9 Apr 2020 21:53:31 +0000 (17:53 -0400)]
documentation: update descriptions for MaxKeepBlobBuffers and MaxConcurrentRequests

keepstore: MaxConcurrentRequests set to zero should mean no limit

refs #16326

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years agoWarn if MaxKeepBlobBuffers > MaxConcurrentRequests.
Tom Clegg [Thu, 9 Apr 2020 20:58:36 +0000 (16:58 -0400)]
Warn if MaxKeepBlobBuffers > MaxConcurrentRequests.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16219: Test populated container fields.
Tom Clegg [Thu, 5 Mar 2020 21:42:39 +0000 (16:42 -0500)]
16219: Test populated container fields.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16219: Load all fields needed to compute node size.
Tom Clegg [Thu, 5 Mar 2020 19:44:22 +0000 (14:44 -0500)]
16219: Load all fields needed to compute node size.

Without ContainerImage and Mounts, the scratch size requirement can't
be computed correctly.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16221: Fix test for config endpoint.
Tom Clegg [Thu, 12 Mar 2020 04:15:16 +0000 (00:15 -0400)]
16221: Fix test for config endpoint.

x['configs'] raises KeyError on an old discovery doc -- test
x.get('configs', False) instead.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoFix instance IDs in arvados-dispatch-cloud log messages.
Tom Clegg [Wed, 11 Mar 2020 20:52:04 +0000 (16:52 -0400)]
Fix instance IDs in arvados-dispatch-cloud log messages.

Some logs had {"Instance": {}} instead of the provider's instance ID.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16270: Fill in missing scratch fields on InstanceType entries.
Tom Clegg [Wed, 1 Apr 2020 20:44:02 +0000 (16:44 -0400)]
16270: Fill in missing scratch fields on InstanceType entries.

Previously they were being filled in correctly when written as an
array in the config file, but not when written as a map.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoBump rake from 12.3.2 to 13.0.1 in /services/api
dependabot[bot] [Tue, 3 Mar 2020 21:27:27 +0000 (21:27 +0000)]
Bump rake from 12.3.2 to 13.0.1 in /services/api

Bumps [rake](https://github.com/ruby/rake) from 12.3.2 to 13.0.1.
- [Release notes](https://github.com/ruby/rake/releases)
- [Changelog](https://github.com/ruby/rake/blob/master/History.rdoc)
- [Commits](https://github.com/ruby/rake/compare/v12.3.2...v13.0.1)

Signed-off-by: dependabot[bot] <support@github.com>
4 years agoBump rake from 12.3.2 to 13.0.1 in /apps/workbench
dependabot[bot] [Tue, 3 Mar 2020 21:27:30 +0000 (21:27 +0000)]
Bump rake from 12.3.2 to 13.0.1 in /apps/workbench

Bumps [rake](https://github.com/ruby/rake) from 12.3.2 to 13.0.1.
- [Release notes](https://github.com/ruby/rake/releases)
- [Changelog](https://github.com/ruby/rake/blob/master/History.rdoc)
- [Commits](https://github.com/ruby/rake/compare/v12.3.2...v13.0.1)

Signed-off-by: dependabot[bot] <support@github.com>
4 years agoBump nokogiri from 1.10.4 to 1.10.8 in /apps/workbench
dependabot[bot] [Tue, 25 Feb 2020 08:04:58 +0000 (08:04 +0000)]
Bump nokogiri from 1.10.4 to 1.10.8 in /apps/workbench

Bumps [nokogiri](https://github.com/sparklemotion/nokogiri) from 1.10.4 to 1.10.8.
- [Release notes](https://github.com/sparklemotion/nokogiri/releases)
- [Changelog](https://github.com/sparklemotion/nokogiri/blob/master/CHANGELOG.md)
- [Commits](https://github.com/sparklemotion/nokogiri/compare/v1.10.4...v1.10.8)

Signed-off-by: dependabot[bot] <support@github.com>
4 years agoBump loofah from 2.2.3 to 2.3.1 in /apps/workbench
dependabot[bot] [Fri, 8 Nov 2019 21:48:47 +0000 (21:48 +0000)]
Bump loofah from 2.2.3 to 2.3.1 in /apps/workbench

Bumps [loofah](https://github.com/flavorjones/loofah) from 2.2.3 to 2.3.1.
- [Release notes](https://github.com/flavorjones/loofah/releases)
- [Changelog](https://github.com/flavorjones/loofah/blob/master/CHANGELOG.md)
- [Commits](https://github.com/flavorjones/loofah/compare/v2.2.3...v2.3.1)

Signed-off-by: dependabot[bot] <support@github.com>
4 years agoBump nokogiri from 1.10.2 to 1.10.8 in /services/api
dependabot[bot] [Tue, 25 Feb 2020 08:04:57 +0000 (08:04 +0000)]
Bump nokogiri from 1.10.2 to 1.10.8 in /services/api

Bumps [nokogiri](https://github.com/sparklemotion/nokogiri) from 1.10.2 to 1.10.8.
- [Release notes](https://github.com/sparklemotion/nokogiri/releases)
- [Changelog](https://github.com/sparklemotion/nokogiri/blob/master/CHANGELOG.md)
- [Commits](https://github.com/sparklemotion/nokogiri/compare/v1.10.2...v1.10.8)

Signed-off-by: dependabot[bot] <support@github.com>
4 years ago16266: Applies monkeypatch to fix CVE-2020-5267 on workbench1.
Lucas Di Pentima [Mon, 23 Mar 2020 21:07:56 +0000 (18:07 -0300)]
16266: Applies monkeypatch to fix CVE-2020-5267 on workbench1.

As adviced on https://github.com/advisories/GHSA-65cv-r6x7-79hv

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16266: Adds tests exposing potential XSS vulnerability on escape_javascript()
Lucas Di Pentima [Thu, 26 Mar 2020 16:29:40 +0000 (13:29 -0300)]
16266: Adds tests exposing potential XSS vulnerability on escape_javascript()

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16138: Remove additional/code references to copying pipelines
Peter Amstutz [Tue, 24 Mar 2020 19:35:38 +0000 (15:35 -0400)]
16138: Remove additional/code references to copying pipelines

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16138: Remove additional pipelines related code
Peter Amstutz [Mon, 23 Mar 2020 15:00:07 +0000 (11:00 -0400)]
16138: Remove additional pipelines related code

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16138: whitelist fields for arv-copy
Peter Amstutz [Fri, 20 Mar 2020 19:47:00 +0000 (15:47 -0400)]
16138: whitelist fields for arv-copy

Also removed code for copying
PipelineTemplate/PipelineInstance (obsolete jobs API).

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoRemove Gemfile.lock from login-sync 2.0.1
Peter Amstutz [Tue, 3 Mar 2020 21:17:38 +0000 (16:17 -0500)]
Remove Gemfile.lock from login-sync

no issue #

To be consistent with sdk/ruby sdk/cli behavior.

There's a circular dependency where the version number of the gem is
embedded in Gemfile.lock, but the version number is derived from the
git commit timestamp, so when it updates Gemfile.lock it creates a new
version, which requires a updating Gemfile.lock, and so on.

However, unlike the Ruby on Rails deb/rpm packages, when we create
gems (dev or production) it does not include Gemfile.lock, so there's
no benefit to having it checked in.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoRuby gems respect ARVADOS_BUILDING_VERSION
Peter Amstutz [Tue, 3 Mar 2020 20:34:05 +0000 (15:34 -0500)]
Ruby gems respect ARVADOS_BUILDING_VERSION

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoNodemanager and crunchstat-summary sync with pysdk version
Peter Amstutz [Thu, 27 Feb 2020 18:56:49 +0000 (13:56 -0500)]
Nodemanager and crunchstat-summary sync with pysdk version

refs #16151

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>