arvados.git
4 years agoMerge branch '16263-logincluster-user-list-fix' refs #16263
Peter Amstutz [Mon, 13 Apr 2020 14:42:47 +0000 (10:42 -0400)]
Merge branch '16263-logincluster-user-list-fix' refs #16263

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Add test for BypassFederation
Peter Amstutz [Mon, 13 Apr 2020 14:25:11 +0000 (10:25 -0400)]
16263: Add test for BypassFederation

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoFix tests.
Ward Vandewege [Fri, 10 Apr 2020 12:56:56 +0000 (08:56 -0400)]
Fix tests.

refs #16326

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years agoMerge branch '16326-doc-and-keepstore-update'
Ward Vandewege [Thu, 9 Apr 2020 22:29:13 +0000 (18:29 -0400)]
Merge branch '16326-doc-and-keepstore-update'

refs #16326

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years agodocumentation: update descriptions for MaxKeepBlobBuffers and MaxConcurrentRequests
Ward Vandewege [Thu, 9 Apr 2020 21:53:31 +0000 (17:53 -0400)]
documentation: update descriptions for MaxKeepBlobBuffers and MaxConcurrentRequests

keepstore: MaxConcurrentRequests set to zero should mean no limit

refs #16326

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years agoWarn if MaxKeepBlobBuffers > MaxConcurrentRequests.
Tom Clegg [Thu, 9 Apr 2020 20:58:36 +0000 (16:58 -0400)]
Warn if MaxKeepBlobBuffers > MaxConcurrentRequests.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '16212-pam-login'
Tom Clegg [Wed, 8 Apr 2020 14:11:23 +0000 (10:11 -0400)]
Merge branch '16212-pam-login'

refs #16212

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16212: Populate all api_client_auth fields.
Tom Clegg [Tue, 7 Apr 2020 21:26:46 +0000 (17:26 -0400)]
16212: Populate all api_client_auth fields.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '16053-install-deps'
Tom Clegg [Tue, 7 Apr 2020 19:25:16 +0000 (15:25 -0400)]
Merge branch '16053-install-deps'

refs #16053

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16053: Avoid using host's tmp/cache dir in railsapi.
Tom Clegg [Tue, 7 Apr 2020 14:32:48 +0000 (10:32 -0400)]
16053: Avoid using host's tmp/cache dir in railsapi.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '16217-ws-metrics'
Tom Clegg [Mon, 6 Apr 2020 19:54:34 +0000 (15:54 -0400)]
Merge branch '16217-ws-metrics'

refs #16217

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16263: Pulls from official git repo when running federation tests.
Lucas Di Pentima [Mon, 6 Apr 2020 14:01:18 +0000 (11:01 -0300)]
16263: Pulls from official git repo when running federation tests.

This is helpful to ask for specific branches that aren't published on github.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoMerge branch '16270-instance-type'
Tom Clegg [Thu, 2 Apr 2020 15:33:46 +0000 (11:33 -0400)]
Merge branch '16270-instance-type'

fixes #16270

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16263: User migration test also checks federated user behavior
Peter Amstutz [Thu, 2 Apr 2020 14:52:44 +0000 (10:52 -0400)]
16263: User migration test also checks federated user behavior

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16270: Fill in missing scratch fields on InstanceType entries.
Tom Clegg [Wed, 1 Apr 2020 20:44:02 +0000 (16:44 -0400)]
16270: Fill in missing scratch fields on InstanceType entries.

Previously they were being filled in correctly when written as an
array in the config file, but not when written as a map.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16217: Restore http.Hijacker capability to wrapped ResponseWriter.
Tom Clegg [Wed, 1 Apr 2020 17:42:43 +0000 (13:42 -0400)]
16217: Restore http.Hijacker capability to wrapped ResponseWriter.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16217: Fix test (satisfy additional handler interface).
Tom Clegg [Wed, 1 Apr 2020 17:42:08 +0000 (13:42 -0400)]
16217: Fix test (satisfy additional handler interface).

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16217: Update startup scripts to run "arvados-server ws".
Tom Clegg [Wed, 1 Apr 2020 15:59:06 +0000 (11:59 -0400)]
16217: Update startup scripts to run "arvados-server ws".

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16212: Return error for users/authenticate endpoint in SSO mode.
Tom Clegg [Wed, 1 Apr 2020 15:50:03 +0000 (11:50 -0400)]
16212: Return error for users/authenticate endpoint in SSO mode.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16212: Don't forward users/authenticate to Rails in legacy mode.
Tom Clegg [Wed, 1 Apr 2020 15:49:16 +0000 (11:49 -0400)]
16212: Don't forward users/authenticate to Rails in legacy mode.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16263: Tweak federation tests, use CWL 1.1
Peter Amstutz [Wed, 1 Apr 2020 01:03:42 +0000 (21:03 -0400)]
16263: Tweak federation tests, use CWL 1.1

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Add bypass_federation test
Peter Amstutz [Tue, 31 Mar 2020 21:42:03 +0000 (17:42 -0400)]
16263: Add bypass_federation test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Fix no_federation -> bypass_federation in boolParms
Peter Amstutz [Tue, 31 Mar 2020 21:16:57 +0000 (17:16 -0400)]
16263: Fix no_federation -> bypass_federation in boolParms

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Fix only_admin_can_bypass_federation
Peter Amstutz [Tue, 31 Mar 2020 21:12:31 +0000 (17:12 -0400)]
16263: Fix only_admin_can_bypass_federation

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16217: Update boot command to run ws via arvados-server.
Tom Clegg [Tue, 31 Mar 2020 20:55:16 +0000 (16:55 -0400)]
16217: Update boot command to run ws via arvados-server.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16217: Merge branch 'master'
Tom Clegg [Tue, 31 Mar 2020 20:51:35 +0000 (16:51 -0400)]
16217: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16263: Missed rename
Peter Amstutz [Tue, 31 Mar 2020 20:45:49 +0000 (16:45 -0400)]
16263: Missed rename

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Rename no_federation -> bypass_federation
Peter Amstutz [Tue, 31 Mar 2020 20:33:27 +0000 (16:33 -0400)]
16263: Rename no_federation -> bypass_federation

Enforce if bypass_federation is true that user is admin.

Update API revision and make federation migrate check for it.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Add no_federation to user update
Peter Amstutz [Tue, 31 Mar 2020 18:42:46 +0000 (14:42 -0400)]
16263: Add no_federation to user update

We might agree on a different API but try this and see if it helps
pass the test.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16053: Merge branch 'master'
Tom Clegg [Tue, 31 Mar 2020 17:52:23 +0000 (13:52 -0400)]
16053: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16053: Error out on unimplemented install in production mode.
Tom Clegg [Tue, 31 Mar 2020 17:51:31 +0000 (13:51 -0400)]
16053: Error out on unimplemented install in production mode.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16212: Merge branch 'master'
Tom Clegg [Tue, 31 Mar 2020 17:11:17 +0000 (13:11 -0400)]
16212: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16212: Upate generated default config.
Tom Clegg [Tue, 31 Mar 2020 17:10:06 +0000 (13:10 -0400)]
16212: Upate generated default config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16212: Fix propagation of logout redirect target.
Tom Clegg [Tue, 31 Mar 2020 17:08:32 +0000 (13:08 -0400)]
16212: Fix propagation of logout redirect target.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16212: Add clues/details to authentication error messages.
Tom Clegg [Tue, 31 Mar 2020 15:27:01 +0000 (11:27 -0400)]
16212: Add clues/details to authentication error messages.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16212: Make test timeout more predictable by pulling image first.
Tom Clegg [Tue, 31 Mar 2020 15:26:01 +0000 (11:26 -0400)]
16212: Make test timeout more predictable by pulling image first.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16212: Ensure added user doesn't prevent subsequent database reset.
Tom Clegg [Tue, 31 Mar 2020 14:32:17 +0000 (10:32 -0400)]
16212: Ensure added user doesn't prevent subsequent database reset.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16263: local_user_list -> no_federation in boolParams
Peter Amstutz [Tue, 31 Mar 2020 02:30:10 +0000 (22:30 -0400)]
16263: local_user_list -> no_federation in boolParams

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Generalize "local_user_list" flag to "no_federation"
Peter Amstutz [Tue, 31 Mar 2020 02:14:23 +0000 (22:14 -0400)]
16263: Generalize "local_user_list" flag to "no_federation"

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16212: Disallow overriding HTTP method on GET requests.
Tom Clegg [Mon, 30 Mar 2020 21:26:40 +0000 (17:26 -0400)]
16212: Disallow overriding HTTP method on GET requests.

Removes an opportunity to circumvent CORS restrictions.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16212: Fix wrong API endpoint for users/batch_update.
Tom Clegg [Mon, 30 Mar 2020 21:26:22 +0000 (17:26 -0400)]
16212: Fix wrong API endpoint for users/batch_update.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16212: Move user/pass authentication to its own endpoint.
Tom Clegg [Mon, 30 Mar 2020 21:26:13 +0000 (17:26 -0400)]
16212: Move user/pass authentication to its own endpoint.

Overloading the /login endpoint turns out to be too awkward: method,
CORS permissions, and response type are all different.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16263: UserMerge shouldn't be federated
Peter Amstutz [Mon, 30 Mar 2020 21:12:17 +0000 (17:12 -0400)]
16263: UserMerge shouldn't be federated

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Fix omitempty placement
Peter Amstutz [Mon, 30 Mar 2020 18:50:06 +0000 (14:50 -0400)]
16263: Fix omitempty placement

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Add omitempty to GetOptions
Peter Amstutz [Mon, 30 Mar 2020 18:43:36 +0000 (14:43 -0400)]
16263: Add omitempty to GetOptions

Don't try to migrate if activate_remote_user fails.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16212: Allow X-Http-Method-Override header in CORS requests.
Tom Clegg [Mon, 30 Mar 2020 16:44:53 +0000 (12:44 -0400)]
16212: Allow X-Http-Method-Override header in CORS requests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16263: Add local_user_list to boolParams
Peter Amstutz [Sat, 28 Mar 2020 01:36:09 +0000 (21:36 -0400)]
16263: Add local_user_list to boolParams

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Add local_user_list flag to bypass LoginCluster behavior
Peter Amstutz [Fri, 27 Mar 2020 21:08:48 +0000 (17:08 -0400)]
16263: Add local_user_list flag to bypass LoginCluster behavior

Required by federation migrate script.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '16265-security-updates'
Lucas Di Pentima [Fri, 27 Mar 2020 15:04:07 +0000 (12:04 -0300)]
Merge branch '16265-security-updates'
Closes #16265

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoMerge branch '16266-wb1-xss-fix'
Lucas Di Pentima [Fri, 27 Mar 2020 14:21:36 +0000 (11:21 -0300)]
Merge branch '16266-wb1-xss-fix'
Closes #16266

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16212: Return 401 or 500 instead of 200 on authentication failure.
Tom Clegg [Thu, 26 Mar 2020 18:31:18 +0000 (14:31 -0400)]
16212: Return 401 or 500 instead of 200 on authentication failure.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16265: Merge branch 'dependabot/bundler/services/api/nokogiri-1.10.8' into 16265...
Lucas Di Pentima [Thu, 26 Mar 2020 17:02:40 +0000 (14:02 -0300)]
16265: Merge branch 'dependabot/bundler/services/api/nokogiri-1.10.8' into 16265-security-updates

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoMerge branch '16265-security-updates' into dependabot/bundler/services/api/nokogiri...
Lucas Di Pentima [Thu, 26 Mar 2020 17:02:24 +0000 (14:02 -0300)]
Merge branch '16265-security-updates' into dependabot/bundler/services/api/nokogiri-1.10.8

4 years ago16265: Merge branch 'dependabot/bundler/apps/workbench/loofah-2.3.1' into 16265-secur...
Lucas Di Pentima [Thu, 26 Mar 2020 16:59:58 +0000 (13:59 -0300)]
16265: Merge branch 'dependabot/bundler/apps/workbench/loofah-2.3.1' into 16265-security-updates

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoMerge branch '16265-security-updates' into dependabot/bundler/apps/workbench/loofah...
Lucas Di Pentima [Thu, 26 Mar 2020 16:59:19 +0000 (13:59 -0300)]
Merge branch '16265-security-updates' into dependabot/bundler/apps/workbench/loofah-2.3.1

4 years ago16265: Merge branch 'dependabot/bundler/apps/workbench/nokogiri-1.10.8' into 16265...
Lucas Di Pentima [Thu, 26 Mar 2020 16:56:37 +0000 (13:56 -0300)]
16265: Merge branch 'dependabot/bundler/apps/workbench/nokogiri-1.10.8' into 16265-security-updates

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoMerge branch '16265-security-updates' into dependabot/bundler/apps/workbench/nokogiri...
Lucas Di Pentima [Thu, 26 Mar 2020 16:56:18 +0000 (13:56 -0300)]
Merge branch '16265-security-updates' into dependabot/bundler/apps/workbench/nokogiri-1.10.8

4 years ago16265: Merge branch 'dependabot/bundler/apps/workbench/rake-13.0.1' into 16265-securi...
Lucas Di Pentima [Thu, 26 Mar 2020 16:54:26 +0000 (13:54 -0300)]
16265: Merge branch 'dependabot/bundler/apps/workbench/rake-13.0.1' into 16265-security-updates

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoMerge branch '16265-security-updates' into dependabot/bundler/apps/workbench/rake...
Lucas Di Pentima [Thu, 26 Mar 2020 16:54:07 +0000 (13:54 -0300)]
Merge branch '16265-security-updates' into dependabot/bundler/apps/workbench/rake-13.0.1

4 years ago16265: Merge branch 'dependabot/bundler/services/api/rake-13.0.1' into 16265-security...
Lucas Di Pentima [Thu, 26 Mar 2020 16:46:52 +0000 (13:46 -0300)]
16265: Merge branch 'dependabot/bundler/services/api/rake-13.0.1' into 16265-security-updates

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoMerge branch '16265-security-updates' into dependabot/bundler/services/api/rake-13.0.1
Lucas Di Pentima [Thu, 26 Mar 2020 16:45:27 +0000 (13:45 -0300)]
Merge branch '16265-security-updates' into dependabot/bundler/services/api/rake-13.0.1

4 years ago16266: Applies monkeypatch to fix CVE-2020-5267 on workbench1.
Lucas Di Pentima [Mon, 23 Mar 2020 21:07:56 +0000 (18:07 -0300)]
16266: Applies monkeypatch to fix CVE-2020-5267 on workbench1.

As adviced on https://github.com/advisories/GHSA-65cv-r6x7-79hv

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16266: Adds tests exposing potential XSS vulnerability on escape_javascript()
Lucas Di Pentima [Thu, 26 Mar 2020 16:29:40 +0000 (13:29 -0300)]
16266: Adds tests exposing potential XSS vulnerability on escape_javascript()

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16212: Build arvados-server binary for test.
Tom Clegg [Thu, 26 Mar 2020 16:25:37 +0000 (12:25 -0400)]
16212: Build arvados-server binary for test.

On a dev system, the one in $GOPATH/bin might be a different version.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16217: Update docs.
Tom Clegg [Thu, 26 Mar 2020 15:24:31 +0000 (11:24 -0400)]
16217: Update docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16263: Decodes JSON numbers as strings instead of float64.
Lucas Di Pentima [Thu, 26 Mar 2020 14:46:34 +0000 (11:46 -0300)]
16263: Decodes JSON numbers as strings instead of float64.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16217: Remove old status/debug endpoints, test /metrics instead.
Tom Clegg [Wed, 25 Mar 2020 20:54:59 +0000 (16:54 -0400)]
16217: Remove old status/debug endpoints, test /metrics instead.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16217: Add prometheus metrics.
Tom Clegg [Wed, 25 Mar 2020 20:23:41 +0000 (16:23 -0400)]
16217: Add prometheus metrics.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16263: Adds unit test case confirming 'limit' bug.
Lucas Di Pentima [Wed, 25 Mar 2020 19:35:18 +0000 (16:35 -0300)]
16263: Adds unit test case confirming 'limit' bug.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16053: Specify utf8 encoding when creating databases.
Tom Clegg [Wed, 25 Mar 2020 18:57:42 +0000 (14:57 -0400)]
16053: Specify utf8 encoding when creating databases.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '16138-fix-arv-copy' refs #16138
Peter Amstutz [Wed, 25 Mar 2020 18:35:51 +0000 (14:35 -0400)]
Merge branch '16138-fix-arv-copy' refs #16138

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch 'Majewski/feature/links-client' refs #16260
Peter Amstutz [Wed, 25 Mar 2020 17:53:25 +0000 (13:53 -0400)]
Merge branch 'Majewski/feature/links-client' refs #16260

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16217: Exit service command if the service handler fails.
Tom Clegg [Wed, 25 Mar 2020 15:28:25 +0000 (11:28 -0400)]
16217: Exit service command if the service handler fails.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16217: Refactor ws to use lib/service.
Tom Clegg [Wed, 25 Mar 2020 15:00:03 +0000 (11:00 -0400)]
16217: Refactor ws to use lib/service.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16263: Adds test exposing a bug when using 'limit' with the max int64 value.
Lucas Di Pentima [Wed, 25 Mar 2020 14:26:55 +0000 (11:26 -0300)]
16263: Adds test exposing a bug when using 'limit' with the max int64 value.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16263: Bool filter bug fix.
Lucas Di Pentima [Tue, 24 Mar 2020 20:39:01 +0000 (17:39 -0300)]
16263: Bool filter bug fix.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16263: Adds test exposing a bug on filter unmarshalling.
Lucas Di Pentima [Tue, 24 Mar 2020 21:03:34 +0000 (18:03 -0300)]
16263: Adds test exposing a bug on filter unmarshalling.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16053: Add ca-certificates to deps.
Tom Clegg [Tue, 24 Mar 2020 19:40:59 +0000 (15:40 -0400)]
16053: Add ca-certificates to deps.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16053: Add example script for installing from scratch.
Tom Clegg [Tue, 24 Mar 2020 16:12:30 +0000 (12:12 -0400)]
16053: Add example script for installing from scratch.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16053: Add scripts for running tests in docker.
Tom Clegg [Tue, 24 Mar 2020 16:03:36 +0000 (12:03 -0400)]
16053: Add scripts for running tests in docker.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16138: Remove additional/code references to copying pipelines
Peter Amstutz [Tue, 24 Mar 2020 19:35:38 +0000 (15:35 -0400)]
16138: Remove additional/code references to copying pipelines

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoRemove python2 arvados-cwl-runner package build, only python3
Peter Amstutz [Tue, 24 Mar 2020 17:23:01 +0000 (13:23 -0400)]
Remove python2 arvados-cwl-runner package build, only python3

refs #12409

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16053: Fix check for installed bundler versions.
Tom Clegg [Mon, 23 Mar 2020 21:40:29 +0000 (17:40 -0400)]
16053: Fix check for installed bundler versions.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16053: Fix test for already-installed en_US.UTF-8 locale.
Tom Clegg [Mon, 23 Mar 2020 20:30:55 +0000 (16:30 -0400)]
16053: Fix test for already-installed en_US.UTF-8 locale.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15063: Fix tests to accommodate curl speed check granularity.
Tom Clegg [Mon, 23 Mar 2020 19:21:44 +0000 (15:21 -0400)]
15063: Fix tests to accommodate curl speed check granularity.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16263: Makes gofmt happy.
Lucas Di Pentima [Mon, 23 Mar 2020 19:20:41 +0000 (16:20 -0300)]
16263: Makes gofmt happy.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16263: Don't cache modified_by_*_uuid fields when using LoginCluster.
Lucas Di Pentima [Mon, 23 Mar 2020 18:32:59 +0000 (15:32 -0300)]
16263: Don't cache modified_by_*_uuid fields when using LoginCluster.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16053: Fix keepstore tests that fail when running as root.
Tom Clegg [Mon, 23 Mar 2020 18:19:10 +0000 (14:19 -0400)]
16053: Fix keepstore tests that fail when running as root.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16053: Upgrade mockito for JDK 11 compatibility.
Tom Clegg [Mon, 23 Mar 2020 18:02:57 +0000 (14:02 -0400)]
16053: Upgrade mockito for JDK 11 compatibility.

Fixes:

17:19:59.486 [DEBUG] [TestEventLogger] org.arvados.client.logic.keep.FileDownloaderTest STARTED
17:19:59.573 [DEBUG] [TestEventLogger]
17:19:59.573 [DEBUG] [TestEventLogger] org.arvados.client.logic.keep.FileDownloaderTest > classMethod STARTED
17:19:59.593 [DEBUG] [TestEventLogger]
17:19:59.594 [DEBUG] [TestEventLogger] org.arvados.client.logic.keep.FileDownloaderTest > classMethod FAILED
17:19:59.594 [DEBUG] [TestEventLogger]     org.mockito.exceptions.base.MockitoException:
17:19:59.594 [DEBUG] [TestEventLogger]     Mockito cannot mock this class: class org.arvados.client.api.client.CollectionsApiClient.
17:19:59.594 [DEBUG] [TestEventLogger]
17:19:59.594 [DEBUG] [TestEventLogger]     If you're not sure why you're getting this error, please report to the mailing list.
17:19:59.594 [DEBUG] [TestEventLogger]
17:19:59.594 [DEBUG] [TestEventLogger]
17:19:59.594 [DEBUG] [TestEventLogger]     Java               : 11
17:19:59.595 [DEBUG] [TestEventLogger]     JVM vendor name    : Debian
17:19:59.595 [DEBUG] [TestEventLogger]     JVM vendor version : 11.0.6+10-post-Debian-1deb10u1
17:19:59.595 [DEBUG] [TestEventLogger]     JVM name           : OpenJDK 64-Bit Server VM
17:19:59.595 [DEBUG] [TestEventLogger]     JVM version        : 11.0.6+10-post-Debian-1deb10u1
17:19:59.595 [DEBUG] [TestEventLogger]     JVM info           : mixed mode, sharing
17:19:59.595 [DEBUG] [TestEventLogger]     OS name            : Linux
17:19:59.595 [DEBUG] [TestEventLogger]     OS version         : 4.9.0-12-amd64
17:19:59.595 [DEBUG] [TestEventLogger]
17:19:59.595 [DEBUG] [TestEventLogger]
17:19:59.595 [DEBUG] [TestEventLogger]     You are seeing this disclaimer because Mockito is configured to create inlined mocks.
17:19:59.595 [DEBUG] [TestEventLogger]     You can learn about inline mocks and their limitations under item #39 of the Mockito class javadoc.
17:19:59.595 [DEBUG] [TestEventLogger]
17:19:59.595 [DEBUG] [TestEventLogger]     Underlying exception : org.mockito.exceptions.base.MockitoException: Could not modify all classes [class java.lang.Object, class org.arvados.client.api.client.BaseApiClient, class org.arvados.client.api.client.CollectionsApiClient, class org.arvados.client.api.client.BaseStandardApiClient]
17:19:59.595 [DEBUG] [TestEventLogger]         at org.mockito.internal.runners.DefaultInternalRunner$1.withBefores(DefaultInternalRunner.java:38)

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16053: Pass along test args to gradle in java-v2 test suite.
Tom Clegg [Mon, 23 Mar 2020 16:42:14 +0000 (12:42 -0400)]
16053: Pass along test args to gradle in java-v2 test suite.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16053: Install java runtime and jdk.
Tom Clegg [Mon, 23 Mar 2020 16:39:37 +0000 (12:39 -0400)]
16053: Install java runtime and jdk.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16263: Adds nullify behavior to users's batch_update endpoint.
Lucas Di Pentima [Mon, 23 Mar 2020 15:27:18 +0000 (12:27 -0300)]
16263: Adds nullify behavior to users's batch_update endpoint.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16138: Remove additional pipelines related code
Peter Amstutz [Mon, 23 Mar 2020 15:00:07 +0000 (11:00 -0400)]
16138: Remove additional pipelines related code

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16053: Install gradle.
Tom Clegg [Fri, 20 Mar 2020 21:04:38 +0000 (17:04 -0400)]
16053: Install gradle.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16138: whitelist fields for arv-copy
Peter Amstutz [Fri, 20 Mar 2020 19:47:00 +0000 (15:47 -0400)]
16138: whitelist fields for arv-copy

Also removed code for copying
PipelineTemplate/PipelineInstance (obsolete jobs API).

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Assigns nil to select attributes when receiving empty values.
Lucas Di Pentima [Thu, 19 Mar 2020 21:15:52 +0000 (18:15 -0300)]
16263: Assigns nil to select attributes when receiving empty values.

Controller may translate NULL values to "" on certain object string fields.
The same with integers, NULLs are converted to 0.
When controller retrieves objects from railsAPI and uses the data to create
or update objects, some of those fields should get converted back to NULL.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16053: Fix warnings when installer cwd is not readable by postgres.
Tom Clegg [Thu, 19 Mar 2020 20:29:50 +0000 (16:29 -0400)]
16053: Fix warnings when installer cwd is not readable by postgres.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16053: Fix permissions for test db user.
Tom Clegg [Thu, 19 Mar 2020 18:57:26 +0000 (14:57 -0400)]
16053: Fix permissions for test db user.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16053: Run initdb, start postgresql, and add arvados user if needed.
Tom Clegg [Thu, 19 Mar 2020 17:35:23 +0000 (13:35 -0400)]
16053: Run initdb, start postgresql, and add arvados user if needed.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16053: Install all three needed versions of bundler.
Tom Clegg [Thu, 19 Mar 2020 17:34:57 +0000 (13:34 -0400)]
16053: Install all three needed versions of bundler.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>