arvados.git
5 years agoReplaced call to non-existent method execute in RESTService class with
Fuad Muhic [Thu, 10 May 2018 09:05:29 +0000 (11:05 +0200)]
Replaced call to non-existent method execute in RESTService class with
correct call to exec method.

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

5 years agoMerge branch '12737-api-security-deps-fixes'
Lucas Di Pentima [Wed, 9 May 2018 18:19:10 +0000 (15:19 -0300)]
Merge branch '12737-api-security-deps-fixes'
Refs #12737

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoFix subprocess32 version constraint, refs #13435
Peter Amstutz [Wed, 9 May 2018 17:53:11 +0000 (13:53 -0400)]
Fix subprocess32 version constraint, refs #13435

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoAvoid copying mutex after first use.
Tom Clegg [Wed, 9 May 2018 17:47:11 +0000 (13:47 -0400)]
Avoid copying mutex after first use.

refs #13455

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoAvoid http client race in test case.
Tom Clegg [Wed, 9 May 2018 17:11:55 +0000 (13:11 -0400)]
Avoid http client race in test case.

If we don't wait for Put() to return before returning from the test
case, CloseIdleConnections can cause Put() to fail, and the resulting
call to t.Error() panics the testing package.

"errType *url.Error, err Put
http://fakeaccountname.blob.127.0.0.1:42861/fakecontainername/e4d909c290d0fb1ca068ffaddf22cbd0:
net/http: HTTP/1.x transport connection broken: http:
CloseIdleConnections called"

"panic: Fail in goroutine after TestAzureBlobVolumeCreateBlobRace has completed"

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago12737: Updated gem dependencies, adressing a couple of known vulnerabilities.
Lucas Di Pentima [Wed, 9 May 2018 17:03:04 +0000 (14:03 -0300)]
12737: Updated gem dependencies, adressing a couple of known vulnerabilities.

* https://nvd.nist.gov/vuln/detail/CVE-2018-3741
* https://github.com/flavorjones/loofah/issues/144

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoMerge branch '12626-merge-accounts'
Tom Clegg [Tue, 8 May 2018 13:30:15 +0000 (09:30 -0400)]
Merge branch '12626-merge-accounts'

refs #12626

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoFix run script syntax.
Tom Clegg [Tue, 8 May 2018 13:06:20 +0000 (09:06 -0400)]
Fix run script syntax.

fixes #8348

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago12626: Merge branch 'master' into 12626-merge-accounts
Tom Clegg [Mon, 7 May 2018 22:14:16 +0000 (18:14 -0400)]
12626: Merge branch 'master' into 12626-merge-accounts

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoTweak tests for slightly different ruamel.yaml behavior, refs #13435
Peter Amstutz [Mon, 7 May 2018 19:37:28 +0000 (15:37 -0400)]
Tweak tests for slightly different ruamel.yaml behavior, refs #13435

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago12626: Copy omniauth info into auth account, not target account.
Tom Clegg [Mon, 7 May 2018 19:11:58 +0000 (15:11 -0400)]
12626: Copy omniauth info into auth account, not target account.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago12626: Update permission graph after user merge.
Tom Clegg [Mon, 7 May 2018 19:10:24 +0000 (15:10 -0400)]
12626: Update permission graph after user merge.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '13435-ruamel-yaml-ver' closes #13435
Peter Amstutz [Mon, 7 May 2018 18:46:11 +0000 (14:46 -0400)]
Merge branch '13435-ruamel-yaml-ver' closes #13435

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13435: Build scandir to satisfy pathlib2 dependency of a-c-r
Peter Amstutz [Mon, 7 May 2018 14:59:58 +0000 (10:59 -0400)]
13435: Build scandir to satisfy pathlib2 dependency of a-c-r

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13435: Update ruamel.yaml and ciso8601 versions.
Peter Amstutz [Mon, 7 May 2018 14:20:57 +0000 (10:20 -0400)]
13435: Update ruamel.yaml and ciso8601 versions.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '13278-launch-failed'
Tom Clegg [Mon, 7 May 2018 14:40:17 +0000 (10:40 -0400)]
Merge branch '13278-launch-failed'

refs #13278
refs #13399

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13278: Release jobs that are pending because "launch failed".
Tom Clegg [Tue, 27 Mar 2018 17:01:38 +0000 (13:01 -0400)]
13278: Release jobs that are pending because "launch failed".

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '13365-default-secondaryFiles' refs #13365
Peter Amstutz [Mon, 7 May 2018 13:49:30 +0000 (09:49 -0400)]
Merge branch '13365-default-secondaryFiles' refs #13365

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '13383-trash-workers'
Tom Clegg [Mon, 7 May 2018 13:31:57 +0000 (09:31 -0400)]
Merge branch '13383-trash-workers'

closes #13383
refs #13335

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13383: Implement EmptyTrashWorkers in azure and filesystem backends.
Tom Clegg [Fri, 4 May 2018 20:48:50 +0000 (16:48 -0400)]
13383: Implement EmptyTrashWorkers in azure and filesystem backends.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13383: Fix warning about expected 404 error.
Tom Clegg [Tue, 24 Apr 2018 21:03:50 +0000 (17:03 -0400)]
13383: Fix warning about expected 404 error.

The expected error (object not found immediately after deleting it)
was being logged as a warning, and the warning erroneously stated the
error was from "HEAD recent/X" rather than "HEAD X".

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13383: Add PullWorkers, TrashWorkers, EmptyTrashWorkers configs.
Tom Clegg [Tue, 24 Apr 2018 20:32:24 +0000 (16:32 -0400)]
13383: Add PullWorkers, TrashWorkers, EmptyTrashWorkers configs.

EmptyTrashWorkers only applies to S3 volumes.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '12167-go-request-id'
Tom Clegg [Fri, 4 May 2018 19:47:13 +0000 (15:47 -0400)]
Merge branch '12167-go-request-id'

refs #12167

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch 'tests-cleanup'
Tom Clegg [Fri, 4 May 2018 19:44:56 +0000 (15:44 -0400)]
Merge branch 'tests-cleanup'

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago12626: Add tests for missing new_owner_uuid.
Tom Clegg [Fri, 4 May 2018 19:19:14 +0000 (15:19 -0400)]
12626: Add tests for missing new_owner_uuid.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago12626: Advertise required params for users#merge in discovery doc.
Tom Clegg [Fri, 4 May 2018 19:09:46 +0000 (15:09 -0400)]
12626: Advertise required params for users#merge in discovery doc.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago12626: Improve error message.
Tom Clegg [Fri, 4 May 2018 19:09:36 +0000 (15:09 -0400)]
12626: Improve error message.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago12626: Change variable dst_user -> new_user for consistency.
Tom Clegg [Fri, 4 May 2018 18:59:41 +0000 (14:59 -0400)]
12626: Change variable dst_user -> new_user for consistency.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago12626: Be more selective/explicit about changing various UUIDs.
Tom Clegg [Fri, 4 May 2018 18:56:23 +0000 (14:56 -0400)]
12626: Be more selective/explicit about changing various UUIDs.

Update comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago12626: Update pg_terminate_backend recipe for PostgreSQL >= 9.2.
Tom Clegg [Fri, 4 May 2018 18:41:39 +0000 (14:41 -0400)]
12626: Update pg_terminate_backend recipe for PostgreSQL >= 9.2.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoAvoid broken llfuse 1.3.4 ("pip install" fails).
Tom Clegg [Fri, 4 May 2018 17:26:04 +0000 (13:26 -0400)]
Avoid broken llfuse 1.3.4 ("pip install" fails).

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13365: Remove check for callback that now happens in a different place.
Peter Amstutz [Fri, 4 May 2018 14:50:52 +0000 (10:50 -0400)]
13365: Remove check for callback that now happens in a different place.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13365: Add tests to confirm regressions are fixed.
Peter Amstutz [Fri, 4 May 2018 14:29:44 +0000 (10:29 -0400)]
13365: Add tests to confirm regressions are fixed.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13365: clean up discover_secondary_files
Peter Amstutz [Fri, 4 May 2018 14:13:05 +0000 (10:13 -0400)]
13365: clean up discover_secondary_files

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13365: Fix state logging
Peter Amstutz [Thu, 3 May 2018 20:18:12 +0000 (16:18 -0400)]
13365: Fix state logging

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoSkip some unnecessary pip invocations.
Tom Clegg [Thu, 3 May 2018 20:09:37 +0000 (16:09 -0400)]
Skip some unnecessary pip invocations.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13365: Further fixes to ensure output callback only happens once
Peter Amstutz [Thu, 3 May 2018 19:48:16 +0000 (15:48 -0400)]
13365: Further fixes to ensure output callback only happens once

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoFix gopath/govendor recipe.
Tom Clegg [Wed, 25 Apr 2018 17:31:11 +0000 (13:31 -0400)]
Fix gopath/govendor recipe.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoSkip explicit libcloud preinstall when not using a fork.
Tom Clegg [Wed, 25 Apr 2018 17:30:27 +0000 (13:30 -0400)]
Skip explicit libcloud preinstall when not using a fork.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoFix wrong temp path in govendor recipe.
Tom Clegg [Sun, 8 Apr 2018 00:49:21 +0000 (20:49 -0400)]
Fix wrong temp path in govendor recipe.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoUse released version of llfuse for tests.
Tom Clegg [Sun, 8 Apr 2018 00:48:03 +0000 (20:48 -0400)]
Use released version of llfuse for tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago12167: Test X-Request-ID headers.
Tom Clegg [Thu, 3 May 2018 18:24:45 +0000 (14:24 -0400)]
12167: Test X-Request-ID headers.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago12167: Generate only one request ID per get/put.
Tom Clegg [Thu, 3 May 2018 18:03:40 +0000 (14:03 -0400)]
12167: Generate only one request ID per get/put.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13365: Fix race condition between job submitted and event monitor threads
Peter Amstutz [Thu, 3 May 2018 17:46:57 +0000 (13:46 -0400)]
13365: Fix race condition between job submitted and event monitor threads

Don't call "done" if work reuse means a container request or job
immediately comes back as Completed because it might get called
twice.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '13365-note-bug-in-docs' refs #13365
Peter Amstutz [Thu, 3 May 2018 17:07:31 +0000 (13:07 -0400)]
Merge branch '13365-note-bug-in-docs' refs #13365

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13365: Add example error messages and highlight the changes.
Peter Amstutz [Thu, 3 May 2018 15:13:38 +0000 (11:13 -0400)]
13365: Add example error messages and highlight the changes.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago12167: Generate a new request ID if caller explicitly uses "".
Tom Clegg [Thu, 3 May 2018 14:21:05 +0000 (10:21 -0400)]
12167: Generate a new request ID if caller explicitly uses "".

Skip invoking unique ID generator if ID is already set.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago12167: Merge branch 'master'
Tom Clegg [Thu, 3 May 2018 14:10:11 +0000 (10:10 -0400)]
12167: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago12626: Log UUID of auth record (if any) instead of supplied token.
Tom Clegg [Thu, 3 May 2018 14:05:40 +0000 (10:05 -0400)]
12626: Log UUID of auth record (if any) instead of supplied token.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13365: Bump cwltool, 3rd party package versions.
Peter Amstutz [Wed, 2 May 2018 23:49:12 +0000 (19:49 -0400)]
13365: Bump cwltool, 3rd party package versions.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago12626: Check for scoped tokens.
Tom Clegg [Wed, 2 May 2018 20:54:45 +0000 (16:54 -0400)]
12626: Check for scoped tokens.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago12626: Add arvados/v1/users/merge API.
Tom Clegg [Wed, 2 May 2018 20:12:15 +0000 (16:12 -0400)]
12626: Add arvados/v1/users/merge API.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13365: Bump schema-salad for better error formatting.
Peter Amstutz [Tue, 1 May 2018 21:37:02 +0000 (17:37 -0400)]
13365: Bump schema-salad for better error formatting.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoBump cwltool version for secondaryFile checker support.
Peter Amstutz [Tue, 1 May 2018 20:30:02 +0000 (16:30 -0400)]
Bump cwltool version for secondaryFile checker support.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13365: Reintroduce secondaryFile discovery.
Peter Amstutz [Tue, 1 May 2018 20:09:38 +0000 (16:09 -0400)]
13365: Reintroduce secondaryFile discovery.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13365: Discover secondaryFiles associated with default files inputs
Peter Amstutz [Tue, 17 Apr 2018 19:23:46 +0000 (15:23 -0400)]
13365: Discover secondaryFiles associated with default files inputs

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '13111-no-anonymous-sitefs'
Tom Clegg [Tue, 1 May 2018 18:06:15 +0000 (14:06 -0400)]
Merge branch '13111-no-anonymous-sitefs'

refs #13111

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '13338-wb-run-wf-proj' refs #13338
Peter Amstutz [Tue, 1 May 2018 17:35:05 +0000 (13:35 -0400)]
Merge branch '13338-wb-run-wf-proj' refs #13338

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago12167: Pass request ID via keepclient instead of custom code.
Tom Clegg [Tue, 1 May 2018 15:16:47 +0000 (11:16 -0400)]
12167: Pass request ID via keepclient instead of custom code.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoFix #ZgotmplZ in dir listing page when filename contains a colon.
Tom Clegg [Mon, 30 Apr 2018 14:03:11 +0000 (10:03 -0400)]
Fix #ZgotmplZ in dir listing page when filename contains a colon.

refs #8784

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13365: Tweak text.
Peter Amstutz [Mon, 30 Apr 2018 21:31:47 +0000 (17:31 -0400)]
13365: Tweak text.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13365: Update release notes about a-c-r bug in v1.1.4.
Peter Amstutz [Mon, 30 Apr 2018 21:29:36 +0000 (17:29 -0400)]
13365: Update release notes about a-c-r bug in v1.1.4.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoFix wrong event_type when getting buffered live logs for crunch2.
Tom Clegg [Mon, 30 Apr 2018 20:37:12 +0000 (16:37 -0400)]
Fix wrong event_type when getting buffered live logs for crunch2.

refs #12690

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13111: Disable siteFS routes for anonymous requests.
Tom Clegg [Fri, 27 Apr 2018 20:45:28 +0000 (16:45 -0400)]
13111: Disable siteFS routes for anonymous requests.

This enables dav clients to use HTTP authentication even when
anonymous tokens are configured.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoDocumentation: update PostgreSQL installation instructions
Ward Vandewege [Fri, 27 Apr 2018 15:46:02 +0000 (11:46 -0400)]
Documentation: update PostgreSQL installation instructions

refs #13165

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoNode manager integration test writes to stderr in chunks.
Peter Amstutz [Fri, 27 Apr 2018 15:51:51 +0000 (11:51 -0400)]
Node manager integration test writes to stderr in chunks.

Handles EAGAIN when getting pipe buffer backpressure.  no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoAvoid dangling child procs in test suite.
Tom Clegg [Thu, 26 Apr 2018 20:51:53 +0000 (16:51 -0400)]
Avoid dangling child procs in test suite.

In go 1.10.1, these seem to make "go test" hang sometimes.

https://github.com/golang/go/issues/24050

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13338: Running workflow from workbench puts collections in correct project.
Peter Amstutz [Thu, 26 Apr 2018 20:45:01 +0000 (16:45 -0400)]
13338: Running workflow from workbench puts collections in correct project.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13377-block-sig-time' refs #13377
Peter Amstutz [Thu, 26 Apr 2018 20:11:37 +0000 (16:11 -0400)]
Merge branch '13377-block-sig-time' refs #13377

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13377: Ensure that collection fetched by PDH has longest available lifetime.
Peter Amstutz [Thu, 26 Apr 2018 20:00:11 +0000 (16:00 -0400)]
13377: Ensure that collection fetched by PDH has longest available lifetime.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '12708-balance-storage-classes'
Tom Clegg [Thu, 26 Apr 2018 19:34:06 +0000 (15:34 -0400)]
Merge branch '12708-balance-storage-classes'

refs #12708

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13399-log-low-priority'
Tom Clegg [Thu, 26 Apr 2018 19:30:03 +0000 (15:30 -0400)]
Merge branch '13399-log-low-priority'

refs #13399

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13399: Log when a slurm job's priority is unrealistically low.
Tom Clegg [Thu, 26 Apr 2018 18:54:24 +0000 (14:54 -0400)]
13399: Log when a slurm job's priority is unrealistically low.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13282-admin-docs' refs #13282
Peter Amstutz [Thu, 26 Apr 2018 18:30:29 +0000 (14:30 -0400)]
Merge branch '13282-admin-docs' refs #13282

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13282: doc updates
Peter Amstutz [Thu, 26 Apr 2018 18:13:27 +0000 (14:13 -0400)]
13282: doc updates

* Improve presentation of R SDK
* Move obsolete crunch1 documentation to "Obsolete" section.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12708: Merge branch 'master' into 12708-balance-storage-classes
Tom Clegg [Thu, 26 Apr 2018 17:14:38 +0000 (13:14 -0400)]
12708: Merge branch 'master' into 12708-balance-storage-classes

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12708: TODO notes about memory use and class combinations.
Tom Clegg [Thu, 26 Apr 2018 17:10:04 +0000 (13:10 -0400)]
12708: TODO notes about memory use and class combinations.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13282: Add note about supported platforms to install guide.
Peter Amstutz [Tue, 10 Apr 2018 15:22:11 +0000 (11:22 -0400)]
13282: Add note about supported platforms to install guide.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13282: Remove some obsolete crunchv1 documenation from python sdk.
Peter Amstutz [Tue, 10 Apr 2018 14:24:12 +0000 (10:24 -0400)]
13282: Remove some obsolete crunchv1 documenation from python sdk.

Fix formatting of "websocket events" page.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13282: Add architecture section
Peter Amstutz [Tue, 10 Apr 2018 14:19:45 +0000 (10:19 -0400)]
13282: Add architecture section

Also commented out obsolete documentation pages about using
crunchv1 (which have already been marked deprecated for a long time).

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13282: First pass at reorganizing
Peter Amstutz [Wed, 28 Mar 2018 19:06:58 +0000 (15:06 -0400)]
13282: First pass at reorganizing

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12708: Precompute len(slots) to reduce mallocs. Rename setupCaches.
Tom Clegg [Thu, 26 Apr 2018 17:09:29 +0000 (13:09 -0400)]
12708: Precompute len(slots) to reduce mallocs. Rename setupCaches.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoAdd tag to secrets test so it is recognized by new cwltest as "optional".
Peter Amstutz [Thu, 26 Apr 2018 15:59:25 +0000 (11:59 -0400)]
Add tag to secrets test so it is recognized by new cwltest as "optional".

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13111-projects-by-id'
Tom Clegg [Thu, 26 Apr 2018 15:42:28 +0000 (11:42 -0400)]
Merge branch '13111-projects-by-id'

refs #13111

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13111: Update to Go 1.10.1.
Tom Clegg [Thu, 26 Apr 2018 15:34:38 +0000 (11:34 -0400)]
13111: Update to Go 1.10.1.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13111: Merge branch 'master'
Tom Clegg [Wed, 25 Apr 2018 15:01:36 +0000 (11:01 -0400)]
13111: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12167: Propagate X-Request-Id in API calls.
Tom Clegg [Wed, 25 Apr 2018 14:58:06 +0000 (10:58 -0400)]
12167: Propagate X-Request-Id in API calls.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12167: Propagate X-Request-Id in keep requests.
Tom Clegg [Wed, 25 Apr 2018 04:34:19 +0000 (00:34 -0400)]
12167: Propagate X-Request-Id in keep requests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12167: Fix impossible fixture.
Tom Clegg [Wed, 25 Apr 2018 04:20:47 +0000 (00:20 -0400)]
12167: Fix impossible fixture.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12167: Log keep-web requests and responses as JSON.
Tom Clegg [Wed, 25 Apr 2018 04:14:16 +0000 (00:14 -0400)]
12167: Log keep-web requests and responses as JSON.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agolibcloud 2.3.0 now requires python-requests 2.4.3 or higher, otherwise
Ward Vandewege [Wed, 25 Apr 2018 03:23:08 +0000 (23:23 -0400)]
libcloud 2.3.0 now requires python-requests 2.4.3 or higher, otherwise
it throws

  ImportError: No module named packages.urllib3.poolmanager

when loaded. We only see this problem on ubuntu1404, because that is our
only supported distribution that ships with a python-requests older than
2.4.3. This issue was caught by our automated package testing, yay!

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoRemove remaining build script references to ubuntu1204, which we do not
Ward Vandewege [Wed, 25 Apr 2018 03:21:16 +0000 (23:21 -0400)]
Remove remaining build script references to ubuntu1204, which we do not
build packages for anymore.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agorefs #13369 rollback packages install on ubuntu1404 Dockerfile for builds
Fernando Monserrat [Wed, 25 Apr 2018 01:09:31 +0000 (22:09 -0300)]
refs #13369 rollback packages install on ubuntu1404 Dockerfile for builds
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

6 years agorefs #13369 remove added packages install. rollback
Fernando Monserrat [Tue, 24 Apr 2018 22:31:25 +0000 (19:31 -0300)]
refs #13369 remove added packages install. rollback
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

6 years agologin-sync test fix also make docker group optional refs #13385
Peter Amstutz [Tue, 24 Apr 2018 21:44:44 +0000 (17:44 -0400)]
login-sync test fix also make docker group optional refs #13385

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13385-login-sync-test' refs #13385
Peter Amstutz [Tue, 24 Apr 2018 20:15:53 +0000 (16:15 -0400)]
Merge branch '13385-login-sync-test' refs #13385

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12167: Propagate X-Request-Id in API calls.
Tom Clegg [Tue, 24 Apr 2018 03:17:41 +0000 (23:17 -0400)]
12167: Propagate X-Request-Id in API calls.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13385: login-sync test works even if there is no fuse group
Peter Amstutz [Tue, 24 Apr 2018 20:11:18 +0000 (16:11 -0400)]
13385: login-sync test works even if there is no fuse group

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoUpdate mock to match new arvados.File interface.
Tom Clegg [Tue, 24 Apr 2018 15:07:15 +0000 (11:07 -0400)]
Update mock to match new arvados.File interface.

refs #13111

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13111: Update arvbox and package-build images to Go 1.9.5.
Tom Clegg [Tue, 24 Apr 2018 03:23:00 +0000 (23:23 -0400)]
13111: Update arvbox and package-build images to Go 1.9.5.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>