arvados.git
6 years agoMerge branch '13435-ruamel-yaml-ver' closes #13435
Peter Amstutz [Mon, 7 May 2018 18:46:11 +0000 (14:46 -0400)]
Merge branch '13435-ruamel-yaml-ver' closes #13435

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13435: Build scandir to satisfy pathlib2 dependency of a-c-r
Peter Amstutz [Mon, 7 May 2018 14:59:58 +0000 (10:59 -0400)]
13435: Build scandir to satisfy pathlib2 dependency of a-c-r

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13435: Update ruamel.yaml and ciso8601 versions.
Peter Amstutz [Mon, 7 May 2018 14:20:57 +0000 (10:20 -0400)]
13435: Update ruamel.yaml and ciso8601 versions.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13278-launch-failed'
Tom Clegg [Mon, 7 May 2018 14:40:17 +0000 (10:40 -0400)]
Merge branch '13278-launch-failed'

refs #13278
refs #13399

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13278: Release jobs that are pending because "launch failed".
Tom Clegg [Tue, 27 Mar 2018 17:01:38 +0000 (13:01 -0400)]
13278: Release jobs that are pending because "launch failed".

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13365-default-secondaryFiles' refs #13365
Peter Amstutz [Mon, 7 May 2018 13:49:30 +0000 (09:49 -0400)]
Merge branch '13365-default-secondaryFiles' refs #13365

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13383-trash-workers'
Tom Clegg [Mon, 7 May 2018 13:31:57 +0000 (09:31 -0400)]
Merge branch '13383-trash-workers'

closes #13383
refs #13335

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13383: Implement EmptyTrashWorkers in azure and filesystem backends.
Tom Clegg [Fri, 4 May 2018 20:48:50 +0000 (16:48 -0400)]
13383: Implement EmptyTrashWorkers in azure and filesystem backends.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13383: Fix warning about expected 404 error.
Tom Clegg [Tue, 24 Apr 2018 21:03:50 +0000 (17:03 -0400)]
13383: Fix warning about expected 404 error.

The expected error (object not found immediately after deleting it)
was being logged as a warning, and the warning erroneously stated the
error was from "HEAD recent/X" rather than "HEAD X".

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13383: Add PullWorkers, TrashWorkers, EmptyTrashWorkers configs.
Tom Clegg [Tue, 24 Apr 2018 20:32:24 +0000 (16:32 -0400)]
13383: Add PullWorkers, TrashWorkers, EmptyTrashWorkers configs.

EmptyTrashWorkers only applies to S3 volumes.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '12167-go-request-id'
Tom Clegg [Fri, 4 May 2018 19:47:13 +0000 (15:47 -0400)]
Merge branch '12167-go-request-id'

refs #12167

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch 'tests-cleanup'
Tom Clegg [Fri, 4 May 2018 19:44:56 +0000 (15:44 -0400)]
Merge branch 'tests-cleanup'

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoAvoid broken llfuse 1.3.4 ("pip install" fails).
Tom Clegg [Fri, 4 May 2018 17:26:04 +0000 (13:26 -0400)]
Avoid broken llfuse 1.3.4 ("pip install" fails).

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13365: Remove check for callback that now happens in a different place.
Peter Amstutz [Fri, 4 May 2018 14:50:52 +0000 (10:50 -0400)]
13365: Remove check for callback that now happens in a different place.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13365: Add tests to confirm regressions are fixed.
Peter Amstutz [Fri, 4 May 2018 14:29:44 +0000 (10:29 -0400)]
13365: Add tests to confirm regressions are fixed.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13365: clean up discover_secondary_files
Peter Amstutz [Fri, 4 May 2018 14:13:05 +0000 (10:13 -0400)]
13365: clean up discover_secondary_files

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13365: Fix state logging
Peter Amstutz [Thu, 3 May 2018 20:18:12 +0000 (16:18 -0400)]
13365: Fix state logging

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoSkip some unnecessary pip invocations.
Tom Clegg [Thu, 3 May 2018 20:09:37 +0000 (16:09 -0400)]
Skip some unnecessary pip invocations.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13365: Further fixes to ensure output callback only happens once
Peter Amstutz [Thu, 3 May 2018 19:48:16 +0000 (15:48 -0400)]
13365: Further fixes to ensure output callback only happens once

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoFix gopath/govendor recipe.
Tom Clegg [Wed, 25 Apr 2018 17:31:11 +0000 (13:31 -0400)]
Fix gopath/govendor recipe.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoSkip explicit libcloud preinstall when not using a fork.
Tom Clegg [Wed, 25 Apr 2018 17:30:27 +0000 (13:30 -0400)]
Skip explicit libcloud preinstall when not using a fork.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoFix wrong temp path in govendor recipe.
Tom Clegg [Sun, 8 Apr 2018 00:49:21 +0000 (20:49 -0400)]
Fix wrong temp path in govendor recipe.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoUse released version of llfuse for tests.
Tom Clegg [Sun, 8 Apr 2018 00:48:03 +0000 (20:48 -0400)]
Use released version of llfuse for tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12167: Test X-Request-ID headers.
Tom Clegg [Thu, 3 May 2018 18:24:45 +0000 (14:24 -0400)]
12167: Test X-Request-ID headers.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12167: Generate only one request ID per get/put.
Tom Clegg [Thu, 3 May 2018 18:03:40 +0000 (14:03 -0400)]
12167: Generate only one request ID per get/put.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13365: Fix race condition between job submitted and event monitor threads
Peter Amstutz [Thu, 3 May 2018 17:46:57 +0000 (13:46 -0400)]
13365: Fix race condition between job submitted and event monitor threads

Don't call "done" if work reuse means a container request or job
immediately comes back as Completed because it might get called
twice.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13365-note-bug-in-docs' refs #13365
Peter Amstutz [Thu, 3 May 2018 17:07:31 +0000 (13:07 -0400)]
Merge branch '13365-note-bug-in-docs' refs #13365

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13365: Add example error messages and highlight the changes.
Peter Amstutz [Thu, 3 May 2018 15:13:38 +0000 (11:13 -0400)]
13365: Add example error messages and highlight the changes.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12167: Generate a new request ID if caller explicitly uses "".
Tom Clegg [Thu, 3 May 2018 14:21:05 +0000 (10:21 -0400)]
12167: Generate a new request ID if caller explicitly uses "".

Skip invoking unique ID generator if ID is already set.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12167: Merge branch 'master'
Tom Clegg [Thu, 3 May 2018 14:10:11 +0000 (10:10 -0400)]
12167: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13365: Bump cwltool, 3rd party package versions.
Peter Amstutz [Wed, 2 May 2018 23:49:12 +0000 (19:49 -0400)]
13365: Bump cwltool, 3rd party package versions.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13365: Bump schema-salad for better error formatting.
Peter Amstutz [Tue, 1 May 2018 21:37:02 +0000 (17:37 -0400)]
13365: Bump schema-salad for better error formatting.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoBump cwltool version for secondaryFile checker support.
Peter Amstutz [Tue, 1 May 2018 20:30:02 +0000 (16:30 -0400)]
Bump cwltool version for secondaryFile checker support.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13365: Reintroduce secondaryFile discovery.
Peter Amstutz [Tue, 1 May 2018 20:09:38 +0000 (16:09 -0400)]
13365: Reintroduce secondaryFile discovery.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13365: Discover secondaryFiles associated with default files inputs
Peter Amstutz [Tue, 17 Apr 2018 19:23:46 +0000 (15:23 -0400)]
13365: Discover secondaryFiles associated with default files inputs

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13111-no-anonymous-sitefs'
Tom Clegg [Tue, 1 May 2018 18:06:15 +0000 (14:06 -0400)]
Merge branch '13111-no-anonymous-sitefs'

refs #13111

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13338-wb-run-wf-proj' refs #13338
Peter Amstutz [Tue, 1 May 2018 17:35:05 +0000 (13:35 -0400)]
Merge branch '13338-wb-run-wf-proj' refs #13338

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12167: Pass request ID via keepclient instead of custom code.
Tom Clegg [Tue, 1 May 2018 15:16:47 +0000 (11:16 -0400)]
12167: Pass request ID via keepclient instead of custom code.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoFix #ZgotmplZ in dir listing page when filename contains a colon.
Tom Clegg [Mon, 30 Apr 2018 14:03:11 +0000 (10:03 -0400)]
Fix #ZgotmplZ in dir listing page when filename contains a colon.

refs #8784

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13365: Tweak text.
Peter Amstutz [Mon, 30 Apr 2018 21:31:47 +0000 (17:31 -0400)]
13365: Tweak text.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13365: Update release notes about a-c-r bug in v1.1.4.
Peter Amstutz [Mon, 30 Apr 2018 21:29:36 +0000 (17:29 -0400)]
13365: Update release notes about a-c-r bug in v1.1.4.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoFix wrong event_type when getting buffered live logs for crunch2.
Tom Clegg [Mon, 30 Apr 2018 20:37:12 +0000 (16:37 -0400)]
Fix wrong event_type when getting buffered live logs for crunch2.

refs #12690

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13111: Disable siteFS routes for anonymous requests.
Tom Clegg [Fri, 27 Apr 2018 20:45:28 +0000 (16:45 -0400)]
13111: Disable siteFS routes for anonymous requests.

This enables dav clients to use HTTP authentication even when
anonymous tokens are configured.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoDocumentation: update PostgreSQL installation instructions
Ward Vandewege [Fri, 27 Apr 2018 15:46:02 +0000 (11:46 -0400)]
Documentation: update PostgreSQL installation instructions

refs #13165

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoNode manager integration test writes to stderr in chunks.
Peter Amstutz [Fri, 27 Apr 2018 15:51:51 +0000 (11:51 -0400)]
Node manager integration test writes to stderr in chunks.

Handles EAGAIN when getting pipe buffer backpressure.  no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoAvoid dangling child procs in test suite.
Tom Clegg [Thu, 26 Apr 2018 20:51:53 +0000 (16:51 -0400)]
Avoid dangling child procs in test suite.

In go 1.10.1, these seem to make "go test" hang sometimes.

https://github.com/golang/go/issues/24050

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13338: Running workflow from workbench puts collections in correct project.
Peter Amstutz [Thu, 26 Apr 2018 20:45:01 +0000 (16:45 -0400)]
13338: Running workflow from workbench puts collections in correct project.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13377-block-sig-time' refs #13377
Peter Amstutz [Thu, 26 Apr 2018 20:11:37 +0000 (16:11 -0400)]
Merge branch '13377-block-sig-time' refs #13377

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13377: Ensure that collection fetched by PDH has longest available lifetime.
Peter Amstutz [Thu, 26 Apr 2018 20:00:11 +0000 (16:00 -0400)]
13377: Ensure that collection fetched by PDH has longest available lifetime.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '12708-balance-storage-classes'
Tom Clegg [Thu, 26 Apr 2018 19:34:06 +0000 (15:34 -0400)]
Merge branch '12708-balance-storage-classes'

refs #12708

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13399-log-low-priority'
Tom Clegg [Thu, 26 Apr 2018 19:30:03 +0000 (15:30 -0400)]
Merge branch '13399-log-low-priority'

refs #13399

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13399: Log when a slurm job's priority is unrealistically low.
Tom Clegg [Thu, 26 Apr 2018 18:54:24 +0000 (14:54 -0400)]
13399: Log when a slurm job's priority is unrealistically low.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13282-admin-docs' refs #13282
Peter Amstutz [Thu, 26 Apr 2018 18:30:29 +0000 (14:30 -0400)]
Merge branch '13282-admin-docs' refs #13282

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13282: doc updates
Peter Amstutz [Thu, 26 Apr 2018 18:13:27 +0000 (14:13 -0400)]
13282: doc updates

* Improve presentation of R SDK
* Move obsolete crunch1 documentation to "Obsolete" section.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12708: Merge branch 'master' into 12708-balance-storage-classes
Tom Clegg [Thu, 26 Apr 2018 17:14:38 +0000 (13:14 -0400)]
12708: Merge branch 'master' into 12708-balance-storage-classes

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12708: TODO notes about memory use and class combinations.
Tom Clegg [Thu, 26 Apr 2018 17:10:04 +0000 (13:10 -0400)]
12708: TODO notes about memory use and class combinations.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13282: Add note about supported platforms to install guide.
Peter Amstutz [Tue, 10 Apr 2018 15:22:11 +0000 (11:22 -0400)]
13282: Add note about supported platforms to install guide.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13282: Remove some obsolete crunchv1 documenation from python sdk.
Peter Amstutz [Tue, 10 Apr 2018 14:24:12 +0000 (10:24 -0400)]
13282: Remove some obsolete crunchv1 documenation from python sdk.

Fix formatting of "websocket events" page.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13282: Add architecture section
Peter Amstutz [Tue, 10 Apr 2018 14:19:45 +0000 (10:19 -0400)]
13282: Add architecture section

Also commented out obsolete documentation pages about using
crunchv1 (which have already been marked deprecated for a long time).

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13282: First pass at reorganizing
Peter Amstutz [Wed, 28 Mar 2018 19:06:58 +0000 (15:06 -0400)]
13282: First pass at reorganizing

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12708: Precompute len(slots) to reduce mallocs. Rename setupCaches.
Tom Clegg [Thu, 26 Apr 2018 17:09:29 +0000 (13:09 -0400)]
12708: Precompute len(slots) to reduce mallocs. Rename setupCaches.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoAdd tag to secrets test so it is recognized by new cwltest as "optional".
Peter Amstutz [Thu, 26 Apr 2018 15:59:25 +0000 (11:59 -0400)]
Add tag to secrets test so it is recognized by new cwltest as "optional".

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13111-projects-by-id'
Tom Clegg [Thu, 26 Apr 2018 15:42:28 +0000 (11:42 -0400)]
Merge branch '13111-projects-by-id'

refs #13111

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13111: Update to Go 1.10.1.
Tom Clegg [Thu, 26 Apr 2018 15:34:38 +0000 (11:34 -0400)]
13111: Update to Go 1.10.1.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13111: Merge branch 'master'
Tom Clegg [Wed, 25 Apr 2018 15:01:36 +0000 (11:01 -0400)]
13111: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12167: Propagate X-Request-Id in API calls.
Tom Clegg [Wed, 25 Apr 2018 14:58:06 +0000 (10:58 -0400)]
12167: Propagate X-Request-Id in API calls.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12167: Propagate X-Request-Id in keep requests.
Tom Clegg [Wed, 25 Apr 2018 04:34:19 +0000 (00:34 -0400)]
12167: Propagate X-Request-Id in keep requests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12167: Fix impossible fixture.
Tom Clegg [Wed, 25 Apr 2018 04:20:47 +0000 (00:20 -0400)]
12167: Fix impossible fixture.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12167: Log keep-web requests and responses as JSON.
Tom Clegg [Wed, 25 Apr 2018 04:14:16 +0000 (00:14 -0400)]
12167: Log keep-web requests and responses as JSON.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agolibcloud 2.3.0 now requires python-requests 2.4.3 or higher, otherwise
Ward Vandewege [Wed, 25 Apr 2018 03:23:08 +0000 (23:23 -0400)]
libcloud 2.3.0 now requires python-requests 2.4.3 or higher, otherwise
it throws

  ImportError: No module named packages.urllib3.poolmanager

when loaded. We only see this problem on ubuntu1404, because that is our
only supported distribution that ships with a python-requests older than
2.4.3. This issue was caught by our automated package testing, yay!

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoRemove remaining build script references to ubuntu1204, which we do not
Ward Vandewege [Wed, 25 Apr 2018 03:21:16 +0000 (23:21 -0400)]
Remove remaining build script references to ubuntu1204, which we do not
build packages for anymore.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agorefs #13369 rollback packages install on ubuntu1404 Dockerfile for builds
Fernando Monserrat [Wed, 25 Apr 2018 01:09:31 +0000 (22:09 -0300)]
refs #13369 rollback packages install on ubuntu1404 Dockerfile for builds
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

6 years agorefs #13369 remove added packages install. rollback
Fernando Monserrat [Tue, 24 Apr 2018 22:31:25 +0000 (19:31 -0300)]
refs #13369 remove added packages install. rollback
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

6 years agologin-sync test fix also make docker group optional refs #13385
Peter Amstutz [Tue, 24 Apr 2018 21:44:44 +0000 (17:44 -0400)]
login-sync test fix also make docker group optional refs #13385

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13385-login-sync-test' refs #13385
Peter Amstutz [Tue, 24 Apr 2018 20:15:53 +0000 (16:15 -0400)]
Merge branch '13385-login-sync-test' refs #13385

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12167: Propagate X-Request-Id in API calls.
Tom Clegg [Tue, 24 Apr 2018 03:17:41 +0000 (23:17 -0400)]
12167: Propagate X-Request-Id in API calls.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13385: login-sync test works even if there is no fuse group
Peter Amstutz [Tue, 24 Apr 2018 20:11:18 +0000 (16:11 -0400)]
13385: login-sync test works even if there is no fuse group

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoUpdate mock to match new arvados.File interface.
Tom Clegg [Tue, 24 Apr 2018 15:07:15 +0000 (11:07 -0400)]
Update mock to match new arvados.File interface.

refs #13111

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13111: Update arvbox and package-build images to Go 1.9.5.
Tom Clegg [Tue, 24 Apr 2018 03:23:00 +0000 (23:23 -0400)]
13111: Update arvbox and package-build images to Go 1.9.5.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agorefs #13369 "Merge branch '13369-update-ubuntu1404-dockerfile'".
Fernando Monserrat [Mon, 23 Apr 2018 21:25:13 +0000 (18:25 -0300)]
refs #13369 "Merge branch '13369-update-ubuntu1404-dockerfile'".
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

6 years ago13369: add ulimit to the docker run fixing slowness bug on ubuntu1404
Fernando Monserrat [Mon, 23 Apr 2018 21:24:12 +0000 (18:24 -0300)]
13369: add ulimit to the docker run fixing slowness bug on ubuntu1404
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

6 years agoMerge branch 'master' into 13369-update-ubuntu1404-dockerfile
Fernando Monserrat [Mon, 23 Apr 2018 21:16:44 +0000 (18:16 -0300)]
Merge branch 'master' into 13369-update-ubuntu1404-dockerfile
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

6 years agorefs #13369 "Merge branch '13369-update-ubuntu1404-dockerfile'".
Fernando Monserrat [Mon, 23 Apr 2018 18:30:54 +0000 (15:30 -0300)]
refs #13369 "Merge branch '13369-update-ubuntu1404-dockerfile'".
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

6 years ago13369: update ubuntu1404 test packages Dockerfile
Fernando Monserrat [Mon, 23 Apr 2018 18:06:21 +0000 (15:06 -0300)]
13369: update ubuntu1404 test packages Dockerfile
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

6 years agoFix nodemanager tests. no issue #
Peter Amstutz [Mon, 23 Apr 2018 15:29:55 +0000 (11:29 -0400)]
Fix nodemanager tests.  no issue #

Stub out subprocess.check_output to avoid calling the real "scontrol".
Fixes test_failed_arvados_calls_retried, test_subscribe and
test_creation_with_arvados_node in SLURMComputeNodeSetupActorTestCase.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agorefs #13369 "Merge branch '13369-update-ubuntu1404-dockerfile'".
Fernando Monserrat [Mon, 23 Apr 2018 14:38:41 +0000 (11:38 -0300)]
refs #13369 "Merge branch '13369-update-ubuntu1404-dockerfile'".
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

6 years ago13369: update ubuntu1404 test Dockerfile
Fernando Monserrat [Mon, 23 Apr 2018 14:37:31 +0000 (11:37 -0300)]
13369: update ubuntu1404 test Dockerfile
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

6 years ago13111: Access projects via /by_id/$uuid/.
Tom Clegg [Mon, 23 Apr 2018 13:05:39 +0000 (09:05 -0400)]
13111: Access projects via /by_id/$uuid/.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch 'thehyve/master' LocalJumpError in arvados-login-sync
Peter Amstutz [Fri, 20 Apr 2018 20:18:45 +0000 (16:18 -0400)]
Merge branch 'thehyve/master' LocalJumpError in arvados-login-sync

no issue #, github PR 65

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13111-webdav-projects'
Tom Clegg [Fri, 20 Apr 2018 19:59:21 +0000 (15:59 -0400)]
Merge branch '13111-webdav-projects'

refs #13111

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13111: Merge branch 'master' into 13111-webdav-projects
Tom Clegg [Fri, 20 Apr 2018 19:56:12 +0000 (15:56 -0400)]
13111: Merge branch 'master' into 13111-webdav-projects

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agorefs #13369 "Merge branch '13369-update-ubuntu1404-dockerfile'".
Fernando Monserrat [Fri, 20 Apr 2018 18:11:48 +0000 (15:11 -0300)]
refs #13369 "Merge branch '13369-update-ubuntu1404-dockerfile'".
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

6 years ago13369: update ubuntu1404 Dockerfile
Fernando Monserrat [Fri, 20 Apr 2018 18:10:43 +0000 (15:10 -0300)]
13369: update ubuntu1404 Dockerfile
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

6 years ago13111: Fix bogus form-encoding in example URL.
Tom Clegg [Fri, 20 Apr 2018 18:08:39 +0000 (14:08 -0400)]
13111: Fix bogus form-encoding in example URL.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoSimplify filtering in arvados-login-sync. Arvados-DCO-1.1-Signed-off-by: Pavel Mikhai...
strangepleasures [Fri, 20 Apr 2018 14:47:46 +0000 (16:47 +0200)]
Simplify filtering in arvados-login-sync. Arvados-DCO-1.1-Signed-off-by: Pavel Mikhailovskii <pavel@thehyve.nl>

6 years agoMerge remote-tracking branch 'upstream/master'
strangepleasures [Fri, 20 Apr 2018 14:29:27 +0000 (16:29 +0200)]
Merge remote-tracking branch 'upstream/master'

6 years agoFix LocalJumpError in arvados-login-sync. Arvados-DCO-1.1-Signed-off-by: Pavel Mikhai...
strangepleasures [Fri, 20 Apr 2018 14:06:58 +0000 (16:06 +0200)]
Fix LocalJumpError in arvados-login-sync. Arvados-DCO-1.1-Signed-off-by: Pavel Mikhailovskii <pavel@thehyve.nl>

6 years agoFix R SDK online doc generation refs #13076
Peter Amstutz [Fri, 20 Apr 2018 13:44:59 +0000 (09:44 -0400)]
Fix R SDK online doc generation refs #13076

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13076-r-autogen-api'
Fuad Muhic [Fri, 20 Apr 2018 08:20:12 +0000 (10:20 +0200)]
Merge branch '13076-r-autogen-api'

refs #13076

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years agoarvbox pin pip to 9.0.3. Add LINES/COLUMNS to "arvbox shell", no issue #
Peter Amstutz [Thu, 19 Apr 2018 17:52:37 +0000 (13:52 -0400)]
arvbox pin pip to 9.0.3.  Add LINES/COLUMNS to "arvbox shell", no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>