arvados.git
7 years agoMerge branch '12573-crunch2-slurm-priority' closes #12573
Peter Amstutz [Mon, 4 Dec 2017 21:32:04 +0000 (16:32 -0500)]
Merge branch '12573-crunch2-slurm-priority' closes #12573

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years agoMerge branch '12662-current-user-test'
Lucas Di Pentima [Mon, 4 Dec 2017 21:28:35 +0000 (18:28 -0300)]
Merge branch '12662-current-user-test'
Closes #12662

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years agoMerge branch '10666-report-version'
Lucas Di Pentima [Mon, 4 Dec 2017 21:02:39 +0000 (18:02 -0300)]
Merge branch '10666-report-version'
Closes #10666

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years ago12573: Test cleanup.
Peter Amstutz [Mon, 4 Dec 2017 20:10:44 +0000 (15:10 -0500)]
12573: Test cleanup.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago12573: Clarify docs.
Peter Amstutz [Mon, 4 Dec 2017 19:55:19 +0000 (14:55 -0500)]
12573: Clarify docs.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago10666: Merge branch 'master' into 10666-report-version
Lucas Di Pentima [Mon, 4 Dec 2017 19:53:20 +0000 (16:53 -0300)]
10666: Merge branch 'master' into 10666-report-version

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years ago10666: Version report formatting fixes on some missing tools
Lucas Di Pentima [Mon, 4 Dec 2017 19:52:29 +0000 (16:52 -0300)]
10666: Version report formatting fixes on some missing tools

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years ago12662: Added test proving that User.current won't return the
Lucas Di Pentima [Mon, 4 Dec 2017 19:19:37 +0000 (16:19 -0300)]
12662: Added test proving that User.current won't return the
anonoymous user when using an invalid token and having the
anonymous_user_token config set.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years agoMerge branch '12614-broken-docker' refs #12614
Peter Amstutz [Mon, 4 Dec 2017 18:47:46 +0000 (13:47 -0500)]
Merge branch '12614-broken-docker' refs #12614

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago12573: Update documentation describing interpretation of priority
Peter Amstutz [Mon, 4 Dec 2017 18:44:05 +0000 (13:44 -0500)]
12573: Update documentation describing interpretation of priority

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years agoMerge branch '12731-synchronized-graphs' closes #12731
Tom Morris [Mon, 4 Dec 2017 18:27:14 +0000 (13:27 -0500)]
Merge branch '12731-synchronized-graphs' closes #12731

Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>

7 years ago12573: Fix tests.
Peter Amstutz [Mon, 4 Dec 2017 16:36:35 +0000 (11:36 -0500)]
12573: Fix tests.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago12731: Remove webchart.js. Add synchronizer.js.
Tom Morris [Mon, 4 Dec 2017 17:24:22 +0000 (12:24 -0500)]
12731: Remove webchart.js. Add synchronizer.js.

Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>

7 years ago12731: Add copyright notice, MIT license text, and source commit hash.
Tom Morris [Mon, 4 Dec 2017 17:22:39 +0000 (12:22 -0500)]
12731: Add copyright notice, MIT license text, and source commit hash.

Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>

7 years ago12573: Record absolute priority from squeue in additional to niceness.
Peter Amstutz [Mon, 4 Dec 2017 16:36:35 +0000 (11:36 -0500)]
12573: Record absolute priority from squeue in additional to niceness.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago10666: Updated build script to pass the version number to go programs.
Lucas Di Pentima [Mon, 4 Dec 2017 15:14:48 +0000 (12:14 -0300)]
10666: Updated build script to pass the version number to go programs.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years ago10666: version string format fix.
Lucas Di Pentima [Mon, 4 Dec 2017 14:46:04 +0000 (11:46 -0300)]
10666: version string format fix.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years ago12731 : Only synchronize X-axis, not both
Tom Morris [Mon, 4 Dec 2017 00:39:33 +0000 (19:39 -0500)]
12731 : Only synchronize X-axis, not both

Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>

7 years ago12731 : Synchronize zoom/pan of all 4 graphs
Tom Morris [Mon, 4 Dec 2017 00:35:20 +0000 (19:35 -0500)]
12731 : Synchronize zoom/pan of all 4 graphs

Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>

7 years ago12573: Priority for container/container request defaults to 0 instead of nil.
Peter Amstutz [Fri, 1 Dec 2017 21:30:41 +0000 (16:30 -0500)]
12573: Priority for container/container request defaults to 0 instead of nil.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago12573: Ensure priority is set on container requests created by other containers.
Peter Amstutz [Fri, 1 Dec 2017 17:01:39 +0000 (12:01 -0500)]
12573: Ensure priority is set on container requests created by other containers.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago12573: Fix scontrol Nice (due of error in scontrol man page).
Peter Amstutz [Fri, 1 Dec 2017 15:01:37 +0000 (10:01 -0500)]
12573: Fix scontrol Nice (due of error in scontrol man page).

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago12573: Add test for dynamic priority adjustment.
Peter Amstutz [Thu, 30 Nov 2017 21:54:27 +0000 (16:54 -0500)]
12573: Add test for dynamic priority adjustment.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago12573: Translate Arvados priority to slurm niceness.
Peter Amstutz [Thu, 30 Nov 2017 20:45:25 +0000 (15:45 -0500)]
12573: Translate Arvados priority to slurm niceness.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago12573: Clamp range of priority to [0,1000] for container & container request.
Peter Amstutz [Thu, 30 Nov 2017 19:39:41 +0000 (14:39 -0500)]
12573: Clamp range of priority to [0,1000] for container & container request.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years agoMerge branch '12574-propagate-priority' closes #12574
Peter Amstutz [Fri, 1 Dec 2017 16:31:52 +0000 (11:31 -0500)]
Merge branch '12574-propagate-priority' closes #12574

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago12614: Additional error message triggers "broken node" behavior (refs #12503)
Peter Amstutz [Fri, 1 Dec 2017 16:23:23 +0000 (11:23 -0500)]
12614: Additional error message triggers "broken node" behavior (refs #12503)

Also make "executable not found" error message check more specific to avoid
false positives which produce confusing messages.  Add tests.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago10666: Formatting fixes.
Lucas Di Pentima [Fri, 1 Dec 2017 16:18:52 +0000 (13:18 -0300)]
10666: Formatting fixes.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years ago12574: Rename update_priority to propagate_priority
Peter Amstutz [Fri, 1 Dec 2017 15:09:02 +0000 (10:09 -0500)]
12574: Rename update_priority to propagate_priority

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago10666: Added version information to arv-mount & nodemanager
Lucas Di Pentima [Thu, 30 Nov 2017 23:57:17 +0000 (20:57 -0300)]
10666: Added version information to arv-mount & nodemanager
startup logging.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years ago10666: Added version information to nodemanager's status.json
Lucas Di Pentima [Thu, 30 Nov 2017 22:46:27 +0000 (19:46 -0300)]
10666: Added version information to nodemanager's status.json
Updated related test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years agoMerge branch '12483-writable-fs'
Tom Clegg [Thu, 30 Nov 2017 22:29:59 +0000 (17:29 -0500)]
Merge branch '12483-writable-fs'

refs #12483

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12574: Use after_save hook to update priority. Add test.
Peter Amstutz [Thu, 30 Nov 2017 22:24:57 +0000 (17:24 -0500)]
12574: Use after_save hook to update priority.  Add test.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago12574: Propagate changes in container priority to child container requests.
Peter Amstutz [Thu, 30 Nov 2017 22:08:08 +0000 (17:08 -0500)]
12574: Propagate changes in container priority to child container requests.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago12483: Update arvados.File mocks.
Tom Clegg [Thu, 30 Nov 2017 22:03:03 +0000 (17:03 -0500)]
12483: Update arvados.File mocks.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago10666: Replaced 'version' package with 'version' var
Lucas Di Pentima [Thu, 30 Nov 2017 20:26:42 +0000 (17:26 -0300)]
10666: Replaced 'version' package with 'version' var
on every go program.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years ago12483: Merge branch 'master' into 12483-writable-fs
Tom Clegg [Thu, 30 Nov 2017 20:06:00 +0000 (15:06 -0500)]
12483: Merge branch 'master' into 12483-writable-fs

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12483: Update install docs to acknowledge read/write webdav support.
Tom Clegg [Thu, 30 Nov 2017 20:02:52 +0000 (15:02 -0500)]
12483: Update install docs to acknowledge read/write webdav support.

Update SSL -> TLS.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago10666: Added Version information to status.json on keep-web,
Lucas Di Pentima [Thu, 30 Nov 2017 17:49:38 +0000 (14:49 -0300)]
10666: Added Version information to status.json on keep-web,
keepstore & ws.
Added tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years ago10666: Added Crunch-run version to container logs.
Lucas Di Pentima [Thu, 30 Nov 2017 16:26:19 +0000 (13:26 -0300)]
10666: Added Crunch-run version to container logs.
Added test for version package.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years agoMerge branch '12167-keep-request-id'
Tom Clegg [Thu, 30 Nov 2017 14:38:29 +0000 (09:38 -0500)]
Merge branch '12167-keep-request-id'

refs #12167

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years agoFix --on-error formatting
Tom Morris [Wed, 29 Nov 2017 22:14:04 +0000 (17:14 -0500)]
Fix --on-error formatting

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>

7 years agoMerge branch '12018-tool-docs'
Lucas Di Pentima [Wed, 29 Nov 2017 21:59:44 +0000 (18:59 -0300)]
Merge branch '12018-tool-docs'
Refs #12018

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years ago12018: Documentation review updates
Tom Morris [Wed, 29 Nov 2017 21:49:37 +0000 (16:49 -0500)]
12018: Documentation review updates

Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>

7 years agoMerge branch '12614-docker-sanity-check' refs #12614
Peter Amstutz [Wed, 29 Nov 2017 20:00:12 +0000 (15:00 -0500)]
Merge branch '12614-docker-sanity-check' refs #12614

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago12614: Restore keepclient error check prior to NewContainerRunner()
Peter Amstutz [Wed, 29 Nov 2017 17:12:22 +0000 (12:12 -0500)]
12614: Restore keepclient error check prior to NewContainerRunner()

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago12614: Restore order set state "Running" before starting the container.
Peter Amstutz [Wed, 29 Nov 2017 16:56:46 +0000 (11:56 -0500)]
12614: Restore order set state "Running" before starting the container.

Use "Matches" in tests.

Broken node hook tests that output is captured.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years agoMerge branch '12662-multisite-add-broken'
Lucas Di Pentima [Wed, 29 Nov 2017 16:14:44 +0000 (13:14 -0300)]
Merge branch '12662-multisite-add-broken'
Refs #12662

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years ago12167: Test request ID size.
Tom Clegg [Wed, 29 Nov 2017 16:07:14 +0000 (11:07 -0500)]
12167: Test request ID size.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago10666: Fixed flags issue.
Lucas Di Pentima [Wed, 29 Nov 2017 15:57:48 +0000 (12:57 -0300)]
10666: Fixed flags issue.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years ago12167: Use pseudo-random IDs instead of timestamps.
Tom Clegg [Wed, 29 Nov 2017 15:56:44 +0000 (10:56 -0500)]
12167: Use pseudo-random IDs instead of timestamps.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12167: Test LogRequests() and AddRequestIDs().
Tom Clegg [Wed, 29 Nov 2017 15:37:05 +0000 (10:37 -0500)]
12167: Test LogRequests() and AddRequestIDs().

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12167: Fix tests.
Tom Clegg [Wed, 29 Nov 2017 07:05:23 +0000 (02:05 -0500)]
12167: Fix tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago10666: Added version number to go sdk and go tools & services
Lucas Di Pentima [Wed, 29 Nov 2017 00:55:13 +0000 (21:55 -0300)]
10666: Added version number to go sdk and go tools & services

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years ago12614: Fix tests
Peter Amstutz [Tue, 28 Nov 2017 21:40:20 +0000 (16:40 -0500)]
12614: Fix tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago12614: Add tests.
Peter Amstutz [Tue, 28 Nov 2017 21:35:15 +0000 (16:35 -0500)]
12614: Add tests.

Also reorder run sequence slightly so that failure to start container due to
broken node is retryable.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago12483: Update docs to acknowledge read/write webdav support.
Tom Clegg [Tue, 28 Nov 2017 21:24:55 +0000 (16:24 -0500)]
12483: Update docs to acknowledge read/write webdav support.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12483: Add comments.
Tom Clegg [Tue, 28 Nov 2017 21:21:10 +0000 (16:21 -0500)]
12483: Add comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12483: Return 405 for all write methods when target is PDH.
Tom Clegg [Tue, 28 Nov 2017 21:04:55 +0000 (16:04 -0500)]
12483: Return 405 for all write methods when target is PDH.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12483: Don't escape "-", "_", etc. in filenames.
Tom Clegg [Tue, 28 Nov 2017 21:02:42 +0000 (16:02 -0500)]
12483: Don't escape "-", "_", etc. in filenames.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12483: Use real modTimes.
Tom Clegg [Tue, 28 Nov 2017 21:01:17 +0000 (16:01 -0500)]
12483: Use real modTimes.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12614: Detect and report broken node errors.
Peter Amstutz [Tue, 28 Nov 2017 20:27:50 +0000 (15:27 -0500)]
12614: Detect and report broken node errors.

1. crunch-run has an errorBlacklist of messages that mean "this Node probably
   cannot run any container successfully"

2. Upon seeing a blacklisted error, the broken node hook script is run

3. The hook script is responsible for marking the node as "broken, don't
schedule work on it, such as executing scontrol reconfigure Node=XXX State=DOWN

4. After the hook script terminates, if possible the container is reset from Locked
back to Queued state.

5. Then crunch-run can terminate.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago12662: Ignore anonymous user token when getting the current user
Lucas Di Pentima [Tue, 28 Nov 2017 19:42:11 +0000 (16:42 -0300)]
12662: Ignore anonymous user token when getting the current user

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years ago12483: Add webdav COPY method.
Tom Clegg [Tue, 28 Nov 2017 15:17:55 +0000 (10:17 -0500)]
12483: Add webdav COPY method.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12483: Use io.Seek* constants instead of deprecated os.SEEK_*.
Tom Clegg [Tue, 28 Nov 2017 14:20:51 +0000 (09:20 -0500)]
12483: Use io.Seek* constants instead of deprecated os.SEEK_*.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12483: Remove dead code, update tests.
Tom Clegg [Mon, 27 Nov 2017 23:23:55 +0000 (18:23 -0500)]
12483: Remove dead code, update tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years agoAdd jessie-dev to apt.arvados.org.list for jobs image, no issue #
Peter Amstutz [Mon, 27 Nov 2017 21:44:22 +0000 (16:44 -0500)]
Add jessie-dev to apt.arvados.org.list for jobs image, no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years agoFix arvbox localdemo problems. refs #12660
Peter Amstutz [Mon, 27 Nov 2017 16:18:11 +0000 (11:18 -0500)]
Fix arvbox localdemo problems. refs #12660

* Checkout composer when building demo image.
* Fix node.js version.
* Precompile assests for SSO and workbench.
* Set correct workbench rails environment.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years agoMerge branch '12616-acr-validate' closes #12616
Peter Amstutz [Mon, 27 Nov 2017 19:37:11 +0000 (14:37 -0500)]
Merge branch '12616-acr-validate' closes #12616

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years ago12483: Error 405 if writing to PDH, 403 if lacking write permission.
Tom Clegg [Mon, 27 Nov 2017 18:12:53 +0000 (13:12 -0500)]
12483: Error 405 if writing to PDH, 403 if lacking write permission.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12483: Fix loading error details from API error response.
Tom Clegg [Mon, 27 Nov 2017 18:10:51 +0000 (13:10 -0500)]
12483: Fix loading error details from API error response.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12483: Recover from errant empty dirs where GOPATH symlink goes.
Tom Clegg [Mon, 27 Nov 2017 18:08:28 +0000 (13:08 -0500)]
12483: Recover from errant empty dirs where GOPATH symlink goes.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12167: Restore timeToStatus + timeWriteBody in keepstore/proxy logs.
Tom Clegg [Mon, 27 Nov 2017 15:51:45 +0000 (10:51 -0500)]
12167: Restore timeToStatus + timeWriteBody in keepstore/proxy logs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12167: Merge branch 'master' into 12167-keep-request-id
Tom Clegg [Sat, 25 Nov 2017 07:20:23 +0000 (02:20 -0500)]
12167: Merge branch 'master' into 12167-keep-request-id

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years agoMake build/run-build-packages-all-targets.sh more explicit about which
Ward Vandewege [Sat, 25 Nov 2017 14:57:47 +0000 (09:57 -0500)]
Make build/run-build-packages-all-targets.sh more explicit about which
target fails.

Remove old ubuntu1204 docker files, we do not support that distribution
anymore. This fixes #12658

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

7 years agoMerge branch '12475-asyncbuf'
Tom Clegg [Sat, 25 Nov 2017 07:17:18 +0000 (02:17 -0500)]
Merge branch '12475-asyncbuf'

refs #12475

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12475: Merge branch 'master' into 12475-asyncbuf
Tom Clegg [Sat, 25 Nov 2017 07:16:05 +0000 (02:16 -0500)]
12475: Merge branch 'master' into 12475-asyncbuf

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12475: Return non-nil error at EOF even if len(p)==0.
Tom Clegg [Sat, 25 Nov 2017 07:05:36 +0000 (02:05 -0500)]
12475: Return non-nil error at EOF even if len(p)==0.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12167: Clean up test suite logging.
Tom Clegg [Fri, 24 Nov 2017 21:52:36 +0000 (16:52 -0500)]
12167: Clean up test suite logging.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12167: Propagate X-Request-ID through keepproxy and keepstore.
Tom Clegg [Fri, 24 Nov 2017 21:46:58 +0000 (16:46 -0500)]
12167: Propagate X-Request-ID through keepproxy and keepstore.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12018: Replaced '<' & '>' with their html entities counterparts
Lucas Di Pentima [Fri, 24 Nov 2017 17:23:54 +0000 (14:23 -0300)]
12018: Replaced '<' & '>' with their html entities counterparts

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years agoMerge branch '12627-token-scope'
Tom Clegg [Fri, 24 Nov 2017 15:29:25 +0000 (10:29 -0500)]
Merge branch '12627-token-scope'

fixes #12627

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12627: Any token can permit scope, if acting as the right user.
Tom Clegg [Fri, 24 Nov 2017 06:10:56 +0000 (01:10 -0500)]
12627: Any token can permit scope, if acting as the right user.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12627: Set current_user from first valid reader_token
Tom Clegg [Thu, 23 Nov 2017 18:52:46 +0000 (13:52 -0500)]
12627: Set current_user from first valid reader_token

...if primary session token is missing or invalid.

Workbench relies on this for anonymous access.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12018: Added documentation for arv-sync-groups
Lucas Di Pentima [Thu, 23 Nov 2017 20:53:04 +0000 (17:53 -0300)]
12018: Added documentation for arv-sync-groups

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years agoMerge branch '12519-multisite-project-search'
Lucas Di Pentima [Thu, 23 Nov 2017 19:22:21 +0000 (16:22 -0300)]
Merge branch '12519-multisite-project-search'
Closes #12519

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years ago12519: Code simplification
Lucas Di Pentima [Thu, 23 Nov 2017 19:13:10 +0000 (16:13 -0300)]
12519: Code simplification

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years agoMerge branch '12627-token-scope'
Tom Clegg [Thu, 23 Nov 2017 18:35:39 +0000 (13:35 -0500)]
Merge branch '12627-token-scope'

fixes #12627

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12475: Faster asyncbuf.
Tom Clegg [Thu, 23 Nov 2017 14:33:34 +0000 (09:33 -0500)]
12475: Faster asyncbuf.

Unlock earlier so multiple readers can copy bytes concurrently.

100 readers: improves from 4.5 GB/s to 17 GB/s
1 reader: unchanged 0.75 GB/s

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12475: Add TestManyFailedPuts with a short timeout.
Tom Clegg [Thu, 23 Nov 2017 06:04:38 +0000 (01:04 -0500)]
12475: Add TestManyFailedPuts with a short timeout.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12475: Rewrite streamer -> asyncbuf.
Tom Clegg [Thu, 23 Nov 2017 04:11:43 +0000 (23:11 -0500)]
12475: Rewrite streamer -> asyncbuf.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12627: Ensure current_user relates to the token that permits scope.
Tom Clegg [Wed, 22 Nov 2017 22:49:08 +0000 (17:49 -0500)]
12627: Ensure current_user relates to the token that permits scope.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12519: Remove trailing slash when guessing the workbench url.
Lucas Di Pentima [Wed, 22 Nov 2017 21:34:54 +0000 (18:34 -0300)]
12519: Remove trailing slash when guessing the workbench url.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

7 years ago12616: Fix validate
Peter Amstutz [Tue, 21 Nov 2017 22:42:42 +0000 (17:42 -0500)]
12616: Fix validate

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years agoMerge branch '12377-arvbox-composer' refs #12377
Peter Amstutz [Wed, 22 Nov 2017 20:30:56 +0000 (15:30 -0500)]
Merge branch '12377-arvbox-composer'  refs #12377

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

7 years agoSet composer config. Bump SSO script for updated passenger.
Peter Amstutz [Wed, 22 Nov 2017 19:31:53 +0000 (14:31 -0500)]
Set composer config.  Bump SSO script for updated passenger.

7 years ago12483: Fix cadaver tests.
Tom Clegg [Wed, 22 Nov 2017 17:45:08 +0000 (12:45 -0500)]
12483: Fix cadaver tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12483: Fix multiple WriteHeader(). Skip updates on readonly methods.
Tom Clegg [Wed, 22 Nov 2017 17:32:38 +0000 (12:32 -0500)]
12483: Fix multiple WriteHeader(). Skip updates on readonly methods.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12483: Update comments.
Tom Clegg [Wed, 22 Nov 2017 15:00:14 +0000 (10:00 -0500)]
12483: Update comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

7 years ago12483: Drop writableSegment interface.
Tom Clegg [Wed, 22 Nov 2017 14:57:21 +0000 (09:57 -0500)]
12483: Drop writableSegment interface.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>