arvados.git
6 years agoMerge branch '14198-index-accepts-cluster-id' refs #14198
Peter Amstutz [Thu, 8 Nov 2018 16:03:55 +0000 (11:03 -0500)]
Merge branch '14198-index-accepts-cluster-id' refs #14198

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14439-federation-admin-docs'
Lucas Di Pentima [Wed, 7 Nov 2018 21:11:32 +0000 (18:11 -0300)]
Merge branch '14439-federation-admin-docs'
Refs #14439

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14439: Adds federation configuration page to the admin docs.
Lucas Di Pentima [Wed, 7 Nov 2018 20:43:20 +0000 (17:43 -0300)]
14439: Adds federation configuration page to the admin docs.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14198: Add cluster_id to index parameters
Peter Amstutz [Wed, 7 Nov 2018 19:38:45 +0000 (14:38 -0500)]
14198: Add cluster_id to index parameters

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14455-loofah-upgrade'
Lucas Di Pentima [Tue, 6 Nov 2018 19:29:48 +0000 (16:29 -0300)]
Merge branch '14455-loofah-upgrade'
Closes #14455

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14406-remote-data-in-output'
Tom Clegg [Tue, 6 Nov 2018 19:26:56 +0000 (14:26 -0500)]
Merge branch '14406-remote-data-in-output'

refs #14406

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14406: Merge branch 'master'
Tom Clegg [Tue, 6 Nov 2018 18:58:53 +0000 (13:58 -0500)]
14406: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14455: Update loofah & nokogiri on workbench & api for security reasons.
Lucas Di Pentima [Tue, 6 Nov 2018 18:41:07 +0000 (15:41 -0300)]
14455: Update loofah & nokogiri on workbench & api for security reasons.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14406: Only call LocalLocator() once per block per stream.
Tom Clegg [Tue, 6 Nov 2018 16:13:05 +0000 (11:13 -0500)]
14406: Only call LocalLocator() once per block per stream.

Avoid excess calls when many files are packed in a single block.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14406: Copy remote blocks to local storage during MarshalManifest.
Tom Clegg [Mon, 5 Nov 2018 14:58:40 +0000 (09:58 -0500)]
14406: Copy remote blocks to local storage during MarshalManifest.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14262-remote-container' refs #14262
Peter Amstutz [Thu, 1 Nov 2018 19:57:09 +0000 (15:57 -0400)]
Merge branch '14262-remote-container' refs #14262

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14406: Tone down slow stress test.
Tom Clegg [Thu, 1 Nov 2018 19:22:36 +0000 (15:22 -0400)]
14406: Tone down slow stress test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14262: Avoid out-of-bounds panics checking cluster prefixes
Peter Amstutz [Thu, 1 Nov 2018 19:14:14 +0000 (15:14 -0400)]
14262: Avoid out-of-bounds panics checking cluster prefixes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14406: Remove debug printfs.
Tom Clegg [Thu, 1 Nov 2018 18:54:13 +0000 (14:54 -0400)]
14406: Remove debug printfs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14262: Fix remote_user_test.rb so it doesn't mess up remote_hosts
Peter Amstutz [Thu, 1 Nov 2018 18:53:37 +0000 (14:53 -0400)]
14262: Fix remote_user_test.rb so it doesn't mess up remote_hosts

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14406: Fix safety warning.
Tom Clegg [Thu, 1 Nov 2018 17:56:59 +0000 (13:56 -0400)]
14406: Fix safety warning.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14406: Pass output through collectionFS if it has remote block refs.
Tom Clegg [Thu, 1 Nov 2018 17:56:13 +0000 (13:56 -0400)]
14406: Pass output through collectionFS if it has remote block refs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14262: Revert changes to client.go
Peter Amstutz [Thu, 1 Nov 2018 15:04:01 +0000 (11:04 -0400)]
14262: Revert changes to client.go

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14262: Move the context deadline to the top of the handler stack
Peter Amstutz [Thu, 1 Nov 2018 14:19:18 +0000 (10:19 -0400)]
14262: Move the context deadline to the top of the handler stack

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14262: Fix permissions so runtime_token can set container progress/output
Peter Amstutz [Wed, 31 Oct 2018 20:40:19 +0000 (16:40 -0400)]
14262: Fix permissions so runtime_token can set container progress/output

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14262: Only create runtime_token on home cluster for the authorization
Peter Amstutz [Wed, 31 Oct 2018 17:45:58 +0000 (13:45 -0400)]
14262: Only create runtime_token on home cluster for the authorization

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14262: Fix spillover of tests changing remote_hosts
Peter Amstutz [Wed, 31 Oct 2018 16:53:25 +0000 (12:53 -0400)]
14262: Fix spillover of tests changing remote_hosts

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14262: Rewrite collectionFederatedRequestHandler PDH search to use channels
Peter Amstutz [Mon, 29 Oct 2018 21:09:08 +0000 (17:09 -0400)]
14262: Rewrite collectionFederatedRequestHandler PDH search to use channels

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14262: Make sure cancel() from proxy.Do() gets called
Peter Amstutz [Mon, 29 Oct 2018 19:36:45 +0000 (15:36 -0400)]
14262: Make sure cancel() from proxy.Do() gets called

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14262: Only allow unknown PDH for images when there are remote_hosts
Peter Amstutz [Mon, 29 Oct 2018 18:56:26 +0000 (14:56 -0400)]
14262: Only allow unknown PDH for images when there are remote_hosts

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14262: Fix logic for when to allow unknown PDH for containers
Peter Amstutz [Wed, 24 Oct 2018 19:30:34 +0000 (15:30 -0400)]
14262: Fix logic for when to allow unknown PDH for containers

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14198: Fix error responses in container POST
Peter Amstutz [Wed, 24 Oct 2018 18:44:25 +0000 (14:44 -0400)]
14198: Fix error responses in container POST

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14262: Handle container_request posted as a string parameter
Peter Amstutz [Tue, 23 Oct 2018 18:30:39 +0000 (14:30 -0400)]
14262: Handle container_request posted as a string parameter

Needs to be parsed as json second time (this is how the Ruby 'arv'
client submits it, unfortunately.)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14262: Fix crunch-run tests
Peter Amstutz [Tue, 23 Oct 2018 17:29:53 +0000 (13:29 -0400)]
14262: Fix crunch-run tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14262: Missing file
Peter Amstutz [Tue, 23 Oct 2018 13:26:48 +0000 (09:26 -0400)]
14262: Missing file

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14262: Fix tests
Peter Amstutz [Mon, 22 Oct 2018 21:01:52 +0000 (17:01 -0400)]
14262: Fix tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14262: Tests for setting and checking container tokens.
Peter Amstutz [Mon, 22 Oct 2018 16:13:38 +0000 (12:13 -0400)]
14262: Tests for setting and checking container tokens.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14262: Add createAPIToken, with test
Peter Amstutz [Mon, 22 Oct 2018 15:02:02 +0000 (11:02 -0400)]
14262: Add createAPIToken, with test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14262: Refactoring, split up federation code into smaller files
Peter Amstutz [Thu, 18 Oct 2018 21:17:33 +0000 (17:17 -0400)]
14262: Refactoring, split up federation code into smaller files

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14262: Refactoring proxy
Peter Amstutz [Thu, 18 Oct 2018 20:08:28 +0000 (16:08 -0400)]
14262: Refactoring proxy

Split proxy.Do() into ForwardRequest() and ForwardResponse().

Inversion of control eliminates need for "filter" callback, since the
caller can now modify the response in between the calls to
ForwardRequest() and ForwardResponse().

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14262: Fix bug moving api_token to header
Peter Amstutz [Thu, 18 Oct 2018 18:34:49 +0000 (14:34 -0400)]
14262: Fix bug moving api_token to header

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14262: Use container token for access to load Docker image
Peter Amstutz [Tue, 16 Oct 2018 19:43:12 +0000 (15:43 -0400)]
14262: Use container token for access to load Docker image

Previously used Dispatcher token, which created a security race
condition (you couldn't set a container image that you didn't have
access to, but if your access was revoked it the meantime, the
container would still run.)

Also tweaked API server to allow a PDH for the container image spec
with no further checking (so the API server doesn't have to go out and
search the federation.)  This is no longer a security hazard since it
is now using a user token and not the dispatcher token.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14262: saltAuthToken returns copy of request object
Peter Amstutz [Tue, 16 Oct 2018 18:51:12 +0000 (14:51 -0400)]
14262: saltAuthToken returns copy of request object

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14259-pysdk-remote-block-copy'
Lucas Di Pentima [Tue, 30 Oct 2018 18:00:44 +0000 (15:00 -0300)]
Merge branch '14259-pysdk-remote-block-copy'
Refs #14259

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14259: Collection class copies remote blocks when saving.
Lucas Di Pentima [Tue, 30 Oct 2018 12:19:49 +0000 (09:19 -0300)]
14259: Collection class copies remote blocks when saving.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMake sure keep-balance gets started with the lowest possible system priority by
Ward Vandewege [Mon, 29 Oct 2018 19:56:34 +0000 (15:56 -0400)]
Make sure keep-balance gets started with the lowest possible system priority by
default.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoFix typos.
Ward Vandewege [Fri, 26 Oct 2018 20:08:05 +0000 (16:08 -0400)]
Fix typos.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoAdd a new release note for v1.2.0.
Ward Vandewege [Fri, 26 Oct 2018 19:51:44 +0000 (15:51 -0400)]
Add a new release note for v1.2.0.

Reorganize release note page to reflect stable version releases.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoMerge branch '14328-watch-docker-ps'
Tom Clegg [Fri, 26 Oct 2018 17:14:38 +0000 (13:14 -0400)]
Merge branch '14328-watch-docker-ps'

refs #14328

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMake geckodriver sanity check non-fatal.
Tom Clegg [Fri, 26 Oct 2018 00:54:00 +0000 (20:54 -0400)]
Make geckodriver sanity check non-fatal.

Allows non-workbench test runs to pass without geckodriver.

refs #14407

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoFix crash in test cleanup.
Tom Clegg [Fri, 26 Oct 2018 00:49:48 +0000 (20:49 -0400)]
Fix crash in test cleanup.

refs #14407

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14398-error-deadlock'
Tom Clegg [Thu, 25 Oct 2018 21:46:54 +0000 (17:46 -0400)]
Merge branch '14398-error-deadlock'

fixes #14398

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14328: Check ContainerInspect instead of List, give up on error.
Tom Clegg [Thu, 25 Oct 2018 21:44:14 +0000 (17:44 -0400)]
14328: Check ContainerInspect instead of List, give up on error.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14259: Move & improve test.
Lucas Di Pentima [Thu, 25 Oct 2018 21:33:53 +0000 (18:33 -0300)]
14259: Move & improve test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14407-selenium'
Tom Clegg [Thu, 25 Oct 2018 21:12:36 +0000 (17:12 -0400)]
Merge branch '14407-selenium'

refs #14407

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14388-overreplication'
Tom Clegg [Thu, 25 Oct 2018 20:00:09 +0000 (16:00 -0400)]
Merge branch '14388-overreplication'

fixes #14388

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14407: Add geckodriver to arvbox image.
Tom Clegg [Thu, 25 Oct 2018 19:56:43 +0000 (15:56 -0400)]
14407: Add geckodriver to arvbox image.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14407: Fix "too much recursion" error.
Tom Clegg [Thu, 25 Oct 2018 19:52:21 +0000 (15:52 -0400)]
14407: Fix "too much recursion" error.

The recursion error comes from evaluate_script() trying to serialize
the magical jQuery response. We don't need to see that response so
we can use execute_script() instead.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14407: Upgrade selenium-webdriver, add geckodriver.
Tom Clegg [Thu, 25 Oct 2018 19:24:28 +0000 (15:24 -0400)]
14407: Upgrade selenium-webdriver, add geckodriver.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14398: Fix deadlock on error in GetCurrentState.
Tom Clegg [Wed, 24 Oct 2018 19:59:31 +0000 (15:59 -0400)]
14398: Fix deadlock on error in GetCurrentState.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14388: Merge branch 'master' into 14388-overreplication
Tom Clegg [Wed, 24 Oct 2018 17:03:20 +0000 (13:03 -0400)]
14388: Merge branch 'master' into 14388-overreplication

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14299-keep-balance-past-versions'
Lucas Di Pentima [Wed, 24 Oct 2018 16:16:34 +0000 (13:16 -0300)]
Merge branch '14299-keep-balance-past-versions'
Closes #14299

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14299: Use include_old_versions in keep-balance to avoid losing blocks.
Lucas Di Pentima [Tue, 23 Oct 2018 22:19:07 +0000 (19:19 -0300)]
14299: Use include_old_versions in keep-balance to avoid losing blocks.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14388: Don't prefer positions that are only temporarily untrashable.
Tom Clegg [Tue, 23 Oct 2018 18:30:42 +0000 (14:30 -0400)]
14388: Don't prefer positions that are only temporarily untrashable.

If old copies exist in the preferred positions, and a new copy is
written to a worse position, keep the old copies and wait for the new
copy to become eligible for trash.

Previously, an old copy would be deleted. This would bring replication
down to the desired level in the short term, but would also cause
extra pulling/copying in the future to restore the optimal copy, and
introduce extra probes for all clients in the meantime.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14388: Fix typo.
Tom Clegg [Tue, 23 Oct 2018 18:28:39 +0000 (14:28 -0400)]
14388: Fix typo.

Condition (si.want != si.want) should have been (si.want != sj.want).

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14388: Fix log message.
Tom Clegg [Tue, 23 Oct 2018 18:25:37 +0000 (14:25 -0400)]
14388: Fix log message.

When a volume with replication=2 has 15 objects, report them as "15
entries / 2x / 30 replicas", rather than "15 replicas", so the numbers
agree with the other logs/stats about replica counts.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14328: Check broken-node blacklist when watchdog hits errors.
Tom Clegg [Tue, 23 Oct 2018 15:52:45 +0000 (11:52 -0400)]
14328: Check broken-node blacklist when watchdog hits errors.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14259: Add method to keep client to request remote block copy via HEAD request.
Lucas Di Pentima [Tue, 23 Oct 2018 15:50:29 +0000 (12:50 -0300)]
14259: Add method to keep client to request remote block copy via HEAD request.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '13561-collection-versions-doc'
Lucas Di Pentima [Tue, 23 Oct 2018 13:56:18 +0000 (10:56 -0300)]
Merge branch '13561-collection-versions-doc'
Closes #13561

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Rephrased some sentences to avoid confusion.
Lucas Di Pentima [Tue, 23 Oct 2018 13:55:12 +0000 (10:55 -0300)]
13561: Rephrased some sentences to avoid confusion.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '13561-trashed-collection-versions-fix'
Lucas Di Pentima [Mon, 22 Oct 2018 16:29:27 +0000 (13:29 -0300)]
Merge branch '13561-trashed-collection-versions-fix'
Refs #13561

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Formatting fixes, examples enhancements & additions.
Lucas Di Pentima [Mon, 22 Oct 2018 15:21:55 +0000 (12:21 -0300)]
13561: Formatting fixes, examples enhancements & additions.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14260-expired-token-delete' refs #14260
Peter Amstutz [Fri, 19 Oct 2018 14:11:33 +0000 (10:11 -0400)]
Merge branch '14260-expired-token-delete' refs #14260

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Use straight SQL DELETE instead of destroy_all
Peter Amstutz [Fri, 19 Oct 2018 14:06:50 +0000 (10:06 -0400)]
14260: Use straight SQL DELETE instead of destroy_all

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14328: Cancel if container ends but ContainerWait does not return.
Tom Clegg [Fri, 19 Oct 2018 04:38:49 +0000 (00:38 -0400)]
14328: Cancel if container ends but ContainerWait does not return.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13561: Code cleanup.
Lucas Di Pentima [Thu, 18 Oct 2018 23:20:19 +0000 (20:20 -0300)]
13561: Code cleanup.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Exclude past versions regardless of user & include_trash setting.
Lucas Di Pentima [Thu, 18 Oct 2018 22:46:18 +0000 (19:46 -0300)]
13561: Exclude past versions regardless of user & include_trash setting.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14260-runtime-token' refs #14260
Peter Amstutz [Thu, 18 Oct 2018 17:44:35 +0000 (13:44 -0400)]
Merge branch '14260-runtime-token' refs #14260

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14366-crunch2-upgrade' refs #14366
Peter Amstutz [Thu, 18 Oct 2018 17:42:13 +0000 (13:42 -0400)]
Merge branch '14366-crunch2-upgrade' refs #14366

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Remove redundant schema_migrations in structure.sql
Peter Amstutz [Thu, 18 Oct 2018 17:18:19 +0000 (13:18 -0400)]
14260: Remove redundant schema_migrations in structure.sql

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Sort runtime_auth_scopes
Peter Amstutz [Thu, 18 Oct 2018 16:20:50 +0000 (12:20 -0400)]
14260: Sort runtime_auth_scopes

Container.for_current_token returns nil or a Container (not an active
record query).

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch 'master' into 14260-runtime-token
Peter Amstutz [Thu, 18 Oct 2018 15:58:57 +0000 (11:58 -0400)]
Merge branch 'master' into 14260-runtime-token

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13561: Re-phrase user guide & add admin guide section.
Lucas Di Pentima [Wed, 10 Oct 2018 20:12:27 +0000 (17:12 -0300)]
13561: Re-phrase user guide & add admin guide section.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Update documentation on collection versioning.
Lucas Di Pentima [Fri, 5 Oct 2018 18:55:41 +0000 (15:55 -0300)]
13561: Update documentation on collection versioning.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '13561-collection-versions-fixes'
Lucas Di Pentima [Wed, 17 Oct 2018 20:12:48 +0000 (17:12 -0300)]
Merge branch '13561-collection-versions-fixes'
Refs #13561

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14366: Add "upgrade to containers api" to "upgrading" section
Peter Amstutz [Wed, 17 Oct 2018 19:54:00 +0000 (15:54 -0400)]
14366: Add "upgrade to containers api" to "upgrading" section

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14366: Improve wording of "upgrading to containers API" section
Peter Amstutz [Wed, 17 Oct 2018 19:43:15 +0000 (15:43 -0400)]
14366: Improve wording of "upgrading to containers API" section

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13561: Raise exception instead of ignoring versioning attributes updates.
Lucas Di Pentima [Wed, 17 Oct 2018 18:51:36 +0000 (15:51 -0300)]
13561: Raise exception instead of ignoring versioning attributes updates.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Fixes api to get a collection with its past versions.
Lucas Di Pentima [Wed, 17 Oct 2018 18:05:50 +0000 (15:05 -0300)]
13561: Fixes api to get a collection with its past versions.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoFor the package test docker images, sanitize how we get the rvm GPG key,
Ward Vandewege [Wed, 17 Oct 2018 01:38:54 +0000 (21:38 -0400)]
For the package test docker images, sanitize how we get the rvm GPG key,
and remove a dependency on the GPG keyservers which are flakey.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoAdd a systemd service file to arvados-node-manager.
Ward Vandewege [Tue, 16 Oct 2018 20:49:15 +0000 (16:49 -0400)]
Add a systemd service file to arvados-node-manager.

Reset package iteration number for arvados-node-manager to version 1.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoRemove spurious output from run-build-packages.sh
Ward Vandewege [Tue, 16 Oct 2018 20:38:01 +0000 (16:38 -0400)]
Remove spurious output from run-build-packages.sh

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14344: bump package version for arvados-docker-cleaner so that we get a new
Ward Vandewege [Tue, 16 Oct 2018 20:37:00 +0000 (16:37 -0400)]
14344: bump package version for arvados-docker-cleaner so that we get a new
package built with the systemd service file.

refs #14344

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14344: Merge branch '14344-fix-rpm-vs-deb-detection'
Ward Vandewege [Tue, 16 Oct 2018 19:48:44 +0000 (15:48 -0400)]
14344: Merge branch '14344-fix-rpm-vs-deb-detection'

closes #14344

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14344: Move "set -e" back to top.
Tom Clegg [Tue, 16 Oct 2018 13:35:17 +0000 (09:35 -0400)]
14344: Move "set -e" back to top.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoFix the detection of rpm vs deb systems.
Ward Vandewege [Tue, 16 Oct 2018 01:49:30 +0000 (21:49 -0400)]
Fix the detection of rpm vs deb systems.

refs #14344

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoMerge branch '14285-keep-balance-metrics'
Tom Clegg [Tue, 16 Oct 2018 17:24:04 +0000 (13:24 -0400)]
Merge branch '14285-keep-balance-metrics'

closes #14285

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14285: Update admin/metrics docs.
Tom Clegg [Mon, 15 Oct 2018 21:36:03 +0000 (17:36 -0400)]
14285: Update admin/metrics docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14285: Add deduplication ratio to keep-balance metrics.
Tom Clegg [Mon, 15 Oct 2018 21:02:22 +0000 (17:02 -0400)]
14285: Add deduplication ratio to keep-balance metrics.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoFix missing namespace in metric names.
Tom Clegg [Tue, 16 Oct 2018 15:41:54 +0000 (11:41 -0400)]
Fix missing namespace in metric names.

refs #14285

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoRevert change to setup.py for arvados-docker-cleaner, pip doesn't agree with
Ward Vandewege [Mon, 15 Oct 2018 23:06:17 +0000 (19:06 -0400)]
Revert change to setup.py for arvados-docker-cleaner, pip doesn't agree with
it...

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14260: secret_mounts works with runtime_token (really this time)
Peter Amstutz [Mon, 15 Oct 2018 21:11:11 +0000 (17:11 -0400)]
14260: secret_mounts works with runtime_token (really this time)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14338-workbench-flag-to-disable-repositories'
Ward Vandewege [Mon, 15 Oct 2018 21:06:04 +0000 (17:06 -0400)]
Merge branch '14338-workbench-flag-to-disable-repositories'

closes #14338

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoAdd a flag to hide repositories entries in the Workbench menus. This is useful
Ward Vandewege [Fri, 12 Oct 2018 15:15:44 +0000 (11:15 -0400)]
Add a flag to hide repositories entries in the Workbench menus. This is useful
in a scenario where the jobs api is disabled and there are no local git
repositories. Local git repositories are optional when using the containers api.

refs #14338

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14260: secret_mounts works with runtime_token
Peter Amstutz [Mon, 15 Oct 2018 20:53:40 +0000 (16:53 -0400)]
14260: secret_mounts works with runtime_token

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>