arvados.git
6 years ago14285: Add keep-balance to health aggregator test stub.
Tom Clegg [Fri, 12 Oct 2018 18:56:51 +0000 (14:56 -0400)]
14285: Add keep-balance to health aggregator test stub.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14260: Don't set auth_uuid when runtime_token is set.
Peter Amstutz [Fri, 12 Oct 2018 18:46:02 +0000 (14:46 -0400)]
14260: Don't set auth_uuid when runtime_token is set.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14285: Add keep-balance to example cluster config.
Tom Clegg [Fri, 12 Oct 2018 17:56:22 +0000 (13:56 -0400)]
14285: Add keep-balance to example cluster config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14285: Add token middleware. Require management token for metrics.
Tom Clegg [Fri, 12 Oct 2018 17:52:08 +0000 (13:52 -0400)]
14285: Add token middleware. Require management token for metrics.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14285: Update sample config.
Tom Clegg [Fri, 12 Oct 2018 14:04:04 +0000 (10:04 -0400)]
14285: Update sample config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14285: Split Server to server.go.
Tom Clegg [Fri, 12 Oct 2018 14:01:50 +0000 (10:01 -0400)]
14285: Split Server to server.go.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14260: Added runtime_token to container record
Peter Amstutz [Thu, 11 Oct 2018 22:27:51 +0000 (18:27 -0400)]
14260: Added runtime_token to container record

* runtime_token, runtime_user_uuid and runtime_auth_scopes are now
  part of container initialization and reuse decisions

* Determine runtime_user_uuid and runtime_auth_scopes as part of
  Container.resolve

* Use runtime_user_uuid to create container token (when runtime_token
  is not set)

* act_as runtime_user_uuid when resolving container request fields

* tokens used for runtime_token will be left untouched (remove expire_destroy)

* added/updated/fixed tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13561-collection-versions-api'
Lucas Di Pentima [Thu, 11 Oct 2018 18:36:03 +0000 (15:36 -0300)]
Merge branch '13561-collection-versions-api'
Refs #13561

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Move versioning code inside locking block.
Lucas Di Pentima [Thu, 11 Oct 2018 16:17:47 +0000 (13:17 -0300)]
13561: Move versioning code inside locking block.

Also, don't allow current_version_uuid updates on current versions.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Fix validation & update related test.
Lucas Di Pentima [Thu, 11 Oct 2018 14:09:37 +0000 (11:09 -0300)]
13561: Fix validation & update related test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14260: runtime_token goes in container auth
Peter Amstutz [Thu, 11 Oct 2018 14:08:08 +0000 (10:08 -0400)]
14260: runtime_token goes in container auth

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Test container runtime_token
Peter Amstutz [Wed, 10 Oct 2018 19:58:21 +0000 (15:58 -0400)]
14260: Test container runtime_token

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Container runtime token wip
Peter Amstutz [Fri, 5 Oct 2018 20:40:33 +0000 (16:40 -0400)]
14260: Container runtime token wip

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Migration adding runtime_token, runtime_user_uuid, runtime_auth_scopes
Peter Amstutz [Fri, 5 Oct 2018 19:31:08 +0000 (15:31 -0400)]
14260: Migration adding runtime_token, runtime_user_uuid, runtime_auth_scopes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13561: Refactor version creation & sync logic.
Lucas Di Pentima [Wed, 10 Oct 2018 01:16:30 +0000 (22:16 -0300)]
13561: Refactor version creation & sync logic.

* Avoid overriding save! and move code to collection's callbacks.
* Use around_update to make the necessary actions and get a lock before saving.
* Arrange version creation and syncing actions so that they happen after the
  current version's update.
* Update test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14199-copy-from-remote'
Tom Clegg [Tue, 9 Oct 2018 20:07:44 +0000 (16:07 -0400)]
Merge branch '14199-copy-from-remote'

refs #14199

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14199: Reduce logging noise from azure test stubs.
Tom Clegg [Tue, 9 Oct 2018 20:07:17 +0000 (16:07 -0400)]
14199: Reduce logging noise from azure test stubs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14199: Merge branch 'master' into 14199-copy-from-remote
Tom Clegg [Tue, 9 Oct 2018 19:56:26 +0000 (15:56 -0400)]
14199: Merge branch 'master' into 14199-copy-from-remote

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14285: Update metrics doc page.
Tom Clegg [Tue, 9 Oct 2018 19:51:38 +0000 (15:51 -0400)]
14285: Update metrics doc page.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14196-api-v2-tokens' refs #14196
Peter Amstutz [Tue, 9 Oct 2018 19:20:38 +0000 (15:20 -0400)]
Merge branch '14196-api-v2-tokens' refs #14196

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14196: Revert debug change to Access-Control-Max-Age
Peter Amstutz [Tue, 9 Oct 2018 19:19:31 +0000 (15:19 -0400)]
14196: Revert debug change to Access-Control-Max-Age

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14274-factory-bot' closes #14274
Peter Amstutz [Tue, 9 Oct 2018 19:16:09 +0000 (15:16 -0400)]
Merge branch '14274-factory-bot' closes #14274

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14199: Abandon processing sooner if client disconnects.
Tom Clegg [Tue, 9 Oct 2018 15:36:52 +0000 (11:36 -0400)]
14199: Abandon processing sooner if client disconnects.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14199: Rename (*remoteResponseCacher)Flush -> Close.
Tom Clegg [Tue, 9 Oct 2018 15:24:44 +0000 (11:24 -0400)]
14199: Rename (*remoteResponseCacher)Flush -> Close.

Finalizing the caching writer is more like Close: it can only happen
once, and only after all Writes are done.  Flush means something
different, especially in http.ResponseWriter context.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14199: Require "X-Keep-Signature: local[, ...]" to invoke signing.
Tom Clegg [Tue, 9 Oct 2018 15:19:16 +0000 (11:19 -0400)]
14199: Require "X-Keep-Signature: local[, ...]" to invoke signing.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14285: Export stats as prometheus metrics.
Tom Clegg [Mon, 8 Oct 2018 20:43:40 +0000 (16:43 -0400)]
14285: Export stats as prometheus metrics.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoarvbox fix "can't write to /dev/stderr" message no issue #
Peter Amstutz [Fri, 5 Oct 2018 18:09:30 +0000 (14:09 -0400)]
arvbox fix "can't write to /dev/stderr" message no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch 'master' into 13561-collection-versions-api
Lucas Di Pentima [Fri, 5 Oct 2018 13:09:16 +0000 (10:09 -0300)]
Merge branch 'master' into 13561-collection-versions-api

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '12690-12748-crunchstat-summary'
Peter Amstutz [Fri, 5 Oct 2018 01:36:05 +0000 (21:36 -0400)]
Merge branch '12690-12748-crunchstat-summary'

refs #12690
refs #12748
refs #13759

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14196: Multi-site search works with v2 tokens.
Peter Amstutz [Fri, 5 Oct 2018 01:27:33 +0000 (21:27 -0400)]
14196: Multi-site search works with v2 tokens.

Also update workbench tests use v2 tokens.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13561: Allow request old collection version by UUID.
Lucas Di Pentima [Fri, 5 Oct 2018 00:49:25 +0000 (21:49 -0300)]
13561: Allow request old collection version by UUID.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Ignore version & current_version_uuid parama on API create endpoint.
Lucas Di Pentima [Thu, 4 Oct 2018 21:55:40 +0000 (18:55 -0300)]
13561: Ignore version & current_version_uuid parama on API create endpoint.

Also, updated discovery doc to include 'include_old_versions' param on index.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Avoid permission links to be attached to past collection versions.
Lucas Di Pentima [Thu, 4 Oct 2018 18:54:18 +0000 (15:54 -0300)]
13561: Avoid permission links to be attached to past collection versions.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Expand index API to include past versions.
Lucas Di Pentima [Thu, 4 Oct 2018 18:22:31 +0000 (15:22 -0300)]
13561: Expand index API to include past versions.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14199: Fix deadlock in test suite.
Tom Clegg [Thu, 4 Oct 2018 18:01:00 +0000 (14:01 -0400)]
14199: Fix deadlock in test suite.

If a KeepClient has been created using an API server address that is
no longer reachable, calling keepclient.RefreshServiceDiscovery() puts
the poll() goroutine into an endless retry loop, and a second call
never returns because ent.clear is never ready to receive.

Work around this in the pull worker tests by only refreshing services
from the API server actually being used, not on additional ones
referenced by previous test cases.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14199: Drop Vary response header for non-proxyable requests.
Tom Clegg [Thu, 4 Oct 2018 14:15:22 +0000 (10:15 -0400)]
14199: Drop Vary response header for non-proxyable requests.

The X-Keep-Signature header is ignored for such requests anyway.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14199: Store data if X-Keep-Signature given in proxied GET/HEAD req.
Tom Clegg [Thu, 4 Oct 2018 05:27:19 +0000 (01:27 -0400)]
14199: Store data if X-Keep-Signature given in proxied GET/HEAD req.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12690 & 12748: Read stats from arv-mount.txt
Peter Amstutz [Wed, 3 Oct 2018 20:38:30 +0000 (16:38 -0400)]
12690 & 12748: Read stats from arv-mount.txt

* Compute elapsed time for containers correctly
* Update tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13561: Avoid collections.index to include old versions
Lucas Di Pentima [Wed, 3 Oct 2018 20:11:38 +0000 (17:11 -0300)]
13561: Avoid collections.index to include old versions

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14199: Refactor test case.
Tom Clegg [Wed, 3 Oct 2018 19:54:45 +0000 (15:54 -0400)]
14199: Refactor test case.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoDocumentation tweaks. Point at Biostars as the forum to discuss Arvados
Ward Vandewege [Wed, 3 Oct 2018 18:01:27 +0000 (14:01 -0400)]
Documentation tweaks. Point at Biostars as the forum to discuss Arvados
questions.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14274: Fix FactoryGirl deprication warning (renamed to FactoryBot)
Peter Amstutz [Tue, 2 Oct 2018 17:56:16 +0000 (13:56 -0400)]
14274: Fix FactoryGirl deprication warning (renamed to FactoryBot)

Also fix "mocha/mini_test" -> "mocha/minitest" warning.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13619-fed-object-list' closes #13619
Peter Amstutz [Wed, 3 Oct 2018 13:23:30 +0000 (09:23 -0400)]
Merge branch '13619-fed-object-list' closes #13619

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14196: Don't crash if element of params[:reader_tokens] is not a String
Peter Amstutz [Tue, 2 Oct 2018 21:14:59 +0000 (17:14 -0400)]
14196: Don't crash if element of params[:reader_tokens] is not a String

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13619: Move configuration options to arvados.Cluster.RequestLimits
Peter Amstutz [Tue, 2 Oct 2018 20:50:07 +0000 (16:50 -0400)]
13619: Move configuration options to arvados.Cluster.RequestLimits

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14201-exclude-home-project' closes #14201
Peter Amstutz [Tue, 2 Oct 2018 18:05:51 +0000 (14:05 -0400)]
Merge branch '14201-exclude-home-project' closes #14201

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13561: Save new version when preserve_version==true or config idle time is up.
Lucas Di Pentima [Tue, 2 Oct 2018 17:51:35 +0000 (14:51 -0300)]
13561: Save new version when preserve_version==true or config idle time is up.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14196: Login process returns v2 tokens
Peter Amstutz [Tue, 2 Oct 2018 17:18:33 +0000 (13:18 -0400)]
14196: Login process returns v2 tokens

Unit/functional/integration tests now use v2 tokens by default.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14201: Make exclude_home protected, deduplicate owner uuids
Peter Amstutz [Mon, 1 Oct 2018 20:13:24 +0000 (16:13 -0400)]
14201: Make exclude_home protected, deduplicate owner uuids

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13619: Code cleanups
Peter Amstutz [Mon, 1 Oct 2018 19:48:51 +0000 (15:48 -0400)]
13619: Code cleanups

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '10181-incremental-log'
Tom Clegg [Mon, 1 Oct 2018 19:43:50 +0000 (15:43 -0400)]
Merge branch '10181-incremental-log'

refs #10181

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14201: add exclude_home_project to 'contents' endpoint
Peter Amstutz [Mon, 1 Oct 2018 17:41:44 +0000 (13:41 -0400)]
14201: add exclude_home_project to 'contents' endpoint

Adds tests and documentation.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13561: Old collection version's modified_at reflects version's create time.
Lucas Di Pentima [Mon, 1 Oct 2018 17:32:12 +0000 (14:32 -0300)]
13561: Old collection version's modified_at reflects version's create time.

Don't update this field when syncing past versions' fields with selected
current updates.
Also, keep created_at the same as the current version when snapshotting.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago10181: Merge branch 'master' into 10181-incremental-log
Tom Clegg [Mon, 1 Oct 2018 17:28:57 +0000 (13:28 -0400)]
10181: Merge branch 'master' into 10181-incremental-log

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoa-c-r recognizes that http and https needs to be uploaded to keep
Peter Amstutz [Sat, 29 Sep 2018 15:17:29 +0000 (11:17 -0400)]
a-c-r recognizes that http and https needs to be uploaded to keep

refs #13573

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13561: Avoid old versions to be updated, with test.
Lucas Di Pentima [Sat, 29 Sep 2018 13:20:24 +0000 (10:20 -0300)]
13561: Avoid old versions to be updated, with test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago10181: Restore container's ability to update its own runtime_status.
Tom Clegg [Fri, 28 Sep 2018 20:21:42 +0000 (16:21 -0400)]
10181: Restore container's ability to update its own runtime_status.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13619: Document availability of federation features
Peter Amstutz [Fri, 28 Sep 2018 20:02:19 +0000 (16:02 -0400)]
13619: Document availability of federation features

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13619: Test error reporting when one of the federates fails
Peter Amstutz [Fri, 28 Sep 2018 18:52:40 +0000 (14:52 -0400)]
13619: Test error reporting when one of the federates fails

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago10181: Don't set log collection is_trashed until final save.
Tom Clegg [Fri, 28 Sep 2018 18:40:05 +0000 (14:40 -0400)]
10181: Don't set log collection is_trashed until final save.

Setting is_trashed prevents subsequent updates.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13619: More tests for paging, error conditions
Peter Amstutz [Fri, 28 Sep 2018 18:32:35 +0000 (14:32 -0400)]
13619: More tests for paging, error conditions

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13619: Test that "select" is passed through multi-object query
Peter Amstutz [Thu, 27 Sep 2018 21:23:45 +0000 (17:23 -0400)]
13619: Test that "select" is passed through multi-object query

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13619: Polish error handling
Peter Amstutz [Thu, 27 Sep 2018 21:00:29 +0000 (17:00 -0400)]
13619: Polish error handling

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago10181: Fix up redundant error message.
Tom Clegg [Thu, 27 Sep 2018 20:56:41 +0000 (16:56 -0400)]
10181: Fix up redundant error message.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13619: Support [uuid, =, ...], cleanups
Peter Amstutz [Thu, 27 Sep 2018 20:44:53 +0000 (16:44 -0400)]
13619: Support [uuid, =, ...], cleanups

Remove call to code that looks for cluster_id from json payload of
POST, the SDKs don't generate this (cluster_id goes in the URL query
string or form encoded).

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13619: Clean up, require count=none
Peter Amstutz [Thu, 27 Sep 2018 18:52:22 +0000 (14:52 -0400)]
13619: Clean up, require count=none

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13619: MultiClusterQuery passes test
Peter Amstutz [Thu, 27 Sep 2018 16:29:35 +0000 (12:29 -0400)]
13619: MultiClusterQuery passes test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13619: Federated multi-object list wip
Peter Amstutz [Thu, 27 Sep 2018 14:53:22 +0000 (10:53 -0400)]
13619: Federated multi-object list wip

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14236-delete-last-file'
Tom Clegg [Thu, 27 Sep 2018 14:03:40 +0000 (10:03 -0400)]
Merge branch '14236-delete-last-file'

fixes #14236

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago10181: Rename configs, add to API server config, support SIGUSR1.
Tom Clegg [Wed, 26 Sep 2018 20:19:16 +0000 (16:19 -0400)]
10181: Rename configs, add to API server config, support SIGUSR1.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoAdd missing copyright headers.
Tom Clegg [Wed, 26 Sep 2018 16:13:06 +0000 (12:13 -0400)]
Add missing copyright headers.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13561: Sync selected fields changes with older versions, with tests.
Lucas Di Pentima [Tue, 25 Sep 2018 21:44:56 +0000 (18:44 -0300)]
13561: Sync selected fields changes with older versions, with tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago10181: Fix overloaded Size method.
Tom Clegg [Tue, 25 Sep 2018 20:57:55 +0000 (16:57 -0400)]
10181: Fix overloaded Size method.

The method recently added to *dirnode is now TreeSize, rather than
overloading the non-recursive Size method of the inode interface.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago10181: Merge branch 'master' into 10181-incremental-log
Tom Clegg [Tue, 25 Sep 2018 18:51:32 +0000 (14:51 -0400)]
10181: Merge branch 'master' into 10181-incremental-log

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago10181: Keep CR logs synchronized with container logs while running.
Tom Clegg [Tue, 25 Sep 2018 18:50:44 +0000 (14:50 -0400)]
10181: Keep CR logs synchronized with container logs while running.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14197-federated-containers' refs #14197
Peter Amstutz [Tue, 25 Sep 2018 15:22:05 +0000 (11:22 -0400)]
Merge branch '14197-federated-containers' refs #14197

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14197: Another test checking uuid from federated container request.
Peter Amstutz [Mon, 24 Sep 2018 20:56:59 +0000 (16:56 -0400)]
14197: Another test checking uuid from federated container request.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14197: Federated container request test tweaks
Peter Amstutz [Mon, 24 Sep 2018 20:53:40 +0000 (16:53 -0400)]
14197: Federated container request test tweaks

* Check uuid on created container request.

* Add test for bogus cluster id

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13561: Lock row when saving a new collection version, update tests.
Lucas Di Pentima [Mon, 24 Sep 2018 20:29:19 +0000 (17:29 -0300)]
13561: Lock row when saving a new collection version, update tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago10181: Fix race in MarshalManifest.
Tom Clegg [Sat, 22 Sep 2018 06:07:22 +0000 (02:07 -0400)]
10181: Fix race in MarshalManifest.

Ensure child nodes stay locked between sync and marshal. Otherwise
concurrent file writes can add new memSegments that can't be
marshaled.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago10181: Fix timing sensitivity in test case.
Tom Clegg [Fri, 21 Sep 2018 20:48:01 +0000 (16:48 -0400)]
10181: Fix timing sensitivity in test case.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago10181: Load checkpoint configs from discovery doc if available.
Tom Clegg [Fri, 21 Sep 2018 20:34:51 +0000 (16:34 -0400)]
10181: Load checkpoint configs from discovery doc if available.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago10181: Cleanup identifiers.
Tom Clegg [Fri, 21 Sep 2018 20:23:58 +0000 (16:23 -0400)]
10181: Cleanup identifiers.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago10181: Update container log PDH after updating log collection.
Tom Clegg [Fri, 21 Sep 2018 19:30:05 +0000 (15:30 -0400)]
10181: Update container log PDH after updating log collection.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14197: Add cluster_id to discovery document for create method.
Peter Amstutz [Fri, 21 Sep 2018 19:23:18 +0000 (15:23 -0400)]
14197: Add cluster_id to discovery document for create method.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago10181: Permit dispatcher to update log while container is running.
Tom Clegg [Thu, 20 Sep 2018 17:52:47 +0000 (13:52 -0400)]
10181: Permit dispatcher to update log while container is running.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14197: Supports routing object create requests, with tests
Peter Amstutz [Fri, 21 Sep 2018 18:25:34 +0000 (14:25 -0400)]
14197: Supports routing object create requests, with tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14236: Fix regexp in test.
Tom Clegg [Fri, 21 Sep 2018 18:07:34 +0000 (14:07 -0400)]
14236: Fix regexp in test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13561: Add missing copyright notices on migrations
Lucas Di Pentima [Fri, 21 Sep 2018 16:31:08 +0000 (13:31 -0300)]
13561: Add missing copyright notices on migrations

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Add basic support for collection versioning at the model level.
Lucas Di Pentima [Fri, 21 Sep 2018 16:18:02 +0000 (13:18 -0300)]
13561: Add basic support for collection versioning at the model level.

* Update "unique name" index to ignore collection records that are old versions
* Add tests
* Update collection fixtures

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '10865-legacy-jobs-api' closes #10865
Peter Amstutz [Thu, 20 Sep 2018 18:57:30 +0000 (14:57 -0400)]
Merge branch '10865-legacy-jobs-api' closes #10865

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14197: Generalizing federated routing
Peter Amstutz [Thu, 20 Sep 2018 18:55:31 +0000 (14:55 -0400)]
14197: Generalizing federated routing

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13493-document-federation' refs #13493
Peter Amstutz [Thu, 20 Sep 2018 18:13:28 +0000 (14:13 -0400)]
Merge branch '13493-document-federation' refs #13493

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14242-verify-manifest-pdh' closes #14242
Peter Amstutz [Thu, 20 Sep 2018 18:12:33 +0000 (14:12 -0400)]
Merge branch '14242-verify-manifest-pdh' closes #14242

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago10865: Update documentation, replace disable_api_methods with enable_legacy_jobs_api
Peter Amstutz [Thu, 20 Sep 2018 17:55:19 +0000 (13:55 -0400)]
10865: Update documentation, replace disable_api_methods with enable_legacy_jobs_api

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoSanitize how we get the rvm GPG key, and remove a dependency on the GPG
Ward Vandewege [Thu, 20 Sep 2018 17:53:51 +0000 (13:53 -0400)]
Sanitize how we get the rvm GPG key, and remove a dependency on the GPG
keyservers which are flakey.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago10865: Add test for check_enable_legacy_jobs_api
Peter Amstutz [Thu, 20 Sep 2018 16:57:40 +0000 (12:57 -0400)]
10865: Add test for check_enable_legacy_jobs_api

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14242: Add a test for manifest_text PDH checking
Peter Amstutz [Thu, 20 Sep 2018 14:46:11 +0000 (10:46 -0400)]
14242: Add a test for manifest_text PDH checking

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago10181: Save log collection snapshots periodically during run.
Tom Clegg [Thu, 20 Sep 2018 05:04:52 +0000 (01:04 -0400)]
10181: Save log collection snapshots periodically during run.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago10181: Add Size method to arvados.CollectionFileSystem.
Tom Clegg [Thu, 20 Sep 2018 04:59:35 +0000 (00:59 -0400)]
10181: Add Size method to arvados.CollectionFileSystem.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>