arvados.git
4 years ago15003: Merge branch 'master' into 15003-preprocess-config
Tom Clegg [Wed, 15 May 2019 13:57:36 +0000 (09:57 -0400)]
15003: Merge branch 'master' into 15003-preprocess-config

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoReset the rails package iteration to 1
Ward Vandewege [Tue, 14 May 2019 21:33:33 +0000 (17:33 -0400)]
Reset the rails package iteration to 1

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years agoMerge branch '15200-fix-blobsigning-config-migration'
Ward Vandewege [Tue, 14 May 2019 21:30:04 +0000 (17:30 -0400)]
Merge branch '15200-fix-blobsigning-config-migration'

closes #15200

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years agoWhen specified in the api configuration,
Ward Vandewege [Tue, 14 May 2019 21:16:28 +0000 (17:16 -0400)]
When specified in the api configuration,

  permit_create_collection_with_unsigned_manifest: false

needs to be translated to

  BlobSigning: true

refs #15200

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years agoBump the rails package iteration to 9, for the packaging fix in commit
Ward Vandewege [Tue, 14 May 2019 16:37:43 +0000 (12:37 -0400)]
Bump the rails package iteration to 9, for the packaging fix in commit
b4fabf39c7cb1c48a2ba09ba2f45da45b6c4574

refs #15225

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years agoFix the api server package postinstall script to use `rake config:dump` to get a
Ward Vandewege [Tue, 14 May 2019 14:21:08 +0000 (10:21 -0400)]
Fix the api server package postinstall script to use `rake config:dump` to get a
value, rather than `rake config:check` which no longer produces output.

closes #15225

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years agoAdd workbench2Url to discovery document refs #15064
Peter Amstutz [Mon, 13 May 2019 14:00:47 +0000 (10:00 -0400)]
Add workbench2Url to discovery document refs #15064

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMigrate arvbox api application.yml settings to config.yml
Peter Amstutz [Mon, 13 May 2019 13:58:39 +0000 (09:58 -0400)]
Migrate arvbox api application.yml settings to config.yml

To set workbench2 url.  refs #15064

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoLog if client hangs up while waiting for unix volume Serialize lock.
Tom Clegg [Fri, 10 May 2019 20:36:39 +0000 (16:36 -0400)]
Log if client hangs up while waiting for unix volume Serialize lock.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoRemove extra \n from log.Printf formats
Tom Clegg [Fri, 10 May 2019 20:07:47 +0000 (16:07 -0400)]
Remove extra \n from log.Printf formats

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '15061-fed-login' refs #15061
Peter Amstutz [Thu, 9 May 2019 20:57:08 +0000 (16:57 -0400)]
Merge branch '15061-fed-login' refs #15061

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15061: Add missing file
Peter Amstutz [Thu, 9 May 2019 19:27:07 +0000 (15:27 -0400)]
15061: Add missing file

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15061: Implement admin variant of user merge by uuid
Peter Amstutz [Tue, 7 May 2019 22:00:57 +0000 (18:00 -0400)]
15061: Implement admin variant of user merge by uuid

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15061: API support for linking local account to remote user
Peter Amstutz [Tue, 7 May 2019 20:31:21 +0000 (16:31 -0400)]
15061: API support for linking local account to remote user

Adds page to login process to redirect user to log in to home cluster.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15061: Correctly filter out "*" from RemoteClusters
Peter Amstutz [Mon, 6 May 2019 19:35:42 +0000 (15:35 -0400)]
15061: Correctly filter out "*" from RemoteClusters

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoPin pykka < 2 for nodemanager no issue #
Peter Amstutz [Thu, 9 May 2019 14:37:36 +0000 (10:37 -0400)]
Pin pykka < 2 for nodemanager no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoFix unit error in the node manager documentation for EC2.
Ward Vandewege [Wed, 8 May 2019 20:39:17 +0000 (16:39 -0400)]
Fix unit error in the node manager documentation for EC2.

refs #15199

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

4 years agoarvbox crunch-run and certificate fixes
Peter Amstutz [Fri, 3 May 2019 20:21:06 +0000 (16:21 -0400)]
arvbox crunch-run and certificate fixes

arvbox crunch-run change to -container-enable-networking=default

Previously was "always" which causes CWL tests that checked that
networking was disabled to fail.

arvbox root-cert creates file with .crt instead of .pem, because
that's the file extension update-ca-certificates looks for.

Add cluster id and timestamp to arvbox test certificate common name to
prevents collisions on the certificate subject.

Arvbox sets trusted api_client for workbench2.

refs #15028 refs #15061

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '15112-rerun-containers' refs #15112
Peter Amstutz [Tue, 7 May 2019 15:55:11 +0000 (11:55 -0400)]
Merge branch '15112-rerun-containers' refs #15112

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15003: Merge branch 'master' into 15003-preprocess-config
Tom Clegg [Mon, 6 May 2019 15:16:15 +0000 (11:16 -0400)]
15003: Merge branch 'master' into 15003-preprocess-config

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoFix mistake setting container_count_max from wrong config parameter
Peter Amstutz [Fri, 3 May 2019 15:40:43 +0000 (11:40 -0400)]
Fix mistake setting container_count_max from wrong config parameter

refs #13996

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '15164-cr-finalize-lock' closes #15164
Peter Amstutz [Thu, 2 May 2019 14:13:26 +0000 (10:13 -0400)]
Merge branch '15164-cr-finalize-lock' closes #15164

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago15112: log root user. log progress.
Peter Amstutz [Thu, 2 May 2019 13:22:12 +0000 (09:22 -0400)]
15112: log root user.  log progress.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago15112: Rename since it doesn't rerun anything
Peter Amstutz [Wed, 1 May 2019 20:39:06 +0000 (16:39 -0400)]
15112: Rename since it doesn't rerun anything

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago15112: Don't submit anything, just produce a csv file with results
Peter Amstutz [Wed, 1 May 2019 20:30:31 +0000 (16:30 -0400)]
15112: Don't submit anything, just produce a csv file with results

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoFix typo.
Ward Vandewege [Wed, 1 May 2019 20:18:51 +0000 (16:18 -0400)]
Fix typo.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years agoFix debug setup accidentally committed.
Tom Morris [Wed, 1 May 2019 18:56:35 +0000 (14:56 -0400)]
Fix debug setup accidentally committed.

refs #14670

Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>

5 years ago15112: Script to re-run containers
Peter Amstutz [Tue, 30 Apr 2019 22:06:54 +0000 (18:06 -0400)]
15112: Script to re-run containers

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '15161-config-check-rake-fix'
Lucas Di Pentima [Tue, 30 Apr 2019 19:55:35 +0000 (16:55 -0300)]
Merge branch '15161-config-check-rake-fix'
Refs #15161

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago15161: Re-adds API's config:check rake task (as a noop)
Lucas Di Pentima [Tue, 30 Apr 2019 16:52:39 +0000 (13:52 -0300)]
15161: Re-adds API's config:check rake task (as a noop)

The unified rails postinst scripts assume that this task is always available.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago15164: Add locking between container completion and reuse
Peter Amstutz [Tue, 30 Apr 2019 15:53:01 +0000 (11:53 -0400)]
15164: Add locking between container completion and reuse

Addresses race condition between container completion and container
reuse.  Without this locking, a container request can resolve and
attempt to reuse a container which is concurrently being completed,
resulting in a race condition that results in the container request
never being finalized.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoFixes test running call on API server to be able to run single test files.
Lucas Di Pentima [Tue, 30 Apr 2019 15:43:04 +0000 (12:43 -0300)]
Fixes test running call on API server to be able to run single test files.

No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoMerge branch 'api-tests-summary-fix'
Lucas Di Pentima [Mon, 29 Apr 2019 14:19:21 +0000 (11:19 -0300)]
Merge branch 'api-tests-summary-fix'

No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoFixes API Server's test runner to print failures summary at the end of the run.
Lucas Di Pentima [Fri, 26 Apr 2019 23:34:07 +0000 (20:34 -0300)]
Fixes API Server's test runner to print failures summary at the end of the run.

No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoMerge branch '15148-lost-collection-pdh'
Tom Clegg [Fri, 26 Apr 2019 20:39:28 +0000 (16:39 -0400)]
Merge branch '15148-lost-collection-pdh'

refs #15148

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15148: Include list of affected PDHs in LostBlocksFile.
Tom Clegg [Fri, 26 Apr 2019 20:06:39 +0000 (16:06 -0400)]
15148: Include list of affected PDHs in LostBlocksFile.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15003: Merge branch 'master' into 15003-preprocess-config
Tom Clegg [Fri, 26 Apr 2019 17:47:21 +0000 (13:47 -0400)]
15003: Merge branch 'master' into 15003-preprocess-config

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '14399-azure-list-retry'
Tom Clegg [Fri, 26 Apr 2019 17:30:20 +0000 (13:30 -0400)]
Merge branch '14399-azure-list-retry'

fixes #14399

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14399: Don't insert error text in the middle of an index response.
Tom Clegg [Thu, 25 Apr 2019 17:54:40 +0000 (13:54 -0400)]
14399: Don't insert error text in the middle of an index response.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14399: Retry Azure ListBlobs call after 503 errors.
Tom Clegg [Thu, 25 Apr 2019 17:54:03 +0000 (13:54 -0400)]
14399: Retry Azure ListBlobs call after 503 errors.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoTypo in one of the parameters
Nico Cesar [Fri, 26 Apr 2019 16:07:38 +0000 (12:07 -0400)]
Typo in one of the parameters

no issue #

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <ncesar@veritasgenetics.com>

5 years agoMerge branch '15112-save-lost-blocks-file'
Tom Clegg [Wed, 24 Apr 2019 20:42:06 +0000 (16:42 -0400)]
Merge branch '15112-save-lost-blocks-file'

refs #15112
refs #15148

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15112: Remove tempfile only if still locked (not renamed).
Tom Clegg [Wed, 24 Apr 2019 20:30:00 +0000 (16:30 -0400)]
15112: Remove tempfile only if still locked (not renamed).

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15112: Fix fd leak on error.
Tom Clegg [Wed, 24 Apr 2019 20:23:56 +0000 (16:23 -0400)]
15112: Fix fd leak on error.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15112: Add config option to save list of lost blocks to a file.
Tom Clegg [Wed, 24 Apr 2019 19:22:44 +0000 (15:22 -0400)]
15112: Add config option to save list of lost blocks to a file.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15003: Warn about unknown keys and bad value types.
Tom Clegg [Wed, 24 Apr 2019 17:34:02 +0000 (13:34 -0400)]
15003: Warn about unknown keys and bad value types.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '14627-crunchstat-summary-elapsed'
Tom Morris [Wed, 24 Apr 2019 16:20:58 +0000 (12:20 -0400)]
Merge branch '14627-crunchstat-summary-elapsed'

Fixes #14627

Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>

5 years agoFix elapsed time calculation.
Tom Morris [Mon, 18 Mar 2019 22:48:33 +0000 (18:48 -0400)]
Fix elapsed time calculation.

refs #14627

Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>

5 years agoMerge branch '14939-crunchstat-summary-python3-fixup'
Tom Morris [Wed, 24 Apr 2019 16:19:12 +0000 (12:19 -0400)]
Merge branch '14939-crunchstat-summary-python3-fixup'

Fixes #14939

Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>

5 years agoFix iteration order dependency.
Tom Morris [Mon, 22 Apr 2019 19:34:39 +0000 (15:34 -0400)]
Fix iteration order dependency.

Causes tests to fail in Python 3.5, but not Python 3.7 due to dependency on iteration order of dicts.

Refs #14939

Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>

5 years agoAdd crunchstat-summary Python 3 to all tests.
Tom Morris [Wed, 27 Mar 2019 17:19:24 +0000 (13:19 -0400)]
Add crunchstat-summary Python 3 to all tests.

Refs #14939

Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>

5 years agoAdd gradle.properties with empty ossrhUsername/Password refs #14670
Peter Amstutz [Wed, 24 Apr 2019 15:49:33 +0000 (11:49 -0400)]
Add gradle.properties with empty ossrhUsername/Password refs #14670

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMake the doc Rakefile a little more helpful when it's missing javadoc
Ward Vandewege [Wed, 24 Apr 2019 15:36:57 +0000 (11:36 -0400)]
Make the doc Rakefile a little more helpful when it's missing javadoc
dependencies.

refs #14670

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago15003: Update service names.
Tom Clegg [Tue, 23 Apr 2019 20:33:58 +0000 (16:33 -0400)]
15003: Update service names.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15003: Add config-check command.
Tom Clegg [Tue, 23 Apr 2019 20:28:38 +0000 (16:28 -0400)]
15003: Add config-check command.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15003: Error out if PostgreSQL connection map is ambiguous.
Tom Clegg [Tue, 23 Apr 2019 18:15:42 +0000 (14:15 -0400)]
15003: Error out if PostgreSQL connection map is ambiguous.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15003: Add missed error checks.
Tom Clegg [Tue, 23 Apr 2019 18:15:14 +0000 (14:15 -0400)]
15003: Add missed error checks.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '14670-new-java-sdk-docs' refs #14670
Peter Amstutz [Tue, 23 Apr 2019 17:49:25 +0000 (13:49 -0400)]
Merge branch '14670-new-java-sdk-docs' refs #14670

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago15003: Check DB conn in controller health check. Check test services.
Tom Clegg [Tue, 23 Apr 2019 17:28:55 +0000 (13:28 -0400)]
15003: Check DB conn in controller health check. Check test services.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15003: Split out deprecated config stuff.
Tom Clegg [Tue, 23 Apr 2019 14:28:52 +0000 (10:28 -0400)]
15003: Split out deprecated config stuff.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15003: Move keys from RequestLimits to API section.
Tom Clegg [Tue, 23 Apr 2019 13:44:54 +0000 (09:44 -0400)]
15003: Move keys from RequestLimits to API section.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15003: Use config lib for arvados-server.
Tom Clegg [Tue, 16 Apr 2019 20:12:12 +0000 (16:12 -0400)]
15003: Use config lib for arvados-server.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15003: Add 'arvados-server dump-config' command.
Tom Clegg [Tue, 16 Apr 2019 19:33:33 +0000 (15:33 -0400)]
15003: Add 'arvados-server dump-config' command.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15003: Load config over defaults.
Tom Clegg [Tue, 16 Apr 2019 18:05:53 +0000 (14:05 -0400)]
15003: Load config over defaults.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15003: Generate config.DefaultYAML from source file.
Tom Clegg [Fri, 12 Apr 2019 20:04:37 +0000 (16:04 -0400)]
15003: Generate config.DefaultYAML from source file.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch 'rails5-schema-env-data'
Lucas Di Pentima [Tue, 23 Apr 2019 13:47:16 +0000 (10:47 -0300)]
Merge branch 'rails5-schema-env-data'
No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoAdjust the environment setting command to be consistent with other calls.
Lucas Di Pentima [Tue, 23 Apr 2019 13:29:46 +0000 (10:29 -0300)]
Adjust the environment setting command to be consistent with other calls.

No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoSet up "test" environment before dropping the rails database.
Lucas Di Pentima [Mon, 22 Apr 2019 20:45:27 +0000 (17:45 -0300)]
Set up "test" environment before dropping the rails database.

After the Rails 5 upgrade, this is necessary to avoid install step failures
when running tests having a pre-rails5 database already created.

No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoHandle unrecognized uuid_prefix of remote host refs #13996
Peter Amstutz [Mon, 22 Apr 2019 20:19:51 +0000 (16:19 -0400)]
Handle unrecognized uuid_prefix of remote host refs #13996

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoUpdate structure.sql for last migration.
Tom Clegg [Mon, 22 Apr 2019 18:45:31 +0000 (14:45 -0400)]
Update structure.sql for last migration.

refs #15112

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14670: Update documentation with example gradle file
Peter Amstutz [Mon, 22 Apr 2019 18:01:05 +0000 (14:01 -0400)]
14670: Update documentation with example gradle file

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '15119-api-config-fixes'
Peter Amstutz [Mon, 22 Apr 2019 17:38:14 +0000 (13:38 -0400)]
Merge branch '15119-api-config-fixes'

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

refs #13996
refs #15119

5 years ago15119: Fixes for Workbench1.ExternalURL and Controller.ExternalURL
Peter Amstutz [Mon, 22 Apr 2019 17:33:58 +0000 (13:33 -0400)]
15119: Fixes for Workbench1.ExternalURL and Controller.ExternalURL

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoissue #15041 Split test and upload. uploadArchives passed as parameter to publish...
Fernando Monserrat [Mon, 22 Apr 2019 15:56:03 +0000 (12:56 -0300)]
issue #15041 Split test and upload. uploadArchives passed as parameter to publish artifact  \nArvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

5 years agoMerge branch '15112-migration'
Tom Clegg [Mon, 22 Apr 2019 15:40:53 +0000 (11:40 -0400)]
Merge branch '15112-migration'

refs #15112

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15112: Fill in missing modified_at values from before #14595.
Tom Clegg [Mon, 22 Apr 2019 15:29:31 +0000 (11:29 -0400)]
15112: Fill in missing modified_at values from before #14595.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '15112-dont-trash-needed-replica'
Tom Clegg [Mon, 22 Apr 2019 14:55:28 +0000 (10:55 -0400)]
Merge branch '15112-dont-trash-needed-replica'

refs #15112

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15112: Note rationale for non-obvious paging approach.
Tom Clegg [Mon, 22 Apr 2019 14:50:59 +0000 (10:50 -0400)]
15112: Note rationale for non-obvious paging approach.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15112: Add test.
Tom Clegg [Mon, 22 Apr 2019 13:30:29 +0000 (09:30 -0400)]
15112: Add test.

This tests for a bug that was already fixed in #14595, but without
noticing.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15112: Refuse to run if modified_at column has any nulls.
Tom Clegg [Mon, 22 Apr 2019 07:06:18 +0000 (03:06 -0400)]
15112: Refuse to run if modified_at column has any nulls.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15112: Stop processing collections on first error.
Tom Clegg [Mon, 22 Apr 2019 00:25:28 +0000 (20:25 -0400)]
15112: Stop processing collections on first error.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15112: Fix duplicate default.
Tom Clegg [Mon, 22 Apr 2019 00:24:40 +0000 (20:24 -0400)]
15112: Fix duplicate default.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15112: Error out right away on unusable manifest.
Tom Clegg [Mon, 22 Apr 2019 00:24:12 +0000 (20:24 -0400)]
15112: Error out right away on unusable manifest.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15112: Fix log check in test case.
Tom Clegg [Mon, 22 Apr 2019 00:23:16 +0000 (20:23 -0400)]
15112: Fix log check in test case.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15112: Show #collections and class->#desired map in dump.
Tom Clegg [Mon, 22 Apr 2019 00:14:16 +0000 (20:14 -0400)]
15112: Show #collections and class->#desired map in dump.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15112: Test multiple volumes with same device IDs.
Tom Clegg [Sun, 21 Apr 2019 00:32:54 +0000 (20:32 -0400)]
15112: Test multiple volumes with same device IDs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15112: Fix mount IDs in test case.
Tom Clegg [Sun, 21 Apr 2019 00:29:42 +0000 (20:29 -0400)]
15112: Fix mount IDs in test case.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15112: Use FieldLogger interface so tests can use ctxlog.TestLogger.
Tom Clegg [Sun, 21 Apr 2019 00:26:44 +0000 (20:26 -0400)]
15112: Use FieldLogger interface so tests can use ctxlog.TestLogger.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago15112: Report volumes without replicas as "none" in -dump output.
Tom Clegg [Sat, 20 Apr 2019 21:22:41 +0000 (17:22 -0400)]
15112: Report volumes without replicas as "none" in -dump output.

...instead of reporting as "stay" or "none" depending on
whether *other* volumes have replicas.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14670: Add an example page
Peter Amstutz [Fri, 19 Apr 2019 21:23:48 +0000 (17:23 -0400)]
14670: Add an example page

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '14723-cwl-multiple-file-targets'
Eric Biagiotti [Fri, 19 Apr 2019 20:32:05 +0000 (16:32 -0400)]
Merge branch '14723-cwl-multiple-file-targets'

refs #14723

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years agoMerge, don't replace RemoteClusters refs #13996
Peter Amstutz [Fri, 19 Apr 2019 18:48:23 +0000 (14:48 -0400)]
Merge, don't replace RemoteClusters refs #13996

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoSet secrets.secret_key_base refs #13996
Peter Amstutz [Fri, 19 Apr 2019 16:13:11 +0000 (12:13 -0400)]
Set secrets.secret_key_base refs #13996

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch 'master' into 14723-cwl-multiple-file-targets
Eric Biagiotti [Fri, 19 Apr 2019 14:59:24 +0000 (10:59 -0400)]
Merge branch 'master' into 14723-cwl-multiple-file-targets

refs #14723

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14723: Adds comments for the changes to StagingPathMapper
Eric Biagiotti [Fri, 19 Apr 2019 14:59:06 +0000 (10:59 -0400)]
14723: Adds comments for the changes to StagingPathMapper

Also improves executor exception handling mapping logic.

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14670: Skip test (fixed)
Peter Amstutz [Thu, 18 Apr 2019 21:57:54 +0000 (17:57 -0400)]
14670: Skip test (fixed)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14670: Ignore failing test
Peter Amstutz [Thu, 18 Apr 2019 21:50:02 +0000 (17:50 -0400)]
14670: Ignore failing test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14670: Fix run-tests. Skip failing test.
Peter Amstutz [Thu, 18 Apr 2019 21:44:21 +0000 (17:44 -0400)]
14670: Fix run-tests.  Skip failing test.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '13996-new-api-config' refs #13996
Peter Amstutz [Thu, 18 Apr 2019 19:28:50 +0000 (15:28 -0400)]
Merge branch '13996-new-api-config' refs #13996

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '15002-cancel-completed-container'
Eric Biagiotti [Thu, 18 Apr 2019 18:41:29 +0000 (14:41 -0400)]
Merge branch '15002-cancel-completed-container'

refs #15002

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>