arvados.git
4 years agoMerge branch 'master' into 14716-webdav-cluster-config
Lucas Di Pentima [Mon, 12 Aug 2019 20:47:26 +0000 (17:47 -0300)]
Merge branch 'master' into 14716-webdav-cluster-config

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago14716: Fixes config type init function naming.
Lucas Di Pentima [Mon, 12 Aug 2019 20:43:44 +0000 (17:43 -0300)]
14716: Fixes config type init function naming.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago14716: Moves keep-web legacy config loading test to lib/config.
Lucas Di Pentima [Mon, 12 Aug 2019 20:38:04 +0000 (17:38 -0300)]
14716: Moves keep-web legacy config loading test to lib/config.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago14716: Removes test config loading func that short-circuited load mechanism.
Lucas Di Pentima [Mon, 12 Aug 2019 18:42:41 +0000 (15:42 -0300)]
14716: Removes test config loading func that short-circuited load mechanism.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago14716: Fixes on config loading.
Lucas Di Pentima [Mon, 12 Aug 2019 18:42:01 +0000 (15:42 -0300)]
14716: Fixes on config loading.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years agoMerge branch '15522-arvmount-ops-encoding'
Eric Biagiotti [Mon, 12 Aug 2019 15:19:53 +0000 (11:19 -0400)]
Merge branch '15522-arvmount-ops-encoding'

refs #15522

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

4 years ago14716: Fixes yaml lib being used.
Lucas Di Pentima [Mon, 12 Aug 2019 14:46:06 +0000 (11:46 -0300)]
14716: Fixes yaml lib being used.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years agoMerge branch '15133-remove-jobs-api' refs #15133
Peter Amstutz [Mon, 12 Aug 2019 14:36:31 +0000 (10:36 -0400)]
Merge branch '15133-remove-jobs-api' refs #15133

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15133: Re-add a stub crunch-dispatch.rb to make upgrade smoother
Peter Amstutz [Mon, 12 Aug 2019 14:31:35 +0000 (10:31 -0400)]
15133: Re-add a stub crunch-dispatch.rb to make upgrade smoother

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15133: Can't edit pipeline descriptions any more.
Peter Amstutz [Mon, 12 Aug 2019 14:15:00 +0000 (10:15 -0400)]
15133: Can't edit pipeline descriptions any more.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15133: Fix migration
Peter Amstutz [Mon, 12 Aug 2019 14:06:50 +0000 (10:06 -0400)]
15133: Fix migration

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago14716: Removes duplicated key from a past merge.
Lucas Di Pentima [Sat, 10 Aug 2019 00:34:56 +0000 (21:34 -0300)]
14716: Removes duplicated key from a past merge.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago14716: Fixes install documentation.
Lucas Di Pentima [Sat, 10 Aug 2019 00:30:55 +0000 (21:30 -0300)]
14716: Fixes install documentation.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15133: Remove some more failing workbench tests for job/pipeline
Peter Amstutz [Fri, 9 Aug 2019 20:38:02 +0000 (16:38 -0400)]
15133: Remove some more failing workbench tests for job/pipeline

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago14716: Sets empty anonymous token on failing wb integration tests.
Lucas Di Pentima [Fri, 9 Aug 2019 19:32:43 +0000 (16:32 -0300)]
14716: Sets empty anonymous token on failing wb integration tests.

Also reverts the previous commit.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15133: Remove 'arv run' and 'arv pipeline' from arvados-client
Peter Amstutz [Fri, 9 Aug 2019 19:10:52 +0000 (15:10 -0400)]
15133: Remove 'arv run' and 'arv pipeline' from arvados-client

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15133: Disallow creating/updating jobs API records in model
Peter Amstutz [Fri, 9 Aug 2019 19:01:28 +0000 (15:01 -0400)]
15133: Disallow creating/updating jobs API records in model

Remove a bunch more tests.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15133: Add read-only jobs API to release notes
Peter Amstutz [Fri, 9 Aug 2019 18:16:10 +0000 (14:16 -0400)]
15133: Add read-only jobs API to release notes

Also remove "crunchrunner" from package build.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago14716: Fixes wb integration test.
Lucas Di Pentima [Fri, 9 Aug 2019 17:04:31 +0000 (14:04 -0300)]
14716: Fixes wb integration test.

Now that we have an unified Users.AnonymousUserToken setting active for the
integration tests, workbench started to show the 'Browse public projects'
menu item.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15133: Delete crunch v1 from arvbox
Peter Amstutz [Fri, 9 Aug 2019 15:40:20 +0000 (11:40 -0400)]
15133: Delete crunch v1 from arvbox

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15133: Remove more referencesto arv-run and arv-run-pipeline-instance
Peter Amstutz [Fri, 9 Aug 2019 15:34:02 +0000 (11:34 -0400)]
15133: Remove more referencesto arv-run and arv-run-pipeline-instance

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15133: Remove 'commits' table, move functions to CommitsHelper
Peter Amstutz [Fri, 9 Aug 2019 14:42:34 +0000 (10:42 -0400)]
15133: Remove 'commits' table, move functions to CommitsHelper

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15522: Adds correct name decoding to fuse ops
Eric Biagiotti [Tue, 6 Aug 2019 15:28:46 +0000 (11:28 -0400)]
15522: Adds correct name decoding to fuse ops

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

4 years ago15133: Delete crunchrunner
Peter Amstutz [Fri, 9 Aug 2019 13:17:19 +0000 (09:17 -0400)]
15133: Delete crunchrunner

Not to be confused with crunch-run, this is only used to run stuff in
crunch v1.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15133: Fix more tests
Peter Amstutz [Thu, 8 Aug 2019 20:50:51 +0000 (16:50 -0400)]
15133: Fix more tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago14716: Remove Host header rewrite in integration test proxy config.
Tom Clegg [Thu, 8 Aug 2019 19:47:03 +0000 (15:47 -0400)]
14716: Remove Host header rewrite in integration test proxy config.

Now that keep-web and Workbench see the same ExternalURL value in the
cluster config file, Nginx needs to leave the Host header alone (like
in production) instead of rewriting it to the fake value "download".

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15133: More test updates. Remove arv-run.
Peter Amstutz [Thu, 8 Aug 2019 19:46:42 +0000 (15:46 -0400)]
15133: More test updates.  Remove arv-run.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15133: Delete legacy crunch v1 docs
Peter Amstutz [Thu, 8 Aug 2019 19:07:35 +0000 (15:07 -0400)]
15133: Delete legacy crunch v1 docs

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15133: Move removing jobs API code+tests
Peter Amstutz [Thu, 8 Aug 2019 18:06:17 +0000 (14:06 -0400)]
15133: Move removing jobs API code+tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago14716: Migrates NodeProfiles to Services on arvbox.
Lucas Di Pentima [Thu, 8 Aug 2019 15:13:18 +0000 (12:13 -0300)]
14716: Migrates NodeProfiles to Services on arvbox.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15133: Delete crunch-job & arv-run-pipeline-instance
Peter Amstutz [Thu, 8 Aug 2019 14:04:43 +0000 (10:04 -0400)]
15133: Delete crunch-job & arv-run-pipeline-instance

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '15453-default-is-not-a-remote'
Tom Clegg [Thu, 8 Aug 2019 13:10:19 +0000 (09:10 -0400)]
Merge branch '15453-default-is-not-a-remote'

fixes #15453

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago14716: wb integration tests (wip)
Lucas Di Pentima [Thu, 8 Aug 2019 00:36:14 +0000 (21:36 -0300)]
14716: wb integration tests (wip)

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago14716: Updates arvbox scripts
Lucas Di Pentima [Wed, 7 Aug 2019 22:17:18 +0000 (19:17 -0300)]
14716: Updates arvbox scripts

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15133: API tests passing
Peter Amstutz [Wed, 7 Aug 2019 20:39:55 +0000 (16:39 -0400)]
15133: API tests passing

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15133: Delete crunch_scripts, start clearing out API server
Peter Amstutz [Tue, 6 Aug 2019 19:20:47 +0000 (15:20 -0400)]
15133: Delete crunch_scripts, start clearing out API server

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15453: Don't use "*" as a real remote. Return 502 for remote errors.
Tom Clegg [Wed, 7 Aug 2019 19:09:35 +0000 (15:09 -0400)]
15453: Don't use "*" as a real remote. Return 502 for remote errors.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '15181-remove-acr-jobs-support' refs #15181
Peter Amstutz [Wed, 7 Aug 2019 18:49:38 +0000 (14:49 -0400)]
Merge branch '15181-remove-acr-jobs-support' refs #15181

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15181: Tweak a few more integration tests to request fewer resources
Peter Amstutz [Tue, 6 Aug 2019 19:44:43 +0000 (15:44 -0400)]
15181: Tweak a few more integration tests to request fewer resources

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15181: Remove some more jobs API references
Peter Amstutz [Tue, 6 Aug 2019 19:44:27 +0000 (15:44 -0400)]
15181: Remove some more jobs API references

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch 'master' into 14716-webdav-cluster-config
Lucas Di Pentima [Tue, 6 Aug 2019 19:36:27 +0000 (16:36 -0300)]
Merge branch 'master' into 14716-webdav-cluster-config

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years agoMerge branch '14716-anonymous-token'
Tom Clegg [Tue, 6 Aug 2019 19:20:03 +0000 (15:20 -0400)]
Merge branch '14716-anonymous-token'

refs #14716

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago14716: Fix accidentally accepting credentials at public download URL.
Tom Clegg [Tue, 6 Aug 2019 17:59:46 +0000 (13:59 -0400)]
14716: Fix accidentally accepting credentials at public download URL.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15181: Reduce memory request, in case that was causing test failures
Peter Amstutz [Tue, 6 Aug 2019 17:26:17 +0000 (13:26 -0400)]
15181: Reduce memory request, in case that was causing test failures

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15181: Remove jobs API support from arvados-cwl-runner
Peter Amstutz [Tue, 6 Aug 2019 14:30:33 +0000 (10:30 -0400)]
15181: Remove jobs API support from arvados-cwl-runner

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago14716: Analyzing integration test fix failure
Lucas Di Pentima [Tue, 6 Aug 2019 13:08:54 +0000 (10:08 -0300)]
14716: Analyzing integration test fix failure

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago14716: Adds upgrade notes for keep-web.
Lucas Di Pentima [Mon, 5 Aug 2019 21:10:55 +0000 (18:10 -0300)]
14716: Adds upgrade notes for keep-web.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years agoMerge branch '15467-update-install-docs' refs #15467
Peter Amstutz [Mon, 5 Aug 2019 19:20:22 +0000 (15:20 -0400)]
Merge branch '15467-update-install-docs' refs #15467

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago14716: Updates documentation, add test check.
Lucas Di Pentima [Mon, 5 Aug 2019 18:44:34 +0000 (15:44 -0300)]
14716: Updates documentation, add test check.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years agoMove generation of config values into arvbox cluster_config.sh
Peter Amstutz [Mon, 5 Aug 2019 17:44:31 +0000 (13:44 -0400)]
Move generation of config values into arvbox cluster_config.sh

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch 'run-tests-fix' refs #15467
Peter Amstutz [Mon, 5 Aug 2019 18:21:34 +0000 (14:21 -0400)]
Merge branch 'run-tests-fix' refs #15467

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15467: Fix SbatchEnvironmentVariables documentation typo
Peter Amstutz [Mon, 5 Aug 2019 18:09:24 +0000 (14:09 -0400)]
15467: Fix SbatchEnvironmentVariables documentation typo

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agorun-tests.sh fixups refs #15356
Peter Amstutz [Mon, 5 Aug 2019 17:39:54 +0000 (13:39 -0400)]
run-tests.sh fixups refs #15356

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago14716: Adds legacy config test.
Lucas Di Pentima [Mon, 5 Aug 2019 16:57:18 +0000 (13:57 -0300)]
14716: Adds legacy config test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago14716: Removes old usage message.
Lucas Di Pentima [Mon, 5 Aug 2019 14:18:36 +0000 (11:18 -0300)]
14716: Removes old usage message.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago14716: Testing workbench integration test fix.
Lucas Di Pentima [Fri, 2 Aug 2019 22:25:23 +0000 (19:25 -0300)]
14716: Testing workbench integration test fix.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years agoMerge branch '12020-flaky-py-test'
Tom Clegg [Fri, 2 Aug 2019 20:33:24 +0000 (16:33 -0400)]
Merge branch '12020-flaky-py-test'

fixes #12020

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years ago15467: Add note about units for byte sizes, reorganize config a bit
Peter Amstutz [Fri, 2 Aug 2019 20:25:13 +0000 (16:25 -0400)]
15467: Add note about units for byte sizes, reorganize config a bit

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago14716: Sets anonymous user token using the new way on tests.
Lucas Di Pentima [Fri, 2 Aug 2019 19:55:48 +0000 (16:55 -0300)]
14716: Sets anonymous user token using the new way on tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago15467: Fix config.default.yml for SbatchEnvironmentVariables
Peter Amstutz [Fri, 2 Aug 2019 19:19:23 +0000 (15:19 -0400)]
15467: Fix config.default.yml for SbatchEnvironmentVariables

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15467: Replace KeepServices with SbatchEnvironmentVariables
Peter Amstutz [Fri, 2 Aug 2019 19:00:45 +0000 (15:00 -0400)]
15467: Replace KeepServices with SbatchEnvironmentVariables

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15467: Formatting fixes
Peter Amstutz [Fri, 2 Aug 2019 15:03:50 +0000 (11:03 -0400)]
15467: Formatting fixes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15467: Added tests for KeepServices
Peter Amstutz [Fri, 2 Aug 2019 14:46:11 +0000 (10:46 -0400)]
15467: Added tests for KeepServices

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15467: Adding KeepServices WIP
Peter Amstutz [Thu, 1 Aug 2019 13:49:58 +0000 (09:49 -0400)]
15467: Adding KeepServices WIP

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15467: Update install docs for crunch-dispatch-slurm
Peter Amstutz [Wed, 31 Jul 2019 19:05:23 +0000 (15:05 -0400)]
15467: Update install docs for crunch-dispatch-slurm

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15467: Updating ws docs wip
Peter Amstutz [Wed, 31 Jul 2019 18:08:01 +0000 (14:08 -0400)]
15467: Updating ws docs wip

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoFix discovery doc dockerImageFormats, refs #15467
Peter Amstutz [Fri, 2 Aug 2019 18:33:30 +0000 (14:33 -0400)]
Fix discovery doc dockerImageFormats, refs #15467

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agorun-tests ensure that ARVADOS_CONFIG is set, refs #15467
Peter Amstutz [Fri, 2 Aug 2019 17:18:30 +0000 (13:18 -0400)]
run-tests ensure that ARVADOS_CONFIG is set, refs #15467

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago14716: Updates run_test_server script to run keep-web without deprecated flags.
Lucas Di Pentima [Fri, 2 Aug 2019 15:26:08 +0000 (12:26 -0300)]
14716: Updates run_test_server script to run keep-web without deprecated flags.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years agoFix DisabledAPIs in schema controller, keys are symbols, refs #15467
Peter Amstutz [Fri, 2 Aug 2019 13:44:46 +0000 (09:44 -0400)]
Fix DisabledAPIs in schema controller, keys are symbols, refs #15467

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '14813-wb2-config'
Eric Biagiotti [Thu, 1 Aug 2019 19:13:29 +0000 (15:13 -0400)]
Merge branch '14813-wb2-config'

refs #14813
2

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

4 years ago14716: Fixes tests (WIP)
Lucas Di Pentima [Wed, 24 Jul 2019 12:50:09 +0000 (09:50 -0300)]
14716: Fixes tests (WIP)

One test case pending.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago14716: Migrates to new config.
Lucas Di Pentima [Wed, 24 Jul 2019 12:48:41 +0000 (09:48 -0300)]
14716: Migrates to new config.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago14716: Adds legacy keep-web config loading.
Lucas Di Pentima [Wed, 24 Jul 2019 12:47:50 +0000 (09:47 -0300)]
14716: Adds legacy keep-web config loading.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago14716: Splits WebDAVCache config into its own struct to be assignable.
Lucas Di Pentima [Wed, 24 Jul 2019 12:46:07 +0000 (09:46 -0300)]
14716: Splits WebDAVCache config into its own struct to be assignable.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago14716: Keep-web config params as part of the cluster config.
Lucas Di Pentima [Tue, 9 Jul 2019 15:38:06 +0000 (12:38 -0300)]
14716: Keep-web config params as part of the cluster config.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

4 years ago12020: Fix test race.
Tom Clegg [Thu, 1 Aug 2019 15:45:20 +0000 (11:45 -0400)]
12020: Fix test race.

The previous fix still had a race bug: it assigned a truthy value to
PollClient._skip_old_events (thereby releasing the test from its wait
loop) before doing the logs().list() query to choose an event ID
threshold.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoec2 SecurityGroupIDs should be a StringSet refs #15467
Peter Amstutz [Thu, 1 Aug 2019 13:57:22 +0000 (09:57 -0400)]
ec2 SecurityGroupIDs should be a StringSet refs #15467

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '15467-legacy-config' refs #15467
Peter Amstutz [Wed, 31 Jul 2019 18:13:22 +0000 (14:13 -0400)]
Merge branch '15467-legacy-config' refs #15467

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '15356-composer-config' refs #15356
Peter Amstutz [Wed, 31 Jul 2019 17:53:10 +0000 (13:53 -0400)]
Merge branch '15356-composer-config' refs #15356

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15356: arvbox writes API_HOST to composer.yml
Peter Amstutz [Wed, 31 Jul 2019 17:42:08 +0000 (13:42 -0400)]
15356: arvbox writes API_HOST to composer.yml

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15356: Update Composer install doc
Peter Amstutz [Wed, 31 Jul 2019 17:40:47 +0000 (13:40 -0400)]
15356: Update Composer install doc

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15467: Services only load their own legacy config files
Peter Amstutz [Wed, 31 Jul 2019 17:15:51 +0000 (13:15 -0400)]
15467: Services only load their own legacy config files

Services may be configured to run as different users, so (for example)
crunch-dispatch-slurm attempting to load another component's legacy
config results in permission error.  Don't do that.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago14813: Fixes cluster config whitelist merge
Eric Biagiotti [Tue, 30 Jul 2019 16:26:47 +0000 (12:26 -0400)]
14813: Fixes cluster config whitelist merge

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

4 years ago14813: Adds ClusterID to config export
Eric Biagiotti [Thu, 25 Jul 2019 21:18:56 +0000 (17:18 -0400)]
14813: Adds ClusterID to config export

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

4 years agoMerge branch '14813-config-cors'
Tom Clegg [Mon, 29 Jul 2019 20:59:14 +0000 (16:59 -0400)]
Merge branch '14813-config-cors'

refs #14813

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '15467-config-fixups'
Peter Amstutz [Mon, 29 Jul 2019 19:37:32 +0000 (15:37 -0400)]
Merge branch '15467-config-fixups'

Also includes 14713-cds-new-config and 14717-ws-new-config

Updates run_test_server.py and run-tests.sh to use new config.yml

refs #14713
refs #14717
refs #15467

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15467: Test case where it ends in 'List' but isn't one
Peter Amstutz [Mon, 29 Jul 2019 19:35:59 +0000 (15:35 -0400)]
15467: Test case where it ends in 'List' but isn't one

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15467: Better CONFIGSRC check, always write config.yml in start_services
Peter Amstutz [Mon, 29 Jul 2019 19:29:53 +0000 (15:29 -0400)]
15467: Better CONFIGSRC check, always write config.yml in start_services

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15467: Test to check that reflection works as intended
Peter Amstutz [Mon, 29 Jul 2019 18:56:14 +0000 (14:56 -0400)]
15467: Test to check that reflection works as intended

Refactor a bit.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15467: Introduce "StringSet"
Peter Amstutz [Fri, 26 Jul 2019 20:21:20 +0000 (16:21 -0400)]
15467: Introduce "StringSet"

Accepts an array of strings and converts to map for backwards
compatibility.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15467: check that array config items must end in 'List'
Peter Amstutz [Wed, 24 Jul 2019 14:12:07 +0000 (10:12 -0400)]
15467: check that array config items must end in 'List'

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15467: Migrate lists to hashes
Peter Amstutz [Tue, 23 Jul 2019 18:30:06 +0000 (14:30 -0400)]
15467: Migrate lists to hashes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago15467: List to map changes (WIP)
Peter Amstutz [Tue, 23 Jul 2019 13:40:37 +0000 (09:40 -0400)]
15467: List to map changes (WIP)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago14717: Put setup_config back into install_env, with comments
Peter Amstutz [Mon, 29 Jul 2019 18:11:11 +0000 (14:11 -0400)]
14717: Put setup_config back into install_env, with comments

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years ago14717: Make CONFIGSRC mandatory for run-tests.sh
Peter Amstutz [Mon, 29 Jul 2019 15:38:13 +0000 (11:38 -0400)]
14717: Make CONFIGSRC mandatory for run-tests.sh

Must point to a directory containing a config.yml with a cluster id of
'zzzzz' and a PostgreSQL section.

Includes a few other cleanups.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoarvbox creates /var/lib/arvados/run_tests/config.yml
Peter Amstutz [Mon, 29 Jul 2019 15:34:03 +0000 (11:34 -0400)]
arvbox creates /var/lib/arvados/run_tests/config.yml

Set CONFIGSRC when running tests in arvbox

refs #14717

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoArvbox config doesn't need to set SupportedDockerImageFormats
Peter Amstutz [Tue, 23 Jul 2019 19:33:33 +0000 (15:33 -0400)]
Arvbox config doesn't need to set SupportedDockerImageFormats

Since it is already the default, refs #15467

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

4 years agoMerge branch '12020-flaky-py-test'
Tom Clegg [Mon, 29 Jul 2019 14:53:37 +0000 (10:53 -0400)]
Merge branch '12020-flaky-py-test'

refs #12020

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

4 years agoMerge branch '15496-wb1-group-membership-admin'
Lucas Di Pentima [Fri, 26 Jul 2019 20:17:26 +0000 (17:17 -0300)]
Merge branch '15496-wb1-group-membership-admin'
Closes #15496

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>