arvados.git
2 years agoRemove illegal characters (currently just '/') from output collection names
Peter Amstutz [Wed, 25 May 2022 16:52:55 +0000 (12:52 -0400)]
Remove illegal characters (currently just '/') from output collection names

refs #19152

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoProvision scripts: do not hardcode a ruby version when using RVM, use
Ward Vandewege [Wed, 25 May 2022 20:03:14 +0000 (16:03 -0400)]
Provision scripts: do not hardcode a ruby version when using RVM, use
the generic wrapper instead.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoDisable LocalKeepBlobBuffersPerVCPU on the single node installer
Ward Vandewege [Wed, 25 May 2022 15:04:56 +0000 (11:04 -0400)]
Disable LocalKeepBlobBuffersPerVCPU on the single node installer
development config, Keep uses /tmp here.

refs #18983

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18983-salt-installer-multinode-disable-LocalKeepBlobBuffersPerVCPU'
Ward Vandewege [Mon, 23 May 2022 18:58:03 +0000 (14:58 -0400)]
Merge branch '18983-salt-installer-multinode-disable-LocalKeepBlobBuffersPerVCPU'

refs #18983

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18983: Disable LocalKeepBlobBuffersPerVCPU on the multinode installer
Ward Vandewege [Mon, 23 May 2022 18:30:39 +0000 (14:30 -0400)]
18983: Disable LocalKeepBlobBuffersPerVCPU on the multinode installer
       development config.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '15370-docker-tests'
Tom Clegg [Sat, 21 May 2022 01:27:12 +0000 (21:27 -0400)]
Merge branch '15370-docker-tests'

refs #15370

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago15370: Temporarily disable some docker tests.
Tom Clegg [Sat, 21 May 2022 00:56:47 +0000 (20:56 -0400)]
15370: Temporarily disable some docker tests.

See https://dev.arvados.org/issues/15370#note-31

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '16345-check-version-skew'
Tom Clegg [Fri, 20 May 2022 17:54:10 +0000 (13:54 -0400)]
Merge branch '16345-check-version-skew'

closes #16345

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19129-wb1-dashboard-speedup' refs #19129
Peter Amstutz [Fri, 20 May 2022 16:05:14 +0000 (12:05 -0400)]
Merge branch '19129-wb1-dashboard-speedup' refs #19129

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19129: add missing exit_code from select
Peter Amstutz [Fri, 20 May 2022 14:39:25 +0000 (10:39 -0400)]
19129: add missing exit_code from select

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18983-warn-unused-local-keep'
Tom Clegg [Fri, 20 May 2022 14:31:40 +0000 (10:31 -0400)]
Merge branch '18983-warn-unused-local-keep'

fixes #18983

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoFix integration test refs #17004
Peter Amstutz [Thu, 19 May 2022 20:13:57 +0000 (16:13 -0400)]
Fix integration test refs #17004

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '19136-freeze-props-whitelist'
Tom Clegg [Thu, 19 May 2022 19:57:07 +0000 (15:57 -0400)]
Merge branch '19136-freeze-props-whitelist'

fixes #19136

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16345: Fail health check on server version mismatch.
Tom Clegg [Thu, 19 May 2022 19:19:23 +0000 (15:19 -0400)]
16345: Fail health check on server version mismatch.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19099-singularity-container-shell'
Tom Clegg [Thu, 19 May 2022 15:26:59 +0000 (11:26 -0400)]
Merge branch '19099-singularity-container-shell'

closes #19099

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19141-nokogiri-update'. Closes #19141
Lucas Di Pentima [Thu, 19 May 2022 14:42:32 +0000 (11:42 -0300)]
Merge branch '19141-nokogiri-update'. Closes #19141

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '17004-properties-on-output' refs #17004
Peter Amstutz [Thu, 19 May 2022 13:45:37 +0000 (09:45 -0400)]
Merge branch '17004-properties-on-output' refs #17004

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19141: Updates nokogiri dependencies on railsAPI & workbench1
Lucas Di Pentima [Thu, 19 May 2022 13:12:20 +0000 (10:12 -0300)]
19141: Updates nokogiri dependencies on railsAPI & workbench1

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19099: Ensure host/container port conflict in IPAddress test.
Tom Clegg [Wed, 18 May 2022 21:51:54 +0000 (17:51 -0400)]
19099: Ensure host/container port conflict in IPAddress test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17004: Move output_properties to progress_attrs
Peter Amstutz [Wed, 18 May 2022 19:50:57 +0000 (15:50 -0400)]
17004: Move output_properties to progress_attrs

Mention default properties "type" and "container_request" in docs

Fix typos on CWL arv:OutputCollectionProperties page.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoDon't install docker in arvbox now that arvados-server install does it.
Peter Amstutz [Wed, 18 May 2022 15:44:34 +0000 (11:44 -0400)]
Don't install docker in arvbox now that arvados-server install does it.

refs #15370

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoarvbox option to override API_HOST to test with other clusters
Peter Amstutz [Tue, 17 May 2022 19:47:31 +0000 (15:47 -0400)]
arvbox option to override API_HOST to test with other clusters

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '19070-cwl-test-fixing' refs #19070
Peter Amstutz [Tue, 17 May 2022 21:24:44 +0000 (17:24 -0400)]
Merge branch '19070-cwl-test-fixing' refs #19070

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19070: make some notes about why the script does things
Peter Amstutz [Tue, 17 May 2022 20:01:16 +0000 (16:01 -0400)]
19070: make some notes about why the script does things

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19070: more test_with_arvbox fixes
Peter Amstutz [Tue, 17 May 2022 19:52:14 +0000 (15:52 -0400)]
19070: more test_with_arvbox fixes

Don't try to pull or upload arvados/jobs image, a-c-r already knows
how to do that.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '15370-install-docker'
Tom Clegg [Tue, 17 May 2022 18:56:08 +0000 (14:56 -0400)]
Merge branch '15370-install-docker'

refs #15370

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19070: Still trying to fix test_with_arvbox
Peter Amstutz [Tue, 17 May 2022 18:45:28 +0000 (14:45 -0400)]
19070: Still trying to fix test_with_arvbox

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago15370: Add docker to development/test dependencies.
Tom Clegg [Fri, 13 May 2022 19:26:35 +0000 (15:26 -0400)]
15370: Add docker to development/test dependencies.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19070: Fixing CWL tests
Peter Amstutz [Tue, 17 May 2022 18:20:24 +0000 (14:20 -0400)]
19070: Fixing CWL tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '19081-singularity-no-eval'
Tom Clegg [Tue, 17 May 2022 18:13:34 +0000 (14:13 -0400)]
Merge branch '19081-singularity-no-eval'

refs #19081

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19136: Fix FreezeProjectRequiresProperties.* missing from whitelist.
Tom Clegg [Tue, 17 May 2022 18:11:32 +0000 (14:11 -0400)]
19136: Fix FreezeProjectRequiresProperties.* missing from whitelist.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19094-log-versions'
Tom Clegg [Tue, 17 May 2022 17:25:54 +0000 (13:25 -0400)]
Merge branch '19094-log-versions'

closes #19094

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19081: Disable singularity env var eval behavior if possible.
Tom Clegg [Tue, 17 May 2022 15:41:40 +0000 (11:41 -0400)]
19081: Disable singularity env var eval behavior if possible.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19094: Note docker/singularity/arv-mount versions in container log.
Tom Clegg [Tue, 17 May 2022 06:17:39 +0000 (02:17 -0400)]
19094: Note docker/singularity/arv-mount versions in container log.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18983: Warn if LocalKeepBlobBuffersPerVCPU > 0 but will not be used.
Tom Clegg [Tue, 17 May 2022 05:36:06 +0000 (01:36 -0400)]
18983: Warn if LocalKeepBlobBuffersPerVCPU > 0 but will not be used.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19129: Select specific fields to speed up dashboard loading
Peter Amstutz [Mon, 16 May 2022 20:22:30 +0000 (16:22 -0400)]
19129: Select specific fields to speed up dashboard loading

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoBash syntax in arvados-tests.sh requires bash, fixed.
Peter Amstutz [Mon, 16 May 2022 20:11:28 +0000 (16:11 -0400)]
Bash syntax in arvados-tests.sh requires bash, fixed.

refs #19109

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19099: Remove unused singularity network permission setup.
Tom Clegg [Mon, 16 May 2022 19:15:12 +0000 (15:15 -0400)]
19099: Remove unused singularity network permission setup.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoFix set_secondary recursion error
Peter Amstutz [Mon, 16 May 2022 18:51:20 +0000 (14:51 -0400)]
Fix set_secondary recursion error

skip some problematic conformance tests in test_with_arvbox

refs #19109

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19099: Skip IPAddress test if it looks like we can't use --fakeroot.
Tom Clegg [Mon, 16 May 2022 18:24:02 +0000 (14:24 -0400)]
19099: Skip IPAddress test if it looks like we can't use --fakeroot.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoFix arvados-tests.sh to use python from a-c-r package if available.
Peter Amstutz [Mon, 16 May 2022 17:20:29 +0000 (13:20 -0400)]
Fix arvados-tests.sh to use python from a-c-r package if available.

Add note about the purpose of arvados-tests.sh

refs #19070

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17004: Fix lingering resource error
Peter Amstutz [Mon, 16 May 2022 16:24:43 +0000 (12:24 -0400)]
17004: Fix lingering resource error

* Remove legacy global api_client from arv-get
* Monkey patch close_connections() method to close keepalive connections
* Use close_connections to tear down lingering connections from arv get test setup

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19099: Fix typos.
Tom Clegg [Mon, 16 May 2022 03:44:40 +0000 (23:44 -0400)]
19099: Fix typos.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17004: Test for setting final output properties from inside container
Peter Amstutz [Fri, 13 May 2022 21:51:06 +0000 (17:51 -0400)]
17004: Test for setting final output properties from inside container

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17004: Fix setting properties on final collection
Peter Amstutz [Fri, 13 May 2022 21:27:11 +0000 (17:27 -0400)]
17004: Fix setting properties on final collection

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19099: Debug singularity test.
Tom Clegg [Fri, 13 May 2022 21:12:37 +0000 (17:12 -0400)]
19099: Debug singularity test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18947-dispatch-slurm'
Tom Clegg [Fri, 13 May 2022 20:53:27 +0000 (16:53 -0400)]
Merge branch '18947-dispatch-slurm'

refs #18947

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18947: Merge branch 'main'
Tom Clegg [Fri, 13 May 2022 20:52:43 +0000 (16:52 -0400)]
18947: Merge branch 'main'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18947-health'
Tom Clegg [Fri, 13 May 2022 20:50:00 +0000 (16:50 -0400)]
Merge branch '18947-health'

refs #18947

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18947: Merge branch 'main'
Tom Clegg [Fri, 13 May 2022 20:48:36 +0000 (16:48 -0400)]
18947: Merge branch 'main'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17004: Set default collection output name "Output from workflow XYZ"
Peter Amstutz [Fri, 13 May 2022 20:41:19 +0000 (16:41 -0400)]
17004: Set default collection output name "Output from workflow XYZ"

Previously this wasn't set, so the output collection would be called
"Container output for request XYZ" which is pretty meaningless to
humans.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoUpdate tests related to make_output_collection
Peter Amstutz [Tue, 10 May 2022 18:48:49 +0000 (14:48 -0400)]
Update tests related to make_output_collection

Also update API revision to reflect addition of output_properties

Check API revision before adding output_properties.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17004: Allow output_properties to override the default metadata
Peter Amstutz [Tue, 10 May 2022 15:26:44 +0000 (11:26 -0400)]
17004: Allow output_properties to override the default metadata

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17004: Work on CWL side
Peter Amstutz [Fri, 6 May 2022 21:12:04 +0000 (17:12 -0400)]
17004: Work on CWL side

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17004: Add API server tests for output_properties
Peter Amstutz [Fri, 6 May 2022 20:10:21 +0000 (16:10 -0400)]
17004: Add API server tests for output_properties

Fix migration to update the trigram index

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17004: Add migration
Peter Amstutz [Fri, 6 May 2022 19:04:25 +0000 (15:04 -0400)]
17004: Add migration

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17004: Setting intermediate collection fields
Peter Amstutz [Fri, 6 May 2022 14:20:47 +0000 (10:20 -0400)]
17004: Setting intermediate collection fields

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17004: Initial CWL support for setting output properties
Peter Amstutz [Thu, 5 May 2022 20:00:37 +0000 (16:00 -0400)]
17004: Initial CWL support for setting output properties

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17004: Initial API server support for output_properties
Peter Amstutz [Thu, 5 May 2022 15:49:48 +0000 (11:49 -0400)]
17004: Initial API server support for output_properties

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19099: Fix singularity config script.
Tom Clegg [Fri, 13 May 2022 19:34:26 +0000 (15:34 -0400)]
19099: Fix singularity config script.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19126-nginx-proxy-settings-change'
Ward Vandewege [Fri, 13 May 2022 18:46:48 +0000 (14:46 -0400)]
Merge branch '19126-nginx-proxy-settings-change'

closes #19126

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago19126: Merge branch 'main' into 19126-nginx-proxy-settings-change
Ward Vandewege [Fri, 13 May 2022 18:46:17 +0000 (14:46 -0400)]
19126: Merge branch 'main' into 19126-nginx-proxy-settings-change

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago19099: docker is optional for run-tests.sh.
Tom Clegg [Fri, 13 May 2022 17:39:44 +0000 (13:39 -0400)]
19099: docker is optional for run-tests.sh.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19099: Show lsns debug info if test fails.
Tom Clegg [Fri, 13 May 2022 17:22:36 +0000 (13:22 -0400)]
19099: Show lsns debug info if test fails.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19099: Log singularity and docker versions in test runs.
Tom Clegg [Fri, 13 May 2022 17:08:59 +0000 (13:08 -0400)]
19099: Log singularity and docker versions in test runs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19109-upload-secondary' refs #19109
Peter Amstutz [Fri, 13 May 2022 15:08:31 +0000 (11:08 -0400)]
Merge branch '19109-upload-secondary' refs #19109

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19099: Update tests to new crunchrun.Gateway fields.
Tom Clegg [Fri, 13 May 2022 15:08:20 +0000 (11:08 -0400)]
19099: Update tests to new crunchrun.Gateway fields.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19070-update-workflow-deps' refs #19070
Peter Amstutz [Fri, 13 May 2022 15:08:08 +0000 (11:08 -0400)]
Merge branch '19070-update-workflow-deps' refs #19070

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19126: disable all nginx proxy caching for controller in the templates used by the...
Ward Vandewege [Fri, 13 May 2022 14:56:07 +0000 (10:56 -0400)]
19126: disable all nginx proxy caching for controller in the templates used by the installer.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago19126: disable all proxy caching in the nginx template used by our tests
Ward Vandewege [Fri, 13 May 2022 14:36:07 +0000 (10:36 -0400)]
19126: disable all proxy caching in the nginx template used by our tests
       and arvados-server boot.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago19126: Merge branch 'main' into 19126-nginx-proxy-settings-change
Ward Vandewege [Fri, 13 May 2022 14:33:06 +0000 (10:33 -0400)]
19126: Merge branch 'main' into 19126-nginx-proxy-settings-change

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '16345-check-clock-skew'
Tom Clegg [Fri, 13 May 2022 14:25:41 +0000 (10:25 -0400)]
Merge branch '16345-check-clock-skew'

refs #16345

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19099: Use --fakeroot to test network isolation without being root.
Tom Clegg [Fri, 13 May 2022 14:23:21 +0000 (10:23 -0400)]
19099: Use --fakeroot to test network isolation without being root.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19127-remove-warnings'
Ward Vandewege [Fri, 13 May 2022 14:13:29 +0000 (10:13 -0400)]
Merge branch '19127-remove-warnings'

closes #19127

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago19126: disable all nginx proxy caching for controller.
Ward Vandewege [Fri, 13 May 2022 11:57:00 +0000 (07:57 -0400)]
19126: disable all nginx proxy caching for controller.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago19099: Enable container shell when using singularity runtime.
Tom Clegg [Fri, 13 May 2022 06:43:14 +0000 (02:43 -0400)]
19099: Enable container shell when using singularity runtime.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19127: remove config file support for InstanceTypes specified as an
Ward Vandewege [Thu, 12 May 2022 18:31:53 +0000 (14:31 -0400)]
19127: remove config file support for InstanceTypes specified as an
       array (deprecated since Arvados 1.2.0). Remove support for
       InstanceType "Scratch" field from config file (deprecated since
       Arvados 1.4.0).

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago19109: Avoid recursion fail mode
Peter Amstutz [Thu, 12 May 2022 21:20:55 +0000 (17:20 -0400)]
19109: Avoid recursion fail mode

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19070: Add documentation notes about --copy-deps
Peter Amstutz [Thu, 12 May 2022 20:55:57 +0000 (16:55 -0400)]
19070: Add documentation notes about --copy-deps

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19070: Fix --update-workflow
Peter Amstutz [Thu, 12 May 2022 18:31:57 +0000 (14:31 -0400)]
19070: Fix --update-workflow

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19099: Refactor container shell backend so it's not docker-specific.
Tom Clegg [Thu, 12 May 2022 14:12:29 +0000 (10:12 -0400)]
19099: Refactor container shell backend so it's not docker-specific.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19127: Update test to catch InstanceTypes computed fields.
Tom Clegg [Wed, 11 May 2022 23:40:43 +0000 (19:40 -0400)]
19127: Update test to catch InstanceTypes computed fields.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19070: Prefer to use the passed-in runtimeContext
Peter Amstutz [Wed, 11 May 2022 21:19:51 +0000 (17:19 -0400)]
19070: Prefer to use the passed-in runtimeContext

Code cleanup, change most places to use the passed-in runtimeContext
instead of the ArvRunner top level runtimeContext.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19070: Fix tests
Peter Amstutz [Fri, 6 May 2022 19:24:23 +0000 (15:24 -0400)]
19070: Fix tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19070: --create/update-workflow also implies --match-submitter-images
Peter Amstutz [Fri, 6 May 2022 14:23:03 +0000 (10:23 -0400)]
19070: --create/update-workflow also implies --match-submitter-images

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19070: Add integration test for copying dependencies
Peter Amstutz [Wed, 4 May 2022 20:57:01 +0000 (16:57 -0400)]
19070: Add integration test for copying dependencies

Fix python tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19070: Fix test_arvados_jobs_image
Peter Amstutz [Wed, 4 May 2022 18:17:18 +0000 (14:17 -0400)]
19070: Fix test_arvados_jobs_image

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19070: Fix most tests
Peter Amstutz [Tue, 3 May 2022 22:05:43 +0000 (18:05 -0400)]
19070: Fix most tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19070: Add --copy-deps/--no-copy-deps
Peter Amstutz [Tue, 3 May 2022 21:01:26 +0000 (17:01 -0400)]
19070: Add --copy-deps/--no-copy-deps

Copies dependencies by default using --create-workflow and --update
workflow

Keeps old behavior by default when running from the command line (can
get new behavior with --copy-deps).

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19070: Always make copy of Docker images with --project-uuid
Peter Amstutz [Thu, 28 Apr 2022 16:53:55 +0000 (12:53 -0400)]
19070: Always make copy of Docker images with --project-uuid

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19070: keepdocker will use image in arvados
Peter Amstutz [Thu, 28 Apr 2022 16:44:10 +0000 (12:44 -0400)]
19070: keepdocker will use image in arvados

If not available in Docker

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19127: do not dump InstanceTypes...Name and InstanceTypes...Scratch,
Ward Vandewege [Wed, 11 May 2022 21:03:07 +0000 (17:03 -0400)]
19127: do not dump InstanceTypes...Name and InstanceTypes...Scratch,
       they are computed fields.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago19109: Fix integration test
Peter Amstutz [Wed, 11 May 2022 19:57:06 +0000 (15:57 -0400)]
19109: Fix integration test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19109: test/fix for related bug, finding secondary files with expressions
Peter Amstutz [Wed, 11 May 2022 19:42:28 +0000 (15:42 -0400)]
19109: test/fix for related bug, finding secondary files with expressions

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19126: update the nginx template used by our tests and arvados-server
Ward Vandewege [Wed, 11 May 2022 18:45:39 +0000 (14:45 -0400)]
19126: update the nginx template used by our tests and arvados-server
       boot.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago19126: update documentation to reflect nginx proxy configuration for
Ward Vandewege [Wed, 11 May 2022 18:44:08 +0000 (14:44 -0400)]
19126: update documentation to reflect nginx proxy configuration for
       controller.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '19103-aca-list-default-limit'. Closes #19103
Lucas Di Pentima [Wed, 11 May 2022 14:02:50 +0000 (11:02 -0300)]
Merge branch '19103-aca-list-default-limit'. Closes #19103

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19109: Add test case for discovering & uploading secondary files
Peter Amstutz [Tue, 10 May 2022 19:34:07 +0000 (15:34 -0400)]
19109: Add test case for discovering & uploading secondary files

Correctly find secondary files in the optional "File?" case

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19103: Fixes the default Limit param for ACA list requests.
Lucas Di Pentima [Wed, 11 May 2022 13:02:00 +0000 (10:02 -0300)]
19103: Fixes the default Limit param for ACA list requests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19103: Exposes the bug with a test.
Lucas Di Pentima [Wed, 11 May 2022 12:48:48 +0000 (09:48 -0300)]
19103: Exposes the bug with a test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>