arvados.git
3 years agoMerge branch '18289-only-pass-allow-other-when-running-docker'
Ward Vandewege [Fri, 22 Oct 2021 18:19:19 +0000 (14:19 -0400)]
Merge branch '18289-only-pass-allow-other-when-running-docker'

closes #18289

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18289: add support to set `mksquashfs mem` for Singularity in our
Ward Vandewege [Fri, 22 Oct 2021 16:47:17 +0000 (12:47 -0400)]
18289: add support to set `mksquashfs mem` for Singularity in our
       compute node image builder for cloud setups.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18289: Address review comments (documentation).
Ward Vandewege [Fri, 22 Oct 2021 16:46:45 +0000 (12:46 -0400)]
18289: Address review comments (documentation).

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18289: Documentation changes to reflect we support both Slurm and LSF.
Ward Vandewege [Fri, 22 Oct 2021 14:29:16 +0000 (10:29 -0400)]
18289: Documentation changes to reflect we support both Slurm and LSF.
       Refactor the compute node installation instructions. Fix a few
       linkchecker warnings.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18289: documentation: singularity refinements.
Ward Vandewege [Thu, 21 Oct 2021 23:33:48 +0000 (19:33 -0400)]
18289: documentation: singularity refinements.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18289: only pass the --allow-other argument to arv-mount when the
Ward Vandewege [Thu, 21 Oct 2021 20:53:03 +0000 (16:53 -0400)]
18289: only pass the --allow-other argument to arv-mount when the
       runtime is Docker.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '18288-fix-anonymouspublic-token-expiration'
Ward Vandewege [Thu, 21 Oct 2021 20:42:37 +0000 (16:42 -0400)]
Merge branch '18288-fix-anonymouspublic-token-expiration'

closes #18288

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18288: when storing the anonymous user token, make sure to clear the
Ward Vandewege [Thu, 21 Oct 2021 20:27:59 +0000 (16:27 -0400)]
18288: when storing the anonymous user token, make sure to clear the
       expires_at field.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18288: when running the db:check_long_lived_tokens and
Ward Vandewege [Thu, 21 Oct 2021 20:16:04 +0000 (16:16 -0400)]
18288: when running the db:check_long_lived_tokens and
       db:fix_long_lived_tokens rake tasks, do not expire the
       anonymouspublic token.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '17742-provide-custom-certs'
Javier Bértoli [Thu, 21 Oct 2021 19:00:13 +0000 (16:00 -0300)]
Merge branch '17742-provide-custom-certs'

closes #17742
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17742: update documentation addressing review suggestions
Javier Bértoli [Thu, 21 Oct 2021 18:59:04 +0000 (15:59 -0300)]
17742: update documentation addressing review suggestions

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoMerge branch '18281-login-sync-expired-tokens'
Ward Vandewege [Thu, 21 Oct 2021 18:47:04 +0000 (14:47 -0400)]
Merge branch '18281-login-sync-expired-tokens'

closes #18281

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch 'main' into 18281-login-sync-expired-tokens
Ward Vandewege [Thu, 21 Oct 2021 18:46:26 +0000 (14:46 -0400)]
Merge branch 'main' into 18281-login-sync-expired-tokens

closes #18281

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '18286-lsf-doc'
Tom Clegg [Thu, 21 Oct 2021 18:37:23 +0000 (14:37 -0400)]
Merge branch '18286-lsf-doc'

refs #18286

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18281: Rephrase the help text for --force-rotate option.
Ward Vandewege [Thu, 21 Oct 2021 18:19:42 +0000 (14:19 -0400)]
18281: Rephrase the help text for --force-rotate option.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18286: Document requirement to add Services.DispatchLSF section.
Tom Clegg [Thu, 21 Oct 2021 18:00:45 +0000 (14:00 -0400)]
18286: Document requirement to add Services.DispatchLSF section.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years ago18281: make arvados-login-sync smart enough to replace expired tokens.
Ward Vandewege [Wed, 20 Oct 2021 20:28:30 +0000 (16:28 -0400)]
18281: make arvados-login-sync smart enough to replace expired tokens.
       Also add a --debug parameter and some debug output.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '18260-update-cwltool' refs #18260
Peter Amstutz [Wed, 20 Oct 2021 18:28:23 +0000 (14:28 -0400)]
Merge branch '18260-update-cwltool' refs #18260

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18260: Update when we're going to actually run the workflow
Peter Amstutz [Wed, 20 Oct 2021 01:11:05 +0000 (21:11 -0400)]
18260: Update when we're going to actually run the workflow

Update cwltool version for bugfixes.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoDocumentation: when starting the Arvados k8s helm chart on GKE, do not
Ward Vandewege [Tue, 19 Oct 2021 20:03:53 +0000 (16:03 -0400)]
Documentation: when starting the Arvados k8s helm chart on GKE, do not
specify the k8s version (use the default).

refs #18278

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18260: Update cwltool for fix for integration test 35
Peter Amstutz [Tue, 19 Oct 2021 20:04:29 +0000 (16:04 -0400)]
18260: Update cwltool for fix for integration test 35

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '18259-doc-architecture-singularity'
Ward Vandewege [Tue, 19 Oct 2021 20:02:14 +0000 (16:02 -0400)]
Merge branch '18259-doc-architecture-singularity'

closes #18259

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17742: update script addressing review suggestions
Javier Bértoli [Mon, 18 Oct 2021 22:47:27 +0000 (19:47 -0300)]
17742: update script addressing review suggestions

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17742: update docs addressing review suggestions
Javier Bértoli [Mon, 18 Oct 2021 22:42:43 +0000 (19:42 -0300)]
17742: update docs addressing review suggestions

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago18259: documentation: add more detail about Singularity.
Ward Vandewege [Fri, 15 Oct 2021 19:36:56 +0000 (15:36 -0400)]
18259: documentation: add more detail about Singularity.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoUse docker inspect instead of iterating over images list
Peter Amstutz [Wed, 13 Oct 2021 19:34:29 +0000 (15:34 -0400)]
Use docker inspect instead of iterating over images list

refs #18238

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17742: add documentation about custom certs usage
Javier Bértoli [Tue, 12 Oct 2021 00:51:27 +0000 (21:51 -0300)]
17742: add documentation about custom certs usage

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17742: add custom certs to the local.params files
Javier Bértoli [Tue, 12 Oct 2021 00:49:43 +0000 (21:49 -0300)]
17742: add custom certs to the local.params files

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17742: modify multi_host/aws example's nginx
Javier Bértoli [Mon, 11 Oct 2021 22:03:26 +0000 (19:03 -0300)]
17742: modify multi_host/aws example's nginx

to use individual certificates and allow custom certs
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoDocumentation: silence the curl command to get our Arvados package signing key.
Ward Vandewege [Sun, 10 Oct 2021 15:30:32 +0000 (11:30 -0400)]
Documentation: silence the curl command to get our Arvados package signing key.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoRemove long dead `run` and `pipeline` subcommands from the `arv`
Ward Vandewege [Sun, 10 Oct 2021 00:29:24 +0000 (20:29 -0400)]
Remove long dead `run` and `pipeline` subcommands from the `arv`
executable.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '18259-singularity-doc'
Ward Vandewege [Fri, 8 Oct 2021 21:36:09 +0000 (17:36 -0400)]
Merge branch '18259-singularity-doc'

refs #18259

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18259: mention `mksquashfs mem` config setting in singularity.conf
Ward Vandewege [Fri, 8 Oct 2021 16:49:20 +0000 (12:49 -0400)]
18259: mention `mksquashfs mem` config setting in singularity.conf

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoThe minimum supported version of Python is 3.6
Ward Vandewege [Fri, 8 Oct 2021 21:20:43 +0000 (17:20 -0400)]
The minimum supported version of Python is 3.6

refs #18261

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFix CWL tests mixed_version_v10_wf and command_input_file_expression
Peter Amstutz [Fri, 8 Oct 2021 20:06:58 +0000 (16:06 -0400)]
Fix CWL tests mixed_version_v10_wf and command_input_file_expression

refs #18238

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '18258-set-singularity-cachedir'
Ward Vandewege [Fri, 8 Oct 2021 16:50:08 +0000 (12:50 -0400)]
Merge branch '18258-set-singularity-cachedir'

closes #18258

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17742: modify single_host/multiple_hostnames example's nginx
Javier Bértoli [Fri, 8 Oct 2021 14:57:50 +0000 (11:57 -0300)]
17742: modify single_host/multiple_hostnames example's nginx

to use individual certificates

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago18258: also handle SINGULARITY_TMPDIR
Ward Vandewege [Fri, 8 Oct 2021 14:43:52 +0000 (10:43 -0400)]
18258: also handle SINGULARITY_TMPDIR

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18258: add missing error check on os.Mkdir
Ward Vandewege [Fri, 8 Oct 2021 14:38:17 +0000 (10:38 -0400)]
18258: add missing error check on os.Mkdir

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18258: set the SINGULARITY_CACHEDIR to a path underneath our temporary
Ward Vandewege [Fri, 8 Oct 2021 14:24:28 +0000 (10:24 -0400)]
18258: set the SINGULARITY_CACHEDIR to a path underneath our temporary
       space, and clean up after we're done building.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoarvbox fix, keepstore is part of arvados-server now
Peter Amstutz [Thu, 7 Oct 2021 18:01:15 +0000 (14:01 -0400)]
arvbox fix, keepstore is part of arvados-server now

refs #18216

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '18113-change-cloudops-defaults'
Ward Vandewege [Thu, 7 Oct 2021 17:26:29 +0000 (13:26 -0400)]
Merge branch '18113-change-cloudops-defaults'

closes #18113

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18113: Merge branch 'main' into 18113-change-cloudops-defaults
Ward Vandewege [Thu, 7 Oct 2021 17:26:12 +0000 (13:26 -0400)]
18113: Merge branch 'main' into 18113-change-cloudops-defaults

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18113: change MaxCloudOpsPerSecond and MaxConcurrentInstanceCreateOps
Ward Vandewege [Wed, 29 Sep 2021 16:08:17 +0000 (12:08 -0400)]
18113: change MaxCloudOpsPerSecond and MaxConcurrentInstanceCreateOps
       defaults.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17742: add state to install custom certificates
Javier Bértoli [Wed, 29 Sep 2021 15:28:08 +0000 (12:28 -0300)]
17742: add state to install custom certificates

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17742: modify snakeoil_certs to create individual certificates
Javier Bértoli [Wed, 29 Sep 2021 15:21:26 +0000 (12:21 -0300)]
17742: modify snakeoil_certs to create individual certificates

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoRemove the failing pre-build (--only-deps) step for crunch
Peter Amstutz [Thu, 7 Oct 2021 14:52:30 +0000 (10:52 -0400)]
Remove the failing pre-build (--only-deps) step for crunch

It will just do what it needs to when the container starts.

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoRemove the 'experimental' label in our config reference from things that
Ward Vandewege [Thu, 7 Oct 2021 14:14:23 +0000 (10:14 -0400)]
Remove the 'experimental' label in our config reference from things that
are not (PAM login support, a-d-c, Singularity support). Update the docs
for our LSF and Singularity support along the same lines, and update
formatting a bit to make the current limitations of the implementation
clear.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoWe support Singularity 3.7.4.
Ward Vandewege [Thu, 7 Oct 2021 13:57:02 +0000 (09:57 -0400)]
We support Singularity 3.7.4.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '18238-singularity-home' refs #18238
Peter Amstutz [Thu, 7 Oct 2021 14:08:43 +0000 (10:08 -0400)]
Merge branch '18238-singularity-home' refs #18238

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18238: Another try at Singularity $HOME fix
Peter Amstutz [Thu, 7 Oct 2021 14:04:48 +0000 (10:04 -0400)]
18238: Another try at Singularity $HOME fix

Use just the --home parameter, which appears to have option of
behaving as a special case of --bind, and apparently (according to
cwltool experience) works across more Singularity versions.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '18216-arvados-server-keepstore'
Tom Clegg [Wed, 6 Oct 2021 20:41:17 +0000 (16:41 -0400)]
Merge branch '18216-arvados-server-keepstore'

closes #18216

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '18248-fix-ubuntu-18.04-testing'
Javier Bértoli [Wed, 6 Oct 2021 20:08:01 +0000 (17:08 -0300)]
Merge branch '18248-fix-ubuntu-18.04-testing'

closes #18248
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago18248: update comment addressing review suggestions
Javier Bértoli [Wed, 6 Oct 2021 20:01:16 +0000 (17:01 -0300)]
18248: update comment addressing review suggestions

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoMerge branch '18238-containers-in-arvbox' refs #18238
Peter Amstutz [Wed, 6 Oct 2021 19:58:02 +0000 (15:58 -0400)]
Merge branch '18238-containers-in-arvbox' refs #18238

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoFix setting HOME on singularity. Fix a-c-r secondaryFiles.
Peter Amstutz [Wed, 6 Oct 2021 19:48:19 +0000 (15:48 -0400)]
Fix setting HOME on singularity.  Fix a-c-r secondaryFiles.

To fix CWL conformance tests.

refs #18238

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '17779-request-id-in-exception'
Tom Clegg [Wed, 6 Oct 2021 18:51:41 +0000 (14:51 -0400)]
Merge branch '17779-request-id-in-exception'

closes #17779

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '18247-faraday-version'
Ward Vandewege [Wed, 6 Oct 2021 13:49:50 +0000 (09:49 -0400)]
Merge branch '18247-faraday-version'

refs #18247

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18247: Merge branch 'main' into 18247-faraday-version
Ward Vandewege [Wed, 6 Oct 2021 13:49:04 +0000 (09:49 -0400)]
18247: Merge branch 'main' into 18247-faraday-version

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '18097-sync-groups-doc' into main. Refs #18097
Lucas Di Pentima [Wed, 6 Oct 2021 13:14:29 +0000 (10:14 -0300)]
Merge branch '18097-sync-groups-doc' into main. Refs #18097

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years ago18247: Merge branch 'main' into 18247-faraday-version
Ward Vandewege [Wed, 6 Oct 2021 13:00:22 +0000 (09:00 -0400)]
18247: Merge branch 'main' into 18247-faraday-version

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoUpdate the godoc path for keep-web in our documentation.
Ward Vandewege [Tue, 5 Oct 2021 21:33:11 +0000 (17:33 -0400)]
Update the godoc path for keep-web in our documentation.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18253: documentation updates around the Arvados GPG package signing key.
Ward Vandewege [Tue, 5 Oct 2021 21:17:48 +0000 (17:17 -0400)]
18253: documentation updates around the Arvados GPG package signing key.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFix CWL tests refs #18238
Peter Amstutz [Tue, 5 Oct 2021 01:33:00 +0000 (21:33 -0400)]
Fix CWL tests refs #18238

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18238: Make sure to pull default image
Peter Amstutz [Mon, 4 Oct 2021 21:40:40 +0000 (17:40 -0400)]
18238: Make sure to pull default image

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18238: Update tests to use newer arvados/jobs image
Peter Amstutz [Mon, 4 Oct 2021 19:25:32 +0000 (15:25 -0400)]
18238: Update tests to use newer arvados/jobs image

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18238: Fix API revision check
Peter Amstutz [Fri, 1 Oct 2021 20:31:06 +0000 (16:31 -0400)]
18238: Fix API revision check

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18238: Check API version before using output_storage_classes
Peter Amstutz [Fri, 1 Oct 2021 14:26:42 +0000 (10:26 -0400)]
18238: Check API version before using output_storage_classes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18238: Make backwards compatible when StorageClasses is not in config
Peter Amstutz [Fri, 1 Oct 2021 14:02:40 +0000 (10:02 -0400)]
18238: Make backwards compatible when StorageClasses is not in config

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18238: Add required container_engine parameter to builder
Peter Amstutz [Thu, 30 Sep 2021 20:13:28 +0000 (16:13 -0400)]
18238: Add required container_engine parameter to builder

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18238: Update cwltool and schema-salad deps
Peter Amstutz [Thu, 30 Sep 2021 14:18:12 +0000 (10:18 -0400)]
18238: Update cwltool and schema-salad deps

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18247: fix arvados gem dependency on the faraday gem
Ward Vandewege [Tue, 5 Oct 2021 01:28:53 +0000 (21:28 -0400)]
18247: fix arvados gem dependency on the faraday gem

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18245: Update the "Ruby and Bundler" installation page:
Ward Vandewege [Fri, 1 Oct 2021 20:25:39 +0000 (16:25 -0400)]
18245: Update the "Ruby and Bundler" installation page:
- installing the system bundler package is no longer needed
- the RVM installation method already installs bundler, no need to do
  that explicitly
- update the references to the latest Ruby 2.5.x version
- remove reference to Ubuntu 16.04 which is no longer supported
- update the "install from source" documentation to make it work with
  the Arvados rails packages

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoAdd Workbench to arvbox status, no issue #
Peter Amstutz [Thu, 30 Sep 2021 13:50:08 +0000 (09:50 -0400)]
Add Workbench to arvbox status, no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17830: Add test for logging request ID.
Tom Clegg [Wed, 29 Sep 2021 14:17:11 +0000 (10:17 -0400)]
17830: Add test for logging request ID.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoThe request_id passing was moved to Rails middleware as part of #17830.
Ward Vandewege [Tue, 28 Sep 2021 18:25:42 +0000 (14:25 -0400)]
The request_id passing was moved to Rails middleware as part of #17830.
Unfortunately, in that process the logging of the request_id parameter
in the rails logs was broken. This commit fixes that.

refs #17830

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '18253-doc-gpg-key-updates'
Ward Vandewege [Wed, 6 Oct 2021 12:46:44 +0000 (08:46 -0400)]
Merge branch '18253-doc-gpg-key-updates'

closes #18253

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18253: Merge branch 'main' into 18253-doc-gpg-key-updates
Ward Vandewege [Wed, 6 Oct 2021 12:45:53 +0000 (08:45 -0400)]
18253: Merge branch 'main' into 18253-doc-gpg-key-updates

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18097: Updates arvados-sync-groups doc page.
Lucas Di Pentima [Tue, 5 Oct 2021 22:06:47 +0000 (19:06 -0300)]
18097: Updates arvados-sync-groups doc page.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

3 years agoUpdate the godoc path for keep-web in our documentation.
Ward Vandewege [Tue, 5 Oct 2021 21:33:11 +0000 (17:33 -0400)]
Update the godoc path for keep-web in our documentation.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18253: documentation updates around the Arvados GPG package signing key.
Ward Vandewege [Tue, 5 Oct 2021 21:17:48 +0000 (17:17 -0400)]
18253: documentation updates around the Arvados GPG package signing key.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18248: Ensure the OS-provided postgres packages are used in Debian's family
Javier Bértoli [Tue, 5 Oct 2021 18:47:03 +0000 (15:47 -0300)]
18248: Ensure the OS-provided postgres packages are used in Debian's family

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoFix CWL tests refs #18238
Peter Amstutz [Tue, 5 Oct 2021 01:33:00 +0000 (21:33 -0400)]
Fix CWL tests refs #18238

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '18238-update-cwltool' refs #18238
Peter Amstutz [Mon, 4 Oct 2021 21:41:18 +0000 (17:41 -0400)]
Merge branch '18238-update-cwltool' refs #18238

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18238: Make sure to pull default image
Peter Amstutz [Mon, 4 Oct 2021 21:40:40 +0000 (17:40 -0400)]
18238: Make sure to pull default image

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18238: Update tests to use newer arvados/jobs image
Peter Amstutz [Mon, 4 Oct 2021 19:25:32 +0000 (15:25 -0400)]
18238: Update tests to use newer arvados/jobs image

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18238: Arvbox Singularity / Docker updates wip
Peter Amstutz [Mon, 4 Oct 2021 17:37:42 +0000 (13:37 -0400)]
18238: Arvbox Singularity / Docker updates wip

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18248: enable debug for cwl-runner in tests
Javier Bértoli [Mon, 4 Oct 2021 15:25:23 +0000 (12:25 -0300)]
18248: enable debug for cwl-runner in tests

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago18238: Fix API revision check
Peter Amstutz [Fri, 1 Oct 2021 20:31:06 +0000 (16:31 -0400)]
18238: Fix API revision check

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18238: Check API version before using output_storage_classes
Peter Amstutz [Fri, 1 Oct 2021 14:26:42 +0000 (10:26 -0400)]
18238: Check API version before using output_storage_classes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18238: Make backwards compatible when StorageClasses is not in config
Peter Amstutz [Fri, 1 Oct 2021 14:02:40 +0000 (10:02 -0400)]
18238: Make backwards compatible when StorageClasses is not in config

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18238: Add required container_engine parameter to builder
Peter Amstutz [Thu, 30 Sep 2021 20:13:28 +0000 (16:13 -0400)]
18238: Add required container_engine parameter to builder

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18238: Update cwltool and schema-salad deps
Peter Amstutz [Thu, 30 Sep 2021 14:18:12 +0000 (10:18 -0400)]
18238: Update cwltool and schema-salad deps

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18248: edit provision's snakeoil cert for ubuntu-18.04
Javier Bértoli [Sun, 3 Oct 2021 23:43:14 +0000 (20:43 -0300)]
18248: edit provision's snakeoil cert for ubuntu-18.04

Comment RANDFILE line in /etc/ssl/openssl.cnf to fix ubuntu 18.04 testing

See https://github.com/openssl/openssl/issues/7754#issuecomment-541310006

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoMerge branch '18245-bundler-doc-update'
Ward Vandewege [Fri, 1 Oct 2021 20:52:46 +0000 (16:52 -0400)]
Merge branch '18245-bundler-doc-update'

closes #18245

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18245: Update the "Ruby and Bundler" installation page:
Ward Vandewege [Fri, 1 Oct 2021 20:25:39 +0000 (16:25 -0400)]
18245: Update the "Ruby and Bundler" installation page:
- installing the system bundler package is no longer needed
- the RVM installation method already installs bundler, no need to do
  that explicitly
- update the references to the latest Ruby 2.5.x version
- remove reference to Ubuntu 16.04 which is no longer supported
- update the "install from source" documentation to make it work with
  the Arvados rails packages

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoAdd Workbench to arvbox status, no issue #
Peter Amstutz [Thu, 30 Sep 2021 13:50:08 +0000 (09:50 -0400)]
Add Workbench to arvbox status, no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago18216: Move keepstore into arvados-server binary.
Tom Clegg [Thu, 30 Sep 2021 12:54:31 +0000 (08:54 -0400)]
18216: Move keepstore into arvados-server binary.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 years agoMerge branch '18003-support-exists-contains-in-filter-groups'
Ward Vandewege [Wed, 29 Sep 2021 19:35:00 +0000 (15:35 -0400)]
Merge branch '18003-support-exists-contains-in-filter-groups'

closes #18003

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18003: Merge branch 'main' into 18003-support-exists-contains-in-filter-groups
Ward Vandewege [Wed, 29 Sep 2021 19:34:29 +0000 (15:34 -0400)]
18003: Merge branch 'main' into 18003-support-exists-contains-in-filter-groups

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>