arvados.git
2 years agoMerge branch '18655-java-prs' refs #18655 2.3.3
Peter Amstutz [Fri, 11 Feb 2022 16:58:50 +0000 (11:58 -0500)]
Merge branch '18655-java-prs' refs #18655

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agocrunchstat-summary pins to current Python SDK version
Peter Amstutz [Thu, 10 Mar 2022 15:37:37 +0000 (10:37 -0500)]
crunchstat-summary pins to current Python SDK version

Same logic as used for arvados-cwl-runner

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoPut upper bound on PyCURL
Peter Amstutz [Thu, 10 Mar 2022 15:03:34 +0000 (10:03 -0500)]
Put upper bound on PyCURL

Starting with PyCURL 7.45.0 it is incompatible with the version of GNU
TLS that ships with Debian 10.

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoRemove the pre-seeding of gems needed by arvados-api-server and
Ward Vandewege [Wed, 9 Mar 2022 14:01:06 +0000 (09:01 -0500)]
Remove the pre-seeding of gems needed by arvados-api-server and
arvados-workbench from the package build Dockerfiles.

This step was doing a git clone from main. This can cause issues when
the packages being built are for another branch. For example, when the
Gemfile in main has gems with a dependency on a version of Ruby that is
newer than the one installed in these Dockerfiles on the branch being
built, which is what happened today.

The git clone should really be for the commit being built, but that
would make the image specific to that build, which means we might as
well not pre-seed.

The pre-seeding of these gems was of dubious utility anyway, since we
rebuild the package build images on every package build step invocation
on the CI server.

refs #18766

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoFix tests refs #18773
Peter Amstutz [Tue, 8 Mar 2022 22:00:10 +0000 (17:00 -0500)]
Fix tests refs #18773

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoUpdate versions on installer/arvbox/docs refs #18733
Peter Amstutz [Tue, 8 Mar 2022 18:43:08 +0000 (13:43 -0500)]
Update versions on installer/arvbox/docs refs #18733

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18808-new-token-race' to 2.3-release
Tom Clegg [Mon, 7 Mar 2022 19:19:14 +0000 (14:19 -0500)]
Merge branch '18808-new-token-race' to 2.3-release

cherry-pick d05b16ce4d4eea6841bf105081191f9964b485b7 + resolve merge
conflict

refs #18808

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoFix python2-ism
Peter Amstutz [Fri, 4 Mar 2022 22:03:06 +0000 (17:03 -0500)]
Fix python2-ism

refs #18835

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18785: avoid error when /etc/cloud/cloud.cfg.d does not exist.
Ward Vandewege [Tue, 1 Mar 2022 21:57:07 +0000 (16:57 -0500)]
18785: avoid error when /etc/cloud/cloud.cfg.d does not exist.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: small doc tweak.
Ward Vandewege [Tue, 1 Mar 2022 21:05:55 +0000 (16:05 -0500)]
18785: small doc tweak.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: remove the documentation for the single host, multiple hostnames
Ward Vandewege [Tue, 1 Mar 2022 20:59:19 +0000 (15:59 -0500)]
18785: remove the documentation for the single host, multiple hostnames
       case. This configuration is not very useful, and it should be
       possible to achieve this setup by using the multiple hostname
       installer on a single node.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: update defaults and comments in local.params files.
Ward Vandewege [Tue, 1 Mar 2022 19:22:52 +0000 (14:22 -0500)]
18785: update defaults and comments in local.params files.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: add explicit test that IP_INT is set correctly in the single host
Ward Vandewege [Tue, 1 Mar 2022 17:50:55 +0000 (12:50 -0500)]
18785: add explicit test that IP_INT is set correctly in the single host
       case.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: documentation: mention the possible need for chained certificates
Ward Vandewege [Tue, 1 Mar 2022 17:44:25 +0000 (12:44 -0500)]
18785: documentation: mention the possible need for chained certificates
       in the bring-your-own certificates case.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: fix self-signed single host installation.
Ward Vandewege [Tue, 1 Mar 2022 16:46:25 +0000 (11:46 -0500)]
18785: fix self-signed single host installation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: make sure the user configures IP_INT in the single host case.
Ward Vandewege [Tue, 1 Mar 2022 16:45:42 +0000 (11:45 -0500)]
18785: make sure the user configures IP_INT in the single host case.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: make sure that dnsmasq is present, and make sure that our
Ward Vandewege [Tue, 1 Mar 2022 14:27:50 +0000 (09:27 -0500)]
18785: make sure that dnsmasq is present, and make sure that our
       customized /etc/hosts survives a reboot.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: update documentation, fix run-tests.sh bug in single host/single
Ward Vandewege [Tue, 1 Mar 2022 02:38:19 +0000 (21:38 -0500)]
18785: update documentation, fix run-tests.sh bug in single host/single
       hostname + LE mode, change default workbench port to 443 in
       single host.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18785: edit documentation, addressing review comments
Javier Bértoli [Mon, 28 Feb 2022 18:34:52 +0000 (15:34 -0300)]
18785: edit documentation, addressing review comments

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: edit documentation, addressing review comments
Javier Bértoli [Mon, 28 Feb 2022 17:41:43 +0000 (14:41 -0300)]
18785: edit documentation, addressing review comments

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: add missing lines addressing review suggestions
Javier Bértoli [Mon, 28 Feb 2022 17:10:46 +0000 (14:10 -0300)]
18785: add missing lines addressing review suggestions

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: add conditional logic for bring-your-own certificates
Javier Bértoli [Mon, 28 Feb 2022 17:04:17 +0000 (14:04 -0300)]
18785: add conditional logic for bring-your-own certificates

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: remove comment addressing review suggestions
Javier Bértoli [Mon, 28 Feb 2022 17:01:08 +0000 (14:01 -0300)]
18785: remove comment addressing review suggestions

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: add missing lines addressing review suggestions
Javier Bértoli [Mon, 28 Feb 2022 16:58:36 +0000 (13:58 -0300)]
18785: add missing lines addressing review suggestions

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: remove unneeded entry in snakeoil certs state
Javier Bértoli [Fri, 25 Feb 2022 22:32:44 +0000 (19:32 -0300)]
18785: remove unneeded entry in snakeoil certs state

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18785: fix letsencrypt/nginx deployment issues for single-host/single-hostname
Javier Bértoli [Fri, 25 Feb 2022 22:17:25 +0000 (19:17 -0300)]
18785: fix letsencrypt/nginx deployment issues for single-host/single-hostname

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18791: allow single-host-single-hostname to manage LE certs
Javier Bértoli [Fri, 25 Feb 2022 16:40:15 +0000 (13:40 -0300)]
18791: allow single-host-single-hostname to manage LE certs

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18791: make the test hasher workflow work by fixing dns resolution
Ward Vandewege [Fri, 25 Feb 2022 02:08:47 +0000 (21:08 -0500)]
18791: make the test hasher workflow work by fixing dns resolution
       inside docker. Cleanup for the local.params file.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18791: update documentation, fix single host/single hostname installer
Ward Vandewege [Mon, 21 Feb 2022 00:44:24 +0000 (19:44 -0500)]
18791: update documentation, fix single host/single hostname installer
       with self-signed certificates. Fix tests/run-test.sh so it works
       even with just crunch-dispatch-local.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18801-aca-req-select-uuid'. Closes #18801
Lucas Di Pentima [Fri, 25 Feb 2022 19:29:12 +0000 (16:29 -0300)]
Merge branch '18801-aca-req-select-uuid'. Closes #18801

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoThe base.sh script that is run by Packer should abort when it encounters
Ward Vandewege [Wed, 23 Feb 2022 19:06:13 +0000 (14:06 -0500)]
The base.sh script that is run by Packer should abort when it encounters
any errors.

refs #18772

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoBugfix: make the create-ebs-volume patch apply.
Ward Vandewege [Wed, 23 Feb 2022 18:52:29 +0000 (13:52 -0500)]
Bugfix: make the create-ebs-volume patch apply.

refs #18772

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: a few more improvements for the autoscaler script, from the
Ward Vandewege [Tue, 22 Feb 2022 18:52:36 +0000 (13:52 -0500)]
18772: a few more improvements for the autoscaler script, from the
       review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: address review feedback.
Ward Vandewege [Tue, 22 Feb 2022 01:37:47 +0000 (20:37 -0500)]
18772: address review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: document the AWS EBS autoscaler support. Refactor the "Build a
Ward Vandewege [Mon, 21 Feb 2022 14:32:08 +0000 (09:32 -0500)]
18772: document the AWS EBS autoscaler support. Refactor the "Build a
       cloud compute node image" documentation page to improve the flow.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: consistently use bash comparison operators in build.sh
Ward Vandewege [Mon, 21 Feb 2022 14:08:30 +0000 (09:08 -0500)]
18772: consistently use bash comparison operators in build.sh

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: add support for the AWS EBS autoscale script to the compute node
Ward Vandewege [Sat, 19 Feb 2022 00:27:11 +0000 (19:27 -0500)]
18772: add support for the AWS EBS autoscale script to the compute node
       image builder.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18772: arvados-dispatch-cloud: add IamInstanceProfile field to the ec2
Ward Vandewege [Thu, 17 Feb 2022 21:31:23 +0000 (16:31 -0500)]
18772: arvados-dispatch-cloud: add IamInstanceProfile field to the ec2
       driver.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18773-check-image-id' refs #18773
Peter Amstutz [Fri, 18 Feb 2022 22:52:54 +0000 (17:52 -0500)]
Merge branch '18773-check-image-id' refs #18773

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoFix typo.
Ward Vandewege [Thu, 17 Feb 2022 19:35:31 +0000 (14:35 -0500)]
Fix typo.

refs #18702

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: consolidate upgrade instructions in one place; move the
Ward Vandewege [Thu, 17 Feb 2022 00:29:34 +0000 (19:29 -0500)]
18702: consolidate upgrade instructions in one place; move the
       "maintenance and upgrading" page to the admin directory, fix a
       few small things on the upgrade notes page.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: fix one more link to the configuration migration page to point at
Ward Vandewege [Thu, 17 Feb 2022 00:16:35 +0000 (19:16 -0500)]
18702: fix one more link to the configuration migration page to point at
       the most recent version.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: remove the old document about upgrading the configuration from
Ward Vandewege [Wed, 16 Feb 2022 18:47:19 +0000 (13:47 -0500)]
18702: remove the old document about upgrading the configuration from
       Arvados versions prior to 2.0, to improve in the install section.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18702: add documentation for maintaining and upgrading Arvados. Make it
Ward Vandewege [Wed, 16 Feb 2022 15:39:41 +0000 (10:39 -0500)]
18702: add documentation for maintaining and upgrading Arvados. Make it
       clear that the Salt-based installer is only intended for
       installation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18723-cwl-upload' refs #18723
Peter Amstutz [Mon, 14 Feb 2022 18:50:05 +0000 (13:50 -0500)]
Merge branch '18723-cwl-upload' refs #18723

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18690-secret-files'
Tom Clegg [Fri, 11 Feb 2022 18:11:43 +0000 (13:11 -0500)]
Merge branch '18690-secret-files'

fixes #18690

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18719-fuse-fixes' refs #18719
Peter Amstutz [Wed, 9 Feb 2022 21:34:54 +0000 (16:34 -0500)]
Merge branch '18719-fuse-fixes' refs #18719

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18577-fix-back_url'
Ward Vandewege [Fri, 7 Jan 2022 18:56:25 +0000 (13:56 -0500)]
Merge branch '18577-fix-back_url'

closes #18577

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18703: upgrade Vagrantfile to debian-11
Javier Bértoli [Tue, 1 Feb 2022 23:15:40 +0000 (20:15 -0300)]
18703: upgrade Vagrantfile to debian-11

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18703: upgrade postgres-formula to 0.43.0 for debian-11
Javier Bértoli [Tue, 1 Feb 2022 23:14:59 +0000 (20:14 -0300)]
18703: upgrade postgres-formula to 0.43.0 for debian-11

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18632: address review comments.
Javier Bértoli [Fri, 28 Jan 2022 18:36:03 +0000 (15:36 -0300)]
18632: address review comments.

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18632: fix missing docker's pillar in shell node
Javier Bértoli [Thu, 27 Jan 2022 22:06:33 +0000 (19:06 -0300)]
18632: fix missing docker's pillar in shell node

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18632: fix docker pillar in provision script
Javier Bértoli [Thu, 27 Jan 2022 18:31:04 +0000 (15:31 -0300)]
18632: fix docker pillar in provision script

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18678: installer: when custom certs are used, do not abort when a role
Ward Vandewege [Tue, 25 Jan 2022 19:55:38 +0000 (14:55 -0500)]
18678: installer: when custom certs are used, do not abort when a role
       is used that does not require any certificates.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18665: Separate Set Host and Set Token steps
Peter Amstutz [Mon, 24 Jan 2022 18:43:30 +0000 (13:43 -0500)]
18665: Separate Set Host and Set Token steps

Being separated because the previous "paste the whole
contents of the dialog box" was actually more confusing than helpful.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoDocumentation tweaks for the Salt installer.
Ward Vandewege [Fri, 21 Jan 2022 20:16:32 +0000 (15:16 -0500)]
Documentation tweaks for the Salt installer.

refs #18658

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18658-fix-custom-certs-deployment-on-multi-host' into 2.3-release
Javier Bértoli [Fri, 21 Jan 2022 20:05:30 +0000 (17:05 -0300)]
Merge branch '18658-fix-custom-certs-deployment-on-multi-host' into 2.3-release

closes #18658
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18658: address review comments.
Javier Bértoli [Fri, 21 Jan 2022 19:07:00 +0000 (16:07 -0300)]
18658: address review comments.

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18658: ensure custom SSL certs are copied to the correct host dir
Javier Bértoli [Thu, 20 Jan 2022 23:17:26 +0000 (20:17 -0300)]
18658: ensure custom SSL certs are copied to the correct host dir

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18658: update multi-host's nginx pillar to use rvm ruby on Ubuntu-18.04
Javier Bértoli [Thu, 20 Jan 2022 23:16:12 +0000 (20:16 -0300)]
18658: update multi-host's nginx pillar to use rvm ruby on Ubuntu-18.04

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18658: add missing state to deploy custom certs in multi-host env
Javier Bértoli [Thu, 20 Jan 2022 15:22:16 +0000 (12:22 -0300)]
18658: add missing state to deploy custom certs in multi-host env

Also, set the full path to the certs dir if not configured

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoSalt installer fixes:
Ward Vandewege [Thu, 20 Jan 2022 21:34:08 +0000 (16:34 -0500)]
Salt installer fixes:
* documentation: fix formatting
* multi-host aws example: remove AccessViaHosts from the config file, it
  is not necessary. Fix volume identifiers. Fix link to documentation by
  dispatcher key.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoRelease branches were renamed.
Ward Vandewege [Tue, 18 Jan 2022 18:18:28 +0000 (13:18 -0500)]
Release branches were renamed.

refs #18249

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18624: implement review feedback.
Ward Vandewege [Fri, 14 Jan 2022 18:51:44 +0000 (13:51 -0500)]
18624: implement review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18624: crunch-run no longer needs to be preinstalled on our cloud
Ward Vandewege [Thu, 13 Jan 2022 13:39:10 +0000 (08:39 -0500)]
18624: crunch-run no longer needs to be preinstalled on our cloud
       compute images, arvados-dispatch-cloud copies it over.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18624: documentation: describe the arvados-dispatch-cloud requirements
Ward Vandewege [Wed, 12 Jan 2022 21:33:47 +0000 (16:33 -0500)]
18624: documentation: describe the arvados-dispatch-cloud requirements
       for compute nodes.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoRelease branches were renamed.
Ward Vandewege [Thu, 6 Jan 2022 18:00:18 +0000 (13:00 -0500)]
Release branches were renamed.

refs #18249

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoBugfixes: doc: show the correct branch names for all the Salt install
Ward Vandewege [Thu, 6 Jan 2022 17:02:37 +0000 (12:02 -0500)]
Bugfixes: doc: show the correct branch names for all the Salt install
methods.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18273-java-timeout' refs #18273
Peter Amstutz [Fri, 29 Oct 2021 15:17:36 +0000 (11:17 -0400)]
Merge branch '18273-java-timeout' refs #18273

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoUpdate package versions for arvbox & provision.sh 2.3.2
Peter Amstutz [Thu, 9 Dec 2021 16:27:08 +0000 (11:27 -0500)]
Update package versions for arvbox & provision.sh

refs #18518

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoAdd (empty) upgrading section for 2.3.2
Peter Amstutz [Wed, 8 Dec 2021 21:22:12 +0000 (16:22 -0500)]
Add (empty) upgrading section for 2.3.2

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17667: a round of edits after review feedback.
Ward Vandewege [Tue, 7 Dec 2021 00:46:01 +0000 (19:46 -0500)]
17667: a round of edits after review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago17667: add some missing information on the "Install prerequisites" page.
Ward Vandewege [Mon, 6 Dec 2021 17:48:57 +0000 (12:48 -0500)]
17667: add some missing information on the "Install prerequisites" page.
       Update the "Install PostgreSQL" page with a reference to Aurora
       RDS. Add a new page that details InternalURLs/ExternalURL.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18547: Error out if two volumes return the same non-empty DeviceID.
Tom Clegg [Tue, 7 Dec 2021 00:32:34 +0000 (19:32 -0500)]
18547: Error out if two volumes return the same non-empty DeviceID.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18547: Use volume UUID instead of DeviceID to deduplicate mounts.
Tom Clegg [Fri, 3 Dec 2021 15:54:59 +0000 (10:54 -0500)]
18547: Use volume UUID instead of DeviceID to deduplicate mounts.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18376: Retry up to 4 times on EBADCOOKIE from readdir.
Tom Clegg [Thu, 18 Nov 2021 19:31:01 +0000 (14:31 -0500)]
18376: Retry up to 4 times on EBADCOOKIE from readdir.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18491: Removes an unnecessary check that made the test fail on module upgrade.
Lucas Di Pentima [Tue, 30 Nov 2021 15:37:00 +0000 (12:37 -0300)]
18491: Removes an unnecessary check that made the test fail on module upgrade.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agogithub.com/Azure/go-autorest/autorest/azure/auth go-jwt security fix
Peter Amstutz [Mon, 6 Dec 2021 18:45:32 +0000 (13:45 -0500)]
github.com/Azure/go-autorest/autorest/azure/auth go-jwt security fix

refs #18491

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18511-java-sdk-groups-links' refs #18511
Peter Amstutz [Thu, 2 Dec 2021 15:31:27 +0000 (10:31 -0500)]
Merge branch '18511-java-sdk-groups-links' refs #18511

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18490-redundant-updates' refs #18490
Peter Amstutz [Wed, 1 Dec 2021 22:27:15 +0000 (17:27 -0500)]
Merge branch '18490-redundant-updates' refs #18490

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18480-arvput-special-files-handling' into main. Closes #18480
Lucas Di Pentima [Fri, 26 Nov 2021 16:21:34 +0000 (13:21 -0300)]
Merge branch '18480-arvput-special-files-handling' into main. Closes #18480

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18488: Close pg connection when waiting for lock.
Tom Clegg [Tue, 30 Nov 2021 15:57:08 +0000 (10:57 -0500)]
18488: Close pg connection when waiting for lock.

In practice, pg_advisory_lock() calls pile up and consume database
connection slots, even when the corresponding processes have exited.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoDocumentation: fix AWS region name in the configuration reference and on
Ward Vandewege [Wed, 1 Dec 2021 20:48:54 +0000 (15:48 -0500)]
Documentation: fix AWS region name in the configuration reference and on
the S3 configuration page.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoUpdate provision.sh VERSION=2.3.1-1 refs #18361
Peter Amstutz [Wed, 24 Nov 2021 14:36:19 +0000 (09:36 -0500)]
Update provision.sh VERSION=2.3.1-1 refs #18361

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoUpdate arvbox DEFAULT_TAG to 2.3.1 refs #18361
Peter Amstutz [Wed, 24 Nov 2021 14:28:56 +0000 (09:28 -0500)]
Update arvbox DEFAULT_TAG to 2.3.1 refs #18361

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18313-arvbox-bootstrap-go-version' 2.3.1
Ward Vandewege [Tue, 2 Nov 2021 16:53:31 +0000 (12:53 -0400)]
Merge branch '18313-arvbox-bootstrap-go-version'

closes #18313

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoWe now rely on Go 1.16. Unbreak the arvbox build toolchain by switching
Ward Vandewege [Fri, 29 Oct 2021 13:29:29 +0000 (09:29 -0400)]
We now rely on Go 1.16. Unbreak the arvbox build toolchain by switching
to upstream Golang, the buster-backports version is too old.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '17742-provide-custom-certs'
Javier Bértoli [Thu, 21 Oct 2021 19:00:13 +0000 (16:00 -0300)]
Merge branch '17742-provide-custom-certs'

closes #17742
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '18298-lsf-no-suitable-hosts'
Tom Clegg [Mon, 22 Nov 2021 18:45:21 +0000 (13:45 -0500)]
Merge branch '18298-lsf-no-suitable-hosts'

refs #18298

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18298-lsf-no-suitable-hosts'
Tom Clegg [Fri, 19 Nov 2021 22:29:50 +0000 (17:29 -0500)]
Merge branch '18298-lsf-no-suitable-hosts'

refs #18298

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18339-sweep-trash-lock'
Tom Clegg [Thu, 18 Nov 2021 20:01:06 +0000 (15:01 -0500)]
Merge branch '18339-sweep-trash-lock'

fixes #18339

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoUsing curl against https requires the ca-certificates package, update
Ward Vandewege [Fri, 19 Nov 2021 01:15:07 +0000 (20:15 -0500)]
Using curl against https requires the ca-certificates package, update
the docs accordingly. Also remove the 'silent' flag from curl so that
errors are shown.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoUpgrade notes are for 2.3.1 refs #18361
Peter Amstutz [Thu, 18 Nov 2021 19:38:46 +0000 (14:38 -0500)]
Upgrade notes are for 2.3.1 refs #18361

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoFix up "upgrading to {earlier version}" links.
Tom Clegg [Thu, 28 Oct 2021 14:28:44 +0000 (10:28 -0400)]
Fix up "upgrading to {earlier version}" links.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '17962-check-wf-definition' refs #17962
Peter Amstutz [Wed, 17 Nov 2021 22:03:57 +0000 (17:03 -0500)]
Merge branch '17962-check-wf-definition' refs #17962

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18285-cwl-hint-warning' refs #18285
Peter Amstutz [Wed, 17 Nov 2021 17:55:16 +0000 (12:55 -0500)]
Merge branch '18285-cwl-hint-warning' refs #18285

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18363-managed-properties-doc-improvement' into main.
Lucas Di Pentima [Wed, 17 Nov 2021 18:28:37 +0000 (15:28 -0300)]
Merge branch '18363-managed-properties-doc-improvement' into main.
Closes #18363

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18340-delete-role-filter-groups' into main. Closes #18340.
Lucas Di Pentima [Wed, 17 Nov 2021 15:03:42 +0000 (12:03 -0300)]
Merge branch '18340-delete-role-filter-groups' into main. Closes #18340.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18336-httplib2-pysdk-issues' into main. Closes #18336
Lucas Di Pentima [Wed, 17 Nov 2021 15:16:54 +0000 (12:16 -0300)]
Merge branch '18336-httplib2-pysdk-issues' into main. Closes #18336

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '18346-crunchrun-no-events' refs #18346
Peter Amstutz [Fri, 12 Nov 2021 14:38:05 +0000 (09:38 -0500)]
Merge branch '18346-crunchrun-no-events' refs #18346

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>