arvados-dev.git
7 days agoScript to publish R package fails fast and accepts host key main
Peter Amstutz [Wed, 13 Nov 2024 23:32:13 +0000 (18:32 -0500)]
Script to publish R package fails fast and accepts host key

refs #22084

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

13 days agoRun CWL tests against 1.2.1 test suite, no issue #
Peter Amstutz [Thu, 7 Nov 2024 14:27:12 +0000 (09:27 -0500)]
Run CWL tests against 1.2.1 test suite, no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 weeks agoMerge branch '22186-ubuntu-fix'. Refs #22186
Lucas Di Pentima [Wed, 6 Nov 2024 22:01:11 +0000 (19:01 -0300)]
Merge branch '22186-ubuntu-fix'. Refs #22186

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 weeks ago22186: Moves cloud-init execution to the common script. 22186-ubuntu-fix
Lucas Di Pentima [Wed, 6 Nov 2024 21:53:14 +0000 (18:53 -0300)]
22186: Moves cloud-init execution to the common script.

Also removes unused SSH keys.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 weeks ago22186: Waits for cloud-init to finish before attempting package installations.
Lucas Di Pentima [Wed, 6 Nov 2024 21:37:26 +0000 (18:37 -0300)]
22186: Waits for cloud-init to finish before attempting package installations.

This is following packer's advice at:
https://developer.hashicorp.com/packer/docs/debugging#issues-installing-ubuntu-packages

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 weeks agoMerge branch '22186-jenkins-docker-mirror' refs #22186
Peter Amstutz [Wed, 6 Nov 2024 18:01:02 +0000 (13:01 -0500)]
Merge branch '22186-jenkins-docker-mirror' refs #22186

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 weeks ago22186: Set up registry-mirrors in jenkins-image-with-docker 22186-jenkins-docker-mirror
Peter Amstutz [Wed, 6 Nov 2024 17:49:51 +0000 (12:49 -0500)]
22186: Set up registry-mirrors in jenkins-image-with-docker

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 weeks ago22186: Update debian base image and consolidate scripts a bit
Peter Amstutz [Wed, 6 Nov 2024 17:45:44 +0000 (12:45 -0500)]
22186: Update debian base image and consolidate scripts a bit

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 weeks ago22206: Add release task to update third-party package pins
Brett Smith [Mon, 4 Nov 2024 16:01:28 +0000 (11:01 -0500)]
22206: Add release task to update third-party package pins

See <https://dev.arvados.org/projects/arvados/wiki/Release_Checklist>
for more details. Refs #22206.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21909: Update build-package-r to build the package with make
Brett Smith [Thu, 19 Sep 2024 20:31:00 +0000 (16:31 -0400)]
21909: Update build-package-r to build the package with make

This is necessary to generate code and documentation before packaging
everything up. The rest of the changes are just path adjustments now
that the script works out of `sdk/R/` instead of just `sdk/`.
Refs #21909.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

4 months ago21931: Support uploading the arvados-google-api-client gem
Brett Smith [Wed, 3 Jul 2024 14:52:45 +0000 (10:52 -0400)]
21931: Support uploading the arvados-google-api-client gem

Because this is updated rarely and does not follow Arvados versioning,
it is uploaded by a dedicated Jenkins job, not the usual
build-packages-multijob. But that's fine, we can still use the existing
tooling. Refs #21931.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

5 months ago21855: Update RPM filesystem path
Brett Smith [Thu, 20 Jun 2024 20:49:44 +0000 (16:49 -0400)]
21855: Update RPM filesystem path

Since we no longer expect to publish packages for CentOS after it
changed its release model. Refs #21855

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

5 months ago21363: Update name of SSH service
Brett Smith [Fri, 7 Jun 2024 14:58:01 +0000 (10:58 -0400)]
21363: Update name of SSH service

The SSH server service has always been named ssh.service (at least since
Ubuntu 20.04). Some distros provide an sshd.service alias, but Ubuntu
24.04 does not, so don't use it.

Note this makes the command consistent with jenkins-image-common.sh.

Refs #21363.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

5 months ago21363: Add ubuntu2404 to run_upload_packages
Brett Smith [Fri, 7 Jun 2024 13:10:38 +0000 (09:10 -0400)]
21363: Add ubuntu2404 to run_upload_packages

Refs #21363.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

5 months agoMerge branch '21840-twine-upload'
Brett Smith [Tue, 28 May 2024 16:05:40 +0000 (12:05 -0400)]
Merge branch '21840-twine-upload'

Refs #21840.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

5 months ago21840: Use twine for Python uploads
Brett Smith [Tue, 28 May 2024 16:00:47 +0000 (12:00 -0400)]
21840: Use twine for Python uploads

In addition to getting us away from a deprecated setup.py invocation,
this also lets the Python upload work a lot more like the Ruby upload:
you just upload distributions that Jenkins built previously.

Note uploading wheels will require a mirror change in the Jenkins build
script.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

5 months ago21840: Migrate from pipes.quote to shlex.quote
Brett Smith [Tue, 28 May 2024 15:40:30 +0000 (11:40 -0400)]
21840: Migrate from pipes.quote to shlex.quote

To avoid the pipes deprecation in modern Python.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

6 months agoUpdate release process TASKS
Peter Amstutz [Mon, 20 May 2024 13:59:05 +0000 (09:59 -0400)]
Update release process TASKS

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

6 months agoart: print git hash and message when running find-and-associate
Peter Amstutz [Mon, 20 May 2024 13:55:01 +0000 (09:55 -0400)]
art: print git hash and message when running find-and-associate

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

6 months agoMerge branch '21521-aptly-flock'
Brett Smith [Mon, 29 Apr 2024 17:35:40 +0000 (13:35 -0400)]
Merge branch '21521-aptly-flock'

Refs #21521.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

6 months ago21521: Wrap aptly commands in flock 21521-aptly-flock
Brett Smith [Fri, 26 Apr 2024 20:47:50 +0000 (16:47 -0400)]
21521: Wrap aptly commands in flock

See comments for rationale.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

6 months ago21521: Make apt upload script less verbose
Brett Smith [Fri, 26 Apr 2024 20:41:55 +0000 (16:41 -0400)]
21521: Make apt upload script less verbose

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

7 months ago21662: Refine distro detection in jenkins-image-common
Brett Smith [Fri, 19 Apr 2024 20:06:05 +0000 (16:06 -0400)]
21662: Refine distro detection in jenkins-image-common

* Use ID_LIKE to identify distros rather than having whole lists.
* Only install buster-backports when we're actually on buster.

Refs #21662.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

7 months agoAdd a banner to the package promotion logging.
Peter Amstutz [Thu, 11 Apr 2024 13:46:24 +0000 (09:46 -0400)]
Add a banner to the package promotion logging.

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

7 months agoFix package publishing script to handle both deb and rpm in one command
Peter Amstutz [Thu, 11 Apr 2024 13:35:11 +0000 (09:35 -0400)]
Fix package publishing script to handle both deb and rpm in one command

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

7 months agoUse createrepo_c, no issue #
Peter Amstutz [Thu, 11 Apr 2024 13:16:35 +0000 (09:16 -0400)]
Use createrepo_c, no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

7 months agoAdd set-sprint subcommand to 'art', no issue #
Peter Amstutz [Fri, 5 Apr 2024 20:20:37 +0000 (16:20 -0400)]
Add set-sprint subcommand to 'art', no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

7 months agoUses createrepo_c instead of createrepo. Refs #21616
Lucas Di Pentima [Tue, 2 Apr 2024 12:23:15 +0000 (09:23 -0300)]
Uses createrepo_c instead of createrepo. Refs #21616

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

8 months agoFixes in git checkout call. Refs #21461
Lucas Di Pentima [Wed, 21 Feb 2024 22:53:17 +0000 (19:53 -0300)]
Fixes in git checkout call. Refs #21461

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

8 months agoFurther fixes on envvar passthrough on packer scripts. Refs #21461
Lucas Di Pentima [Wed, 21 Feb 2024 22:46:48 +0000 (19:46 -0300)]
Further fixes on envvar passthrough on packer scripts. Refs #21461

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

8 months agoPasses arvados git hash as a envvar to the packer script. Refs #21461
Lucas Di Pentima [Wed, 21 Feb 2024 22:13:09 +0000 (19:13 -0300)]
Passes arvados git hash as a envvar to the packer script. Refs #21461

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

8 months agoAllow requesting a specific arvados commit hash for image buildind. Refs #21461
Lucas Di Pentima [Wed, 21 Feb 2024 20:26:40 +0000 (17:26 -0300)]
Allow requesting a specific arvados commit hash for image buildind. Refs #21461

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

8 months agoFixes sysctl call on provisioning scripts. Refs #21461
Lucas Di Pentima [Wed, 21 Feb 2024 18:10:43 +0000 (15:10 -0300)]
Fixes sysctl call on provisioning scripts. Refs #21461

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

8 months agoApplies settings from sysctl conf file. Refs #21461
Lucas Di Pentima [Wed, 21 Feb 2024 17:53:15 +0000 (14:53 -0300)]
Applies settings from sysctl conf file. Refs #21461

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

8 months agoUses Debian Bullseye as a base for wb2 jenkins image. Refs #21461
Lucas Di Pentima [Wed, 21 Feb 2024 14:36:57 +0000 (11:36 -0300)]
Uses Debian Bullseye as a base for wb2 jenkins image. Refs #21461

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

8 months agoUpdates WB2 image building script for Jenkins. Refs #21461
Lucas Di Pentima [Wed, 21 Feb 2024 14:28:32 +0000 (11:28 -0300)]
Updates WB2 image building script for Jenkins. Refs #21461

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

10 months agoincrease fs.inotify.max_user_watches to run wb2 tests
Peter Amstutz [Tue, 16 Jan 2024 20:33:17 +0000 (15:33 -0500)]
increase fs.inotify.max_user_watches to run wb2 tests

refs #21393

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

10 months agoChanges the SSH key type that packer creates to communicate with nodes.
Lucas Di Pentima [Fri, 12 Jan 2024 18:17:58 +0000 (15:17 -0300)]
Changes the SSH key type that packer creates to communicate with nodes.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

This is a test to see if the packer-build-provision-testing-image pipeline
works with Debian 12 & Ubuntu 22.04, that seem to have deprecated RSA SSH
key types for authentication.

No issue #

10 months agoReverts previous change as it wasn't needed. No issue #
Lucas Di Pentima [Fri, 12 Jan 2024 15:51:00 +0000 (12:51 -0300)]
Reverts previous change as it wasn't needed. No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

10 months agoMoves packer installation to the common script. No issue #
Lucas Di Pentima [Thu, 11 Jan 2024 21:50:18 +0000 (18:50 -0300)]
Moves packer installation to the common script. No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

10 months agoSets Debian image to v11. Refs #21330
Lucas Di Pentima [Tue, 2 Jan 2024 22:16:19 +0000 (19:16 -0300)]
Sets Debian image to v11. Refs #21330

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

10 months ago20846: Add debian12 and ubuntu2204 upload targets
Brett Smith [Fri, 29 Dec 2023 14:59:38 +0000 (09:59 -0500)]
20846: Add debian12 and ubuntu2204 upload targets

I also checked testing_to_stable_publish_packages.sh and
upload_packages_testing_to_stable.sh but there doesn't seem to be
anything to update in those. They seem to default to working on
deb-based distributions just fine.

Refs #20846.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months agoAdd task to update public-facing clusters to stable release
Peter Amstutz [Fri, 8 Dec 2023 15:21:14 +0000 (10:21 -0500)]
Add task to update public-facing clusters to stable release

refs #21089

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

12 months agoInstalls 'createrepo-c' package instead of the deprecated 'createrepo'.
Lucas Di Pentima [Tue, 7 Nov 2023 19:49:25 +0000 (16:49 -0300)]
Installs 'createrepo-c' package instead of the deprecated 'createrepo'.
No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

12 months agoSets Debian image to v11. No issue #
Lucas Di Pentima [Tue, 7 Nov 2023 19:38:05 +0000 (16:38 -0300)]
Sets Debian image to v11. No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

14 months agoAdd rocky8 to publish package script
Peter Amstutz [Thu, 21 Sep 2023 16:57:02 +0000 (12:57 -0400)]
Add rocky8 to publish package script

refs #20769

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

15 months agoMerge branch '20797-rh8-packages'
Brett Smith [Tue, 1 Aug 2023 21:29:32 +0000 (17:29 -0400)]
Merge branch '20797-rh8-packages'

Refs #20797. Closes #20807.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

15 months ago20797: Add support for rocky8 upload target 20797-rh8-packages
Brett Smith [Tue, 1 Aug 2023 18:52:49 +0000 (14:52 -0400)]
20797: Add support for rocky8 upload target

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

17 months agoAccept "resolves #" (equivalent to "closes #"), update help message.
Tom Clegg [Thu, 1 Jun 2023 13:31:53 +0000 (09:31 -0400)]
Accept "resolves #" (equivalent to "closes #"), update help message.

no issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

21 months agoMerge branch '19920-move-unassigned-open-tickets'. Closes #19920
Lucas Di Pentima [Wed, 15 Feb 2023 15:52:40 +0000 (12:52 -0300)]
Merge branch '19920-move-unassigned-open-tickets'. Closes #19920

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

21 months agoAdds worker pool to speed up processing lots of issues. Refs #19920 19920-move-unassigned-open-tickets
Lucas Di Pentima [Wed, 25 Jan 2023 21:29:47 +0000 (18:29 -0300)]
Adds worker pool to speed up processing lots of issues. Refs #19920

The single-threaded version was processing issues at about 1 per second,
too slow to move lots of issues in one go.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

21 months agoIgnore .gitignore files for licensing. No issue #
Lucas Di Pentima [Wed, 25 Jan 2023 18:55:08 +0000 (15:55 -0300)]
Ignore .gitignore files for licensing. No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

21 months agoAdds 'associate-orphans' subcommand. Refs #19920
Lucas Di Pentima [Wed, 25 Jan 2023 18:38:35 +0000 (15:38 -0300)]
Adds 'associate-orphans' subcommand. Refs #19920

This subcommand takes a project name, a release ID and searches for
every open issue that's not assigned to a version and release,
associating it with the given release ID.
There's a dry-run parameter to allow the user to double check before
committing.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

21 months agoAdds release filtering on issues. Refs #19920
Lucas Di Pentima [Wed, 25 Jan 2023 14:44:03 +0000 (11:44 -0300)]
Adds release filtering on issues. Refs #19920

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

21 months agoAdds gitignore. Refs #19920
Lucas Di Pentima [Thu, 19 Jan 2023 14:32:18 +0000 (11:32 -0300)]
Adds gitignore. Refs #19920

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

23 months agoArvados release tool maintenance, refs #19647
Peter Amstutz [Tue, 13 Dec 2022 15:35:05 +0000 (10:35 -0500)]
Arvados release tool maintenance, refs #19647

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

23 months agoFixes installer var replacement. No issue #
Lucas Di Pentima [Tue, 6 Dec 2022 23:13:33 +0000 (00:13 +0100)]
Fixes installer var replacement. No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoFix go.mod confusion.
Tom Clegg [Thu, 10 Nov 2022 17:08:07 +0000 (12:08 -0500)]
Fix go.mod confusion.

refs #19572

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoUpdate release process a bit
Peter Amstutz [Fri, 5 Aug 2022 21:05:01 +0000 (17:05 -0400)]
Update release process a bit

refs #19330

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoTweak to the order of release tasks: the reference to the default
Ward Vandewege [Wed, 1 Jun 2022 17:34:51 +0000 (13:34 -0400)]
Tweak to the order of release tasks: the reference to the default
package that the installer uses should only be updated after that
package is published.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoSalt installer change: standardize on putting the certs directory under
Ward Vandewege [Wed, 1 Jun 2022 14:22:49 +0000 (10:22 -0400)]
Salt installer change: standardize on putting the certs directory under
the local_config_dir directory, this simplifies things.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '19092-upload-crunchstat_summary-to-pypi'
Ward Vandewege [Wed, 25 May 2022 15:41:53 +0000 (11:41 -0400)]
Merge branch '19092-upload-crunchstat_summary-to-pypi'

closes #19092

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago19092: upload crunchstat_summary to Pypi 19092-upload-crunchstat_summary-to-pypi
Ward Vandewege [Wed, 25 May 2022 14:33:15 +0000 (10:33 -0400)]
19092: upload crunchstat_summary to Pypi

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoTweak fuse.conf after the fuse package is installed, not before.
Ward Vandewege [Fri, 20 May 2022 19:55:54 +0000 (15:55 -0400)]
Tweak fuse.conf after the fuse package is installed, not before.

refs #15370

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoFor running our tests, FUSE must be configured with the
Ward Vandewege [Fri, 20 May 2022 19:40:43 +0000 (15:40 -0400)]
For running our tests, FUSE must be configured with the
'user_allow_other' option enabled for Crunch to set up Keep mounts that
are readable by containers.

refs #15370

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoBump the buster base image for our test image.
Ward Vandewege [Fri, 20 May 2022 19:32:49 +0000 (15:32 -0400)]
Bump the buster base image for our test image.

refs #15370

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoAdd docker to our tests image.
Ward Vandewege [Fri, 20 May 2022 16:38:58 +0000 (12:38 -0400)]
Add docker to our tests image.

refs #15370

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoAdd a convenient way to disable our git hooks via an environment
Ward Vandewege [Thu, 19 May 2022 17:41:29 +0000 (13:41 -0400)]
Add a convenient way to disable our git hooks via an environment
variable.

refs #18872

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoOur base test image installs the correct version of Go (detected in the
Ward Vandewege [Wed, 13 Apr 2022 16:53:25 +0000 (12:53 -0400)]
Our base test image installs the correct version of Go (detected in the
usual way from the Arvados source tree).

Check out the git tree using the git protocol, not http.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '16375-arvados-multinode-testing'
Javier Bértoli [Tue, 12 Apr 2022 14:17:47 +0000 (11:17 -0300)]
Merge branch '16375-arvados-multinode-testing'

refs #16375
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago16375: add code to test arvados in multi-node
Javier Bértoli [Wed, 6 Apr 2022 22:55:47 +0000 (19:55 -0300)]
16375: add code to test arvados in multi-node

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoUpdate build process a bit
Peter Amstutz [Fri, 8 Apr 2022 14:17:34 +0000 (10:17 -0400)]
Update build process a bit

refs #18701

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoFix skips no issue #
Peter Amstutz [Wed, 6 Apr 2022 21:08:22 +0000 (17:08 -0400)]
Fix skips no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoSkip invalid cwl tests
Peter Amstutz [Wed, 6 Apr 2022 20:26:06 +0000 (16:26 -0400)]
Skip invalid cwl tests

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agocwl test Fetch tags
Peter Amstutz [Tue, 5 Apr 2022 20:16:15 +0000 (16:16 -0400)]
cwl test Fetch tags

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoRun the v1.2.0 tagged test suite instead of 'main'
Peter Amstutz [Tue, 5 Apr 2022 20:05:51 +0000 (16:05 -0400)]
Run the v1.2.0 tagged test suite instead of 'main'

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoAdjust position of "Publish stable arvados/jobs Docker image"
Peter Amstutz [Thu, 24 Mar 2022 15:30:38 +0000 (11:30 -0400)]
Adjust position of "Publish stable arvados/jobs Docker image"

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoAdd the zenodo.org step to the release tasks.
Ward Vandewege [Thu, 24 Mar 2022 21:17:15 +0000 (17:17 -0400)]
Add the zenodo.org step to the release tasks.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoReview reminder script: fix another edge case on the date the sprint
Ward Vandewege [Wed, 16 Mar 2022 14:25:36 +0000 (10:25 -0400)]
Review reminder script: fix another edge case on the date the sprint
turns over.

refs #18813

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoBump the packer version in the "build" image to 1.8.0.
Ward Vandewege [Tue, 15 Mar 2022 16:36:02 +0000 (12:36 -0400)]
Bump the packer version in the "build" image to 1.8.0.

refs #18772

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoReview reminder script: review task titles can start with a capitalized
Ward Vandewege [Fri, 11 Mar 2022 16:03:08 +0000 (11:03 -0500)]
Review reminder script: review task titles can start with a capitalized
word.

refs #18813

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoBump the version of lib/redmine to latest to get pagination bugfix. Add
Ward Vandewege [Thu, 10 Mar 2022 18:21:22 +0000 (13:21 -0500)]
Bump the version of lib/redmine to latest to get pagination bugfix. Add
a few more lines to the debug log.

refs #18813

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoA few bugfixes in the redmine library: fix the version filter for
Ward Vandewege [Thu, 10 Mar 2022 18:11:26 +0000 (13:11 -0500)]
A few bugfixes in the redmine library: fix the version filter for
issues, handle pagination in the FilteredIssues function.

refs #18813

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18813-review-reminders'
Ward Vandewege [Fri, 4 Mar 2022 20:17:04 +0000 (15:17 -0500)]
Merge branch '18813-review-reminders'

closes #18813

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18813: add script to send review reminders for the current sprint. 18813-review-reminders
Ward Vandewege [Fri, 4 Mar 2022 14:46:27 +0000 (09:46 -0500)]
18813: add script to send review reminders for the current sprint.
       Extend our redmine library as needed.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoNote about building compute image
Peter Amstutz [Thu, 9 Dec 2021 16:51:22 +0000 (11:51 -0500)]
Note about building compute image

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoUpdate TASKS to sync with checklist
Peter Amstutz [Thu, 9 Dec 2021 16:33:14 +0000 (11:33 -0500)]
Update TASKS to sync with checklist

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '18093-create-release-ticket'
Ward Vandewege [Fri, 19 Nov 2021 22:16:54 +0000 (17:16 -0500)]
Merge branch '18093-create-release-ticket'

closes #18093

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18093: Merge branch 'main' into 18093-create-release-ticket 18093-create-release-ticket
Ward Vandewege [Fri, 19 Nov 2021 22:15:08 +0000 (17:15 -0500)]
18093: Merge branch 'main' into 18093-create-release-ticket

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18093: implement review feedback
Ward Vandewege [Fri, 19 Nov 2021 19:29:39 +0000 (14:29 -0500)]
18093: implement review feedback

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoAptly does not strip spaces from architecture names, sigh.
Ward Vandewege [Thu, 18 Nov 2021 21:47:17 +0000 (16:47 -0500)]
Aptly does not strip spaces from architecture names, sigh.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18093: add functionality to create a new release checklist ticket in
Ward Vandewege [Thu, 18 Nov 2021 01:18:00 +0000 (20:18 -0500)]
18093: add functionality to create a new release checklist ticket in
       Redmine.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoUpdate go dependencies for the compute image cleaner.
Ward Vandewege [Tue, 16 Nov 2021 21:43:29 +0000 (16:43 -0500)]
Update go dependencies for the compute image cleaner.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '18300-release-ticket-association'
Ward Vandewege [Tue, 16 Nov 2021 20:36:11 +0000 (15:36 -0500)]
Merge branch '18300-release-ticket-association'

closes #18300

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18300: Merge branch 'main' into 18300-release-ticket-association 18300-release-ticket-association
Ward Vandewege [Tue, 16 Nov 2021 20:33:06 +0000 (15:33 -0500)]
18300: Merge branch 'main' into 18300-release-ticket-association

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18300: add the initial version of `art`, the Arvados Release Tool. It
Ward Vandewege [Fri, 12 Nov 2021 20:59:46 +0000 (15:59 -0500)]
18300: add the initial version of `art`, the Arvados Release Tool. It
       can associate redmine tickets with a redmine release, based on a
       git commit history range.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '18264-cwl-testing'
Ward Vandewege [Thu, 28 Oct 2021 17:39:27 +0000 (13:39 -0400)]
Merge branch '18264-cwl-testing'

refs #18264

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18264: simplify after review feedback. 18264-cwl-testing
Ward Vandewege [Thu, 28 Oct 2021 17:02:12 +0000 (13:02 -0400)]
18264: simplify after review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18264: switch to running the 1.2 version of the CWL conformance tests.
Ward Vandewege [Tue, 12 Oct 2021 19:52:41 +0000 (15:52 -0400)]
18264: switch to running the 1.2 version of the CWL conformance tests.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18264: clean up the way we run the CWL tests. Only run the upstream
Ward Vandewege [Tue, 12 Oct 2021 18:03:09 +0000 (14:03 -0400)]
18264: clean up the way we run the CWL tests. Only run the upstream
suite from a new run-cwl-test-suite.sh script (the arvados CWL tests are
run separately now, directly from CI). Remove old run-cwl-test.sh script.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>