arvados-dev.git
6 months ago21521: Wrap aptly commands in flock 21521-aptly-flock
Brett Smith [Fri, 26 Apr 2024 20:47:50 +0000 (16:47 -0400)]
21521: Wrap aptly commands in flock

See comments for rationale.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

6 months ago21521: Make apt upload script less verbose
Brett Smith [Fri, 26 Apr 2024 20:41:55 +0000 (16:41 -0400)]
21521: Make apt upload script less verbose

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

7 months ago21662: Refine distro detection in jenkins-image-common
Brett Smith [Fri, 19 Apr 2024 20:06:05 +0000 (16:06 -0400)]
21662: Refine distro detection in jenkins-image-common

* Use ID_LIKE to identify distros rather than having whole lists.
* Only install buster-backports when we're actually on buster.

Refs #21662.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

7 months agoAdd a banner to the package promotion logging.
Peter Amstutz [Thu, 11 Apr 2024 13:46:24 +0000 (09:46 -0400)]
Add a banner to the package promotion logging.

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

7 months agoFix package publishing script to handle both deb and rpm in one command
Peter Amstutz [Thu, 11 Apr 2024 13:35:11 +0000 (09:35 -0400)]
Fix package publishing script to handle both deb and rpm in one command

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

7 months agoUse createrepo_c, no issue #
Peter Amstutz [Thu, 11 Apr 2024 13:16:35 +0000 (09:16 -0400)]
Use createrepo_c, no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

7 months agoAdd set-sprint subcommand to 'art', no issue #
Peter Amstutz [Fri, 5 Apr 2024 20:20:37 +0000 (16:20 -0400)]
Add set-sprint subcommand to 'art', no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

7 months agoUses createrepo_c instead of createrepo. Refs #21616
Lucas Di Pentima [Tue, 2 Apr 2024 12:23:15 +0000 (09:23 -0300)]
Uses createrepo_c instead of createrepo. Refs #21616

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

9 months agoFixes in git checkout call. Refs #21461
Lucas Di Pentima [Wed, 21 Feb 2024 22:53:17 +0000 (19:53 -0300)]
Fixes in git checkout call. Refs #21461

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

9 months agoFurther fixes on envvar passthrough on packer scripts. Refs #21461
Lucas Di Pentima [Wed, 21 Feb 2024 22:46:48 +0000 (19:46 -0300)]
Further fixes on envvar passthrough on packer scripts. Refs #21461

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

9 months agoPasses arvados git hash as a envvar to the packer script. Refs #21461
Lucas Di Pentima [Wed, 21 Feb 2024 22:13:09 +0000 (19:13 -0300)]
Passes arvados git hash as a envvar to the packer script. Refs #21461

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

9 months agoAllow requesting a specific arvados commit hash for image buildind. Refs #21461
Lucas Di Pentima [Wed, 21 Feb 2024 20:26:40 +0000 (17:26 -0300)]
Allow requesting a specific arvados commit hash for image buildind. Refs #21461

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

9 months agoFixes sysctl call on provisioning scripts. Refs #21461
Lucas Di Pentima [Wed, 21 Feb 2024 18:10:43 +0000 (15:10 -0300)]
Fixes sysctl call on provisioning scripts. Refs #21461

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

9 months agoApplies settings from sysctl conf file. Refs #21461
Lucas Di Pentima [Wed, 21 Feb 2024 17:53:15 +0000 (14:53 -0300)]
Applies settings from sysctl conf file. Refs #21461

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

9 months agoUses Debian Bullseye as a base for wb2 jenkins image. Refs #21461
Lucas Di Pentima [Wed, 21 Feb 2024 14:36:57 +0000 (11:36 -0300)]
Uses Debian Bullseye as a base for wb2 jenkins image. Refs #21461

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

9 months agoUpdates WB2 image building script for Jenkins. Refs #21461
Lucas Di Pentima [Wed, 21 Feb 2024 14:28:32 +0000 (11:28 -0300)]
Updates WB2 image building script for Jenkins. Refs #21461

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

10 months agoincrease fs.inotify.max_user_watches to run wb2 tests
Peter Amstutz [Tue, 16 Jan 2024 20:33:17 +0000 (15:33 -0500)]
increase fs.inotify.max_user_watches to run wb2 tests

refs #21393

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

10 months agoChanges the SSH key type that packer creates to communicate with nodes.
Lucas Di Pentima [Fri, 12 Jan 2024 18:17:58 +0000 (15:17 -0300)]
Changes the SSH key type that packer creates to communicate with nodes.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

This is a test to see if the packer-build-provision-testing-image pipeline
works with Debian 12 & Ubuntu 22.04, that seem to have deprecated RSA SSH
key types for authentication.

No issue #

10 months agoReverts previous change as it wasn't needed. No issue #
Lucas Di Pentima [Fri, 12 Jan 2024 15:51:00 +0000 (12:51 -0300)]
Reverts previous change as it wasn't needed. No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

10 months agoMoves packer installation to the common script. No issue #
Lucas Di Pentima [Thu, 11 Jan 2024 21:50:18 +0000 (18:50 -0300)]
Moves packer installation to the common script. No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

10 months agoSets Debian image to v11. Refs #21330
Lucas Di Pentima [Tue, 2 Jan 2024 22:16:19 +0000 (19:16 -0300)]
Sets Debian image to v11. Refs #21330

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

10 months ago20846: Add debian12 and ubuntu2204 upload targets
Brett Smith [Fri, 29 Dec 2023 14:59:38 +0000 (09:59 -0500)]
20846: Add debian12 and ubuntu2204 upload targets

I also checked testing_to_stable_publish_packages.sh and
upload_packages_testing_to_stable.sh but there doesn't seem to be
anything to update in those. They seem to default to working on
deb-based distributions just fine.

Refs #20846.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months agoAdd task to update public-facing clusters to stable release
Peter Amstutz [Fri, 8 Dec 2023 15:21:14 +0000 (10:21 -0500)]
Add task to update public-facing clusters to stable release

refs #21089

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

12 months agoInstalls 'createrepo-c' package instead of the deprecated 'createrepo'.
Lucas Di Pentima [Tue, 7 Nov 2023 19:49:25 +0000 (16:49 -0300)]
Installs 'createrepo-c' package instead of the deprecated 'createrepo'.
No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

12 months agoSets Debian image to v11. No issue #
Lucas Di Pentima [Tue, 7 Nov 2023 19:38:05 +0000 (16:38 -0300)]
Sets Debian image to v11. No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

14 months agoAdd rocky8 to publish package script
Peter Amstutz [Thu, 21 Sep 2023 16:57:02 +0000 (12:57 -0400)]
Add rocky8 to publish package script

refs #20769

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

15 months agoMerge branch '20797-rh8-packages'
Brett Smith [Tue, 1 Aug 2023 21:29:32 +0000 (17:29 -0400)]
Merge branch '20797-rh8-packages'

Refs #20797. Closes #20807.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

15 months ago20797: Add support for rocky8 upload target 20797-rh8-packages
Brett Smith [Tue, 1 Aug 2023 18:52:49 +0000 (14:52 -0400)]
20797: Add support for rocky8 upload target

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

17 months agoAccept "resolves #" (equivalent to "closes #"), update help message.
Tom Clegg [Thu, 1 Jun 2023 13:31:53 +0000 (09:31 -0400)]
Accept "resolves #" (equivalent to "closes #"), update help message.

no issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

21 months agoMerge branch '19920-move-unassigned-open-tickets'. Closes #19920
Lucas Di Pentima [Wed, 15 Feb 2023 15:52:40 +0000 (12:52 -0300)]
Merge branch '19920-move-unassigned-open-tickets'. Closes #19920

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

21 months agoAdds worker pool to speed up processing lots of issues. Refs #19920 19920-move-unassigned-open-tickets
Lucas Di Pentima [Wed, 25 Jan 2023 21:29:47 +0000 (18:29 -0300)]
Adds worker pool to speed up processing lots of issues. Refs #19920

The single-threaded version was processing issues at about 1 per second,
too slow to move lots of issues in one go.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

21 months agoIgnore .gitignore files for licensing. No issue #
Lucas Di Pentima [Wed, 25 Jan 2023 18:55:08 +0000 (15:55 -0300)]
Ignore .gitignore files for licensing. No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

21 months agoAdds 'associate-orphans' subcommand. Refs #19920
Lucas Di Pentima [Wed, 25 Jan 2023 18:38:35 +0000 (15:38 -0300)]
Adds 'associate-orphans' subcommand. Refs #19920

This subcommand takes a project name, a release ID and searches for
every open issue that's not assigned to a version and release,
associating it with the given release ID.
There's a dry-run parameter to allow the user to double check before
committing.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

21 months agoAdds release filtering on issues. Refs #19920
Lucas Di Pentima [Wed, 25 Jan 2023 14:44:03 +0000 (11:44 -0300)]
Adds release filtering on issues. Refs #19920

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

21 months agoAdds gitignore. Refs #19920
Lucas Di Pentima [Thu, 19 Jan 2023 14:32:18 +0000 (11:32 -0300)]
Adds gitignore. Refs #19920

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

23 months agoArvados release tool maintenance, refs #19647
Peter Amstutz [Tue, 13 Dec 2022 15:35:05 +0000 (10:35 -0500)]
Arvados release tool maintenance, refs #19647

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

23 months agoFixes installer var replacement. No issue #
Lucas Di Pentima [Tue, 6 Dec 2022 23:13:33 +0000 (00:13 +0100)]
Fixes installer var replacement. No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoFix go.mod confusion.
Tom Clegg [Thu, 10 Nov 2022 17:08:07 +0000 (12:08 -0500)]
Fix go.mod confusion.

refs #19572

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoUpdate release process a bit
Peter Amstutz [Fri, 5 Aug 2022 21:05:01 +0000 (17:05 -0400)]
Update release process a bit

refs #19330

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoTweak to the order of release tasks: the reference to the default
Ward Vandewege [Wed, 1 Jun 2022 17:34:51 +0000 (13:34 -0400)]
Tweak to the order of release tasks: the reference to the default
package that the installer uses should only be updated after that
package is published.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoSalt installer change: standardize on putting the certs directory under
Ward Vandewege [Wed, 1 Jun 2022 14:22:49 +0000 (10:22 -0400)]
Salt installer change: standardize on putting the certs directory under
the local_config_dir directory, this simplifies things.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '19092-upload-crunchstat_summary-to-pypi'
Ward Vandewege [Wed, 25 May 2022 15:41:53 +0000 (11:41 -0400)]
Merge branch '19092-upload-crunchstat_summary-to-pypi'

closes #19092

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago19092: upload crunchstat_summary to Pypi 19092-upload-crunchstat_summary-to-pypi
Ward Vandewege [Wed, 25 May 2022 14:33:15 +0000 (10:33 -0400)]
19092: upload crunchstat_summary to Pypi

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoTweak fuse.conf after the fuse package is installed, not before.
Ward Vandewege [Fri, 20 May 2022 19:55:54 +0000 (15:55 -0400)]
Tweak fuse.conf after the fuse package is installed, not before.

refs #15370

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoFor running our tests, FUSE must be configured with the
Ward Vandewege [Fri, 20 May 2022 19:40:43 +0000 (15:40 -0400)]
For running our tests, FUSE must be configured with the
'user_allow_other' option enabled for Crunch to set up Keep mounts that
are readable by containers.

refs #15370

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoBump the buster base image for our test image.
Ward Vandewege [Fri, 20 May 2022 19:32:49 +0000 (15:32 -0400)]
Bump the buster base image for our test image.

refs #15370

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoAdd docker to our tests image.
Ward Vandewege [Fri, 20 May 2022 16:38:58 +0000 (12:38 -0400)]
Add docker to our tests image.

refs #15370

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoAdd a convenient way to disable our git hooks via an environment
Ward Vandewege [Thu, 19 May 2022 17:41:29 +0000 (13:41 -0400)]
Add a convenient way to disable our git hooks via an environment
variable.

refs #18872

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoOur base test image installs the correct version of Go (detected in the
Ward Vandewege [Wed, 13 Apr 2022 16:53:25 +0000 (12:53 -0400)]
Our base test image installs the correct version of Go (detected in the
usual way from the Arvados source tree).

Check out the git tree using the git protocol, not http.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '16375-arvados-multinode-testing'
Javier Bértoli [Tue, 12 Apr 2022 14:17:47 +0000 (11:17 -0300)]
Merge branch '16375-arvados-multinode-testing'

refs #16375
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago16375: add code to test arvados in multi-node
Javier Bértoli [Wed, 6 Apr 2022 22:55:47 +0000 (19:55 -0300)]
16375: add code to test arvados in multi-node

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoUpdate build process a bit
Peter Amstutz [Fri, 8 Apr 2022 14:17:34 +0000 (10:17 -0400)]
Update build process a bit

refs #18701

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoFix skips no issue #
Peter Amstutz [Wed, 6 Apr 2022 21:08:22 +0000 (17:08 -0400)]
Fix skips no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoSkip invalid cwl tests
Peter Amstutz [Wed, 6 Apr 2022 20:26:06 +0000 (16:26 -0400)]
Skip invalid cwl tests

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agocwl test Fetch tags
Peter Amstutz [Tue, 5 Apr 2022 20:16:15 +0000 (16:16 -0400)]
cwl test Fetch tags

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoRun the v1.2.0 tagged test suite instead of 'main'
Peter Amstutz [Tue, 5 Apr 2022 20:05:51 +0000 (16:05 -0400)]
Run the v1.2.0 tagged test suite instead of 'main'

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoAdjust position of "Publish stable arvados/jobs Docker image"
Peter Amstutz [Thu, 24 Mar 2022 15:30:38 +0000 (11:30 -0400)]
Adjust position of "Publish stable arvados/jobs Docker image"

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoAdd the zenodo.org step to the release tasks.
Ward Vandewege [Thu, 24 Mar 2022 21:17:15 +0000 (17:17 -0400)]
Add the zenodo.org step to the release tasks.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoReview reminder script: fix another edge case on the date the sprint
Ward Vandewege [Wed, 16 Mar 2022 14:25:36 +0000 (10:25 -0400)]
Review reminder script: fix another edge case on the date the sprint
turns over.

refs #18813

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoBump the packer version in the "build" image to 1.8.0.
Ward Vandewege [Tue, 15 Mar 2022 16:36:02 +0000 (12:36 -0400)]
Bump the packer version in the "build" image to 1.8.0.

refs #18772

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoReview reminder script: review task titles can start with a capitalized
Ward Vandewege [Fri, 11 Mar 2022 16:03:08 +0000 (11:03 -0500)]
Review reminder script: review task titles can start with a capitalized
word.

refs #18813

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoBump the version of lib/redmine to latest to get pagination bugfix. Add
Ward Vandewege [Thu, 10 Mar 2022 18:21:22 +0000 (13:21 -0500)]
Bump the version of lib/redmine to latest to get pagination bugfix. Add
a few more lines to the debug log.

refs #18813

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoA few bugfixes in the redmine library: fix the version filter for
Ward Vandewege [Thu, 10 Mar 2022 18:11:26 +0000 (13:11 -0500)]
A few bugfixes in the redmine library: fix the version filter for
issues, handle pagination in the FilteredIssues function.

refs #18813

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18813-review-reminders'
Ward Vandewege [Fri, 4 Mar 2022 20:17:04 +0000 (15:17 -0500)]
Merge branch '18813-review-reminders'

closes #18813

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18813: add script to send review reminders for the current sprint. 18813-review-reminders
Ward Vandewege [Fri, 4 Mar 2022 14:46:27 +0000 (09:46 -0500)]
18813: add script to send review reminders for the current sprint.
       Extend our redmine library as needed.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoNote about building compute image
Peter Amstutz [Thu, 9 Dec 2021 16:51:22 +0000 (11:51 -0500)]
Note about building compute image

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoUpdate TASKS to sync with checklist
Peter Amstutz [Thu, 9 Dec 2021 16:33:14 +0000 (11:33 -0500)]
Update TASKS to sync with checklist

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '18093-create-release-ticket'
Ward Vandewege [Fri, 19 Nov 2021 22:16:54 +0000 (17:16 -0500)]
Merge branch '18093-create-release-ticket'

closes #18093

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18093: Merge branch 'main' into 18093-create-release-ticket 18093-create-release-ticket
Ward Vandewege [Fri, 19 Nov 2021 22:15:08 +0000 (17:15 -0500)]
18093: Merge branch 'main' into 18093-create-release-ticket

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18093: implement review feedback
Ward Vandewege [Fri, 19 Nov 2021 19:29:39 +0000 (14:29 -0500)]
18093: implement review feedback

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoAptly does not strip spaces from architecture names, sigh.
Ward Vandewege [Thu, 18 Nov 2021 21:47:17 +0000 (16:47 -0500)]
Aptly does not strip spaces from architecture names, sigh.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18093: add functionality to create a new release checklist ticket in
Ward Vandewege [Thu, 18 Nov 2021 01:18:00 +0000 (20:18 -0500)]
18093: add functionality to create a new release checklist ticket in
       Redmine.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoUpdate go dependencies for the compute image cleaner.
Ward Vandewege [Tue, 16 Nov 2021 21:43:29 +0000 (16:43 -0500)]
Update go dependencies for the compute image cleaner.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '18300-release-ticket-association'
Ward Vandewege [Tue, 16 Nov 2021 20:36:11 +0000 (15:36 -0500)]
Merge branch '18300-release-ticket-association'

closes #18300

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18300: Merge branch 'main' into 18300-release-ticket-association 18300-release-ticket-association
Ward Vandewege [Tue, 16 Nov 2021 20:33:06 +0000 (15:33 -0500)]
18300: Merge branch 'main' into 18300-release-ticket-association

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18300: add the initial version of `art`, the Arvados Release Tool. It
Ward Vandewege [Fri, 12 Nov 2021 20:59:46 +0000 (15:59 -0500)]
18300: add the initial version of `art`, the Arvados Release Tool. It
       can associate redmine tickets with a redmine release, based on a
       git commit history range.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '18264-cwl-testing'
Ward Vandewege [Thu, 28 Oct 2021 17:39:27 +0000 (13:39 -0400)]
Merge branch '18264-cwl-testing'

refs #18264

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18264: simplify after review feedback. 18264-cwl-testing
Ward Vandewege [Thu, 28 Oct 2021 17:02:12 +0000 (13:02 -0400)]
18264: simplify after review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18264: switch to running the 1.2 version of the CWL conformance tests.
Ward Vandewege [Tue, 12 Oct 2021 19:52:41 +0000 (15:52 -0400)]
18264: switch to running the 1.2 version of the CWL conformance tests.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago18264: clean up the way we run the CWL tests. Only run the upstream
Ward Vandewege [Tue, 12 Oct 2021 18:03:09 +0000 (14:03 -0400)]
18264: clean up the way we run the CWL tests. Only run the upstream
suite from a new run-cwl-test-suite.sh script (the arvados CWL tests are
run separately now, directly from CI). Remove old run-cwl-test.sh script.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFix output when a token is suppressed.
Ward Vandewege [Wed, 6 Oct 2021 23:17:02 +0000 (19:17 -0400)]
Fix output when a token is suppressed.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoBump the debian-10 base image for all our packer images.
Ward Vandewege [Mon, 4 Oct 2021 16:41:07 +0000 (12:41 -0400)]
Bump the debian-10 base image for all our packer images.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoSkip docker_entrypoint test refs #18223
Peter Amstutz [Wed, 29 Sep 2021 18:51:15 +0000 (14:51 -0400)]
Skip docker_entrypoint test refs #18223

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoBump the Debian base image for our main Jenkins image, and increase the
Ward Vandewege [Mon, 27 Sep 2021 17:08:13 +0000 (13:08 -0400)]
Bump the Debian base image for our main Jenkins image, and increase the
disk space to 20 GB (I ran out of space generating a new image).

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoBump the debian-10 base image for all our packer images.
Ward Vandewege [Tue, 17 Aug 2021 20:25:30 +0000 (16:25 -0400)]
Bump the debian-10 base image for all our packer images.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMake sure the workbench2 test image has a much higher filesystem
Ward Vandewege [Tue, 10 Aug 2021 20:32:04 +0000 (16:32 -0400)]
Make sure the workbench2 test image has a much higher filesystem
watchers limit than the default 8192, since React eats those things for
breakfast.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoUse apt-get instead of apt so debian/ubuntu don't complain
Javier Bértoli [Thu, 5 Aug 2021 18:08:51 +0000 (15:08 -0300)]
Use apt-get instead of apt so debian/ubuntu don't complain

refs #17535
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoOnly add Debian's backport in Debian images
Javier Bértoli [Thu, 5 Aug 2021 17:38:11 +0000 (14:38 -0300)]
Only add Debian's backport in Debian images

refs #17535
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoDebian/Ubuntu: os-release has an extra string to remove
Javier Bértoli [Thu, 5 Aug 2021 17:07:12 +0000 (14:07 -0300)]
Debian/Ubuntu: os-release has an extra string to remove

refs #17535
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoMerge branch '17535-test-provision-jenkins'
Javier Bértoli [Thu, 5 Aug 2021 16:08:36 +0000 (13:08 -0300)]
Merge branch '17535-test-provision-jenkins'

refs #17535
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoUpdate run_upload_packages.py: add debian 11 (bullseye), remove some no
Ward Vandewege [Thu, 29 Jul 2021 20:49:02 +0000 (16:49 -0400)]
Update run_upload_packages.py: add debian 11 (bullseye), remove some no
longer supported distributions.

refs #17949

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoAdd script to create new release repositories.
Ward Vandewege [Thu, 29 Jul 2021 19:13:38 +0000 (15:13 -0400)]
Add script to create new release repositories.

refs #17949

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17535: missing command
Javier Bértoli [Thu, 22 Jul 2021 20:06:01 +0000 (17:06 -0300)]
17535: missing command

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17535: typo
Javier Bértoli [Thu, 22 Jul 2021 19:56:13 +0000 (16:56 -0300)]
17535: typo

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17535: Use the backport line only in the Debian family
Javier Bértoli [Thu, 22 Jul 2021 19:46:56 +0000 (16:46 -0300)]
17535: Use the backport line only in the Debian family

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17535: typo
Javier Bértoli [Thu, 22 Jul 2021 19:36:26 +0000 (16:36 -0300)]
17535: typo

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17535: Allow to specify distro as part of the image name
Javier Bértoli [Thu, 22 Jul 2021 19:16:57 +0000 (16:16 -0300)]
17535: Allow to specify distro as part of the image name

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17535: Add a basic instance template for provision testing
Javier Bértoli [Thu, 22 Jul 2021 16:52:41 +0000 (13:52 -0300)]
17535: Add a basic instance template for provision testing

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17535: Re-add netcat to the images
Javier Bértoli [Thu, 22 Jul 2021 16:11:35 +0000 (13:11 -0300)]
17535: Re-add netcat to the images

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago17535: Add missing Debian's pre-install command
Javier Bértoli [Thu, 22 Jul 2021 15:43:31 +0000 (12:43 -0300)]
17535: Add missing Debian's pre-install command

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>