Brett Smith [Sun, 20 Jul 2025 17:47:24 +0000 (13:47 -0400)]
23006: Hardcode runner image inside arvbox
It is already a known limitation that arvbox can't build its own
arvados/jobs image because it runs Singularity. This pins it to a
known-good version while we work on transitioning away from arvbox.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Mon, 21 Jul 2025 20:37:38 +0000 (16:37 -0400)]
21389: Unify Python Docker images
Fundamentally these images all build a Docker image with a Python
virtualenv. There are minor details in how they go about it, but none of
them have any real consequence for the final built image. We can use the
same code to build all these images and just parametrize it in the build
context.
* Port build-dev-docker-jobs-image.sh to Python (build_docker_image.py).
This makes it easier to share code between them; provides better
argument parsing; gives us a better base to build from; and makes
sense for build tooling that works so much with Python.
* Update the Dockerfile to use a two-stage build. It still builds a
virtualenv with wheels provided by the build script, but a two-stage
build keeps image sizes in line with what we had with the package-based
approach, which is appropriate for an image that gets distributed as
widely as arvados/jobs.
* Synchronize everything on bookworm-slim.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Mon, 21 Jul 2025 20:34:18 +0000 (16:34 -0400)]
21389: Remove Docker image build from test_with_arvbox
This code has been noop for a while: arvbox doesn't include Docker, it
uses Singularity, to avoid the usual Docker-in-Docker problems. Since
there's no way it can work, we should stop maintaining it.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Thu, 17 Jul 2025 18:29:05 +0000 (14:29 -0400)]
21389: Add requirements.txt files to build
This makes it easier for different build tools to install all their
dependencies and keep them all consistent.
With this change, I have chosen to flatten the distinction between "env"
and "deps" in run-tests.sh. It's already a little shaky, and it didn't
seem worth splitting out two files to keep it going.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Tue, 15 Jul 2025 18:40:48 +0000 (14:40 -0400)]
23044: Add external service container port routing to handler
This is an initial pass to address the bug in refs #23044.
This might not be the right solution, but it seems to at least get
things functioning, and it's self-contained so it's easy to replace
later as desired.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Tue, 15 Jul 2025 13:18:25 +0000 (09:18 -0400)]
23041: Refine Ansible's strategy for installing FUSE
`/etc/fuse.conf` could be provided by either `fuse` or `fuse3`. If it
already exists, don't install a package, to avoid messing with the
administrator's selections. If it doesn't, install `fuse3` to get the
most modern version. All of our supported distributions have this except
maybe Ubuntu 20.04, where we're not going to run the Ansible installer
anyway.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Mon, 14 Jul 2025 16:03:04 +0000 (12:03 -0400)]
23033: Remove fuse dependency from arvados-client
The arv-mount dependency notes it is there because arv-mount can
sometimes call FUSE command line tools. As best I can tell, this is not
true for arvados-client. Declaring the library dependency is more
accurate. Refs #23033.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Wed, 9 Jul 2025 18:33:23 +0000 (14:33 -0400)]
22866: Document single-node install with Ansible
This is tested and we expect this will be easier for most people to
deploy.
Part of what's changing here is the documentation page does not have a
bunch of forks for different options. Instead it prioritizes getting the
simplest possible install working with minimum fuss. I think this is
what most people installing with this option want. The provided
configuration templates give pointers for ways you might change the
configuration in more advanced ways.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Tue, 8 Jul 2025 18:23:01 +0000 (14:23 -0400)]
22866: Touch up example cluster config
* Use `xurid` ("your id") instead of the test cluster id `zzzzz`.
* Clarify that the cluster identifier must be lowercase.
* Correct the documentation for nginx internal networks.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Zoë Ma [Wed, 2 Jul 2025 21:04:40 +0000 (17:04 -0400)]
23013: Minor rewording for clarity.
Move the negation ("not") much closer to the substantive verb ("is
allowed") in a long sentence, to avoid giving a false impression of the
opposite meaning upon a partial read.
Arvados-DCO-1.1-Signed-off-by: Zoë Ma <zoe.ma@curii.com>
Zoë Ma [Wed, 2 Jul 2025 20:43:35 +0000 (16:43 -0400)]
23013: Update documentation about Google login setup.
- Clarify the difference between the "JavaScript origin" and "Redirect
URI" settings.
- Update terminology to match current UI of Google Developer Console.
- Minor cleanup (e.g. use full path to Arvados config file).
Arvados-DCO-1.1-Signed-off-by: Zoë Ma <zoe.ma@curii.com>
Brett Smith [Wed, 2 Jul 2025 02:06:13 +0000 (22:06 -0400)]
22830: Write default controller MaxRequestSize in Ansible
In general, we should do #22830. But right now this is the only thing
that Ansible reads from the API section, so we can get a big usability
win for single-node installs by just duplicating the default here for now.
Refs #22830.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Wed, 2 Jul 2025 01:52:22 +0000 (21:52 -0400)]
21362: Update RHEL documentation with new key path
This lets us use different keys for different versions. The old path
still works, and I've made sure the new path works for all currently
supported releases.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Mon, 30 Jun 2025 21:25:14 +0000 (17:25 -0400)]
23007: Fix expected test output for ruamel.yaml 0.18.13+
This release changed the wrapping of its output, which goes into a Keep
block, which goes into a manifest, which the CWL tests expect to match
an exact PDH. We might want to do something more sophisticated here but
this should get the Jenkins tests passing again for now.
Refs #23007.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Mon, 30 Jun 2025 18:54:36 +0000 (14:54 -0400)]
22965: Update default CI_REF
After reconfiguring a bunch of Jenkins jobs, it became clear that this
is a better default. We can consistently use the `ci-build` ref name to
point to the commit we want to build from that remote, for all remotes.
Refs #22965.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
projects / arvados.git / log