arvados.git
9 months ago15317: Replace comment with better variable name.
Tom Clegg [Mon, 11 Mar 2024 19:08:53 +0000 (15:08 -0400)]
15317: Replace comment with better variable name.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

9 months ago15317: Fix missing blank line between funcs.
Tom Clegg [Mon, 11 Mar 2024 19:05:56 +0000 (15:05 -0400)]
15317: Fix missing blank line between funcs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago15317: Add transfer size bucketed latency/speed metrics.
Tom Clegg [Thu, 18 Jan 2024 15:51:41 +0000 (10:51 -0500)]
15317: Add transfer size bucketed latency/speed metrics.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months agoMerge branch '21353-loginas-flaky-bug' into main. Closes #21353.
Stephen Smith [Thu, 18 Jan 2024 15:04:11 +0000 (10:04 -0500)]
Merge branch '21353-loginas-flaky-bug' into main. Closes #21353.

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

11 months agoMerge branch '20318-disk-cache' 20318-disk-cache
Tom Clegg [Wed, 17 Jan 2024 22:51:34 +0000 (17:51 -0500)]
Merge branch '20318-disk-cache'

closes #20318

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20318: Fix arvados-login-sync and arvados-cli dependencies.
Tom Clegg [Wed, 17 Jan 2024 21:41:24 +0000 (16:41 -0500)]
20318: Fix arvados-login-sync and arvados-cli dependencies.

Previous requirement '~> 2.7.0.rc1' excluded the current prerelease
version '2.8.0.dev20231214204948' that the test suite deliberately
installs ahead of time, so bundler overrode that and selected the last
released published version 2.7.1 from rubygems, which is not
compatible with Ruby 3.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20318: Update stale comments to match current error handling.
Tom Clegg [Tue, 16 Jan 2024 22:32:01 +0000 (17:32 -0500)]
20318: Update stale comments to match current error handling.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months agoMerge branch '21379-user-activity-remote-collection'
Tom Clegg [Tue, 16 Jan 2024 19:05:50 +0000 (14:05 -0500)]
Merge branch '21379-user-activity-remote-collection'

fixes #21379

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago21353: Add waitForDom in process spec 21353-loginas-flaky-bug 21353-test3
Stephen Smith [Tue, 16 Jan 2024 01:35:38 +0000 (20:35 -0500)]
21353: Add waitForDom in process spec

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

11 months ago21353: Add waitForDom to loginAs to wait before getting elements
Stephen Smith [Tue, 16 Jan 2024 00:59:32 +0000 (19:59 -0500)]
21353: Add waitForDom to loginAs to wait before getting elements

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

11 months ago21353: Move url location check into waitUntil
Stephen Smith [Mon, 15 Jan 2024 21:44:12 +0000 (16:44 -0500)]
21353: Move url location check into waitUntil

It seems possible for window.location to be defined, then later undefined.
Moving the url location check should solve the problem by waiting for redirects
to be done.

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

11 months ago21353: Add cypress-wait-until to prevent cy.url before window.location is
Stephen Smith [Mon, 15 Jan 2024 21:02:16 +0000 (16:02 -0500)]
21353: Add cypress-wait-until to prevent cy.url before window.location is
defined in loginAs, fixes flaky test

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

11 months agoMerge branch '21285-installer-updates'. Closes #21285
Lucas Di Pentima [Fri, 12 Jan 2024 21:27:39 +0000 (18:27 -0300)]
Merge branch '21285-installer-updates'. Closes #21285

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

11 months ago21285: Fixes worker & nofile calculations on nginx config. 21285-installer-updates
Lucas Di Pentima [Fri, 12 Jan 2024 20:45:59 +0000 (17:45 -0300)]
21285: Fixes worker & nofile calculations on nginx config.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

11 months agoMerge branch '21315-row-select'
Lisa Knox [Fri, 12 Jan 2024 20:24:42 +0000 (15:24 -0500)]
Merge branch '21315-row-select'

closes #21315

Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

11 months ago21317: increased checkbox hitbox size Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa... 21315-row-select
Lisa Knox [Fri, 12 Jan 2024 20:21:23 +0000 (15:21 -0500)]
21317: increased checkbox hitbox size Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

11 months agoMerge branch '21316-left-panel-collapse'
Lisa Knox [Fri, 12 Jan 2024 19:50:49 +0000 (14:50 -0500)]
Merge branch '21316-left-panel-collapse'

closes #21316

Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

11 months ago21379: Follow rules for federated list queries. 21379-user-activity-remote-collection
Tom Clegg [Fri, 12 Jan 2024 19:43:43 +0000 (14:43 -0500)]
21379: Follow rules for federated list queries.

* cannot execute federated list query unless count=="none"

* cannot execute federated list query with limit (1) < nUUIDs (1),
  offset (0) > 0, or order ([created_at]) parameter

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20318: Avoid error when cache file is deleted while being written.
Tom Clegg [Fri, 12 Jan 2024 16:06:19 +0000 (11:06 -0500)]
20318: Avoid error when cache file is deleted while being written.

The previous code had one goroutine writing the cache file, and
another goroutine(s) waiting for it to finish, then opening the file
for reading. If the cache file was deleted before being opened for
reading, ReadAt would return an error.

The new code shares the writer's filehandle with all of the goroutines
that are waiting for it to finish writing. This ensures ReadAt can
always read from the newly written file even if it is deleted
mid-write.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20318: Bypass disk cache in keep-rsync.
Tom Clegg [Thu, 11 Jan 2024 20:51:20 +0000 (15:51 -0500)]
20318: Bypass disk cache in keep-rsync.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20318: Fix tests that expect Get to work on bare hashes.
Tom Clegg [Thu, 11 Jan 2024 20:12:57 +0000 (15:12 -0500)]
20318: Fix tests that expect Get to work on bare hashes.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20318: Fix ornery tests that hang/panic instead of failing.
Tom Clegg [Thu, 11 Jan 2024 20:08:56 +0000 (15:08 -0500)]
20318: Fix ornery tests that hang/panic instead of failing.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20318: Fix settled condition.
Tom Clegg [Thu, 11 Jan 2024 18:10:47 +0000 (13:10 -0500)]
20318: Fix settled condition.

Intention was to stop iterating when *all* of the keepstore servers
need 0 pulls, but the code as written stops on the N>1st iteration
when *any* of the keepstore servers need 0 pulls. This caused a false
negative when it took more than one iteration for keepstore to
complete the requested pulls.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20318: Clean up some gocheck usage: Equals, Nil -> IsNil
Tom Clegg [Thu, 11 Jan 2024 18:10:22 +0000 (13:10 -0500)]
20318: Clean up some gocheck usage: Equals, Nil -> IsNil

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20318: Route (*KeepClient)Get() through disk cache layer.
Tom Clegg [Thu, 11 Jan 2024 17:01:11 +0000 (12:01 -0500)]
20318: Route (*KeepClient)Get() through disk cache layer.

The updated implementation maintains the existing calling signature
but has some semantic differences:

The block size returned by Get is now -1 if the block size is not
indicated by the supplied locator. All locators generated by Arvados
include sizes, and Get() doesn't work on bare hashes because they have
no permission signature, so in practice this only comes up for test
cases and keepstore's pull worker.

The url returned by Get is now "" because
* in general it is not necessarily available in principle (data often
  comes from the cache instead of a backend server)
* in the cases where it is available in principle, it would be a lot
  of trouble to propagate it
* the only known reason to reveal the url is to provide detail about
  an error, in which case the error message should already include the
  relevant url.

In some cases where the upstream server responds 200 but an error is
detected early in the response content, Get() now returns the error
itself, where the old Get() implementation would have returned a
reader whose Read method returns an error.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20318: Fix DiskCacheSize not propagated by (*KeepClient)Clone().
Tom Clegg [Thu, 11 Jan 2024 16:49:42 +0000 (11:49 -0500)]
20318: Fix DiskCacheSize not propagated by (*KeepClient)Clone().

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20318: Bypass disk cache in certain tests, keepstore, and keepproxy.
Tom Clegg [Thu, 11 Jan 2024 16:48:28 +0000 (11:48 -0500)]
20318: Bypass disk cache in certain tests, keepstore, and keepproxy.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20318: Propagate Close error from http backend.
Tom Clegg [Thu, 11 Jan 2024 16:45:10 +0000 (11:45 -0500)]
20318: Propagate Close error from http backend.

This isn't known to happen, but if it does, it should propagate.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20318: Fix BadChecksum error not propagated through cache layer.
Tom Clegg [Thu, 11 Jan 2024 16:22:27 +0000 (11:22 -0500)]
20318: Fix BadChecksum error not propagated through cache layer.

Previously, ReadAt would not return an error as long as enough bytes
were read, because the error might mean the read was truncated after
the point needed for the current read. This had the unintended
consequence that even a BadChecksum error returned on the final read
would not be propagated.

The updated version propagates errors even if the requested bytes were
retrieved, so the only case where a bad checksum error can be
undetected is when the read does not reach the end of the block *and*
the block has not been fully retrieved yet.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20318: Remove redundant WriteTo case already handled by io.Copy.
Tom Clegg [Thu, 11 Jan 2024 16:21:58 +0000 (11:21 -0500)]
20318: Remove redundant WriteTo case already handled by io.Copy.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago21367: Use --dist-dir option of setup.py sdist
Brett Smith [Thu, 11 Jan 2024 14:41:51 +0000 (09:41 -0500)]
21367: Use --dist-dir option of setup.py sdist

Way cleaner and clearer. Refs #21367.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months agoMerge branch '21367-arvados-jobs-update'
Brett Smith [Wed, 10 Jan 2024 22:03:12 +0000 (17:03 -0500)]
Merge branch '21367-arvados-jobs-update'

Closes #21367.
Refs #21230.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago21367: Prefer COPY to ADD
Brett Smith [Wed, 10 Jan 2024 22:02:05 +0000 (17:02 -0500)]
21367: Prefer COPY to ADD

This avoids ADD's auto-extract behavior and helps keep the image a
little cleaner.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago21367: Explicitly install setuptools
Brett Smith [Wed, 10 Jan 2024 22:01:41 +0000 (17:01 -0500)]
21367: Explicitly install setuptools

Prepare for a PEP 517 world.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago21367/21230: Set up dev-jobs with virtualenv 21367-arvados-jobs-update
Brett Smith [Wed, 10 Jan 2024 18:43:20 +0000 (13:43 -0500)]
21367/21230: Set up dev-jobs with virtualenv

The functional goal here is to do all pip installs inside the Dockerfile
inside a virtualenv to avoid the global pip install issues.

Changes that fall out of that:

* Installing python3-venv is all we need to go back to the -slim Debian
  image.
* Stop installing other Python packages we'll just install inside the
  virtualenv anyway.
* Rather than having separate arguments and code blocks for every
  package we might want to install, just set up a dedicated build
  context for the Docker image with all the packages we want to install,
  and install them all unconditionally during the image build. This is
  much less code and hopefully easier to follow.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago21367: Remove environment check
Brett Smith [Wed, 10 Jan 2024 18:33:36 +0000 (13:33 -0500)]
21367: Remove environment check

You only need for this for `arv-keepdocker` at the end of the process,
which can read from settings.conf just fine too. Even if it fails, the
developer will have the command handy to fix their environment and try
that again easily.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago21367: Remove debug print
Brett Smith [Wed, 10 Jan 2024 18:33:13 +0000 (13:33 -0500)]
21367: Remove debug print

Doubly redundant since we're using `set -x` here anyway.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago21285: Updates overview dashboard to include concurrent reqs queue names.
Lucas Di Pentima [Tue, 9 Jan 2024 22:03:05 +0000 (19:03 -0300)]
21285: Updates overview dashboard to include concurrent reqs queue names.

At the moment we have 2 queues: "api" & "tunnel", I think this change will
allow the dashboard to adapt to potential new queues (instead of hardcoding
queue names in the query)

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

11 months ago20318: Fix bad compare / short read behavior in DiskCache BlockRead.
Tom Clegg [Tue, 9 Jan 2024 21:59:21 +0000 (16:59 -0500)]
20318: Fix bad compare / short read behavior in DiskCache BlockRead.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago21367: Use regular bullseye instead of bullseye-slim
Peter Amstutz [Tue, 9 Jan 2024 21:51:53 +0000 (16:51 -0500)]
21367: Use regular bullseye instead of bullseye-slim

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

11 months agoAdd arvbox check for fs.inotify.max_user_watches, refs #21349
Peter Amstutz [Tue, 9 Jan 2024 21:14:14 +0000 (16:14 -0500)]
Add arvbox check for fs.inotify.max_user_watches, refs #21349

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

11 months ago21367: Add arvados virtualenv to $PATH
Brett Smith [Tue, 9 Jan 2024 20:38:33 +0000 (15:38 -0500)]
21367: Add arvados virtualenv to $PATH

This is both more user-friendly (now a-c-r itself is in $PATH) and a
cleaner implementation than the previous version.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago21367: Modernize apt key handling in arvados/jobs Dockerfile
Brett Smith [Tue, 9 Jan 2024 20:34:29 +0000 (15:34 -0500)]
21367: Modernize apt key handling in arvados/jobs Dockerfile

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago21367: Remove debug prints
Brett Smith [Tue, 9 Jan 2024 20:26:06 +0000 (15:26 -0500)]
21367: Remove debug prints

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago21367: Update arvados/jobs image to bullseye
Brett Smith [Tue, 9 Jan 2024 20:24:24 +0000 (15:24 -0500)]
21367: Update arvados/jobs image to bullseye

Required for Python 3.7 deprecation.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago21285: Adds MaxGatewayTunnels' value to nginx's request queue size.
Lucas Di Pentima [Tue, 9 Jan 2024 17:35:53 +0000 (14:35 -0300)]
21285: Adds MaxGatewayTunnels' value to nginx's request queue size.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

11 months agoMerge branch '21258-flaky-adc-test'
Tom Clegg [Tue, 9 Jan 2024 16:05:29 +0000 (11:05 -0500)]
Merge branch '21258-flaky-adc-test'

fixes #21258

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months agoMerge branch '21036-keep-balance-metrics'
Tom Clegg [Tue, 9 Jan 2024 16:04:09 +0000 (11:04 -0500)]
Merge branch '21036-keep-balance-metrics'

fixes #21036

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago21285: Adds max gw tunnels config to multi host installer.
Lucas Di Pentima [Tue, 9 Jan 2024 15:28:56 +0000 (12:28 -0300)]
21285: Adds max gw tunnels config to multi host installer.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

11 months agoMerge branch '20846-package-build-fixes'
Brett Smith [Mon, 8 Jan 2024 21:48:00 +0000 (16:48 -0500)]
Merge branch '20846-package-build-fixes'

Closes #21273.
Refs #20846, #21230.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months agoMerge branch '21285-max-gw-tunnels'
Tom Clegg [Mon, 8 Jan 2024 21:39:38 +0000 (16:39 -0500)]
Merge branch '21285-max-gw-tunnels'

refs #21285

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago21315: fixed bug where a deselected item can still be shown in details panel Arvados...
Lisa Knox [Mon, 8 Jan 2024 19:59:11 +0000 (14:59 -0500)]
21315: fixed bug where a deselected item can still be shown in details panel Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

11 months ago21315: extended checkbox click area further Arvados-DCO-1.1-Signed-off-by: Lisa Knox...
Lisa Knox [Mon, 8 Jan 2024 19:26:36 +0000 (14:26 -0500)]
21315: extended checkbox click area further Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

11 months ago21315: extended checkbox click area Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa...
Lisa Knox [Mon, 8 Jan 2024 19:17:26 +0000 (14:17 -0500)]
21315: extended checkbox click area Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

11 months ago21315: rows now deselect properly, fixed some spelling errors Arvados-DCO-1.1-Signed...
Lisa Knox [Mon, 8 Jan 2024 16:41:57 +0000 (11:41 -0500)]
21315: rows now deselect properly, fixed some spelling errors Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

11 months ago20318: Add comments about KeepClient/KeepGateway wiring.
Tom Clegg [Mon, 8 Jan 2024 16:37:53 +0000 (11:37 -0500)]
20318: Add comments about KeepClient/KeepGateway wiring.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago21036: Test all balancerStats metrics. 21036-keep-balance-metrics
Tom Clegg [Mon, 8 Jan 2024 16:29:20 +0000 (11:29 -0500)]
21036: Test all balancerStats metrics.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20846: Use Python build variables more consistently 20846-package-build-fixes
Brett Smith [Sat, 6 Jan 2024 21:00:25 +0000 (16:00 -0500)]
20846: Use Python build variables more consistently

Rather than have the virtualenv process use its own python command,
ensure PYTHON3_EXECUTABLE points to a specific minor version, and use it
throughout the entire build process.

The changes to the virtualenv manipulation with sed are meant to clean
things up with fewer commands and tighter regexps, but not make any
functional change beyond referring to a specific minor Python version.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago20846: Remove unused Python packaging constants
Brett Smith [Sat, 6 Jan 2024 16:26:29 +0000 (11:26 -0500)]
20846: Remove unused Python packaging constants

I believe these are remnants from when we packaged our modules for
system use, outside a virtualenv.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago21273: Build rocky8 Python packages against python39 21273-rocky8-python39
Brett Smith [Fri, 5 Jan 2024 21:53:57 +0000 (16:53 -0500)]
21273: Build rocky8 Python packages against python39

We can no longer support the Python 3.6 that ships with rocky8. Building
against the latest appstream release is the most straightforward way to
continue building packages for the distro.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago21273: Remove support for unsupported distros
Brett Smith [Fri, 5 Jan 2024 21:52:47 +0000 (16:52 -0500)]
21273: Remove support for unsupported distros

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago20318: Fix nil pointer usage.
Tom Clegg [Fri, 5 Jan 2024 20:40:04 +0000 (15:40 -0500)]
20318: Fix nil pointer usage.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20318: Update stale comment.
Tom Clegg [Fri, 5 Jan 2024 20:33:38 +0000 (15:33 -0500)]
20318: Update stale comment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20318: Note no-op defers in comments.
Tom Clegg [Fri, 5 Jan 2024 20:33:26 +0000 (15:33 -0500)]
20318: Note no-op defers in comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago21316: adjusted margins so collapse button doesnt hide on small(er) screens Arvados... 21316-left-panel-collapse
Lisa Knox [Fri, 5 Jan 2024 20:21:12 +0000 (15:21 -0500)]
21316: adjusted margins so collapse button doesnt hide on small(er) screens Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

11 months agoMerge branch '21278-search-redirect' refs #21278
Peter Amstutz [Fri, 5 Jan 2024 20:00:31 +0000 (15:00 -0500)]
Merge branch '21278-search-redirect' refs #21278

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

11 months agoMerge branch '21290-sync-past-versions' refs #21290
Peter Amstutz [Fri, 5 Jan 2024 19:59:56 +0000 (14:59 -0500)]
Merge branch '21290-sync-past-versions' refs #21290

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

11 months ago21316: Merge commit '1416f698b72de4b09350d9c2fb25c1405c3247bc' into 21316-left-panel...
Lisa Knox [Fri, 5 Jan 2024 18:56:55 +0000 (13:56 -0500)]
21316: Merge commit '1416f698b72de4b09350d9c2fb25c1405c3247bc' into 21316-left-panel-collapse

Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

11 months agoMerge branch '21128-toolbar-context-menu'
Lisa Knox [Fri, 5 Jan 2024 18:38:13 +0000 (13:38 -0500)]
Merge branch '21128-toolbar-context-menu'

Merging branch copied from arvados-workbench2 repo

refs #21128

Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

11 months ago21285: Document that only HPC dispatchers use tunnel slots. 21285-max-gw-tunnels
Tom Clegg [Fri, 5 Jan 2024 16:02:01 +0000 (11:02 -0500)]
21285: Document that only HPC dispatchers use tunnel slots.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago21128: Merge commit 'adbbc9e3c7a36d39b30f403555ee5889e32adcc0' into 21128-toolbar...
Lisa Knox [Fri, 5 Jan 2024 15:47:49 +0000 (10:47 -0500)]
21128: Merge commit 'adbbc9e3c7a36d39b30f403555ee5889e32adcc0' into 21128-toolbar-context-menu

Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

11 months ago20846: Update dpkg .so search to handle merged-/usr systems
Brett Smith [Fri, 5 Jan 2024 15:22:19 +0000 (10:22 -0500)]
20846: Update dpkg .so search to handle merged-/usr systems

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months agoMerge branch '21200-breadcrumbs-issues'
Lisa Knox [Fri, 5 Jan 2024 15:04:19 +0000 (10:04 -0500)]
Merge branch '21200-breadcrumbs-issues'

closes #21200

Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

11 months ago21200: removed vestigial virtual machines refs Arvados-DCO-1.1-Signed-off-by: Lisa... 21200-breadcrumbs-issues
Lisa Knox [Fri, 5 Jan 2024 14:35:57 +0000 (09:35 -0500)]
21200: removed vestigial virtual machines refs Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

11 months ago21258: Ensure at least one boot failure. 21258-flaky-adc-test
Tom Clegg [Thu, 4 Jan 2024 22:51:33 +0000 (17:51 -0500)]
21258: Ensure at least one boot failure.

With the previous approach, it was possible for all containers needing
a type4 instance to finish, and a different instance type to report a
quota error and cause the scheduler to shut down the now-unneeded
instance, all before the "guaranteed broken" node reached
TimeoutBooting. In such a case it would not be counted as a boot
failure.

To avoid this, the new approach induces boot failures on *all* type4
instances until 2x TimeoutBooting intervals have passed.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20846: Python package build uses one specific Python version
Brett Smith [Thu, 4 Jan 2024 22:45:44 +0000 (17:45 -0500)]
20846: Python package build uses one specific Python version

This is meant to prevent all kinds of weird problems that can arise if
`python3` ever stops being the same version that we used to build the
package.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago21036: Report remaining balancerStats as prometheus metrics.
Tom Clegg [Thu, 4 Jan 2024 21:12:18 +0000 (16:12 -0500)]
21036: Report remaining balancerStats as prometheus metrics.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20846: Remove module versions print
Brett Smith [Thu, 4 Jan 2024 20:58:41 +0000 (15:58 -0500)]
20846: Remove module versions print

`pip install` writes this information at the end of the process. Writing
it again ourselves is redundant verbosity.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago21316: collapsed sidebar splitter no longer moves when opening details panel Arvados...
Lisa Knox [Thu, 4 Jan 2024 19:36:00 +0000 (14:36 -0500)]
21316: collapsed sidebar splitter no longer moves when opening details panel Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

11 months ago20846/21230: Remove Python transitional metapackages from the package build
Brett Smith [Thu, 4 Jan 2024 19:15:43 +0000 (14:15 -0500)]
20846/21230: Remove Python transitional metapackages from the package build

The build process for this is relatively expensive (we set up a
dedicated virtualenv for each one) and not PEP 668-compliant (it tries
to upgrade packages globally). We don't need these packages anymore for
the Arvados 3.0 release. Stop building all of them.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago20846/21230: Modernize virtualenv setup in package building
Brett Smith [Thu, 4 Jan 2024 19:00:46 +0000 (14:00 -0500)]
20846/21230: Modernize virtualenv setup in package building

This change sets up the virtualenv earlier, then does all work inside
it, starting with installing build dependencies, to comply with PEP 668.

A couple optimizations that were easy to do as part of this work:

* We install modules in as few pip commands as possible, to reduce
  the overhead of determining what's currently installed, what's
  available from PyPI, etc.

* Removed a special case for CentOS 7 that we no longer need.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago20846: Migrate from pkg_resources to importlib in sdk/cwl
Brett Smith [Thu, 4 Jan 2024 15:42:02 +0000 (10:42 -0500)]
20846: Migrate from pkg_resources to importlib in sdk/cwl

Now that we're deprecating Python 3.7, it's easy to rely on importlib
from the stdlib.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago20846: Ensure packages directories and indexes are world-readable
Brett Smith [Thu, 4 Jan 2024 14:55:52 +0000 (09:55 -0500)]
20846: Ensure packages directories and indexes are world-readable

See comments for rationale.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago21258: Fix log message.
Tom Clegg [Thu, 4 Jan 2024 15:19:22 +0000 (10:19 -0500)]
21258: Fix log message.

Reverts an unintentional logging change in
1875af9bcf4a1afe435176e952e63341a9ae9c03 from

msg="creating new instance" InstanceType="type8" ...

to

msg="creating new instance" InstanceType="{type8 providertype8 8 8589934592 0 0 0 0.984 false {  0}}" ...

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago21290: Use update_all to efficiently sync past version records 21290-sync-past-versions
Peter Amstutz [Wed, 3 Jan 2024 21:43:16 +0000 (16:43 -0500)]
21290: Use update_all to efficiently sync past version records

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

11 months agoFix misspelled configuration in doc AllowTrashWhileReadOnly -> AllowTrashWhenReadOnly
Peter Amstutz [Wed, 3 Jan 2024 20:43:11 +0000 (15:43 -0500)]
Fix misspelled configuration in doc AllowTrashWhileReadOnly -> AllowTrashWhenReadOnly

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

11 months ago21278: Remove the '/search.*' to '/search-results' redirect 21278-search-redirect
Peter Amstutz [Wed, 3 Jan 2024 19:40:28 +0000 (14:40 -0500)]
21278: Remove the '/search.*' to '/search-results' redirect

It produces an infinite loop and I don't think the /search endpoint is
really compatible with the /search-results endpoint anyway, and it's
less likely for people to have old hyperlinks to search results than
to projects or collections.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

11 months agoFix version displayed in workbench2.
Tom Clegg [Tue, 2 Jan 2024 18:49:12 +0000 (13:49 -0500)]
Fix version displayed in workbench2.

refs #18874

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months agoMerge branch '21059-signup-email' refs #21059
Peter Amstutz [Tue, 2 Jan 2024 15:02:51 +0000 (10:02 -0500)]
Merge branch '21059-signup-email' refs #21059

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

11 months ago21059: Fix "Arvado" typo. Use URI::join. 21059-signup-email
Peter Amstutz [Tue, 2 Jan 2024 14:56:14 +0000 (09:56 -0500)]
21059: Fix "Arvado" typo.  Use URI::join.

Also delete some commented-out debug code.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

11 months agoMerge branch '21206-ws-requesting-container-uuid'
Tom Clegg [Tue, 2 Jan 2024 14:34:21 +0000 (09:34 -0500)]
Merge branch '21206-ws-requesting-container-uuid'

closes #21206

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months agoMerge branch '21276-test-race'
Tom Clegg [Tue, 2 Jan 2024 14:32:56 +0000 (09:32 -0500)]
Merge branch '21276-test-race'

fixes #21276

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago21285: Propagate HTTP status code in tunnel setup error.
Tom Clegg [Mon, 1 Jan 2024 21:46:50 +0000 (16:46 -0500)]
21285: Propagate HTTP status code in tunnel setup error.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago21206: Add test for property fields returned in log events. 21206-ws-requesting-container-uuid
Tom Clegg [Fri, 29 Dec 2023 20:27:04 +0000 (15:27 -0500)]
21206: Add test for property fields returned in log events.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago21276: Fix unreliable test. 21276-test-race
Tom Clegg [Fri, 29 Dec 2023 19:40:35 +0000 (14:40 -0500)]
21276: Fix unreliable test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months ago20846/20690: Remove Workbench1 build in debian12/ubuntu2204
Brett Smith [Fri, 29 Dec 2023 17:09:01 +0000 (12:09 -0500)]
20846/20690: Remove Workbench1 build in debian12/ubuntu2204

This applies the change from c7cf228372bee18d84b14fc4089a758bc157fe76 to
the debian12 and ubuntu2204 package build Dockerfiles.

Refs #20690, #20846. These branches were in development in parallel, so
the changes from the former weren't applied to the latter.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago20846/21089: Update BRANCH support in debian12/ubuntu2204
Brett Smith [Fri, 29 Dec 2023 16:20:28 +0000 (11:20 -0500)]
20846/21089: Update BRANCH support in debian12/ubuntu2204

This applies the change from 73cc3ce5feb6d22c40742c499db9c799aa5ff874 to
the debian12 and ubuntu2204 package build Dockerfiles.

Refs #21089, #20846. These branches were in development in parallel, so
the changes from the former weren't applied to the latter.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago20846/18874: Update NodeJS/Yarn in debian12/ubuntu2204
Brett Smith [Fri, 29 Dec 2023 16:16:42 +0000 (11:16 -0500)]
20846/18874: Update NodeJS/Yarn in debian12/ubuntu2204

This applies the change from c4d4088d3e7f3e3f896ed0bb482560ab702d5465 to
the debian12 and ubuntu2204 package build Dockerfiles. It uses a
slightly different yarn install recipe to avoid the "double ln" and
associated layer, but the end result is the same.

Refs #18874, #20846. These branches were in development in parallel, so
the changes from the former weren't applied to the latter.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

11 months ago20318: Add install/upgrade notes about /var/cache.
Tom Clegg [Thu, 28 Dec 2023 20:40:14 +0000 (15:40 -0500)]
20318: Add install/upgrade notes about /var/cache.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months agoCopyedit scoped token creation example
Brett Smith [Thu, 28 Dec 2023 19:38:04 +0000 (14:38 -0500)]
Copyedit scoped token creation example

* Mark up user input
* Use zzzzz cluster id

No issue #.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>