arvados.git
8 months ago19744: Report steps with low utilization at end of workflow
Peter Amstutz [Wed, 28 Feb 2024 19:53:29 +0000 (14:53 -0500)]
19744: Report steps with low utilization at end of workflow

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

8 months ago19744: Remove specific recommendations
Peter Amstutz [Wed, 28 Feb 2024 19:27:52 +0000 (14:27 -0500)]
19744: Remove specific recommendations

Still want to note inefficient CPU/RAM usage.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

8 months ago19744: Add --enable/disable-usage-report
Peter Amstutz [Tue, 27 Feb 2024 21:28:59 +0000 (16:28 -0500)]
19744: Add --enable/disable-usage-report

Now warns about under-utilized nodes.

Also code cleanup from review.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

8 months ago19744: Adjust chart format so legend doesn't cover data
Peter Amstutz [Fri, 23 Feb 2024 21:29:32 +0000 (16:29 -0500)]
19744: Adjust chart format so legend doesn't cover data

Adjust summarizer check for CPU < 50% instead of "nearest vCPU"

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

8 months ago19744: Adjust some of the recommendations
Peter Amstutz [Fri, 23 Feb 2024 19:22:25 +0000 (14:22 -0500)]
19744: Adjust some of the recommendations

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

8 months ago19744: Need to have runtime_constraints on hand
Peter Amstutz [Fri, 23 Feb 2024 18:45:07 +0000 (13:45 -0500)]
19744: Need to have runtime_constraints on hand

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

8 months ago19744: Fix single container report generation.
Peter Amstutz [Fri, 23 Feb 2024 18:24:00 +0000 (13:24 -0500)]
19744: Fix single container report generation.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

8 months ago19744: Remove jobs/pipeline templates from crunchstat-summary
Peter Amstutz [Fri, 23 Feb 2024 15:05:01 +0000 (10:05 -0500)]
19744: Remove jobs/pipeline templates from crunchstat-summary

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

8 months ago19744: Extend test_done() to check for a usage report
Peter Amstutz [Thu, 22 Feb 2024 21:00:25 +0000 (16:00 -0500)]
19744: Extend test_done() to check for a usage report

This isn't comprehensive but it at least checks the happy path detect
obvious problems in the interface between a-c-r and
crunchstat-summary.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

8 months ago19744: Fix existing tests
Peter Amstutz [Thu, 22 Feb 2024 19:59:12 +0000 (14:59 -0500)]
19744: Fix existing tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

8 months ago19744: Don't warn about missing data when the runtime is short
Peter Amstutz [Thu, 22 Feb 2024 18:19:47 +0000 (13:19 -0500)]
19744: Don't warn about missing data when the runtime is short

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

8 months ago19744: Don't warn about missing metrics when the elapsed time is short
Peter Amstutz [Thu, 22 Feb 2024 16:30:53 +0000 (11:30 -0500)]
19744: Don't warn about missing metrics when the elapsed time is short

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

8 months ago19744: Don't post crunchstat summary warnings to runtime status
Peter Amstutz [Thu, 22 Feb 2024 16:23:01 +0000 (11:23 -0500)]
19744: Don't post crunchstat summary warnings to runtime status

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

8 months ago19744: Fix up threading
Peter Amstutz [Thu, 22 Feb 2024 16:02:38 +0000 (11:02 -0500)]
19744: Fix up threading

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

8 months ago19744: Incorporate runtime constraints and node info into report
Peter Amstutz [Thu, 22 Feb 2024 00:05:36 +0000 (19:05 -0500)]
19744: Incorporate runtime constraints and node info into report

This makes it much easier to judge CPU and RAM utilization.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

8 months ago19744: Add exception handler and pass api client to summarizer
Peter Amstutz [Wed, 21 Feb 2024 21:40:41 +0000 (16:40 -0500)]
19744: Add exception handler and pass api client to summarizer

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

8 months ago19744: Change usage report button back to link
Peter Amstutz [Mon, 19 Feb 2024 15:23:38 +0000 (10:23 -0500)]
19744: Change usage report button back to link

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months ago19744: Add icon
Peter Amstutz [Wed, 14 Feb 2024 02:55:25 +0000 (21:55 -0500)]
19744: Add icon

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months ago19744: Made the resource usage report button obvious
Peter Amstutz [Wed, 14 Feb 2024 02:34:17 +0000 (21:34 -0500)]
19744: Made the resource usage report button obvious

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months ago19744: Calling it the usage report
Peter Amstutz [Wed, 14 Feb 2024 00:54:56 +0000 (19:54 -0500)]
19744: Calling it the usage report

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months ago19744: Apply styling to roughly match workbench
Peter Amstutz [Tue, 13 Feb 2024 23:58:43 +0000 (18:58 -0500)]
19744: Apply styling to roughly match workbench

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months ago19744: Better incorporation of the text report data into HTML
Peter Amstutz [Tue, 13 Feb 2024 22:28:38 +0000 (17:28 -0500)]
19744: Better incorporation of the text report data into HTML

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months ago19744: Include text report in HTML report
Peter Amstutz [Fri, 9 Feb 2024 23:23:36 +0000 (18:23 -0500)]
19744: Include text report in HTML report

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months ago19744: Run summarizer at end of container
Peter Amstutz [Fri, 9 Feb 2024 22:56:28 +0000 (17:56 -0500)]
19744: Run summarizer at end of container

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months agoMerge branch 'github-pr-224'
Brett Smith [Fri, 9 Feb 2024 19:51:46 +0000 (14:51 -0500)]
Merge branch 'github-pr-224'

<https://github.com/arvados/arvados/pull/224>
Closes #21457.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months agoReplace files
szlenkj [Mon, 5 Feb 2024 12:49:30 +0000 (13:49 +0100)]
Replace files
Arvados-DCO-1.1-Signed-off-by: Jakub Szlenk jakubszlenk@gmail.com

9 months ago21230: Clean up venv diagnostic output
Brett Smith [Thu, 8 Feb 2024 17:05:44 +0000 (12:05 -0500)]
21230: Clean up venv diagnostic output

This output stopped making sense in the transition from using virtualenv
to the venv module. The module doesn't really have a version separate
from Python, so just report a boolean result. Refs #21230.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months agoMerge branch '21384-version-pins'
Brett Smith [Wed, 7 Feb 2024 21:44:23 +0000 (16:44 -0500)]
Merge branch '21384-version-pins'

Closes #21384, #21406, #21454.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21406: Declare python_requires~=3.8 in all packages
Brett Smith [Wed, 7 Feb 2024 16:09:00 +0000 (11:09 -0500)]
21406: Declare python_requires~=3.8 in all packages

This is what we officially support as of Arvados 3.0, and saying so
helps prevent trouble if users try to install our packages on a too-old
Python.

Remove other requirements that are redundant after this change.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21406: Remove Python 2 support cruft from FUSE setup.py
Brett Smith [Wed, 7 Feb 2024 16:07:38 +0000 (11:07 -0500)]
21406: Remove Python 2 support cruft from FUSE setup.py

This has been irrelevant for a while.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21454: Update required_ruby_version in all gems
Brett Smith [Wed, 7 Feb 2024 15:57:07 +0000 (10:57 -0500)]
21454: Update required_ruby_version in all gems

They might technically work on older versions, but this is all we're
testing with and supporting as of Arvados 3.0, so say that.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21384: Update arvados-google-api-client in RailsAPI
Brett Smith [Wed, 7 Feb 2024 15:54:10 +0000 (10:54 -0500)]
21384: Update arvados-google-api-client in RailsAPI

There's no functional need for this. The main motivation is to make sure
this release and the associated stack gets thoroughly tested, to give us
more confidence it works for clients too.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months agoMerge branch '21359-rightclick-newproject-bug'
Lisa Knox [Tue, 6 Feb 2024 19:16:34 +0000 (14:16 -0500)]
Merge branch '21359-rightclick-newproject-bug'

closes #21359

Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

9 months agoMerge branch '21384-ruby27-gemspec'
Brett Smith [Tue, 6 Feb 2024 16:05:28 +0000 (11:05 -0500)]
Merge branch '21384-ruby27-gemspec'

Refs #21384.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21359: added test Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com> 21359-rightclick-newproject-bug
Lisa Knox [Mon, 5 Feb 2024 20:18:42 +0000 (15:18 -0500)]
21359: added test Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

9 months agoMerge branch '21440-process-panel-reorg' refs #21440
Peter Amstutz [Mon, 5 Feb 2024 17:03:28 +0000 (12:03 -0500)]
Merge branch '21440-process-panel-reorg' refs #21440

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months ago21384: Narrow faraday dependency for arvados-google-api-client gem 21384-ruby27-gemspec
Brett Smith [Mon, 5 Feb 2024 14:31:44 +0000 (09:31 -0500)]
21384: Narrow faraday dependency for arvados-google-api-client gem

See comments for rationale.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months agoMerge branch 'main' into 21359-rightclick-newproject-bug
Lisa Knox [Mon, 5 Feb 2024 14:05:51 +0000 (09:05 -0500)]
Merge branch 'main' into 21359-rightclick-newproject-bug

refs #21359

Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

9 months agoMerge branch '21361-excise-old-distros'
Brett Smith [Fri, 2 Feb 2024 22:21:22 +0000 (17:21 -0500)]
Merge branch '21361-excise-old-distros'

Closes #21361.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21361: Upgrade workbenh2 Dockerfile to Debian 11
Brett Smith [Fri, 2 Feb 2024 22:20:33 +0000 (17:20 -0500)]
21361: Upgrade workbenh2 Dockerfile to Debian 11

Thanks to Lucas' patch from
<https://dev.arvados.org/issues/21361#note-6>.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months agoMerge branch '21370-process-search' refs #21370
Peter Amstutz [Fri, 2 Feb 2024 21:45:50 +0000 (16:45 -0500)]
Merge branch '21370-process-search' refs #21370

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months agoMerge branch '21304-user-update' refs #21304
Peter Amstutz [Fri, 2 Feb 2024 21:44:13 +0000 (16:44 -0500)]
Merge branch '21304-user-update' refs #21304

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months ago21304: Add a test
Peter Amstutz [Fri, 2 Feb 2024 21:41:44 +0000 (16:41 -0500)]
21304: Add a test

Confirmed this fails on main and passes on this branch

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months agoMerge branch '21216-multiplier-typo-fix' refs #21216
Peter Amstutz [Fri, 2 Feb 2024 21:00:02 +0000 (16:00 -0500)]
Merge branch '21216-multiplier-typo-fix' refs #21216

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months agoMerge branch 'main' into 21440-process-panel-reorg 21440-process-panel-reorg
Peter Amstutz [Fri, 2 Feb 2024 20:51:32 +0000 (15:51 -0500)]
Merge branch 'main' into 21440-process-panel-reorg

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months ago20318: Fix flaky test.
Tom Clegg [Fri, 2 Feb 2024 20:47:34 +0000 (15:47 -0500)]
20318: Fix flaky test.

Hash in "put" test should not have changed to a hash+size locator in
commit ff3db3f54ab58f9f2d4578765438af41b2d2d550.

refs #20318

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

9 months agoMerge branch 'main' into 21370-process-search 21370-process-search
Peter Amstutz [Fri, 2 Feb 2024 20:45:15 +0000 (15:45 -0500)]
Merge branch 'main' into 21370-process-search

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months agoMerge branch 'main' into 21440-process-panel-reorg
Peter Amstutz [Fri, 2 Feb 2024 19:09:39 +0000 (14:09 -0500)]
Merge branch 'main' into 21440-process-panel-reorg

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months agoMerge branch '21427-collection-test-fix'
Lisa Knox [Fri, 2 Feb 2024 18:39:52 +0000 (13:39 -0500)]
Merge branch '21427-collection-test-fix'

closes #21427

Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

9 months ago21370: Put option for process search back, just don't enable it by default.
Peter Amstutz [Fri, 2 Feb 2024 16:51:52 +0000 (11:51 -0500)]
21370: Put option for process search back, just don't enable it by default.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months ago21359: corrected owneruuid passed to creatproject function Arvados-DCO-1.1-Signed...
Lisa Knox [Fri, 2 Feb 2024 16:38:33 +0000 (11:38 -0500)]
21359: corrected owneruuid passed to creatproject function Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

9 months ago21304: Handle user record updates with empty string username 21304-user-update
Peter Amstutz [Fri, 2 Feb 2024 16:17:03 +0000 (11:17 -0500)]
21304: Handle user record updates with empty string username

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months agoMerge branch '21417-keepdocker-oci-layout'
Brett Smith [Fri, 2 Feb 2024 15:30:10 +0000 (10:30 -0500)]
Merge branch '21417-keepdocker-oci-layout'

Closes #21417.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21427: modified visibility map check Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa... 21427-collection-test-fix
Lisa Knox [Fri, 2 Feb 2024 15:15:50 +0000 (10:15 -0500)]
21427: modified visibility map check Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

9 months agoMerge branch '21429-remember-docker-state'
Brett Smith [Fri, 2 Feb 2024 07:38:14 +0000 (02:38 -0500)]
Merge branch '21429-remember-docker-state'

Closes #21429.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21417: Update arv-keepdocker for OCI-layout archives 21417-keepdocker-oci-layout
Brett Smith [Fri, 2 Feb 2024 07:26:26 +0000 (02:26 -0500)]
21417: Update arv-keepdocker for OCI-layout archives

Docker started saving image archives with this layout in version 25. Use
a more correct implementation that reads manifest.json as the archive
entry point and supports both layouts without branching.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21417: Clean arv-keepdocker imports
Brett Smith [Fri, 2 Feb 2024 06:23:43 +0000 (01:23 -0500)]
21417: Clean arv-keepdocker imports

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21304: Check for nil from set_initial_username
Peter Amstutz [Thu, 1 Feb 2024 21:43:06 +0000 (16:43 -0500)]
21304: Check for nil from set_initial_username

If set_initial_username comes back as nil (this happens when calling
update_remote_user on a remote system user), don't set username in
'needupdate', in order to avoid a spurious user record update.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months ago21440: Densify the rows on the input/output parameters table
Peter Amstutz [Thu, 1 Feb 2024 19:55:47 +0000 (14:55 -0500)]
21440: Densify the rows on the input/output parameters table

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months ago21427: applied rowselect to all processes panel Arvados-DCO-1.1-Signed-off-by: Lisa...
Lisa Knox [Thu, 1 Feb 2024 17:07:04 +0000 (12:07 -0500)]
21427: applied rowselect to all processes panel Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

9 months ago21427: set last menu item to change only after transition Arvados-DCO-1.1-Signed...
Lisa Knox [Thu, 1 Feb 2024 16:56:35 +0000 (11:56 -0500)]
21427: set last menu item to change only after transition Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

9 months ago21427: fixed toolbar transition between lengths Arvados-DCO-1.1-Signed-off-by: Lisa...
Lisa Knox [Thu, 1 Feb 2024 15:51:01 +0000 (10:51 -0500)]
21427: fixed toolbar transition between lengths Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

9 months ago21361: Update various random Docker tests to Debian 11 21361-excise-old-distros
Brett Smith [Mon, 29 Jan 2024 17:02:48 +0000 (12:02 -0500)]
21361: Update various random Docker tests to Debian 11

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21361: Remove Debian 10 support from installer
Brett Smith [Mon, 29 Jan 2024 16:58:08 +0000 (11:58 -0500)]
21361: Remove Debian 10 support from installer

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21361: Modernize test script
Brett Smith [Mon, 29 Jan 2024 16:57:22 +0000 (11:57 -0500)]
21361: Modernize test script

* Update for Debian 11.
* Assume #16053 has been merged, as it has been for a while.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21361: Add license headers
Brett Smith [Mon, 29 Jan 2024 17:02:21 +0000 (12:02 -0500)]
21361: Add license headers

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21361: Remove Ubuntu 18.04 exception from Salt installer
Brett Smith [Mon, 29 Jan 2024 15:31:27 +0000 (10:31 -0500)]
21361: Remove Ubuntu 18.04 exception from Salt installer

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21361: Remove CentOS 7 exceptions from Salt installer
Brett Smith [Mon, 29 Jan 2024 15:28:49 +0000 (10:28 -0500)]
21361: Remove CentOS 7 exceptions from Salt installer

This does leave behind some exceptions that look like they're for CentOS
7 but I believe are meant to be exceptions for Red Hat-family distros
generally. That refinement can happen as part of #21425.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21361: Fix comment typo
Brett Smith [Mon, 29 Jan 2024 15:27:15 +0000 (10:27 -0500)]
21361: Fix comment typo

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21361: Change variable names to match Go style
Brett Smith [Mon, 29 Jan 2024 14:52:59 +0000 (09:52 -0500)]
21361: Change variable names to match Go style

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21361: Detect more Red Hat-family distros in installer
Brett Smith [Mon, 29 Jan 2024 04:33:49 +0000 (23:33 -0500)]
21361: Detect more Red Hat-family distros in installer

To support Rocky, Alma, etc.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21361: Update support distros in compute image build script
Brett Smith [Mon, 29 Jan 2024 04:18:23 +0000 (23:18 -0500)]
21361: Update support distros in compute image build script

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21361: Remove SCL support from arvados-docker-cleaner ExecStart
Brett Smith [Mon, 29 Jan 2024 04:05:20 +0000 (23:05 -0500)]
21361: Remove SCL support from arvados-docker-cleaner ExecStart

This is no longer needed that we no longer support CentOS 7.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21361: Remove StartLimitInterval from service units
Brett Smith [Mon, 29 Jan 2024 03:57:33 +0000 (22:57 -0500)]
21361: Remove StartLimitInterval from service units

CentOS 7 was the last distribution we supported with systemd this old,
and that ends with Arvados 3.0.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21361: Update workbench2 package TARGETS
Brett Smith [Mon, 29 Jan 2024 03:49:27 +0000 (22:49 -0500)]
21361: Update workbench2 package TARGETS

We no longer support centos7, debian10, or ubuntu1804.
We now support debian12 and ubuntu2204.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21361: Remove ubuntu1804 dependencies from services/api package
Brett Smith [Mon, 29 Jan 2024 03:46:52 +0000 (22:46 -0500)]
21361: Remove ubuntu1804 dependencies from services/api package

We no longer support this distribution.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21361: Expand distro detection in Salt installer
Brett Smith [Mon, 29 Jan 2024 03:10:11 +0000 (22:10 -0500)]
21361: Expand distro detection in Salt installer

The immediate motivation for this is to detect Alma/Rocky/RHEL 8.
The way we do it is by reading both the ID and ID_LIKE values from
/etc/os-release. All these have "rhel" in either ID or
ID_LIKE. Similiarly, Ubuntu has ID_LIKE=debian. We're already reading
this file anyway; now we just use more of it.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21361: Remove unsupported distros from build scripts
Brett Smith [Mon, 29 Jan 2024 02:47:31 +0000 (21:47 -0500)]
21361: Remove unsupported distros from build scripts

After this, `git grep -e debian10 -e ubuntu1804 -e centos7 build`
returns nothing.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21392: Package build scripts require --target
Brett Smith [Mon, 29 Jan 2024 02:40:36 +0000 (21:40 -0500)]
21392: Package build scripts require --target

Now that we no longer support debian10, it doesn't make sense as a
default. Rather than continue updating the default at arbitrary points
in time, remove it and require the user to specify their target.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21370: Remove workflows/container requests from federated search
Peter Amstutz [Wed, 31 Jan 2024 20:17:39 +0000 (15:17 -0500)]
21370: Remove workflows/container requests from federated search

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months ago21427: changed spec to allow for delay in toolbar transition Arvados-DCO-1.1-Signed...
Lisa Knox [Wed, 31 Jan 2024 20:00:58 +0000 (15:00 -0500)]
21427: changed spec to allow for delay in toolbar transition Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

9 months ago21440: Always include Collection in the Outputs panel
Peter Amstutz [Wed, 31 Jan 2024 19:48:41 +0000 (14:48 -0500)]
21440: Always include Collection in the Outputs panel

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months ago21440: Adjust order of process panel and make panels bigger
Peter Amstutz [Wed, 31 Jan 2024 19:35:01 +0000 (14:35 -0500)]
21440: Adjust order of process panel and make panels bigger

This makes switching panels feel more like tabs, while retaining the
ability to scroll through them.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months ago21427: process test passes Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii...
Lisa Knox [Wed, 31 Jan 2024 18:30:13 +0000 (13:30 -0500)]
21427: process test passes Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

9 months agoAdd comment to workaround while waiting for upstream to merge PR.
Tom Clegg [Wed, 31 Jan 2024 16:37:23 +0000 (11:37 -0500)]
Add comment to workaround while waiting for upstream to merge PR.

refs #21252

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

9 months ago21429: Remember and restore Docker service state 21429-remember-docker-state
Brett Smith [Tue, 30 Jan 2024 16:54:58 +0000 (11:54 -0500)]
21429: Remember and restore Docker service state

At least with systemd, which should cover all modern production
deployments. This makes the behavior of ensure-encrypted-partitions less
surprising in deployments where it runs in coordination with other
deployment scripts.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

9 months ago21427: adjusted toolbar margin to pass test spec Arvados-DCO-1.1-Signed-off-by: Lisa...
Lisa Knox [Tue, 30 Jan 2024 16:17:08 +0000 (11:17 -0500)]
21427: adjusted toolbar margin to pass test spec Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

9 months agoMerge branch '21317-toolbar-overflow'
Lisa Knox [Thu, 25 Jan 2024 14:16:21 +0000 (09:16 -0500)]
Merge branch '21317-toolbar-overflow'

closes #21317

Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

9 months agoMerge branch '21366-subprocess-output-loading-bug' into main. Closes #21366
Stephen Smith [Wed, 24 Jan 2024 21:30:24 +0000 (16:30 -0500)]
Merge branch '21366-subprocess-output-loading-bug' into main. Closes #21366

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

9 months ago21317: overflow now toggles on and off at the same pixel Arvados-DCO-1.1-Signed-off... 21317-toolbar-overflow
Lisa Knox [Wed, 24 Jan 2024 16:19:08 +0000 (11:19 -0500)]
21317: overflow now toggles on and off at the same pixel Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

9 months ago21336: Add type checking to output data reducer instead of accepting any, fix 21366-subprocess-output-loading-bug
Stephen Smith [Tue, 23 Jan 2024 20:00:51 +0000 (15:00 -0500)]
21336: Add type checking to output data reducer instead of accepting any, fix
misalignments in payload type. Rename some properties for clarity to align with
passing in uuid in addition to output details to reducer.

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

9 months ago21317: fixed collapse occlusion Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox...
Lisa Knox [Tue, 23 Jan 2024 16:49:19 +0000 (11:49 -0500)]
21317: fixed collapse occlusion Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

9 months ago21366: Display raw/JSON tab on subprocess even if empty while still guarding against...
Stephen Smith [Tue, 23 Jan 2024 15:40:24 +0000 (10:40 -0500)]
21366: Display raw/JSON tab on subprocess even if empty while still guarding against undefined

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

9 months agoMerge branch '21394-docker-tag-push'
Peter Amstutz [Fri, 19 Jan 2024 14:34:21 +0000 (09:34 -0500)]
Merge branch '21394-docker-tag-push'

Also includes 21230-no-global-pip

This updates how certain dev/test environments install our Python
packages as well as some infrastructure around running the CWL
conformance tests.

refs #21230
refs #21394

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months ago21394: Emit conformance badges json from test_with_arvbox 21394-docker-tag-push
Peter Amstutz [Thu, 18 Jan 2024 15:32:12 +0000 (10:32 -0500)]
21394: Emit conformance badges json from test_with_arvbox

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

9 months agoMerge branch '21353-loginas-flaky-bug' into main. Closes #21353.
Stephen Smith [Thu, 18 Jan 2024 15:04:11 +0000 (10:04 -0500)]
Merge branch '21353-loginas-flaky-bug' into main. Closes #21353.

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

9 months agoMerge branch '20318-disk-cache' 20318-disk-cache
Tom Clegg [Wed, 17 Jan 2024 22:51:34 +0000 (17:51 -0500)]
Merge branch '20318-disk-cache'

closes #20318

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

9 months ago20318: Fix arvados-login-sync and arvados-cli dependencies.
Tom Clegg [Wed, 17 Jan 2024 21:41:24 +0000 (16:41 -0500)]
20318: Fix arvados-login-sync and arvados-cli dependencies.

Previous requirement '~> 2.7.0.rc1' excluded the current prerelease
version '2.8.0.dev20231214204948' that the test suite deliberately
installs ahead of time, so bundler overrode that and selected the last
released published version 2.7.1 from rubygems, which is not
compatible with Ruby 3.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

9 months ago21394: use /opt/arvados-py if present
Peter Amstutz [Wed, 17 Jan 2024 20:28:20 +0000 (15:28 -0500)]
21394: use /opt/arvados-py if present

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

10 months ago21394: Use v1.2.1 tag for CWL conformance tests
Peter Amstutz [Wed, 17 Jan 2024 01:18:53 +0000 (20:18 -0500)]
21394: Use v1.2.1 tag for CWL conformance tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>