arvados.git
8 weeks ago21461: Fixes Cypress test to match log viewer changes. 21461-scrollbars-fix-old-cypress
Lucas Di Pentima [Tue, 20 Feb 2024 21:17:19 +0000 (18:17 -0300)]
21461: Fixes Cypress test to match log viewer changes.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

8 weeks ago21461: Fixes log line-breaking behavior for really long strings.
Lucas Di Pentima [Fri, 16 Feb 2024 22:50:27 +0000 (19:50 -0300)]
21461: Fixes log line-breaking behavior for really long strings.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

8 weeks ago21461: Adds test that confirms no horizontal scrollbar exist on long lines.
Lucas Di Pentima [Fri, 23 Feb 2024 20:22:46 +0000 (17:22 -0300)]
21461: Adds test that confirms no horizontal scrollbar exist on long lines.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

8 weeks agoMerge branch '21504-arv-mount-reference'
Brett Smith [Tue, 5 Mar 2024 16:31:22 +0000 (11:31 -0500)]
Merge branch '21504-arv-mount-reference'

Refs #21504.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

8 weeks agoClean up default tested package list
Brett Smith [Mon, 4 Mar 2024 21:19:23 +0000 (16:19 -0500)]
Clean up default tested package list

I was referring to this list while filing a bug and happened to notice
the redundant `keep-block-check` and `keep-rsync` entries. These caused
duplicate work during the package-build Jenkins jobs. No issue #.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

8 weeks agoMerge branch '21552-ebs-autoscale-update'. Closes #21552
Lucas Di Pentima [Mon, 4 Mar 2024 18:15:33 +0000 (15:15 -0300)]
Merge branch '21552-ebs-autoscale-update'. Closes #21552

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 months ago21494: Bugfix incorrect method name
Brett Smith [Sat, 2 Mar 2024 20:45:26 +0000 (15:45 -0500)]
21494: Bugfix incorrect method name

Refs #21494.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21552: Updates autoscale-ebs commit hash to install the latest fix. 21552-ebs-autoscale-update
Lucas Di Pentima [Fri, 1 Mar 2024 15:46:35 +0000 (12:46 -0300)]
21552: Updates autoscale-ebs commit hash to install the latest fix.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 months agoMerge branch '2960-keepstore-streaming'
Tom Clegg [Thu, 29 Feb 2024 18:27:11 +0000 (13:27 -0500)]
Merge branch '2960-keepstore-streaming'

refs #2960

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 months ago2960: Merge branch 'main' into 2960-keepstore-streaming 2960-keepstore-streaming
Tom Clegg [Thu, 29 Feb 2024 17:38:09 +0000 (12:38 -0500)]
2960: Merge branch 'main' into 2960-keepstore-streaming

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 months ago21552: Download & use newer ebs-autoscale fork version with IMDSv2 enabled.
Lucas Di Pentima [Wed, 28 Feb 2024 21:19:03 +0000 (18:19 -0300)]
21552: Download & use newer ebs-autoscale fork version with IMDSv2 enabled.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 months agoMerge branch '21552-force-imdsv2'
Tom Clegg [Wed, 28 Feb 2024 20:48:42 +0000 (15:48 -0500)]
Merge branch '21552-force-imdsv2'

refs #21552
closes #21565

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 months ago21552: Require IMDSv2 on ec2 compute instances. 21552-force-imdsv2
Tom Clegg [Wed, 28 Feb 2024 17:26:03 +0000 (12:26 -0500)]
21552: Require IMDSv2 on ec2 compute instances.

As described at
https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/configuring-IMDS-new-instances.html

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 months agoMerge branch '21249-group-paging' into main. Closes #21249
Stephen Smith [Wed, 28 Feb 2024 14:48:15 +0000 (09:48 -0500)]
Merge branch '21249-group-paging' into main. Closes #21249

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

2 months ago21249: Add unit tests to check group details pagination 21249-group-paging
Stephen Smith [Tue, 27 Feb 2024 20:10:14 +0000 (15:10 -0500)]
21249: Add unit tests to check group details pagination

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

2 months agoMerge branch '21386-project-loading-view'
Lisa Knox [Tue, 27 Feb 2024 20:07:52 +0000 (15:07 -0500)]
Merge branch '21386-project-loading-view'

closes #21386

Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago21249: Implement paging for group members panel and group permission list
Stephen Smith [Tue, 27 Feb 2024 19:12:22 +0000 (14:12 -0500)]
21249: Implement paging for group members panel and group permission list

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

2 months ago21386: feedback cleanup Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii... 21386-project-loading-view
Lisa Knox [Tue, 27 Feb 2024 18:53:07 +0000 (13:53 -0500)]
21386: feedback cleanup Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months agoMerge branch '21416-email-options-doc' refs #21416
Peter Amstutz [Tue, 27 Feb 2024 16:13:26 +0000 (11:13 -0500)]
Merge branch '21416-email-options-doc' refs #21416

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 months ago21416: Typo fix plural to singular
Peter Amstutz [Tue, 27 Feb 2024 16:12:32 +0000 (11:12 -0500)]
21416: Typo fix plural to singular

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 months ago21224: cleanup Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>
Lisa Knox [Tue, 27 Feb 2024 16:07:14 +0000 (11:07 -0500)]
21224: cleanup Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago21224: changed search results 404 message Arvados-DCO-1.1-Signed-off-by: Lisa Knox...
Lisa Knox [Tue, 27 Feb 2024 16:02:48 +0000 (11:02 -0500)]
21224: changed search results 404 message Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago21224: changed pending icon to PendingIcon Arvados-DCO-1.1-Signed-off-by: Lisa Knox...
Lisa Knox [Tue, 27 Feb 2024 15:46:36 +0000 (10:46 -0500)]
21224: changed pending icon to PendingIcon Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago21224: removed dataexplorer component state Arvados-DCO-1.1-Signed-off-by: Lisa Knox...
Lisa Knox [Tue, 27 Feb 2024 15:42:32 +0000 (10:42 -0500)]
21224: removed dataexplorer component state Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago21224: moved isNotFound fetching to data explorer Arvados-DCO-1.1-Signed-off-by:...
Lisa Knox [Tue, 27 Feb 2024 15:09:21 +0000 (10:09 -0500)]
21224: moved isNotFound fetching to data explorer Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago21504: Add a table of contents to the arv-mount reference 21504-arv-mount-reference
Brett Smith [Mon, 26 Feb 2024 16:57:33 +0000 (11:57 -0500)]
21504: Add a table of contents to the arv-mount reference

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21504: Add an example arv-mount systemd service definition
Brett Smith [Mon, 26 Feb 2024 16:54:04 +0000 (11:54 -0500)]
21504: Add an example arv-mount systemd service definition

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21504: Add an `arv-mount --exec` example
Brett Smith [Mon, 26 Feb 2024 16:16:48 +0000 (11:16 -0500)]
21504: Add an `arv-mount --exec` example

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21504: Start arv-mount reference
Brett Smith [Mon, 26 Feb 2024 16:11:32 +0000 (11:11 -0500)]
21504: Start arv-mount reference

Mostly generated from `arv-mount --help`. The filters section is new.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21504: Consistently use backtick markup in arv-mount help
Brett Smith [Mon, 26 Feb 2024 15:39:29 +0000 (10:39 -0500)]
21504: Consistently use backtick markup in arv-mount help

Mostly to make it easier to generate reference documentation, but it's
nice as-is too.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21504: Reorder arv-mount --mount-* options
Brett Smith [Mon, 26 Feb 2024 15:32:31 +0000 (10:32 -0500)]
21504: Reorder arv-mount --mount-* options

For consistency with the previous section.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21504: Break out FUSE section of SDK reference
Brett Smith [Mon, 26 Feb 2024 15:25:05 +0000 (10:25 -0500)]
21504: Break out FUSE section of SDK reference

This includes modernizing the index:

* Fix the distro package name
* Update the list of C dependencies
* Copyediting throughout

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21504: Modernize SDK documentation tree
Brett Smith [Mon, 26 Feb 2024 15:04:26 +0000 (10:04 -0500)]
21504: Modernize SDK documentation tree

* Spell out "CLI"
* Remove long-gone page listing from CLI section
* Ditch the "v2" moniker from the Java SDK
* Alphabetize the less-mature SDKs

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21504: Modernize the SDK index
Brett Smith [Mon, 26 Feb 2024 14:42:23 +0000 (09:42 -0500)]
21504: Modernize the SDK index

* Note these packages also include client tools.
* Highlight more mature SDKs. Attach caveats to the less mature ones.
* Update Workbench text for v2.

This is preparation to list most client tools here, and generally turn
the "SDK reference" into a "User reference."

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21504: Rewrite arv-mount help for more consistent style
Brett Smith [Sun, 25 Feb 2024 22:00:48 +0000 (17:00 -0500)]
21504: Rewrite arv-mount help for more consistent style

Some key points:

* Prefer describing the effect with a phrase over a sentence
* Only use periods when there are multiple sentences
* Defaults in parentheses
* Consistent text where needed (particularly across --by-* and
  --mount-by-* options and different --unmount options)

We don't really have a style guide for documentation like this. I'm not
trying to establish one by fiat. I'd be open to discussing basically all
these points. But until that discussion happens, consistency is
valuable, so I'm using the rules that I tend to follow naturally.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21504: Refine arv-mount description and epilog
Brett Smith [Sun, 25 Feb 2024 04:33:20 +0000 (23:33 -0500)]
21504: Refine arv-mount description and epilog

* Modernize the description.
* Remove outdated mode information.
* Move epilog to --exec help.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21504: Refine metavars for arv-mount options
Brett Smith [Sun, 25 Feb 2024 04:26:21 +0000 (23:26 -0500)]
21504: Refine metavars for arv-mount options

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21504: Organize arv-mount options into groups
Brett Smith [Sun, 25 Feb 2024 04:17:53 +0000 (23:17 -0500)]
21504: Organize arv-mount options into groups

Groups are ordered roughly from more to less important, although
different users will have different needs. Options within a group are
mostly alphabetical except when organization requires otherwise.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21504: Style arv-mount argument creation consistently
Brett Smith [Sun, 25 Feb 2024 03:44:47 +0000 (22:44 -0500)]
21504: Style arv-mount argument creation consistently

This is purely a code style change: every argparse argument is created
with one argument per line. This is preparation for readability
reorganization I'm about to do.

Remove arguments that match the argparse defaults as part of this.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months agoMerge branch '21441-progress-tooltip' refs #21441
Peter Amstutz [Fri, 23 Feb 2024 22:19:58 +0000 (17:19 -0500)]
Merge branch '21441-progress-tooltip' refs #21441

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 months ago21494: Clean test_doc
Brett Smith [Fri, 23 Feb 2024 16:54:34 +0000 (11:54 -0500)]
21494: Clean test_doc

* Use local variables and `env -C` to preserve global state, instead of
  a subshell.
* Remove outdated python-epydoc comment.
* Remove PYTHONPATH setting. It's unnecessary now that we run inside a
  virtualenv with PySDK installed.

Refs #21494.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21386: added sleep to data-table unit test Arvados-DCO-1.1-Signed-off-by: Lisa Knox...
Lisa Knox [Fri, 23 Feb 2024 15:52:08 +0000 (10:52 -0500)]
21386: added sleep to data-table unit test Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago21386: not found test passes Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox...
Lisa Knox [Fri, 23 Feb 2024 15:17:17 +0000 (10:17 -0500)]
21386: not found test passes Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months agoMerge branch '21494-sdk-doc-linkchecker'
Brett Smith [Thu, 22 Feb 2024 20:53:33 +0000 (15:53 -0500)]
Merge branch '21494-sdk-doc-linkchecker'

Refs #21494.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21386: fixed not found test again Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa...
Lisa Knox [Thu, 22 Feb 2024 20:51:39 +0000 (15:51 -0500)]
21386: fixed not found test again Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago21494: Adapt linkchecker arguments to built SDKs 21494-sdk-doc-linkchecker
Brett Smith [Thu, 22 Feb 2024 19:48:04 +0000 (14:48 -0500)]
21494: Adapt linkchecker arguments to built SDKs

This lets you build a subset of SDK documentation, linkcheck it, and get
an accurate result.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21494: Run linkchecker task unconditionally
Brett Smith [Thu, 22 Feb 2024 19:25:05 +0000 (14:25 -0500)]
21494: Run linkchecker task unconditionally

This better matches the new behavior of SDK doc build tasks. It also
just makes sense IMO: linkchecker never runs implicitly, only when you
request it, so if it can't do what you asked I think that should count
as failure.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21494: Support arguments to doc tests
Brett Smith [Thu, 22 Feb 2024 19:08:48 +0000 (14:08 -0500)]
21494: Support arguments to doc tests

Mainly for the new `sdks` environment variable.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21386: fixed not found test Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii...
Lisa Knox [Thu, 22 Feb 2024 16:39:18 +0000 (11:39 -0500)]
21386: fixed not found test Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago2960: Use getLocatorInfo to get block size in blockReadRemote.
Tom Clegg [Thu, 22 Feb 2024 16:25:39 +0000 (11:25 -0500)]
2960: Use getLocatorInfo to get block size in blockReadRemote.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 months ago21386: refined loading state params Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa...
Lisa Knox [Thu, 22 Feb 2024 16:14:27 +0000 (11:14 -0500)]
21386: refined loading state params Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago2960: Rewrite getLocatorInfo and add some more error checks.
Tom Clegg [Thu, 22 Feb 2024 16:01:45 +0000 (11:01 -0500)]
2960: Rewrite getLocatorInfo and add some more error checks.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 months ago2960: Rename parseLocator to getLocatorInfo, add comments.
Tom Clegg [Thu, 22 Feb 2024 15:12:18 +0000 (10:12 -0500)]
2960: Rename parseLocator to getLocatorInfo, add comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 months agoMerge branch '21494-sdk-doc-build'
Brett Smith [Thu, 22 Feb 2024 14:00:51 +0000 (09:00 -0500)]
Merge branch '21494-sdk-doc-build'

Closes #21494.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21386: added case for initial project view before loading Arvados-DCO-1.1-Signed...
Lisa Knox [Wed, 21 Feb 2024 20:52:41 +0000 (15:52 -0500)]
21386: added case for initial project view before loading Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago21416: Add comments to try and explain the options related to email better 21416-email-options-doc
Peter Amstutz [Wed, 21 Feb 2024 19:47:25 +0000 (14:47 -0500)]
21416: Add comments to try and explain the options related to email better

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 months agoMerge branch '21288-launch-wf-101'
Lisa Knox [Wed, 21 Feb 2024 19:04:51 +0000 (14:04 -0500)]
Merge branch '21288-launch-wf-101'

closes #21288

Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago21386: added default case for isNotFound Arvados-DCO-1.1-Signed-off-by: Lisa Knox...
Lisa Knox [Wed, 21 Feb 2024 18:35:37 +0000 (13:35 -0500)]
21386: added default case for isNotFound Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months agoMerge branch 'main' into 21386-project-loading-view
Lisa Knox [Wed, 21 Feb 2024 17:06:20 +0000 (12:06 -0500)]
Merge branch 'main' into 21386-project-loading-view

Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago21494: Let documentation build specify what SDKs should be included 21494-sdk-doc-build
Brett Smith [Wed, 21 Feb 2024 16:14:58 +0000 (11:14 -0500)]
21494: Let documentation build specify what SDKs should be included

This is to support Jenkins. It also lets us ensure that we actually
build the documentation we intend, and avoid situations where the build
quietly skips an SDK because of a missing dependency.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21494: Document build requirements for all SDK documentation
Brett Smith [Wed, 21 Feb 2024 16:04:15 +0000 (11:04 -0500)]
21494: Document build requirements for all SDK documentation

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21494: Refine Python SDK documentation requirements
Brett Smith [Wed, 21 Feb 2024 16:01:11 +0000 (11:01 -0500)]
21494: Refine Python SDK documentation requirements

Installing `python3-pip` is unnecessary, it'll be in the virtualenv.

Explicitly install setuptools as PEP 517/518 futureproofing.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21386: cleanup Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>
Lisa Knox [Wed, 21 Feb 2024 15:54:34 +0000 (10:54 -0500)]
21386: cleanup Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago21441: List all counts in a single tooltip 21441-progress-tooltip
Peter Amstutz [Wed, 21 Feb 2024 15:47:09 +0000 (10:47 -0500)]
21441: List all counts in a single tooltip

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 months ago21494: Improve error if pdoc is not available
Brett Smith [Wed, 21 Feb 2024 15:32:49 +0000 (10:32 -0500)]
21494: Improve error if pdoc is not available

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21386: favorites loading view good Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa...
Lisa Knox [Wed, 21 Feb 2024 15:18:20 +0000 (10:18 -0500)]
21386: favorites loading view good Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago21386: allprocesses loading view good Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa...
Lisa Knox [Wed, 21 Feb 2024 14:55:46 +0000 (09:55 -0500)]
21386: allprocesses loading view good Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago21386: renamed is404 to isnotfound Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa...
Lisa Knox [Wed, 21 Feb 2024 14:43:05 +0000 (09:43 -0500)]
21386: renamed is404 to isnotfound Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago21386: search results good Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii...
Lisa Knox [Tue, 20 Feb 2024 19:50:38 +0000 (14:50 -0500)]
21386: search results good Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago21386: cleanup Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>
Lisa Knox [Tue, 20 Feb 2024 18:53:43 +0000 (13:53 -0500)]
21386: cleanup Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago21386: project 404 vs empty working Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa...
Lisa Knox [Tue, 20 Feb 2024 17:13:04 +0000 (12:13 -0500)]
21386: project 404 vs empty working Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago21386: removed duplicate isWorking functions and moved default views to data-table...
Lisa Knox [Tue, 20 Feb 2024 15:50:53 +0000 (10:50 -0500)]
21386: removed duplicate isWorking functions and moved default views to data-table Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months agoMerge branch '21321-cran-mirror'
Brett Smith [Fri, 16 Feb 2024 16:42:51 +0000 (11:42 -0500)]
Merge branch '21321-cran-mirror'

Refs #21321.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21288: new api request if wf is not in top 100 list Arvados-DCO-1.1-Signed-off-by... 21288-launch-wf-101
Lisa Knox [Fri, 16 Feb 2024 16:19:45 +0000 (11:19 -0500)]
21288: new api request if wf is not in top 100 list Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months agoMerge branch '21023-keepclient-retry-delay'
Tom Clegg [Fri, 16 Feb 2024 15:54:07 +0000 (10:54 -0500)]
Merge branch '21023-keepclient-retry-delay'

fixes #21023

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 months ago21023: Clean up tests. 21023-keepclient-retry-delay
Tom Clegg [Fri, 16 Feb 2024 15:52:51 +0000 (10:52 -0500)]
21023: Clean up tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 months ago2960: Tweak s3 concurrent download parameters.
Tom Clegg [Fri, 16 Feb 2024 15:22:28 +0000 (10:22 -0500)]
2960: Tweak s3 concurrent download parameters.

Trials show performance difference is negligible between 11x 6MiB and
13x 5MiB. Given that, I figure lower concurrency wins because it
involves less processing.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 months ago2960: Add back volume implementation requirements.
Tom Clegg [Fri, 16 Feb 2024 00:05:33 +0000 (19:05 -0500)]
2960: Add back volume implementation requirements.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 months ago21453: Clean imports in arvados.http_to_keep
Brett Smith [Thu, 15 Feb 2024 22:45:42 +0000 (17:45 -0500)]
21453: Clean imports in arvados.http_to_keep

This is to force Jenkins to build a new PySDK package. Right now it's
trying to run the test updated in the previous commit without updating
the package first, and failing. But this should still be a nice change.
Refs #21453.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21023: Just use the default retry delay profile in keepproxy.
Tom Clegg [Thu, 15 Feb 2024 22:21:06 +0000 (17:21 -0500)]
21023: Just use the default retry delay profile in keepproxy.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 months ago21321: Use CRAN cloud redirect 21321-cran-mirror
Brett Smith [Thu, 15 Feb 2024 22:09:07 +0000 (17:09 -0500)]
21321: Use CRAN cloud redirect

The wustl.edu mirror has been unreliable lately, sending incomplete
packages and causing test run failures. The hope is that this will be
more reliable.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21361: Remove dependency pin for Debian 10
Brett Smith [Thu, 15 Feb 2024 22:07:04 +0000 (17:07 -0500)]
21361: Remove dependency pin for Debian 10

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21023: Use known-good exponential backoff with jitter strategy.
Tom Clegg [Thu, 15 Feb 2024 21:30:31 +0000 (16:30 -0500)]
21023: Use known-good exponential backoff with jitter strategy.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 months agoMerge branch '21453-python-package-path'
Brett Smith [Thu, 15 Feb 2024 21:17:42 +0000 (16:17 -0500)]
Merge branch '21453-python-package-path'

Closes #21453.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21453: Update package test with new packaged virtualenv path 21453-python-package-path
Brett Smith [Thu, 15 Feb 2024 21:08:37 +0000 (16:08 -0500)]
21453: Update package test with new packaged virtualenv path

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21453: Update CWL tests with new packaged virtualenv path
Brett Smith [Thu, 15 Feb 2024 20:46:24 +0000 (15:46 -0500)]
21453: Update CWL tests with new packaged virtualenv path

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago2960: Move streaming from volume to keepstore layer.
Tom Clegg [Thu, 15 Feb 2024 20:20:41 +0000 (15:20 -0500)]
2960: Move streaming from volume to keepstore layer.

Avoids using 2x buffers when comparing existing data during
BlockWrite.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 months ago2960: Buffer reads when serialize enabled on unix volume.
Tom Clegg [Thu, 15 Feb 2024 01:25:04 +0000 (20:25 -0500)]
2960: Buffer reads when serialize enabled on unix volume.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 months ago2960: Finish renaming s3aws_volume to s3_volume.
Tom Clegg [Wed, 14 Feb 2024 22:21:27 +0000 (17:21 -0500)]
2960: Finish renaming s3aws_volume to s3_volume.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 months agoMerge branch '21501-pin-dotenv'
Brett Smith [Wed, 14 Feb 2024 21:29:43 +0000 (16:29 -0500)]
Merge branch '21501-pin-dotenv'

Closes #21501.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21023: Add exponential-backoff delay between keepclient retries.
Tom Clegg [Wed, 14 Feb 2024 19:43:14 +0000 (14:43 -0500)]
21023: Add exponential-backoff delay between keepclient retries.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 months ago21386: fixed loading display in search results Arvados-DCO-1.1-Signed-off-by: Lisa...
Lisa Knox [Wed, 14 Feb 2024 19:38:24 +0000 (14:38 -0500)]
21386: fixed loading display in search results Arvados-DCO-1.1-Signed-off-by: Lisa Knox <lisa.knox@curii.com>

2 months ago21501: Pin dotenv gem version on distros with Ruby 2.7 21501-pin-dotenv
Brett Smith [Wed, 14 Feb 2024 16:34:40 +0000 (11:34 -0500)]
21501: Pin dotenv gem version on distros with Ruby 2.7

See comments for rationale.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago2960: Fix some needlessly exported identifiers.
Tom Clegg [Tue, 13 Feb 2024 19:48:09 +0000 (14:48 -0500)]
2960: Fix some needlessly exported identifiers.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 months ago2960: Refactor keepstore into a streaming server.
Tom Clegg [Mon, 12 Feb 2024 19:46:30 +0000 (14:46 -0500)]
2960: Refactor keepstore into a streaming server.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 months agoMerge branch '21452-fuse-filters'
Brett Smith [Tue, 13 Feb 2024 17:26:35 +0000 (12:26 -0500)]
Merge branch '21452-fuse-filters'

Closes #21452.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21453: Update minimum Python version in SDK documentation
Brett Smith [Tue, 13 Feb 2024 15:44:45 +0000 (10:44 -0500)]
21453: Update minimum Python version in SDK documentation

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21453: Clean up documentation note for unsupported distribution
Brett Smith [Tue, 13 Feb 2024 15:43:11 +0000 (10:43 -0500)]
21453: Clean up documentation note for unsupported distribution

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21453: Install Python package virtualenvs under /usr/lib
Brett Smith [Tue, 13 Feb 2024 15:36:54 +0000 (10:36 -0500)]
21453: Install Python package virtualenvs under /usr/lib

Installing under /usr/share/python3 is a remnant from when we built
library packages that integrated with the distribution. Now that we
install an entire virtualenv that's tied to a specific minor version of
Python, installing under /usr/lib makes more sense.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

2 months ago21023: Avoid overloading 503 status.
Tom Clegg [Thu, 18 Jan 2024 19:04:26 +0000 (14:04 -0500)]
21023: Avoid overloading 503 status.

When all volumes are full, return 507 (cf WebDAV) indicating the
client should not auto-retry without additional user interaction.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>