Brett Smith [Wed, 24 Jul 2024 18:49:41 +0000 (14:49 -0400)]
21935: Rename SafeHTTPCache to ThreadSafeHTTPCache
This mirrors the name of ThreadSafeAPIClient and clarifies what it is
"safe" for.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Wed, 24 Jul 2024 18:12:36 +0000 (14:12 -0400)]
21935/15397: Remove StreamFileReader
Unused after earlier changes.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Wed, 24 Jul 2024 18:04:06 +0000 (14:04 -0400)]
21935: Add upgrade note about PySDK reorganization
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Fri, 12 Jul 2024 21:57:47 +0000 (17:57 -0400)]
21935: Fix docstring markup typo
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Fri, 12 Jul 2024 20:01:47 +0000 (16:01 -0400)]
21935: Add a docstring to arvados.commands
Mostly to annotate it @private so pdoc skips rendering it.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Fri, 12 Jul 2024 19:57:44 +0000 (15:57 -0400)]
21935: Extract BaseDirectory classes to arvados._internal.basedirs
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Fri, 12 Jul 2024 19:14:04 +0000 (15:14 -0400)]
21935: Move arvados._pycurlhelper to arvados._internal.pycurl
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Fri, 12 Jul 2024 19:02:02 +0000 (15:02 -0400)]
21935: Merge _normalize_stream and _ranges into arvados._internal.streams
All these classes and functions are related to parsing and manipulating
streams, so it makes sense to collect them in one module with a name
reflecting that.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Fri, 12 Jul 2024 18:37:12 +0000 (14:37 -0400)]
21935: Move arvados.http_to_keep under arvados._internal
This functionality could be useful to provide to people writing their
own tools. However, because of the way it was extracted out of
arvados-cwl-runner, the API wasn't really designed to be public, and has
already had one breaking change since it was introduced.
Make the current module internal so the API doesn't ossify. We can
always develop a public API for it in the future.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Fri, 12 Jul 2024 18:23:35 +0000 (14:23 -0400)]
21935: Move arvados.diskcache under arvados._internal
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Fri, 12 Jul 2024 17:21:49 +0000 (13:21 -0400)]
21935: Merge arvados.timer into arvados._internal
It's one small class. It doesn't need a dedicated module.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Fri, 12 Jul 2024 15:35:29 +0000 (11:35 -0400)]
21935: Move arvados.util._deprecated to arvados._internal
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Fri, 12 Jul 2024 15:20:17 +0000 (11:20 -0400)]
15397: Remove documentation about upgrading to Crunch v2
Now that the Crunch v1 jobs API has been removed, there is no need to
document how to transition away from it.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Fri, 12 Jul 2024 15:17:13 +0000 (11:17 -0400)]
21935/15397: Remove arv-migrate-docker19
This tool was written to aid a migration that became necessary with the
release of Docker 1.10 in February 2016. Its time has passed.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Fri, 12 Jul 2024 14:57:45 +0000 (10:57 -0400)]
21935: Rename safeapi.ThreadSafeApiCache to api.ThreadSafeAPIClient
Moving the class lets us delist the safeapi module from reference
documentation and streamline it.
Changing the class name better describes what it does (it doesn't
cache anything!) and follows PEP 8 case rules.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Fri, 12 Jul 2024 14:32:19 +0000 (10:32 -0400)]
21935: Move arvados.cache.SafeHTTPCache to arvados.api
This removes a module from the reference documentation while maintaining
backwards compatibility.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Fri, 12 Jul 2024 14:21:06 +0000 (10:21 -0400)]
21935: Correct return type of arvados.api.http_cache
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Fri, 12 Jul 2024 14:03:49 +0000 (10:03 -0400)]
21974: Remove CentOS discussion from Arvados 3.0 release notes
Redundant since this support was removed in Arvados 2.7.4.
Refs #21974.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Peter Amstutz [Mon, 8 Jul 2024 21:50:13 +0000 (17:50 -0400)]
Fix a couple of upgrade note typos.
refs #21947
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Mon, 8 Jul 2024 21:46:06 +0000 (17:46 -0400)]
Synchronize upgrade notes between 2.7 branch and main
refs #21947
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Mon, 8 Jul 2024 15:52:49 +0000 (11:52 -0400)]
Merge branch '21989-headers'
fixes #21989
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 8 Jul 2024 15:21:59 +0000 (11:21 -0400)]
21989: Fix order-sensitive test.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Zoë Ma [Mon, 8 Jul 2024 07:15:26 +0000 (15:15 +0800)]
21989: Keepstore: Use comma separator for X-Keep-Storage-Classes-Confirmed header
When generating the X-Keep-Storage-Classes-Confirmed header, use comma
(",") instead of semicolon (";") as the separator for multi-entry value.
This is to be consistent with keep-proxy's behavior and the arv-put
client's expectation. Plus, it follows RFC 9110 (see sec. 5.2).
Without the fix, arv-put wrongly believes that storage classes are not
supported on the cluster it is putting to. The spurious warning
"X-Keep-Storage-Classes header not supported by the cluster" can be seen
in arv-put messages and in Workbench2.
Arvados-DCO-1.1-Signed-off-by: Zoë Ma <zoe.ma@curii.com>
Brett Smith [Wed, 3 Jul 2024 18:43:23 +0000 (14:43 -0400)]
Merge branch '21931-public-suffix-pin'
Refs #21931.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Tom Clegg [Wed, 3 Jul 2024 13:38:08 +0000 (09:38 -0400)]
Merge branch '21701-replace-files-current-version'
refs #21701
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Brett Smith [Tue, 2 Jul 2024 17:45:08 +0000 (13:45 -0400)]
21931: Revert net-imap dependency
This was updated as part of #21933 in
9167b2053ef2a39a4e8a7c13e4127e12470b14ed.
However, net-imap 0.4 requires Ruby > 2.7.3, while Ubuntu 20.04 only
ships with Ruby 2.7.0. Upgrading this gem doesn't seem to be required
for the new Rails release, so don't.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Tue, 2 Jul 2024 16:09:40 +0000 (12:09 -0400)]
21931: Narrow public_suffix dependency for arvados-google-api-client gem
For the usual reason: to force `gem install` to resolve dependencies in
a way that works on Ruby 2.7.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Peter Amstutz [Tue, 2 Jul 2024 17:18:59 +0000 (13:18 -0400)]
Merge branch 'jszlenk/create_new_subproject' refs #21937
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Brett Smith [Mon, 1 Jul 2024 19:18:50 +0000 (15:18 -0400)]
Merge branch '21934-python36-compat'
Refs #21934.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Thu, 27 Jun 2024 19:45:11 +0000 (15:45 -0400)]
21934: Avoid using subprocess.run capture_output for Py3.6 compatibility
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Thu, 27 Jun 2024 19:10:55 +0000 (15:10 -0400)]
21934: Use older name of ssl.CertificateError
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Thu, 27 Jun 2024 19:05:45 +0000 (15:05 -0400)]
21934: Set explicit cache_max in test_disk_cache_retry_write_error
Without this, the test might fail if /tmp is small and the initially
calculated cache_max is already at the floor.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Thu, 27 Jun 2024 18:56:34 +0000 (14:56 -0400)]
21934: Use assertGreater
To improve diagnostics if the test fails.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Thu, 27 Jun 2024 18:43:45 +0000 (14:43 -0400)]
21934: Autospec mmap mocks
So attribute checks get the right result.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Stephen Smith [Mon, 1 Jul 2024 16:09:09 +0000 (12:09 -0400)]
Merge branch '21764-project-picker-crash' into main. Closes #21764
Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>
Peter Amstutz [Mon, 1 Jul 2024 15:45:34 +0000 (11:45 -0400)]
Merge branch '15814-wb2-secrets' refs #15814
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Mon, 1 Jul 2024 15:28:06 +0000 (11:28 -0400)]
21701: Reword examples, add h4 headings and IDs.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 1 Jul 2024 15:26:56 +0000 (11:26 -0400)]
21701: Use <PDH> to distinguish literal strings from placeholders.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Mon, 1 Jul 2024 14:44:50 +0000 (10:44 -0400)]
15814: Fix runtime typecheck error
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Mon, 1 Jul 2024 14:11:03 +0000 (10:11 -0400)]
21701: Update comments.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Mon, 1 Jul 2024 14:10:28 +0000 (10:10 -0400)]
Merge branch 'main' into 15814-wb2-secrets
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Mon, 1 Jul 2024 13:57:59 +0000 (09:57 -0400)]
Merge branch '20640-computed-permissions-api'
closes #20640
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Fri, 28 Jun 2024 23:09:22 +0000 (19:09 -0400)]
20640: Merge branch 'main' into 20640-computed-permissions-api
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Fri, 28 Jun 2024 19:48:59 +0000 (15:48 -0400)]
20640: Fix obfuscated asserts.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Stephen Smith [Fri, 28 Jun 2024 15:22:30 +0000 (11:22 -0400)]
21764: Consolidate tree node extraction to be reused for tests, add TreePicker unit tests
Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>
Stephen Smith [Fri, 28 Jun 2024 15:21:01 +0000 (11:21 -0400)]
21764: Add more type safety to TreePicker
Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>
Stephen Smith [Fri, 28 Jun 2024 15:16:27 +0000 (11:16 -0400)]
21764: Add better type safety to TreePicker and handle empty string name
Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>
Stephen Smith [Wed, 19 Jun 2024 15:48:18 +0000 (11:48 -0400)]
21764: Preload cypress in wb2 build docker and start cypress as e2e by default
Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>
Peter Amstutz [Thu, 27 Jun 2024 19:18:02 +0000 (15:18 -0400)]
15814: Specifically communicate secrets cannot be displayed
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Thu, 27 Jun 2024 18:26:23 +0000 (14:26 -0400)]
21701: Reject requests with unused non-empty manifest_text.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Brett Smith [Thu, 27 Jun 2024 16:10:01 +0000 (12:10 -0400)]
Add locales and unzip to install deps
Commands from both these packages are used directly by `arvados-server install`.
No issue #.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Peter Amstutz [Thu, 27 Jun 2024 15:29:31 +0000 (11:29 -0400)]
15814: Simplify conditionals
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Thu, 27 Jun 2024 15:26:41 +0000 (11:26 -0400)]
15814: Fix tabs -> spaces
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Thu, 27 Jun 2024 14:16:38 +0000 (10:16 -0400)]
21701: Bump API revision.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 27 Jun 2024 14:02:25 +0000 (10:02 -0400)]
21701: Wordsmith.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 27 Jun 2024 13:54:57 +0000 (09:54 -0400)]
21701: Update replace_files API docs.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 26 Jun 2024 21:37:53 +0000 (17:37 -0400)]
21701: Accept "manifest_text" and "current" replace_files sources.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 26 Jun 2024 21:36:53 +0000 (17:36 -0400)]
21701: Test replace_files using provided manifest_text as source.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 26 Jun 2024 20:00:33 +0000 (16:00 -0400)]
21701: Test concurrent replace_files operations.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Lucas Di Pentima [Tue, 25 Jun 2024 20:54:28 +0000 (17:54 -0300)]
Merge branch '21933-deps-upgrade'
closes #21933
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Tom Clegg [Tue, 25 Jun 2024 20:28:13 +0000 (16:28 -0400)]
Merge branch '21891-output-copying-performance'
fixes #21891
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Tue, 25 Jun 2024 20:27:25 +0000 (16:27 -0400)]
21891: Comment to explain mysterious numbers 13 and 17 in test case.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Tue, 25 Jun 2024 19:25:55 +0000 (15:25 -0400)]
20640: Update docstring to clarify usage and link to list method.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Tue, 25 Jun 2024 17:44:43 +0000 (13:44 -0400)]
20640: Make test parameterization more readable.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Lucas Di Pentima [Tue, 25 Jun 2024 20:17:48 +0000 (17:17 -0300)]
21933: Replaces gopkg.in/square/go-jose.v2 to address CVE-2024-28180
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Tue, 25 Jun 2024 19:36:17 +0000 (16:36 -0300)]
21933: Upgrades rails to 7.0.8.4 to address CVE-2024-28103
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Tue, 25 Jun 2024 19:30:02 +0000 (16:30 -0300)]
21933: Upgrades github.com/hashicorp/go-retryablehttp to address CVE-2024-6104
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Tom Clegg [Tue, 25 Jun 2024 17:44:20 +0000 (13:44 -0400)]
20640: Simplify 'select' munging.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Tue, 25 Jun 2024 17:44:00 +0000 (13:44 -0400)]
20640: Change key_fields to a Container, since order doesn't matter.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Tue, 25 Jun 2024 15:04:24 +0000 (11:04 -0400)]
20640: Fix iter_computed_permissions args not being propagated.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Tue, 25 Jun 2024 15:03:41 +0000 (11:03 -0400)]
20640: Fix secondary sort column (use tiebreak_key, not 'uuid').
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Tue, 25 Jun 2024 15:03:16 +0000 (11:03 -0400)]
20640: Add iter_computed_permissions tests.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 24 Jun 2024 18:45:46 +0000 (14:45 -0400)]
Merge branch '21703-collection-update-lock'
closes #21703
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 24 Jun 2024 18:43:46 +0000 (14:43 -0400)]
21703: Improve test failure reporting.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 24 Jun 2024 18:41:41 +0000 (14:41 -0400)]
21703: Fix unlogged exception.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 24 Jun 2024 18:31:12 +0000 (14:31 -0400)]
21891: Remove unused sdk/go/manifest package and ManifestFileReader.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Thu, 20 Jun 2024 21:05:17 +0000 (17:05 -0400)]
15814: Catch error that otherwise goes unhandled
Running into this with some tests, during teardown.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Thu, 20 Jun 2024 19:28:52 +0000 (15:28 -0400)]
15814: Fix request intercepts that assume certain field in response
During teardown, the intercept is still active but requests may return
404 from upstream, causing the intercept that modifies the reponse to fail.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Thu, 20 Jun 2024 18:37:22 +0000 (14:37 -0400)]
15814: Fix unit test, trying to figure out test that only fails on jenkins
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Thu, 20 Jun 2024 00:02:12 +0000 (20:02 -0400)]
15814: Name test user consistently
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Wed, 19 Jun 2024 21:27:10 +0000 (17:27 -0400)]
15814: Fix sequencing for setupDockerImage
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Wed, 19 Jun 2024 21:22:41 +0000 (17:22 -0400)]
15814: Remove .only
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Wed, 19 Jun 2024 21:12:14 +0000 (17:12 -0400)]
15814: Add missing file
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Wed, 19 Jun 2024 21:03:24 +0000 (17:03 -0400)]
15814: Have FAIL_FAST default false unless interactive
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Wed, 19 Jun 2024 20:52:23 +0000 (16:52 -0400)]
15814: Add e2e test for workflows with secrets
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Wed, 19 Jun 2024 19:51:09 +0000 (15:51 -0400)]
15814: Add cypress fail fast and tweak some process tests
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Mon, 17 Jun 2024 21:25:00 +0000 (17:25 -0400)]
15814: Secret inputs now render as password inputs
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Mon, 17 Jun 2024 20:57:12 +0000 (16:57 -0400)]
15814: Now handles secret inputs properly.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Mon, 17 Jun 2024 19:27:42 +0000 (15:27 -0400)]
15814: Fix "secret store only accepts strings" error
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Stephen Smith [Mon, 24 Jun 2024 18:02:49 +0000 (14:02 -0400)]
Merge branch '21925-progress-bar-useeffect-fix' into main. Closes #21925
Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>
Tom Clegg [Mon, 24 Jun 2024 15:41:02 +0000 (11:41 -0400)]
20640: Add iter_computed_permissions.
Add explicit key_fields argument to keyset_list_all() instead of
modifying behavior automatically based on API responses.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 24 Jun 2024 02:17:39 +0000 (22:17 -0400)]
21703: Merge branch 'main' into 21703-collection-update-lock
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Sun, 23 Jun 2024 23:50:54 +0000 (19:50 -0400)]
21703: Test trash_sweep for both active and inactive uuid_locks.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Sun, 23 Jun 2024 12:52:34 +0000 (08:52 -0400)]
21891: Skip extra serialization step.
In copy-by-reference, copy everything to one collfs, instead of
copying each subcollection to its own temporary collfs, concatenating
the manifests, and then loading that into a new collfs.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Sun, 23 Jun 2024 01:31:05 +0000 (21:31 -0400)]
21891: Use collectionfs Snapshot/Splice instead of Extract.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Sun, 23 Jun 2024 13:32:38 +0000 (09:32 -0400)]
21891: Use bytes.Buffer to reduce string copies.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Sun, 23 Jun 2024 00:48:46 +0000 (20:48 -0400)]
21891: Test copier with a large collection.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Sun, 23 Jun 2024 12:52:38 +0000 (08:52 -0400)]
21891: Update test to accept singularity 4.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Stephen Smith [Fri, 21 Jun 2024 20:50:52 +0000 (16:50 -0400)]
21925: Add resources to fake store for progress bar unit tests
Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>
Stephen Smith [Fri, 21 Jun 2024 18:18:30 +0000 (14:18 -0400)]
21925: Don't pass full resource to progress bar useEffect to stop request spam
* Changes progress bar fetch to accept UUID
* Split polling flag into 2 for process and project
* Fetch method now only returns polling flag for projects
* The previous changes for project support switched to updating isRunning
in the fetch action where it would use the store for processes and progress
counts for projects
* This resulted in polling not starting if a draft process is already open
when started since it would only update if already polling
* This new approach uses the store (including WS updates) for processes and
polling-based updates for projects
* Splitting these up also allows eliminating an extra refresh when project
polling stops while keeping a final refresh when websocket updates a process
to stopped
* Added comments and better type guards
Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>
projects / arvados.git / log