arvados.git
3 months ago22005: Add Etag to s3 response header. 22005-s3-etag
Tom Clegg [Tue, 23 Jul 2024 12:06:43 +0000 (08:06 -0400)]
22005: Add Etag to s3 response header.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 months agoMerge branch '21978-replace-files-docs'
Tom Clegg [Mon, 22 Jul 2024 18:51:44 +0000 (14:51 -0400)]
Merge branch '21978-replace-files-docs'

closes #21978

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 months agoProvide more guidance for using arvbox the first time.
Peter Amstutz [Fri, 12 Jul 2024 15:41:57 +0000 (11:41 -0400)]
Provide more guidance for using arvbox the first time.

When arvbox is ready, now provides more information about things that
need to be done before you log in to arvbox workbench.

Also add a workbench banner with text and links to the Arvados docs,
based on the playground banner.

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 months ago21978: Streamline replace_files cross-reference markup 21978-replace-files-docs
Brett Smith [Mon, 22 Jul 2024 15:29:03 +0000 (11:29 -0400)]
21978: Streamline replace_files cross-reference markup

If we're linking to the section anyway, we can use less words and not
worry about whether it's "above" or "below."

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

3 months ago21978: Broaden replace_files argument summary to match new features.
Tom Clegg [Mon, 22 Jul 2024 14:03:41 +0000 (10:03 -0400)]
21978: Broaden replace_files argument summary to match new features.

Also update "below" to "above" in text, to match the current location
of the replace_files section on the page.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 months ago21978: Note replace_files usage restrictions re federated clusters.
Tom Clegg [Mon, 22 Jul 2024 14:00:19 +0000 (10:00 -0400)]
21978: Note replace_files usage restrictions re federated clusters.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 months agoMerge branch '21907-cache-s3-token'
Brett Smith [Fri, 19 Jul 2024 19:39:31 +0000 (15:39 -0400)]
Merge branch '21907-cache-s3-token'

Closes #21907.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

3 months ago21907: Rename s3SecretCacheTidyInterval 21907-cache-s3-token
Brett Smith [Fri, 19 Jul 2024 17:23:41 +0000 (13:23 -0400)]
21907: Rename s3SecretCacheTidyInterval

For improved clarity.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

3 months ago21907: Make new functions and methods private
Brett Smith [Fri, 19 Jul 2024 17:23:22 +0000 (13:23 -0400)]
21907: Make new functions and methods private

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

3 months ago21907: Use an APIClientAuthorization pointer directly
Brett Smith [Fri, 19 Jul 2024 17:18:59 +0000 (13:18 -0400)]
21907: Use an APIClientAuthorization pointer directly

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

3 months ago21907: Lock mutex when looking up cached S3 secrets
Brett Smith [Fri, 19 Jul 2024 17:17:35 +0000 (13:17 -0400)]
21907: Lock mutex when looking up cached S3 secrets

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

3 months ago21907: Cache valid S3 secrets in keep-web
Brett Smith [Thu, 18 Jul 2024 20:32:47 +0000 (16:32 -0400)]
21907: Cache valid S3 secrets in keep-web

This improves performance by avoiding a call to
/arvados/v1/api_client_authorizations on each request.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

3 months agoMerge branch '22001-run-tests-py3'
Brett Smith [Wed, 17 Jul 2024 14:05:49 +0000 (10:05 -0400)]
Merge branch '22001-run-tests-py3'

Closes #22001.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

3 months ago22001: Install PySDK earlier in run-tests.sh 22001-run-tests-py3
Brett Smith [Wed, 17 Jul 2024 13:00:50 +0000 (09:00 -0400)]
22001: Install PySDK earlier in run-tests.sh

See comments for rationale.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

3 months ago22001: Run arvados_version.py before `pip install`
Brett Smith [Mon, 15 Jul 2024 20:16:41 +0000 (16:16 -0400)]
22001: Run arvados_version.py before `pip install`

Otherwise `pip install` may package and try to install source that
doesn't include _version.py.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

3 months ago22001: Simplify virtualenv management in run-tests
Brett Smith [Mon, 15 Jul 2024 19:12:18 +0000 (15:12 -0400)]
22001: Simplify virtualenv management in run-tests

A lot of the current virtualenv management code is parameterized,
probably to able to support virtualenvs for Python 2 and 3 in
parallel. Since we don't need that anymore, remove all this code to
simplify the script.

* initialize() calls setup_virtualenv(), which ensures the virtualenv
  exists and then activates it. Everything else in the script can assume
  this is done.
* install_env() installs the Python build tools and support libraries
  we need.
* install_deps() installs our Python modules that are used by other
  components in Arvados.

With all this, there should be no need for regular virtualenv
de/reactivation.

Various old incantations meant to work around old setuptools/pip bugs
got cleaned up as part of this too.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

3 months ago22001: Remove :py3 suffix from tests
Brett Smith [Mon, 15 Jul 2024 14:39:00 +0000 (10:39 -0400)]
22001: Remove :py3 suffix from tests

We haven't supported Python 2 for a while, so requiring the user to
specify just demands extra typing for no reason.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

3 months ago21974: Remove CentOS discussion from Arvados 3.0 release notes
Brett Smith [Fri, 12 Jul 2024 14:03:49 +0000 (10:03 -0400)]
21974: Remove CentOS discussion from Arvados 3.0 release notes

Redundant since this support was removed in Arvados 2.7.4.
Refs #21974.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

4 months agoFix a couple of upgrade note typos.
Peter Amstutz [Mon, 8 Jul 2024 21:50:13 +0000 (17:50 -0400)]
Fix a couple of upgrade note typos.

refs #21947

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months agoSynchronize upgrade notes between 2.7 branch and main
Peter Amstutz [Mon, 8 Jul 2024 21:46:06 +0000 (17:46 -0400)]
Synchronize upgrade notes between 2.7 branch and main

refs #21947

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months agoMerge branch '21989-headers'
Tom Clegg [Mon, 8 Jul 2024 15:52:49 +0000 (11:52 -0400)]
Merge branch '21989-headers'

fixes #21989

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21989: Fix order-sensitive test. 21989-headers
Tom Clegg [Mon, 8 Jul 2024 15:21:59 +0000 (11:21 -0400)]
21989: Fix order-sensitive test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21989: Keepstore: Use comma separator for X-Keep-Storage-Classes-Confirmed header
Zoë Ma [Mon, 8 Jul 2024 07:15:26 +0000 (15:15 +0800)]
21989: Keepstore: Use comma separator for X-Keep-Storage-Classes-Confirmed header

When generating the X-Keep-Storage-Classes-Confirmed header, use comma
(",") instead of semicolon (";") as the separator for multi-entry value.

This is to be consistent with keep-proxy's behavior and the arv-put
client's expectation. Plus, it follows RFC 9110 (see sec. 5.2).

Without the fix, arv-put wrongly believes that storage classes are not
supported on the cluster it is putting to. The spurious warning
"X-Keep-Storage-Classes header not supported by the cluster" can be seen
in arv-put messages and in Workbench2.

Arvados-DCO-1.1-Signed-off-by: Zoë Ma <zoe.ma@curii.com>

4 months agoMerge branch '21931-public-suffix-pin'
Brett Smith [Wed, 3 Jul 2024 18:43:23 +0000 (14:43 -0400)]
Merge branch '21931-public-suffix-pin'

Refs #21931.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

4 months agoMerge branch '21701-replace-files-current-version'
Tom Clegg [Wed, 3 Jul 2024 13:38:08 +0000 (09:38 -0400)]
Merge branch '21701-replace-files-current-version'

refs #21701

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21931: Revert net-imap dependency 21931-public-suffix-pin
Brett Smith [Tue, 2 Jul 2024 17:45:08 +0000 (13:45 -0400)]
21931: Revert net-imap dependency

This was updated as part of #21933 in
9167b2053ef2a39a4e8a7c13e4127e12470b14ed.
However, net-imap 0.4 requires Ruby > 2.7.3, while Ubuntu 20.04 only
ships with Ruby 2.7.0. Upgrading this gem doesn't seem to be required
for the new Rails release, so don't.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

4 months ago21931: Narrow public_suffix dependency for arvados-google-api-client gem
Brett Smith [Tue, 2 Jul 2024 16:09:40 +0000 (12:09 -0400)]
21931: Narrow public_suffix dependency for arvados-google-api-client gem

For the usual reason: to force `gem install` to resolve dependencies in
a way that works on Ruby 2.7.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

4 months agoMerge branch 'jszlenk/create_new_subproject' refs #21937
Peter Amstutz [Tue, 2 Jul 2024 17:18:59 +0000 (13:18 -0400)]
Merge branch 'jszlenk/create_new_subproject' refs #21937

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months agoMerge branch '21934-python36-compat'
Brett Smith [Mon, 1 Jul 2024 19:18:50 +0000 (15:18 -0400)]
Merge branch '21934-python36-compat'

Refs #21934.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

4 months ago21934: Avoid using subprocess.run capture_output for Py3.6 compatibility
Brett Smith [Thu, 27 Jun 2024 19:45:11 +0000 (15:45 -0400)]
21934: Avoid using subprocess.run capture_output for Py3.6 compatibility

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

4 months ago21934: Use older name of ssl.CertificateError
Brett Smith [Thu, 27 Jun 2024 19:10:55 +0000 (15:10 -0400)]
21934: Use older name of ssl.CertificateError

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

4 months ago21934: Set explicit cache_max in test_disk_cache_retry_write_error
Brett Smith [Thu, 27 Jun 2024 19:05:45 +0000 (15:05 -0400)]
21934: Set explicit cache_max in test_disk_cache_retry_write_error

Without this, the test might fail if /tmp is small and the initially
calculated cache_max is already at the floor.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

4 months ago21934: Use assertGreater
Brett Smith [Thu, 27 Jun 2024 18:56:34 +0000 (14:56 -0400)]
21934: Use assertGreater

To improve diagnostics if the test fails.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

4 months ago21934: Autospec mmap mocks
Brett Smith [Thu, 27 Jun 2024 18:43:45 +0000 (14:43 -0400)]
21934: Autospec mmap mocks

So attribute checks get the right result.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

4 months agoMerge branch '21764-project-picker-crash' into main. Closes #21764
Stephen Smith [Mon, 1 Jul 2024 16:09:09 +0000 (12:09 -0400)]
Merge branch '21764-project-picker-crash' into main. Closes #21764

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

4 months agoMerge branch '15814-wb2-secrets' refs #15814
Peter Amstutz [Mon, 1 Jul 2024 15:45:34 +0000 (11:45 -0400)]
Merge branch '15814-wb2-secrets' refs #15814

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months ago21701: Reword examples, add h4 headings and IDs. 21701-replace-files-current-version
Tom Clegg [Mon, 1 Jul 2024 15:28:06 +0000 (11:28 -0400)]
21701: Reword examples, add h4 headings and IDs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21701: Use <PDH> to distinguish literal strings from placeholders.
Tom Clegg [Mon, 1 Jul 2024 15:26:56 +0000 (11:26 -0400)]
21701: Use <PDH> to distinguish literal strings from placeholders.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago15814: Fix runtime typecheck error 15814-wb2-secrets
Peter Amstutz [Mon, 1 Jul 2024 14:44:50 +0000 (10:44 -0400)]
15814: Fix runtime typecheck error

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months ago21701: Update comments.
Tom Clegg [Mon, 1 Jul 2024 14:11:03 +0000 (10:11 -0400)]
21701: Update comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months agoMerge branch 'main' into 15814-wb2-secrets
Peter Amstutz [Mon, 1 Jul 2024 14:10:28 +0000 (10:10 -0400)]
Merge branch 'main' into 15814-wb2-secrets

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months agoMerge branch '20640-computed-permissions-api'
Tom Clegg [Mon, 1 Jul 2024 13:57:59 +0000 (09:57 -0400)]
Merge branch '20640-computed-permissions-api'

closes #20640

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20640: Merge branch 'main' into 20640-computed-permissions-api 20640-computed-permissions-api
Tom Clegg [Fri, 28 Jun 2024 23:09:22 +0000 (19:09 -0400)]
20640: Merge branch 'main' into 20640-computed-permissions-api

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20640: Fix obfuscated asserts.
Tom Clegg [Fri, 28 Jun 2024 19:48:59 +0000 (15:48 -0400)]
20640: Fix obfuscated asserts.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21764: Consolidate tree node extraction to be reused for tests, add TreePicker unit... 21764-project-picker-crash
Stephen Smith [Fri, 28 Jun 2024 15:22:30 +0000 (11:22 -0400)]
21764: Consolidate tree node extraction to be reused for tests, add TreePicker unit tests

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

4 months ago21764: Add more type safety to TreePicker
Stephen Smith [Fri, 28 Jun 2024 15:21:01 +0000 (11:21 -0400)]
21764: Add more type safety to TreePicker

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

4 months ago21764: Add better type safety to TreePicker and handle empty string name
Stephen Smith [Fri, 28 Jun 2024 15:16:27 +0000 (11:16 -0400)]
21764: Add better type safety to TreePicker and handle empty string name

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

4 months ago21764: Preload cypress in wb2 build docker and start cypress as e2e by default
Stephen Smith [Wed, 19 Jun 2024 15:48:18 +0000 (11:48 -0400)]
21764: Preload cypress in wb2 build docker and start cypress as e2e by default

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

4 months ago15814: Specifically communicate secrets cannot be displayed
Peter Amstutz [Thu, 27 Jun 2024 19:18:02 +0000 (15:18 -0400)]
15814: Specifically communicate secrets cannot be displayed

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months ago21701: Reject requests with unused non-empty manifest_text.
Tom Clegg [Thu, 27 Jun 2024 18:26:23 +0000 (14:26 -0400)]
21701: Reject requests with unused non-empty manifest_text.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months agoAdd locales and unzip to install deps
Brett Smith [Thu, 27 Jun 2024 16:10:01 +0000 (12:10 -0400)]
Add locales and unzip to install deps

Commands from both these packages are used directly by `arvados-server install`.
No issue #.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

4 months ago15814: Simplify conditionals
Peter Amstutz [Thu, 27 Jun 2024 15:29:31 +0000 (11:29 -0400)]
15814: Simplify conditionals

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months ago15814: Fix tabs -> spaces
Peter Amstutz [Thu, 27 Jun 2024 15:26:41 +0000 (11:26 -0400)]
15814: Fix tabs -> spaces

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months ago21701: Bump API revision.
Tom Clegg [Thu, 27 Jun 2024 14:16:38 +0000 (10:16 -0400)]
21701: Bump API revision.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21701: Wordsmith.
Tom Clegg [Thu, 27 Jun 2024 14:02:25 +0000 (10:02 -0400)]
21701: Wordsmith.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21701: Update replace_files API docs.
Tom Clegg [Thu, 27 Jun 2024 13:54:57 +0000 (09:54 -0400)]
21701: Update replace_files API docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21701: Accept "manifest_text" and "current" replace_files sources.
Tom Clegg [Wed, 26 Jun 2024 21:37:53 +0000 (17:37 -0400)]
21701: Accept "manifest_text" and "current" replace_files sources.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21701: Test replace_files using provided manifest_text as source.
Tom Clegg [Wed, 26 Jun 2024 21:36:53 +0000 (17:36 -0400)]
21701: Test replace_files using provided manifest_text as source.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21701: Test concurrent replace_files operations.
Tom Clegg [Wed, 26 Jun 2024 20:00:33 +0000 (16:00 -0400)]
21701: Test concurrent replace_files operations.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months agoMerge branch '21933-deps-upgrade'
Lucas Di Pentima [Tue, 25 Jun 2024 20:54:28 +0000 (17:54 -0300)]
Merge branch '21933-deps-upgrade'

closes #21933

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

4 months agoMerge branch '21891-output-copying-performance'
Tom Clegg [Tue, 25 Jun 2024 20:28:13 +0000 (16:28 -0400)]
Merge branch '21891-output-copying-performance'

fixes #21891

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21891: Comment to explain mysterious numbers 13 and 17 in test case.
Tom Clegg [Tue, 25 Jun 2024 20:27:25 +0000 (16:27 -0400)]
21891: Comment to explain mysterious numbers 13 and 17 in test case.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20640: Update docstring to clarify usage and link to list method.
Tom Clegg [Tue, 25 Jun 2024 19:25:55 +0000 (15:25 -0400)]
20640: Update docstring to clarify usage and link to list method.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20640: Make test parameterization more readable.
Tom Clegg [Tue, 25 Jun 2024 17:44:43 +0000 (13:44 -0400)]
20640: Make test parameterization more readable.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21933: Replaces gopkg.in/square/go-jose.v2 to address CVE-2024-28180 21933-deps-upgrade
Lucas Di Pentima [Tue, 25 Jun 2024 20:17:48 +0000 (17:17 -0300)]
21933: Replaces gopkg.in/square/go-jose.v2 to address CVE-2024-28180

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

4 months ago21933: Upgrades rails to 7.0.8.4 to address CVE-2024-28103
Lucas Di Pentima [Tue, 25 Jun 2024 19:36:17 +0000 (16:36 -0300)]
21933: Upgrades rails to 7.0.8.4 to address CVE-2024-28103

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

4 months ago21933: Upgrades github.com/hashicorp/go-retryablehttp to address CVE-2024-6104
Lucas Di Pentima [Tue, 25 Jun 2024 19:30:02 +0000 (16:30 -0300)]
21933: Upgrades github.com/hashicorp/go-retryablehttp to address CVE-2024-6104

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

4 months ago20640: Simplify 'select' munging.
Tom Clegg [Tue, 25 Jun 2024 17:44:20 +0000 (13:44 -0400)]
20640: Simplify 'select' munging.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20640: Change key_fields to a Container, since order doesn't matter.
Tom Clegg [Tue, 25 Jun 2024 17:44:00 +0000 (13:44 -0400)]
20640: Change key_fields to a Container, since order doesn't matter.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20640: Fix iter_computed_permissions args not being propagated.
Tom Clegg [Tue, 25 Jun 2024 15:04:24 +0000 (11:04 -0400)]
20640: Fix iter_computed_permissions args not being propagated.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20640: Fix secondary sort column (use tiebreak_key, not 'uuid').
Tom Clegg [Tue, 25 Jun 2024 15:03:41 +0000 (11:03 -0400)]
20640: Fix secondary sort column (use tiebreak_key, not 'uuid').

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20640: Add iter_computed_permissions tests.
Tom Clegg [Tue, 25 Jun 2024 15:03:16 +0000 (11:03 -0400)]
20640: Add iter_computed_permissions tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months agoMerge branch '21703-collection-update-lock'
Tom Clegg [Mon, 24 Jun 2024 18:45:46 +0000 (14:45 -0400)]
Merge branch '21703-collection-update-lock'

closes #21703

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21703: Improve test failure reporting.
Tom Clegg [Mon, 24 Jun 2024 18:43:46 +0000 (14:43 -0400)]
21703: Improve test failure reporting.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21703: Fix unlogged exception.
Tom Clegg [Mon, 24 Jun 2024 18:41:41 +0000 (14:41 -0400)]
21703: Fix unlogged exception.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21891: Remove unused sdk/go/manifest package and ManifestFileReader. 21891-output-copying-performance
Tom Clegg [Mon, 24 Jun 2024 18:31:12 +0000 (14:31 -0400)]
21891: Remove unused sdk/go/manifest package and ManifestFileReader.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago15814: Catch error that otherwise goes unhandled
Peter Amstutz [Thu, 20 Jun 2024 21:05:17 +0000 (17:05 -0400)]
15814: Catch error that otherwise goes unhandled

Running into this with some tests, during teardown.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months ago15814: Fix request intercepts that assume certain field in response
Peter Amstutz [Thu, 20 Jun 2024 19:28:52 +0000 (15:28 -0400)]
15814: Fix request intercepts that assume certain field in response

During teardown, the intercept is still active but requests may return
404 from upstream, causing the intercept that modifies the reponse to fail.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months ago15814: Fix unit test, trying to figure out test that only fails on jenkins
Peter Amstutz [Thu, 20 Jun 2024 18:37:22 +0000 (14:37 -0400)]
15814: Fix unit test, trying to figure out test that only fails on jenkins

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months ago15814: Name test user consistently
Peter Amstutz [Thu, 20 Jun 2024 00:02:12 +0000 (20:02 -0400)]
15814: Name test user consistently

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months ago15814: Fix sequencing for setupDockerImage
Peter Amstutz [Wed, 19 Jun 2024 21:27:10 +0000 (17:27 -0400)]
15814: Fix sequencing for setupDockerImage

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months ago15814: Remove .only
Peter Amstutz [Wed, 19 Jun 2024 21:22:41 +0000 (17:22 -0400)]
15814: Remove .only

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months ago15814: Add missing file
Peter Amstutz [Wed, 19 Jun 2024 21:12:14 +0000 (17:12 -0400)]
15814: Add missing file

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months ago15814: Have FAIL_FAST default false unless interactive
Peter Amstutz [Wed, 19 Jun 2024 21:03:24 +0000 (17:03 -0400)]
15814: Have FAIL_FAST default false unless interactive

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months ago15814: Add e2e test for workflows with secrets
Peter Amstutz [Wed, 19 Jun 2024 20:52:23 +0000 (16:52 -0400)]
15814: Add e2e test for workflows with secrets

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months ago15814: Add cypress fail fast and tweak some process tests
Peter Amstutz [Wed, 19 Jun 2024 19:51:09 +0000 (15:51 -0400)]
15814: Add cypress fail fast and tweak some process tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months ago15814: Secret inputs now render as password inputs
Peter Amstutz [Mon, 17 Jun 2024 21:25:00 +0000 (17:25 -0400)]
15814: Secret inputs now render as password inputs

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months ago15814: Now handles secret inputs properly.
Peter Amstutz [Mon, 17 Jun 2024 20:57:12 +0000 (16:57 -0400)]
15814: Now handles secret inputs properly.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months ago15814: Fix "secret store only accepts strings" error
Peter Amstutz [Mon, 17 Jun 2024 19:27:42 +0000 (15:27 -0400)]
15814: Fix "secret store only accepts strings" error

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months agoMerge branch '21925-progress-bar-useeffect-fix' into main. Closes #21925
Stephen Smith [Mon, 24 Jun 2024 18:02:49 +0000 (14:02 -0400)]
Merge branch '21925-progress-bar-useeffect-fix' into main. Closes #21925

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

4 months ago20640: Add iter_computed_permissions.
Tom Clegg [Mon, 24 Jun 2024 15:41:02 +0000 (11:41 -0400)]
20640: Add iter_computed_permissions.

Add explicit key_fields argument to keyset_list_all() instead of
modifying behavior automatically based on API responses.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21703: Merge branch 'main' into 21703-collection-update-lock 21703-collection-update-lock
Tom Clegg [Mon, 24 Jun 2024 02:17:39 +0000 (22:17 -0400)]
21703: Merge branch 'main' into 21703-collection-update-lock

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21703: Test trash_sweep for both active and inactive uuid_locks.
Tom Clegg [Sun, 23 Jun 2024 23:50:54 +0000 (19:50 -0400)]
21703: Test trash_sweep for both active and inactive uuid_locks.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21891: Skip extra serialization step.
Tom Clegg [Sun, 23 Jun 2024 12:52:34 +0000 (08:52 -0400)]
21891: Skip extra serialization step.

In copy-by-reference, copy everything to one collfs, instead of
copying each subcollection to its own temporary collfs, concatenating
the manifests, and then loading that into a new collfs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21891: Use collectionfs Snapshot/Splice instead of Extract.
Tom Clegg [Sun, 23 Jun 2024 01:31:05 +0000 (21:31 -0400)]
21891: Use collectionfs Snapshot/Splice instead of Extract.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21891: Use bytes.Buffer to reduce string copies.
Tom Clegg [Sun, 23 Jun 2024 13:32:38 +0000 (09:32 -0400)]
21891: Use bytes.Buffer to reduce string copies.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21891: Test copier with a large collection.
Tom Clegg [Sun, 23 Jun 2024 00:48:46 +0000 (20:48 -0400)]
21891: Test copier with a large collection.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21891: Update test to accept singularity 4.
Tom Clegg [Sun, 23 Jun 2024 12:52:38 +0000 (08:52 -0400)]
21891: Update test to accept singularity 4.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21925: Add resources to fake store for progress bar unit tests 21925-progress-bar-useeffect-fix
Stephen Smith [Fri, 21 Jun 2024 20:50:52 +0000 (16:50 -0400)]
21925: Add resources to fake store for progress bar unit tests

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

4 months ago21925: Don't pass full resource to progress bar useEffect to stop request spam
Stephen Smith [Fri, 21 Jun 2024 18:18:30 +0000 (14:18 -0400)]
21925: Don't pass full resource to progress bar useEffect to stop request spam

* Changes progress bar fetch to accept UUID
* Split polling flag into 2 for process and project
  * Fetch method now only returns polling flag for projects
  * The previous changes for project support switched to updating isRunning
    in the fetch action where it would use the store for processes and progress
    counts for projects
  * This resulted in polling not starting if a draft process is already open
    when started since it would only update if already polling
  * This new approach uses the store (including WS updates) for processes and
    polling-based updates for projects
  * Splitting these up also allows eliminating an extra refresh when project
    polling stops while keeping a final refresh when websocket updates a process
    to stopped
* Added comments and better type guards

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>