arvados.git
3 months ago20318: Fix settled condition.
Tom Clegg [Thu, 11 Jan 2024 18:10:47 +0000 (13:10 -0500)]
20318: Fix settled condition.

Intention was to stop iterating when *all* of the keepstore servers
need 0 pulls, but the code as written stops on the N>1st iteration
when *any* of the keepstore servers need 0 pulls. This caused a false
negative when it took more than one iteration for keepstore to
complete the requested pulls.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 months ago20318: Clean up some gocheck usage: Equals, Nil -> IsNil
Tom Clegg [Thu, 11 Jan 2024 18:10:22 +0000 (13:10 -0500)]
20318: Clean up some gocheck usage: Equals, Nil -> IsNil

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 months ago20318: Route (*KeepClient)Get() through disk cache layer.
Tom Clegg [Thu, 11 Jan 2024 17:01:11 +0000 (12:01 -0500)]
20318: Route (*KeepClient)Get() through disk cache layer.

The updated implementation maintains the existing calling signature
but has some semantic differences:

The block size returned by Get is now -1 if the block size is not
indicated by the supplied locator. All locators generated by Arvados
include sizes, and Get() doesn't work on bare hashes because they have
no permission signature, so in practice this only comes up for test
cases and keepstore's pull worker.

The url returned by Get is now "" because
* in general it is not necessarily available in principle (data often
  comes from the cache instead of a backend server)
* in the cases where it is available in principle, it would be a lot
  of trouble to propagate it
* the only known reason to reveal the url is to provide detail about
  an error, in which case the error message should already include the
  relevant url.

In some cases where the upstream server responds 200 but an error is
detected early in the response content, Get() now returns the error
itself, where the old Get() implementation would have returned a
reader whose Read method returns an error.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 months ago20318: Fix DiskCacheSize not propagated by (*KeepClient)Clone().
Tom Clegg [Thu, 11 Jan 2024 16:49:42 +0000 (11:49 -0500)]
20318: Fix DiskCacheSize not propagated by (*KeepClient)Clone().

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 months ago20318: Bypass disk cache in certain tests, keepstore, and keepproxy.
Tom Clegg [Thu, 11 Jan 2024 16:48:28 +0000 (11:48 -0500)]
20318: Bypass disk cache in certain tests, keepstore, and keepproxy.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 months ago20318: Propagate Close error from http backend.
Tom Clegg [Thu, 11 Jan 2024 16:45:10 +0000 (11:45 -0500)]
20318: Propagate Close error from http backend.

This isn't known to happen, but if it does, it should propagate.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 months ago20318: Fix BadChecksum error not propagated through cache layer.
Tom Clegg [Thu, 11 Jan 2024 16:22:27 +0000 (11:22 -0500)]
20318: Fix BadChecksum error not propagated through cache layer.

Previously, ReadAt would not return an error as long as enough bytes
were read, because the error might mean the read was truncated after
the point needed for the current read. This had the unintended
consequence that even a BadChecksum error returned on the final read
would not be propagated.

The updated version propagates errors even if the requested bytes were
retrieved, so the only case where a bad checksum error can be
undetected is when the read does not reach the end of the block *and*
the block has not been fully retrieved yet.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 months ago20318: Remove redundant WriteTo case already handled by io.Copy.
Tom Clegg [Thu, 11 Jan 2024 16:21:58 +0000 (11:21 -0500)]
20318: Remove redundant WriteTo case already handled by io.Copy.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 months ago20318: Fix bad compare / short read behavior in DiskCache BlockRead.
Tom Clegg [Tue, 9 Jan 2024 21:59:21 +0000 (16:59 -0500)]
20318: Fix bad compare / short read behavior in DiskCache BlockRead.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

3 months ago20318: Add comments about KeepClient/KeepGateway wiring.
Tom Clegg [Mon, 8 Jan 2024 16:37:53 +0000 (11:37 -0500)]
20318: Add comments about KeepClient/KeepGateway wiring.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Fix nil pointer usage.
Tom Clegg [Fri, 5 Jan 2024 20:40:04 +0000 (15:40 -0500)]
20318: Fix nil pointer usage.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Update stale comment.
Tom Clegg [Fri, 5 Jan 2024 20:33:38 +0000 (15:33 -0500)]
20318: Update stale comment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Note no-op defers in comments.
Tom Clegg [Fri, 5 Jan 2024 20:33:26 +0000 (15:33 -0500)]
20318: Note no-op defers in comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Add install/upgrade notes about /var/cache.
Tom Clegg [Thu, 28 Dec 2023 20:40:14 +0000 (15:40 -0500)]
20318: Add install/upgrade notes about /var/cache.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Sync cache state after 1% churn instead of 5 minute timer.
Tom Clegg [Thu, 28 Dec 2023 19:13:24 +0000 (14:13 -0500)]
20318: Sync cache state after 1% churn instead of 5 minute timer.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Ensure empty cache for test case.
Tom Clegg [Tue, 26 Dec 2023 21:52:11 +0000 (16:52 -0500)]
20318: Ensure empty cache for test case.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Add -cache-size flag to arvados-client mount.
Tom Clegg [Tue, 26 Dec 2023 20:44:12 +0000 (15:44 -0500)]
20318: Add -cache-size flag to arvados-client mount.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Fix shared var in test.
Tom Clegg [Tue, 26 Dec 2023 20:43:20 +0000 (15:43 -0500)]
20318: Fix shared var in test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Use one tidying goroutine and filehandle pool per cache dir.
Tom Clegg [Tue, 26 Dec 2023 20:16:28 +0000 (15:16 -0500)]
20318: Use one tidying goroutine and filehandle pool per cache dir.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Fix write using Reader and unspecified Hash.
Tom Clegg [Tue, 26 Dec 2023 17:25:34 +0000 (12:25 -0500)]
20318: Fix write using Reader and unspecified Hash.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Add config entry for keep-web cache size.
Tom Clegg [Fri, 22 Dec 2023 16:11:51 +0000 (11:11 -0500)]
20318: Add config entry for keep-web cache size.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Merge branch 'main' into 20318-disk-cache
Tom Clegg [Wed, 20 Dec 2023 22:40:10 +0000 (17:40 -0500)]
20318: Merge branch 'main' into 20318-disk-cache

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Test hash check on block write.
Tom Clegg [Wed, 20 Dec 2023 19:37:28 +0000 (14:37 -0500)]
20318: Test hash check on block write.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Track estimated cache usage, and tidy more diligently.
Tom Clegg [Wed, 20 Dec 2023 18:33:56 +0000 (13:33 -0500)]
20318: Track estimated cache usage, and tidy more diligently.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Implement BlockRead via ReadAt so it supports streaming.
Tom Clegg [Wed, 20 Dec 2023 18:19:32 +0000 (13:19 -0500)]
20318: Implement BlockRead via ReadAt so it supports streaming.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Test streaming.
Tom Clegg [Wed, 20 Dec 2023 15:55:30 +0000 (10:55 -0500)]
20318: Test streaming.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Comment about error handling.
Tom Clegg [Wed, 20 Dec 2023 15:22:31 +0000 (10:22 -0500)]
20318: Comment about error handling.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Return requested range while fetching remainder of block.
Tom Clegg [Tue, 19 Dec 2023 21:48:58 +0000 (16:48 -0500)]
20318: Return requested range while fetching remainder of block.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Fix stuttering error message.
Tom Clegg [Tue, 19 Dec 2023 19:07:28 +0000 (14:07 -0500)]
20318: Fix stuttering error message.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Remove memory-backed keep block cache.
Tom Clegg [Tue, 19 Dec 2023 19:07:23 +0000 (14:07 -0500)]
20318: Remove memory-backed keep block cache.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Route KeepClient block writes through disk cache.
Tom Clegg [Tue, 19 Dec 2023 15:57:27 +0000 (10:57 -0500)]
20318: Route KeepClient block writes through disk cache.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Don't use memory-backed block cache for short reads.
Tom Clegg [Tue, 19 Dec 2023 15:47:05 +0000 (10:47 -0500)]
20318: Don't use memory-backed block cache for short reads.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months agoMerge branch '21309-x-crypto-upgrade'. Closes #21309
Lucas Di Pentima [Tue, 19 Dec 2023 16:17:13 +0000 (13:17 -0300)]
Merge branch '21309-x-crypto-upgrade'. Closes #21309

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

4 months ago21309: Upgrades golang.org/x/crypto dependency 21309-x-crypto-upgrade
Lucas Di Pentima [Tue, 19 Dec 2023 15:53:16 +0000 (12:53 -0300)]
21309: Upgrades golang.org/x/crypto dependency

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

4 months ago20318: Fail instead of reading through if cache dir is unusable.
Tom Clegg [Tue, 19 Dec 2023 15:07:36 +0000 (10:07 -0500)]
20318: Fail instead of reading through if cache dir is unusable.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Close held-open filehandles when deleting cache files.
Tom Clegg [Tue, 19 Dec 2023 01:59:31 +0000 (20:59 -0500)]
20318: Close held-open filehandles when deleting cache files.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Test mangling cache files while reading.
Tom Clegg [Tue, 19 Dec 2023 01:19:35 +0000 (20:19 -0500)]
20318: Test mangling cache files while reading.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Add concurrent and sequential read benchmarks.
Tom Clegg [Mon, 18 Dec 2023 23:45:51 +0000 (18:45 -0500)]
20318: Add concurrent and sequential read benchmarks.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months agoMerge branch '21254-test-race'
Tom Clegg [Mon, 18 Dec 2023 21:29:18 +0000 (16:29 -0500)]
Merge branch '21254-test-race'

fixes #21254

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months agoMerge branch '21214-dav-virtual-projects'
Tom Clegg [Mon, 18 Dec 2023 21:19:53 +0000 (16:19 -0500)]
Merge branch '21214-dav-virtual-projects'

fixes #21214

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21214: Note cycle detection/behavior on WebDAV doc page. 21214-dav-virtual-projects
Tom Clegg [Mon, 18 Dec 2023 20:33:40 +0000 (15:33 -0500)]
21214: Note cycle detection/behavior on WebDAV doc page.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21214: Include project/collection singletons in customfs MemorySize.
Tom Clegg [Mon, 18 Dec 2023 20:03:04 +0000 (15:03 -0500)]
21214: Include project/collection singletons in customfs MemorySize.

Previously, a hardlink returned its target's MemorySize, which
overreported the size of a tree in which a collection or project was
reachable by multiple paths.

Since 3d5a798ef6f4bd3b1a771bacdf0acf70edf6c1f5 a hardlink returns a
MemorySize reflecting only the hardlink itself, so the MemorySize of
the hardlink targets (project/collection singletons) needs to be added
explicitly by customFilesystem.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months agoMerge branch '21283-callable-api-module'
Brett Smith [Mon, 18 Dec 2023 18:48:50 +0000 (13:48 -0500)]
Merge branch '21283-callable-api-module'

Closes #21283.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

4 months agoMerge branch '21146-pysdk-new-websockets'
Brett Smith [Sat, 16 Dec 2023 20:05:50 +0000 (15:05 -0500)]
Merge branch '21146-pysdk-new-websockets'

Closes #21146, #19825.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

4 months ago20318: Try to keep cache files open for subsequent/concurrent reads.
Tom Clegg [Fri, 15 Dec 2023 01:17:04 +0000 (20:17 -0500)]
20318: Try to keep cache files open for subsequent/concurrent reads.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago20318: Use const for cache-tidy hold timer.
Tom Clegg [Fri, 15 Dec 2023 01:12:41 +0000 (20:12 -0500)]
20318: Use const for cache-tidy hold timer.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months agoRevert "Add require 'random', refs #20846"
Peter Amstutz [Thu, 14 Dec 2023 20:49:03 +0000 (15:49 -0500)]
Revert "Add require 'random', refs #20846"

This reverts commit e7ffa5492684992e4f08f793e6dbb526bcb6b6a1.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months agoarvbox updates for ruby and bundler, refs #21301
Peter Amstutz [Thu, 14 Dec 2023 20:16:12 +0000 (15:16 -0500)]
arvbox updates for ruby and bundler, refs #21301

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months agoAdd require 'random', refs #20846
Peter Amstutz [Thu, 14 Dec 2023 19:40:12 +0000 (14:40 -0500)]
Add require 'random', refs #20846

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months agoFix arvbox wb1 to wb2 redirects refs #20850
Peter Amstutz [Fri, 1 Sep 2023 21:20:32 +0000 (17:20 -0400)]
Fix arvbox wb1 to wb2 redirects refs #20850

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months agoFix release date of 2.7.1, refs #21089
Peter Amstutz [Tue, 12 Dec 2023 17:58:56 +0000 (12:58 -0500)]
Fix release date of 2.7.1, refs #21089

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months agoarvbox fixes, refs #21089
Peter Amstutz [Mon, 11 Dec 2023 14:29:42 +0000 (09:29 -0500)]
arvbox fixes, refs #21089

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 months ago21254: Split TestRunForever into timer- and signal-triggered tests. 21254-test-race
Tom Clegg [Wed, 13 Dec 2023 15:18:30 +0000 (10:18 -0500)]
21254: Split TestRunForever into timer- and signal-triggered tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months agoMerge branch '21254-test-race'
Tom Clegg [Wed, 13 Dec 2023 14:39:12 +0000 (09:39 -0500)]
Merge branch '21254-test-race'

refs #21254

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21214: Fix lookup of file with trailing slash.
Tom Clegg [Wed, 13 Dec 2023 00:03:58 +0000 (19:03 -0500)]
21214: Fix lookup of file with trailing slash.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21214: Permit filter groups to match filter groups but avoid cycles.
Tom Clegg [Tue, 12 Dec 2023 16:27:27 +0000 (11:27 -0500)]
21214: Permit filter groups to match filter groups but avoid cycles.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months agoMerge branch '21277-github-pr-221'
Brett Smith [Tue, 12 Dec 2023 13:54:51 +0000 (08:54 -0500)]
Merge branch '21277-github-pr-221'

Closes #21277.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

4 months agoMerge branch '21206-ws-requesting-container-uuid'
Tom Clegg [Mon, 11 Dec 2023 17:33:21 +0000 (12:33 -0500)]
Merge branch '21206-ws-requesting-container-uuid'

refs #21206

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months agoMerge branch '21204-stable-log-sort-from-wb2-repo' into main. Closes #21204
Stephen Smith [Mon, 11 Dec 2023 17:25:43 +0000 (12:25 -0500)]
Merge branch '21204-stable-log-sort-from-wb2-repo' into main. Closes #21204

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

4 months ago21204: Merge branch '21204-stable-log-sort' from arvados-workbench2.git 21204-stable-log-sort-from-wb2-repo
Stephen Smith [Mon, 11 Dec 2023 17:24:21 +0000 (12:24 -0500)]
21204: Merge branch '21204-stable-log-sort' from arvados-workbench2.git

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

4 months ago21214: Include filter groups in sitefs.
Tom Clegg [Mon, 11 Dec 2023 15:22:30 +0000 (10:22 -0500)]
21214: Include filter groups in sitefs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months ago21204: Add test for stable log line sort
Stephen Smith [Mon, 11 Dec 2023 15:00:43 +0000 (10:00 -0500)]
21204: Add test for stable log line sort

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

4 months ago21204: Change log sorter to preserve ordering of same-timestamped lines of a
Stephen Smith [Mon, 11 Dec 2023 14:59:59 +0000 (09:59 -0500)]
21204: Change log sorter to preserve ordering of same-timestamped lines of a
single type

Arvados-DCO-1.1-Signed-off-by: Stephen Smith <stephen@curii.com>

4 months ago21283: Make arvados.api.__call__ a staticmethod 21283-callable-api-module
Brett Smith [Mon, 11 Dec 2023 14:29:56 +0000 (09:29 -0500)]
21283: Make arvados.api.__call__ a staticmethod

This gives it a more helpful signature and docstring with less code.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

4 months ago21283: Make arvados.api a callable module
Brett Smith [Mon, 11 Dec 2023 00:23:00 +0000 (19:23 -0500)]
21283: Make arvados.api a callable module

See comments for rationale and implementation discussion.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

4 months ago21214: Prevent filter groups from matching other/same filter groups.
Tom Clegg [Sat, 9 Dec 2023 20:56:10 +0000 (15:56 -0500)]
21214: Prevent filter groups from matching other/same filter groups.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

4 months agoAdd option to upload InputStream to KeepWebApi 21277-github-pr-221
Krzysztof Majewski [Fri, 8 Dec 2023 09:43:54 +0000 (10:43 +0100)]
Add option to upload InputStream to KeepWebApi

Arvados-DCO-1.1-Signed-off-by: Krzysztof Majewski majewski.kielce@gmail.com

5 months agoFix coreui version dependency, refs #21089
Peter Amstutz [Thu, 7 Dec 2023 19:14:51 +0000 (14:14 -0500)]
Fix coreui version dependency, refs #21089

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

5 months ago21254: Fix racy keep-balance test.
Tom Clegg [Thu, 7 Dec 2023 19:01:09 +0000 (14:01 -0500)]
21254: Fix racy keep-balance test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months agoPass in VERSION, MAINTAINER and DESCRIPTION, refs #21089
Peter Amstutz [Thu, 7 Dec 2023 17:53:50 +0000 (12:53 -0500)]
Pass in VERSION, MAINTAINER and DESCRIPTION, refs #21089

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

5 months agoMerge branch '21258-flaky-adc-test'
Tom Clegg [Thu, 7 Dec 2023 16:27:44 +0000 (11:27 -0500)]
Merge branch '21258-flaky-adc-test'

fixes #21258

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months agoFix branch checkout in the build Docker image, refs #21089
Peter Amstutz [Wed, 6 Dec 2023 22:54:53 +0000 (17:54 -0500)]
Fix branch checkout in the build Docker image, refs #21089

Previously it would always check out the remote HEAD and not the
intended version that was going to be built, which causes problems
when the build environment diverges.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

5 months agoMerge branch 'main' from arvados-workbench2.git
Tom Clegg [Wed, 6 Dec 2023 23:16:24 +0000 (18:16 -0500)]
Merge branch 'main' from arvados-workbench2.git

refs #18874

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months ago21258: Fix "guaranteed broken" stub instance not broken.
Tom Clegg [Wed, 6 Dec 2023 19:01:00 +0000 (14:01 -0500)]
21258: Fix "guaranteed broken" stub instance not broken.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months ago21258: Fix "container completed twice" testing bug.
Tom Clegg [Wed, 6 Dec 2023 17:47:53 +0000 (12:47 -0500)]
21258: Fix "container completed twice" testing bug.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months agoMerge branch '21227-keep-web-panic'
Tom Clegg [Wed, 6 Dec 2023 16:55:52 +0000 (11:55 -0500)]
Merge branch '21227-keep-web-panic'

fixes #21227

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months ago21258: Fix flaky boot_outcomes metric test.
Tom Clegg [Wed, 6 Dec 2023 15:22:24 +0000 (10:22 -0500)]
21258: Fix flaky boot_outcomes metric test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months agoMerge branch '21223-arv-mount-nofile' refs #21223
Peter Amstutz [Wed, 6 Dec 2023 14:31:40 +0000 (09:31 -0500)]
Merge branch '21223-arv-mount-nofile' refs #21223

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

5 months agoMerge branch '21160-user-activation' refs #21160
Peter Amstutz [Tue, 5 Dec 2023 21:37:14 +0000 (16:37 -0500)]
Merge branch '21160-user-activation' refs #21160

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

5 months ago21227: Use a separate global requestLimiter for each target host. 21227-keep-web-panic
Tom Clegg [Tue, 5 Dec 2023 15:31:13 +0000 (10:31 -0500)]
21227: Use a separate global requestLimiter for each target host.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months agoMerge branch '21262-dependency-upgrades'. Closes #21262
Lucas Di Pentima [Tue, 5 Dec 2023 15:12:18 +0000 (12:12 -0300)]
Merge branch '21262-dependency-upgrades'. Closes #21262

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

5 months ago21160: Avoid redundant work 21160-user-activation
Peter Amstutz [Tue, 5 Dec 2023 15:07:04 +0000 (10:07 -0500)]
21160: Avoid redundant work

Don't recompute permissions on a link update that doesn't change
anything.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

5 months ago20684: Remove old apt-get command
Brett Smith [Tue, 5 Dec 2023 14:15:42 +0000 (09:15 -0500)]
20684: Remove old apt-get command

This is the list of packages that was meant to be replaced in the
previous commit, but it accidentally added the new list without removing
the old one. Refs #20684.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

5 months ago21262: Upgrades google.golang.org/grpc and its dependencies. 21262-dependency-upgrades
Lucas Di Pentima [Tue, 5 Dec 2023 14:17:17 +0000 (11:17 -0300)]
21262: Upgrades google.golang.org/grpc and its dependencies.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

5 months ago21262: Upgrades golang.org/x/net and its dependencies.
Lucas Di Pentima [Tue, 5 Dec 2023 14:15:20 +0000 (11:15 -0300)]
21262: Upgrades golang.org/x/net and its dependencies.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

5 months ago21262: Upgrades github.com/go-jose/go-jose/v3 dependency.
Lucas Di Pentima [Tue, 5 Dec 2023 14:13:43 +0000 (11:13 -0300)]
21262: Upgrades github.com/go-jose/go-jose/v3 dependency.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

5 months ago21262: Upgrades github.com/docker/docker dependency
Lucas Di Pentima [Tue, 5 Dec 2023 14:12:26 +0000 (11:12 -0300)]
21262: Upgrades github.com/docker/docker dependency

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

5 months ago21227: Don't reduce outgoing request concurrency below 4.
Tom Clegg [Mon, 4 Dec 2023 23:11:47 +0000 (18:11 -0500)]
21227: Don't reduce outgoing request concurrency below 4.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months ago21223: Add a few more --file-cache RLIMIT_NOFILE tests 21223-arv-mount-nofile
Peter Amstutz [Mon, 4 Dec 2023 19:37:31 +0000 (14:37 -0500)]
21223: Add a few more --file-cache RLIMIT_NOFILE tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

5 months agoMerge branch '21217-invalid-auth-header'
Tom Clegg [Mon, 4 Dec 2023 19:35:36 +0000 (14:35 -0500)]
Merge branch '21217-invalid-auth-header'

refs #21217

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months agoMerge branch '18862-replay-job-log-task'
Tom Clegg [Mon, 4 Dec 2023 19:35:21 +0000 (14:35 -0500)]
Merge branch '18862-replay-job-log-task'

closes #18862

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months ago21223: Add tests for setting RLIMIT_NOFILE based on --file-cache
Peter Amstutz [Mon, 4 Dec 2023 19:28:30 +0000 (14:28 -0500)]
21223: Add tests for setting RLIMIT_NOFILE based on --file-cache

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

5 months agoMerge branch '21219-java-sdk-pr-220'
Brett Smith [Fri, 1 Dec 2023 21:36:43 +0000 (16:36 -0500)]
Merge branch '21219-java-sdk-pr-220'

Closes #21219.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

5 months ago21217: Automatically clean double-slash in API URLs. 21217-invalid-auth-header
Tom Clegg [Fri, 1 Dec 2023 21:07:31 +0000 (16:07 -0500)]
21217: Automatically clean double-slash in API URLs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months agoAdd timeouts as configuration parameters 21219-java-sdk-pr-220
Krzysztof Majewski [Mon, 27 Nov 2023 12:20:05 +0000 (13:20 +0100)]
Add timeouts as configuration parameters
Arvados-DCO-1.1-Signed-off-by: Krzysztof Majewski majewski.kielce@gmail.com

5 months ago21227: Fix captured loop variable.
Tom Clegg [Fri, 1 Dec 2023 20:48:22 +0000 (15:48 -0500)]
21227: Fix captured loop variable.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months ago21227: Fix copied mutexes.
Tom Clegg [Fri, 1 Dec 2023 20:48:13 +0000 (15:48 -0500)]
21227: Fix copied mutexes.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months ago21227: Fix unbuffered channels used for signal.Notify.
Tom Clegg [Fri, 1 Dec 2023 20:47:06 +0000 (15:47 -0500)]
21227: Fix unbuffered channels used for signal.Notify.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months ago21227: Fail tests on 'go vet' problems.
Tom Clegg [Fri, 1 Dec 2023 20:44:31 +0000 (15:44 -0500)]
21227: Fail tests on 'go vet' problems.

...except "literal uses unkeyed fields", of which there are currently
many instances, mostly in tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months ago21227: Fix copied mutex after first use.
Tom Clegg [Fri, 1 Dec 2023 20:43:56 +0000 (15:43 -0500)]
21227: Fix copied mutex after first use.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>