Brett Smith [Fri, 23 Jun 2023 13:25:24 +0000 (09:25 -0400)]
20663: Bugfix configuration lookup
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Tom Clegg [Thu, 22 Jun 2023 17:27:24 +0000 (13:27 -0400)]
Merge branch '20425-fed-pdh-retry'
fixes #20425
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 22 Jun 2023 16:55:05 +0000 (12:55 -0400)]
20425: Merge branch 'main' into 20425-fed-pdh-retry
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Brett Smith [Thu, 22 Jun 2023 15:10:29 +0000 (11:10 -0400)]
20663: Add configuration for arvados-login-sync
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Thu, 22 Jun 2023 14:52:05 +0000 (10:52 -0400)]
20663: Clarify comment about what "safe" config means
I might've liked to reveal configuration to authenticated clients, but
not unauthenticated ones. Unfortunately the code doesn't currently
support that.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Thu, 22 Jun 2023 14:43:36 +0000 (10:43 -0400)]
20663: Make arvados-login-sync actions configurable
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Thu, 22 Jun 2023 14:18:02 +0000 (10:18 -0400)]
20663: Use set operations for group management
Make code more consistent for easier readability.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Thu, 22 Jun 2023 14:16:40 +0000 (10:16 -0400)]
20663: Make minimum groups configurable
Note this no longer adds the user's own group to the membership
list. The administrator can control that by adjusting USERGROUPS_ENAB
in /etc/login.defs.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Thu, 22 Jun 2023 13:48:44 +0000 (09:48 -0400)]
20663: Improve permissions and ownership handling
* Set permissions of everything at creation time.
* Only change ownership for things we touch.
* Manage group ownership as well as user
(having things owned by user:root is weird).
* Modernize style.
This is preparation for allowing administrators to configure what
resources arvados-login-sync manages.
Note this means arvados-login-sync no longer changes permissions for a
user's home directory. The administrator can do that by setting UMASK
in /etc/login.defs.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Peter Amstutz [Thu, 22 Jun 2023 14:43:12 +0000 (10:43 -0400)]
Merge branch '20374-workflow-main-prop' refs #20374
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Thu, 22 Jun 2023 14:41:10 +0000 (10:41 -0400)]
Merge branch '20660-r-sdk-pr-204' refs #20660
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Thu, 22 Jun 2023 14:29:53 +0000 (10:29 -0400)]
20374: add arv:workflowMain to metadata properties doc.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Thu, 22 Jun 2023 13:54:01 +0000 (09:54 -0400)]
20660: Tweaks to eliminate check warnings
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Lucas Di Pentima [Wed, 21 Jun 2023 20:51:32 +0000 (17:51 -0300)]
20665: Updates single-host docs to reflect local.params.secrets addition.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Wed, 21 Jun 2023 20:27:41 +0000 (17:27 -0300)]
20665: Updates documentation reflecting the new local.params.secrets file.
Also, fixes some old issues related to the use of ${CLUSTER} and ${DOMAIN}.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Wed, 21 Jun 2023 19:11:11 +0000 (16:11 -0300)]
20665: Handles secrets on a separate file.
This allows the admin to give special treatment to it, to comply with security
policies that the local organization may have.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Peter Amstutz [Wed, 21 Jun 2023 20:42:51 +0000 (16:42 -0400)]
Merge branch '20664-java-sdk-pr-205' refs #20664
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Wed, 21 Jun 2023 20:34:26 +0000 (16:34 -0400)]
20660: Add devtools::check to run_test.R
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
AnetaSta22 [Thu, 8 Jun 2023 12:20:35 +0000 (14:20 +0200)]
Update README.md
correct order
Add \dontrun{} in documentation in Arvados.R
Add \dontrun{} in documentation in ArvadosFile.R
Add \dontrun{} in documentation in Collection.R
Arvados-DCO-1.1-Signed-off-by: Aneta Stanczyk <aneta.stanczyk@contractors.roche.com>
Lucas Di Pentima [Tue, 20 Jun 2023 14:45:40 +0000 (11:45 -0300)]
Merge branch '20643-login-sync-homedir-check'. Closes #20643
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Tue, 20 Jun 2023 14:44:08 +0000 (11:44 -0300)]
20643: Skips user account processing earlier to avoid any partial configs.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Krzysztof Majewski [Tue, 20 Jun 2023 14:07:47 +0000 (16:07 +0200)]
Add new list method parameters: include_old_versions, include_trash
Arvados-DCO-1.1-Signed-off-by: Krzysztof Majewski majewski.kielce@gmail.com
Tom Clegg [Tue, 20 Jun 2023 14:03:20 +0000 (10:03 -0400)]
Merge branch '20602-queue-metrics'
refs #20602
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Tue, 20 Jun 2023 13:43:10 +0000 (09:43 -0400)]
Merge branch '20647-cr-logs-preflight'
fixes #20647
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 19 Jun 2023 20:41:18 +0000 (16:41 -0400)]
20602: Allow lock requests to queue up to 2s (configurable).
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Mon, 19 Jun 2023 20:07:56 +0000 (16:07 -0400)]
Merge branch '20652-cwl-poll-select' refs #20652
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Mon, 19 Jun 2023 19:29:58 +0000 (15:29 -0400)]
20647: Improve comment on header deduplication.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Mon, 19 Jun 2023 18:56:48 +0000 (14:56 -0400)]
Merge branch '20637-prefetch-threads' refs #20637
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Mon, 19 Jun 2023 18:37:50 +0000 (14:37 -0400)]
20602: Report queue usage bucketed by priority.
Also report queue time stats for requests that are abandoned before
getting a processing slot.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 19 Jun 2023 15:53:38 +0000 (11:53 -0400)]
20602: Report queue time for pos/neg/zero-priority reqs.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Sat, 17 Jun 2023 02:19:41 +0000 (22:19 -0400)]
20647: Fix duplicate response headers via reverse proxy.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Fri, 16 Jun 2023 19:46:48 +0000 (15:46 -0400)]
20637: Fix tests
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Fri, 16 Jun 2023 18:53:49 +0000 (14:53 -0400)]
20637: Fix arv-get
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Fri, 16 Jun 2023 18:35:20 +0000 (14:35 -0400)]
20637: Move the prefetch thread pool to KeepClient
This avoids the problem of every Collection with its own BlockManager
creating its own prefetch thread pool, which becomes a resource leak
when reading files from 1000s of separate Collection objects.
The 'put' thread pool remains with the BlockManager but it now stops
the put threads on 'BlockManager.commit_all'. This is because this
method always flushes pending blocks anyway, and is called before the
collection record is written to the API server -- so we can assume
we've just finished a batch of writes to that collection, and might
not need the put thread pool any more, and if we do, we can just make
a new one.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Fri, 16 Jun 2023 17:58:16 +0000 (13:58 -0400)]
20602: Add queue metrics.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Fri, 16 Jun 2023 15:48:24 +0000 (11:48 -0400)]
20652: When polling the API server, limit fields returned
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Fri, 16 Jun 2023 15:10:06 +0000 (11:10 -0400)]
Merge branch '20647-cr-logs-preflight'
fixes #20647
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Fri, 16 Jun 2023 14:26:12 +0000 (10:26 -0400)]
Merge branch '20601-supervisor-fraction' refs #20601
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Fri, 16 Jun 2023 14:00:25 +0000 (10:00 -0400)]
20601: Rename Scheduler.maxSupervisors -> Scheduler.supervisorFraction
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Fri, 16 Jun 2023 06:06:35 +0000 (02:06 -0400)]
20647: Test CORS preflight request routing.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Fri, 16 Jun 2023 06:05:59 +0000 (02:05 -0400)]
20647: Fix CORS preflight request handling.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 15 Jun 2023 19:53:34 +0000 (15:53 -0400)]
20601: MaxSupervisorFraction is relative to maxConcurrency.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 15 Jun 2023 18:59:49 +0000 (14:59 -0400)]
Merge branch '20601-big-ctr-queue'
refs #20601
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Lucas Di Pentima [Thu, 15 Jun 2023 13:05:01 +0000 (10:05 -0300)]
20643: Improves error message.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Wed, 14 Jun 2023 15:07:44 +0000 (12:07 -0300)]
20643: Skip (with a log error) users that don't have their HOME dirs created.
Some systems may be able to resolve users from centralized services, but
need additional steps to allow them to log into the shell node. We then
expect that allowed users should already have their HOME directories created
before doing any syncing.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Tom Clegg [Tue, 13 Jun 2023 16:13:25 +0000 (12:13 -0400)]
Merge branch '20602-controller-qos'
refs #20602
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Tue, 13 Jun 2023 13:58:51 +0000 (09:58 -0400)]
20601: Add comment re fetch-by-uuid loop.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 12 Jun 2023 19:47:57 +0000 (15:47 -0400)]
20601: Slow down container queue polling when busy/slow.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 12 Jun 2023 18:47:30 +0000 (14:47 -0400)]
20602: Add IneligibleForQueuePriority const.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 12 Jun 2023 18:43:39 +0000 (14:43 -0400)]
20602: Use stdlib heap implementation.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 12 Jun 2023 18:18:13 +0000 (14:18 -0400)]
20601: Fetch mounts field only once per container.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 12 Jun 2023 15:29:33 +0000 (11:29 -0400)]
20601: Fetch only high-priority containers when queue is long.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Fri, 9 Jun 2023 14:07:23 +0000 (10:07 -0400)]
20425: Reduce timeout for keep-web->controller calls from 5m to 1m.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Fri, 9 Jun 2023 13:31:37 +0000 (09:31 -0400)]
20425: Fix response status for mixed-status backend errors.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 5 Jun 2023 19:15:17 +0000 (15:15 -0400)]
20425: Test response status for mixed-status backend errors.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 5 Jun 2023 14:50:07 +0000 (10:50 -0400)]
20425: Revert "12684/20425: Skip TestContainerInputOnDifferentCluster"
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Thu, 8 Jun 2023 20:12:22 +0000 (16:12 -0400)]
Merge branch '20614-no-retry-cancel' refs #20614
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Thu, 8 Jun 2023 18:30:23 +0000 (14:30 -0400)]
20602: Disable queue when testing DumpRequests.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 8 Jun 2023 14:31:11 +0000 (10:31 -0400)]
20602: Prioritize backend traffic from keep-web as interactive.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 8 Jun 2023 14:30:35 +0000 (10:30 -0400)]
20602: Attach assigned priority to response log entry.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 7 Jun 2023 21:13:30 +0000 (17:13 -0400)]
20602: Prioritize interactive (browser) requests.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 7 Jun 2023 21:12:17 +0000 (17:12 -0400)]
20602: Priority MinInt64 means never wait in queue.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 7 Jun 2023 16:37:40 +0000 (12:37 -0400)]
20602: Add MaxQueuedRequests config.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 7 Jun 2023 16:37:25 +0000 (12:37 -0400)]
20602: Add priority queue to RequestLimiter.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Thu, 8 Jun 2023 16:31:48 +0000 (12:31 -0400)]
20614: Better query for live container requests when deciding to retry
Now takes into account the state and priority of the requesting
container, if any.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Brett Smith [Wed, 7 Jun 2023 20:28:53 +0000 (16:28 -0400)]
Merge branch '20613-googleapiclient-init-logs'
Closes #20613.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Wed, 7 Jun 2023 19:00:43 +0000 (15:00 -0400)]
20613: Update unconfigured logger check to accommodate NullHandler
googleapiclient sets up its own NullHandler, as recommended by the
logging documentation. That makes the hasHandlers() test not work as
intended, so instead we traverse the hierarchy ourselves looking for a
real handler.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Peter Amstutz [Wed, 7 Jun 2023 17:51:21 +0000 (13:51 -0400)]
Merge branch '20548-installer-deploy' refs #20548
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Mon, 5 Jun 2023 22:10:07 +0000 (18:10 -0400)]
Initialize rcode variable, refs #20611
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Brett Smith [Wed, 7 Jun 2023 16:39:44 +0000 (12:39 -0400)]
20613: Add an upgrade note about new PySDK logging
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Wed, 7 Jun 2023 14:50:58 +0000 (10:50 -0400)]
20613: Fix test syntax for older Pythons
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Wed, 7 Jun 2023 14:24:04 +0000 (10:24 -0400)]
20613: Deconfigure logger after an exception
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Wed, 7 Jun 2023 12:04:13 +0000 (08:04 -0400)]
20613: Bugfix boolean tucnaround
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Tue, 6 Jun 2023 19:35:01 +0000 (15:35 -0400)]
20613: Use GoogleHTTPClientFilter in a-c-r
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Tue, 6 Jun 2023 19:33:03 +0000 (15:33 -0400)]
20613: Log early discovery document retries
See comments for rationale.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Tue, 6 Jun 2023 18:55:21 +0000 (14:55 -0400)]
20613: Introduce arvados.logging.GoogleHTTPClientFilter
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Tue, 6 Jun 2023 18:54:22 +0000 (14:54 -0400)]
20613: Start PySDK logging module with existing constants
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Tom Clegg [Mon, 5 Jun 2023 19:16:11 +0000 (15:16 -0400)]
Merge branch '20522-load-dispatch-priv-key'
closes #20522
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Lucas Di Pentima [Mon, 5 Jun 2023 18:47:32 +0000 (15:47 -0300)]
Merge branch '20594-scaling-nginx-settings'. Closes #20594
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Peter Amstutz [Fri, 2 Jun 2023 20:37:53 +0000 (16:37 -0400)]
20548: Emit the git commit in the deploy log.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Fri, 2 Jun 2023 20:18:07 +0000 (16:18 -0400)]
20548: Rework git deployment a bit
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Fri, 2 Jun 2023 17:59:52 +0000 (13:59 -0400)]
Merge branch '20531-cwl-log-tail' refs #20531
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Fri, 2 Jun 2023 17:39:04 +0000 (13:39 -0400)]
20531: Add --reinstall option to test_with_arvbox.sh
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Fri, 2 Jun 2023 16:11:02 +0000 (12:11 -0400)]
Merge branch '20541-less-fetching-mounts'
fixes #20541
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Fri, 2 Jun 2023 15:21:35 +0000 (11:21 -0400)]
20531: Bump cwltool and schema-salad versions
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Fri, 2 Jun 2023 15:19:25 +0000 (11:19 -0400)]
20531: Suppress googleapiclient retry warning, better download error
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Fri, 26 May 2023 19:26:12 +0000 (15:26 -0400)]
Increase WatchdogInterval and WatchdogThreshold
Quick workaround for customer, we should add these to the config file.
refs #20595
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Thu, 1 Jun 2023 19:13:57 +0000 (15:13 -0400)]
Merge branch '20540-crunch-run-retry'
fixes #20540
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Thu, 1 Jun 2023 18:32:47 +0000 (14:32 -0400)]
20531: Remove urllib3 pin, add cwltest pin.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Thu, 1 Jun 2023 17:54:41 +0000 (13:54 -0400)]
20540: Increase crunch-run API call timeouts to 10m.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Brett Smith [Thu, 1 Jun 2023 15:53:27 +0000 (11:53 -0400)]
Merge branch '20545-drop-if-none-match'
Closes #20545.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Thu, 1 Jun 2023 15:53:23 +0000 (11:53 -0400)]
Merge branch '20433-crunch-log-zero-bytes-job'
Closes #20433.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Peter Amstutz [Thu, 1 Jun 2023 14:23:41 +0000 (10:23 -0400)]
Merge branch '20561-file-copy-logging' refs #20561
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Brett Smith [Thu, 1 Jun 2023 13:51:29 +0000 (09:51 -0400)]
20545: Drop If-None-Match from requests proxied by controller
See comments for rationale.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Tom Clegg [Thu, 1 Jun 2023 13:33:48 +0000 (09:33 -0400)]
Merge branch '20485-optional-deploy-ssh-key'
closes #20485
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Brett Smith [Wed, 31 May 2023 20:46:36 +0000 (16:46 -0400)]
20433: Document that LimitLogBytesPerJob=0 disables live logging
Except for the throttle message, which is a nice user affordance.
Add a test for this specific case.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Tom Clegg [Wed, 31 May 2023 19:55:33 +0000 (15:55 -0400)]
20485: Test handling of nil publickey argument.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 31 May 2023 19:24:30 +0000 (15:24 -0400)]
20540: Ensure delay>0 at attempt>0, even if requested min=0.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 31 May 2023 13:59:30 +0000 (09:59 -0400)]
20541: Auto unselect fields if response body will not be read.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Tue, 30 May 2023 20:54:03 +0000 (16:54 -0400)]
20540: Implement nearly-full jitter for exponential backoff.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>