Peter Amstutz [Fri, 16 Jun 2023 14:00:25 +0000 (10:00 -0400)]
20601: Rename Scheduler.maxSupervisors -> Scheduler.supervisorFraction
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Thu, 15 Jun 2023 19:53:34 +0000 (15:53 -0400)]
20601: MaxSupervisorFraction is relative to maxConcurrency.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 15 Jun 2023 18:59:49 +0000 (14:59 -0400)]
Merge branch '20601-big-ctr-queue'
refs #20601
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Tue, 13 Jun 2023 16:13:25 +0000 (12:13 -0400)]
Merge branch '20602-controller-qos'
refs #20602
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Tue, 13 Jun 2023 13:58:51 +0000 (09:58 -0400)]
20601: Add comment re fetch-by-uuid loop.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 12 Jun 2023 19:47:57 +0000 (15:47 -0400)]
20601: Slow down container queue polling when busy/slow.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 12 Jun 2023 18:47:30 +0000 (14:47 -0400)]
20602: Add IneligibleForQueuePriority const.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 12 Jun 2023 18:43:39 +0000 (14:43 -0400)]
20602: Use stdlib heap implementation.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 12 Jun 2023 18:18:13 +0000 (14:18 -0400)]
20601: Fetch mounts field only once per container.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 12 Jun 2023 15:29:33 +0000 (11:29 -0400)]
20601: Fetch only high-priority containers when queue is long.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Thu, 8 Jun 2023 20:12:22 +0000 (16:12 -0400)]
Merge branch '20614-no-retry-cancel' refs #20614
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Thu, 8 Jun 2023 18:30:23 +0000 (14:30 -0400)]
20602: Disable queue when testing DumpRequests.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 8 Jun 2023 14:31:11 +0000 (10:31 -0400)]
20602: Prioritize backend traffic from keep-web as interactive.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 8 Jun 2023 14:30:35 +0000 (10:30 -0400)]
20602: Attach assigned priority to response log entry.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 7 Jun 2023 21:13:30 +0000 (17:13 -0400)]
20602: Prioritize interactive (browser) requests.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 7 Jun 2023 21:12:17 +0000 (17:12 -0400)]
20602: Priority MinInt64 means never wait in queue.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 7 Jun 2023 16:37:40 +0000 (12:37 -0400)]
20602: Add MaxQueuedRequests config.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 7 Jun 2023 16:37:25 +0000 (12:37 -0400)]
20602: Add priority queue to RequestLimiter.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Thu, 8 Jun 2023 16:31:48 +0000 (12:31 -0400)]
20614: Better query for live container requests when deciding to retry
Now takes into account the state and priority of the requesting
container, if any.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Brett Smith [Wed, 7 Jun 2023 20:28:53 +0000 (16:28 -0400)]
Merge branch '20613-googleapiclient-init-logs'
Closes #20613.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Wed, 7 Jun 2023 19:00:43 +0000 (15:00 -0400)]
20613: Update unconfigured logger check to accommodate NullHandler
googleapiclient sets up its own NullHandler, as recommended by the
logging documentation. That makes the hasHandlers() test not work as
intended, so instead we traverse the hierarchy ourselves looking for a
real handler.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Peter Amstutz [Wed, 7 Jun 2023 17:51:21 +0000 (13:51 -0400)]
Merge branch '20548-installer-deploy' refs #20548
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Mon, 5 Jun 2023 22:10:07 +0000 (18:10 -0400)]
Initialize rcode variable, refs #20611
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Brett Smith [Wed, 7 Jun 2023 16:39:44 +0000 (12:39 -0400)]
20613: Add an upgrade note about new PySDK logging
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Wed, 7 Jun 2023 14:50:58 +0000 (10:50 -0400)]
20613: Fix test syntax for older Pythons
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Wed, 7 Jun 2023 14:24:04 +0000 (10:24 -0400)]
20613: Deconfigure logger after an exception
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Wed, 7 Jun 2023 12:04:13 +0000 (08:04 -0400)]
20613: Bugfix boolean tucnaround
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Tue, 6 Jun 2023 19:35:01 +0000 (15:35 -0400)]
20613: Use GoogleHTTPClientFilter in a-c-r
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Tue, 6 Jun 2023 19:33:03 +0000 (15:33 -0400)]
20613: Log early discovery document retries
See comments for rationale.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Tue, 6 Jun 2023 18:55:21 +0000 (14:55 -0400)]
20613: Introduce arvados.logging.GoogleHTTPClientFilter
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Tue, 6 Jun 2023 18:54:22 +0000 (14:54 -0400)]
20613: Start PySDK logging module with existing constants
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Tom Clegg [Mon, 5 Jun 2023 19:16:11 +0000 (15:16 -0400)]
Merge branch '20522-load-dispatch-priv-key'
closes #20522
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Lucas Di Pentima [Mon, 5 Jun 2023 18:47:32 +0000 (15:47 -0300)]
Merge branch '20594-scaling-nginx-settings'. Closes #20594
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Peter Amstutz [Fri, 2 Jun 2023 20:37:53 +0000 (16:37 -0400)]
20548: Emit the git commit in the deploy log.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Fri, 2 Jun 2023 20:18:07 +0000 (16:18 -0400)]
20548: Rework git deployment a bit
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Fri, 2 Jun 2023 17:59:52 +0000 (13:59 -0400)]
Merge branch '20531-cwl-log-tail' refs #20531
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Fri, 2 Jun 2023 17:39:04 +0000 (13:39 -0400)]
20531: Add --reinstall option to test_with_arvbox.sh
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Fri, 2 Jun 2023 16:11:02 +0000 (12:11 -0400)]
Merge branch '20541-less-fetching-mounts'
fixes #20541
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Fri, 2 Jun 2023 15:21:35 +0000 (11:21 -0400)]
20531: Bump cwltool and schema-salad versions
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Fri, 2 Jun 2023 15:19:25 +0000 (11:19 -0400)]
20531: Suppress googleapiclient retry warning, better download error
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Fri, 26 May 2023 19:26:12 +0000 (15:26 -0400)]
Increase WatchdogInterval and WatchdogThreshold
Quick workaround for customer, we should add these to the config file.
refs #20595
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Thu, 1 Jun 2023 19:13:57 +0000 (15:13 -0400)]
Merge branch '20540-crunch-run-retry'
fixes #20540
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Thu, 1 Jun 2023 18:32:47 +0000 (14:32 -0400)]
20531: Remove urllib3 pin, add cwltest pin.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Thu, 1 Jun 2023 17:54:41 +0000 (13:54 -0400)]
20540: Increase crunch-run API call timeouts to 10m.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Brett Smith [Thu, 1 Jun 2023 15:53:27 +0000 (11:53 -0400)]
Merge branch '20545-drop-if-none-match'
Closes #20545.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Thu, 1 Jun 2023 15:53:23 +0000 (11:53 -0400)]
Merge branch '20433-crunch-log-zero-bytes-job'
Closes #20433.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Peter Amstutz [Thu, 1 Jun 2023 14:23:41 +0000 (10:23 -0400)]
Merge branch '20561-file-copy-logging' refs #20561
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Brett Smith [Thu, 1 Jun 2023 13:51:29 +0000 (09:51 -0400)]
20545: Drop If-None-Match from requests proxied by controller
See comments for rationale.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Tom Clegg [Thu, 1 Jun 2023 13:33:48 +0000 (09:33 -0400)]
Merge branch '20485-optional-deploy-ssh-key'
closes #20485
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Brett Smith [Wed, 31 May 2023 20:46:36 +0000 (16:46 -0400)]
20433: Document that LimitLogBytesPerJob=0 disables live logging
Except for the throttle message, which is a nice user affordance.
Add a test for this specific case.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Tom Clegg [Wed, 31 May 2023 19:55:33 +0000 (15:55 -0400)]
20485: Test handling of nil publickey argument.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 31 May 2023 19:24:30 +0000 (15:24 -0400)]
20540: Ensure delay>0 at attempt>0, even if requested min=0.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 31 May 2023 13:59:30 +0000 (09:59 -0400)]
20541: Auto unselect fields if response body will not be read.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Tue, 30 May 2023 20:54:03 +0000 (16:54 -0400)]
20540: Implement nearly-full jitter for exponential backoff.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Tue, 30 May 2023 18:58:13 +0000 (14:58 -0400)]
20561: Don't fail when inspecting a file outside the output directory
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Tue, 30 May 2023 14:33:56 +0000 (10:33 -0400)]
20541: Unselect unneeded fields in API calls from crunch-run.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 29 May 2023 19:43:17 +0000 (15:43 -0400)]
Merge branch '20229-doc-inspect-requests'
closes #20229
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 29 May 2023 19:42:51 +0000 (15:42 -0400)]
20229: Improve formatting.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 29 May 2023 19:24:52 +0000 (15:24 -0400)]
20485: Option to skip automatic SSH key deployment on cloud VMs.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 29 May 2023 19:11:27 +0000 (15:11 -0400)]
20540: Use arvados.Client for arvadosclient.ArvadosClient reqs.
Caller-specified Retries is used as a timeout in minutes.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Fri, 26 May 2023 19:30:25 +0000 (15:30 -0400)]
Merge branch '20520-instance-init-command'
refs #20520
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Fri, 26 May 2023 19:22:01 +0000 (15:22 -0400)]
20540: Remove arvadosclient usage in copier and git_tree.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Lucas Di Pentima [Fri, 26 May 2023 18:45:31 +0000 (15:45 -0300)]
20595: Scales nginx settings depending on max concurrent requests config.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Tom Clegg [Fri, 26 May 2023 14:25:36 +0000 (10:25 -0400)]
20520: Fix broken link.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Fri, 26 May 2023 14:10:09 +0000 (10:10 -0400)]
20520: Fix unreleased mutex on error importing SSH key.
Any error listing or importing keys (which, luckily, only happens the
first time a arvados-dispatch-cloud process creates a new instance)
would cause Create() call to fail, and cause all subsequent Create()
calls to hang forever until the service is restarted.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Fri, 26 May 2023 14:29:16 +0000 (10:29 -0400)]
Merge branch '20511-aborted-boot'
refs #20511
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Lucas Di Pentima [Fri, 26 May 2023 13:42:20 +0000 (10:42 -0300)]
Merge branch '20474-installer-api-reqs-limit'. Closes #20474
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Tom Clegg [Thu, 25 May 2023 21:45:50 +0000 (17:45 -0400)]
20511: Fix allowing too many supervisor processes.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 25 May 2023 21:10:48 +0000 (17:10 -0400)]
20511: Don't shutdown excess instances just because MaxSupervisors.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Thu, 25 May 2023 20:12:39 +0000 (16:12 -0400)]
20531: Add toplevel dependency to solve install error
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Thu, 25 May 2023 19:57:56 +0000 (15:57 -0400)]
20531: Add an extra newline to make the error section easier to see
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Lucas Di Pentima [Thu, 25 May 2023 18:58:53 +0000 (15:58 -0300)]
20474: Updates documentation stating that RailsAPI supports /metrics endpoint.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Thu, 25 May 2023 18:52:32 +0000 (15:52 -0300)]
20474: Changes RailsAPI queue size to be 10% more than controller's.
Also, adds comment on config file clarifying why we're setting up this
increased value.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Tom Clegg [Thu, 25 May 2023 18:42:15 +0000 (14:42 -0400)]
20520: Add test for custom init command.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 25 May 2023 17:57:58 +0000 (13:57 -0400)]
20511: Fix unclosed response body in test.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 25 May 2023 17:43:34 +0000 (13:43 -0400)]
20511: Don't shutdown/unlock based on dynamic maxConcurrency.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Thu, 25 May 2023 17:34:13 +0000 (13:34 -0400)]
20531: don't print crunch-run log when the error is with the tool
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Thu, 25 May 2023 17:30:36 +0000 (13:30 -0400)]
20561: crunch-run logs files/directories propagated from keep
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Thu, 25 May 2023 15:25:02 +0000 (11:25 -0400)]
20511: Limit server-to-server client to 1/4 of API req capacity.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 25 May 2023 14:33:53 +0000 (10:33 -0400)]
20511: Fix slow-expansion logic.
Limit was always being raised to 2x known-working, instead of
min(+10%, 2x known-working) as intended.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 25 May 2023 14:12:40 +0000 (10:12 -0400)]
20511: Start with 8 concurrent outgoing API calls, not unlimited.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Tue, 23 May 2023 21:40:06 +0000 (17:40 -0400)]
20520: Add Containers.CloudVMs.InstanceInitCommand config.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Tue, 23 May 2023 17:56:06 +0000 (13:56 -0400)]
20522: Load dispatch key from file if configured as file:///...
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Mon, 22 May 2023 21:16:12 +0000 (17:16 -0400)]
Add 2.6.2 to the upgrading notes refs #20393
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Lucas Di Pentima [Mon, 22 May 2023 21:13:53 +0000 (18:13 -0300)]
20474: Adds 5 to controller's request queue size for RailsAPI.
This size difference would allow extra requests (like metrics) to happen
even on heavily loaded clusters.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Peter Amstutz [Mon, 22 May 2023 15:33:46 +0000 (11:33 -0400)]
Merge branch '20529-container-deadlocks' refs #20529
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Brett Smith [Mon, 22 May 2023 14:47:29 +0000 (10:47 -0400)]
Merge branch '20527-group-contents-select-doc'
Closes #20527.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Peter Amstutz [Fri, 19 May 2023 19:01:34 +0000 (15:01 -0400)]
20529: Lock direct parent containers on updates
This is because cost is propagated up to the parent container on
container completion.
Handle case of resource attrs at top level when deciding whether to
lock or not (resource attrs appear as strings, not symbols)
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Lucas Di Pentima [Fri, 19 May 2023 18:11:57 +0000 (15:11 -0300)]
Merge branch '20482-installer-improvements'. Closes #20482
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Fri, 19 May 2023 16:16:56 +0000 (13:16 -0300)]
20482: For some reason, symlinks don't seem to be ignored for copyright checks.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Fri, 19 May 2023 15:06:33 +0000 (12:06 -0300)]
20482: Updates the upgrade notice to include the DOMAIN envvar at local.params.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Thu, 18 May 2023 20:36:10 +0000 (17:36 -0300)]
20482: Updates installer's documentation to reflect latest changes.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Thu, 18 May 2023 20:35:17 +0000 (17:35 -0300)]
20482: Code cleanup for readability.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Thu, 18 May 2023 20:31:37 +0000 (17:31 -0300)]
20482: Re-exports VPC's CIDR.
Previously exported as 'vpc_cidr' and removed when preexisting vpc usage
was added. This config data is used on local.params and was mentioned on the
documentation page.
Now, it's exported as 'cluster_int_cidr' and its value is requested from AWS
so that we get the correct one whether the vpc was just created or a
previously existing one is being in use.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Fri, 19 May 2023 14:57:03 +0000 (11:57 -0300)]
20482: Overrides shellinabox config templates to fix the domain name usage.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Thu, 18 May 2023 14:22:10 +0000 (11:22 -0300)]
20482: Allows the cluster operator to use an arbitrary domain.
Instead of making domains like cluster_prefix.domain mandatory, let the site
admin to select whichever domain they need for the deployment.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Brett Smith [Fri, 19 May 2023 14:39:03 +0000 (10:39 -0400)]
20527: Document the select argument of the groups contents API method
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Thu, 18 May 2023 15:40:55 +0000 (11:40 -0400)]
Merge branch '12684-pysdk-auto-retry'
Closes #12684.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Thu, 18 May 2023 12:48:13 +0000 (08:48 -0400)]
12684: Test that plain 403 responses are not retried
Requested in review.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
Brett Smith [Thu, 18 May 2023 12:36:56 +0000 (08:36 -0400)]
12684: Stop retrying 422 responses in PySDK
The original motivation for this was to retry when the API server was
having database connectivity problems. The feeling eight years later is
that things have changed enough that, on balance, this isn't worth
retrying anymore.
I don't think this will have any real impact on current Arvados
software. In the main branch as I write this,
`check_http_response_status` only gets called in five places. Three of
those are in the main `arvados` module for job and task utilities, which
presumably nobody is using anymore. The other two talk to Keep, which
only returns 422 for hash mismatches, where a retry will definitely
never succeed.
Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>
projects / arvados.git / log