arvados.git
2 years ago18887: undo the warning introduced in 18676 if a v2 anonymous token is
Ward Vandewege [Mon, 28 Mar 2022 20:18:16 +0000 (16:18 -0400)]
18887: undo the warning introduced in 18676 if a v2 anonymous token is
       supplied in the config file, using a v2 anonymous token is now
       fine. Also add a config loader check for the minimum secret
       length if a v2 token is acceptable.

refs #18887, #18676

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18887: it is OK for controller to forward the local anymous token,
Ward Vandewege [Fri, 25 Mar 2022 13:11:53 +0000 (09:11 -0400)]
18887: it is OK for controller to forward the local anymous token,
       because all anonymous tokens get mapped to the local anonymous
       token on every cluster.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18887: when wb1 sends the anonymous user token, it makes sure to always
Ward Vandewege [Fri, 25 Mar 2022 12:19:10 +0000 (08:19 -0400)]
18887: when wb1 sends the anonymous user token, it makes sure to always
       send a v2 token.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoAdd csv output mode to the user activity script.
Ward Vandewege [Sat, 2 Apr 2022 15:40:04 +0000 (11:40 -0400)]
Add csv output mode to the user activity script.

refs #18903

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18940: Go clients load $HOME/.config/arvados/settings.conf
Tom Clegg [Wed, 30 Mar 2022 18:40:25 +0000 (14:40 -0400)]
18940: Go clients load $HOME/.config/arvados/settings.conf

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18903: make getCollectionName smarter: look up the name by uuid if it is
Ward Vandewege [Fri, 1 Apr 2022 13:05:23 +0000 (09:05 -0400)]
18903: make getCollectionName smarter: look up the name by uuid if it is
       available and fall back to look up by pdh if not. If the latter,
       always return the name of the oldest collection with that pdh.

       Clarify that start/end parameters are in UTC since all timestamps
       in the database are stored in UTC.

       Fix error when printing help text.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18903: add a date range option to the user activity report.
Ward Vandewege [Sat, 26 Mar 2022 00:30:09 +0000 (20:30 -0400)]
18903: add a date range option to the user activity report.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18903: handle deleted users properly.
Ward Vandewege [Fri, 25 Mar 2022 21:33:43 +0000 (17:33 -0400)]
18903: handle deleted users properly.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18903: keep-web: when logging a file upload or download, if the
Ward Vandewege [Wed, 23 Mar 2022 18:08:09 +0000 (14:08 -0400)]
18903: keep-web: when logging a file upload or download, if the
       collection UUID is not known, blank the field rather than
       populating it with the PDH (which is also present in a separate
       field).

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18903: formatting fix for output: always prepend the event timestamp
Ward Vandewege [Wed, 23 Mar 2022 17:04:48 +0000 (13:04 -0400)]
18903: formatting fix for output: always prepend the event timestamp

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18903: the user activity script needs to look up collections by PDH, not
Ward Vandewege [Wed, 23 Mar 2022 16:07:51 +0000 (12:07 -0400)]
18903: the user activity script needs to look up collections by PDH, not
       UUID (that field is not always populated with a UUID).

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18903: fix uninitialized user object in the user activity script.
Ward Vandewege [Wed, 23 Mar 2022 15:00:08 +0000 (11:00 -0400)]
18903: fix uninitialized user object in the user activity script.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoUpdate hardcoded versions for 2.4 release
Peter Amstutz [Thu, 24 Mar 2022 17:59:08 +0000 (13:59 -0400)]
Update hardcoded versions for 2.4 release

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18941-arv-prefetch' refs #18941
Peter Amstutz [Wed, 30 Mar 2022 19:30:24 +0000 (15:30 -0400)]
Merge branch '18941-arv-prefetch' refs #18941

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Update help text in arv-get subcommand
Peter Amstutz [Wed, 30 Mar 2022 19:29:21 +0000 (15:29 -0400)]
18941: Update help text in arv-get subcommand

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Tweak the prefetch thread max to 7
Peter Amstutz [Wed, 30 Mar 2022 17:27:55 +0000 (13:27 -0400)]
18941: Tweak the prefetch thread max to 7

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Rename cache_slot_get option to 'prefetch' for clarity
Peter Amstutz [Wed, 30 Mar 2022 03:09:46 +0000 (23:09 -0400)]
18941: Rename cache_slot_get option to 'prefetch' for clarity

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Fix tests.
Peter Amstutz [Wed, 30 Mar 2022 02:55:35 +0000 (22:55 -0400)]
18941: Fix tests.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: clamp prefetch to 6
Peter Amstutz [Wed, 30 Mar 2022 02:13:45 +0000 (22:13 -0400)]
18941: clamp prefetch to 6

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Clamp to 4 block prefetch
Peter Amstutz [Wed, 30 Mar 2022 01:55:26 +0000 (21:55 -0400)]
18941: Clamp to 4 block prefetch

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Clamp between 1 and 16 prefetch threads
Peter Amstutz [Wed, 30 Mar 2022 01:41:20 +0000 (21:41 -0400)]
18941: Clamp between 1 and 16 prefetch threads

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoc18941: fix cache_slot_get behavior
Peter Amstutz [Tue, 29 Mar 2022 22:01:54 +0000 (18:01 -0400)]
c18941: fix cache_slot_get behavior

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Separate get() behavior for prefetch
Peter Amstutz [Tue, 29 Mar 2022 20:52:47 +0000 (16:52 -0400)]
18941: Separate get() behavior for prefetch

Add flag to get() which causes it to return None immediately if a cache
slot already exists for a block.

In the standard behavior, if multiple readers try to get() the same
block, the first one will start downloading the block, and all the
others will wait and return the block content from the cache slot
when complete.

With the new optional behavior, if multiple readers try to get() the same
block, the first one will start downloading the block, and all the
others will immediately return None.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Fix another typo
Peter Amstutz [Tue, 29 Mar 2022 18:54:03 +0000 (14:54 -0400)]
18941: Fix another typo

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Fix typo
Peter Amstutz [Tue, 29 Mar 2022 18:53:20 +0000 (14:53 -0400)]
18941: Fix typo

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Need to leave some space for current block
Peter Amstutz [Tue, 29 Mar 2022 18:51:14 +0000 (14:51 -0400)]
18941: Need to leave some space for current block

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Order of operations
Peter Amstutz [Tue, 29 Mar 2022 17:02:10 +0000 (13:02 -0400)]
18941: Order of operations

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: FUSE set number of get threads based on cache size
Peter Amstutz [Tue, 29 Mar 2022 16:58:05 +0000 (12:58 -0400)]
18941: FUSE set number of get threads based on cache size

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Add --threads option to arv-get
Peter Amstutz [Tue, 29 Mar 2022 16:24:53 +0000 (12:24 -0400)]
18941: Add --threads option to arv-get

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: bugfixing prefetch
Peter Amstutz [Tue, 29 Mar 2022 15:42:11 +0000 (15:42 +0000)]
18941: bugfixing prefetch

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18896-controller-logs-tokenUUIDs'
Ward Vandewege [Mon, 28 Mar 2022 19:28:19 +0000 (15:28 -0400)]
Merge branch '18896-controller-logs-tokenUUIDs'

refs #18896

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18896: Test token UUID logging.
Tom Clegg [Mon, 28 Mar 2022 15:23:09 +0000 (11:23 -0400)]
18896: Test token UUID logging.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18896: review feedback, un-pyramid the logrus.Fields update.
Ward Vandewege [Mon, 28 Mar 2022 14:14:09 +0000 (10:14 -0400)]
18896: review feedback, un-pyramid the logrus.Fields update.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18896: add locking. Also handle v1 tokens shorter than 5 characters.
Ward Vandewege [Fri, 25 Mar 2022 20:37:28 +0000 (16:37 -0400)]
18896: add locking. Also handle v1 tokens shorter than 5 characters.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18896: controller logs the UUIDs of the tokens used in each request.
Ward Vandewege [Fri, 25 Mar 2022 11:58:48 +0000 (07:58 -0400)]
18896: controller logs the UUIDs of the tokens used in each request.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoCorrect company name.
Ward Vandewege [Thu, 24 Mar 2022 21:00:55 +0000 (17:00 -0400)]
Correct company name.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoAdd a citation file.
Ward Vandewege [Thu, 24 Mar 2022 21:00:15 +0000 (17:00 -0400)]
Add a citation file.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoUpdate upgrading notes for pending 2.4.0 release refs #18701
Peter Amstutz [Thu, 24 Mar 2022 18:57:21 +0000 (14:57 -0400)]
Update upgrading notes for pending 2.4.0 release refs #18701

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18638-noisy-errors-regarding-tests'
Javier Bértoli [Thu, 24 Mar 2022 18:44:43 +0000 (15:44 -0300)]
Merge branch '18638-noisy-errors-regarding-tests'

closes #18638
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18638: Address review comments
Javier Bértoli [Thu, 24 Mar 2022 17:56:33 +0000 (14:56 -0300)]
18638: Address review comments

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '18596-preemptible-price-factor'
Tom Clegg [Thu, 24 Mar 2022 15:26:44 +0000 (11:26 -0400)]
Merge branch '18596-preemptible-price-factor'

closes #18596

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18633-install-sudo-passwordless-in-shell'
Javier Bértoli [Thu, 24 Mar 2022 13:27:05 +0000 (10:27 -0300)]
Merge branch '18633-install-sudo-passwordless-in-shell'

closes #18633
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18596: Fix test case to catch up with new default config.
Tom Clegg [Wed, 23 Mar 2022 14:36:30 +0000 (10:36 -0400)]
18596: Fix test case to catch up with new default config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18180-spot-default' refs #18180
Peter Amstutz [Tue, 22 Mar 2022 21:06:41 +0000 (17:06 -0400)]
Merge branch '18180-spot-default' refs #18180

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18180: Change AlwaysUsePreemptibleInstances: default to false
Peter Amstutz [Tue, 22 Mar 2022 21:04:23 +0000 (17:04 -0400)]
18180: Change AlwaysUsePreemptibleInstances: default to false

Add a little more detail to API docs about preemptible scheduling parameter.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18596: Warn about PreemptiblePriceFactor / InstanceTypes collision.
Tom Clegg [Tue, 22 Mar 2022 19:24:10 +0000 (15:24 -0400)]
18596: Warn about PreemptiblePriceFactor / InstanceTypes collision.

In case of a collision, use the explicit type, not the automatic one.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18596: Mention that 1.0 is a reasonable PreemptiblePriceFactor.
Tom Clegg [Tue, 22 Mar 2022 19:23:52 +0000 (15:23 -0400)]
18596: Mention that 1.0 is a reasonable PreemptiblePriceFactor.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18596: Change AlwaysUsePreemptibleInstances default to false.
Tom Clegg [Tue, 22 Mar 2022 19:22:00 +0000 (15:22 -0400)]
18596: Change AlwaysUsePreemptibleInstances default to false.

Admin docs were already updated to say the default is false, which
makes sense now that users can request preemptible instances via
arvados-cwl-runner (#18180) -- now the default really is false.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18596: Explain PreemptiblePriceFactor in admin docs.
Tom Clegg [Tue, 22 Mar 2022 19:21:06 +0000 (15:21 -0400)]
18596: Explain PreemptiblePriceFactor in admin docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agotest_with_arvbox pass through -j3 refs #18899
Peter Amstutz [Tue, 22 Mar 2022 18:37:43 +0000 (14:37 -0400)]
test_with_arvbox pass through -j3  refs #18899

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18638: fix provision script errors on tests when they're not required
Javier Bértoli [Tue, 22 Mar 2022 18:03:58 +0000 (15:03 -0300)]
18638: fix provision script errors on tests when they're not required

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18633: add sudo passwordless on shell role
Javier Bértoli [Mon, 21 Mar 2022 21:42:45 +0000 (18:42 -0300)]
18633: add sudo passwordless on shell role

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoSpecial behavior to skip bad cwl-1.2 test
Peter Amstutz [Tue, 22 Mar 2022 15:55:40 +0000 (11:55 -0400)]
Special behavior to skip bad cwl-1.2 test

refs #18899

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoDon't git pull in test_with_arvbox no issue #
Peter Amstutz [Mon, 21 Mar 2022 21:40:12 +0000 (17:40 -0400)]
Don't git pull in test_with_arvbox no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoFix test_with_arvbox checkout by tag no issue #
Peter Amstutz [Mon, 21 Mar 2022 21:30:39 +0000 (17:30 -0400)]
Fix test_with_arvbox checkout by tag no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoarvbox localdemo shouldn't use latest for data container no issue #
Peter Amstutz [Mon, 21 Mar 2022 21:17:55 +0000 (17:17 -0400)]
arvbox localdemo shouldn't use latest for data container no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoCheck out tagged conformance test suite refs #18614
Peter Amstutz [Mon, 21 Mar 2022 20:56:04 +0000 (16:56 -0400)]
Check out tagged conformance test suite refs #18614

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18767-filename-search-doc' refs #18767
Peter Amstutz [Mon, 21 Mar 2022 20:43:59 +0000 (16:43 -0400)]
Merge branch '18767-filename-search-doc' refs #18767

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18767: Move to 'list' section and mention ways to list files.
Peter Amstutz [Mon, 21 Mar 2022 20:30:02 +0000 (16:30 -0400)]
18767: Move to 'list' section and mention ways to list files.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18691-freeze-project'
Tom Clegg [Mon, 21 Mar 2022 14:17:29 +0000 (10:17 -0400)]
Merge branch '18691-freeze-project'

refs #18691

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18732-crunch-run-log-uids'
Tom Clegg [Mon, 21 Mar 2022 14:13:57 +0000 (10:13 -0400)]
Merge branch '18732-crunch-run-log-uids'

refs #18732

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18596: Add PreemptiblePriceFactor config.
Tom Clegg [Sun, 20 Mar 2022 06:37:31 +0000 (02:37 -0400)]
18596: Add PreemptiblePriceFactor config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18180-cwl-spot' refs #18180
Peter Amstutz [Fri, 18 Mar 2022 19:59:19 +0000 (15:59 -0400)]
Merge branch '18180-cwl-spot' refs #18180

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18180: Documentation improvements discussing spot instance support.
Peter Amstutz [Fri, 18 Mar 2022 19:44:23 +0000 (15:44 -0400)]
18180: Documentation improvements discussing spot instance support.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18180: Support for requesting preemptible instances in CWL
Peter Amstutz [Thu, 17 Mar 2022 18:26:07 +0000 (14:26 -0400)]
18180: Support for requesting preemptible instances in CWL

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoImprove arvados bash aliases, no issue #
Peter Amstutz [Fri, 18 Mar 2022 18:27:55 +0000 (14:27 -0400)]
Improve arvados bash aliases, no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoDon't mess with the ownership of /var/lib/arvados refs #18732
Peter Amstutz [Fri, 18 Mar 2022 18:19:15 +0000 (14:19 -0400)]
Don't mess with the ownership of /var/lib/arvados refs #18732

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18732: Log crunch-run process uid, gid, and groups.
Tom Clegg [Fri, 18 Mar 2022 04:56:41 +0000 (00:56 -0400)]
18732: Log crunch-run process uid, gid, and groups.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Disallow freezing projects with active container requests.
Tom Clegg [Thu, 17 Mar 2022 19:55:11 +0000 (15:55 -0400)]
18691: Disallow freezing projects with active container requests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Clarify that frozen projects cannot be moved.
Tom Clegg [Thu, 17 Mar 2022 19:19:06 +0000 (15:19 -0400)]
18691: Clarify that frozen projects cannot be moved.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Add parens to clarify operator precedence.
Tom Clegg [Thu, 17 Mar 2022 19:12:46 +0000 (15:12 -0400)]
18691: Add parens to clarify operator precedence.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Go back to old attribute_was method for consistency.
Tom Clegg [Thu, 17 Mar 2022 18:56:04 +0000 (14:56 -0400)]
18691: Go back to old attribute_was method for consistency.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Make it more obvious that unfreeze requires :manage.
Tom Clegg [Thu, 17 Mar 2022 18:26:58 +0000 (14:26 -0400)]
18691: Make it more obvious that unfreeze requires :manage.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Test that write permission is insufficient to unfreeze.
Tom Clegg [Thu, 17 Mar 2022 18:20:07 +0000 (14:20 -0400)]
18691: Test that write permission is insufficient to unfreeze.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18681-install-passenger-only-when-required'
Javier Bértoli [Thu, 17 Mar 2022 18:19:06 +0000 (15:19 -0300)]
Merge branch '18681-install-passenger-only-when-required'

closes #18681
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoWhen building compute node images on AWS, default to gp3 for the root
Ward Vandewege [Thu, 17 Mar 2022 17:59:32 +0000 (13:59 -0400)]
When building compute node images on AWS, default to gp3 for the root
filesystem, and use an m5.large by default instead of m4.large.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18890-python-sdk-verifyhost'
Ward Vandewege [Thu, 17 Mar 2022 17:58:31 +0000 (13:58 -0400)]
Merge branch '18890-python-sdk-verifyhost'

closes #18890

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18890: when ARVADOS_API_HOST_INSECURE is set, also disable certificate
Ward Vandewege [Thu, 17 Mar 2022 17:06:50 +0000 (13:06 -0400)]
18890: when ARVADOS_API_HOST_INSECURE is set, also disable certificate
       hostname checking in the Python SDK when talking to Keep.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18867-compute-image-new-minimum-docker-version'
Ward Vandewege [Thu, 17 Mar 2022 14:15:35 +0000 (10:15 -0400)]
Merge branch '18867-compute-image-new-minimum-docker-version'

closes #18867

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18867: Merge branch 'main' into 18867-compute-image-new-minimum-docker-version
Ward Vandewege [Thu, 17 Mar 2022 14:15:00 +0000 (10:15 -0400)]
18867: Merge branch 'main' into 18867-compute-image-new-minimum-docker-version

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18867: parameterize docker version for easier future maintenance.
Ward Vandewege [Thu, 17 Mar 2022 14:12:23 +0000 (10:12 -0400)]
18867: parameterize docker version for easier future maintenance.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '17421-wb2-doc' refs #17421
Peter Amstutz [Thu, 17 Mar 2022 13:50:17 +0000 (09:50 -0400)]
Merge branch '17421-wb2-doc' refs #17421

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17421: a few wording tweaks.
Ward Vandewege [Thu, 17 Mar 2022 12:57:30 +0000 (08:57 -0400)]
17421: a few wording tweaks.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18767: Add API documentation about searching for file/directory names.
Peter Amstutz [Wed, 16 Mar 2022 21:12:56 +0000 (17:12 -0400)]
18767: Add API documentation about searching for file/directory names.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17421: Added page about migration to Workbench 2
Peter Amstutz [Wed, 16 Mar 2022 20:23:05 +0000 (16:23 -0400)]
17421: Added page about migration to Workbench 2

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18867: introduce a minimum docker version of 20.10 in our compute image
Ward Vandewege [Wed, 16 Mar 2022 19:44:08 +0000 (15:44 -0400)]
18867: introduce a minimum docker version of 20.10 in our compute image
       build script. Also explicitly abort the script if it is not run
       against a supported distribution/version.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18681: Fix typo
Javier Bértoli [Wed, 16 Mar 2022 16:39:41 +0000 (13:39 -0300)]
18681: Fix typo

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoTypo
Javier Bértoli [Wed, 16 Mar 2022 14:47:52 +0000 (11:47 -0300)]
Typo

no issue #
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '18766-package-building-dockerfile-tweaks'
Ward Vandewege [Wed, 16 Mar 2022 14:04:24 +0000 (10:04 -0400)]
Merge branch '18766-package-building-dockerfile-tweaks'

refs #18766

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18766: Merge branch 'main' into 18766-package-building-dockerfile-tweaks
Ward Vandewege [Wed, 16 Mar 2022 14:03:51 +0000 (10:03 -0400)]
18766: Merge branch 'main' into 18766-package-building-dockerfile-tweaks

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18766: be a bit smarter about the preseeding of the go module cache and
Ward Vandewege [Wed, 16 Mar 2022 12:43:42 +0000 (08:43 -0400)]
18766: be a bit smarter about the preseeding of the go module cache and
the ruby gems in our docker images used for package building: make sure
to preseed with the currently checked out branch of the source tree,
not 'main'. This avoids potential compatibility issues between the
version of Ruby and certain gems.

The preseeding is worthwhile to speed up repeated package builds. When
testing on an 8 core i7-10510U:

* save ~60s on rails package build if the gems are fresh
* save ~30s on go package build if the go mods are fresh
* total gain for worst case scenario (workbench1 package) is almost 50%
 (85 seconds): ~3m down to ~1m35s

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18766: deal with deprecation warnings for our bundler invocation.
Ward Vandewege [Wed, 16 Mar 2022 12:42:56 +0000 (08:42 -0400)]
18766: deal with deprecation warnings for our bundler invocation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoFix unterminated sed in the installer
Javier Bértoli [Tue, 15 Mar 2022 22:28:00 +0000 (19:28 -0300)]
Fix unterminated sed in the installer

no issue #
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '18600-update-files'
Tom Clegg [Tue, 15 Mar 2022 19:39:36 +0000 (15:39 -0400)]
Merge branch '18600-update-files'

refs #18600

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoHandle 'add-apt-repository contrib' on Ubuntu 18.04 properly.
Ward Vandewege [Tue, 15 Mar 2022 16:46:13 +0000 (12:46 -0400)]
Handle 'add-apt-repository contrib' on Ubuntu 18.04 properly.

refs #18772

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoFix azure compute node image build.
Ward Vandewege [Tue, 15 Mar 2022 15:48:57 +0000 (11:48 -0400)]
Fix azure compute node image build.

refs #18772

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18600: Merge branch 'main'
Tom Clegg [Tue, 15 Mar 2022 17:30:59 +0000 (13:30 -0400)]
18600: Merge branch 'main'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Expand on "frozen" behavior, mention "...even by admins."
Tom Clegg [Tue, 15 Mar 2022 14:30:56 +0000 (10:30 -0400)]
18691: Expand on "frozen" behavior, mention "...even by admins."

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Rephrase expression.
Tom Clegg [Tue, 15 Mar 2022 14:21:40 +0000 (10:21 -0400)]
18691: Rephrase expression.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Comment excluded_trash sql, add more parentheses.
Tom Clegg [Tue, 15 Mar 2022 06:58:36 +0000 (02:58 -0400)]
18691: Comment excluded_trash sql, add more parentheses.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>