arvados.git
2 years agoMerge branch '18887-wb1-sends-v2-anonymous-token'
Ward Vandewege [Mon, 4 Apr 2022 19:38:05 +0000 (15:38 -0400)]
Merge branch '18887-wb1-sends-v2-anonymous-token'

closes #18887

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18887: Merge branch 'main' into 18887-wb1-sends-v2-anonymous-token
Ward Vandewege [Mon, 4 Apr 2022 19:33:28 +0000 (15:33 -0400)]
18887: Merge branch 'main' into 18887-wb1-sends-v2-anonymous-token

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18943-created-at-index' refs #18943
Peter Amstutz [Mon, 4 Apr 2022 19:01:37 +0000 (15:01 -0400)]
Merge branch '18943-created-at-index' refs #18943

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18887: Fix salted_secret check. Add test.
Ward Vandewege [Mon, 4 Apr 2022 19:01:18 +0000 (15:01 -0400)]
18887: Fix salted_secret check. Add test.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18943: Fix workbench bug
Peter Amstutz [Mon, 4 Apr 2022 18:02:40 +0000 (14:02 -0400)]
18943: Fix workbench bug

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18943: fix fixtures
Peter Amstutz [Mon, 4 Apr 2022 15:21:38 +0000 (11:21 -0400)]
18943: fix fixtures

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18943: Fixing fixture
Peter Amstutz [Mon, 4 Apr 2022 15:16:49 +0000 (11:16 -0400)]
18943: Fixing fixture

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18887: address review comments.
Ward Vandewege [Mon, 4 Apr 2022 15:00:25 +0000 (11:00 -0400)]
18887: address review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18943: Tweaking fixtures
Peter Amstutz [Mon, 4 Apr 2022 14:50:06 +0000 (10:50 -0400)]
18943: Tweaking fixtures

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18943: Fix tests
Peter Amstutz [Mon, 4 Apr 2022 14:18:31 +0000 (10:18 -0400)]
18943: Fix tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoAdd csv output mode to the user activity script.
Ward Vandewege [Sat, 2 Apr 2022 15:40:04 +0000 (11:40 -0400)]
Add csv output mode to the user activity script.

refs #18903

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18943: Drop redundant indexes
Peter Amstutz [Fri, 1 Apr 2022 21:07:43 +0000 (17:07 -0400)]
18943: Drop redundant indexes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18943: modified_by index doesn't need to be (desc, desc)
Peter Amstutz [Fri, 1 Apr 2022 21:03:44 +0000 (17:03 -0400)]
18943: modified_by index doesn't need to be (desc, desc)

Can use an (asc, asc) index for a (desc, desc) "order by".

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18943: Adjust default ordering of results to account for index order
Peter Amstutz [Fri, 1 Apr 2022 20:50:46 +0000 (16:50 -0400)]
18943: Adjust default ordering of results to account for index order

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18943: consistency between modified_at/created_at indexes
Peter Amstutz [Fri, 1 Apr 2022 20:46:49 +0000 (16:46 -0400)]
18943: consistency between modified_at/created_at indexes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18943: add modified_at descending index
Peter Amstutz [Fri, 1 Apr 2022 20:36:39 +0000 (16:36 -0400)]
18943: add modified_at descending index

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18943: Adjust keyset_list_all for efficient decending order
Peter Amstutz [Fri, 1 Apr 2022 18:47:39 +0000 (14:47 -0400)]
18943: Adjust keyset_list_all for efficient decending order

Default is ascending (created_at asc, uuid asc) but if acending=False
to use the index properly the query needs to be
(created_at desc, uuid desc)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18940-go-settings-conf'
Tom Clegg [Fri, 1 Apr 2022 18:26:30 +0000 (14:26 -0400)]
Merge branch '18940-go-settings-conf'

refs #18940

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18887: self.check_anonymous_user_token can now handle a full V2 token in
Ward Vandewege [Fri, 1 Apr 2022 18:09:36 +0000 (14:09 -0400)]
18887: self.check_anonymous_user_token can now handle a full V2 token in
       the config file. It can also verify a salted anonymous token.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18943: Migrate created_at indexes to (created_at, uuid)
Peter Amstutz [Fri, 1 Apr 2022 17:24:31 +0000 (13:24 -0400)]
18943: Migrate created_at indexes to (created_at, uuid)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18903-fix-activity-script'
Ward Vandewege [Fri, 1 Apr 2022 13:15:06 +0000 (09:15 -0400)]
Merge branch '18903-fix-activity-script'

closes #18903

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18903: Merge branch 'main' into 18903-fix-activity-script
Ward Vandewege [Fri, 1 Apr 2022 13:14:31 +0000 (09:14 -0400)]
18903: Merge branch 'main' into 18903-fix-activity-script

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18903: make getCollectionName smarter: look up the name by uuid if it is
Ward Vandewege [Fri, 1 Apr 2022 13:05:23 +0000 (09:05 -0400)]
18903: make getCollectionName smarter: look up the name by uuid if it is
       available and fall back to look up by pdh if not. If the latter,
       always return the name of the oldest collection with that pdh.

       Clarify that start/end parameters are in UTC since all timestamps
       in the database are stored in UTC.

       Fix error when printing help text.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18887: add an integration test.
Ward Vandewege [Thu, 31 Mar 2022 19:50:07 +0000 (15:50 -0400)]
18887: add an integration test.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18941-arv-prefetch' refs #18941
Peter Amstutz [Wed, 30 Mar 2022 19:30:24 +0000 (15:30 -0400)]
Merge branch '18941-arv-prefetch' refs #18941

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Update help text in arv-get subcommand
Peter Amstutz [Wed, 30 Mar 2022 19:29:21 +0000 (15:29 -0400)]
18941: Update help text in arv-get subcommand

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18940: Go clients load $HOME/.config/arvados/settings.conf
Tom Clegg [Wed, 30 Mar 2022 18:40:25 +0000 (14:40 -0400)]
18940: Go clients load $HOME/.config/arvados/settings.conf

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18941: Tweak the prefetch thread max to 7
Peter Amstutz [Wed, 30 Mar 2022 17:27:55 +0000 (13:27 -0400)]
18941: Tweak the prefetch thread max to 7

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Rename cache_slot_get option to 'prefetch' for clarity
Peter Amstutz [Wed, 30 Mar 2022 03:09:46 +0000 (23:09 -0400)]
18941: Rename cache_slot_get option to 'prefetch' for clarity

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Fix tests.
Peter Amstutz [Wed, 30 Mar 2022 02:55:35 +0000 (22:55 -0400)]
18941: Fix tests.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: clamp prefetch to 6
Peter Amstutz [Wed, 30 Mar 2022 02:13:45 +0000 (22:13 -0400)]
18941: clamp prefetch to 6

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Clamp to 4 block prefetch
Peter Amstutz [Wed, 30 Mar 2022 01:55:26 +0000 (21:55 -0400)]
18941: Clamp to 4 block prefetch

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Clamp between 1 and 16 prefetch threads
Peter Amstutz [Wed, 30 Mar 2022 01:41:20 +0000 (21:41 -0400)]
18941: Clamp between 1 and 16 prefetch threads

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoc18941: fix cache_slot_get behavior
Peter Amstutz [Tue, 29 Mar 2022 22:01:54 +0000 (18:01 -0400)]
c18941: fix cache_slot_get behavior

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Separate get() behavior for prefetch
Peter Amstutz [Tue, 29 Mar 2022 20:52:47 +0000 (16:52 -0400)]
18941: Separate get() behavior for prefetch

Add flag to get() which causes it to return None immediately if a cache
slot already exists for a block.

In the standard behavior, if multiple readers try to get() the same
block, the first one will start downloading the block, and all the
others will wait and return the block content from the cache slot
when complete.

With the new optional behavior, if multiple readers try to get() the same
block, the first one will start downloading the block, and all the
others will immediately return None.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Fix another typo
Peter Amstutz [Tue, 29 Mar 2022 18:54:03 +0000 (14:54 -0400)]
18941: Fix another typo

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Fix typo
Peter Amstutz [Tue, 29 Mar 2022 18:53:20 +0000 (14:53 -0400)]
18941: Fix typo

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Need to leave some space for current block
Peter Amstutz [Tue, 29 Mar 2022 18:51:14 +0000 (14:51 -0400)]
18941: Need to leave some space for current block

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Order of operations
Peter Amstutz [Tue, 29 Mar 2022 17:02:10 +0000 (13:02 -0400)]
18941: Order of operations

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: FUSE set number of get threads based on cache size
Peter Amstutz [Tue, 29 Mar 2022 16:58:05 +0000 (12:58 -0400)]
18941: FUSE set number of get threads based on cache size

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Add --threads option to arv-get
Peter Amstutz [Tue, 29 Mar 2022 16:24:53 +0000 (12:24 -0400)]
18941: Add --threads option to arv-get

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: bugfixing prefetch
Peter Amstutz [Tue, 29 Mar 2022 15:42:11 +0000 (15:42 +0000)]
18941: bugfixing prefetch

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18887: undo the warning introduced in 18676 if a v2 anonymous token is
Ward Vandewege [Mon, 28 Mar 2022 20:18:16 +0000 (16:18 -0400)]
18887: undo the warning introduced in 18676 if a v2 anonymous token is
       supplied in the config file, using a v2 anonymous token is now
       fine. Also add a config loader check for the minimum secret
       length if a v2 token is acceptable.

refs #18887, #18676

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18896-controller-logs-tokenUUIDs'
Ward Vandewege [Mon, 28 Mar 2022 19:28:19 +0000 (15:28 -0400)]
Merge branch '18896-controller-logs-tokenUUIDs'

refs #18896

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18896: Test token UUID logging.
Tom Clegg [Mon, 28 Mar 2022 15:23:09 +0000 (11:23 -0400)]
18896: Test token UUID logging.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18896: review feedback, un-pyramid the logrus.Fields update.
Ward Vandewege [Mon, 28 Mar 2022 14:14:09 +0000 (10:14 -0400)]
18896: review feedback, un-pyramid the logrus.Fields update.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18903: Merge branch 'main' into 18903-fix-activity-script
Ward Vandewege [Sat, 26 Mar 2022 00:32:27 +0000 (20:32 -0400)]
18903: Merge branch 'main' into 18903-fix-activity-script

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18903: add a date range option to the user activity report.
Ward Vandewege [Sat, 26 Mar 2022 00:30:09 +0000 (20:30 -0400)]
18903: add a date range option to the user activity report.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18903: handle deleted users properly.
Ward Vandewege [Fri, 25 Mar 2022 21:33:43 +0000 (17:33 -0400)]
18903: handle deleted users properly.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18896: add locking. Also handle v1 tokens shorter than 5 characters.
Ward Vandewege [Fri, 25 Mar 2022 20:37:28 +0000 (16:37 -0400)]
18896: add locking. Also handle v1 tokens shorter than 5 characters.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18887: it is OK for controller to forward the local anymous token,
Ward Vandewege [Fri, 25 Mar 2022 13:11:53 +0000 (09:11 -0400)]
18887: it is OK for controller to forward the local anymous token,
       because all anonymous tokens get mapped to the local anonymous
       token on every cluster.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18887: when wb1 sends the anonymous user token, it makes sure to always
Ward Vandewege [Fri, 25 Mar 2022 12:19:10 +0000 (08:19 -0400)]
18887: when wb1 sends the anonymous user token, it makes sure to always
       send a v2 token.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18896: controller logs the UUIDs of the tokens used in each request.
Ward Vandewege [Fri, 25 Mar 2022 11:58:48 +0000 (07:58 -0400)]
18896: controller logs the UUIDs of the tokens used in each request.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoCorrect company name.
Ward Vandewege [Thu, 24 Mar 2022 21:00:55 +0000 (17:00 -0400)]
Correct company name.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoAdd a citation file.
Ward Vandewege [Thu, 24 Mar 2022 21:00:15 +0000 (17:00 -0400)]
Add a citation file.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoUpdate upgrading notes for pending 2.4.0 release refs #18701
Peter Amstutz [Thu, 24 Mar 2022 18:57:21 +0000 (14:57 -0400)]
Update upgrading notes for pending 2.4.0 release refs #18701

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18638-noisy-errors-regarding-tests'
Javier Bértoli [Thu, 24 Mar 2022 18:44:43 +0000 (15:44 -0300)]
Merge branch '18638-noisy-errors-regarding-tests'

closes #18638
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18638: Address review comments
Javier Bértoli [Thu, 24 Mar 2022 17:56:33 +0000 (14:56 -0300)]
18638: Address review comments

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '18596-preemptible-price-factor'
Tom Clegg [Thu, 24 Mar 2022 15:26:44 +0000 (11:26 -0400)]
Merge branch '18596-preemptible-price-factor'

closes #18596

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18633-install-sudo-passwordless-in-shell'
Javier Bértoli [Thu, 24 Mar 2022 13:27:05 +0000 (10:27 -0300)]
Merge branch '18633-install-sudo-passwordless-in-shell'

closes #18633
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18903: keep-web: when logging a file upload or download, if the
Ward Vandewege [Wed, 23 Mar 2022 18:08:09 +0000 (14:08 -0400)]
18903: keep-web: when logging a file upload or download, if the
       collection UUID is not known, blank the field rather than
       populating it with the PDH (which is also present in a separate
       field).

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18903: formatting fix for output: always prepend the event timestamp
Ward Vandewege [Wed, 23 Mar 2022 17:04:48 +0000 (13:04 -0400)]
18903: formatting fix for output: always prepend the event timestamp

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18903: the user activity script needs to look up collections by PDH, not
Ward Vandewege [Wed, 23 Mar 2022 16:07:51 +0000 (12:07 -0400)]
18903: the user activity script needs to look up collections by PDH, not
       UUID (that field is not always populated with a UUID).

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18903: fix uninitialized user object in the user activity script.
Ward Vandewege [Wed, 23 Mar 2022 15:00:08 +0000 (11:00 -0400)]
18903: fix uninitialized user object in the user activity script.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18596: Fix test case to catch up with new default config.
Tom Clegg [Wed, 23 Mar 2022 14:36:30 +0000 (10:36 -0400)]
18596: Fix test case to catch up with new default config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18180-spot-default' refs #18180
Peter Amstutz [Tue, 22 Mar 2022 21:06:41 +0000 (17:06 -0400)]
Merge branch '18180-spot-default' refs #18180

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18180: Change AlwaysUsePreemptibleInstances: default to false
Peter Amstutz [Tue, 22 Mar 2022 21:04:23 +0000 (17:04 -0400)]
18180: Change AlwaysUsePreemptibleInstances: default to false

Add a little more detail to API docs about preemptible scheduling parameter.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18596: Warn about PreemptiblePriceFactor / InstanceTypes collision.
Tom Clegg [Tue, 22 Mar 2022 19:24:10 +0000 (15:24 -0400)]
18596: Warn about PreemptiblePriceFactor / InstanceTypes collision.

In case of a collision, use the explicit type, not the automatic one.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18596: Mention that 1.0 is a reasonable PreemptiblePriceFactor.
Tom Clegg [Tue, 22 Mar 2022 19:23:52 +0000 (15:23 -0400)]
18596: Mention that 1.0 is a reasonable PreemptiblePriceFactor.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18596: Change AlwaysUsePreemptibleInstances default to false.
Tom Clegg [Tue, 22 Mar 2022 19:22:00 +0000 (15:22 -0400)]
18596: Change AlwaysUsePreemptibleInstances default to false.

Admin docs were already updated to say the default is false, which
makes sense now that users can request preemptible instances via
arvados-cwl-runner (#18180) -- now the default really is false.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18596: Explain PreemptiblePriceFactor in admin docs.
Tom Clegg [Tue, 22 Mar 2022 19:21:06 +0000 (15:21 -0400)]
18596: Explain PreemptiblePriceFactor in admin docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agotest_with_arvbox pass through -j3 refs #18899
Peter Amstutz [Tue, 22 Mar 2022 18:37:43 +0000 (14:37 -0400)]
test_with_arvbox pass through -j3  refs #18899

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18638: fix provision script errors on tests when they're not required
Javier Bértoli [Tue, 22 Mar 2022 18:03:58 +0000 (15:03 -0300)]
18638: fix provision script errors on tests when they're not required

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18633: add sudo passwordless on shell role
Javier Bértoli [Mon, 21 Mar 2022 21:42:45 +0000 (18:42 -0300)]
18633: add sudo passwordless on shell role

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoSpecial behavior to skip bad cwl-1.2 test
Peter Amstutz [Tue, 22 Mar 2022 15:55:40 +0000 (11:55 -0400)]
Special behavior to skip bad cwl-1.2 test

refs #18899

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoDon't git pull in test_with_arvbox no issue #
Peter Amstutz [Mon, 21 Mar 2022 21:40:12 +0000 (17:40 -0400)]
Don't git pull in test_with_arvbox no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoFix test_with_arvbox checkout by tag no issue #
Peter Amstutz [Mon, 21 Mar 2022 21:30:39 +0000 (17:30 -0400)]
Fix test_with_arvbox checkout by tag no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoarvbox localdemo shouldn't use latest for data container no issue #
Peter Amstutz [Mon, 21 Mar 2022 21:17:55 +0000 (17:17 -0400)]
arvbox localdemo shouldn't use latest for data container no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoCheck out tagged conformance test suite refs #18614
Peter Amstutz [Mon, 21 Mar 2022 20:56:04 +0000 (16:56 -0400)]
Check out tagged conformance test suite refs #18614

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18767-filename-search-doc' refs #18767
Peter Amstutz [Mon, 21 Mar 2022 20:43:59 +0000 (16:43 -0400)]
Merge branch '18767-filename-search-doc' refs #18767

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18767: Move to 'list' section and mention ways to list files.
Peter Amstutz [Mon, 21 Mar 2022 20:30:02 +0000 (16:30 -0400)]
18767: Move to 'list' section and mention ways to list files.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18691-freeze-project'
Tom Clegg [Mon, 21 Mar 2022 14:17:29 +0000 (10:17 -0400)]
Merge branch '18691-freeze-project'

refs #18691

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18732-crunch-run-log-uids'
Tom Clegg [Mon, 21 Mar 2022 14:13:57 +0000 (10:13 -0400)]
Merge branch '18732-crunch-run-log-uids'

refs #18732

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18596: Add PreemptiblePriceFactor config.
Tom Clegg [Sun, 20 Mar 2022 06:37:31 +0000 (02:37 -0400)]
18596: Add PreemptiblePriceFactor config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18180-cwl-spot' refs #18180
Peter Amstutz [Fri, 18 Mar 2022 19:59:19 +0000 (15:59 -0400)]
Merge branch '18180-cwl-spot' refs #18180

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18180: Documentation improvements discussing spot instance support.
Peter Amstutz [Fri, 18 Mar 2022 19:44:23 +0000 (15:44 -0400)]
18180: Documentation improvements discussing spot instance support.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18180: Support for requesting preemptible instances in CWL
Peter Amstutz [Thu, 17 Mar 2022 18:26:07 +0000 (14:26 -0400)]
18180: Support for requesting preemptible instances in CWL

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoImprove arvados bash aliases, no issue #
Peter Amstutz [Fri, 18 Mar 2022 18:27:55 +0000 (14:27 -0400)]
Improve arvados bash aliases, no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoDon't mess with the ownership of /var/lib/arvados refs #18732
Peter Amstutz [Fri, 18 Mar 2022 18:19:15 +0000 (14:19 -0400)]
Don't mess with the ownership of /var/lib/arvados refs #18732

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18732: Log crunch-run process uid, gid, and groups.
Tom Clegg [Fri, 18 Mar 2022 04:56:41 +0000 (00:56 -0400)]
18732: Log crunch-run process uid, gid, and groups.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Disallow freezing projects with active container requests.
Tom Clegg [Thu, 17 Mar 2022 19:55:11 +0000 (15:55 -0400)]
18691: Disallow freezing projects with active container requests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Clarify that frozen projects cannot be moved.
Tom Clegg [Thu, 17 Mar 2022 19:19:06 +0000 (15:19 -0400)]
18691: Clarify that frozen projects cannot be moved.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Add parens to clarify operator precedence.
Tom Clegg [Thu, 17 Mar 2022 19:12:46 +0000 (15:12 -0400)]
18691: Add parens to clarify operator precedence.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Go back to old attribute_was method for consistency.
Tom Clegg [Thu, 17 Mar 2022 18:56:04 +0000 (14:56 -0400)]
18691: Go back to old attribute_was method for consistency.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Make it more obvious that unfreeze requires :manage.
Tom Clegg [Thu, 17 Mar 2022 18:26:58 +0000 (14:26 -0400)]
18691: Make it more obvious that unfreeze requires :manage.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Test that write permission is insufficient to unfreeze.
Tom Clegg [Thu, 17 Mar 2022 18:20:07 +0000 (14:20 -0400)]
18691: Test that write permission is insufficient to unfreeze.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18681-install-passenger-only-when-required'
Javier Bértoli [Thu, 17 Mar 2022 18:19:06 +0000 (15:19 -0300)]
Merge branch '18681-install-passenger-only-when-required'

closes #18681
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoWhen building compute node images on AWS, default to gp3 for the root
Ward Vandewege [Thu, 17 Mar 2022 17:59:32 +0000 (13:59 -0400)]
When building compute node images on AWS, default to gp3 for the root
filesystem, and use an m5.large by default instead of m4.large.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18890-python-sdk-verifyhost'
Ward Vandewege [Thu, 17 Mar 2022 17:58:31 +0000 (13:58 -0400)]
Merge branch '18890-python-sdk-verifyhost'

closes #18890

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18890: when ARVADOS_API_HOST_INSECURE is set, also disable certificate
Ward Vandewege [Thu, 17 Mar 2022 17:06:50 +0000 (13:06 -0400)]
18890: when ARVADOS_API_HOST_INSECURE is set, also disable certificate
       hostname checking in the Python SDK when talking to Keep.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>