arvados.git
2 years ago18941: Clamp to 4 block prefetch
Peter Amstutz [Wed, 30 Mar 2022 01:55:26 +0000 (21:55 -0400)]
18941: Clamp to 4 block prefetch

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Clamp between 1 and 16 prefetch threads
Peter Amstutz [Wed, 30 Mar 2022 01:41:20 +0000 (21:41 -0400)]
18941: Clamp between 1 and 16 prefetch threads

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoc18941: fix cache_slot_get behavior
Peter Amstutz [Tue, 29 Mar 2022 22:01:54 +0000 (18:01 -0400)]
c18941: fix cache_slot_get behavior

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Separate get() behavior for prefetch
Peter Amstutz [Tue, 29 Mar 2022 20:52:47 +0000 (16:52 -0400)]
18941: Separate get() behavior for prefetch

Add flag to get() which causes it to return None immediately if a cache
slot already exists for a block.

In the standard behavior, if multiple readers try to get() the same
block, the first one will start downloading the block, and all the
others will wait and return the block content from the cache slot
when complete.

With the new optional behavior, if multiple readers try to get() the same
block, the first one will start downloading the block, and all the
others will immediately return None.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Fix another typo
Peter Amstutz [Tue, 29 Mar 2022 18:54:03 +0000 (14:54 -0400)]
18941: Fix another typo

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Fix typo
Peter Amstutz [Tue, 29 Mar 2022 18:53:20 +0000 (14:53 -0400)]
18941: Fix typo

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Need to leave some space for current block
Peter Amstutz [Tue, 29 Mar 2022 18:51:14 +0000 (14:51 -0400)]
18941: Need to leave some space for current block

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Order of operations
Peter Amstutz [Tue, 29 Mar 2022 17:02:10 +0000 (13:02 -0400)]
18941: Order of operations

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: FUSE set number of get threads based on cache size
Peter Amstutz [Tue, 29 Mar 2022 16:58:05 +0000 (12:58 -0400)]
18941: FUSE set number of get threads based on cache size

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: Add --threads option to arv-get
Peter Amstutz [Tue, 29 Mar 2022 16:24:53 +0000 (12:24 -0400)]
18941: Add --threads option to arv-get

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18941: bugfixing prefetch
Peter Amstutz [Tue, 29 Mar 2022 15:42:11 +0000 (15:42 +0000)]
18941: bugfixing prefetch

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoCorrect company name.
Ward Vandewege [Thu, 24 Mar 2022 21:00:55 +0000 (17:00 -0400)]
Correct company name.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoAdd a citation file.
Ward Vandewege [Thu, 24 Mar 2022 21:00:15 +0000 (17:00 -0400)]
Add a citation file.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoUpdate upgrading notes for pending 2.4.0 release refs #18701
Peter Amstutz [Thu, 24 Mar 2022 18:57:21 +0000 (14:57 -0400)]
Update upgrading notes for pending 2.4.0 release refs #18701

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18638-noisy-errors-regarding-tests'
Javier Bértoli [Thu, 24 Mar 2022 18:44:43 +0000 (15:44 -0300)]
Merge branch '18638-noisy-errors-regarding-tests'

closes #18638
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18638: Address review comments
Javier Bértoli [Thu, 24 Mar 2022 17:56:33 +0000 (14:56 -0300)]
18638: Address review comments

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '18596-preemptible-price-factor'
Tom Clegg [Thu, 24 Mar 2022 15:26:44 +0000 (11:26 -0400)]
Merge branch '18596-preemptible-price-factor'

closes #18596

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18633-install-sudo-passwordless-in-shell'
Javier Bértoli [Thu, 24 Mar 2022 13:27:05 +0000 (10:27 -0300)]
Merge branch '18633-install-sudo-passwordless-in-shell'

closes #18633
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18596: Fix test case to catch up with new default config.
Tom Clegg [Wed, 23 Mar 2022 14:36:30 +0000 (10:36 -0400)]
18596: Fix test case to catch up with new default config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18180-spot-default' refs #18180
Peter Amstutz [Tue, 22 Mar 2022 21:06:41 +0000 (17:06 -0400)]
Merge branch '18180-spot-default' refs #18180

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18180: Change AlwaysUsePreemptibleInstances: default to false
Peter Amstutz [Tue, 22 Mar 2022 21:04:23 +0000 (17:04 -0400)]
18180: Change AlwaysUsePreemptibleInstances: default to false

Add a little more detail to API docs about preemptible scheduling parameter.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18596: Warn about PreemptiblePriceFactor / InstanceTypes collision.
Tom Clegg [Tue, 22 Mar 2022 19:24:10 +0000 (15:24 -0400)]
18596: Warn about PreemptiblePriceFactor / InstanceTypes collision.

In case of a collision, use the explicit type, not the automatic one.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18596: Mention that 1.0 is a reasonable PreemptiblePriceFactor.
Tom Clegg [Tue, 22 Mar 2022 19:23:52 +0000 (15:23 -0400)]
18596: Mention that 1.0 is a reasonable PreemptiblePriceFactor.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18596: Change AlwaysUsePreemptibleInstances default to false.
Tom Clegg [Tue, 22 Mar 2022 19:22:00 +0000 (15:22 -0400)]
18596: Change AlwaysUsePreemptibleInstances default to false.

Admin docs were already updated to say the default is false, which
makes sense now that users can request preemptible instances via
arvados-cwl-runner (#18180) -- now the default really is false.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18596: Explain PreemptiblePriceFactor in admin docs.
Tom Clegg [Tue, 22 Mar 2022 19:21:06 +0000 (15:21 -0400)]
18596: Explain PreemptiblePriceFactor in admin docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agotest_with_arvbox pass through -j3 refs #18899
Peter Amstutz [Tue, 22 Mar 2022 18:37:43 +0000 (14:37 -0400)]
test_with_arvbox pass through -j3  refs #18899

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18638: fix provision script errors on tests when they're not required
Javier Bértoli [Tue, 22 Mar 2022 18:03:58 +0000 (15:03 -0300)]
18638: fix provision script errors on tests when they're not required

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18633: add sudo passwordless on shell role
Javier Bértoli [Mon, 21 Mar 2022 21:42:45 +0000 (18:42 -0300)]
18633: add sudo passwordless on shell role

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoSpecial behavior to skip bad cwl-1.2 test
Peter Amstutz [Tue, 22 Mar 2022 15:55:40 +0000 (11:55 -0400)]
Special behavior to skip bad cwl-1.2 test

refs #18899

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoDon't git pull in test_with_arvbox no issue #
Peter Amstutz [Mon, 21 Mar 2022 21:40:12 +0000 (17:40 -0400)]
Don't git pull in test_with_arvbox no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoFix test_with_arvbox checkout by tag no issue #
Peter Amstutz [Mon, 21 Mar 2022 21:30:39 +0000 (17:30 -0400)]
Fix test_with_arvbox checkout by tag no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoarvbox localdemo shouldn't use latest for data container no issue #
Peter Amstutz [Mon, 21 Mar 2022 21:17:55 +0000 (17:17 -0400)]
arvbox localdemo shouldn't use latest for data container no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoCheck out tagged conformance test suite refs #18614
Peter Amstutz [Mon, 21 Mar 2022 20:56:04 +0000 (16:56 -0400)]
Check out tagged conformance test suite refs #18614

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18767-filename-search-doc' refs #18767
Peter Amstutz [Mon, 21 Mar 2022 20:43:59 +0000 (16:43 -0400)]
Merge branch '18767-filename-search-doc' refs #18767

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18767: Move to 'list' section and mention ways to list files.
Peter Amstutz [Mon, 21 Mar 2022 20:30:02 +0000 (16:30 -0400)]
18767: Move to 'list' section and mention ways to list files.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '18691-freeze-project'
Tom Clegg [Mon, 21 Mar 2022 14:17:29 +0000 (10:17 -0400)]
Merge branch '18691-freeze-project'

refs #18691

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18732-crunch-run-log-uids'
Tom Clegg [Mon, 21 Mar 2022 14:13:57 +0000 (10:13 -0400)]
Merge branch '18732-crunch-run-log-uids'

refs #18732

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18596: Add PreemptiblePriceFactor config.
Tom Clegg [Sun, 20 Mar 2022 06:37:31 +0000 (02:37 -0400)]
18596: Add PreemptiblePriceFactor config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18180-cwl-spot' refs #18180
Peter Amstutz [Fri, 18 Mar 2022 19:59:19 +0000 (15:59 -0400)]
Merge branch '18180-cwl-spot' refs #18180

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18180: Documentation improvements discussing spot instance support.
Peter Amstutz [Fri, 18 Mar 2022 19:44:23 +0000 (15:44 -0400)]
18180: Documentation improvements discussing spot instance support.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18180: Support for requesting preemptible instances in CWL
Peter Amstutz [Thu, 17 Mar 2022 18:26:07 +0000 (14:26 -0400)]
18180: Support for requesting preemptible instances in CWL

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoImprove arvados bash aliases, no issue #
Peter Amstutz [Fri, 18 Mar 2022 18:27:55 +0000 (14:27 -0400)]
Improve arvados bash aliases, no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoDon't mess with the ownership of /var/lib/arvados refs #18732
Peter Amstutz [Fri, 18 Mar 2022 18:19:15 +0000 (14:19 -0400)]
Don't mess with the ownership of /var/lib/arvados refs #18732

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18732: Log crunch-run process uid, gid, and groups.
Tom Clegg [Fri, 18 Mar 2022 04:56:41 +0000 (00:56 -0400)]
18732: Log crunch-run process uid, gid, and groups.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Disallow freezing projects with active container requests.
Tom Clegg [Thu, 17 Mar 2022 19:55:11 +0000 (15:55 -0400)]
18691: Disallow freezing projects with active container requests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Clarify that frozen projects cannot be moved.
Tom Clegg [Thu, 17 Mar 2022 19:19:06 +0000 (15:19 -0400)]
18691: Clarify that frozen projects cannot be moved.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Add parens to clarify operator precedence.
Tom Clegg [Thu, 17 Mar 2022 19:12:46 +0000 (15:12 -0400)]
18691: Add parens to clarify operator precedence.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Go back to old attribute_was method for consistency.
Tom Clegg [Thu, 17 Mar 2022 18:56:04 +0000 (14:56 -0400)]
18691: Go back to old attribute_was method for consistency.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Make it more obvious that unfreeze requires :manage.
Tom Clegg [Thu, 17 Mar 2022 18:26:58 +0000 (14:26 -0400)]
18691: Make it more obvious that unfreeze requires :manage.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Test that write permission is insufficient to unfreeze.
Tom Clegg [Thu, 17 Mar 2022 18:20:07 +0000 (14:20 -0400)]
18691: Test that write permission is insufficient to unfreeze.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18681-install-passenger-only-when-required'
Javier Bértoli [Thu, 17 Mar 2022 18:19:06 +0000 (15:19 -0300)]
Merge branch '18681-install-passenger-only-when-required'

closes #18681
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoWhen building compute node images on AWS, default to gp3 for the root
Ward Vandewege [Thu, 17 Mar 2022 17:59:32 +0000 (13:59 -0400)]
When building compute node images on AWS, default to gp3 for the root
filesystem, and use an m5.large by default instead of m4.large.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18890-python-sdk-verifyhost'
Ward Vandewege [Thu, 17 Mar 2022 17:58:31 +0000 (13:58 -0400)]
Merge branch '18890-python-sdk-verifyhost'

closes #18890

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18890: when ARVADOS_API_HOST_INSECURE is set, also disable certificate
Ward Vandewege [Thu, 17 Mar 2022 17:06:50 +0000 (13:06 -0400)]
18890: when ARVADOS_API_HOST_INSECURE is set, also disable certificate
       hostname checking in the Python SDK when talking to Keep.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '18867-compute-image-new-minimum-docker-version'
Ward Vandewege [Thu, 17 Mar 2022 14:15:35 +0000 (10:15 -0400)]
Merge branch '18867-compute-image-new-minimum-docker-version'

closes #18867

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18867: Merge branch 'main' into 18867-compute-image-new-minimum-docker-version
Ward Vandewege [Thu, 17 Mar 2022 14:15:00 +0000 (10:15 -0400)]
18867: Merge branch 'main' into 18867-compute-image-new-minimum-docker-version

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18867: parameterize docker version for easier future maintenance.
Ward Vandewege [Thu, 17 Mar 2022 14:12:23 +0000 (10:12 -0400)]
18867: parameterize docker version for easier future maintenance.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoMerge branch '17421-wb2-doc' refs #17421
Peter Amstutz [Thu, 17 Mar 2022 13:50:17 +0000 (09:50 -0400)]
Merge branch '17421-wb2-doc' refs #17421

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17421: a few wording tweaks.
Ward Vandewege [Thu, 17 Mar 2022 12:57:30 +0000 (08:57 -0400)]
17421: a few wording tweaks.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18767: Add API documentation about searching for file/directory names.
Peter Amstutz [Wed, 16 Mar 2022 21:12:56 +0000 (17:12 -0400)]
18767: Add API documentation about searching for file/directory names.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17421: Added page about migration to Workbench 2
Peter Amstutz [Wed, 16 Mar 2022 20:23:05 +0000 (16:23 -0400)]
17421: Added page about migration to Workbench 2

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18867: introduce a minimum docker version of 20.10 in our compute image
Ward Vandewege [Wed, 16 Mar 2022 19:44:08 +0000 (15:44 -0400)]
18867: introduce a minimum docker version of 20.10 in our compute image
       build script. Also explicitly abort the script if it is not run
       against a supported distribution/version.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18681: Fix typo
Javier Bértoli [Wed, 16 Mar 2022 16:39:41 +0000 (13:39 -0300)]
18681: Fix typo

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoTypo
Javier Bértoli [Wed, 16 Mar 2022 14:47:52 +0000 (11:47 -0300)]
Typo

no issue #
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '18766-package-building-dockerfile-tweaks'
Ward Vandewege [Wed, 16 Mar 2022 14:04:24 +0000 (10:04 -0400)]
Merge branch '18766-package-building-dockerfile-tweaks'

refs #18766

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18766: Merge branch 'main' into 18766-package-building-dockerfile-tweaks
Ward Vandewege [Wed, 16 Mar 2022 14:03:51 +0000 (10:03 -0400)]
18766: Merge branch 'main' into 18766-package-building-dockerfile-tweaks

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18766: be a bit smarter about the preseeding of the go module cache and
Ward Vandewege [Wed, 16 Mar 2022 12:43:42 +0000 (08:43 -0400)]
18766: be a bit smarter about the preseeding of the go module cache and
the ruby gems in our docker images used for package building: make sure
to preseed with the currently checked out branch of the source tree,
not 'main'. This avoids potential compatibility issues between the
version of Ruby and certain gems.

The preseeding is worthwhile to speed up repeated package builds. When
testing on an 8 core i7-10510U:

* save ~60s on rails package build if the gems are fresh
* save ~30s on go package build if the go mods are fresh
* total gain for worst case scenario (workbench1 package) is almost 50%
 (85 seconds): ~3m down to ~1m35s

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18766: deal with deprecation warnings for our bundler invocation.
Ward Vandewege [Wed, 16 Mar 2022 12:42:56 +0000 (08:42 -0400)]
18766: deal with deprecation warnings for our bundler invocation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoFix unterminated sed in the installer
Javier Bértoli [Tue, 15 Mar 2022 22:28:00 +0000 (19:28 -0300)]
Fix unterminated sed in the installer

no issue #
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '18600-update-files'
Tom Clegg [Tue, 15 Mar 2022 19:39:36 +0000 (15:39 -0400)]
Merge branch '18600-update-files'

refs #18600

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoHandle 'add-apt-repository contrib' on Ubuntu 18.04 properly.
Ward Vandewege [Tue, 15 Mar 2022 16:46:13 +0000 (12:46 -0400)]
Handle 'add-apt-repository contrib' on Ubuntu 18.04 properly.

refs #18772

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoFix azure compute node image build.
Ward Vandewege [Tue, 15 Mar 2022 15:48:57 +0000 (11:48 -0400)]
Fix azure compute node image build.

refs #18772

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18600: Merge branch 'main'
Tom Clegg [Tue, 15 Mar 2022 17:30:59 +0000 (13:30 -0400)]
18600: Merge branch 'main'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Expand on "frozen" behavior, mention "...even by admins."
Tom Clegg [Tue, 15 Mar 2022 14:30:56 +0000 (10:30 -0400)]
18691: Expand on "frozen" behavior, mention "...even by admins."

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Rephrase expression.
Tom Clegg [Tue, 15 Mar 2022 14:21:40 +0000 (10:21 -0400)]
18691: Rephrase expression.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Comment excluded_trash sql, add more parentheses.
Tom Clegg [Tue, 15 Mar 2022 06:58:36 +0000 (02:58 -0400)]
18691: Comment excluded_trash sql, add more parentheses.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Refactor frozen_groups check.
Tom Clegg [Tue, 15 Mar 2022 06:56:09 +0000 (02:56 -0400)]
18691: Refactor frozen_groups check.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18635-remove-unnecesary-.psql-management'
Javier Bértoli [Tue, 15 Mar 2022 14:34:14 +0000 (11:34 -0300)]
Merge branch '18635-remove-unnecesary-.psql-management'

closes #18635
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoUpgrade nginx, docker and postgresql formulas in the installer
Javier Bértoli [Tue, 15 Mar 2022 00:12:20 +0000 (21:12 -0300)]
Upgrade nginx, docker and postgresql formulas in the installer

no issue #

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18681: install passenger conditionally, only when required
Javier Bértoli [Tue, 15 Mar 2022 00:11:42 +0000 (21:11 -0300)]
18681: install passenger conditionally, only when required

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18691: Recommend postgresql 10+ (9 is unsupported anyway).
Tom Clegg [Mon, 14 Mar 2022 19:01:16 +0000 (15:01 -0400)]
18691: Recommend postgresql 10+ (9 is unsupported anyway).

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18691: Show readable_by query plan in test suite.
Tom Clegg [Mon, 14 Mar 2022 18:54:57 +0000 (14:54 -0400)]
18691: Show readable_by query plan in test suite.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMake the sql statement that clears old container logs more efficient by
Ward Vandewege [Mon, 14 Mar 2022 18:25:08 +0000 (14:25 -0400)]
Make the sql statement that clears old container logs more efficient by
using now() instead of clock_timestamp(). The former is calculated once
per transaction.

refs #18763

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years agoEnforce a consistent postgresql version across examples
Javier Bértoli [Mon, 14 Mar 2022 18:00:28 +0000 (15:00 -0300)]
Enforce a consistent postgresql version across examples

no issue #
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoMerge branch '18763-rails-cleanups'
Ward Vandewege [Mon, 14 Mar 2022 17:21:09 +0000 (13:21 -0400)]
Merge branch '18763-rails-cleanups'

closes #18763

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18763: remove rake tasks that are no longer needed (cf.
Ward Vandewege [Mon, 14 Mar 2022 15:51:08 +0000 (11:51 -0400)]
18763: remove rake tasks that are no longer needed (cf.
       https://dev.arvados.org/issues/18763#note-5).

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18763: remove unused gems from the API server Gemfile.
Ward Vandewege [Mon, 14 Mar 2022 13:54:53 +0000 (09:54 -0400)]
18763: remove unused gems from the API server Gemfile.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18635: remove .psqlrc management from the provision.sh script
Javier Bértoli [Fri, 11 Mar 2022 17:47:39 +0000 (14:47 -0300)]
18635: remove .psqlrc management from the provision.sh script

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agoAdd "go mod vendor" so switching branches in arvbox dev works better
Peter Amstutz [Fri, 11 Mar 2022 16:50:43 +0000 (11:50 -0500)]
Add "go mod vendor" so switching branches in arvbox dev works better

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18600: Merge branch 'main'
Tom Clegg [Fri, 11 Mar 2022 16:01:30 +0000 (11:01 -0500)]
18600: Merge branch 'main'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18663-add-keepbalance-support'
Javier Bértoli [Fri, 11 Mar 2022 15:12:06 +0000 (12:12 -0300)]
Merge branch '18663-add-keepbalance-support'

closes #18663
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18600: Revert query→body change to argument location.
Tom Clegg [Fri, 11 Mar 2022 14:42:09 +0000 (09:42 -0500)]
18600: Revert query→body change to argument location.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18663: one more documentation tweak.
Ward Vandewege [Fri, 11 Mar 2022 14:37:35 +0000 (09:37 -0500)]
18663: one more documentation tweak.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

2 years ago18663: address review comments
Javier Bértoli [Fri, 11 Mar 2022 11:02:46 +0000 (08:02 -0300)]
18663: address review comments

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years ago18849: enforce RVM on Debian 10
Javier Bértoli [Thu, 10 Mar 2022 23:49:33 +0000 (20:49 -0300)]
18849: enforce RVM on Debian 10

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

2 years agocrunchstat-summary pins to current Python SDK version
Peter Amstutz [Thu, 10 Mar 2022 15:37:37 +0000 (10:37 -0500)]
crunchstat-summary pins to current Python SDK version

Same logic as used for arvados-cwl-runner

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoPut upper bound on PyCURL
Peter Amstutz [Thu, 10 Mar 2022 15:03:34 +0000 (10:03 -0500)]
Put upper bound on PyCURL

Starting with PyCURL 7.45.0 it is incompatible with the version of GNU
TLS that ships with Debian 10.

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18600: Test replace_files feature via sdk/cli.
Tom Clegg [Thu, 10 Mar 2022 21:30:43 +0000 (16:30 -0500)]
18600: Test replace_files feature via sdk/cli.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18600: Move "splices" to "update_files" update/create option.
Tom Clegg [Thu, 10 Mar 2022 21:30:27 +0000 (16:30 -0500)]
18600: Move "splices" to "update_files" update/create option.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18663: address review comments
Javier Bértoli [Thu, 10 Mar 2022 20:24:03 +0000 (17:24 -0300)]
18663: address review comments

Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>