arvados.git
3 years ago17111: Deselect unsigned_manifest_text by default in groups#contents. 2.1.1
Tom Clegg [Fri, 13 Nov 2020 20:44:43 +0000 (15:44 -0500)]
17111: Deselect unsigned_manifest_text by default in groups#contents.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoFix require path in the 'script/rails' script for api server.
Ward Vandewege [Fri, 6 Nov 2020 13:34:38 +0000 (08:34 -0500)]
Fix require path in the 'script/rails' script for api server.

closes #17094

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17090: Migration to refresh_permissions
Peter Amstutz [Thu, 5 Nov 2020 19:55:35 +0000 (14:55 -0500)]
17090: Migration to refresh_permissions

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17090: Use EXCLUSIVE lock for permission updates
Peter Amstutz [Thu, 5 Nov 2020 16:09:30 +0000 (11:09 -0500)]
17090: Use EXCLUSIVE lock for permission updates

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17040: Update structure.sql
Peter Amstutz [Tue, 3 Nov 2020 18:01:57 +0000 (13:01 -0500)]
17040: Update structure.sql

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17040: RefreshTrashedGroups migration, clear_permissions calls forget_cached_group_perms
Peter Amstutz [Tue, 3 Nov 2020 17:12:59 +0000 (12:12 -0500)]
17040: RefreshTrashedGroups migration, clear_permissions calls forget_cached_group_perms

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17040: Cache results of User.group_permissions
Peter Amstutz [Mon, 2 Nov 2020 21:20:02 +0000 (16:20 -0500)]
17040: Cache results of User.group_permissions

When requesting a list of groups (either directly, or with the
"shared" endpoint) it calls writable_by for each group.  This
indirectly calls User.group_permissions, which makes a database query.
When it does this for every group (with a database query each time),
which gets very expensive.

To address this, this commit caches the result of group_permissions on
the user object.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17040: Get user_uuids and embed them as a constant in the main query
Peter Amstutz [Mon, 2 Nov 2020 19:25:28 +0000 (14:25 -0500)]
17040: Get user_uuids and embed them as a constant in the main query

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17040: Refactor trash check
Peter Amstutz [Tue, 27 Oct 2020 02:55:46 +0000 (22:55 -0400)]
17040: Refactor trash check

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17040: Swap the order of where clauses in the readable_by query
Peter Amstutz [Fri, 23 Oct 2020 00:44:15 +0000 (20:44 -0400)]
17040: Swap the order of where clauses in the readable_by query

This seems work around a query planner bug in Postgres 9.5.

A hotfix provided to a customer resulted in dramatically better
performance.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agodocumentation: Mention distribution packages on the "Install the Slurm
Ward Vandewege [Tue, 27 Oct 2020 15:23:05 +0000 (11:23 -0400)]
documentation: Mention distribution packages on the "Install the Slurm
dispatcher" page.

closes #16883

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16930: remove local 'latest' tag before pushing.
Ward Vandewege [Fri, 23 Oct 2020 18:31:14 +0000 (14:31 -0400)]
16930: remove local 'latest' tag before pushing.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago17010: Use !! instead of (? true : false)
Peter Amstutz [Thu, 22 Oct 2020 18:44:37 +0000 (14:44 -0400)]
17010: Use !! instead of (? true : false)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17010: Don't double up --enable-reuse
Peter Amstutz [Thu, 22 Oct 2020 02:27:14 +0000 (22:27 -0400)]
17010: Don't double up --enable-reuse

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17010: Fix tests. Tests check that --enable-reuse is set
Peter Amstutz [Thu, 22 Oct 2020 02:16:26 +0000 (22:16 -0400)]
17010: Fix tests.  Tests check that --enable-reuse is set

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17010: Fix tests
Peter Amstutz [Wed, 21 Oct 2020 21:19:05 +0000 (17:19 -0400)]
17010: Fix tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17010: Fix debug comment
Peter Amstutz [Wed, 21 Oct 2020 20:37:17 +0000 (16:37 -0400)]
17010: Fix debug comment

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17010: When running workflow from workbench, enable reuse by default
Peter Amstutz [Wed, 21 Oct 2020 20:13:50 +0000 (16:13 -0400)]
17010: When running workflow from workbench, enable reuse by default

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago17010: Redesign "Re-run..." button to choose project to run in
Peter Amstutz [Wed, 21 Oct 2020 20:02:12 +0000 (16:02 -0400)]
17010: Redesign "Re-run..." button to choose project to run in

Also move workflow step reuse to the "Inputs" tab instead of a modal.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '16471-install-using-salt' into 2.1-dev
Ward Vandewege [Wed, 21 Oct 2020 16:08:03 +0000 (12:08 -0400)]
Merge branch '16471-install-using-salt' into 2.1-dev

refs #16471

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16930: make run-build-docker-images.sh a little smarter, allow building
Ward Vandewege [Wed, 21 Oct 2020 16:06:26 +0000 (12:06 -0400)]
16930: make run-build-docker-images.sh a little smarter, allow building
           just one type of arvbox images (part 2).

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16930: make run-build-docker-images.sh a little smarter, allow building
Ward Vandewege [Wed, 21 Oct 2020 15:10:00 +0000 (11:10 -0400)]
16930: make run-build-docker-images.sh a little smarter, allow building
       just one type of arvbox images.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16471: documentation: clarify where the Salt scripts can be found.
Ward Vandewege [Tue, 20 Oct 2020 20:31:44 +0000 (16:31 -0400)]
16471: documentation: clarify where the Salt scripts can be found.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agodocs(salt): some minor fixes in the Salt-based installation documentation.
Javier Bértoli [Tue, 20 Oct 2020 11:12:26 +0000 (08:12 -0300)]
docs(salt): some minor fixes in the Salt-based installation documentation.

refs #16471:
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago16471: refactor documentation to reflect different Salt-based
Ward Vandewege [Mon, 19 Oct 2020 17:38:00 +0000 (13:38 -0400)]
16471: refactor documentation to reflect different Salt-based
       installation methods.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16471: fix a few typos.
Ward Vandewege [Mon, 19 Oct 2020 15:40:36 +0000 (11:40 -0400)]
16471: fix a few typos.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoCollection$create returns (vector of) ArvadosFile object
Peter Amstutz [Thu, 15 Oct 2020 16:07:33 +0000 (12:07 -0400)]
Collection$create returns (vector of) ArvadosFile object

Update documentation.

refs #16998

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoUpdate new cluster checklist to reflect the deprecation of the SSO
Ward Vandewege [Mon, 19 Oct 2020 14:24:39 +0000 (10:24 -0400)]
Update new cluster checklist to reflect the deprecation of the SSO
server.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoAdd WebDAV and S3 API documentation
Peter Amstutz [Fri, 9 Oct 2020 22:48:07 +0000 (18:48 -0400)]
Add WebDAV and S3 API documentation

Remove sections of keep-web/doc.go are now part of the API
documentation

refs #16558

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16471: Formatting fixes.
Lucas Di Pentima [Fri, 16 Oct 2020 20:30:08 +0000 (17:30 -0300)]
16471: Formatting fixes.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agodocs(provision): document initial URL
Javier Bértoli [Fri, 16 Oct 2020 19:29:51 +0000 (16:29 -0300)]
docs(provision): document initial URL

refs #16471 and #16992
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agofeat(provision): better testing config and documentation
Javier Bértoli [Fri, 16 Oct 2020 18:30:34 +0000 (15:30 -0300)]
feat(provision): better testing config and documentation

refs #16471 and #16992
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agofeat(provision): example configurations in salt
Javier Bértoli [Fri, 16 Oct 2020 16:25:31 +0000 (13:25 -0300)]
feat(provision): example configurations in salt

refs #16471 and #16992
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoFix heading for "upgrading" no issue #
Peter Amstutz [Wed, 14 Oct 2020 14:29:52 +0000 (10:29 -0400)]
Fix heading for "upgrading" no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agofeat(docs): salt install documentation
Javier Bértoli [Wed, 14 Oct 2020 13:43:32 +0000 (10:43 -0300)]
feat(docs): salt install documentation
refs #16471 and #16992
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agofix(salt): choose repo
Javier Bértoli [Mon, 12 Oct 2020 15:25:16 +0000 (12:25 -0300)]
fix(salt): choose repo

refs #16471 and #16992
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoMerge branch '16992-disable-pg-pager' into master
Ward Vandewege [Wed, 14 Oct 2020 13:31:11 +0000 (09:31 -0400)]
Merge branch '16992-disable-pg-pager' into master

closes #16992

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16992: Merge branch 'master' into 16992-disable-pg-pager
Ward Vandewege [Wed, 14 Oct 2020 13:30:29 +0000 (09:30 -0400)]
16992: Merge branch 'master' into 16992-disable-pg-pager

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16981-sync-group-report-fix'. Refs #16981
Lucas Di Pentima [Tue, 13 Oct 2020 14:16:32 +0000 (11:16 -0300)]
Merge branch '16981-sync-group-report-fix'. Refs #16981

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoMerge branch '16989-fix-fed-migrate' refs #16989 2.1.0
Peter Amstutz [Mon, 12 Oct 2020 19:52:35 +0000 (15:52 -0400)]
Merge branch '16989-fix-fed-migrate' refs #16989

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16989: setup_on_activate needs to happen after update, not before
Peter Amstutz [Mon, 12 Oct 2020 19:42:20 +0000 (15:42 -0400)]
16989: setup_on_activate needs to happen after update, not before

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16989: Don't auto-admin first user in federation migrate test
Peter Amstutz [Mon, 12 Oct 2020 19:23:14 +0000 (15:23 -0400)]
16989: Don't auto-admin first user in federation migrate test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16989: Make sure username is valid before trying to create repo
Peter Amstutz [Mon, 12 Oct 2020 19:18:32 +0000 (15:18 -0400)]
16989: Make sure username is valid before trying to create repo

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16981: Fixes error reporting when failing to create a remote group.
Lucas Di Pentima [Mon, 12 Oct 2020 14:23:18 +0000 (11:23 -0300)]
16981: Fixes error reporting when failing to create a remote group.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoFix a few more golint warnings.
Ward Vandewege [Mon, 12 Oct 2020 02:12:12 +0000 (22:12 -0400)]
Fix a few more golint warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16922: disable the postgres pager in the rails postinst script.
Ward Vandewege [Sat, 10 Oct 2020 12:56:02 +0000 (08:56 -0400)]
16922: disable the postgres pager in the rails postinst script.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoSetup default VM/repo in setup method refs #16989
Peter Amstutz [Sat, 10 Oct 2020 00:12:53 +0000 (20:12 -0400)]
Setup default VM/repo in setup method refs #16989

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoSetup default VM from AutoSetupNewUsersWithVmUUID refs #16989
Peter Amstutz [Fri, 9 Oct 2020 22:52:14 +0000 (18:52 -0400)]
Setup default VM from AutoSetupNewUsersWithVmUUID refs #16989

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '16989-user-setup' refs #16989
Peter Amstutz [Fri, 9 Oct 2020 18:30:58 +0000 (14:30 -0400)]
Merge branch '16989-user-setup' refs #16989

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agofix(salt): temporal fix for database setup issue
Javier Bértoli [Fri, 9 Oct 2020 16:00:51 +0000 (13:00 -0300)]
fix(salt): temporal fix for database setup issue

plus some linting

refs #16471 and #16992
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years ago16989: Test all combinations of remote user status
Peter Amstutz [Fri, 9 Oct 2020 17:00:05 +0000 (13:00 -0400)]
16989: Test all combinations of remote user status

Rework remote user setup/activate/unsetup.  Sending welcome email
moved to model setup method.  Add tests.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16989: Add test to sync is_invited
Peter Amstutz [Fri, 9 Oct 2020 16:26:04 +0000 (12:26 -0400)]
16989: Add test to sync is_invited

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16471: Includes saltstack quick start section on install guide.
Lucas Di Pentima [Fri, 9 Oct 2020 14:23:27 +0000 (11:23 -0300)]
16471: Includes saltstack quick start section on install guide.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoMerge branch '16981-logincluster-sync-groups-fix'
Lucas Di Pentima [Fri, 9 Oct 2020 13:41:09 +0000 (10:41 -0300)]
Merge branch '16981-logincluster-sync-groups-fix'
Refs #16981

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16981: Retrieves the local clusterID from exported config.
Lucas Di Pentima [Thu, 8 Oct 2020 21:01:09 +0000 (18:01 -0300)]
16981: Retrieves the local clusterID from exported config.

Also, fixed tests by not starting a new api server and using what run-tests
provides.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoMerge branch '16976-python-rc-packages' refs #16976
Peter Amstutz [Thu, 8 Oct 2020 18:28:49 +0000 (14:28 -0400)]
Merge branch '16976-python-rc-packages' refs #16976

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16976: use unfiltered version number when checking for deb/rpm of our
Ward Vandewege [Thu, 8 Oct 2020 18:23:19 +0000 (14:23 -0400)]
16976: use unfiltered version number when checking for deb/rpm of our
       Python packages.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16976: Use adjusted version tag to accomodate release candidate packages
Peter Amstutz [Thu, 8 Oct 2020 17:40:18 +0000 (13:40 -0400)]
16976: Use adjusted version tag to accomodate release candidate packages

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16976: Support release candidates for our Python packages
Peter Amstutz [Thu, 8 Oct 2020 16:55:31 +0000 (12:55 -0400)]
16976: Support release candidates for our Python packages

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoWhen doing arvbox hotreset, make sure to use flock around the rake task.
Ward Vandewege [Thu, 8 Oct 2020 03:40:42 +0000 (23:40 -0400)]
When doing arvbox hotreset, make sure to use flock around the rake task.

refs #16955

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16955-more-fixes' into master
Ward Vandewege [Thu, 8 Oct 2020 01:24:28 +0000 (21:24 -0400)]
Merge branch '16955-more-fixes' into master

refs #16955

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoSerialize the service startup in arvbox by adding a dependency on the
Ward Vandewege [Thu, 8 Oct 2020 00:53:22 +0000 (20:53 -0400)]
Serialize the service startup in arvbox by adding a dependency on the
availability of the API server for those services that need it. This
greatly speeds up boot. Also remove superfluous service configuration
for keepproxy.

refs #16955

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agofeat(salt): start salt install documentation
Javier Bértoli [Wed, 7 Oct 2020 21:01:09 +0000 (18:01 -0300)]
feat(salt): start salt install documentation

refs #16471
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@curii.com>

3 years agoMerge branch '16928-non-boolean-param-warning'
Tom Clegg [Wed, 7 Oct 2020 20:37:06 +0000 (16:37 -0400)]
Merge branch '16928-non-boolean-param-warning'

refs #16928

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoActually load our custom sysctl.conf entries.
Ward Vandewege [Wed, 7 Oct 2020 18:33:25 +0000 (14:33 -0400)]
Actually load our custom sysctl.conf entries.

refs #16955

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16928: Avoid misleading warning when using implicit bool defaults.
Tom Clegg [Wed, 7 Oct 2020 17:32:10 +0000 (13:32 -0400)]
16928: Avoid misleading warning when using implicit bool defaults.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16928: Fill in missing bool defaults in *_requires_parameters.
Tom Clegg [Wed, 7 Oct 2020 17:31:03 +0000 (13:31 -0400)]
16928: Fill in missing bool defaults in *_requires_parameters.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16928: Fix advertised default value of include_old_versions.
Tom Clegg [Wed, 7 Oct 2020 17:30:47 +0000 (13:30 -0400)]
16928: Fix advertised default value of include_old_versions.

Also remove special defaults-override logic, now that the existing
load_params code knows the right defaults.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16928: Improve warning message.
Tom Clegg [Wed, 7 Oct 2020 17:25:12 +0000 (13:25 -0400)]
16928: Improve warning message.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16955-fix-arvbox' into master
Ward Vandewege [Wed, 7 Oct 2020 15:45:50 +0000 (11:45 -0400)]
Merge branch '16955-fix-arvbox' into master

closes #16955

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16955: Merge branch 'master' into 16955-fix-arvbox
Ward Vandewege [Wed, 7 Oct 2020 15:45:09 +0000 (11:45 -0400)]
16955: Merge branch 'master' into 16955-fix-arvbox

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16955: a number of fixes to make the federation migration tests pass
Ward Vandewege [Wed, 7 Oct 2020 01:06:01 +0000 (21:06 -0400)]
16955: a number of fixes to make the federation migration tests pass
       with arvbox again. Followup to #16267.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16956-doc-fix-zenweb-liquid-4' into master
Ward Vandewege [Tue, 6 Oct 2020 21:23:23 +0000 (17:23 -0400)]
Merge branch '16956-doc-fix-zenweb-liquid-4' into master

closes #16956

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16956: address review comments.
Ward Vandewege [Tue, 6 Oct 2020 21:14:48 +0000 (17:14 -0400)]
16956: address review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16956: update our zenweb/liquid package to support liquid 4+
Ward Vandewege [Tue, 6 Oct 2020 18:02:17 +0000 (14:02 -0400)]
16956: update our zenweb/liquid package to support liquid 4+

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16809-s3-v4-signature'
Tom Clegg [Tue, 6 Oct 2020 17:56:07 +0000 (13:56 -0400)]
Merge branch '16809-s3-v4-signature'

closes #16809

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoFix arv-federation-migrate-test jenkins job: update hardcoded arvbox
Ward Vandewege [Tue, 6 Oct 2020 15:55:41 +0000 (11:55 -0400)]
Fix arv-federation-migrate-test jenkins job: update hardcoded arvbox
container paths.

refs #16267

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFix arvados-cwl-conformance-tests and arv-federation-migrate-test
Ward Vandewege [Tue, 6 Oct 2020 13:47:55 +0000 (09:47 -0400)]
Fix arvados-cwl-conformance-tests and arv-federation-migrate-test
jenkins jobs.

refs #16267

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFix more golint warnings.
Ward Vandewege [Tue, 6 Oct 2020 00:26:10 +0000 (20:26 -0400)]
Fix more golint warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoCan't use generic copy for container requests refs #16886
Peter Amstutz [Mon, 5 Oct 2020 18:18:27 +0000 (14:18 -0400)]
Can't use generic copy for container requests refs #16886

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16809: Test S3 API using Amazon client library.
Tom Clegg [Mon, 5 Oct 2020 18:13:00 +0000 (14:13 -0400)]
16809: Test S3 API using Amazon client library.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoFix 'test' login method to return v2 token, no issue #
Peter Amstutz [Mon, 5 Oct 2020 18:01:36 +0000 (14:01 -0400)]
Fix 'test' login method to return v2 token, no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoFix more golint warnings.
Ward Vandewege [Sun, 4 Oct 2020 21:25:37 +0000 (17:25 -0400)]
Fix more golint warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoAdd a cli example: create an empty collection.
Ward Vandewege [Sun, 4 Oct 2020 21:10:27 +0000 (17:10 -0400)]
Add a cli example: create an empty collection.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16750-logincluster-wb1-trash-fix'
Lucas Di Pentima [Sat, 3 Oct 2020 14:29:57 +0000 (11:29 -0300)]
Merge branch '16750-logincluster-wb1-trash-fix'
Closes #16750

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoFix some more golint warnings.
Ward Vandewege [Sat, 3 Oct 2020 01:10:19 +0000 (21:10 -0400)]
Fix some more golint warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16750: Avoids using params on requests to make it compatible with federation.
Lucas Di Pentima [Thu, 1 Oct 2020 13:52:23 +0000 (10:52 -0300)]
16750: Avoids using params on requests to make it compatible with federation.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoFixes collection_versioning mention on documentation. No issue #
Lucas Di Pentima [Fri, 2 Oct 2020 14:48:14 +0000 (11:48 -0300)]
Fixes collection_versioning mention on documentation. No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoFix more golint warnings.
Ward Vandewege [Thu, 1 Oct 2020 23:44:14 +0000 (19:44 -0400)]
Fix more golint warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16923-auth-api-client' refs #16923
Peter Amstutz [Thu, 1 Oct 2020 22:12:03 +0000 (18:12 -0400)]
Merge branch '16923-auth-api-client' refs #16923

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16923: Improve architecture diagram a bit.
Peter Amstutz [Thu, 1 Oct 2020 22:09:50 +0000 (18:09 -0400)]
16923: Improve architecture diagram a bit.

Fix comment about TrustedClients config item.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoarvados-cwl-runner, don't pull arvados/jobs:latest, pull arvados/jobs:version
Peter Amstutz [Thu, 1 Oct 2020 20:46:08 +0000 (16:46 -0400)]
arvados-cwl-runner, don't pull arvados/jobs:latest, pull arvados/jobs:version

refs #16886

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16923: Add Login.TrustedClients to export
Peter Amstutz [Thu, 1 Oct 2020 19:11:44 +0000 (15:11 -0400)]
16923: Add Login.TrustedClients to export

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16923: Add peer federation / logincluster federation to architecture
Peter Amstutz [Thu, 1 Oct 2020 17:58:43 +0000 (13:58 -0400)]
16923: Add peer federation / logincluster federation to architecture

Also rearrange the high-level architecture diagram a little bit.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16923: Add note about federation types and trusted clients.
Peter Amstutz [Wed, 30 Sep 2020 18:08:12 +0000 (14:08 -0400)]
16923: Add note about federation types and trusted clients.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16923: Add "TrustedClients" configuration option.
Peter Amstutz [Tue, 29 Sep 2020 23:12:50 +0000 (19:12 -0400)]
16923: Add "TrustedClients" configuration option.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16923: user/pass api_client is trusted by default
Peter Amstutz [Tue, 29 Sep 2020 21:26:46 +0000 (17:26 -0400)]
16923: user/pass api_client is trusted by default

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoUserGet() passes "select" option along to batch update refs #16914
Peter Amstutz [Wed, 30 Sep 2020 21:13:59 +0000 (17:13 -0400)]
UserGet() passes "select" option along to batch update refs #16914

Fixes issue of user being deactivated because something called "get
user" and selected fields didn't include is_active.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agolibpam-arvados-go: do not put a file with comments in
Ward Vandewege [Tue, 29 Sep 2020 21:53:53 +0000 (17:53 -0400)]
libpam-arvados-go: do not put a file with comments in
/usr/share/pam-configs, the `pam-auth-update` command does not take
kindly to that. Put that file in the package documentation directory
instead.

refs #15348

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoAdjust arvbox shell to have /var/lib/arvados/bin in PATH
Peter Amstutz [Tue, 29 Sep 2020 19:42:54 +0000 (15:42 -0400)]
Adjust arvbox shell to have /var/lib/arvados/bin in PATH

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>