arvados.git
3 years ago16171: Add OIDC config keys to export whitelist.
Tom Clegg [Mon, 1 Jun 2020 15:08:06 +0000 (11:08 -0400)]
16171: Add OIDC config keys to export whitelist.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16171: Tidy up config test.
Tom Clegg [Mon, 1 Jun 2020 14:28:15 +0000 (10:28 -0400)]
16171: Tidy up config test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16171: Don't use Google as example of non-Google OIDC issuer.
Tom Clegg [Mon, 1 Jun 2020 14:17:21 +0000 (10:17 -0400)]
16171: Don't use Google as example of non-Google OIDC issuer.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16427: Fix test order dependency.
Tom Clegg [Mon, 1 Jun 2020 13:42:22 +0000 (09:42 -0400)]
16427: Fix test order dependency.

Test was incorrectly assuming keep2, keep3 data dirs existed.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16171: Support non-Google OpenID Connect auth provider.
Tom Clegg [Sun, 31 May 2020 23:57:11 +0000 (19:57 -0400)]
16171: Support non-Google OpenID Connect auth provider.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16427: Move blob signing test cases to arvados pkg.
Tom Clegg [Fri, 29 May 2020 20:38:24 +0000 (16:38 -0400)]
16427: Move blob signing test cases to arvados pkg.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16427: Add test cases.
Tom Clegg [Fri, 29 May 2020 14:41:37 +0000 (10:41 -0400)]
16427: Add test cases.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16427: Touch block timestamps to avoid garbage collection race.
Tom Clegg [Fri, 29 May 2020 14:36:13 +0000 (10:36 -0400)]
16427: Touch block timestamps to avoid garbage collection race.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16007: Add comment about override_edge_* parameters
Peter Amstutz [Fri, 29 May 2020 02:22:57 +0000 (22:22 -0400)]
16007: Add comment about override_edge_* parameters

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16007: Ensure that updated permission edge overrides edges view
Peter Amstutz [Fri, 29 May 2020 01:41:46 +0000 (21:41 -0400)]
16007: Ensure that updated permission edge overrides edges view

An edge originating from a user can be traversed more than once, if
that edge is the same as the one being updated, ensure that it uses
the updated permission level and not the permission from the edges
view.  Necessary when revoking permissions.

Also moved comments into the body of the postgres functions to bring
them closer to the code, this also has the convenient effect of having
the comments appear in structure.sql function definitions so as to be
easier for future developers to find.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16007: Enable permission correctness checking (only for tests)
Peter Amstutz [Thu, 28 May 2020 19:35:29 +0000 (15:35 -0400)]
16007: Enable permission correctness checking (only for tests)

* Explicitly set up a transaction in update_permissions
* Rename refresh_permission_view.rb -> update_permissions.rb
* Add skip_check_permissions_against_full_refresh

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16007: refresh_trashed uses a transaction
Peter Amstutz [Tue, 26 May 2020 19:12:56 +0000 (15:12 -0400)]
16007: refresh_trashed uses a transaction

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16007: More code comment detail about compute_permission_subgraph query
Peter Amstutz [Tue, 26 May 2020 18:11:24 +0000 (14:11 -0400)]
16007: More code comment detail about compute_permission_subgraph query

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16007: Lots and lots lots of method documentation via code comments.
Peter Amstutz [Fri, 22 May 2020 19:00:22 +0000 (15:00 -0400)]
16007: Lots and lots lots of method documentation via code comments.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16007: Use incremental updates instead of materialized view for permissions
Peter Amstutz [Fri, 1 May 2020 18:26:35 +0000 (14:26 -0400)]
16007: Use incremental updates instead of materialized view for permissions

Separate 'trashed' from 'permissions' and remove 'trashed' from
permission computation.  Add postgres functions for computing trash
and update trashed_groups incrementally.  Make sure trash table gets
refreshed on database reset.  readable_by() now checks trash_at timestamp.

Drop materialized view and replace with a table that is updated
incrementally.  Add postgres functions for computing permissions.
Initialize materialized_permissions from search_permission_graph.
Call refresh_permissions in database_seeds.  Add index on
materialized_permissions.target_uuid.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16427: Add "touch" API to keepstore.
Tom Clegg [Thu, 28 May 2020 13:40:44 +0000 (09:40 -0400)]
16427: Add "touch" API to keepstore.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '15881-ldap'
Tom Clegg [Wed, 27 May 2020 20:10:06 +0000 (16:10 -0400)]
Merge branch '15881-ldap'

refs #15881

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16435-sync-groups-perm-levels'
Lucas Di Pentima [Wed, 27 May 2020 19:04:47 +0000 (16:04 -0300)]
Merge branch '16435-sync-groups-perm-levels'
Closes #16435

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16171: Rename googleLoginController to oidcLoginController.
Tom Clegg [Wed, 27 May 2020 13:44:36 +0000 (09:44 -0400)]
16171: Rename googleLoginController to oidcLoginController.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoThe arvados kubernetes repository has been renamed to arvados-k8s.
Ward Vandewege [Tue, 26 May 2020 13:40:48 +0000 (09:40 -0400)]
The arvados kubernetes repository has been renamed to arvados-k8s.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years agodoc: fix typo on admin/federation page.
Ward Vandewege [Fri, 22 May 2020 12:18:06 +0000 (08:18 -0400)]
doc: fix typo on admin/federation page.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years ago16435: Merge branch 'master' into 16435-sync-groups-perm-levels
Lucas Di Pentima [Thu, 21 May 2020 23:09:38 +0000 (20:09 -0300)]
16435: Merge branch 'master' into 16435-sync-groups-perm-levels

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16435: Updates the documentation.
Lucas Di Pentima [Thu, 21 May 2020 23:08:40 +0000 (20:08 -0300)]
16435: Updates the documentation.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16435: Adds & updates tests.
Lucas Di Pentima [Thu, 21 May 2020 22:00:37 +0000 (19:00 -0300)]
16435: Adds & updates tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16435: Avoids creating duplicated group->user links.
Lucas Di Pentima [Thu, 21 May 2020 21:11:10 +0000 (18:11 -0300)]
16435: Avoids creating duplicated group->user links.

When a user needs a permission change, the g->u link already exists.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago15881: Elaborate on SearchFilters behavior/uses.
Tom Clegg [Thu, 21 May 2020 20:10:12 +0000 (16:10 -0400)]
15881: Elaborate on SearchFilters behavior/uses.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16427: Add arvados-server undelete command.
Tom Clegg [Thu, 21 May 2020 19:48:19 +0000 (15:48 -0400)]
16427: Add arvados-server undelete command.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16435: Adds support for different permission levels: read, write & manage.
Lucas Di Pentima [Thu, 21 May 2020 19:21:12 +0000 (16:21 -0300)]
16435: Adds support for different permission levels: read, write & manage.

If the 3rd field isn't present on any record, it will fallback to 'can_write'
to maintain backwards compatibility.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoWhen building/testing debian packages, run-build-packages-one-target.sh
Ward Vandewege [Thu, 21 May 2020 15:22:08 +0000 (11:22 -0400)]
When building/testing debian packages, run-build-packages-one-target.sh
now tests for the presence of dpkg-scanpackages and apt-ftparchive and
aborts if they are not present.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years agoMerge branch '16419-ssl-cert-file' refs #16419
Peter Amstutz [Thu, 21 May 2020 14:22:35 +0000 (10:22 -0400)]
Merge branch '16419-ssl-cert-file' refs #16419

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16419: Use CAINFO instead of CAPATH
Peter Amstutz [Thu, 21 May 2020 13:51:03 +0000 (09:51 -0400)]
16419: Use CAINFO instead of CAPATH

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16427: Move signing code to sdk/go/arvados, add SignManifest.
Tom Clegg [Thu, 21 May 2020 13:48:24 +0000 (09:48 -0400)]
16427: Move signing code to sdk/go/arvados, add SignManifest.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16435: Allows 2 or 3 fields per record on the CSV file.
Lucas Di Pentima [Wed, 20 May 2020 21:23:08 +0000 (18:23 -0300)]
16435: Allows 2 or 3 fields per record on the CSV file.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agokeep.py: python-api https certificate align pycurl with httplib2 certificate finder
Pjotr Prins [Wed, 20 May 2020 19:35:54 +0000 (14:35 -0500)]
keep.py: python-api https certificate align pycurl with httplib2 certificate finder

Arvados-DCO-1.1-Signed-off-by: Pjotr Prins <pjotr.public01@thebird.nl>

3 years agoutil.py: python-api https certificate openssl override as is used in GNU Guix
Pjotr Prins [Wed, 20 May 2020 16:12:20 +0000 (11:12 -0500)]
util.py: python-api https certificate openssl override as is used in GNU Guix

Arvados-DCO-1.1-Signed-off-by: Pjotr Prins <pjotr.public01@thebird.nl>

3 years agoMerge branch '16312-s3-signature-v4'
Tom Clegg [Wed, 20 May 2020 14:14:41 +0000 (10:14 -0400)]
Merge branch '16312-s3-signature-v4'

closes #16312

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16319-timestamp-precision'
Tom Clegg [Wed, 20 May 2020 14:10:58 +0000 (10:10 -0400)]
Merge branch '16319-timestamp-precision'

refs #16319

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16451-run-tests-interactive-run-test-many-times'
Ward Vandewege [Wed, 20 May 2020 14:00:47 +0000 (10:00 -0400)]
Merge branch '16451-run-tests-interactive-run-test-many-times'

closes #16451

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years ago16451: do not leave testargs as a space when there are no opts provided.
Ward Vandewege [Wed, 20 May 2020 13:54:08 +0000 (09:54 -0400)]
16451: do not leave testargs as a space when there are no opts provided.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years ago16451: make it possible to run a test many times in interactive mode.
Ward Vandewege [Tue, 19 May 2020 20:53:11 +0000 (16:53 -0400)]
16451: make it possible to run a test many times in interactive mode.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years ago16319: Count Utimes stats.
Tom Clegg [Wed, 20 May 2020 13:59:00 +0000 (09:59 -0400)]
16319: Count Utimes stats.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16319: Use stdlib func Chtimes instead of UtimesNano syscall.
Tom Clegg [Wed, 20 May 2020 13:49:29 +0000 (09:49 -0400)]
16319: Use stdlib func Chtimes instead of UtimesNano syscall.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16319-set-test-db-collation'
Tom Clegg [Wed, 20 May 2020 13:45:30 +0000 (09:45 -0400)]
Merge branch '16319-set-test-db-collation'

refs #16319

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16319: Fix restarting postgresql twice.
Tom Clegg [Wed, 20 May 2020 08:03:08 +0000 (04:03 -0400)]
16319: Fix restarting postgresql twice.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16319: Use high precision clock for file timestamps.
Tom Clegg [Wed, 20 May 2020 03:35:33 +0000 (23:35 -0400)]
16319: Use high precision clock for file timestamps.

Fixes occasional test failures caused by artificially old file
timestamps.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoRestart postgresql before trying to create missing collation.
Tom Clegg [Tue, 19 May 2020 20:05:59 +0000 (16:05 -0400)]
Restart postgresql before trying to create missing collation.

refs #16319

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoUse selenium for tests that rely on HTTP redirects.
Tom Clegg [Tue, 19 May 2020 15:02:46 +0000 (11:02 -0400)]
Use selenium for tests that rely on HTTP redirects.

phantomjs doesn't seem to follow them any more.

refs #16319

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16319-set-test-db-collation'
Tom Clegg [Tue, 19 May 2020 13:40:10 +0000 (09:40 -0400)]
Merge branch '16319-set-test-db-collation'

refs #16319

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16319: Specify en_US.UTF-8 collation when creating test database.
Tom Clegg [Mon, 18 May 2020 19:37:08 +0000 (15:37 -0400)]
16319: Specify en_US.UTF-8 collation when creating test database.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '16434-fix-python3-arvados-cwl-runner-packaging'
Ward Vandewege [Fri, 15 May 2020 01:01:02 +0000 (21:01 -0400)]
Merge branch '16434-fix-python3-arvados-cwl-runner-packaging'

closes #16434

4 years agobugfix: fix arvados-node-manager package build
Ward Vandewege [Fri, 15 May 2020 00:57:49 +0000 (20:57 -0400)]
bugfix: fix arvados-node-manager package build

refs #16373

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years ago16434: add a basic execution test for the python3-arvados-cwl-runner packages
Ward Vandewege [Fri, 15 May 2020 00:40:55 +0000 (20:40 -0400)]
16434: add a basic execution test for the python3-arvados-cwl-runner packages

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years agoFix comment typos in run-library.sh
Ward Vandewege [Fri, 15 May 2020 00:40:14 +0000 (20:40 -0400)]
Fix comment typos in run-library.sh

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years ago16434: the python3-arvados-cwl-runner packages on Debian 10 and Ubuntu
Ward Vandewege [Fri, 15 May 2020 00:39:13 +0000 (20:39 -0400)]
16434: the python3-arvados-cwl-runner packages on Debian 10 and Ubuntu
18.04 (and later, presumably) have a dependency on the
python3-distutils package.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years agoWe only build the python3 version of the arvados-cwl-runner package now.
Ward Vandewege [Fri, 15 May 2020 00:30:05 +0000 (20:30 -0400)]
We only build the python3 version of the arvados-cwl-runner package now.

refs #12409

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years ago16312: Test V2Signature config.
Tom Clegg [Thu, 14 May 2020 20:11:42 +0000 (16:11 -0400)]
16312: Test V2Signature config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16312: Use V4 signatures for all AWS regions. Add config override.
Tom Clegg [Thu, 14 May 2020 19:25:21 +0000 (15:25 -0400)]
16312: Use V4 signatures for all AWS regions. Add config override.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '16387-batch-update-deactivated-user'
Tom Clegg [Thu, 14 May 2020 19:06:49 +0000 (15:06 -0400)]
Merge branch '16387-batch-update-deactivated-user'

fixes #16387

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '15881-ldap'
Tom Clegg [Thu, 14 May 2020 17:38:04 +0000 (13:38 -0400)]
Merge branch '15881-ldap'

refs #15881

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoFix typo.
Tom Clegg [Thu, 14 May 2020 15:15:48 +0000 (11:15 -0400)]
Fix typo.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15881: Remove unreferenced doc page install/install-components.html.
Tom Clegg [Thu, 14 May 2020 15:12:45 +0000 (11:12 -0400)]
15881: Remove unreferenced doc page install/install-components.html.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15881: Remove duplicate section, update test URL.
Tom Clegg [Thu, 14 May 2020 15:09:03 +0000 (11:09 -0400)]
15881: Remove duplicate section, update test URL.

//ws/status.json has been removed.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15881: Fix typo.
Tom Clegg [Thu, 14 May 2020 14:56:43 +0000 (10:56 -0400)]
15881: Fix typo.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '16391-sbatch-error-logging'
Tom Clegg [Thu, 14 May 2020 14:21:25 +0000 (10:21 -0400)]
Merge branch '16391-sbatch-error-logging'

fixes #16391

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16391: Fix log message.
Tom Clegg [Wed, 13 May 2020 21:07:11 +0000 (17:07 -0400)]
16391: Fix log message.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '16392-url-trailing-slash'
Tom Clegg [Wed, 13 May 2020 20:16:42 +0000 (16:16 -0400)]
Merge branch '16392-url-trailing-slash'

refs #16392

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15881: Skip docker tests if docker is not available.
Tom Clegg [Wed, 13 May 2020 20:12:39 +0000 (16:12 -0400)]
15881: Skip docker tests if docker is not available.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15881: Add "remove sso-provider" to upgrade notes.
Tom Clegg [Wed, 13 May 2020 19:25:11 +0000 (15:25 -0400)]
15881: Add "remove sso-provider" to upgrade notes.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15881: Remove SSO install instructions.
Tom Clegg [Wed, 13 May 2020 19:13:34 +0000 (15:13 -0400)]
15881: Remove SSO install instructions.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15881: Enable docker tests, unless -short mode.
Tom Clegg [Wed, 13 May 2020 17:47:37 +0000 (13:47 -0400)]
15881: Enable docker tests, unless -short mode.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15881: Update config keys.
Tom Clegg [Wed, 13 May 2020 17:45:11 +0000 (13:45 -0400)]
15881: Update config keys.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15881: Fail faster on config error.
Tom Clegg [Wed, 13 May 2020 17:45:00 +0000 (13:45 -0400)]
15881: Fail faster on config error.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15881: Test ldap with fake ldap server.
Tom Clegg [Wed, 13 May 2020 14:56:32 +0000 (10:56 -0400)]
15881: Test ldap with fake ldap server.

Adds file missing from 8f435f4ba.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16392: Update tests.
Tom Clegg [Tue, 12 May 2020 23:01:54 +0000 (19:01 -0400)]
16392: Update tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '16118-arvboot-fixes'
Lucas Di Pentima [Tue, 12 May 2020 13:27:31 +0000 (10:27 -0300)]
Merge branch '16118-arvboot-fixes'
Refs #16118

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16118: Set URL path to '/' to all services instead of just keep-web.
Lucas Di Pentima [Tue, 12 May 2020 12:46:40 +0000 (09:46 -0300)]
16118: Set URL path to '/' to all services instead of just keep-web.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16392: Add trailing slash to URLs like https://example in configs.
Tom Clegg [Tue, 12 May 2020 07:51:38 +0000 (03:51 -0400)]
16392: Add trailing slash to URLs like https://example in configs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16118: Keep-web initializes its client pool from config instead of envvars.
Lucas Di Pentima [Mon, 11 May 2020 18:26:28 +0000 (15:26 -0300)]
16118: Keep-web initializes its client pool from config instead of envvars.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoMerge branch '16339-cwl-schema-refs' refs #16339
Peter Amstutz [Mon, 11 May 2020 15:08:47 +0000 (11:08 -0400)]
Merge branch '16339-cwl-schema-refs' refs #16339

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16339: Fix $schemas rewriting bug
Peter Amstutz [Mon, 11 May 2020 15:08:01 +0000 (11:08 -0400)]
16339: Fix $schemas rewriting bug

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago15881: Update config keys in tests.
Tom Clegg [Mon, 11 May 2020 15:06:03 +0000 (11:06 -0400)]
15881: Update config keys in tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15881: Update config keys in rails api.
Tom Clegg [Mon, 11 May 2020 13:59:31 +0000 (09:59 -0400)]
15881: Update config keys in rails api.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15881: Update config keys in tests.
Tom Clegg [Mon, 11 May 2020 13:59:20 +0000 (09:59 -0400)]
15881: Update config keys in tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15881: Remove debug printf.
Tom Clegg [Fri, 8 May 2020 20:29:38 +0000 (16:29 -0400)]
15881: Remove debug printf.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15881: Test ldap login with fake ldap server.
Tom Clegg [Fri, 8 May 2020 19:28:56 +0000 (15:28 -0400)]
15881: Test ldap login with fake ldap server.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15881: Update test config.
Tom Clegg [Fri, 8 May 2020 19:28:44 +0000 (15:28 -0400)]
15881: Update test config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15881: Add missing details on doc page.
Tom Clegg [Fri, 8 May 2020 17:50:47 +0000 (13:50 -0400)]
15881: Add missing details on doc page.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15881: Move Google, SSO, and PAM configs into their own sections.
Tom Clegg [Fri, 8 May 2020 17:46:44 +0000 (13:46 -0400)]
15881: Move Google, SSO, and PAM configs into their own sections.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16118: Fixes ExternalURL configs for keep-web & websocket.
Lucas Di Pentima [Thu, 7 May 2020 21:38:08 +0000 (18:38 -0300)]
16118: Fixes ExternalURL configs for keep-web & websocket.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago15881: Add LDAP option to install docs.
Tom Clegg [Thu, 7 May 2020 15:07:48 +0000 (11:07 -0400)]
15881: Add LDAP option to install docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoBugfix: make the arvados-docker-cleaner packages install their systemd
Ward Vandewege [Thu, 7 May 2020 14:20:50 +0000 (10:20 -0400)]
Bugfix: make the arvados-docker-cleaner packages install their systemd
unit file in the correct directory.

closes #16373

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years ago15881: Add LDAP authentication option.
Tom Clegg [Thu, 7 May 2020 04:38:23 +0000 (00:38 -0400)]
15881: Add LDAP authentication option.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16387: Allow setting is_active=false only on LoginCluster users.
Tom Clegg [Wed, 6 May 2020 19:39:30 +0000 (15:39 -0400)]
16387: Allow setting is_active=false only on LoginCluster users.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '16393-keepproxy-timeout-with-slow-clients'
Ward Vandewege [Mon, 4 May 2020 17:37:21 +0000 (13:37 -0400)]
Merge branch '16393-keepproxy-timeout-with-slow-clients'

closes #16393

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years ago16393: keepproxy used cluster.API.KeepServiceRequestTimeout (defaults to
Ward Vandewege [Fri, 1 May 2020 20:55:01 +0000 (16:55 -0400)]
16393: keepproxy used cluster.API.KeepServiceRequestTimeout (defaults to
15s) as the timeout on its connection to the keepstores. When a slow client
sends blocks to keepproxy, they get streamed through to keepstore, and
the upload can take more than cluster.API.KeepServiceRequestTimeout
seconds. Update keepproxy to use keepclient.DefaultProxyRequestTimeout
(300s) instead when it connects to the keepstores.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years ago16387: Allow batch update to set is_active=false for a remote user.
Tom Clegg [Mon, 4 May 2020 14:53:21 +0000 (10:53 -0400)]
16387: Allow batch update to set is_active=false for a remote user.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16387: Test updating cache after deactivating user.
Tom Clegg [Mon, 4 May 2020 14:51:57 +0000 (10:51 -0400)]
16387: Test updating cache after deactivating user.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoAdd StartedAt and FinishedAt fields to arvados.Container.
Tom Clegg [Fri, 1 May 2020 19:58:58 +0000 (15:58 -0400)]
Add StartedAt and FinishedAt fields to arvados.Container.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '16349-non-utc-timestamps'
Tom Clegg [Fri, 1 May 2020 19:10:44 +0000 (15:10 -0400)]
Merge branch '16349-non-utc-timestamps'

fixes #16349

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '16212-pam-install-docs'
Tom Clegg [Fri, 1 May 2020 18:51:41 +0000 (14:51 -0400)]
Merge branch '16212-pam-install-docs'

refs #16212

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>