arvados.git
3 years ago16007: Fix typo & use query parameters
Peter Amstutz [Fri, 5 Jun 2020 21:02:28 +0000 (17:02 -0400)]
16007: Fix typo & use query parameters

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16007: Refactoring and update comments.
Peter Amstutz [Fri, 5 Jun 2020 20:20:24 +0000 (16:20 -0400)]
16007: Refactoring and update comments.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16007: Special handing for users with permissions on other users
Peter Amstutz [Thu, 4 Jun 2020 20:58:18 +0000 (16:58 -0400)]
16007: Special handing for users with permissions on other users

Revise & simplify permission traversal.  Don't traverse users except
when starting from the user (origin_uuid = starting_uuid).

This avoids disasterous queries where we re-traverse other users "just
in case" and end up recomputing the whole database.  As a tradeoff,
our epic readable_by query gets a touch more epic, as it now has to go
to the permissions table to check if there are other user permissions
the current user also is allowed to use.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16007: Add comment about override_edge_* parameters
Peter Amstutz [Fri, 29 May 2020 02:22:57 +0000 (22:22 -0400)]
16007: Add comment about override_edge_* parameters

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16007: Ensure that updated permission edge overrides edges view
Peter Amstutz [Fri, 29 May 2020 01:41:46 +0000 (21:41 -0400)]
16007: Ensure that updated permission edge overrides edges view

An edge originating from a user can be traversed more than once, if
that edge is the same as the one being updated, ensure that it uses
the updated permission level and not the permission from the edges
view.  Necessary when revoking permissions.

Also moved comments into the body of the postgres functions to bring
them closer to the code, this also has the convenient effect of having
the comments appear in structure.sql function definitions so as to be
easier for future developers to find.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16007: Enable permission correctness checking (only for tests)
Peter Amstutz [Thu, 28 May 2020 19:35:29 +0000 (15:35 -0400)]
16007: Enable permission correctness checking (only for tests)

* Explicitly set up a transaction in update_permissions
* Rename refresh_permission_view.rb -> update_permissions.rb
* Add skip_check_permissions_against_full_refresh

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16007: refresh_trashed uses a transaction
Peter Amstutz [Tue, 26 May 2020 19:12:56 +0000 (15:12 -0400)]
16007: refresh_trashed uses a transaction

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16007: More code comment detail about compute_permission_subgraph query
Peter Amstutz [Tue, 26 May 2020 18:11:24 +0000 (14:11 -0400)]
16007: More code comment detail about compute_permission_subgraph query

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16007: Lots and lots lots of method documentation via code comments.
Peter Amstutz [Fri, 22 May 2020 19:00:22 +0000 (15:00 -0400)]
16007: Lots and lots lots of method documentation via code comments.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16007: Use incremental updates instead of materialized view for permissions
Peter Amstutz [Fri, 1 May 2020 18:26:35 +0000 (14:26 -0400)]
16007: Use incremental updates instead of materialized view for permissions

Separate 'trashed' from 'permissions' and remove 'trashed' from
permission computation.  Add postgres functions for computing trash
and update trashed_groups incrementally.  Make sure trash table gets
refreshed on database reset.  readable_by() now checks trash_at timestamp.

Drop materialized view and replace with a table that is updated
incrementally.  Add postgres functions for computing permissions.
Initialize materialized_permissions from search_permission_graph.
Call refresh_permissions in database_seeds.  Add index on
materialized_permissions.target_uuid.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoThe arvados kubernetes repository has been renamed to arvados-k8s.
Ward Vandewege [Tue, 26 May 2020 13:40:48 +0000 (09:40 -0400)]
The arvados kubernetes repository has been renamed to arvados-k8s.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years agodoc: fix typo on admin/federation page.
Ward Vandewege [Fri, 22 May 2020 12:18:06 +0000 (08:18 -0400)]
doc: fix typo on admin/federation page.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years agoWhen building/testing debian packages, run-build-packages-one-target.sh
Ward Vandewege [Thu, 21 May 2020 15:22:08 +0000 (11:22 -0400)]
When building/testing debian packages, run-build-packages-one-target.sh
now tests for the presence of dpkg-scanpackages and apt-ftparchive and
aborts if they are not present.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years agoMerge branch '16419-ssl-cert-file' refs #16419
Peter Amstutz [Thu, 21 May 2020 14:22:35 +0000 (10:22 -0400)]
Merge branch '16419-ssl-cert-file' refs #16419

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16419: Use CAINFO instead of CAPATH
Peter Amstutz [Thu, 21 May 2020 13:51:03 +0000 (09:51 -0400)]
16419: Use CAINFO instead of CAPATH

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agokeep.py: python-api https certificate align pycurl with httplib2 certificate finder
Pjotr Prins [Wed, 20 May 2020 19:35:54 +0000 (14:35 -0500)]
keep.py: python-api https certificate align pycurl with httplib2 certificate finder

Arvados-DCO-1.1-Signed-off-by: Pjotr Prins <pjotr.public01@thebird.nl>

3 years agoutil.py: python-api https certificate openssl override as is used in GNU Guix
Pjotr Prins [Wed, 20 May 2020 16:12:20 +0000 (11:12 -0500)]
util.py: python-api https certificate openssl override as is used in GNU Guix

Arvados-DCO-1.1-Signed-off-by: Pjotr Prins <pjotr.public01@thebird.nl>

3 years agoMerge branch '16312-s3-signature-v4'
Tom Clegg [Wed, 20 May 2020 14:14:41 +0000 (10:14 -0400)]
Merge branch '16312-s3-signature-v4'

closes #16312

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16319-timestamp-precision'
Tom Clegg [Wed, 20 May 2020 14:10:58 +0000 (10:10 -0400)]
Merge branch '16319-timestamp-precision'

refs #16319

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16451-run-tests-interactive-run-test-many-times'
Ward Vandewege [Wed, 20 May 2020 14:00:47 +0000 (10:00 -0400)]
Merge branch '16451-run-tests-interactive-run-test-many-times'

closes #16451

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years ago16451: do not leave testargs as a space when there are no opts provided.
Ward Vandewege [Wed, 20 May 2020 13:54:08 +0000 (09:54 -0400)]
16451: do not leave testargs as a space when there are no opts provided.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years ago16451: make it possible to run a test many times in interactive mode.
Ward Vandewege [Tue, 19 May 2020 20:53:11 +0000 (16:53 -0400)]
16451: make it possible to run a test many times in interactive mode.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years ago16319: Count Utimes stats.
Tom Clegg [Wed, 20 May 2020 13:59:00 +0000 (09:59 -0400)]
16319: Count Utimes stats.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16319: Use stdlib func Chtimes instead of UtimesNano syscall.
Tom Clegg [Wed, 20 May 2020 13:49:29 +0000 (09:49 -0400)]
16319: Use stdlib func Chtimes instead of UtimesNano syscall.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16319-set-test-db-collation'
Tom Clegg [Wed, 20 May 2020 13:45:30 +0000 (09:45 -0400)]
Merge branch '16319-set-test-db-collation'

refs #16319

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16319: Fix restarting postgresql twice.
Tom Clegg [Wed, 20 May 2020 08:03:08 +0000 (04:03 -0400)]
16319: Fix restarting postgresql twice.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16319: Use high precision clock for file timestamps.
Tom Clegg [Wed, 20 May 2020 03:35:33 +0000 (23:35 -0400)]
16319: Use high precision clock for file timestamps.

Fixes occasional test failures caused by artificially old file
timestamps.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoRestart postgresql before trying to create missing collation.
Tom Clegg [Tue, 19 May 2020 20:05:59 +0000 (16:05 -0400)]
Restart postgresql before trying to create missing collation.

refs #16319

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoUse selenium for tests that rely on HTTP redirects.
Tom Clegg [Tue, 19 May 2020 15:02:46 +0000 (11:02 -0400)]
Use selenium for tests that rely on HTTP redirects.

phantomjs doesn't seem to follow them any more.

refs #16319

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16319-set-test-db-collation'
Tom Clegg [Tue, 19 May 2020 13:40:10 +0000 (09:40 -0400)]
Merge branch '16319-set-test-db-collation'

refs #16319

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16319: Specify en_US.UTF-8 collation when creating test database.
Tom Clegg [Mon, 18 May 2020 19:37:08 +0000 (15:37 -0400)]
16319: Specify en_US.UTF-8 collation when creating test database.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16434-fix-python3-arvados-cwl-runner-packaging'
Ward Vandewege [Fri, 15 May 2020 01:01:02 +0000 (21:01 -0400)]
Merge branch '16434-fix-python3-arvados-cwl-runner-packaging'

closes #16434

3 years agobugfix: fix arvados-node-manager package build
Ward Vandewege [Fri, 15 May 2020 00:57:49 +0000 (20:57 -0400)]
bugfix: fix arvados-node-manager package build

refs #16373

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years ago16434: add a basic execution test for the python3-arvados-cwl-runner packages
Ward Vandewege [Fri, 15 May 2020 00:40:55 +0000 (20:40 -0400)]
16434: add a basic execution test for the python3-arvados-cwl-runner packages

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years agoFix comment typos in run-library.sh
Ward Vandewege [Fri, 15 May 2020 00:40:14 +0000 (20:40 -0400)]
Fix comment typos in run-library.sh

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years ago16434: the python3-arvados-cwl-runner packages on Debian 10 and Ubuntu
Ward Vandewege [Fri, 15 May 2020 00:39:13 +0000 (20:39 -0400)]
16434: the python3-arvados-cwl-runner packages on Debian 10 and Ubuntu
18.04 (and later, presumably) have a dependency on the
python3-distutils package.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years agoWe only build the python3 version of the arvados-cwl-runner package now.
Ward Vandewege [Fri, 15 May 2020 00:30:05 +0000 (20:30 -0400)]
We only build the python3 version of the arvados-cwl-runner package now.

refs #12409

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years ago16312: Test V2Signature config.
Tom Clegg [Thu, 14 May 2020 20:11:42 +0000 (16:11 -0400)]
16312: Test V2Signature config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16312: Use V4 signatures for all AWS regions. Add config override.
Tom Clegg [Thu, 14 May 2020 19:25:21 +0000 (15:25 -0400)]
16312: Use V4 signatures for all AWS regions. Add config override.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16387-batch-update-deactivated-user'
Tom Clegg [Thu, 14 May 2020 19:06:49 +0000 (15:06 -0400)]
Merge branch '16387-batch-update-deactivated-user'

fixes #16387

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '15881-ldap'
Tom Clegg [Thu, 14 May 2020 17:38:04 +0000 (13:38 -0400)]
Merge branch '15881-ldap'

refs #15881

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoFix typo.
Tom Clegg [Thu, 14 May 2020 15:15:48 +0000 (11:15 -0400)]
Fix typo.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15881: Remove unreferenced doc page install/install-components.html.
Tom Clegg [Thu, 14 May 2020 15:12:45 +0000 (11:12 -0400)]
15881: Remove unreferenced doc page install/install-components.html.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15881: Remove duplicate section, update test URL.
Tom Clegg [Thu, 14 May 2020 15:09:03 +0000 (11:09 -0400)]
15881: Remove duplicate section, update test URL.

//ws/status.json has been removed.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15881: Fix typo.
Tom Clegg [Thu, 14 May 2020 14:56:43 +0000 (10:56 -0400)]
15881: Fix typo.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16391-sbatch-error-logging'
Tom Clegg [Thu, 14 May 2020 14:21:25 +0000 (10:21 -0400)]
Merge branch '16391-sbatch-error-logging'

fixes #16391

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16391: Fix log message.
Tom Clegg [Wed, 13 May 2020 21:07:11 +0000 (17:07 -0400)]
16391: Fix log message.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16392-url-trailing-slash'
Tom Clegg [Wed, 13 May 2020 20:16:42 +0000 (16:16 -0400)]
Merge branch '16392-url-trailing-slash'

refs #16392

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15881: Skip docker tests if docker is not available.
Tom Clegg [Wed, 13 May 2020 20:12:39 +0000 (16:12 -0400)]
15881: Skip docker tests if docker is not available.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15881: Add "remove sso-provider" to upgrade notes.
Tom Clegg [Wed, 13 May 2020 19:25:11 +0000 (15:25 -0400)]
15881: Add "remove sso-provider" to upgrade notes.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15881: Remove SSO install instructions.
Tom Clegg [Wed, 13 May 2020 19:13:34 +0000 (15:13 -0400)]
15881: Remove SSO install instructions.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15881: Enable docker tests, unless -short mode.
Tom Clegg [Wed, 13 May 2020 17:47:37 +0000 (13:47 -0400)]
15881: Enable docker tests, unless -short mode.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15881: Update config keys.
Tom Clegg [Wed, 13 May 2020 17:45:11 +0000 (13:45 -0400)]
15881: Update config keys.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15881: Fail faster on config error.
Tom Clegg [Wed, 13 May 2020 17:45:00 +0000 (13:45 -0400)]
15881: Fail faster on config error.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15881: Test ldap with fake ldap server.
Tom Clegg [Wed, 13 May 2020 14:56:32 +0000 (10:56 -0400)]
15881: Test ldap with fake ldap server.

Adds file missing from 8f435f4ba.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16392: Update tests.
Tom Clegg [Tue, 12 May 2020 23:01:54 +0000 (19:01 -0400)]
16392: Update tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16118-arvboot-fixes'
Lucas Di Pentima [Tue, 12 May 2020 13:27:31 +0000 (10:27 -0300)]
Merge branch '16118-arvboot-fixes'
Refs #16118

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16118: Set URL path to '/' to all services instead of just keep-web.
Lucas Di Pentima [Tue, 12 May 2020 12:46:40 +0000 (09:46 -0300)]
16118: Set URL path to '/' to all services instead of just keep-web.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16392: Add trailing slash to URLs like https://example in configs.
Tom Clegg [Tue, 12 May 2020 07:51:38 +0000 (03:51 -0400)]
16392: Add trailing slash to URLs like https://example in configs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16118: Keep-web initializes its client pool from config instead of envvars.
Lucas Di Pentima [Mon, 11 May 2020 18:26:28 +0000 (15:26 -0300)]
16118: Keep-web initializes its client pool from config instead of envvars.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoMerge branch '16339-cwl-schema-refs' refs #16339
Peter Amstutz [Mon, 11 May 2020 15:08:47 +0000 (11:08 -0400)]
Merge branch '16339-cwl-schema-refs' refs #16339

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16339: Fix $schemas rewriting bug
Peter Amstutz [Mon, 11 May 2020 15:08:01 +0000 (11:08 -0400)]
16339: Fix $schemas rewriting bug

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago15881: Update config keys in tests.
Tom Clegg [Mon, 11 May 2020 15:06:03 +0000 (11:06 -0400)]
15881: Update config keys in tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15881: Update config keys in rails api.
Tom Clegg [Mon, 11 May 2020 13:59:31 +0000 (09:59 -0400)]
15881: Update config keys in rails api.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15881: Update config keys in tests.
Tom Clegg [Mon, 11 May 2020 13:59:20 +0000 (09:59 -0400)]
15881: Update config keys in tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15881: Remove debug printf.
Tom Clegg [Fri, 8 May 2020 20:29:38 +0000 (16:29 -0400)]
15881: Remove debug printf.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15881: Test ldap login with fake ldap server.
Tom Clegg [Fri, 8 May 2020 19:28:56 +0000 (15:28 -0400)]
15881: Test ldap login with fake ldap server.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15881: Update test config.
Tom Clegg [Fri, 8 May 2020 19:28:44 +0000 (15:28 -0400)]
15881: Update test config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15881: Add missing details on doc page.
Tom Clegg [Fri, 8 May 2020 17:50:47 +0000 (13:50 -0400)]
15881: Add missing details on doc page.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15881: Move Google, SSO, and PAM configs into their own sections.
Tom Clegg [Fri, 8 May 2020 17:46:44 +0000 (13:46 -0400)]
15881: Move Google, SSO, and PAM configs into their own sections.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16118: Fixes ExternalURL configs for keep-web & websocket.
Lucas Di Pentima [Thu, 7 May 2020 21:38:08 +0000 (18:38 -0300)]
16118: Fixes ExternalURL configs for keep-web & websocket.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago15881: Add LDAP option to install docs.
Tom Clegg [Thu, 7 May 2020 15:07:48 +0000 (11:07 -0400)]
15881: Add LDAP option to install docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoBugfix: make the arvados-docker-cleaner packages install their systemd
Ward Vandewege [Thu, 7 May 2020 14:20:50 +0000 (10:20 -0400)]
Bugfix: make the arvados-docker-cleaner packages install their systemd
unit file in the correct directory.

closes #16373

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years ago15881: Add LDAP authentication option.
Tom Clegg [Thu, 7 May 2020 04:38:23 +0000 (00:38 -0400)]
15881: Add LDAP authentication option.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16387: Allow setting is_active=false only on LoginCluster users.
Tom Clegg [Wed, 6 May 2020 19:39:30 +0000 (15:39 -0400)]
16387: Allow setting is_active=false only on LoginCluster users.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16393-keepproxy-timeout-with-slow-clients'
Ward Vandewege [Mon, 4 May 2020 17:37:21 +0000 (13:37 -0400)]
Merge branch '16393-keepproxy-timeout-with-slow-clients'

closes #16393

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years ago16393: keepproxy used cluster.API.KeepServiceRequestTimeout (defaults to
Ward Vandewege [Fri, 1 May 2020 20:55:01 +0000 (16:55 -0400)]
16393: keepproxy used cluster.API.KeepServiceRequestTimeout (defaults to
15s) as the timeout on its connection to the keepstores. When a slow client
sends blocks to keepproxy, they get streamed through to keepstore, and
the upload can take more than cluster.API.KeepServiceRequestTimeout
seconds. Update keepproxy to use keepclient.DefaultProxyRequestTimeout
(300s) instead when it connects to the keepstores.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years ago16387: Allow batch update to set is_active=false for a remote user.
Tom Clegg [Mon, 4 May 2020 14:53:21 +0000 (10:53 -0400)]
16387: Allow batch update to set is_active=false for a remote user.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16387: Test updating cache after deactivating user.
Tom Clegg [Mon, 4 May 2020 14:51:57 +0000 (10:51 -0400)]
16387: Test updating cache after deactivating user.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoAdd StartedAt and FinishedAt fields to arvados.Container.
Tom Clegg [Fri, 1 May 2020 19:58:58 +0000 (15:58 -0400)]
Add StartedAt and FinishedAt fields to arvados.Container.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16349-non-utc-timestamps'
Tom Clegg [Fri, 1 May 2020 19:10:44 +0000 (15:10 -0400)]
Merge branch '16349-non-utc-timestamps'

fixes #16349

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16212-pam-install-docs'
Tom Clegg [Fri, 1 May 2020 18:51:41 +0000 (14:51 -0400)]
Merge branch '16212-pam-install-docs'

refs #16212

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16212: Merge branch 'master'
Tom Clegg [Fri, 1 May 2020 18:27:52 +0000 (14:27 -0400)]
16212: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16212: Add PAM configuration hints.
Tom Clegg [Fri, 1 May 2020 18:26:32 +0000 (14:26 -0400)]
16212: Add PAM configuration hints.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoFixes 'apt-get install' example on SSO install page.
Lucas Di Pentima [Fri, 1 May 2020 13:30:04 +0000 (10:30 -0300)]
Fixes 'apt-get install' example on SSO install page.
No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoArvados on Kubernetes now has workbench2 as well.
Ward Vandewege [Thu, 30 Apr 2020 19:32:57 +0000 (15:32 -0400)]
Arvados on Kubernetes now has workbench2 as well.

closes #16384

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

3 years agoFixes documentation quotation usage. No issue #
Lucas Di Pentima [Thu, 30 Apr 2020 18:37:27 +0000 (15:37 -0300)]
Fixes documentation quotation usage. No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoMerge branch '16343-create-cr-with-logincluster-token'
Tom Clegg [Wed, 29 Apr 2020 21:09:19 +0000 (17:09 -0400)]
Merge branch '16343-create-cr-with-logincluster-token'

fixes #16343

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16349: Set time zone to UTC at db connection level.
Tom Clegg [Wed, 29 Apr 2020 19:37:32 +0000 (15:37 -0400)]
16349: Set time zone to UTC at db connection level.

This covers the trash time comparisons in materialized_permission_view
as well as explicit uses of CURRENT_TIMESTAMP in Rails queries.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoUpdated Arvados on Kubernetes documentation.
Ward Vandewege [Mon, 27 Apr 2020 19:58:34 +0000 (15:58 -0400)]
Updated Arvados on Kubernetes documentation.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years agoMerge branch '16263-fed-test-on-jenkins' refs #16263
Peter Amstutz [Wed, 29 Apr 2020 17:12:10 +0000 (13:12 -0400)]
Merge branch '16263-fed-test-on-jenkins' refs #16263

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16366: "InternalURLs" and "AccessViaHosts" are consistent in install
Peter Amstutz [Tue, 28 Apr 2020 20:44:30 +0000 (16:44 -0400)]
16366: "InternalURLs" and "AccessViaHosts" are consistent in install

refs #16366

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16349: Skip converting DB timestamps to & from localtime.
Tom Clegg [Mon, 27 Apr 2020 20:57:55 +0000 (16:57 -0400)]
16349: Skip converting DB timestamps to & from localtime.

The previous code already returned the correct time. This change
merely avoids converting the time to the local time zone in
PostgreSQL, and back to UTC again in Rails.

This might also avoid rare problems in unusual edge cases where Rails
and PostgreSQL session use different time zones, like a configuration
mishap or a race during a daylight savings time transition.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16349: Fix TZ-sensitive comparison in token expiry checks.
Tom Clegg [Mon, 27 Apr 2020 20:37:49 +0000 (16:37 -0400)]
16349: Fix TZ-sensitive comparison in token expiry checks.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16349: Test token expiry using actual token validation func.
Tom Clegg [Mon, 27 Apr 2020 20:37:19 +0000 (16:37 -0400)]
16349: Test token expiry using actual token validation func.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16263: Ensure arvbox in $PATH
Peter Amstutz [Fri, 24 Apr 2020 21:24:33 +0000 (17:24 -0400)]
16263: Ensure arvbox in $PATH

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: jenkin script to run whole fed-migrate test
Peter Amstutz [Fri, 24 Apr 2020 19:13:36 +0000 (15:13 -0400)]
16263: jenkin script to run whole fed-migrate test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: make the checker happy
Peter Amstutz [Fri, 24 Apr 2020 15:52:24 +0000 (11:52 -0400)]
16263: make the checker happy

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16263: Fed tests can set arvbox mode (dev or localdemo)
Peter Amstutz [Fri, 24 Apr 2020 15:25:58 +0000 (11:25 -0400)]
16263: Fed tests can set arvbox mode (dev or localdemo)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16364: Fix arvbox websockets demo build
Peter Amstutz [Fri, 24 Apr 2020 14:49:59 +0000 (10:49 -0400)]
16364: Fix arvbox websockets demo build

refs #16364

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>