arvados.git
2 years agoMerge branch '19296-remove-recursive'
Tom Clegg [Mon, 25 Jul 2022 17:30:11 +0000 (13:30 -0400)]
Merge branch '19296-remove-recursive'

fixes #19296

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19296: Fix remove(recursive=True) for depth>1. 19296-remove-recursive
Tom Clegg [Mon, 25 Jul 2022 14:22:32 +0000 (10:22 -0400)]
19296: Fix remove(recursive=True) for depth>1.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch 'MajewskiKrzysztof/use_api_token_from_config_object'
Peter Amstutz [Fri, 22 Jul 2022 19:45:24 +0000 (15:45 -0400)]
Merge branch 'MajewskiKrzysztof/use_api_token_from_config_object'

refs #19282

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '19249-header-ctrl-chars'
Tom Clegg [Fri, 22 Jul 2022 17:48:21 +0000 (13:48 -0400)]
Merge branch '19249-header-ctrl-chars'

fixes #19249

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19283-salt-webshell-upstream-fix'. Closes #19283
Lucas Di Pentima [Fri, 22 Jul 2022 16:18:16 +0000 (13:18 -0300)]
Merge branch '19283-salt-webshell-upstream-fix'. Closes #19283

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '19291-tzinfo-upgrade'. Closes #19291
Lucas Di Pentima [Fri, 22 Jul 2022 15:21:57 +0000 (12:21 -0300)]
Merge branch '19291-tzinfo-upgrade'. Closes #19291

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19291: Bumps tzinfo to 1.2.10 19291-tzinfo-upgrade
Lucas Di Pentima [Fri, 22 Jul 2022 14:00:06 +0000 (11:00 -0300)]
19291: Bumps tzinfo to 1.2.10

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19283: Fixes webshell nginx upstream to point to the shell node. 19283-salt-webshell-upstream-fix
Lucas Di Pentima [Wed, 20 Jul 2022 14:35:46 +0000 (11:35 -0300)]
19283: Fixes webshell nginx upstream to point to the shell node.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '19277-local-keep-from-ctr'
Tom Clegg [Thu, 21 Jul 2022 15:22:48 +0000 (11:22 -0400)]
Merge branch '19277-local-keep-from-ctr'

fixes #19277

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '17344-easy-demo'
Tom Clegg [Thu, 21 Jul 2022 14:36:35 +0000 (10:36 -0400)]
Merge branch '17344-easy-demo'

refs #17344

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: -create-db=false to use $POSTGRES_HOST/USER/etc instead.
Tom Clegg [Wed, 20 Jul 2022 19:55:57 +0000 (15:55 -0400)]
17344: -create-db=false to use $POSTGRES_HOST/USER/etc instead.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Merge branch 'main'
Tom Clegg [Wed, 20 Jul 2022 19:02:00 +0000 (15:02 -0400)]
17344: Merge branch 'main'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '16552-autocert'
Tom Clegg [Wed, 20 Jul 2022 18:56:16 +0000 (14:56 -0400)]
Merge branch '16552-autocert'

closes #16552

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Drop accidental python2 dependency.
Tom Clegg [Wed, 20 Jul 2022 18:42:30 +0000 (14:42 -0400)]
17344: Drop accidental python2 dependency.

debian:11 satisfies "python" with "python-is-python2".

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Remove some -dev packages from runtime dependencies.
Tom Clegg [Wed, 20 Jul 2022 18:30:58 +0000 (14:30 -0400)]
17344: Remove some -dev packages from runtime dependencies.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Link next steps to appropriate doc pages.
Tom Clegg [Wed, 20 Jul 2022 18:02:21 +0000 (14:02 -0400)]
17344: Link next steps to appropriate doc pages.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '17807-keep-web-login-flow'
Tom Clegg [Tue, 19 Jul 2022 21:36:20 +0000 (17:36 -0400)]
Merge branch '17807-keep-web-login-flow'

fixes #17807

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Point to diagnostics and docs after successful init.
Tom Clegg [Tue, 19 Jul 2022 21:35:49 +0000 (17:35 -0400)]
17344: Point to diagnostics and docs after successful init.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Fix available-port check.
Tom Clegg [Tue, 19 Jul 2022 21:35:27 +0000 (17:35 -0400)]
17344: Fix available-port check.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Use #cpus as 'bundle install' concurrency.
Tom Clegg [Tue, 19 Jul 2022 21:34:17 +0000 (17:34 -0400)]
17344: Use #cpus as 'bundle install' concurrency.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17807: keep-web redirect to wb2 login-and-return in no-auth case. 17807-keep-web-login-flow
Tom Clegg [Fri, 8 Jul 2022 17:53:14 +0000 (13:53 -0400)]
17807: keep-web redirect to wb2 login-and-return in no-auth case.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19278-activerecord-update'. Closes #19278
Lucas Di Pentima [Tue, 19 Jul 2022 17:03:54 +0000 (14:03 -0300)]
Merge branch '19278-activerecord-update'. Closes #19278

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19277: Test for ARVADOS_KEEP_SERVICES env in container. 19277-local-keep-from-ctr
Tom Clegg [Tue, 19 Jul 2022 15:12:48 +0000 (11:12 -0400)]
19277: Test for ARVADOS_KEEP_SERVICES env in container.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19278: Updates api & wb1 rails to 5.2.8.1 19278-activerecord-update
Lucas Di Pentima [Tue, 19 Jul 2022 15:08:06 +0000 (12:08 -0300)]
19278: Updates api & wb1 rails to 5.2.8.1

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19277: Expose local keepstore service to processes in container.
Tom Clegg [Mon, 18 Jul 2022 20:53:28 +0000 (16:53 -0400)]
19277: Expose local keepstore service to processes in container.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16552: Change -tls=acmetool to -tls=/path/to/certdir. 16552-autocert
Tom Clegg [Mon, 18 Jul 2022 17:35:48 +0000 (13:35 -0400)]
16552: Change -tls=acmetool to -tls=/path/to/certdir.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16552: Rename ACME config options.
Tom Clegg [Mon, 18 Jul 2022 03:16:59 +0000 (23:16 -0400)]
16552: Rename ACME config options.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16552: Fix PATH so setup rake tasks can run arvados-server.
Tom Clegg [Fri, 15 Jul 2022 18:43:13 +0000 (14:43 -0400)]
16552: Fix PATH so setup rake tasks can run arvados-server.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Give up early if cluster config cannot be fetched.
Tom Clegg [Fri, 15 Jul 2022 16:02:48 +0000 (12:02 -0400)]
17344: Give up early if cluster config cannot be fetched.

Avoids unhelpful noise, like "unsupported protocol scheme" trying to
use an empty URL.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19139-user-creation-fixes'. Closes #19139
Lucas Di Pentima [Thu, 14 Jul 2022 14:46:21 +0000 (11:46 -0300)]
Merge branch '19139-user-creation-fixes'. Closes #19139

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19139: Adds test confirming that provided owner_uuid is ignored on create calls 19139-user-creation-fixes
Lucas Di Pentima [Thu, 14 Jul 2022 14:45:21 +0000 (11:45 -0300)]
19139: Adds test confirming that provided owner_uuid is ignored on create calls

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19139: Fixes bug by always setting owner_uuid to the system root user's UUID.
Lucas Di Pentima [Thu, 14 Jul 2022 14:01:46 +0000 (11:01 -0300)]
19139: Fixes bug by always setting owner_uuid to the system root user's UUID.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19139: Adds tests related to user creation.
Lucas Di Pentima [Thu, 14 Jul 2022 13:59:41 +0000 (10:59 -0300)]
19139: Adds tests related to user creation.

* Confirms that non-admin users cannot create user records.
* Exposes bug where user's owner_uuid fields were populated with the UUID of
  the creating admin user instead of using the system root user's UUID.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '19206-root-user-disabling-fix'. Closes #19206
Lucas Di Pentima [Thu, 14 Jul 2022 13:26:41 +0000 (10:26 -0300)]
Merge branch '19206-root-user-disabling-fix'. Closes #19206

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago17344: Fix unclosed response body.
Tom Clegg [Thu, 14 Jul 2022 04:58:15 +0000 (00:58 -0400)]
17344: Fix unclosed response body.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Diagnostics warning, not error, if there are no VMs listed.
Tom Clegg [Wed, 13 Jul 2022 19:38:26 +0000 (15:38 -0400)]
17344: Diagnostics warning, not error, if there are no VMs listed.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Rename "root" subcommand to "sudo".
Tom Clegg [Wed, 13 Jul 2022 19:34:04 +0000 (15:34 -0400)]
17344: Rename "root" subcommand to "sudo".

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Add firewall info to easy install doc page.
Tom Clegg [Wed, 13 Jul 2022 19:27:04 +0000 (15:27 -0400)]
17344: Add firewall info to easy install doc page.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19235: Don't try bogus URL if WebDAV ExternalURL has no wildcard.
Tom Clegg [Mon, 4 Jul 2022 14:55:38 +0000 (10:55 -0400)]
19235: Don't try bogus URL if WebDAV ExternalURL has no wildcard.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Check that needed ports are usable before doing any init.
Tom Clegg [Wed, 13 Jul 2022 02:32:40 +0000 (22:32 -0400)]
17344: Check that needed ports are usable before doing any init.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Load alpine docker image for diagnostics.
Tom Clegg [Tue, 12 Jul 2022 19:31:41 +0000 (15:31 -0400)]
17344: Load alpine docker image for diagnostics.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Add docker and postgresql as suggested deb packages.
Tom Clegg [Tue, 12 Jul 2022 18:41:33 +0000 (14:41 -0400)]
17344: Add docker and postgresql as suggested deb packages.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Update automatic install docs.
Tom Clegg [Tue, 12 Jul 2022 18:41:23 +0000 (14:41 -0400)]
17344: Update automatic install docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Add arv-mount and python tools to package.
Tom Clegg [Tue, 12 Jul 2022 14:25:28 +0000 (10:25 -0400)]
17344: Add arv-mount and python tools to package.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Note "systemd enable" step is irrelevant in pkg case.
Tom Clegg [Tue, 12 Jul 2022 13:32:24 +0000 (09:32 -0400)]
17344: Note "systemd enable" step is irrelevant in pkg case.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Install ruby arv as arv-ruby, and arvados-client as arv.
Tom Clegg [Tue, 12 Jul 2022 04:10:41 +0000 (00:10 -0400)]
17344: Install ruby arv as arv-ruby, and arvados-client as arv.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: 'arvados-client root cmd...' uses root token from config.
Tom Clegg [Mon, 11 Jul 2022 18:33:45 +0000 (14:33 -0400)]
17344: 'arvados-client root cmd...' uses root token from config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: 'systemctl reload arvados' sends SIGHUP to reload config.
Tom Clegg [Mon, 11 Jul 2022 18:00:14 +0000 (14:00 -0400)]
17344: 'systemctl reload arvados' sends SIGHUP to reload config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Ensure arvados-server is in PATH for rake tasks.
Tom Clegg [Mon, 11 Jul 2022 15:28:10 +0000 (11:28 -0400)]
17344: Ensure arvados-server is in PATH for rake tasks.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Silence misleading warning during gem install.
Tom Clegg [Mon, 11 Jul 2022 13:51:21 +0000 (09:51 -0400)]
17344: Silence misleading warning during gem install.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Remove extra 'go install' cmd.
Tom Clegg [Mon, 11 Jul 2022 14:14:32 +0000 (10:14 -0400)]
17344: Remove extra 'go install' cmd.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Update bundle usage.
Tom Clegg [Mon, 11 Jul 2022 13:56:27 +0000 (09:56 -0400)]
17344: Update bundle usage.

[DEPRECATED] The `--deployment` flag is deprecated because it relies
on being remembered across bundler invocations, which bundler will no
longer do in future versions. Instead please use `bundle config set
--local deployment 'true'`, and stop using this flag
[DEPRECATED] The `--path` flag is deprecated because it relies on
being remembered across bundler invocations, which bundler will no
longer do in future versions. Instead please use `bundle config set
--local path '/var/www/.gem'`, and stop using this flag
[DEPRECATED] The `--without` flag is deprecated because it relies on
being remembered across bundler invocations, which bundler will no
longer do in future versions. Instead please use `bundle config set
--local without 'development test diagnostics performance'`, and stop
using this flag

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Check postgresql situation earlier.
Tom Clegg [Mon, 11 Jul 2022 13:41:39 +0000 (09:41 -0400)]
17344: Check postgresql situation earlier.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Tidy systemd / fpm integration.
Tom Clegg [Mon, 11 Jul 2022 01:26:14 +0000 (21:26 -0400)]
17344: Tidy systemd / fpm integration.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Improve "init" transcript.
Tom Clegg [Sat, 9 Jul 2022 03:02:52 +0000 (23:02 -0400)]
17344: Improve "init" transcript.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: After init/startup, check API and show wb2 URL.
Tom Clegg [Fri, 8 Jul 2022 20:44:03 +0000 (16:44 -0400)]
17344: After init/startup, check API and show wb2 URL.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16552: Avoid port collision due to port assignment races in tests.
Tom Clegg [Thu, 14 Jul 2022 04:23:18 +0000 (00:23 -0400)]
16552: Avoid port collision due to port assignment races in tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16552: Fix deprecated bundler usage.
Tom Clegg [Thu, 14 Jul 2022 04:22:36 +0000 (00:22 -0400)]
16552: Fix deprecated bundler usage.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19206: Avoids disabling or setting system root user as non-admin. 19206-root-user-disabling-fix
Lucas Di Pentima [Wed, 13 Jul 2022 20:38:26 +0000 (17:38 -0300)]
19206: Avoids disabling or setting system root user as non-admin.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19206: Adds test exposing the bug.
Lucas Di Pentima [Wed, 13 Jul 2022 20:21:28 +0000 (17:21 -0300)]
19206: Adds test exposing the bug.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago16552: Merge branch 'main' into 16552-autocert
Tom Clegg [Wed, 13 Jul 2022 19:43:48 +0000 (15:43 -0400)]
16552: Merge branch 'main' into 16552-autocert

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19249: Add test for control chars in properties key. 19249-header-ctrl-chars
Tom Clegg [Mon, 11 Jul 2022 15:17:17 +0000 (11:17 -0400)]
19249: Add test for control chars in properties key.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19249: Mime-encode metadata headers that have control chars.
Tom Clegg [Mon, 11 Jul 2022 15:08:00 +0000 (11:08 -0400)]
19249: Mime-encode metadata headers that have control chars.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19249: Test handling of crlf for properties rendered in headers.
Tom Clegg [Mon, 11 Jul 2022 15:03:12 +0000 (11:03 -0400)]
19249: Test handling of crlf for properties rendered in headers.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16552: Update (hidden) single-node install doc page.
Tom Clegg [Fri, 8 Jul 2022 19:28:52 +0000 (15:28 -0400)]
16552: Update (hidden) single-node install doc page.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16552: Fix error message.
Tom Clegg [Fri, 8 Jul 2022 19:14:22 +0000 (15:14 -0400)]
16552: Fix error message.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoUse config parameter to fetch api token in KeepClient
Krzysztof Majewski [Fri, 8 Jul 2022 07:32:26 +0000 (09:32 +0200)]
Use config parameter to fetch api token in KeepClient

Arvados-DCO-1.1-Signed-off-by: Krzysztof Majewski majewski.kielce@gmail.com

2 years agoMerge branch '18858-sync-users-fixes'. Closes #18858
Lucas Di Pentima [Thu, 7 Jul 2022 18:37:22 +0000 (15:37 -0300)]
Merge branch '18858-sync-users-fixes'. Closes #18858

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18858: Don't treat as an error empty usernames on system users. 18858-sync-users-fixes
Lucas Di Pentima [Thu, 7 Jul 2022 17:31:24 +0000 (14:31 -0300)]
18858: Don't treat as an error empty usernames on system users.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18858: Removed root & anonymous usernames from fixture to reflect reality.
Lucas Di Pentima [Thu, 7 Jul 2022 17:24:17 +0000 (14:24 -0300)]
18858: Removed root & anonymous usernames from fixture to reflect reality.

This makes tests to fail, but I think forcing usernames on common users
is problematic on federated scenarios because of username collisions
between users that exist on every cluster.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch 'keep_web_api_client_upload_method' refs #19220
Peter Amstutz [Thu, 7 Jul 2022 14:57:59 +0000 (10:57 -0400)]
Merge branch 'keep_web_api_client_upload_method' refs #19220

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago16552: Comment in config template re autocert implementation status.
Tom Clegg [Thu, 7 Jul 2022 13:49:12 +0000 (09:49 -0400)]
16552: Comment in config template re autocert implementation status.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16552: Merge branch 'main'
Tom Clegg [Thu, 7 Jul 2022 13:42:02 +0000 (09:42 -0400)]
16552: Merge branch 'main'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18858: Adds username case matching tests.
Lucas Di Pentima [Wed, 6 Jul 2022 21:22:55 +0000 (18:22 -0300)]
18858: Adds username case matching tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18858: Improves test & fixes discovered bug by said improved test.
Lucas Di Pentima [Wed, 6 Jul 2022 21:02:50 +0000 (18:02 -0300)]
18858: Improves test & fixes discovered bug by said improved test.

Also, fixes update decision function to avoid unnecessary calls on
users that are already inactive but the CSV file list them with admin=true.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18858: Fixes positional argument retrieval on sync-users & sync-groups.
Lucas Di Pentima [Wed, 6 Jul 2022 19:36:18 +0000 (16:36 -0300)]
18858: Fixes positional argument retrieval on sync-users & sync-groups.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18858: Don't immediately exit on existing accounts with empty user IDs.
Lucas Di Pentima [Wed, 6 Jul 2022 19:03:48 +0000 (16:03 -0300)]
18858: Don't immediately exit on existing accounts with empty user IDs.

Instead, record the UUIDs and report them as an error after processing
the rest.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '16888-ctr-fed-token'
Tom Clegg [Wed, 6 Jul 2022 15:53:08 +0000 (11:53 -0400)]
Merge branch '16888-ctr-fed-token'

refs #16888

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18858-sync-users-tool'. Closes #18858
Lucas Di Pentima [Tue, 5 Jul 2022 20:24:49 +0000 (17:24 -0300)]
Merge branch '18858-sync-users-tool'. Closes #18858

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18858: Adds sync-users package building. 18858-sync-users-tool
Lucas Di Pentima [Mon, 4 Jul 2022 17:45:01 +0000 (14:45 -0300)]
18858: Adds sync-users package building.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18858: Adds first/last name updates, with tests.
Lucas Di Pentima [Mon, 4 Jul 2022 17:40:57 +0000 (14:40 -0300)]
18858: Adds first/last name updates, with tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18858: Expands documentation to include the new tool.
Lucas Di Pentima [Mon, 4 Jul 2022 16:39:46 +0000 (13:39 -0300)]
18858: Expands documentation to include the new tool.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18858: Adds username-based test cases.
Lucas Di Pentima [Mon, 4 Jul 2022 14:29:43 +0000 (11:29 -0300)]
18858: Adds username-based test cases.

Also, fixes user fixtures and improves railsAPI's debugging logs on database
reset failures.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago16552: Fix default websocket external port and proxy config.
Tom Clegg [Mon, 4 Jul 2022 14:08:44 +0000 (10:08 -0400)]
16552: Fix default websocket external port and proxy config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16552: Use sdnotify to signal to systemd that service is up.
Tom Clegg [Sun, 3 Jul 2022 04:50:40 +0000 (00:50 -0400)]
16552: Use sdnotify to signal to systemd that service is up.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago18858: Tidies up testing code.
Lucas Di Pentima [Fri, 1 Jul 2022 18:16:30 +0000 (15:16 -0300)]
18858: Tidies up testing code.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago18858: Adds ability to identify users by their usernames.
Lucas Di Pentima [Fri, 1 Jul 2022 18:14:17 +0000 (15:14 -0300)]
18858: Adds ability to identify users by their usernames.

Also, adds case-insensitive matchig support for usernames, and forces it
when using emails.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago16888: Test unsupported federation use case. 16888-ctr-fed-token
Tom Clegg [Mon, 16 May 2022 17:30:02 +0000 (13:30 -0400)]
16888: Test unsupported federation use case.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16552: Fix rebase error.
Tom Clegg [Thu, 30 Jun 2022 20:26:59 +0000 (16:26 -0400)]
16552: Fix rebase error.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoNote that Get*Tagging APIs are not supported.
Tom Clegg [Thu, 30 Jun 2022 20:14:50 +0000 (16:14 -0400)]
Note that Get*Tagging APIs are not supported.

refs #19088

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19088-s3-properties-tags'
Tom Clegg [Thu, 30 Jun 2022 20:03:52 +0000 (16:03 -0400)]
Merge branch '19088-s3-properties-tags'

closes #19088

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16552: Add arvados-server init -admin-email option.
Tom Clegg [Thu, 30 Jun 2022 20:02:26 +0000 (16:02 -0400)]
16552: Add arvados-server init -admin-email option.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16552: Fix warnings re wrong process signalling service readiness.
Tom Clegg [Thu, 30 Jun 2022 19:11:32 +0000 (15:11 -0400)]
16552: Fix warnings re wrong process signalling service readiness.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16552: Fix cwd warning from psql.
Tom Clegg [Thu, 30 Jun 2022 19:04:11 +0000 (15:04 -0400)]
16552: Fix cwd warning from psql.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16552: change default db name to just arvados.
Tom Clegg [Thu, 30 Jun 2022 18:56:18 +0000 (14:56 -0400)]
16552: change default db name to just arvados.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16552: arvados-server init -login "google $clientid $clientsecret"
Tom Clegg [Thu, 30 Jun 2022 18:53:18 +0000 (14:53 -0400)]
16552: arvados-server init -login "google $clientid $clientsecret"

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16552: Add arvados-cli gem to arvados-server-easy package.
Tom Clegg [Thu, 30 Jun 2022 15:44:52 +0000 (11:44 -0400)]
16552: Add arvados-cli gem to arvados-server-easy package.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago16552: Improve "init" feedback when config already exists.
Tom Clegg [Thu, 30 Jun 2022 15:25:53 +0000 (11:25 -0400)]
16552: Improve "init" feedback when config already exists.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '18870-installer' refs #18870
Peter Amstutz [Thu, 30 Jun 2022 18:06:48 +0000 (14:06 -0400)]
Merge branch '18870-installer' refs #18870

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago18870: Add message about running diagnostics
Peter Amstutz [Thu, 30 Jun 2022 17:27:59 +0000 (13:27 -0400)]
18870: Add message about running diagnostics

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>