arvados.git
3 years ago16314: Fix cleanup of temp/arvbox dirs that contain readonly dirs.
Tom Clegg [Tue, 25 Aug 2020 14:12:55 +0000 (10:12 -0400)]
16314: Fix cleanup of temp/arvbox dirs that contain readonly dirs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16314: Serve login form in test login mode.
Tom Clegg [Mon, 24 Aug 2020 21:05:25 +0000 (17:05 -0400)]
16314: Serve login form in test login mode.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16314: Remove SSO from arvbox.
Tom Clegg [Mon, 24 Aug 2020 14:06:50 +0000 (10:06 -0400)]
16314: Remove SSO from arvbox.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16314: Clean up long bool expressions.
Tom Clegg [Thu, 20 Aug 2020 14:32:41 +0000 (10:32 -0400)]
16314: Clean up long bool expressions.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16314: Export Login.Test.Enable config.
Tom Clegg [Thu, 20 Aug 2020 14:26:29 +0000 (10:26 -0400)]
16314: Export Login.Test.Enable config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16314: Support "Test" authentication type.
Tom Clegg [Tue, 18 Aug 2020 20:37:58 +0000 (16:37 -0400)]
16314: Support "Test" authentication type.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16580-remove-python2-packages'
Ward Vandewege [Tue, 18 Aug 2020 18:23:42 +0000 (14:23 -0400)]
Merge branch '16580-remove-python2-packages'

closes #16580

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16580: Merge branch 'master' into 16580-remove-python2-packages
Ward Vandewege [Tue, 18 Aug 2020 18:22:52 +0000 (14:22 -0400)]
16580: Merge branch 'master' into 16580-remove-python2-packages

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16470-api-rails-52'
Lucas Di Pentima [Mon, 17 Aug 2020 19:48:31 +0000 (16:48 -0300)]
Merge branch '16470-api-rails-52'
Refs #16470

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoAdd link from upgrade notes to general release notes.
Peter Amstutz [Mon, 17 Aug 2020 18:51:04 +0000 (14:51 -0400)]
Add link from upgrade notes to general release notes.

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16470: Avoids crashing when running db:create in development mode.
Lucas Di Pentima [Mon, 17 Aug 2020 17:38:06 +0000 (14:38 -0300)]
16470: Avoids crashing when running db:create in development mode.

The 'preload_all_models' initializer is now run even when db:create is
called, so it avoids the database to be created on arvbox, for example,
because it attempts to access the database before being created.

This initializer was added 7 years ago and it now seems to not be needed
anymore, so I think it's the cleaner way to resolve this issue.

See: https://github.com/rails/rails/issues/32870

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoMerge branch '16631-add-test'
Ward Vandewege [Mon, 17 Aug 2020 15:32:12 +0000 (11:32 -0400)]
Merge branch '16631-add-test'

closes #16631

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16631: Merge branch 'master' into 16631-add-test
Ward Vandewege [Mon, 17 Aug 2020 15:30:06 +0000 (11:30 -0400)]
16631: Merge branch 'master' into 16631-add-test

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16663-running-ctrs-unknown-workers'
Tom Clegg [Mon, 17 Aug 2020 15:00:08 +0000 (11:00 -0400)]
Merge branch '16663-running-ctrs-unknown-workers'

fixes #16663

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16631: Remove some unneeded code.
Tom Clegg [Mon, 17 Aug 2020 14:53:16 +0000 (10:53 -0400)]
16631: Remove some unneeded code.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '15889-delete-traffic_test.py' into master
Nico Cesar [Mon, 17 Aug 2020 14:47:48 +0000 (10:47 -0400)]
Merge branch '15889-delete-traffic_test.py' into master

closes #15889

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years ago16580: remove more references to Nodemanager.
Ward Vandewege [Mon, 17 Aug 2020 14:32:31 +0000 (10:32 -0400)]
16580: remove more references to Nodemanager.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agodeleted services/keep/tools/traffic_test.py
Nico Cesar [Mon, 17 Aug 2020 14:26:14 +0000 (10:26 -0400)]
deleted services/keep/tools/traffic_test.py

refs #15889

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

3 years ago16663: Merge branch 'master'
Tom Clegg [Mon, 17 Aug 2020 14:17:28 +0000 (10:17 -0400)]
16663: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16663: Add comments in racy test.
Tom Clegg [Mon, 17 Aug 2020 14:16:47 +0000 (10:16 -0400)]
16663: Add comments in racy test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoFix more ineffassign warnings.
Ward Vandewege [Mon, 17 Aug 2020 02:27:59 +0000 (22:27 -0400)]
Fix more ineffassign warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFix more ineffassign warnings.
Ward Vandewege [Sat, 15 Aug 2020 02:22:44 +0000 (22:22 -0400)]
Fix more ineffassign warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16683-fed-sharing' refs #16683
Peter Amstutz [Fri, 14 Aug 2020 19:54:16 +0000 (15:54 -0400)]
Merge branch '16683-fed-sharing' refs #16683

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16683: Add test, remove useless check for PDH pattern
Peter Amstutz [Fri, 14 Aug 2020 16:07:56 +0000 (12:07 -0400)]
16683: Add test, remove useless check for PDH pattern

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16683: Check that remote cluster id is presumed valid
Peter Amstutz [Fri, 14 Aug 2020 13:57:53 +0000 (09:57 -0400)]
16683: Check that remote cluster id is presumed valid

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16683: Revert behavior change, run gofmt
Peter Amstutz [Thu, 13 Aug 2020 20:31:31 +0000 (16:31 -0400)]
16683: Revert behavior change, run gofmt

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16683: Accept PDH for head_uuid/tail_uuid
Peter Amstutz [Thu, 13 Aug 2020 19:22:49 +0000 (15:22 -0400)]
16683: Accept PDH for head_uuid/tail_uuid

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16580: remove libpam-arvados
Ward Vandewege [Thu, 13 Aug 2020 18:49:22 +0000 (14:49 -0400)]
16580: remove libpam-arvados

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16580: remove arvados-node-manager
Ward Vandewege [Thu, 13 Aug 2020 18:39:33 +0000 (14:39 -0400)]
16580: remove arvados-node-manager

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16580: stop building python2 packages
Ward Vandewege [Thu, 13 Aug 2020 17:22:43 +0000 (13:22 -0400)]
16580: stop building python2 packages

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16683: Permit granting permissions to remote users
Peter Amstutz [Wed, 12 Aug 2020 21:32:06 +0000 (17:32 -0400)]
16683: Permit granting permissions to remote users

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16683: Sharing dialog query is compatible with federated user list
Peter Amstutz [Wed, 12 Aug 2020 20:20:19 +0000 (16:20 -0400)]
16683: Sharing dialog query is compatible with federated user list

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16683: Set and check ForwardedFor on federated list requests
Peter Amstutz [Wed, 12 Aug 2020 20:10:32 +0000 (16:10 -0400)]
16683: Set and check ForwardedFor on federated list requests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16683: Add checks related to sharing and remote users
Peter Amstutz [Thu, 13 Aug 2020 16:44:29 +0000 (12:44 -0400)]
16683: Add checks related to sharing and remote users

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agodocumentation: disable download buffering in our sample nginx config for
Ward Vandewege [Wed, 12 Aug 2020 14:19:07 +0000 (10:19 -0400)]
documentation: disable download buffering in our sample nginx config for
keep-web and keepproxy. This helps when the clients are far away/slow.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFix some ineffassign warnings.
Ward Vandewege [Mon, 10 Aug 2020 23:32:43 +0000 (19:32 -0400)]
Fix some ineffassign warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoFix typo.
Ward Vandewege [Mon, 10 Aug 2020 23:11:00 +0000 (19:11 -0400)]
Fix typo.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16353-1.2-release' refs #16353
Peter Amstutz [Mon, 10 Aug 2020 20:10:48 +0000 (16:10 -0400)]
Merge branch '16353-1.2-release' refs #16353

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16353: Add a section "Upgrading your workflow to CWL v1.2"
Peter Amstutz [Mon, 10 Aug 2020 20:09:35 +0000 (16:09 -0400)]
16353: Add a section "Upgrading your workflow to CWL v1.2"

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16353: Update cwltool for stable 1.2
Peter Amstutz [Mon, 10 Aug 2020 17:17:57 +0000 (13:17 -0400)]
16353: Update cwltool for stable 1.2

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16470: Discards changes before locking instead of reloading the record.
Lucas Di Pentima [Fri, 7 Aug 2020 22:11:27 +0000 (19:11 -0300)]
16470: Discards changes before locking instead of reloading the record.

There's no need to make a database roundtrip, because all the old attribute
values are available.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16631: simplify test
Ward Vandewege [Fri, 7 Aug 2020 22:01:45 +0000 (18:01 -0400)]
16631: simplify test

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16470: Removes active storage config file, ammends secrets.yml file.
Lucas Di Pentima [Fri, 7 Aug 2020 15:09:14 +0000 (12:09 -0300)]
16470: Removes active storage config file, ammends secrets.yml file.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: Don't explicitly reload before locking on CR updates.
Lucas Di Pentima [Thu, 6 Aug 2020 12:22:28 +0000 (09:22 -0300)]
16470: Don't explicitly reload before locking on CR updates.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: Fixes unrelated typo.
Lucas Di Pentima [Wed, 5 Aug 2020 13:38:04 +0000 (10:38 -0300)]
16470: Fixes unrelated typo.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: Fixes collection versioning management code.
Lucas Di Pentima [Mon, 3 Aug 2020 22:24:00 +0000 (19:24 -0300)]
16470: Fixes collection versioning management code.

Collection versioning management is implemented on an 'around_update' callback
so some 'attribute_changed()' & 'changes()' calls changed behaviour depending
on which side of the 'yield' were made.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: Avoids crashing when running the rake task db:create.
Lucas Di Pentima [Fri, 31 Jul 2020 19:43:40 +0000 (16:43 -0300)]
16470: Avoids crashing when running the rake task db:create.

There was a behaviour change on rake tasks that avoided the creation of the
test database. All initializers are now called from rake tasks, so those
initializers with code accessing the database will fail when the database
isn't created.

See: https://github.com/rails/rails/issues/32870

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: File updates & additions from 'rake rails:update'
Lucas Di Pentima [Fri, 31 Jul 2020 17:38:20 +0000 (14:38 -0300)]
16470: File updates & additions from 'rake rails:update'

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: Fixes deprecation warning.
Lucas Di Pentima [Tue, 28 Jul 2020 20:51:16 +0000 (17:51 -0300)]
16470: Fixes deprecation warning.

Explained at: https://github.com/rails/rails/pull/29619#issuecomment-392583498

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: Removes exception deprecated on rails 3.2
Lucas Di Pentima [Tue, 28 Jul 2020 20:40:09 +0000 (17:40 -0300)]
16470: Removes exception deprecated on rails 3.2

Its substitute is already being used.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: Upgrades rails to 5.2
Lucas Di Pentima [Tue, 28 Jul 2020 19:54:22 +0000 (16:54 -0300)]
16470: Upgrades rails to 5.2

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: Fixes false unpersisted status when retrieving a record with audit logs.
Lucas Di Pentima [Tue, 28 Jul 2020 19:16:29 +0000 (16:16 -0300)]
16470: Fixes false unpersisted status when retrieving a record with audit logs.

The cleanest solution I came up with is to flag the instance when it's
retrieved from the database, and reset any changes after stashing its
state on the log_start_state callback.
Haven't found a way to read the serialized attributes without making
them appear as changed, and I think it isn't possible because the
attributes have to be unserialized before the read operation, and thus
the dirty state machinery would assume the attribute may be modified.
This solution isn't ideal, but I think it's acceptable as it doesn't
make additional database requests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: Adds ArvadosModel test exposing a bug with audit logs.
Lucas Di Pentima [Tue, 28 Jul 2020 16:55:50 +0000 (13:55 -0300)]
16470: Adds ArvadosModel test exposing a bug with audit logs.

When audit logs are enabled, fetching objects from models with serialized
attributes (for example: User or ContainerRequest) return an unpersisted
instance even if reload() is called on it.
This is a problem because from Rails 5.2, lock!() and with_lock() will raise
an exception when called on unpersisted instances.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: Fixes test on user model.
Lucas Di Pentima [Fri, 24 Jul 2020 14:47:16 +0000 (11:47 -0300)]
16470: Fixes test on user model.

Rails 5.1 deprecated the attr_changed? in favor of more explicit methods
because there was ambiguity when called from an 'after' or 'before' callback.
The test UsersTest#test_cannot_set_is_active_to_false_directly started failing
because User.setup is called from both types of callbacks, so its internal
checks weren't passing in some cases.

Also, avoids doing unnecessary queries to get the 'All users' group.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: Changes the way of setting the callback that sets the DB timezone.
Lucas Di Pentima [Thu, 23 Jul 2020 20:54:32 +0000 (17:54 -0300)]
16470: Changes the way of setting the callback that sets the DB timezone.

This avoids intermittent freezes when running tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16631: add test
Ward Vandewege [Thu, 6 Aug 2020 21:16:53 +0000 (17:16 -0400)]
16631: add test

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16470: Removes cleanup code on test. All threads share a db connection.
Lucas Di Pentima [Tue, 21 Jul 2020 14:18:24 +0000 (11:18 -0300)]
16470: Removes cleanup code on test. All threads share a db connection.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: Removes unnecessary gem that may also cause issues.
Lucas Di Pentima [Tue, 21 Jul 2020 13:22:41 +0000 (10:22 -0300)]
16470: Removes unnecessary gem that may also cause issues.

The gem doesn't seem to be used anywhere and may not be needed
anymore.
See: https://github.com/rails/rails/issues/28197#issuecomment-291120834

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: Fixes reload() API to match the overridden function.
Lucas Di Pentima [Mon, 20 Jul 2020 14:40:38 +0000 (11:40 -0300)]
16470: Fixes reload() API to match the overridden function.

reload()'s documentation states: "...in addition to the in-place modification
the method returns self for convenience."

https://api.rubyonrails.org/v5.1.7/classes/ActiveRecord/Persistence.html#method-i-reload

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: Avoids DB connection closing when running tests on missing places.
Lucas Di Pentima [Mon, 20 Jul 2020 14:36:06 +0000 (11:36 -0300)]
16470: Avoids DB connection closing when running tests on missing places.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: Fixes internal API usage.
Lucas Di Pentima [Mon, 20 Jul 2020 14:35:00 +0000 (11:35 -0300)]
16470: Fixes internal API usage.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: Fixes tests. Avoids closing a DB connection when using threads on tests.
Lucas Di Pentima [Wed, 15 Jul 2020 14:14:09 +0000 (11:14 -0300)]
16470: Fixes tests. Avoids closing a DB connection when using threads on tests.

From Rails 5.1, test threads share a database connection, so UpdatePriority
won't try to close DB connections when running from tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: Fixes deprecation warnings on unit tests.
Lucas Di Pentima [Mon, 6 Jul 2020 22:07:29 +0000 (19:07 -0300)]
16470: Fixes deprecation warnings on unit tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: Updates Rails API to 5.1.7
Lucas Di Pentima [Mon, 6 Jul 2020 19:44:19 +0000 (16:44 -0300)]
16470: Updates Rails API to 5.1.7

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16470: Bumps dependency on activesupport for rails upgrade.
Lucas Di Pentima [Wed, 1 Jul 2020 21:42:41 +0000 (18:42 -0300)]
16470: Bumps dependency on activesupport for rails upgrade.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16663: Test for errant cancel while VMs have state==unknown.
Tom Clegg [Tue, 4 Aug 2020 21:19:45 +0000 (17:19 -0400)]
16663: Test for errant cancel while VMs have state==unknown.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16663: Don't kill orphaned containers when unprobed nodes exist.
Tom Clegg [Tue, 4 Aug 2020 20:06:29 +0000 (16:06 -0400)]
16663: Don't kill orphaned containers when unprobed nodes exist.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '10477-upgrade-aws-s3-driver'
Ward Vandewege [Tue, 4 Aug 2020 19:45:51 +0000 (15:45 -0400)]
Merge branch '10477-upgrade-aws-s3-driver'

closes #10477

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch 'master' into 10477-upgrade-aws-s3-driver
Ward Vandewege [Tue, 4 Aug 2020 19:45:07 +0000 (15:45 -0400)]
Merge branch 'master' into 10477-upgrade-aws-s3-driver

refs #10477

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16625: Added fix to prevent ruby from failing when @ appears in the user for the...
medcelerate [Mon, 27 Jul 2020 17:00:30 +0000 (13:00 -0400)]
16625: Added fix to prevent ruby from failing when @ appears in the user for the database config.

Added escaping to password and dbname.

refs #16625

Arvados-DCO-1.1-Signed-off-by: Evan Clark <evan.clark.professional@gmail.com>

3 years agoboot outcomes metric: fix labels and add some checks for the new metric
Ward Vandewege [Mon, 3 Aug 2020 20:04:31 +0000 (16:04 -0400)]
boot outcomes metric: fix labels and add some checks for the new metric
in the tests.

refs #16636

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16636-boot-outcome-metrics'
Ward Vandewege [Mon, 3 Aug 2020 18:49:23 +0000 (14:49 -0400)]
Merge branch '16636-boot-outcome-metrics'

refs #16636

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16636: implement review comments.
Ward Vandewege [Mon, 3 Aug 2020 18:37:22 +0000 (14:37 -0400)]
16636: implement review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago10477: Fix timezone handling in s3aws tests, to avoid issues when the tests are
Ward Vandewege [Mon, 3 Aug 2020 15:14:29 +0000 (11:14 -0400)]
10477: Fix timezone handling in s3aws tests, to avoid issues when the tests are
run in non-UTC environments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago10477: implement review comments.
Ward Vandewege [Wed, 29 Jul 2020 15:58:16 +0000 (11:58 -0400)]
10477: implement review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago10477: disable sha-256 calculation by the S3 driver; we don't need it
Ward Vandewege [Fri, 24 Jul 2020 17:55:51 +0000 (13:55 -0400)]
10477: disable sha-256 calculation by the S3 driver; we don't need it
       and it slows uploads down because it's CPU bound.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago10477: first version of the aws-sdk-go-v2 driver.
Ward Vandewege [Wed, 22 Jul 2020 11:10:14 +0000 (07:10 -0400)]
10477: first version of the aws-sdk-go-v2 driver.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16636: add boot outcome metrics.
Ward Vandewege [Fri, 31 Jul 2020 21:37:12 +0000 (17:37 -0400)]
16636: add boot outcome metrics.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agogofmt fix.
Ward Vandewege [Fri, 31 Jul 2020 21:28:04 +0000 (17:28 -0400)]
gofmt fix.

refs #16616

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agodocumentation: fix more broken links.
Ward Vandewege [Fri, 31 Jul 2020 20:06:18 +0000 (16:06 -0400)]
documentation: fix more broken links.

refs #16616

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agodocumentation: fix broken links; also arvados-dispatch-cloud is not
Ward Vandewege [Fri, 31 Jul 2020 19:05:22 +0000 (15:05 -0400)]
documentation: fix broken links; also arvados-dispatch-cloud is not
experimental anymore.

refs #16616

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agodocumentation: mention API/MaxKeepBlobBuffers on the Keepstore
Ward Vandewege [Wed, 29 Jul 2020 21:36:30 +0000 (17:36 -0400)]
documentation: mention API/MaxKeepBlobBuffers on the Keepstore
installation page.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16616-publish-packer-compute-images'
Ward Vandewege [Wed, 29 Jul 2020 15:10:15 +0000 (11:10 -0400)]
Merge branch '16616-publish-packer-compute-images'

refs #16616

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16616: make sure that docker uses the large partition on the compute
Ward Vandewege [Wed, 29 Jul 2020 15:09:24 +0000 (11:09 -0400)]
16616: make sure that docker uses the large partition on the compute
       nodes.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16616: incorporate review comments.
Ward Vandewege [Wed, 29 Jul 2020 13:58:25 +0000 (09:58 -0400)]
16616: incorporate review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16616: move the compute-image packer templates into the arvados
Ward Vandewege [Tue, 28 Jul 2020 17:37:46 +0000 (13:37 -0400)]
16616: move the compute-image packer templates into the arvados
       repository. Update documentation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agodocumentation: arvados-dispatch-cloud: add missing curl command.
Ward Vandewege [Fri, 24 Jul 2020 21:13:49 +0000 (17:13 -0400)]
documentation: arvados-dispatch-cloud: add missing curl command.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16631-no-run-on-drain'
Tom Clegg [Fri, 24 Jul 2020 19:57:58 +0000 (15:57 -0400)]
Merge branch '16631-no-run-on-drain'

refs #16631

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16631: Don't start new containers on nodes in hold/drain state.
Tom Clegg [Fri, 24 Jul 2020 19:47:31 +0000 (15:47 -0400)]
16631: Don't start new containers on nodes in hold/drain state.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoThe arvados-docker-cleaner packages on Debian 10 and Ubuntu
Ward Vandewege [Thu, 23 Jul 2020 13:13:53 +0000 (09:13 -0400)]
The arvados-docker-cleaner packages on Debian 10 and Ubuntu
18.04 (and later, presumably) have a dependency on the python3-distutils
package.

closes #16611

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16623: Add NetworkResourceGroup to install-dispatch-cloud
Peter Amstutz [Wed, 22 Jul 2020 20:28:57 +0000 (16:28 -0400)]
16623: Add NetworkResourceGroup to install-dispatch-cloud

refs #16623

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16623: Add NetworkResourceGroup option for Azure
Peter Amstutz [Wed, 22 Jul 2020 18:58:59 +0000 (14:58 -0400)]
16623: Add NetworkResourceGroup option for Azure

refs #16623

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '16585-keep-exercise-improvements'
Ward Vandewege [Wed, 22 Jul 2020 20:09:53 +0000 (16:09 -0400)]
Merge branch '16585-keep-exercise-improvements'

closes #16585

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch 'master' into 16585-keep-exercise-improvements
Ward Vandewege [Wed, 22 Jul 2020 20:09:19 +0000 (16:09 -0400)]
Merge branch 'master' into 16585-keep-exercise-improvements

refs #16585

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16585: implement review feedback.
Ward Vandewege [Tue, 21 Jul 2020 21:10:40 +0000 (17:10 -0400)]
16585: implement review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16584-with-schemas' refs #16584
Peter Amstutz [Tue, 21 Jul 2020 21:02:11 +0000 (17:02 -0400)]
Merge branch '16584-with-schemas' refs #16584

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '16377-missing-default' refs #16377
Peter Amstutz [Tue, 21 Jul 2020 21:01:57 +0000 (17:01 -0400)]
Merge branch '16377-missing-default' refs #16377

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '16353-cwl-1.2' refs #16353
Peter Amstutz [Tue, 21 Jul 2020 20:59:14 +0000 (16:59 -0400)]
Merge branch '16353-cwl-1.2' refs #16353

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16585: fix memory leak when -repeat is specified and -rthreads is not
Ward Vandewege [Mon, 20 Jul 2020 23:21:14 +0000 (19:21 -0400)]
16585: fix memory leak when -repeat is specified and -rthreads is not
       zero. Always skip warmup phase when -rthreads is zero.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16353: Handle a few mount point edge cases.
Peter Amstutz [Mon, 20 Jul 2020 22:11:18 +0000 (18:11 -0400)]
16353: Handle a few mount point edge cases.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>