arvados.git
4 years agoMerge branch '16663-running-ctrs-unknown-workers'
Tom Clegg [Mon, 17 Aug 2020 15:00:08 +0000 (11:00 -0400)]
Merge branch '16663-running-ctrs-unknown-workers'

fixes #16663

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '15889-delete-traffic_test.py' into master
Nico Cesar [Mon, 17 Aug 2020 14:47:48 +0000 (10:47 -0400)]
Merge branch '15889-delete-traffic_test.py' into master

closes #15889

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

4 years agodeleted services/keep/tools/traffic_test.py
Nico Cesar [Mon, 17 Aug 2020 14:26:14 +0000 (10:26 -0400)]
deleted services/keep/tools/traffic_test.py

refs #15889

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curii.com>

4 years ago16663: Merge branch 'master'
Tom Clegg [Mon, 17 Aug 2020 14:17:28 +0000 (10:17 -0400)]
16663: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16663: Add comments in racy test.
Tom Clegg [Mon, 17 Aug 2020 14:16:47 +0000 (10:16 -0400)]
16663: Add comments in racy test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoFix more ineffassign warnings.
Ward Vandewege [Mon, 17 Aug 2020 02:27:59 +0000 (22:27 -0400)]
Fix more ineffassign warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agoFix more ineffassign warnings.
Ward Vandewege [Sat, 15 Aug 2020 02:22:44 +0000 (22:22 -0400)]
Fix more ineffassign warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agoMerge branch '16683-fed-sharing' refs #16683
Peter Amstutz [Fri, 14 Aug 2020 19:54:16 +0000 (15:54 -0400)]
Merge branch '16683-fed-sharing' refs #16683

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16683: Add test, remove useless check for PDH pattern
Peter Amstutz [Fri, 14 Aug 2020 16:07:56 +0000 (12:07 -0400)]
16683: Add test, remove useless check for PDH pattern

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16683: Check that remote cluster id is presumed valid
Peter Amstutz [Fri, 14 Aug 2020 13:57:53 +0000 (09:57 -0400)]
16683: Check that remote cluster id is presumed valid

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16683: Revert behavior change, run gofmt
Peter Amstutz [Thu, 13 Aug 2020 20:31:31 +0000 (16:31 -0400)]
16683: Revert behavior change, run gofmt

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16683: Accept PDH for head_uuid/tail_uuid
Peter Amstutz [Thu, 13 Aug 2020 19:22:49 +0000 (15:22 -0400)]
16683: Accept PDH for head_uuid/tail_uuid

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16683: Permit granting permissions to remote users
Peter Amstutz [Wed, 12 Aug 2020 21:32:06 +0000 (17:32 -0400)]
16683: Permit granting permissions to remote users

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16683: Sharing dialog query is compatible with federated user list
Peter Amstutz [Wed, 12 Aug 2020 20:20:19 +0000 (16:20 -0400)]
16683: Sharing dialog query is compatible with federated user list

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16683: Set and check ForwardedFor on federated list requests
Peter Amstutz [Wed, 12 Aug 2020 20:10:32 +0000 (16:10 -0400)]
16683: Set and check ForwardedFor on federated list requests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16683: Add checks related to sharing and remote users
Peter Amstutz [Thu, 13 Aug 2020 16:44:29 +0000 (12:44 -0400)]
16683: Add checks related to sharing and remote users

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agodocumentation: disable download buffering in our sample nginx config for
Ward Vandewege [Wed, 12 Aug 2020 14:19:07 +0000 (10:19 -0400)]
documentation: disable download buffering in our sample nginx config for
keep-web and keepproxy. This helps when the clients are far away/slow.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agoFix some ineffassign warnings.
Ward Vandewege [Mon, 10 Aug 2020 23:32:43 +0000 (19:32 -0400)]
Fix some ineffassign warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agoFix typo.
Ward Vandewege [Mon, 10 Aug 2020 23:11:00 +0000 (19:11 -0400)]
Fix typo.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agoMerge branch '16353-1.2-release' refs #16353
Peter Amstutz [Mon, 10 Aug 2020 20:10:48 +0000 (16:10 -0400)]
Merge branch '16353-1.2-release' refs #16353

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16353: Add a section "Upgrading your workflow to CWL v1.2"
Peter Amstutz [Mon, 10 Aug 2020 20:09:35 +0000 (16:09 -0400)]
16353: Add a section "Upgrading your workflow to CWL v1.2"

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16353: Update cwltool for stable 1.2
Peter Amstutz [Mon, 10 Aug 2020 17:17:57 +0000 (13:17 -0400)]
16353: Update cwltool for stable 1.2

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16663: Test for errant cancel while VMs have state==unknown.
Tom Clegg [Tue, 4 Aug 2020 21:19:45 +0000 (17:19 -0400)]
16663: Test for errant cancel while VMs have state==unknown.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16663: Don't kill orphaned containers when unprobed nodes exist.
Tom Clegg [Tue, 4 Aug 2020 20:06:29 +0000 (16:06 -0400)]
16663: Don't kill orphaned containers when unprobed nodes exist.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '10477-upgrade-aws-s3-driver'
Ward Vandewege [Tue, 4 Aug 2020 19:45:51 +0000 (15:45 -0400)]
Merge branch '10477-upgrade-aws-s3-driver'

closes #10477

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agoMerge branch 'master' into 10477-upgrade-aws-s3-driver
Ward Vandewege [Tue, 4 Aug 2020 19:45:07 +0000 (15:45 -0400)]
Merge branch 'master' into 10477-upgrade-aws-s3-driver

refs #10477

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago16625: Added fix to prevent ruby from failing when @ appears in the user for the...
medcelerate [Mon, 27 Jul 2020 17:00:30 +0000 (13:00 -0400)]
16625: Added fix to prevent ruby from failing when @ appears in the user for the database config.

Added escaping to password and dbname.

refs #16625

Arvados-DCO-1.1-Signed-off-by: Evan Clark <evan.clark.professional@gmail.com>

4 years agoboot outcomes metric: fix labels and add some checks for the new metric
Ward Vandewege [Mon, 3 Aug 2020 20:04:31 +0000 (16:04 -0400)]
boot outcomes metric: fix labels and add some checks for the new metric
in the tests.

refs #16636

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agoMerge branch '16636-boot-outcome-metrics'
Ward Vandewege [Mon, 3 Aug 2020 18:49:23 +0000 (14:49 -0400)]
Merge branch '16636-boot-outcome-metrics'

refs #16636

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago16636: implement review comments.
Ward Vandewege [Mon, 3 Aug 2020 18:37:22 +0000 (14:37 -0400)]
16636: implement review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago10477: Fix timezone handling in s3aws tests, to avoid issues when the tests are
Ward Vandewege [Mon, 3 Aug 2020 15:14:29 +0000 (11:14 -0400)]
10477: Fix timezone handling in s3aws tests, to avoid issues when the tests are
run in non-UTC environments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago10477: implement review comments.
Ward Vandewege [Wed, 29 Jul 2020 15:58:16 +0000 (11:58 -0400)]
10477: implement review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago10477: disable sha-256 calculation by the S3 driver; we don't need it
Ward Vandewege [Fri, 24 Jul 2020 17:55:51 +0000 (13:55 -0400)]
10477: disable sha-256 calculation by the S3 driver; we don't need it
       and it slows uploads down because it's CPU bound.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago10477: first version of the aws-sdk-go-v2 driver.
Ward Vandewege [Wed, 22 Jul 2020 11:10:14 +0000 (07:10 -0400)]
10477: first version of the aws-sdk-go-v2 driver.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago16636: add boot outcome metrics.
Ward Vandewege [Fri, 31 Jul 2020 21:37:12 +0000 (17:37 -0400)]
16636: add boot outcome metrics.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agogofmt fix.
Ward Vandewege [Fri, 31 Jul 2020 21:28:04 +0000 (17:28 -0400)]
gofmt fix.

refs #16616

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agodocumentation: fix more broken links.
Ward Vandewege [Fri, 31 Jul 2020 20:06:18 +0000 (16:06 -0400)]
documentation: fix more broken links.

refs #16616

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agodocumentation: fix broken links; also arvados-dispatch-cloud is not
Ward Vandewege [Fri, 31 Jul 2020 19:05:22 +0000 (15:05 -0400)]
documentation: fix broken links; also arvados-dispatch-cloud is not
experimental anymore.

refs #16616

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agodocumentation: mention API/MaxKeepBlobBuffers on the Keepstore
Ward Vandewege [Wed, 29 Jul 2020 21:36:30 +0000 (17:36 -0400)]
documentation: mention API/MaxKeepBlobBuffers on the Keepstore
installation page.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agoMerge branch '16616-publish-packer-compute-images'
Ward Vandewege [Wed, 29 Jul 2020 15:10:15 +0000 (11:10 -0400)]
Merge branch '16616-publish-packer-compute-images'

refs #16616

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago16616: make sure that docker uses the large partition on the compute
Ward Vandewege [Wed, 29 Jul 2020 15:09:24 +0000 (11:09 -0400)]
16616: make sure that docker uses the large partition on the compute
       nodes.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago16616: incorporate review comments.
Ward Vandewege [Wed, 29 Jul 2020 13:58:25 +0000 (09:58 -0400)]
16616: incorporate review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago16616: move the compute-image packer templates into the arvados
Ward Vandewege [Tue, 28 Jul 2020 17:37:46 +0000 (13:37 -0400)]
16616: move the compute-image packer templates into the arvados
       repository. Update documentation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agodocumentation: arvados-dispatch-cloud: add missing curl command.
Ward Vandewege [Fri, 24 Jul 2020 21:13:49 +0000 (17:13 -0400)]
documentation: arvados-dispatch-cloud: add missing curl command.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agoMerge branch '16631-no-run-on-drain'
Tom Clegg [Fri, 24 Jul 2020 19:57:58 +0000 (15:57 -0400)]
Merge branch '16631-no-run-on-drain'

refs #16631

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16631: Don't start new containers on nodes in hold/drain state.
Tom Clegg [Fri, 24 Jul 2020 19:47:31 +0000 (15:47 -0400)]
16631: Don't start new containers on nodes in hold/drain state.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoThe arvados-docker-cleaner packages on Debian 10 and Ubuntu
Ward Vandewege [Thu, 23 Jul 2020 13:13:53 +0000 (09:13 -0400)]
The arvados-docker-cleaner packages on Debian 10 and Ubuntu
18.04 (and later, presumably) have a dependency on the python3-distutils
package.

closes #16611

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago16623: Add NetworkResourceGroup to install-dispatch-cloud
Peter Amstutz [Wed, 22 Jul 2020 20:28:57 +0000 (16:28 -0400)]
16623: Add NetworkResourceGroup to install-dispatch-cloud

refs #16623

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16623: Add NetworkResourceGroup option for Azure
Peter Amstutz [Wed, 22 Jul 2020 18:58:59 +0000 (14:58 -0400)]
16623: Add NetworkResourceGroup option for Azure

refs #16623

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '16585-keep-exercise-improvements'
Ward Vandewege [Wed, 22 Jul 2020 20:09:53 +0000 (16:09 -0400)]
Merge branch '16585-keep-exercise-improvements'

closes #16585

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agoMerge branch 'master' into 16585-keep-exercise-improvements
Ward Vandewege [Wed, 22 Jul 2020 20:09:19 +0000 (16:09 -0400)]
Merge branch 'master' into 16585-keep-exercise-improvements

refs #16585

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago16585: implement review feedback.
Ward Vandewege [Tue, 21 Jul 2020 21:10:40 +0000 (17:10 -0400)]
16585: implement review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agoMerge branch '16584-with-schemas' refs #16584
Peter Amstutz [Tue, 21 Jul 2020 21:02:11 +0000 (17:02 -0400)]
Merge branch '16584-with-schemas' refs #16584

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '16377-missing-default' refs #16377
Peter Amstutz [Tue, 21 Jul 2020 21:01:57 +0000 (17:01 -0400)]
Merge branch '16377-missing-default' refs #16377

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '16353-cwl-1.2' refs #16353
Peter Amstutz [Tue, 21 Jul 2020 20:59:14 +0000 (16:59 -0400)]
Merge branch '16353-cwl-1.2' refs #16353

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16585: fix memory leak when -repeat is specified and -rthreads is not
Ward Vandewege [Mon, 20 Jul 2020 23:21:14 +0000 (19:21 -0400)]
16585: fix memory leak when -repeat is specified and -rthreads is not
       zero. Always skip warmup phase when -rthreads is zero.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago16353: Handle a few mount point edge cases.
Peter Amstutz [Mon, 20 Jul 2020 22:11:18 +0000 (18:11 -0400)]
16353: Handle a few mount point edge cases.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16353: Support CWL 1.2 behavior for mounting at arbitrary container path
Peter Amstutz [Mon, 20 Jul 2020 19:59:29 +0000 (15:59 -0400)]
16353: Support CWL 1.2 behavior for mounting at arbitrary container path

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch 'golharam-use_mktemp'
Ward Vandewege [Fri, 17 Jul 2020 13:34:33 +0000 (09:34 -0400)]
Merge branch 'golharam-use_mktemp'

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agoMerge branch 'use_mktemp' of https://github.com/golharam/arvados into golharam-use_mktemp
Ward Vandewege [Fri, 17 Jul 2020 13:33:19 +0000 (09:33 -0400)]
Merge branch 'use_mktemp' of https://github.com/golharam/arvados into golharam-use_mktemp

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agoMerge branch 'mr-c-patch-1'
Ward Vandewege [Fri, 17 Jul 2020 13:28:56 +0000 (09:28 -0400)]
Merge branch 'mr-c-patch-1'

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agoMerge branch 'patch-1' of https://github.com/mr-c/arvados into mr-c-patch-1
Ward Vandewege [Fri, 17 Jul 2020 13:14:59 +0000 (09:14 -0400)]
Merge branch 'patch-1' of https://github.com/mr-c/arvados into mr-c-patch-1

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agoMerge branch '16589-arv-fed-migrate-fixes'
Lucas Di Pentima [Tue, 14 Jul 2020 21:42:56 +0000 (18:42 -0300)]
Merge branch '16589-arv-fed-migrate-fixes'
Closes #16589

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16589: Changes error message wording.
Lucas Di Pentima [Tue, 14 Jul 2020 21:33:17 +0000 (18:33 -0300)]
16589: Changes error message wording.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16377: Fix CollectionFsAccess.exists to catch IOError & return False
Peter Amstutz [Thu, 25 Jun 2020 21:36:19 +0000 (17:36 -0400)]
16377: Fix CollectionFsAccess.exists to catch IOError & return False

Add test to reproduce

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16584: Fix http tests for change in naming
Peter Amstutz [Tue, 14 Jul 2020 17:19:14 +0000 (13:19 -0400)]
16584: Fix http tests for change in naming

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16584: Add --skip-schemas (passthrough to cwltool)
Peter Amstutz [Mon, 13 Jul 2020 21:39:50 +0000 (17:39 -0400)]
16584: Add --skip-schemas (passthrough to cwltool)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16584: collection name quote slashes in http_to_keep
Peter Amstutz [Mon, 13 Jul 2020 21:36:45 +0000 (17:36 -0400)]
16584: collection name quote slashes in http_to_keep

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16584: Don't consume exception in set_crunch_output
Peter Amstutz [Tue, 14 Jul 2020 17:19:14 +0000 (13:19 -0400)]
16584: Don't consume exception in set_crunch_output

Fix a couple of incorrect tests that were hidden by this.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16589: Fixes name collision error matching, enhances admin migration message.
Lucas Di Pentima [Tue, 14 Jul 2020 16:43:47 +0000 (13:43 -0300)]
16589: Fixes name collision error matching, enhances admin migration message.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16589: Properly reports error when a name collision happens.
Lucas Di Pentima [Mon, 13 Jul 2020 21:58:47 +0000 (18:58 -0300)]
16589: Properly reports error when a name collision happens.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16589: Changes default data migration behavior.
Lucas Di Pentima [Mon, 13 Jul 2020 21:31:23 +0000 (18:31 -0300)]
16589: Changes default data migration behavior.

Now all users' data will be moved to the target account's home project unless
--data-into-subproject is used.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16589: Enhances error message when admin status doesn't match.
Lucas Di Pentima [Mon, 13 Jul 2020 21:03:44 +0000 (18:03 -0300)]
16589: Enhances error message when admin status doesn't match.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoMerge branch '16534-testable'
Tom Clegg [Mon, 13 Jul 2020 18:12:26 +0000 (14:12 -0400)]
Merge branch '16534-testable'

refs #16534

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16353: Bump cwltool version
Peter Amstutz [Mon, 13 Jul 2020 15:20:10 +0000 (11:20 -0400)]
16353: Bump cwltool version

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '16573-keep-deduplication-reporting-tool'
Ward Vandewege [Mon, 13 Jul 2020 13:26:53 +0000 (09:26 -0400)]
Merge branch '16573-keep-deduplication-reporting-tool'

closes #16573

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago16573: address a few more review comments.
Ward Vandewege [Mon, 13 Jul 2020 13:25:11 +0000 (09:25 -0400)]
16573: address a few more review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago16573: address review comments.
Ward Vandewege [Mon, 13 Jul 2020 01:34:02 +0000 (21:34 -0400)]
16573: address review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago16589: Removes debugging import.
Lucas Di Pentima [Fri, 10 Jul 2020 17:09:36 +0000 (14:09 -0300)]
16589: Removes debugging import.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16589: Fixes test check.
Lucas Di Pentima [Fri, 10 Jul 2020 16:17:22 +0000 (13:17 -0300)]
16589: Fixes test check.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16589: Migrates users' first & last names.
Lucas Di Pentima [Fri, 10 Jul 2020 15:22:39 +0000 (12:22 -0300)]
16589: Migrates users' first & last names.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16573: Merge branch 'master' into 16573-keep-deduplication-reporting-tool
Ward Vandewege [Fri, 10 Jul 2020 14:53:46 +0000 (10:53 -0400)]
16573: Merge branch 'master' into 16573-keep-deduplication-reporting-tool

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago16589: Adds checks testing that migrated users get their first & last names.
Lucas Di Pentima [Fri, 10 Jul 2020 14:05:41 +0000 (11:05 -0300)]
16589: Adds checks testing that migrated users get their first & last names.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16585: add -useIndex flag. Remove global variables.
Ward Vandewege [Thu, 9 Jul 2020 21:31:46 +0000 (17:31 -0400)]
16585: add -useIndex flag. Remove global variables.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago16589: Fixes dry-run mode. Adds command arg to avoid subproject creation.
Lucas Di Pentima [Thu, 9 Jul 2020 21:00:17 +0000 (18:00 -0300)]
16589: Fixes dry-run mode. Adds command arg to avoid subproject creation.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16534: Merge branch 'master'
Tom Clegg [Thu, 9 Jul 2020 15:09:18 +0000 (11:09 -0400)]
16534: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16534: Get ready to pass parent handle to controllers.
Tom Clegg [Thu, 9 Jul 2020 14:24:55 +0000 (10:24 -0400)]
16534: Get ready to pass parent handle to controllers.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16534: Move RoutableFunc to lib/controller/api.
Tom Clegg [Thu, 9 Jul 2020 14:07:59 +0000 (10:07 -0400)]
16534: Move RoutableFunc to lib/controller/api.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16573: add a deduplication-report command to arvados-client
Ward Vandewege [Mon, 29 Jun 2020 20:53:38 +0000 (16:53 -0400)]
16573: add a deduplication-report command to arvados-client

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago16585: simplify the code: use a context instead of a channel for the
Ward Vandewege [Tue, 7 Jul 2020 20:56:21 +0000 (16:56 -0400)]
16585: simplify the code: use a context instead of a channel for the
       timer and catching signals.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago16534: Add/fix comments.
Tom Clegg [Tue, 7 Jul 2020 18:40:08 +0000 (14:40 -0400)]
16534: Add/fix comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16353: Initialize 'builder' with document version
Peter Amstutz [Tue, 7 Jul 2020 17:55:04 +0000 (13:55 -0400)]
16353: Initialize 'builder' with document version

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16353: Bump schema salad and cwltool versions for v1.2.0-dev4 support
Peter Amstutz [Tue, 7 Jul 2020 17:23:11 +0000 (13:23 -0400)]
16353: Bump schema salad and cwltool versions for v1.2.0-dev4 support

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16585: Add --repeat cli argument, which automatically repeats an
Ward Vandewege [Mon, 6 Jul 2020 13:37:32 +0000 (09:37 -0400)]
16585: Add --repeat cli argument, which automatically repeats an
expirement N times. Add warmup phase to ensure there are always
sufficient blocks available for all read threads. Refactor nextLocator
to be an atomic.Value instead of a channel, to avoid read starvation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years agoInstall old version of XML package from source.
Tom Clegg [Tue, 7 Jul 2020 14:51:31 +0000 (10:51 -0400)]
Install old version of XML package from source.

refs #16586

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoDocumentation: fix nginx snippets, remove warnings.
Ward Vandewege [Tue, 7 Jul 2020 13:27:43 +0000 (09:27 -0400)]
Documentation: fix nginx snippets, remove warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

4 years ago16534: Move controller transaction/context code to its own package.
Tom Clegg [Mon, 6 Jul 2020 20:00:35 +0000 (16:00 -0400)]
16534: Move controller transaction/context code to its own package.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '15348-pam-module'
Tom Clegg [Mon, 6 Jul 2020 18:18:18 +0000 (14:18 -0400)]
Merge branch '15348-pam-module'

refs #15348

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16534: Exempt go.mod and go.sum from license header check.
Tom Clegg [Mon, 6 Jul 2020 13:51:12 +0000 (09:51 -0400)]
16534: Exempt go.mod and go.sum from license header check.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16534: Supply *sqlx.Tx to controller handlers.
Tom Clegg [Mon, 6 Jul 2020 13:47:46 +0000 (09:47 -0400)]
16534: Supply *sqlx.Tx to controller handlers.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>