arvados.git
3 years ago10477: implement review comments.
Ward Vandewege [Wed, 29 Jul 2020 15:58:16 +0000 (11:58 -0400)]
10477: implement review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago10477: disable sha-256 calculation by the S3 driver; we don't need it
Ward Vandewege [Fri, 24 Jul 2020 17:55:51 +0000 (13:55 -0400)]
10477: disable sha-256 calculation by the S3 driver; we don't need it
       and it slows uploads down because it's CPU bound.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago10477: first version of the aws-sdk-go-v2 driver.
Ward Vandewege [Wed, 22 Jul 2020 11:10:14 +0000 (07:10 -0400)]
10477: first version of the aws-sdk-go-v2 driver.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16636: add boot outcome metrics.
Ward Vandewege [Fri, 31 Jul 2020 21:37:12 +0000 (17:37 -0400)]
16636: add boot outcome metrics.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agogofmt fix.
Ward Vandewege [Fri, 31 Jul 2020 21:28:04 +0000 (17:28 -0400)]
gofmt fix.

refs #16616

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16535: Test XML header and content-type.
Tom Clegg [Fri, 31 Jul 2020 20:36:22 +0000 (16:36 -0400)]
16535: Test XML header and content-type.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16535: Test Size field in list response.
Tom Clegg [Fri, 31 Jul 2020 20:32:42 +0000 (16:32 -0400)]
16535: Test Size field in list response.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16535: Test HeadObject and HeadBucket.
Tom Clegg [Fri, 31 Jul 2020 20:23:25 +0000 (16:23 -0400)]
16535: Test HeadObject and HeadBucket.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agodocumentation: fix more broken links.
Ward Vandewege [Fri, 31 Jul 2020 20:06:18 +0000 (16:06 -0400)]
documentation: fix more broken links.

refs #16616

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agodocumentation: fix broken links; also arvados-dispatch-cloud is not
Ward Vandewege [Fri, 31 Jul 2020 19:05:22 +0000 (15:05 -0400)]
documentation: fix broken links; also arvados-dispatch-cloud is not
experimental anymore.

refs #16616

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16535: Fixup HeadBucket handler.
Tom Clegg [Thu, 30 Jul 2020 20:53:00 +0000 (16:53 -0400)]
16535: Fixup HeadBucket handler.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16535: Populate object Size field in ListBucket response.
Tom Clegg [Thu, 30 Jul 2020 20:38:34 +0000 (16:38 -0400)]
16535: Populate object Size field in ListBucket response.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16535: Add HeadBucket API.
Tom Clegg [Thu, 30 Jul 2020 20:38:26 +0000 (16:38 -0400)]
16535: Add HeadBucket API.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16535: Fix XML tags on ListBucket response, add XML headers.
Tom Clegg [Thu, 30 Jul 2020 20:23:13 +0000 (16:23 -0400)]
16535: Fix XML tags on ListBucket response, add XML headers.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16535: Set header Content-Type: application/xml.
Tom Clegg [Thu, 30 Jul 2020 19:21:19 +0000 (15:21 -0400)]
16535: Set header Content-Type: application/xml.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agodocumentation: mention API/MaxKeepBlobBuffers on the Keepstore
Ward Vandewege [Wed, 29 Jul 2020 21:36:30 +0000 (17:36 -0400)]
documentation: mention API/MaxKeepBlobBuffers on the Keepstore
installation page.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16616-publish-packer-compute-images'
Ward Vandewege [Wed, 29 Jul 2020 15:10:15 +0000 (11:10 -0400)]
Merge branch '16616-publish-packer-compute-images'

refs #16616

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16616: make sure that docker uses the large partition on the compute
Ward Vandewege [Wed, 29 Jul 2020 15:09:24 +0000 (11:09 -0400)]
16616: make sure that docker uses the large partition on the compute
       nodes.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16535: Add GetBucketVersioning API.
Tom Clegg [Wed, 29 Jul 2020 14:20:16 +0000 (10:20 -0400)]
16535: Add GetBucketVersioning API.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16535: Delete project in teardown.
Tom Clegg [Tue, 28 Jul 2020 20:14:54 +0000 (16:14 -0400)]
16535: Delete project in teardown.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16535: Improve error message.
Tom Clegg [Tue, 28 Jul 2020 20:14:48 +0000 (16:14 -0400)]
16535: Improve error message.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16535: Use 1000 as default and maximum value for max-keys.
Tom Clegg [Tue, 28 Jul 2020 20:14:29 +0000 (16:14 -0400)]
16535: Use 1000 as default and maximum value for max-keys.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16616: incorporate review comments.
Ward Vandewege [Wed, 29 Jul 2020 13:58:25 +0000 (09:58 -0400)]
16616: incorporate review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16535: Trial support for V4 S3 signatures.
Tom Clegg [Tue, 28 Jul 2020 20:13:50 +0000 (16:13 -0400)]
16535: Trial support for V4 S3 signatures.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16616: move the compute-image packer templates into the arvados
Ward Vandewege [Tue, 28 Jul 2020 17:37:46 +0000 (13:37 -0400)]
16616: move the compute-image packer templates into the arvados
       repository. Update documentation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agodocumentation: arvados-dispatch-cloud: add missing curl command.
Ward Vandewege [Fri, 24 Jul 2020 21:13:49 +0000 (17:13 -0400)]
documentation: arvados-dispatch-cloud: add missing curl command.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16631-no-run-on-drain'
Tom Clegg [Fri, 24 Jul 2020 19:57:58 +0000 (15:57 -0400)]
Merge branch '16631-no-run-on-drain'

refs #16631

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16631: Don't start new containers on nodes in hold/drain state.
Tom Clegg [Fri, 24 Jul 2020 19:47:31 +0000 (15:47 -0400)]
16631: Don't start new containers on nodes in hold/drain state.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16535: Fix import path.
Tom Clegg [Thu, 23 Jul 2020 14:35:27 +0000 (10:35 -0400)]
16535: Fix import path.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoThe arvados-docker-cleaner packages on Debian 10 and Ubuntu
Ward Vandewege [Thu, 23 Jul 2020 13:13:53 +0000 (09:13 -0400)]
The arvados-docker-cleaner packages on Debian 10 and Ubuntu
18.04 (and later, presumably) have a dependency on the python3-distutils
package.

closes #16611

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16623: Add NetworkResourceGroup to install-dispatch-cloud
Peter Amstutz [Wed, 22 Jul 2020 20:28:57 +0000 (16:28 -0400)]
16623: Add NetworkResourceGroup to install-dispatch-cloud

refs #16623

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16623: Add NetworkResourceGroup option for Azure
Peter Amstutz [Wed, 22 Jul 2020 18:58:59 +0000 (14:58 -0400)]
16623: Add NetworkResourceGroup option for Azure

refs #16623

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '16585-keep-exercise-improvements'
Ward Vandewege [Wed, 22 Jul 2020 20:09:53 +0000 (16:09 -0400)]
Merge branch '16585-keep-exercise-improvements'

closes #16585

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch 'master' into 16585-keep-exercise-improvements
Ward Vandewege [Wed, 22 Jul 2020 20:09:19 +0000 (16:09 -0400)]
Merge branch 'master' into 16585-keep-exercise-improvements

refs #16585

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16585: implement review feedback.
Ward Vandewege [Tue, 21 Jul 2020 21:10:40 +0000 (17:10 -0400)]
16585: implement review feedback.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch '16584-with-schemas' refs #16584
Peter Amstutz [Tue, 21 Jul 2020 21:02:11 +0000 (17:02 -0400)]
Merge branch '16584-with-schemas' refs #16584

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '16377-missing-default' refs #16377
Peter Amstutz [Tue, 21 Jul 2020 21:01:57 +0000 (17:01 -0400)]
Merge branch '16377-missing-default' refs #16377

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years agoMerge branch '16353-cwl-1.2' refs #16353
Peter Amstutz [Tue, 21 Jul 2020 20:59:14 +0000 (16:59 -0400)]
Merge branch '16353-cwl-1.2' refs #16353

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16535: Support delimiter/rollup option in list API.
Tom Clegg [Tue, 21 Jul 2020 15:17:49 +0000 (11:17 -0400)]
16535: Support delimiter/rollup option in list API.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16585: fix memory leak when -repeat is specified and -rthreads is not
Ward Vandewege [Mon, 20 Jul 2020 23:21:14 +0000 (19:21 -0400)]
16585: fix memory leak when -repeat is specified and -rthreads is not
       zero. Always skip warmup phase when -rthreads is zero.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16353: Handle a few mount point edge cases.
Peter Amstutz [Mon, 20 Jul 2020 22:11:18 +0000 (18:11 -0400)]
16353: Handle a few mount point edge cases.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16353: Support CWL 1.2 behavior for mounting at arbitrary container path
Peter Amstutz [Mon, 20 Jul 2020 19:59:29 +0000 (15:59 -0400)]
16353: Support CWL 1.2 behavior for mounting at arbitrary container path

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16535: Add ListObjects API.
Tom Clegg [Fri, 17 Jul 2020 20:06:18 +0000 (16:06 -0400)]
16535: Add ListObjects API.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch 'golharam-use_mktemp'
Ward Vandewege [Fri, 17 Jul 2020 13:34:33 +0000 (09:34 -0400)]
Merge branch 'golharam-use_mktemp'

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch 'use_mktemp' of https://github.com/golharam/arvados into golharam-use_mktemp
Ward Vandewege [Fri, 17 Jul 2020 13:33:19 +0000 (09:33 -0400)]
Merge branch 'use_mktemp' of https://github.com/golharam/arvados into golharam-use_mktemp

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch 'mr-c-patch-1'
Ward Vandewege [Fri, 17 Jul 2020 13:28:56 +0000 (09:28 -0400)]
Merge branch 'mr-c-patch-1'

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoMerge branch 'patch-1' of https://github.com/mr-c/arvados into mr-c-patch-1
Ward Vandewege [Fri, 17 Jul 2020 13:14:59 +0000 (09:14 -0400)]
Merge branch 'patch-1' of https://github.com/mr-c/arvados into mr-c-patch-1

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16535: Support Sync() on customfilesystem.
Tom Clegg [Wed, 15 Jul 2020 16:15:38 +0000 (12:15 -0400)]
16535: Support Sync() on customfilesystem.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16589-arv-fed-migrate-fixes'
Lucas Di Pentima [Tue, 14 Jul 2020 21:42:56 +0000 (18:42 -0300)]
Merge branch '16589-arv-fed-migrate-fixes'
Closes #16589

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16589: Changes error message wording.
Lucas Di Pentima [Tue, 14 Jul 2020 21:33:17 +0000 (18:33 -0300)]
16589: Changes error message wording.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16377: Fix CollectionFsAccess.exists to catch IOError & return False
Peter Amstutz [Thu, 25 Jun 2020 21:36:19 +0000 (17:36 -0400)]
16377: Fix CollectionFsAccess.exists to catch IOError & return False

Add test to reproduce

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16584: Fix http tests for change in naming
Peter Amstutz [Tue, 14 Jul 2020 17:19:14 +0000 (13:19 -0400)]
16584: Fix http tests for change in naming

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16584: Add --skip-schemas (passthrough to cwltool)
Peter Amstutz [Mon, 13 Jul 2020 21:39:50 +0000 (17:39 -0400)]
16584: Add --skip-schemas (passthrough to cwltool)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16584: collection name quote slashes in http_to_keep
Peter Amstutz [Mon, 13 Jul 2020 21:36:45 +0000 (17:36 -0400)]
16584: collection name quote slashes in http_to_keep

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16584: Don't consume exception in set_crunch_output
Peter Amstutz [Tue, 14 Jul 2020 17:19:14 +0000 (13:19 -0400)]
16584: Don't consume exception in set_crunch_output

Fix a couple of incorrect tests that were hidden by this.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16589: Fixes name collision error matching, enhances admin migration message.
Lucas Di Pentima [Tue, 14 Jul 2020 16:43:47 +0000 (13:43 -0300)]
16589: Fixes name collision error matching, enhances admin migration message.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16535: Fix error response codes for invalid names (4xx, not 5xx).
Tom Clegg [Tue, 14 Jul 2020 14:22:09 +0000 (10:22 -0400)]
16535: Fix error response codes for invalid names (4xx, not 5xx).

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16535: Refactor Sync implementation.
Tom Clegg [Tue, 14 Jul 2020 13:23:21 +0000 (09:23 -0400)]
16535: Refactor Sync implementation.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16589: Properly reports error when a name collision happens.
Lucas Di Pentima [Mon, 13 Jul 2020 21:58:47 +0000 (18:58 -0300)]
16589: Properly reports error when a name collision happens.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16589: Changes default data migration behavior.
Lucas Di Pentima [Mon, 13 Jul 2020 21:31:23 +0000 (18:31 -0300)]
16589: Changes default data migration behavior.

Now all users' data will be moved to the target account's home project unless
--data-into-subproject is used.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16589: Enhances error message when admin status doesn't match.
Lucas Di Pentima [Mon, 13 Jul 2020 21:03:44 +0000 (18:03 -0300)]
16589: Enhances error message when admin status doesn't match.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years agoMerge branch '16534-testable'
Tom Clegg [Mon, 13 Jul 2020 18:12:26 +0000 (14:12 -0400)]
Merge branch '16534-testable'

refs #16534

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16535: collectionFileSystem implements inode, eliminating wrapper.
Tom Clegg [Mon, 13 Jul 2020 15:57:37 +0000 (11:57 -0400)]
16535: collectionFileSystem implements inode, eliminating wrapper.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16353: Bump cwltool version
Peter Amstutz [Mon, 13 Jul 2020 15:20:10 +0000 (11:20 -0400)]
16353: Bump cwltool version

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16535: Refactor test suite to accommodate "project bucket" tests.
Tom Clegg [Mon, 13 Jul 2020 14:46:09 +0000 (10:46 -0400)]
16535: Refactor test suite to accommodate "project bucket" tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16535: Move s3 handler to s3.go.
Tom Clegg [Mon, 13 Jul 2020 14:45:47 +0000 (10:45 -0400)]
16535: Move s3 handler to s3.go.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16535: Add s3 endpoint.
Tom Clegg [Mon, 13 Jul 2020 13:55:57 +0000 (09:55 -0400)]
16535: Add s3 endpoint.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '16573-keep-deduplication-reporting-tool'
Ward Vandewege [Mon, 13 Jul 2020 13:26:53 +0000 (09:26 -0400)]
Merge branch '16573-keep-deduplication-reporting-tool'

closes #16573

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16573: address a few more review comments.
Ward Vandewege [Mon, 13 Jul 2020 13:25:11 +0000 (09:25 -0400)]
16573: address a few more review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16573: address review comments.
Ward Vandewege [Mon, 13 Jul 2020 01:34:02 +0000 (21:34 -0400)]
16573: address review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16589: Removes debugging import.
Lucas Di Pentima [Fri, 10 Jul 2020 17:09:36 +0000 (14:09 -0300)]
16589: Removes debugging import.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16589: Fixes test check.
Lucas Di Pentima [Fri, 10 Jul 2020 16:17:22 +0000 (13:17 -0300)]
16589: Fixes test check.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16589: Migrates users' first & last names.
Lucas Di Pentima [Fri, 10 Jul 2020 15:22:39 +0000 (12:22 -0300)]
16589: Migrates users' first & last names.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16573: Merge branch 'master' into 16573-keep-deduplication-reporting-tool
Ward Vandewege [Fri, 10 Jul 2020 14:53:46 +0000 (10:53 -0400)]
16573: Merge branch 'master' into 16573-keep-deduplication-reporting-tool

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16589: Adds checks testing that migrated users get their first & last names.
Lucas Di Pentima [Fri, 10 Jul 2020 14:05:41 +0000 (11:05 -0300)]
16589: Adds checks testing that migrated users get their first & last names.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16585: add -useIndex flag. Remove global variables.
Ward Vandewege [Thu, 9 Jul 2020 21:31:46 +0000 (17:31 -0400)]
16585: add -useIndex flag. Remove global variables.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16589: Fixes dry-run mode. Adds command arg to avoid subproject creation.
Lucas Di Pentima [Thu, 9 Jul 2020 21:00:17 +0000 (18:00 -0300)]
16589: Fixes dry-run mode. Adds command arg to avoid subproject creation.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

3 years ago16534: Merge branch 'master'
Tom Clegg [Thu, 9 Jul 2020 15:09:18 +0000 (11:09 -0400)]
16534: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16534: Get ready to pass parent handle to controllers.
Tom Clegg [Thu, 9 Jul 2020 14:24:55 +0000 (10:24 -0400)]
16534: Get ready to pass parent handle to controllers.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16534: Move RoutableFunc to lib/controller/api.
Tom Clegg [Thu, 9 Jul 2020 14:07:59 +0000 (10:07 -0400)]
16534: Move RoutableFunc to lib/controller/api.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16573: add a deduplication-report command to arvados-client
Ward Vandewege [Mon, 29 Jun 2020 20:53:38 +0000 (16:53 -0400)]
16573: add a deduplication-report command to arvados-client

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16585: simplify the code: use a context instead of a channel for the
Ward Vandewege [Tue, 7 Jul 2020 20:56:21 +0000 (16:56 -0400)]
16585: simplify the code: use a context instead of a channel for the
       timer and catching signals.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16534: Add/fix comments.
Tom Clegg [Tue, 7 Jul 2020 18:40:08 +0000 (14:40 -0400)]
16534: Add/fix comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16353: Initialize 'builder' with document version
Peter Amstutz [Tue, 7 Jul 2020 17:55:04 +0000 (13:55 -0400)]
16353: Initialize 'builder' with document version

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16353: Bump schema salad and cwltool versions for v1.2.0-dev4 support
Peter Amstutz [Tue, 7 Jul 2020 17:23:11 +0000 (13:23 -0400)]
16353: Bump schema salad and cwltool versions for v1.2.0-dev4 support

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

3 years ago16585: Add --repeat cli argument, which automatically repeats an
Ward Vandewege [Mon, 6 Jul 2020 13:37:32 +0000 (09:37 -0400)]
16585: Add --repeat cli argument, which automatically repeats an
expirement N times. Add warmup phase to ensure there are always
sufficient blocks available for all read threads. Refactor nextLocator
to be an atomic.Value instead of a channel, to avoid read starvation.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years agoInstall old version of XML package from source.
Tom Clegg [Tue, 7 Jul 2020 14:51:31 +0000 (10:51 -0400)]
Install old version of XML package from source.

refs #16586

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoDocumentation: fix nginx snippets, remove warnings.
Ward Vandewege [Tue, 7 Jul 2020 13:27:43 +0000 (09:27 -0400)]
Documentation: fix nginx snippets, remove warnings.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>

3 years ago16534: Move controller transaction/context code to its own package.
Tom Clegg [Mon, 6 Jul 2020 20:00:35 +0000 (16:00 -0400)]
16534: Move controller transaction/context code to its own package.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years agoMerge branch '15348-pam-module'
Tom Clegg [Mon, 6 Jul 2020 18:18:18 +0000 (14:18 -0400)]
Merge branch '15348-pam-module'

refs #15348

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16534: Exempt go.mod and go.sum from license header check.
Tom Clegg [Mon, 6 Jul 2020 13:51:12 +0000 (09:51 -0400)]
16534: Exempt go.mod and go.sum from license header check.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago16534: Supply *sqlx.Tx to controller handlers.
Tom Clegg [Mon, 6 Jul 2020 13:47:46 +0000 (09:47 -0400)]
16534: Supply *sqlx.Tx to controller handlers.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15348: Fix packaging bug that was ignoring fpm-info.sh for Go progs.
Tom Clegg [Thu, 2 Jul 2020 20:53:51 +0000 (16:53 -0400)]
15348: Fix packaging bug that was ignoring fpm-info.sh for Go progs.

Until now, the libpam-arvados-go dependency on ca-certificates and the
keep-web dependency on mailcap/mime-support were listed correctly in
fpm-info.sh, but they weren't expressed in the packages because
run-library.sh was looking for fpm-info.sh in the wrong place.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15348: Tweak README wording.
Tom Clegg [Thu, 2 Jul 2020 15:20:16 +0000 (11:20 -0400)]
15348: Tweak README wording.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15348: Look up hostname if not provided in config args.
Tom Clegg [Thu, 2 Jul 2020 14:48:15 +0000 (10:48 -0400)]
15348: Look up hostname if not provided in config args.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15348: Add README to libpam-arvados-go package.
Tom Clegg [Wed, 1 Jul 2020 19:28:47 +0000 (15:28 -0400)]
15348: Add README to libpam-arvados-go package.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15348: Update webshell install docs to use new pam package.
Tom Clegg [Wed, 1 Jul 2020 19:05:28 +0000 (15:05 -0400)]
15348: Update webshell install docs to use new pam package.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15348: Merge branch 'master'
Tom Clegg [Wed, 1 Jul 2020 19:01:38 +0000 (15:01 -0400)]
15348: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15348: Rename libpam-arvados-experimental -> libpam-arvados-go.
Tom Clegg [Wed, 1 Jul 2020 18:49:49 +0000 (14:49 -0400)]
15348: Rename libpam-arvados-experimental -> libpam-arvados-go.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

3 years ago15348: Use normal (packaged) path in docker test case.
Tom Clegg [Wed, 1 Jul 2020 18:48:29 +0000 (14:48 -0400)]
15348: Use normal (packaged) path in docker test case.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>