arvados.git
5 years agoExplicitly print the version numbers of virtualenv, pip, setuptools and wheel
Ward Vandewege [Mon, 11 Mar 2019 15:04:44 +0000 (11:04 -0400)]
Explicitly print the version numbers of virtualenv, pip, setuptools and wheel
when building Python packages.

refs #14936

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years agoMerge branch '14938-unreliable-test'
Tom Clegg [Mon, 11 Mar 2019 04:34:33 +0000 (00:34 -0400)]
Merge branch '14938-unreliable-test'

fixes #14938

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14938: Fix unreliable test.
Tom Clegg [Mon, 11 Mar 2019 04:32:22 +0000 (00:32 -0400)]
14938: Fix unreliable test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '14880-keepdocker-argparse' refs #14880
Peter Amstutz [Fri, 8 Mar 2019 21:05:12 +0000 (16:05 -0500)]
Merge branch '14880-keepdocker-argparse' refs #14880

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14880: Fix help message typo.
Peter Amstutz [Fri, 8 Mar 2019 21:03:03 +0000 (16:03 -0500)]
14880: Fix help message typo.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13937: Adds tests for operation & I/O counters.
Lucas Di Pentima [Fri, 8 Mar 2019 20:56:17 +0000 (17:56 -0300)]
13937: Adds tests for operation & I/O counters.

Added {"operation": "any"} to opsCounters so that it's easy to check on tests,
because the kind of operation depends on the driver and the tests were
implemented as part of the volume generic tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoMerge branch '14291-cdc-aws' refs #14291
Peter Amstutz [Fri, 8 Mar 2019 20:19:59 +0000 (15:19 -0500)]
Merge branch '14291-cdc-aws' refs #14291

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14291: EbsVolumeType → EBSVolumeType
Peter Amstutz [Fri, 8 Mar 2019 20:18:44 +0000 (15:18 -0500)]
14291: EbsVolumeType → EBSVolumeType

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14880: Fix argument parsing issues
Peter Amstutz [Fri, 8 Mar 2019 15:14:27 +0000 (10:14 -0500)]
14880: Fix argument parsing issues

arv-keepdocker passes through some flags to arv-put.  The strategy it
uses is to remove known flags and pass through unknown flags. However
it doesn't know if an unknown flag takes a value or not, so it treats
the values as a positional argument rather than the value
corresponding to the unknown flag.

* Move positional arguments from "keepdocker_parser" to "arg_parser"
* Strip positional arguments (image name, tag) from arguments before
  parsing known keepdocker_parser flags.
* Additionally move a couple of flags that were mistakenly added to
  put.run_opts (and thus appearing in the arv-keepdocker help despite
  making no sense) that should have been in put.upload_opts

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14291: Exclude both "shutting-down" and "terminated" instances.
Peter Amstutz [Thu, 7 Mar 2019 21:53:14 +0000 (16:53 -0500)]
14291: Exclude both "shutting-down" and "terminated" instances.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14291: Generate key fingerprints that work with AWS. Filter out terminated instances
Peter Amstutz [Thu, 7 Mar 2019 21:27:18 +0000 (16:27 -0500)]
14291: Generate key fingerprints that work with AWS.  Filter out terminated instances

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '14920-unknown-booting-race'
Tom Clegg [Thu, 7 Mar 2019 19:35:01 +0000 (14:35 -0500)]
Merge branch '14920-unknown-booting-race'

fixes #14920

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14920: Update metrics when worker state changes idle->running.
Tom Clegg [Thu, 7 Mar 2019 19:27:13 +0000 (14:27 -0500)]
14920: Update metrics when worker state changes idle->running.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14291: Add EbsVolumeType, also test fixes
Peter Amstutz [Thu, 7 Mar 2019 19:16:40 +0000 (14:16 -0500)]
14291: Add EbsVolumeType, also test fixes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14291: Tweak Scratch/AddedScratch/IncludedScratch behavior
Peter Amstutz [Thu, 7 Mar 2019 19:16:11 +0000 (14:16 -0500)]
14291: Tweak Scratch/AddedScratch/IncludedScratch behavior

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '14870-retry-logs' refs #14870
Peter Amstutz [Thu, 7 Mar 2019 17:58:04 +0000 (12:58 -0500)]
Merge branch '14870-retry-logs' refs #14870

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14291: Report errors from ImportKeyPair
Peter Amstutz [Thu, 7 Mar 2019 16:43:05 +0000 (11:43 -0500)]
14291: Report errors from ImportKeyPair

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14291: Try again with vendor.json
Peter Amstutz [Thu, 7 Mar 2019 16:26:58 +0000 (11:26 -0500)]
14291: Try again with vendor.json

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14920: Improve comment.
Tom Clegg [Thu, 7 Mar 2019 16:20:38 +0000 (11:20 -0500)]
14920: Improve comment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14291: Another update to vendor.json
Peter Amstutz [Thu, 7 Mar 2019 14:55:15 +0000 (09:55 -0500)]
14291: Another update to vendor.json

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agorefs #14891 .Merge branch '14891-upload-to-testing-repo'
Fernando Monserrat [Thu, 7 Mar 2019 14:52:25 +0000 (11:52 -0300)]
refs #14891 .Merge branch '14891-upload-to-testing-repo'
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

5 years agoissue #14891 fix spaces and initialize RC
Fernando Monserrat [Thu, 7 Mar 2019 14:48:58 +0000 (11:48 -0300)]
issue #14891 fix spaces and initialize RC
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

5 years ago13937: Simplifies volume counter stats assignments. Fixes test.
Lucas Di Pentima [Thu, 7 Mar 2019 14:42:43 +0000 (11:42 -0300)]
13937: Simplifies volume counter stats assignments. Fixes test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14920: Fix state==unknown during create/list race.
Tom Clegg [Thu, 7 Mar 2019 01:51:59 +0000 (20:51 -0500)]
14920: Fix state==unknown during create/list race.

Recognize a new/booting node by its "instance secret" tag instead of
relying on Create() to return the new instance's ID quickly.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13937: Fixes metrics naming
Lucas Di Pentima [Wed, 6 Mar 2019 22:25:10 +0000 (19:25 -0300)]
13937: Fixes metrics naming

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago13937: Simplifies arg passing on Start() funcs
Lucas Di Pentima [Wed, 6 Mar 2019 22:12:20 +0000 (19:12 -0300)]
13937: Simplifies arg passing on Start() funcs

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14291: Add more missing packages to vendor
Peter Amstutz [Wed, 6 Mar 2019 21:35:44 +0000 (16:35 -0500)]
14291: Add more missing packages to vendor

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14291: Add more missing packages to vendor
Peter Amstutz [Wed, 6 Mar 2019 21:30:03 +0000 (16:30 -0500)]
14291: Add more missing packages to vendor

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14291: Add missing packages to vendor
Peter Amstutz [Wed, 6 Mar 2019 21:25:15 +0000 (16:25 -0500)]
14291: Add missing packages to vendor

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14870: Oops need to fix edge case assertion, too
Peter Amstutz [Wed, 6 Mar 2019 21:16:59 +0000 (16:16 -0500)]
14870: Oops need to fix edge case assertion, too

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch 'master' into 13937-keepstore-prometheus
Lucas Di Pentima [Wed, 6 Mar 2019 21:09:28 +0000 (18:09 -0300)]
Merge branch 'master' into 13937-keepstore-prometheus

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14870: Adjust edge case some more, a file named '\' isn't legal either
Peter Amstutz [Wed, 6 Mar 2019 20:59:06 +0000 (15:59 -0500)]
14870: Adjust edge case some more, a file named '\' isn't legal either

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14291: Introduce "AddedScratch" and "IncludedScratch" to InstanceType
Peter Amstutz [Wed, 6 Mar 2019 20:39:44 +0000 (15:39 -0500)]
14291: Introduce "AddedScratch" and "IncludedScratch" to InstanceType

EC2 driver imports public keys on the fly.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14870: Remove \x01 from edge cases
Peter Amstutz [Wed, 6 Mar 2019 19:46:06 +0000 (14:46 -0500)]
14870: Remove \x01 from edge cases

It is no longer accepted by the API server, manifests with control
characters like that are invalid.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '14885-ciso-and-conda-packaging-pr'
Eric Biagiotti [Wed, 6 Mar 2019 19:43:29 +0000 (14:43 -0500)]
Merge branch '14885-ciso-and-conda-packaging-pr'

refs #14885

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years agoMerge branch '14916-rubysdk-upgrade-note'
Lucas Di Pentima [Wed, 6 Mar 2019 19:38:20 +0000 (16:38 -0300)]
Merge branch '14916-rubysdk-upgrade-note'
Closes #14916

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14916: Rephrases upgrade notes. Enhances example script with success message.
Lucas Di Pentima [Wed, 6 Mar 2019 17:44:11 +0000 (14:44 -0300)]
14916: Rephrases upgrade notes. Enhances example script with success message.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoissue #14891 remove -x
Fernando Monserrat [Wed, 6 Mar 2019 15:03:49 +0000 (12:03 -0300)]
issue #14891 remove -x
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

5 years agoissue #14891 Update to receive param rc to build for release candidates
Fernando Monserrat [Tue, 5 Mar 2019 19:19:36 +0000 (16:19 -0300)]
issue #14891 Update to receive param rc to build for release candidates
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

5 years agoMerge branch '14807-zero-metrics'
Tom Clegg [Tue, 5 Mar 2019 19:08:10 +0000 (14:08 -0500)]
Merge branch '14807-zero-metrics'

refs #14807

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14807: Start reporting metrics immediately.
Tom Clegg [Tue, 5 Mar 2019 04:00:00 +0000 (23:00 -0500)]
14807: Start reporting metrics immediately.

...instead of waiting for the first notify event.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14885: Reverts back to parse_datetime_as_naive
Eric Biagiotti [Tue, 5 Mar 2019 19:07:47 +0000 (14:07 -0500)]
14885: Reverts back to parse_datetime_as_naive

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14916: Adds upgrading note with script example for collection checking.
Lucas Di Pentima [Tue, 5 Mar 2019 19:00:58 +0000 (16:00 -0300)]
14916: Adds upgrading note with script example for collection checking.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoissue #14891 upload rcs . Add verbose
Fernando Monserrat [Tue, 5 Mar 2019 16:40:57 +0000 (13:40 -0300)]
issue #14891 upload rcs . Add verbose
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

5 years agoMerge branch '14911-azure-panic'
Tom Clegg [Tue, 5 Mar 2019 16:39:13 +0000 (11:39 -0500)]
Merge branch '14911-azure-panic'

fixes #14911

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '14886-acr-recursion-runtime-error'
Eric Biagiotti [Tue, 5 Mar 2019 16:14:44 +0000 (11:14 -0500)]
Merge branch '14886-acr-recursion-runtime-error'

refs #14886

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14886: Fixes typo
Eric Biagiotti [Tue, 5 Mar 2019 16:11:19 +0000 (11:11 -0500)]
14886: Fixes typo

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14886: Fixes mock issue between tests
Eric Biagiotti [Tue, 5 Mar 2019 14:42:16 +0000 (09:42 -0500)]
14886: Fixes mock issue between tests

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14291: Tweak symbol naming
Peter Amstutz [Tue, 5 Mar 2019 14:15:01 +0000 (09:15 -0500)]
14291: Tweak symbol naming

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14870: Fix another test
Peter Amstutz [Mon, 4 Mar 2019 21:32:23 +0000 (16:32 -0500)]
14870: Fix another test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14911: Fix initialization order.
Tom Clegg [Mon, 4 Mar 2019 20:57:05 +0000 (15:57 -0500)]
14911: Fix initialization order.

Nil az.ctx was being passed to ListKeys(), causing panic.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoissue #14891 upload rcs to testing repo
Fernando Monserrat [Mon, 4 Mar 2019 20:45:41 +0000 (17:45 -0300)]
issue #14891 upload rcs to testing repo
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>

5 years ago14870: Add tests
Peter Amstutz [Mon, 4 Mar 2019 20:08:27 +0000 (15:08 -0500)]
14870: Add tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14886: Updates test to fail for the more specific case
Eric Biagiotti [Mon, 4 Mar 2019 19:44:39 +0000 (14:44 -0500)]
14886: Updates test to fail for the more specific case

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14886: Adds flag to stop infinite logs
Eric Biagiotti [Fri, 1 Mar 2019 22:04:57 +0000 (17:04 -0500)]
14886: Adds flag to stop infinite logs

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14886: Simplifies test mocking
Eric Biagiotti [Fri, 1 Mar 2019 21:54:30 +0000 (16:54 -0500)]
14886: Simplifies test mocking

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14870: Copy previous container logs to "container uuid" subdir
Peter Amstutz [Fri, 1 Mar 2019 21:38:44 +0000 (16:38 -0500)]
14870: Copy previous container logs to "container uuid" subdir

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14886: Adds a test that reproduces the error
Eric Biagiotti [Fri, 1 Mar 2019 21:24:25 +0000 (16:24 -0500)]
14886: Adds a test that reproduces the error

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14870: Update Arvados Ruby SDK gem dependency for bugfix
Peter Amstutz [Fri, 1 Mar 2019 21:24:13 +0000 (16:24 -0500)]
14870: Update Arvados Ruby SDK gem dependency for bugfix

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14870: Saving previous retry logs into collection WIP
Peter Amstutz [Fri, 1 Mar 2019 20:48:56 +0000 (15:48 -0500)]
14870: Saving previous retry logs into collection WIP

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '14870-ruby-sdk-cp-r' refs #14870
Peter Amstutz [Fri, 1 Mar 2019 21:20:59 +0000 (16:20 -0500)]
Merge branch '14870-ruby-sdk-cp-r' refs #14870

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14870: Ruby SDK fix for copying collection into root of an empty collection
Peter Amstutz [Fri, 1 Mar 2019 20:51:08 +0000 (15:51 -0500)]
14870: Ruby SDK fix for copying collection into root of an empty collection

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '14885-ciso-and-conda-packaging-pr'
Eric Biagiotti [Fri, 1 Mar 2019 15:02:58 +0000 (10:02 -0500)]
Merge branch '14885-ciso-and-conda-packaging-pr'

refs #14885

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years agoMerge branch '14844-cdc-azure-fixes' closes #14844
Peter Amstutz [Fri, 1 Mar 2019 14:55:24 +0000 (09:55 -0500)]
Merge branch '14844-cdc-azure-fixes' closes #14844

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '14819-arvados-jobs-on-stretch'
Ward Vandewege [Fri, 1 Mar 2019 14:30:11 +0000 (09:30 -0500)]
Merge branch '14819-arvados-jobs-on-stretch'

closes #14819

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14819: Merge branch 'master' into 14819-arvados-jobs-on-stretch
Ward Vandewege [Fri, 1 Mar 2019 14:29:16 +0000 (09:29 -0500)]
14819: Merge branch 'master' into 14819-arvados-jobs-on-stretch

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14819: use the python executable from the python-arvados-cwl-runner package
Ward Vandewege [Fri, 1 Mar 2019 13:34:28 +0000 (08:34 -0500)]
14819: use the python executable from the python-arvados-cwl-runner package

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14844: Azure fixes
Peter Amstutz [Thu, 28 Feb 2019 20:47:59 +0000 (15:47 -0500)]
14844: Azure fixes

* If PrivateIPAddress somehow isn't defined, return empty
  string (don't panic)

* If VM create fails, attempt to immediately clean the VHD and NIC
  corresponding to that VM (if it doesn't work, cleanup processes
  should still get around to it.)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '9865-cwl-fix-ignored-exceptions'
Eric Biagiotti [Thu, 28 Feb 2019 20:33:38 +0000 (15:33 -0500)]
Merge branch '9865-cwl-fix-ignored-exceptions'

refs #9865

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago9865: Removes trailing whitespace
Eric Biagiotti [Thu, 28 Feb 2019 20:32:48 +0000 (15:32 -0500)]
9865: Removes trailing whitespace

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14885: Adds python2 conditional pytz import
Eric Biagiotti [Thu, 28 Feb 2019 20:18:55 +0000 (15:18 -0500)]
14885: Adds python2 conditional pytz import

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14885: Removes as_naive datetime parsing distinction
Eric Biagiotti [Thu, 28 Feb 2019 20:17:31 +0000 (15:17 -0500)]
14885: Removes as_naive datetime parsing distinction

parse_datetime_as_naive should only be used in instances where we want to parse a string that we know contains timezone info AND  we do not want to include it in the resulting datetime object. Otherwise, parse_datetime is preferred for parsing strings with or without timezone info.

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years agoFix typo.
Ward Vandewege [Thu, 28 Feb 2019 20:07:29 +0000 (15:07 -0500)]
Fix typo.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago13937: Adds counters to azure driver.
Lucas Di Pentima [Thu, 28 Feb 2019 18:58:35 +0000 (15:58 -0300)]
13937: Adds counters to azure driver.

Also, generalizes counters usage and updates unix & s3 volume drivers.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14819: upgrade the arvados/jobs image to Debian Stretch. Also add argument to
Ward Vandewege [Thu, 7 Feb 2019 21:06:47 +0000 (16:06 -0500)]
14819: upgrade the arvados/jobs image to Debian Stretch. Also add argument to
the build script to choose which package repo to build from.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14291: Adjust ExtraScratch (int) to AttachScratch (bool)
Peter Amstutz [Thu, 28 Feb 2019 18:05:57 +0000 (13:05 -0500)]
14291: Adjust ExtraScratch (int) to AttachScratch (bool)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13937: Adds counters to S3 driver.
Lucas Di Pentima [Thu, 28 Feb 2019 17:36:39 +0000 (14:36 -0300)]
13937: Adds counters to S3 driver.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14291: minimal stub so that tests don't panic when run without live config
Peter Amstutz [Thu, 28 Feb 2019 15:35:00 +0000 (10:35 -0500)]
14291: minimal stub so that tests don't panic when run without live config

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14291: Fix tag prefix typo
Peter Amstutz [Thu, 28 Feb 2019 15:18:26 +0000 (10:18 -0500)]
14291: Fix tag prefix typo

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14291: Change instance type to a supported one, add SetTags test
Peter Amstutz [Thu, 28 Feb 2019 15:16:22 +0000 (10:16 -0500)]
14291: Change instance type to a supported one, add SetTags test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13937: Fixes file naming inconsistency between storage drivers.
Lucas Di Pentima [Thu, 28 Feb 2019 15:00:43 +0000 (12:00 -0300)]
13937: Fixes file naming inconsistency between storage drivers.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoUbuntu 18.04 ("bionic") packages are now confirmed working, add it to the list
Ward Vandewege [Thu, 28 Feb 2019 14:43:00 +0000 (09:43 -0500)]
Ubuntu 18.04 ("bionic") packages are now confirmed working, add it to the list
of supported GNU/Linux distributions.

refs #13823

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago13937: Don't try to update stats if they aren't initialized (useful for tests)
Lucas Di Pentima [Wed, 27 Feb 2019 22:26:34 +0000 (19:26 -0300)]
13937: Don't try to update stats if they aren't initialized (useful for tests)

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14291: Support EBS attached storage and preemptible instances
Peter Amstutz [Wed, 27 Feb 2019 21:38:33 +0000 (16:38 -0500)]
14291: Support EBS attached storage and preemptible instances

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '14884-unicode-name-support'
Tom Morris [Wed, 27 Feb 2019 21:25:50 +0000 (16:25 -0500)]
Merge branch '14884-unicode-name-support'

Fixes #14884.

Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>

5 years ago14884: Adds unicode-named file upload test.
Lucas Di Pentima [Wed, 27 Feb 2019 20:09:10 +0000 (17:09 -0300)]
14884: Adds unicode-named file upload test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14884: Fix some additional formats where Unicode can be used
Tom Morris [Tue, 26 Feb 2019 16:58:04 +0000 (11:58 -0500)]
14884: Fix some additional formats where Unicode can be used

Including filenames, collection names, and directory path for cache

Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>

5 years ago14884: Allow non-ASCII filenames in manifests.
Tom Morris [Mon, 25 Feb 2019 21:29:39 +0000 (16:29 -0500)]
14884: Allow non-ASCII filenames in manifests.

    Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>

5 years ago14291: Vendoring
Peter Amstutz [Wed, 27 Feb 2019 19:30:16 +0000 (14:30 -0500)]
14291: Vendoring

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14291: Still trying to nail down aws go sdk vendor
Peter Amstutz [Wed, 27 Feb 2019 19:27:20 +0000 (14:27 -0500)]
14291: Still trying to nail down aws go sdk vendor

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch 'master' into 14885-ciso-and-conda-packaging-pr
Eric Biagiotti [Wed, 27 Feb 2019 19:24:58 +0000 (14:24 -0500)]
Merge branch 'master' into 14885-ciso-and-conda-packaging-pr

refs #14885

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14291: Add individual packages in github.com/aws/aws-sdk-go to vendor
Peter Amstutz [Wed, 27 Feb 2019 19:23:42 +0000 (14:23 -0500)]
14291: Add individual packages in github.com/aws/aws-sdk-go to vendor

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14885: Updates sdk/cwl and services/fuse ciso8601 dependency
Eric Biagiotti [Wed, 27 Feb 2019 19:23:21 +0000 (14:23 -0500)]
14885: Updates sdk/cwl and services/fuse ciso8601 dependency

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14291: Add github.com/aws/aws-sdk-go to vendor
Peter Amstutz [Wed, 27 Feb 2019 19:17:41 +0000 (14:17 -0500)]
14291: Add github.com/aws/aws-sdk-go to vendor

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14291: Working on instance creation
Peter Amstutz [Wed, 27 Feb 2019 18:57:18 +0000 (13:57 -0500)]
14291: Working on instance creation

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '14383-java-sdk-double-slash'. Fixes #14383.
Tom Morris [Wed, 27 Feb 2019 15:58:28 +0000 (10:58 -0500)]
Merge branch '14383-java-sdk-double-slash'. Fixes #14383.

Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>

5 years agoChange argument order for arv-keepdocker to the one that works, as it is
Ward Vandewege [Wed, 27 Feb 2019 13:45:07 +0000 (08:45 -0500)]
Change argument order for arv-keepdocker to the one that works, as it is
currently sensitive to the order.

refs #14880

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14291: EC2 driver WIP
Peter Amstutz [Tue, 26 Feb 2019 22:54:08 +0000 (17:54 -0500)]
14291: EC2 driver WIP

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '14794-link-wb1-to-wb2'
Lucas Di Pentima [Tue, 26 Feb 2019 21:47:47 +0000 (18:47 -0300)]
Merge branch '14794-link-wb1-to-wb2'
Closes #14794

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14794: Moved config validator to lib/ so that it can be testable.
Lucas Di Pentima [Tue, 26 Feb 2019 20:18:19 +0000 (17:18 -0300)]
14794: Moved config validator to lib/ so that it can be testable.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>