Eric Biagiotti [Tue, 5 Mar 2019 16:14:44 +0000 (11:14 -0500)]
Merge branch '14886-acr-recursion-runtime-error'
refs #14886
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>
Eric Biagiotti [Tue, 5 Mar 2019 16:11:19 +0000 (11:11 -0500)]
14886: Fixes typo
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>
Eric Biagiotti [Tue, 5 Mar 2019 14:42:16 +0000 (09:42 -0500)]
14886: Fixes mock issue between tests
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>
Eric Biagiotti [Mon, 4 Mar 2019 19:44:39 +0000 (14:44 -0500)]
14886: Updates test to fail for the more specific case
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>
Eric Biagiotti [Fri, 1 Mar 2019 22:04:57 +0000 (17:04 -0500)]
14886: Adds flag to stop infinite logs
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>
Eric Biagiotti [Fri, 1 Mar 2019 21:54:30 +0000 (16:54 -0500)]
14886: Simplifies test mocking
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>
Eric Biagiotti [Fri, 1 Mar 2019 21:24:25 +0000 (16:24 -0500)]
14886: Adds a test that reproduces the error
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>
Peter Amstutz [Fri, 1 Mar 2019 21:20:59 +0000 (16:20 -0500)]
Merge branch '14870-ruby-sdk-cp-r' refs #14870
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Fri, 1 Mar 2019 20:51:08 +0000 (15:51 -0500)]
14870: Ruby SDK fix for copying collection into root of an empty collection
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Eric Biagiotti [Fri, 1 Mar 2019 15:02:58 +0000 (10:02 -0500)]
Merge branch '14885-ciso-and-conda-packaging-pr'
refs #14885
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>
Peter Amstutz [Fri, 1 Mar 2019 14:55:24 +0000 (09:55 -0500)]
Merge branch '14844-cdc-azure-fixes' closes #14844
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Ward Vandewege [Fri, 1 Mar 2019 14:30:11 +0000 (09:30 -0500)]
Merge branch '14819-arvados-jobs-on-stretch'
closes #14819
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Fri, 1 Mar 2019 14:29:16 +0000 (09:29 -0500)]
14819: Merge branch 'master' into 14819-arvados-jobs-on-stretch
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Fri, 1 Mar 2019 13:34:28 +0000 (08:34 -0500)]
14819: use the python executable from the python-arvados-cwl-runner package
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Peter Amstutz [Thu, 28 Feb 2019 20:47:59 +0000 (15:47 -0500)]
14844: Azure fixes
* If PrivateIPAddress somehow isn't defined, return empty
string (don't panic)
* If VM create fails, attempt to immediately clean the VHD and NIC
corresponding to that VM (if it doesn't work, cleanup processes
should still get around to it.)
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Eric Biagiotti [Thu, 28 Feb 2019 20:33:38 +0000 (15:33 -0500)]
Merge branch '9865-cwl-fix-ignored-exceptions'
refs #9865
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>
Eric Biagiotti [Thu, 28 Feb 2019 20:32:48 +0000 (15:32 -0500)]
9865: Removes trailing whitespace
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>
Eric Biagiotti [Thu, 28 Feb 2019 20:18:55 +0000 (15:18 -0500)]
14885: Adds python2 conditional pytz import
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>
Eric Biagiotti [Thu, 28 Feb 2019 20:17:31 +0000 (15:17 -0500)]
14885: Removes as_naive datetime parsing distinction
parse_datetime_as_naive should only be used in instances where we want to parse a string that we know contains timezone info AND we do not want to include it in the resulting datetime object. Otherwise, parse_datetime is preferred for parsing strings with or without timezone info.
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>
Ward Vandewege [Thu, 28 Feb 2019 20:07:29 +0000 (15:07 -0500)]
Fix typo.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Thu, 7 Feb 2019 21:06:47 +0000 (16:06 -0500)]
14819: upgrade the arvados/jobs image to Debian Stretch. Also add argument to
the build script to choose which package repo to build from.
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Thu, 28 Feb 2019 14:43:00 +0000 (09:43 -0500)]
Ubuntu 18.04 ("bionic") packages are now confirmed working, add it to the list
of supported GNU/Linux distributions.
refs #13823
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Tom Morris [Wed, 27 Feb 2019 21:25:50 +0000 (16:25 -0500)]
Merge branch '14884-unicode-name-support'
Fixes #14884.
Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>
Lucas Di Pentima [Wed, 27 Feb 2019 20:09:10 +0000 (17:09 -0300)]
14884: Adds unicode-named file upload test.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Tom Morris [Tue, 26 Feb 2019 16:58:04 +0000 (11:58 -0500)]
14884: Fix some additional formats where Unicode can be used
Including filenames, collection names, and directory path for cache
Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>
Tom Morris [Mon, 25 Feb 2019 21:29:39 +0000 (16:29 -0500)]
14884: Allow non-ASCII filenames in manifests.
Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>
Eric Biagiotti [Wed, 27 Feb 2019 19:24:58 +0000 (14:24 -0500)]
Merge branch 'master' into 14885-ciso-and-conda-packaging-pr
refs #14885
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>
Eric Biagiotti [Wed, 27 Feb 2019 19:23:21 +0000 (14:23 -0500)]
14885: Updates sdk/cwl and services/fuse ciso8601 dependency
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>
Tom Morris [Wed, 27 Feb 2019 15:58:28 +0000 (10:58 -0500)]
Merge branch '14383-java-sdk-double-slash'. Fixes #14383.
Arvados-DCO-1.1-Signed-off-by: Tom Morris <tfmorris@veritasgenetics.com>
Ward Vandewege [Wed, 27 Feb 2019 13:45:07 +0000 (08:45 -0500)]
Change argument order for arv-keepdocker to the one that works, as it is
currently sensitive to the order.
refs #14880
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Lucas Di Pentima [Tue, 26 Feb 2019 21:47:47 +0000 (18:47 -0300)]
Merge branch '14794-link-wb1-to-wb2'
Closes #14794
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Lucas Di Pentima [Tue, 26 Feb 2019 20:18:19 +0000 (17:18 -0300)]
14794: Moved config validator to lib/ so that it can be testable.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Lucas Di Pentima [Tue, 26 Feb 2019 18:43:31 +0000 (15:43 -0300)]
14794: Validates workbench2_url config at startup.
* In case of errors, a warning message is logged & config set to false.
* Enhanced test set.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Eric Biagiotti [Tue, 26 Feb 2019 15:23:22 +0000 (10:23 -0500)]
9865: Adds stack trace to API server state check exception
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>
Lucas Di Pentima [Mon, 25 Feb 2019 21:30:39 +0000 (18:30 -0300)]
14794: Adds workbench2 url to workbench's config on arvbox
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Lucas Di Pentima [Mon, 25 Feb 2019 19:45:54 +0000 (16:45 -0300)]
14794: Adds test
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Lucas Di Pentima [Mon, 25 Feb 2019 17:17:19 +0000 (14:17 -0300)]
14794: Adds configuration to point to workbench2 URL explicitly
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Lucas Di Pentima [Mon, 25 Feb 2019 14:49:12 +0000 (11:49 -0300)]
Merge branch '14804-keepstore-transient-backend-errors'
Closes #14804
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Lucas Di Pentima [Mon, 25 Feb 2019 14:47:48 +0000 (11:47 -0300)]
14804: Adds test scenario comment
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
chapmanb [Sun, 24 Feb 2019 10:46:26 +0000 (05:46 -0500)]
Python 3: move to recent ciso8601 2.x branch
Older ciso8601 versions are not built for Python 3.7 which
prevents migration to latest Python on conda packaging. This
swaps over usage to match the breaking 2.x changes:
https://github.com/closeio/ciso8601/blob/master/CHANGELOG.md#v1xx---200-migration-guide
Arvados-DCO-1.1-Signed-off-by: Brad Chapman <chapmanb@fastmail.com>
Lucas Di Pentima [Fri, 22 Feb 2019 21:44:37 +0000 (18:44 -0300)]
14794: Adds Workbench2 menu item.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Eric Biagiotti [Fri, 22 Feb 2019 20:59:25 +0000 (15:59 -0500)]
9865: Executor exception improvement
- Fixed issue where BaseExeptions (SystemExit, KeyboardInterrupt) were being handled incorrectly
- Added a return statement to clarify that the function is meant to return after catching the exception
- Added explicit handling of a potential WorkflowException
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>
Eric Biagiotti [Fri, 22 Feb 2019 20:53:38 +0000 (15:53 -0500)]
9865: Removes handling of exceptions derived from BaseException
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>
Eric Biagiotti [Fri, 22 Feb 2019 20:42:45 +0000 (15:42 -0500)]
9865: Simplifies ACR exception handling
- Ensures stack trace info is included where appropriate
- Adds comments clarifying exclusion of stack traces in some instances
- Removes exceptions from the formatted log string since logger.exception will include it
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>
Lucas Di Pentima [Fri, 22 Feb 2019 18:59:32 +0000 (15:59 -0300)]
14804: Returns 503 status (instead of 404) on GET when a volume does the same.
Also, translates Azure's "...StatusCode=503..." error to VolumeBusyError.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Lucas Di Pentima [Fri, 22 Feb 2019 18:06:30 +0000 (15:06 -0300)]
14804: Exposes the bug with a test.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Tom Clegg [Thu, 21 Feb 2019 19:41:56 +0000 (14:41 -0500)]
Merge branch '14807-dispatch-cloud-fixes'
refs #14807
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Thu, 21 Feb 2019 18:49:09 +0000 (13:49 -0500)]
14807: Force test SSH server to listen on IPv4.
It seems net.Listen defaults to listening on IPv6 even on systems
where that doesn't work.
https://dev.arvados.org/issues/14807#note-19
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Eric Biagiotti [Thu, 21 Feb 2019 15:04:17 +0000 (10:04 -0500)]
Merge branch '14853-chapmanb-subprocess-merge'
refs #14853
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <ebiagiotti@veritasgenetics.com>
Tom Clegg [Thu, 21 Feb 2019 06:00:00 +0000 (01:00 -0500)]
14807: Avoid doing concurrent update requests per container.
The previous code avoided concurrent Lock requests, but would
sometimes generate lots of overlapping Cancel requests instead of
waiting for the first one to finish.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Ward Vandewege [Wed, 20 Feb 2019 22:45:04 +0000 (17:45 -0500)]
Some build script housekeeping: make the CentOS builds less noisy, and remove
unused variables from the run-build-packages-python-and-ruby.sh script.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Wed, 20 Feb 2019 22:04:42 +0000 (17:04 -0500)]
14853: we need a newer version of setuptools to build on centos7, debian8 and ubuntu1404 (part 2).
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Fri, 1 Feb 2019 14:46:24 +0000 (09:46 -0500)]
Remove a few files that were checked in erroneously, update the .gitignore
files for workbench and api to avoid this in the future.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Tom Clegg [Wed, 20 Feb 2019 16:49:18 +0000 (11:49 -0500)]
14807: Merge branch 'master'
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Wed, 20 Feb 2019 16:48:25 +0000 (11:48 -0500)]
14807: Fix missing import.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Wed, 20 Feb 2019 13:55:53 +0000 (08:55 -0500)]
14807: Fix logger type mismatch.
Broke in
91b39ff3fbba69e54a330a7949c9ed4bbb3117ff.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Tue, 19 Feb 2019 22:28:26 +0000 (17:28 -0500)]
14807: Fix admin permissions for containers.
Admins are allowed to see all containers, even ones that aren't
associated with any container request.
Otherwise, when a container request retries, even the dispatcher can't
see the previously assigned container, and therefore never learns that
the container is supposed to be cancelled.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Lucas Di Pentima [Tue, 19 Feb 2019 20:21:32 +0000 (17:21 -0300)]
Merge branch '14860-fix-collection-versioning'
Closes #14860
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Lucas Di Pentima [Tue, 19 Feb 2019 19:50:36 +0000 (16:50 -0300)]
14860: Fixes bug by assigning the signed manifest text to the snapshot being saved.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Lucas Di Pentima [Tue, 19 Feb 2019 18:24:46 +0000 (15:24 -0300)]
14860: Exposes the bug with a new test.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Peter Amstutz [Tue, 19 Feb 2019 16:40:12 +0000 (11:40 -0500)]
Merge branch '11561-limit-container-locks' refs #11561
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Tom Clegg [Tue, 19 Feb 2019 16:35:22 +0000 (11:35 -0500)]
14807: Send detached crunch-run logs to journal via systemd-cat.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Ward Vandewege [Tue, 19 Feb 2019 15:47:24 +0000 (10:47 -0500)]
14853: we need a newer version of setuptools to build on centos7, debian8 and ubuntu1404.
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Tom Clegg [Mon, 18 Feb 2019 23:08:12 +0000 (18:08 -0500)]
Merge branch '14845-fix-flaky-test'
fixes #14845
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Mon, 18 Feb 2019 19:48:24 +0000 (14:48 -0500)]
14807: Remove errant rm.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Mon, 18 Feb 2019 19:32:31 +0000 (14:32 -0500)]
14807: Update API endpoints: instance_id is always a query param.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Mon, 18 Feb 2019 18:50:25 +0000 (13:50 -0500)]
14807: Log idle time in seconds instead of nanoseconds.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Mon, 18 Feb 2019 18:17:08 +0000 (13:17 -0500)]
14807: Cancel or requeue container when priority drops to zero.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Mon, 18 Feb 2019 17:33:21 +0000 (12:33 -0500)]
14807: Use context to pass a suitable logger to all service commands.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Sun, 17 Feb 2019 03:25:44 +0000 (22:25 -0500)]
14807: Log when a container is added/removed from the queue.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Sun, 17 Feb 2019 03:17:26 +0000 (22:17 -0500)]
14807: Split instance count/size/cost metrics by idle/hold status.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Fri, 15 Feb 2019 21:31:09 +0000 (16:31 -0500)]
14807: Fix up azure log message.
arvados.Duration's string representation includes units, so the log
message was "...older than 20s s".
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Fri, 15 Feb 2019 21:15:27 +0000 (16:15 -0500)]
14807: Move secret-tag host key verify mechanism out of Azure driver.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Fri, 15 Feb 2019 20:28:34 +0000 (15:28 -0500)]
14807: Don't delete existing tags when updating.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Fri, 15 Feb 2019 20:26:10 +0000 (15:26 -0500)]
14807: Load API host/token directly from stdin without shell hack.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Thu, 14 Feb 2019 21:13:23 +0000 (16:13 -0500)]
14807: Wait at least 1 second between retries on initial queue poll.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Wed, 13 Feb 2019 19:38:07 +0000 (14:38 -0500)]
14807: Include more detail in errors.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Wed, 13 Feb 2019 16:11:03 +0000 (11:11 -0500)]
14807: Fix crunch-run --list output when /var/lock is a symlink.
filepath.Walk(/var/lock) does not return entries inside /var/lock if
/var/lock is a symlink, as it is on debian:9.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Wed, 13 Feb 2019 06:59:42 +0000 (01:59 -0500)]
14807: Always set node-token tag.
Azure driver expects it to be set to an unpredictable string.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Wed, 13 Feb 2019 06:57:46 +0000 (01:57 -0500)]
14807: Log full instance ID.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Wed, 13 Feb 2019 06:56:49 +0000 (01:56 -0500)]
14807: Expose instance IP addresses in logs and management API.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Wed, 13 Feb 2019 06:55:32 +0000 (01:55 -0500)]
14807: Fix SSH target address.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Wed, 13 Feb 2019 06:52:21 +0000 (01:52 -0500)]
14807: Accept .../instances/_/drain?instance_id=X.
Azure Instance IDs contain slashes, so they don't work well as path
parameters.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Wed, 13 Feb 2019 06:49:59 +0000 (01:49 -0500)]
14807: Pass SSH public key to driver.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Wed, 13 Feb 2019 06:42:40 +0000 (01:42 -0500)]
14807: Allow driver to specify SSH username.
Use a non-root account with passwordless sudo on a provider (Azure)
that can easily set that up, but can't easily set up direct root
login.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Eric Biagiotti [Fri, 15 Feb 2019 16:28:09 +0000 (11:28 -0500)]
14853: Adds os.name check for subprocess conditional import
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>
chapmanb [Thu, 14 Feb 2019 16:23:39 +0000 (11:23 -0500)]
Python 3: only import subprocess32 on py27
Avoids the need to install and import subprocess32 when working
with any recent Python 3.x version. This helps with bioconda
install since subprocess32 is not built for py3.
Arvados-DCO-1.1-Signed-off-by: Brad Chapman <chapmanb@fastmail.com>
Tom Clegg [Wed, 13 Feb 2019 06:34:43 +0000 (01:34 -0500)]
14807: When ProviderType is unspecified, default to Arvados type.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Wed, 13 Feb 2019 06:32:34 +0000 (01:32 -0500)]
14807: Pass env vars on stdin instead of using SSH feature.
Arbitrary environment variables are typically not accepted by SSH
server configs.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Wed, 13 Feb 2019 03:00:21 +0000 (22:00 -0500)]
14807: Match systemd description to component name.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Tue, 12 Feb 2019 19:17:10 +0000 (14:17 -0500)]
14325: Start up immediately if there are no stale locks.
...instead of waiting for the pool to send a notification to trigger
the first loop iteration.
refs #14325
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Peter Amstutz [Thu, 14 Feb 2019 23:28:00 +0000 (18:28 -0500)]
11561: Add lock_count to containers, cancel container on unlock exceeded
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Eric Biagiotti [Thu, 14 Feb 2019 19:56:47 +0000 (14:56 -0500)]
Merge branch '14745-azure-cloud-driver-fixups'
refs #14745
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>
Eric Biagiotti [Thu, 14 Feb 2019 19:11:34 +0000 (14:11 -0500)]
14745: Removes unnecessary test parameter
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>
Eric Biagiotti [Thu, 14 Feb 2019 17:31:53 +0000 (12:31 -0500)]
14745: Adds support for passing nil params to StubDriver InstanceSet
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>
Tom Clegg [Thu, 14 Feb 2019 16:31:32 +0000 (11:31 -0500)]
Merge branch '14828-fix-flaky-test'
fixes #14828
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Thu, 14 Feb 2019 07:07:21 +0000 (02:07 -0500)]
14845: Fix inconsistent timeout error message.
http.Client's Timeout feature is not needed because every outgoing
request runs in the context of an incoming request, which already has
a deadline. It only makes the "timed out" error response inconsistent.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Eric Biagiotti [Wed, 13 Feb 2019 22:38:54 +0000 (17:38 -0500)]
14745: Improves azure driver exported var comment
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>
Eric Biagiotti [Wed, 13 Feb 2019 22:18:57 +0000 (17:18 -0500)]
14745: Removes unneeded file and debug code and improves Duration comments
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>
Eric Biagiotti [Wed, 13 Feb 2019 21:50:03 +0000 (16:50 -0500)]
14745: Adds back param loading to StubDriver InstanceSet
Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>