arvados.git
5 years agoWe have reset the package iterations to -1, make the
Ward Vandewege [Tue, 5 Feb 2019 13:36:07 +0000 (08:36 -0500)]
We have reset the package iterations to -1, make the
run-build-docker-jobs-image.sh script reflect that.

refs #9945

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years agoDo not try to test packages that were not built.
Ward Vandewege [Mon, 4 Feb 2019 22:21:22 +0000 (17:21 -0500)]
Do not try to test packages that were not built.

refs #9945

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14806: Fix test suite to work even if PERL5LIB is set.
Tom Clegg [Mon, 4 Feb 2019 21:43:14 +0000 (16:43 -0500)]
14806: Fix test suite to work even if PERL5LIB is set.

PERL5LIB has precedence over PERLLIB.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoarvbox support for python3 refs #13306
Peter Amstutz [Mon, 4 Feb 2019 18:17:44 +0000 (13:17 -0500)]
arvbox support for python3 refs #13306

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14806: Handle escaped chars when parsing docker image manifest.
Tom Clegg [Mon, 4 Feb 2019 20:58:57 +0000 (15:58 -0500)]
14806: Handle escaped chars when parsing docker image manifest.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13306: fix crunchv1 bug
Peter Amstutz [Mon, 4 Feb 2019 20:13:34 +0000 (15:13 -0500)]
13306: fix crunchv1 bug

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13306: test_with_arvbox can select api
Peter Amstutz [Mon, 4 Feb 2019 20:13:12 +0000 (15:13 -0500)]
13306: test_with_arvbox can select api

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13306: select between "conformance" and "integration" in test_with_arvbox.sh
Peter Amstutz [Mon, 4 Feb 2019 19:22:58 +0000 (14:22 -0500)]
13306: select between "conformance" and "integration" in test_with_arvbox.sh

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13306: test_with_arvbox.sh can test either python2 or python3
Peter Amstutz [Mon, 4 Feb 2019 18:27:09 +0000 (13:27 -0500)]
13306: test_with_arvbox.sh can test either python2 or python3

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoThe libpam-arvados package on Centos7 has a dependency on the python-pam package.
Ward Vandewege [Mon, 4 Feb 2019 17:41:29 +0000 (12:41 -0500)]
The libpam-arvados package on Centos7 has a dependency on the python-pam package.

refs #9945

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14325: Log stderr from last boot-probe when giving up on boot.
Tom Clegg [Mon, 4 Feb 2019 16:21:32 +0000 (11:21 -0500)]
14325: Log stderr from last boot-probe when giving up on boot.

Remove duplicate log message after failed run-probe.

Ensure we always make at least one probe attempt after the boot/probe
timeout expires.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '9945-make-python-package-dependency-free'
Ward Vandewege [Mon, 4 Feb 2019 15:35:51 +0000 (10:35 -0500)]
Merge branch '9945-make-python-package-dependency-free'

closes #9945

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago9945: Merge branch 'master' into 9945-make-python-package-dependency-free
Ward Vandewege [Mon, 4 Feb 2019 15:19:35 +0000 (10:19 -0500)]
9945: Merge branch 'master' into 9945-make-python-package-dependency-free

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago9945: Backwards compatibility fix for libpam-arvados
Ward Vandewege [Mon, 4 Feb 2019 13:36:00 +0000 (08:36 -0500)]
9945: Backwards compatibility fix for libpam-arvados

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years agoarvbox certificates can have DNS in subjectAltName
Peter Amstutz [Fri, 1 Feb 2019 22:03:52 +0000 (17:03 -0500)]
arvbox certificates can have DNS in subjectAltName

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14325: Merge branch 'master'
Tom Clegg [Fri, 1 Feb 2019 21:29:17 +0000 (16:29 -0500)]
14325: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Rephrase confusing conditions and add comments.
Tom Clegg [Fri, 1 Feb 2019 21:26:46 +0000 (16:26 -0500)]
14325: Rephrase confusing conditions and add comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Improve identifiers/comments.
Tom Clegg [Fri, 1 Feb 2019 21:25:59 +0000 (16:25 -0500)]
14325: Improve identifiers/comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Note assumption concurrent dispatchers share a VM size menu.
Tom Clegg [Fri, 1 Feb 2019 21:23:07 +0000 (16:23 -0500)]
14325: Note assumption concurrent dispatchers share a VM size menu.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Fix test.
Tom Clegg [Fri, 1 Feb 2019 21:22:41 +0000 (16:22 -0500)]
14325: Fix test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13306: Improved py2/3 str compatibility
Eric Biagiotti [Fri, 1 Feb 2019 18:45:25 +0000 (13:45 -0500)]
13306: Improved py2/3 str compatibility

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago13306: Additional dict item iteration improvements
Eric Biagiotti [Fri, 1 Feb 2019 18:33:14 +0000 (13:33 -0500)]
13306: Additional dict item iteration improvements

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago9945: Merge branch 'master' into 9945-make-python-package-dependency-free
Ward Vandewege [Fri, 1 Feb 2019 15:39:16 +0000 (10:39 -0500)]
9945: Merge branch 'master' into 9945-make-python-package-dependency-free

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago13306: Fix 12213-keepref test
Peter Amstutz [Thu, 31 Jan 2019 17:54:10 +0000 (12:54 -0500)]
13306: Fix 12213-keepref test

Test itself was buggy and seems to have been relying on undefined
behavior, py3 exposed the bug.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13306: Fixes futurize mistakes regarding PathMapper items()
Eric Biagiotti [Thu, 31 Jan 2019 17:16:42 +0000 (12:16 -0500)]
13306: Fixes futurize mistakes regarding PathMapper items()

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago9945: More changes based on review comments.
Ward Vandewege [Wed, 30 Jan 2019 21:14:52 +0000 (16:14 -0500)]
9945: More changes based on review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years agoMerge branch '14770-wb-acr-bad-param'
Lucas Di Pentima [Wed, 30 Jan 2019 20:53:42 +0000 (17:53 -0300)]
Merge branch '14770-wb-acr-bad-param'
Closes #14770

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoMerge branch '14738-tag-editor-fix-es5'
Lucas Di Pentima [Wed, 30 Jan 2019 20:18:30 +0000 (17:18 -0300)]
Merge branch '14738-tag-editor-fix-es5'
Closes #14738

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago9945: address more review comments.
Ward Vandewege [Tue, 29 Jan 2019 21:53:43 +0000 (16:53 -0500)]
9945: address more review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14738: Replaces double with single quotes for code style.
Lucas Di Pentima [Tue, 29 Jan 2019 22:48:15 +0000 (19:48 -0300)]
14738: Replaces double with single quotes for code style.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14738: Enhances code readability when concatenating strings.
Lucas Di Pentima [Tue, 29 Jan 2019 20:39:26 +0000 (17:39 -0300)]
14738: Enhances code readability when concatenating strings.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14738: Fixes the double-slash usage on requests to prevent 301 from controller
Lucas Di Pentima [Tue, 29 Jan 2019 19:25:02 +0000 (16:25 -0300)]
14738: Fixes the double-slash usage on requests to prevent 301 from controller

When a request is made to controller using double slashes, for example to
http://apiserver//arvados/v1/collections, arvados controller returns a 301
that breaks CORS.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoMerge branch '14718-api-login-salted-token'
Lucas Di Pentima [Tue, 29 Jan 2019 09:30:10 +0000 (06:30 -0300)]
Merge branch '14718-api-login-salted-token'
Closes #14718

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14718: Updates controller test to support josh_id's return_to new format.
Lucas Di Pentima [Mon, 28 Jan 2019 22:03:10 +0000 (19:03 -0300)]
14718: Updates controller test to support josh_id's return_to new format.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14718: Validates remote cluster id parameter on login endpoint & callback.
Lucas Di Pentima [Mon, 28 Jan 2019 21:58:06 +0000 (18:58 -0300)]
14718: Validates remote cluster id parameter on login endpoint & callback.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago9945: address a bunch of review comments.
Ward Vandewege [Wed, 23 Jan 2019 15:12:59 +0000 (10:12 -0500)]
9945: address a bunch of review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14718: Changes the way remote param is packed into return_to.
Lucas Di Pentima [Mon, 28 Jan 2019 20:12:33 +0000 (17:12 -0300)]
14718: Changes the way remote param is packed into return_to.

Also:
* Escapes the remote param for security reasons.
* Adds comments.
* Updates tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoMerge branch 'master' into 13306-arvados-cwl-runner-py3-support
Eric Biagiotti [Mon, 28 Jan 2019 15:34:10 +0000 (10:34 -0500)]
Merge branch 'master' into 13306-arvados-cwl-runner-py3-support

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago13306: Removing debug echo
Eric Biagiotti [Mon, 28 Jan 2019 15:14:30 +0000 (10:14 -0500)]
13306: Removing debug echo

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14325: Clean up test suite logging.
Tom Clegg [Mon, 28 Jan 2019 07:26:49 +0000 (02:26 -0500)]
14325: Clean up test suite logging.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Change remaining LameInstanceSet uses to StubDriver.
Tom Clegg [Mon, 28 Jan 2019 07:19:27 +0000 (02:19 -0500)]
14325: Change remaining LameInstanceSet uses to StubDriver.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14718: Issue salted token when passing 'remote' param to login.
Lucas Di Pentima [Sat, 26 Jan 2019 00:04:58 +0000 (21:04 -0300)]
14718: Issue salted token when passing 'remote' param to login.

When logging in with a 'remote' parameter, it's encoded into the return_to
param passed to the SSO server so that it's received back after the user
is authenticated.
When the omniauth callback receives a remote parameter inside the return_to
url, it returns the salted version of the client token.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14325: Don't count busy workers with state=Unknown as Unallocated.
Tom Clegg [Fri, 25 Jan 2019 21:40:59 +0000 (16:40 -0500)]
14325: Don't count busy workers with state=Unknown as Unallocated.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Build crunch-dispatch-cloud package.
Tom Clegg [Fri, 25 Jan 2019 21:31:48 +0000 (16:31 -0500)]
14325: Build crunch-dispatch-cloud package.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Point to API details in interface doc comments.
Tom Clegg [Fri, 25 Jan 2019 21:28:31 +0000 (16:28 -0500)]
14325: Point to API details in interface doc comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Test resuming worker pool state after restart.
Tom Clegg [Fri, 25 Jan 2019 20:24:19 +0000 (15:24 -0500)]
14325: Test resuming worker pool state after restart.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Remove obsolete test stubs.
Tom Clegg [Fri, 25 Jan 2019 18:28:15 +0000 (13:28 -0500)]
14325: Remove obsolete test stubs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Clean up unsafe concurrency in tests.
Tom Clegg [Fri, 25 Jan 2019 18:22:25 +0000 (13:22 -0500)]
14325: Clean up unsafe concurrency in tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Document Running() return value.
Tom Clegg [Fri, 25 Jan 2019 18:20:34 +0000 (13:20 -0500)]
14325: Document Running() return value.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13306: Adding support for building the dev docker jobs image with py3
Eric Biagiotti [Fri, 25 Jan 2019 18:03:12 +0000 (13:03 -0500)]
13306: Adding support for building the dev docker jobs image with py3

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14325: Don't shutdown busy VMs even if boot probe fails.
Tom Clegg [Thu, 24 Jan 2019 21:10:48 +0000 (16:10 -0500)]
14325: Don't shutdown busy VMs even if boot probe fails.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Wake up scheduler when quota timeout expires.
Tom Clegg [Tue, 22 Jan 2019 22:30:52 +0000 (17:30 -0500)]
14325: Wake up scheduler when quota timeout expires.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Obey EarliestRetry specified by cloud rate-limiting errors.
Tom Clegg [Tue, 22 Jan 2019 22:13:56 +0000 (17:13 -0500)]
14325: Obey EarliestRetry specified by cloud rate-limiting errors.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14770: Fixes parameter on acr call.
Lucas Di Pentima [Thu, 24 Jan 2019 18:48:54 +0000 (15:48 -0300)]
14770: Fixes parameter on acr call.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago13306: Unicode fix for docker image generation in py3 environment
Eric Biagiotti [Thu, 24 Jan 2019 14:38:25 +0000 (09:38 -0500)]
13306: Unicode fix for docker image generation in py3 environment

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago13306: Unicode fixes for the conformance tests
Eric Biagiotti [Thu, 24 Jan 2019 14:37:13 +0000 (09:37 -0500)]
13306: Unicode fixes for the conformance tests

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years agoMerge branch '14482-rubysdk-empty-dir'
Lucas Di Pentima [Tue, 22 Jan 2019 16:40:02 +0000 (13:40 -0300)]
Merge branch '14482-rubysdk-empty-dir'
Closes #14482

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago9945: use virtualenv for our python packages
Ward Vandewege [Tue, 22 Jan 2019 01:46:50 +0000 (20:46 -0500)]
9945: use virtualenv for our python packages

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago9945: run-library changes
Ward Vandewege [Thu, 20 Dec 2018 16:52:01 +0000 (11:52 -0500)]
9945: run-library changes

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago9945: there is a new rvm gpg key
Ward Vandewege [Sun, 20 Jan 2019 18:12:45 +0000 (13:12 -0500)]
9945: there is a new rvm gpg key

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14325: Move magic number to const.
Tom Clegg [Mon, 21 Jan 2019 20:19:53 +0000 (15:19 -0500)]
14325: Move magic number to const.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Log when a worker's first probe succeeds.
Tom Clegg [Mon, 21 Jan 2019 15:19:17 +0000 (10:19 -0500)]
14325: Log when a worker's first probe succeeds.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Shutdown unknown-state worker after boot timeout.
Tom Clegg [Mon, 21 Jan 2019 15:09:09 +0000 (10:09 -0500)]
14325: Shutdown unknown-state worker after boot timeout.

(instead of idle timeout)

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Include instance ID in log messages from stub VM.
Tom Clegg [Mon, 21 Jan 2019 14:38:58 +0000 (09:38 -0500)]
14325: Include instance ID in log messages from stub VM.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14482: Stricter token regexes.
Lucas Di Pentima [Fri, 18 Jan 2019 23:24:43 +0000 (20:24 -0300)]
14482: Stricter token regexes.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14325: Use snake_case keys in management API responses.
Tom Clegg [Fri, 18 Jan 2019 21:54:59 +0000 (16:54 -0500)]
14325: Use snake_case keys in management API responses.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Cancel containers with unsatisfiable runtime constraints.
Tom Clegg [Fri, 18 Jan 2019 21:28:45 +0000 (16:28 -0500)]
14325: Cancel containers with unsatisfiable runtime constraints.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13306: Removing old_div to simplify division operations
Eric Biagiotti [Fri, 18 Jan 2019 16:08:13 +0000 (11:08 -0500)]
13306: Removing old_div to simplify division operations

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14482: Manifest validation including 8-bit escaped chars; with tests.
Lucas Di Pentima [Thu, 17 Jan 2019 23:53:58 +0000 (20:53 -0300)]
14482: Manifest validation including 8-bit escaped chars; with tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14325: Test dispatch container queue against controller.
Tom Clegg [Thu, 17 Jan 2019 21:31:55 +0000 (16:31 -0500)]
14325: Test dispatch container queue against controller.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Fix dropped request params when body not specified by caller.
Tom Clegg [Thu, 17 Jan 2019 21:29:18 +0000 (16:29 -0500)]
14325: Fix dropped request params when body not specified by caller.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13306: Removing list wrapping added by futurize to PathMapper objects
Eric Biagiotti [Thu, 17 Jan 2019 21:03:03 +0000 (16:03 -0500)]
13306: Removing list wrapping added by futurize to PathMapper objects

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

Because cwltool.PathMapper objects have a function called items(), futurize incorrectly added the results of calls to items() to a list object (thinking it was a call to dict.items()). In fact, cwltool.PathMapper.items() already returns a list.

5 years ago13306: Updating dict items as lists to improve py2 performance
Eric Biagiotti [Thu, 17 Jan 2019 20:55:24 +0000 (15:55 -0500)]
13306: Updating dict items as lists to improve py2 performance

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago13306: Fixing previous commit to use viewvalues instead of listvalues
Eric Biagiotti [Thu, 17 Jan 2019 20:40:08 +0000 (15:40 -0500)]
13306: Fixing previous commit to use viewvalues instead of listvalues

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14325: Test that ssh_executor obeys a negative VerifyHostKey result.
Tom Clegg [Thu, 17 Jan 2019 20:08:04 +0000 (15:08 -0500)]
14325: Test that ssh_executor obeys a negative VerifyHostKey result.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Add total houly price metric.
Tom Clegg [Thu, 17 Jan 2019 19:35:29 +0000 (14:35 -0500)]
14325: Add total houly price metric.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13306: Updating dict values as a list to improve py2 performance
Eric Biagiotti [Thu, 17 Jan 2019 19:00:05 +0000 (14:00 -0500)]
13306: Updating dict values as a list to improve py2 performance

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago13306: Updating dict keys as a list to ensure py2/3 compatibility
Eric Biagiotti [Thu, 17 Jan 2019 18:49:39 +0000 (13:49 -0500)]
13306: Updating dict keys as a list to ensure py2/3 compatibility

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14325: Configurable SSH target port for cloud VMs.
Tom Clegg [Thu, 17 Jan 2019 17:01:15 +0000 (12:01 -0500)]
14325: Configurable SSH target port for cloud VMs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '14539-pysdk-empty-dir'
Lucas Di Pentima [Thu, 17 Jan 2019 16:43:25 +0000 (13:43 -0300)]
Merge branch '14539-pysdk-empty-dir'
Closes #14539

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago13306: Updating dict value iteration to be more efficient with py2
Eric Biagiotti [Thu, 17 Jan 2019 16:21:04 +0000 (11:21 -0500)]
13306: Updating dict value iteration to be more efficient with py2

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago13306: Adds test for when get_current_container results in a 404
Eric Biagiotti [Thu, 17 Jan 2019 16:11:35 +0000 (11:11 -0500)]
13306: Adds test for when get_current_container results in a 404

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14325: More testing for hold/drain states.
Tom Clegg [Thu, 17 Jan 2019 15:14:33 +0000 (10:14 -0500)]
14325: More testing for hold/drain states.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13306: Removes a log handler added during a test, breaking subsequent tests.
Eric Biagiotti [Thu, 17 Jan 2019 15:04:03 +0000 (10:04 -0500)]
13306: Removes a log handler added during a test, breaking subsequent tests.

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago13306: Prevents multiple RunTimeStatusLoggingHandlers from being added
Eric Biagiotti [Thu, 17 Jan 2019 15:02:43 +0000 (10:02 -0500)]
13306: Prevents multiple RunTimeStatusLoggingHandlers from being added

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14539: Simplifies a bit further the regexp replacement on escape() function.
Lucas Di Pentima [Thu, 17 Jan 2019 09:55:40 +0000 (06:55 -0300)]
14539: Simplifies a bit further the regexp replacement on escape() function.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14539: Removes pointless code comment.
Lucas Di Pentima [Thu, 17 Jan 2019 09:48:53 +0000 (06:48 -0300)]
14539: Removes pointless code comment.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14539: Fixes and simplifies the escape() function. Updates test.
Lucas Di Pentima [Wed, 16 Jan 2019 22:34:34 +0000 (19:34 -0300)]
14539: Fixes and simplifies the escape() function. Updates test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14325: Add management API endpoints for drain/hold/run behavior.
Tom Clegg [Wed, 16 Jan 2019 22:09:40 +0000 (17:09 -0500)]
14325: Add management API endpoints for drain/hold/run behavior.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Add IdleBehavior to worker pool.
Tom Clegg [Wed, 16 Jan 2019 22:09:34 +0000 (17:09 -0500)]
14325: Add IdleBehavior to worker pool.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Add worker state diagram.
Tom Clegg [Thu, 20 Dec 2018 21:09:32 +0000 (16:09 -0500)]
14325: Add worker state diagram.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14539: Fixes literal backslash escaping.
Lucas Di Pentima [Wed, 16 Jan 2019 21:33:49 +0000 (18:33 -0300)]
14539: Fixes literal backslash escaping.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14325: Propagate API env vars to crunch-run.
Tom Clegg [Tue, 18 Dec 2018 20:50:17 +0000 (15:50 -0500)]
14325: Propagate API env vars to crunch-run.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13306: Removing unneeded try/except statements in the acr submit tests
Eric Biagiotti [Wed, 16 Jan 2019 01:52:36 +0000 (20:52 -0500)]
13306: Removing unneeded try/except statements in the acr submit tests

Removed the try/except statements and moved the asserts checking if the call to arvados_cwl.main exited properly to the bottom of the tests.  In other words, the tests should be using specific call asserts to establish if it ran correctly and checking the exited value should be a last resort to report an unhandled case.

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14482: Allow unescaped " " on stream and file token regexes (WIP)
Lucas Di Pentima [Tue, 15 Jan 2019 21:27:29 +0000 (18:27 -0300)]
14482: Allow unescaped " " on stream and file token regexes (WIP)

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoMerge branch '14324-cdc-azure' refs #14324
Peter Amstutz [Tue, 15 Jan 2019 18:40:34 +0000 (13:40 -0500)]
Merge branch '14324-cdc-azure' refs #14324

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14482: Adds failing test about partially unescaped file tokens.
Lucas Di Pentima [Tue, 15 Jan 2019 18:33:58 +0000 (15:33 -0300)]
14482: Adds failing test about partially unescaped file tokens.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14324: Embed test public key instead of reading from file
Peter Amstutz [Tue, 15 Jan 2019 18:29:30 +0000 (13:29 -0500)]
14324: Embed test public key instead of reading from file

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch 'master' into 14482-rubysdk-empty-dir
Lucas Di Pentima [Tue, 15 Jan 2019 17:34:38 +0000 (14:34 -0300)]
Merge branch 'master' into 14482-rubysdk-empty-dir

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14539: Encode \t & \n chars on file/dir names on collection's manifest.
Lucas Di Pentima [Tue, 15 Jan 2019 17:25:39 +0000 (14:25 -0300)]
14539: Encode \t & \n chars on file/dir names on collection's manifest.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>