arvados.git
5 years agoIn the arvados/jobs image, use the Python executable from the
Ward Vandewege [Thu, 7 Feb 2019 16:52:04 +0000 (11:52 -0500)]
In the arvados/jobs image, use the Python executable from the
python-arvados-python-client package by default.

refs #9945

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years agoMerge branch '13306-arvados-cwl-runner-py3-support'
Eric Biagiotti [Wed, 6 Feb 2019 22:38:17 +0000 (17:38 -0500)]
Merge branch '13306-arvados-cwl-runner-py3-support'

refs #13306
3

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years agoMerge branch '14325-dispatch-cloud'
Tom Clegg [Wed, 6 Feb 2019 21:29:38 +0000 (16:29 -0500)]
Merge branch '14325-dispatch-cloud'

closes #14325

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Merge branch 'master'
Tom Clegg [Wed, 6 Feb 2019 21:27:57 +0000 (16:27 -0500)]
14325: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch 'master' into 13306-arvados-cwl-runner-py3-support
Eric Biagiotti [Wed, 6 Feb 2019 16:40:17 +0000 (11:40 -0500)]
Merge branch 'master' into 13306-arvados-cwl-runner-py3-support

refs #13306
3

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago13306: Removing unneeded import statements
Eric Biagiotti [Wed, 6 Feb 2019 16:40:04 +0000 (11:40 -0500)]
13306: Removing unneeded import statements

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years agoMake the python-arvados-cwl-runner package expose the cwltool executable, make
Ward Vandewege [Tue, 5 Feb 2019 22:14:05 +0000 (17:14 -0500)]
Make the python-arvados-cwl-runner package expose the cwltool executable, make
it conflict with the python-cwltool (and cwltool) packages, and add a note to
the upgrade documentation to that effect. Also document the Centos7 specific
upgrade from python33 to rh-python35 as part of story 9945.

refs #9945

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years agoMerge branch '13306-arvados-cwl-runner-py3-support'
Eric Biagiotti [Tue, 5 Feb 2019 18:25:14 +0000 (13:25 -0500)]
Merge branch '13306-arvados-cwl-runner-py3-support'

refs #13306

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago13306: Adds declaration of py2/3 support to arvados cwl and python sdks
Eric Biagiotti [Tue, 5 Feb 2019 17:55:54 +0000 (12:55 -0500)]
13306: Adds declaration of py2/3 support to arvados cwl and python sdks

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago13306: fixes test_with_arvados.sh pip executable with python2
Eric Biagiotti [Tue, 5 Feb 2019 16:53:07 +0000 (11:53 -0500)]
13306: fixes test_with_arvados.sh pip executable with python2

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years agoMerge branch '14806-crunch1-unescape-manifest'
Tom Clegg [Tue, 5 Feb 2019 15:41:51 +0000 (10:41 -0500)]
Merge branch '14806-crunch1-unescape-manifest'

fixes #14806

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14806: Merge branch 'master'
Tom Clegg [Tue, 5 Feb 2019 15:41:31 +0000 (10:41 -0500)]
14806: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoWe have reset the package iterations to -1, make the
Ward Vandewege [Tue, 5 Feb 2019 13:36:07 +0000 (08:36 -0500)]
We have reset the package iterations to -1, make the
run-build-docker-jobs-image.sh script reflect that.

refs #9945

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years agoDo not try to test packages that were not built.
Ward Vandewege [Mon, 4 Feb 2019 22:21:22 +0000 (17:21 -0500)]
Do not try to test packages that were not built.

refs #9945

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14806: Fix test suite to work even if PERL5LIB is set.
Tom Clegg [Mon, 4 Feb 2019 21:43:14 +0000 (16:43 -0500)]
14806: Fix test suite to work even if PERL5LIB is set.

PERL5LIB has precedence over PERLLIB.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoarvbox support for python3 refs #13306
Peter Amstutz [Mon, 4 Feb 2019 18:17:44 +0000 (13:17 -0500)]
arvbox support for python3 refs #13306

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14806: Handle escaped chars when parsing docker image manifest.
Tom Clegg [Mon, 4 Feb 2019 20:58:57 +0000 (15:58 -0500)]
14806: Handle escaped chars when parsing docker image manifest.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13306: fix crunchv1 bug
Peter Amstutz [Mon, 4 Feb 2019 20:13:34 +0000 (15:13 -0500)]
13306: fix crunchv1 bug

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13306: test_with_arvbox can select api
Peter Amstutz [Mon, 4 Feb 2019 20:13:12 +0000 (15:13 -0500)]
13306: test_with_arvbox can select api

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13306: select between "conformance" and "integration" in test_with_arvbox.sh
Peter Amstutz [Mon, 4 Feb 2019 19:22:58 +0000 (14:22 -0500)]
13306: select between "conformance" and "integration" in test_with_arvbox.sh

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13306: test_with_arvbox.sh can test either python2 or python3
Peter Amstutz [Mon, 4 Feb 2019 18:27:09 +0000 (13:27 -0500)]
13306: test_with_arvbox.sh can test either python2 or python3

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoThe libpam-arvados package on Centos7 has a dependency on the python-pam package.
Ward Vandewege [Mon, 4 Feb 2019 17:41:29 +0000 (12:41 -0500)]
The libpam-arvados package on Centos7 has a dependency on the python-pam package.

refs #9945

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14325: Log stderr from last boot-probe when giving up on boot.
Tom Clegg [Mon, 4 Feb 2019 16:21:32 +0000 (11:21 -0500)]
14325: Log stderr from last boot-probe when giving up on boot.

Remove duplicate log message after failed run-probe.

Ensure we always make at least one probe attempt after the boot/probe
timeout expires.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '9945-make-python-package-dependency-free'
Ward Vandewege [Mon, 4 Feb 2019 15:35:51 +0000 (10:35 -0500)]
Merge branch '9945-make-python-package-dependency-free'

closes #9945

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago9945: Merge branch 'master' into 9945-make-python-package-dependency-free
Ward Vandewege [Mon, 4 Feb 2019 15:19:35 +0000 (10:19 -0500)]
9945: Merge branch 'master' into 9945-make-python-package-dependency-free

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago9945: Backwards compatibility fix for libpam-arvados
Ward Vandewege [Mon, 4 Feb 2019 13:36:00 +0000 (08:36 -0500)]
9945: Backwards compatibility fix for libpam-arvados

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years agoarvbox certificates can have DNS in subjectAltName
Peter Amstutz [Fri, 1 Feb 2019 22:03:52 +0000 (17:03 -0500)]
arvbox certificates can have DNS in subjectAltName

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14325: Merge branch 'master'
Tom Clegg [Fri, 1 Feb 2019 21:29:17 +0000 (16:29 -0500)]
14325: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Rephrase confusing conditions and add comments.
Tom Clegg [Fri, 1 Feb 2019 21:26:46 +0000 (16:26 -0500)]
14325: Rephrase confusing conditions and add comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Improve identifiers/comments.
Tom Clegg [Fri, 1 Feb 2019 21:25:59 +0000 (16:25 -0500)]
14325: Improve identifiers/comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Note assumption concurrent dispatchers share a VM size menu.
Tom Clegg [Fri, 1 Feb 2019 21:23:07 +0000 (16:23 -0500)]
14325: Note assumption concurrent dispatchers share a VM size menu.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Fix test.
Tom Clegg [Fri, 1 Feb 2019 21:22:41 +0000 (16:22 -0500)]
14325: Fix test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13306: Improved py2/3 str compatibility
Eric Biagiotti [Fri, 1 Feb 2019 18:45:25 +0000 (13:45 -0500)]
13306: Improved py2/3 str compatibility

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago13306: Additional dict item iteration improvements
Eric Biagiotti [Fri, 1 Feb 2019 18:33:14 +0000 (13:33 -0500)]
13306: Additional dict item iteration improvements

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago9945: Merge branch 'master' into 9945-make-python-package-dependency-free
Ward Vandewege [Fri, 1 Feb 2019 15:39:16 +0000 (10:39 -0500)]
9945: Merge branch 'master' into 9945-make-python-package-dependency-free

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago13306: Fix 12213-keepref test
Peter Amstutz [Thu, 31 Jan 2019 17:54:10 +0000 (12:54 -0500)]
13306: Fix 12213-keepref test

Test itself was buggy and seems to have been relying on undefined
behavior, py3 exposed the bug.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13306: Fixes futurize mistakes regarding PathMapper items()
Eric Biagiotti [Thu, 31 Jan 2019 17:16:42 +0000 (12:16 -0500)]
13306: Fixes futurize mistakes regarding PathMapper items()

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago9945: More changes based on review comments.
Ward Vandewege [Wed, 30 Jan 2019 21:14:52 +0000 (16:14 -0500)]
9945: More changes based on review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years agoMerge branch '14770-wb-acr-bad-param'
Lucas Di Pentima [Wed, 30 Jan 2019 20:53:42 +0000 (17:53 -0300)]
Merge branch '14770-wb-acr-bad-param'
Closes #14770

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoMerge branch '14738-tag-editor-fix-es5'
Lucas Di Pentima [Wed, 30 Jan 2019 20:18:30 +0000 (17:18 -0300)]
Merge branch '14738-tag-editor-fix-es5'
Closes #14738

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago9945: address more review comments.
Ward Vandewege [Tue, 29 Jan 2019 21:53:43 +0000 (16:53 -0500)]
9945: address more review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14738: Replaces double with single quotes for code style.
Lucas Di Pentima [Tue, 29 Jan 2019 22:48:15 +0000 (19:48 -0300)]
14738: Replaces double with single quotes for code style.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14738: Enhances code readability when concatenating strings.
Lucas Di Pentima [Tue, 29 Jan 2019 20:39:26 +0000 (17:39 -0300)]
14738: Enhances code readability when concatenating strings.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14738: Fixes the double-slash usage on requests to prevent 301 from controller
Lucas Di Pentima [Tue, 29 Jan 2019 19:25:02 +0000 (16:25 -0300)]
14738: Fixes the double-slash usage on requests to prevent 301 from controller

When a request is made to controller using double slashes, for example to
http://apiserver//arvados/v1/collections, arvados controller returns a 301
that breaks CORS.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoMerge branch '14718-api-login-salted-token'
Lucas Di Pentima [Tue, 29 Jan 2019 09:30:10 +0000 (06:30 -0300)]
Merge branch '14718-api-login-salted-token'
Closes #14718

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14718: Updates controller test to support josh_id's return_to new format.
Lucas Di Pentima [Mon, 28 Jan 2019 22:03:10 +0000 (19:03 -0300)]
14718: Updates controller test to support josh_id's return_to new format.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14718: Validates remote cluster id parameter on login endpoint & callback.
Lucas Di Pentima [Mon, 28 Jan 2019 21:58:06 +0000 (18:58 -0300)]
14718: Validates remote cluster id parameter on login endpoint & callback.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago9945: address a bunch of review comments.
Ward Vandewege [Wed, 23 Jan 2019 15:12:59 +0000 (10:12 -0500)]
9945: address a bunch of review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14718: Changes the way remote param is packed into return_to.
Lucas Di Pentima [Mon, 28 Jan 2019 20:12:33 +0000 (17:12 -0300)]
14718: Changes the way remote param is packed into return_to.

Also:
* Escapes the remote param for security reasons.
* Adds comments.
* Updates tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoMerge branch 'master' into 13306-arvados-cwl-runner-py3-support
Eric Biagiotti [Mon, 28 Jan 2019 15:34:10 +0000 (10:34 -0500)]
Merge branch 'master' into 13306-arvados-cwl-runner-py3-support

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago13306: Removing debug echo
Eric Biagiotti [Mon, 28 Jan 2019 15:14:30 +0000 (10:14 -0500)]
13306: Removing debug echo

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14325: Clean up test suite logging.
Tom Clegg [Mon, 28 Jan 2019 07:26:49 +0000 (02:26 -0500)]
14325: Clean up test suite logging.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Change remaining LameInstanceSet uses to StubDriver.
Tom Clegg [Mon, 28 Jan 2019 07:19:27 +0000 (02:19 -0500)]
14325: Change remaining LameInstanceSet uses to StubDriver.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14718: Issue salted token when passing 'remote' param to login.
Lucas Di Pentima [Sat, 26 Jan 2019 00:04:58 +0000 (21:04 -0300)]
14718: Issue salted token when passing 'remote' param to login.

When logging in with a 'remote' parameter, it's encoded into the return_to
param passed to the SSO server so that it's received back after the user
is authenticated.
When the omniauth callback receives a remote parameter inside the return_to
url, it returns the salted version of the client token.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14325: Don't count busy workers with state=Unknown as Unallocated.
Tom Clegg [Fri, 25 Jan 2019 21:40:59 +0000 (16:40 -0500)]
14325: Don't count busy workers with state=Unknown as Unallocated.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Build crunch-dispatch-cloud package.
Tom Clegg [Fri, 25 Jan 2019 21:31:48 +0000 (16:31 -0500)]
14325: Build crunch-dispatch-cloud package.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Point to API details in interface doc comments.
Tom Clegg [Fri, 25 Jan 2019 21:28:31 +0000 (16:28 -0500)]
14325: Point to API details in interface doc comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Test resuming worker pool state after restart.
Tom Clegg [Fri, 25 Jan 2019 20:24:19 +0000 (15:24 -0500)]
14325: Test resuming worker pool state after restart.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Remove obsolete test stubs.
Tom Clegg [Fri, 25 Jan 2019 18:28:15 +0000 (13:28 -0500)]
14325: Remove obsolete test stubs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Clean up unsafe concurrency in tests.
Tom Clegg [Fri, 25 Jan 2019 18:22:25 +0000 (13:22 -0500)]
14325: Clean up unsafe concurrency in tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Document Running() return value.
Tom Clegg [Fri, 25 Jan 2019 18:20:34 +0000 (13:20 -0500)]
14325: Document Running() return value.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13306: Adding support for building the dev docker jobs image with py3
Eric Biagiotti [Fri, 25 Jan 2019 18:03:12 +0000 (13:03 -0500)]
13306: Adding support for building the dev docker jobs image with py3

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14325: Don't shutdown busy VMs even if boot probe fails.
Tom Clegg [Thu, 24 Jan 2019 21:10:48 +0000 (16:10 -0500)]
14325: Don't shutdown busy VMs even if boot probe fails.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Wake up scheduler when quota timeout expires.
Tom Clegg [Tue, 22 Jan 2019 22:30:52 +0000 (17:30 -0500)]
14325: Wake up scheduler when quota timeout expires.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Obey EarliestRetry specified by cloud rate-limiting errors.
Tom Clegg [Tue, 22 Jan 2019 22:13:56 +0000 (17:13 -0500)]
14325: Obey EarliestRetry specified by cloud rate-limiting errors.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14770: Fixes parameter on acr call.
Lucas Di Pentima [Thu, 24 Jan 2019 18:48:54 +0000 (15:48 -0300)]
14770: Fixes parameter on acr call.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago13306: Unicode fix for docker image generation in py3 environment
Eric Biagiotti [Thu, 24 Jan 2019 14:38:25 +0000 (09:38 -0500)]
13306: Unicode fix for docker image generation in py3 environment

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago13306: Unicode fixes for the conformance tests
Eric Biagiotti [Thu, 24 Jan 2019 14:37:13 +0000 (09:37 -0500)]
13306: Unicode fixes for the conformance tests

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years agoMerge branch '14482-rubysdk-empty-dir'
Lucas Di Pentima [Tue, 22 Jan 2019 16:40:02 +0000 (13:40 -0300)]
Merge branch '14482-rubysdk-empty-dir'
Closes #14482

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago9945: use virtualenv for our python packages
Ward Vandewege [Tue, 22 Jan 2019 01:46:50 +0000 (20:46 -0500)]
9945: use virtualenv for our python packages

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago9945: run-library changes
Ward Vandewege [Thu, 20 Dec 2018 16:52:01 +0000 (11:52 -0500)]
9945: run-library changes

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago9945: there is a new rvm gpg key
Ward Vandewege [Sun, 20 Jan 2019 18:12:45 +0000 (13:12 -0500)]
9945: there is a new rvm gpg key

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14325: Move magic number to const.
Tom Clegg [Mon, 21 Jan 2019 20:19:53 +0000 (15:19 -0500)]
14325: Move magic number to const.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Log when a worker's first probe succeeds.
Tom Clegg [Mon, 21 Jan 2019 15:19:17 +0000 (10:19 -0500)]
14325: Log when a worker's first probe succeeds.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Shutdown unknown-state worker after boot timeout.
Tom Clegg [Mon, 21 Jan 2019 15:09:09 +0000 (10:09 -0500)]
14325: Shutdown unknown-state worker after boot timeout.

(instead of idle timeout)

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Include instance ID in log messages from stub VM.
Tom Clegg [Mon, 21 Jan 2019 14:38:58 +0000 (09:38 -0500)]
14325: Include instance ID in log messages from stub VM.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14482: Stricter token regexes.
Lucas Di Pentima [Fri, 18 Jan 2019 23:24:43 +0000 (20:24 -0300)]
14482: Stricter token regexes.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14325: Use snake_case keys in management API responses.
Tom Clegg [Fri, 18 Jan 2019 21:54:59 +0000 (16:54 -0500)]
14325: Use snake_case keys in management API responses.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Cancel containers with unsatisfiable runtime constraints.
Tom Clegg [Fri, 18 Jan 2019 21:28:45 +0000 (16:28 -0500)]
14325: Cancel containers with unsatisfiable runtime constraints.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13306: Removing old_div to simplify division operations
Eric Biagiotti [Fri, 18 Jan 2019 16:08:13 +0000 (11:08 -0500)]
13306: Removing old_div to simplify division operations

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14482: Manifest validation including 8-bit escaped chars; with tests.
Lucas Di Pentima [Thu, 17 Jan 2019 23:53:58 +0000 (20:53 -0300)]
14482: Manifest validation including 8-bit escaped chars; with tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14325: Test dispatch container queue against controller.
Tom Clegg [Thu, 17 Jan 2019 21:31:55 +0000 (16:31 -0500)]
14325: Test dispatch container queue against controller.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Fix dropped request params when body not specified by caller.
Tom Clegg [Thu, 17 Jan 2019 21:29:18 +0000 (16:29 -0500)]
14325: Fix dropped request params when body not specified by caller.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13306: Removing list wrapping added by futurize to PathMapper objects
Eric Biagiotti [Thu, 17 Jan 2019 21:03:03 +0000 (16:03 -0500)]
13306: Removing list wrapping added by futurize to PathMapper objects

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

Because cwltool.PathMapper objects have a function called items(), futurize incorrectly added the results of calls to items() to a list object (thinking it was a call to dict.items()). In fact, cwltool.PathMapper.items() already returns a list.

5 years ago13306: Updating dict items as lists to improve py2 performance
Eric Biagiotti [Thu, 17 Jan 2019 20:55:24 +0000 (15:55 -0500)]
13306: Updating dict items as lists to improve py2 performance

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago13306: Fixing previous commit to use viewvalues instead of listvalues
Eric Biagiotti [Thu, 17 Jan 2019 20:40:08 +0000 (15:40 -0500)]
13306: Fixing previous commit to use viewvalues instead of listvalues

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14325: Test that ssh_executor obeys a negative VerifyHostKey result.
Tom Clegg [Thu, 17 Jan 2019 20:08:04 +0000 (15:08 -0500)]
14325: Test that ssh_executor obeys a negative VerifyHostKey result.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Add total houly price metric.
Tom Clegg [Thu, 17 Jan 2019 19:35:29 +0000 (14:35 -0500)]
14325: Add total houly price metric.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13306: Updating dict values as a list to improve py2 performance
Eric Biagiotti [Thu, 17 Jan 2019 19:00:05 +0000 (14:00 -0500)]
13306: Updating dict values as a list to improve py2 performance

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago13306: Updating dict keys as a list to ensure py2/3 compatibility
Eric Biagiotti [Thu, 17 Jan 2019 18:49:39 +0000 (13:49 -0500)]
13306: Updating dict keys as a list to ensure py2/3 compatibility

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14325: Configurable SSH target port for cloud VMs.
Tom Clegg [Thu, 17 Jan 2019 17:01:15 +0000 (12:01 -0500)]
14325: Configurable SSH target port for cloud VMs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '14539-pysdk-empty-dir'
Lucas Di Pentima [Thu, 17 Jan 2019 16:43:25 +0000 (13:43 -0300)]
Merge branch '14539-pysdk-empty-dir'
Closes #14539

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago13306: Updating dict value iteration to be more efficient with py2
Eric Biagiotti [Thu, 17 Jan 2019 16:21:04 +0000 (11:21 -0500)]
13306: Updating dict value iteration to be more efficient with py2

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago13306: Adds test for when get_current_container results in a 404
Eric Biagiotti [Thu, 17 Jan 2019 16:11:35 +0000 (11:11 -0500)]
13306: Adds test for when get_current_container results in a 404

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14325: More testing for hold/drain states.
Tom Clegg [Thu, 17 Jan 2019 15:14:33 +0000 (10:14 -0500)]
14325: More testing for hold/drain states.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13306: Removes a log handler added during a test, breaking subsequent tests.
Eric Biagiotti [Thu, 17 Jan 2019 15:04:03 +0000 (10:04 -0500)]
13306: Removes a log handler added during a test, breaking subsequent tests.

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago13306: Prevents multiple RunTimeStatusLoggingHandlers from being added
Eric Biagiotti [Thu, 17 Jan 2019 15:02:43 +0000 (10:02 -0500)]
13306: Prevents multiple RunTimeStatusLoggingHandlers from being added

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14539: Simplifies a bit further the regexp replacement on escape() function.
Lucas Di Pentima [Thu, 17 Jan 2019 09:55:40 +0000 (06:55 -0300)]
14539: Simplifies a bit further the regexp replacement on escape() function.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14539: Removes pointless code comment.
Lucas Di Pentima [Thu, 17 Jan 2019 09:48:53 +0000 (06:48 -0300)]
14539: Removes pointless code comment.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14539: Fixes and simplifies the escape() function. Updates test.
Lucas Di Pentima [Wed, 16 Jan 2019 22:34:34 +0000 (19:34 -0300)]
14539: Fixes and simplifies the escape() function. Updates test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>