arvados.git
5 years ago14807: Load API host/token directly from stdin without shell hack.
Tom Clegg [Fri, 15 Feb 2019 20:26:10 +0000 (15:26 -0500)]
14807: Load API host/token directly from stdin without shell hack.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14807: Wait at least 1 second between retries on initial queue poll.
Tom Clegg [Thu, 14 Feb 2019 21:13:23 +0000 (16:13 -0500)]
14807: Wait at least 1 second between retries on initial queue poll.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14807: Include more detail in errors.
Tom Clegg [Wed, 13 Feb 2019 19:38:07 +0000 (14:38 -0500)]
14807: Include more detail in errors.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14807: Fix crunch-run --list output when /var/lock is a symlink.
Tom Clegg [Wed, 13 Feb 2019 16:11:03 +0000 (11:11 -0500)]
14807: Fix crunch-run --list output when /var/lock is a symlink.

filepath.Walk(/var/lock) does not return entries inside /var/lock if
/var/lock is a symlink, as it is on debian:9.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14807: Always set node-token tag.
Tom Clegg [Wed, 13 Feb 2019 06:59:42 +0000 (01:59 -0500)]
14807: Always set node-token tag.

Azure driver expects it to be set to an unpredictable string.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14807: Log full instance ID.
Tom Clegg [Wed, 13 Feb 2019 06:57:46 +0000 (01:57 -0500)]
14807: Log full instance ID.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14807: Expose instance IP addresses in logs and management API.
Tom Clegg [Wed, 13 Feb 2019 06:56:49 +0000 (01:56 -0500)]
14807: Expose instance IP addresses in logs and management API.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14807: Fix SSH target address.
Tom Clegg [Wed, 13 Feb 2019 06:55:32 +0000 (01:55 -0500)]
14807: Fix SSH target address.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14807: Accept .../instances/_/drain?instance_id=X.
Tom Clegg [Wed, 13 Feb 2019 06:52:21 +0000 (01:52 -0500)]
14807: Accept .../instances/_/drain?instance_id=X.

Azure Instance IDs contain slashes, so they don't work well as path
parameters.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14807: Pass SSH public key to driver.
Tom Clegg [Wed, 13 Feb 2019 06:49:59 +0000 (01:49 -0500)]
14807: Pass SSH public key to driver.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14807: Allow driver to specify SSH username.
Tom Clegg [Wed, 13 Feb 2019 06:42:40 +0000 (01:42 -0500)]
14807: Allow driver to specify SSH username.

Use a non-root account with passwordless sudo on a provider (Azure)
that can easily set that up, but can't easily set up direct root
login.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14807: When ProviderType is unspecified, default to Arvados type.
Tom Clegg [Wed, 13 Feb 2019 06:34:43 +0000 (01:34 -0500)]
14807: When ProviderType is unspecified, default to Arvados type.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14807: Pass env vars on stdin instead of using SSH feature.
Tom Clegg [Wed, 13 Feb 2019 06:32:34 +0000 (01:32 -0500)]
14807: Pass env vars on stdin instead of using SSH feature.

Arbitrary environment variables are typically not accepted by SSH
server configs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14807: Match systemd description to component name.
Tom Clegg [Wed, 13 Feb 2019 03:00:21 +0000 (22:00 -0500)]
14807: Match systemd description to component name.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Start up immediately if there are no stale locks.
Tom Clegg [Tue, 12 Feb 2019 19:17:10 +0000 (14:17 -0500)]
14325: Start up immediately if there are no stale locks.

...instead of waiting for the pool to send a notification to trigger
the first loop iteration.

refs #14325

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '14745-azure-cloud-driver-fixups'
Eric Biagiotti [Thu, 14 Feb 2019 19:56:47 +0000 (14:56 -0500)]
Merge branch '14745-azure-cloud-driver-fixups'

refs #14745

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago14745: Removes unnecessary test parameter
Eric Biagiotti [Thu, 14 Feb 2019 19:11:34 +0000 (14:11 -0500)]
14745: Removes unnecessary test parameter

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago14745: Adds support for passing nil params to StubDriver InstanceSet
Eric Biagiotti [Thu, 14 Feb 2019 17:31:53 +0000 (12:31 -0500)]
14745: Adds support for passing nil params to StubDriver InstanceSet

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years agoMerge branch '14828-fix-flaky-test'
Tom Clegg [Thu, 14 Feb 2019 16:31:32 +0000 (11:31 -0500)]
Merge branch '14828-fix-flaky-test'

fixes #14828

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14745: Improves azure driver exported var comment
Eric Biagiotti [Wed, 13 Feb 2019 22:38:54 +0000 (17:38 -0500)]
14745: Improves azure driver exported var comment

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago14745: Removes unneeded file and debug code and improves Duration comments
Eric Biagiotti [Wed, 13 Feb 2019 22:18:57 +0000 (17:18 -0500)]
14745: Removes unneeded file and debug code and improves Duration comments

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago14745: Adds back param loading to StubDriver InstanceSet
Eric Biagiotti [Wed, 13 Feb 2019 21:50:03 +0000 (16:50 -0500)]
14745: Adds back param loading to StubDriver InstanceSet

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago14828: Fix double-cancel of unsatisfiable container.
Tom Clegg [Wed, 13 Feb 2019 21:47:36 +0000 (16:47 -0500)]
14828: Fix double-cancel of unsatisfiable container.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14745: Replaces debug println with proper return and doc clean up
Eric Biagiotti [Wed, 13 Feb 2019 20:10:48 +0000 (15:10 -0500)]
14745: Replaces debug println with proper return and doc clean up

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago14745: Updates StubDriver to match driver interface and updates vendor.json
Eric Biagiotti [Wed, 13 Feb 2019 18:51:18 +0000 (13:51 -0500)]
14745: Updates StubDriver to match driver interface and updates vendor.json

StubDriver InstanceSet was previously using mapstructure to decode DriverParameters into a StubInstanceSet, which doesn't make sense, but mapstructure would just return nil instead of an error.

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago14745: Updates drivers to use json.RawMessage instead of map[string]interface
Eric Biagiotti [Tue, 12 Feb 2019 22:09:47 +0000 (17:09 -0500)]
14745: Updates drivers to use json.RawMessage instead of map[string]interface

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com

5 years ago14325: Start up immediately if there are no stale locks.
Tom Clegg [Tue, 12 Feb 2019 19:17:10 +0000 (14:17 -0500)]
14325: Start up immediately if there are no stale locks.

...instead of waiting for the pool to send a notification to trigger
the first loop iteration.

refs #14325

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Fix PrivateKey config type.
Tom Clegg [Tue, 12 Feb 2019 16:25:56 +0000 (11:25 -0500)]
14325: Fix PrivateKey config type.

JSON decoder expects []byte fields to be base64-encoded, which we
don't want here.

refs #14325

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '14325-dispatch-cloud'
Tom Clegg [Tue, 12 Feb 2019 06:10:55 +0000 (01:10 -0500)]
Merge branch '14325-dispatch-cloud'

refs #14325

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Rename crunch-dispatch-cloud → arvados-dispatch-cloud.
Tom Clegg [Tue, 12 Feb 2019 06:07:09 +0000 (01:07 -0500)]
14325: Rename crunch-dispatch-cloud → arvados-dispatch-cloud.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14745: Un-exports identifiers
Eric Biagiotti [Mon, 11 Feb 2019 21:46:29 +0000 (16:46 -0500)]
14745: Un-exports identifiers

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years agoMake sure to bump the dependency on the arvados gems to the 1.3 series.
Ward Vandewege [Mon, 11 Feb 2019 21:10:47 +0000 (16:10 -0500)]
Make sure to bump the dependency on the arvados gems to the 1.3 series.

refs #14559

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14745: Makes DeleteDanglingResourcesAfter an arvados.Duration
Eric Biagiotti [Mon, 11 Feb 2019 19:59:15 +0000 (14:59 -0500)]
14745: Makes DeleteDanglingResourcesAfter an arvados.Duration

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years agoMerge branch '14826-cert-path' refs #14826
Peter Amstutz [Mon, 11 Feb 2019 19:54:53 +0000 (14:54 -0500)]
Merge branch '14826-cert-path' refs #14826

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14826: Fix copy and paste error
Peter Amstutz [Mon, 11 Feb 2019 18:05:34 +0000 (13:05 -0500)]
14826: Fix copy and paste error

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoMerge branch '14725-wes' refs #14725
Peter Amstutz [Mon, 11 Feb 2019 16:32:01 +0000 (11:32 -0500)]
Merge branch '14725-wes'  refs #14725

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14725: Fix tests.
Peter Amstutz [Mon, 11 Feb 2019 16:23:48 +0000 (11:23 -0500)]
14725: Fix tests.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14745: Updates config keys, documentation, and addresses golint suggestions
Eric Biagiotti [Mon, 11 Feb 2019 16:07:28 +0000 (11:07 -0500)]
14745: Updates config keys, documentation, and addresses golint suggestions

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago14826: API server looks in CA cert path that works on CentOS
Peter Amstutz [Mon, 11 Feb 2019 15:57:45 +0000 (10:57 -0500)]
14826: API server looks in CA cert path that works on CentOS

API server makes callbacks to remote clusters to validate remote
users, ensure it has the right system CA cert path to validate TLS
certs of remote clusters.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14725: Don't give a cluster_id when updating container request record
Peter Amstutz [Mon, 11 Feb 2019 15:09:24 +0000 (10:09 -0500)]
14725: Don't give a cluster_id when updating container request record

* When transferring files from http to keep, explicitly open in binary
  mode

* Bump arvados-python-client dependency for python3 support

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14745: Adds gocheck hook to go test for azure dirver
Eric Biagiotti [Mon, 11 Feb 2019 14:58:11 +0000 (09:58 -0500)]
14745: Adds gocheck hook to go test for azure dirver

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago14745: Makes the azure driver its own package
Eric Biagiotti [Mon, 11 Feb 2019 14:13:11 +0000 (09:13 -0500)]
14745: Makes the azure driver its own package

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years agoIn the arvados/jobs image, use the Python executable from the
Ward Vandewege [Thu, 7 Feb 2019 16:52:04 +0000 (11:52 -0500)]
In the arvados/jobs image, use the Python executable from the
python-arvados-python-client package by default.

refs #9945

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years agoMerge branch '13306-arvados-cwl-runner-py3-support'
Eric Biagiotti [Wed, 6 Feb 2019 22:38:17 +0000 (17:38 -0500)]
Merge branch '13306-arvados-cwl-runner-py3-support'

refs #13306
3

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years agoMerge branch '14325-dispatch-cloud'
Tom Clegg [Wed, 6 Feb 2019 21:29:38 +0000 (16:29 -0500)]
Merge branch '14325-dispatch-cloud'

closes #14325

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Merge branch 'master'
Tom Clegg [Wed, 6 Feb 2019 21:27:57 +0000 (16:27 -0500)]
14325: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch 'master' into 13306-arvados-cwl-runner-py3-support
Eric Biagiotti [Wed, 6 Feb 2019 16:40:17 +0000 (11:40 -0500)]
Merge branch 'master' into 13306-arvados-cwl-runner-py3-support

refs #13306
3

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago13306: Removing unneeded import statements
Eric Biagiotti [Wed, 6 Feb 2019 16:40:04 +0000 (11:40 -0500)]
13306: Removing unneeded import statements

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years agoMake the python-arvados-cwl-runner package expose the cwltool executable, make
Ward Vandewege [Tue, 5 Feb 2019 22:14:05 +0000 (17:14 -0500)]
Make the python-arvados-cwl-runner package expose the cwltool executable, make
it conflict with the python-cwltool (and cwltool) packages, and add a note to
the upgrade documentation to that effect. Also document the Centos7 specific
upgrade from python33 to rh-python35 as part of story 9945.

refs #9945

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years agoMerge branch '13306-arvados-cwl-runner-py3-support'
Eric Biagiotti [Tue, 5 Feb 2019 18:25:14 +0000 (13:25 -0500)]
Merge branch '13306-arvados-cwl-runner-py3-support'

refs #13306

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago13306: Adds declaration of py2/3 support to arvados cwl and python sdks
Eric Biagiotti [Tue, 5 Feb 2019 17:55:54 +0000 (12:55 -0500)]
13306: Adds declaration of py2/3 support to arvados cwl and python sdks

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago13306: fixes test_with_arvados.sh pip executable with python2
Eric Biagiotti [Tue, 5 Feb 2019 16:53:07 +0000 (11:53 -0500)]
13306: fixes test_with_arvados.sh pip executable with python2

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years agoMerge branch '14806-crunch1-unescape-manifest'
Tom Clegg [Tue, 5 Feb 2019 15:41:51 +0000 (10:41 -0500)]
Merge branch '14806-crunch1-unescape-manifest'

fixes #14806

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14806: Merge branch 'master'
Tom Clegg [Tue, 5 Feb 2019 15:41:31 +0000 (10:41 -0500)]
14806: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoWe have reset the package iterations to -1, make the
Ward Vandewege [Tue, 5 Feb 2019 13:36:07 +0000 (08:36 -0500)]
We have reset the package iterations to -1, make the
run-build-docker-jobs-image.sh script reflect that.

refs #9945

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years agoDo not try to test packages that were not built.
Ward Vandewege [Mon, 4 Feb 2019 22:21:22 +0000 (17:21 -0500)]
Do not try to test packages that were not built.

refs #9945

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14806: Fix test suite to work even if PERL5LIB is set.
Tom Clegg [Mon, 4 Feb 2019 21:43:14 +0000 (16:43 -0500)]
14806: Fix test suite to work even if PERL5LIB is set.

PERL5LIB has precedence over PERLLIB.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoarvbox support for python3 refs #13306
Peter Amstutz [Mon, 4 Feb 2019 18:17:44 +0000 (13:17 -0500)]
arvbox support for python3 refs #13306

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14806: Handle escaped chars when parsing docker image manifest.
Tom Clegg [Mon, 4 Feb 2019 20:58:57 +0000 (15:58 -0500)]
14806: Handle escaped chars when parsing docker image manifest.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13306: fix crunchv1 bug
Peter Amstutz [Mon, 4 Feb 2019 20:13:34 +0000 (15:13 -0500)]
13306: fix crunchv1 bug

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13306: test_with_arvbox can select api
Peter Amstutz [Mon, 4 Feb 2019 20:13:12 +0000 (15:13 -0500)]
13306: test_with_arvbox can select api

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13306: select between "conformance" and "integration" in test_with_arvbox.sh
Peter Amstutz [Mon, 4 Feb 2019 19:22:58 +0000 (14:22 -0500)]
13306: select between "conformance" and "integration" in test_with_arvbox.sh

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13306: test_with_arvbox.sh can test either python2 or python3
Peter Amstutz [Mon, 4 Feb 2019 18:27:09 +0000 (13:27 -0500)]
13306: test_with_arvbox.sh can test either python2 or python3

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years agoThe libpam-arvados package on Centos7 has a dependency on the python-pam package.
Ward Vandewege [Mon, 4 Feb 2019 17:41:29 +0000 (12:41 -0500)]
The libpam-arvados package on Centos7 has a dependency on the python-pam package.

refs #9945

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14325: Log stderr from last boot-probe when giving up on boot.
Tom Clegg [Mon, 4 Feb 2019 16:21:32 +0000 (11:21 -0500)]
14325: Log stderr from last boot-probe when giving up on boot.

Remove duplicate log message after failed run-probe.

Ensure we always make at least one probe attempt after the boot/probe
timeout expires.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years agoMerge branch '9945-make-python-package-dependency-free'
Ward Vandewege [Mon, 4 Feb 2019 15:35:51 +0000 (10:35 -0500)]
Merge branch '9945-make-python-package-dependency-free'

closes #9945

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago9945: Merge branch 'master' into 9945-make-python-package-dependency-free
Ward Vandewege [Mon, 4 Feb 2019 15:19:35 +0000 (10:19 -0500)]
9945: Merge branch 'master' into 9945-make-python-package-dependency-free

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago9945: Backwards compatibility fix for libpam-arvados
Ward Vandewege [Mon, 4 Feb 2019 13:36:00 +0000 (08:36 -0500)]
9945: Backwards compatibility fix for libpam-arvados

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years agoarvbox certificates can have DNS in subjectAltName
Peter Amstutz [Fri, 1 Feb 2019 22:03:52 +0000 (17:03 -0500)]
arvbox certificates can have DNS in subjectAltName

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago14325: Merge branch 'master'
Tom Clegg [Fri, 1 Feb 2019 21:29:17 +0000 (16:29 -0500)]
14325: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Rephrase confusing conditions and add comments.
Tom Clegg [Fri, 1 Feb 2019 21:26:46 +0000 (16:26 -0500)]
14325: Rephrase confusing conditions and add comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Improve identifiers/comments.
Tom Clegg [Fri, 1 Feb 2019 21:25:59 +0000 (16:25 -0500)]
14325: Improve identifiers/comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Note assumption concurrent dispatchers share a VM size menu.
Tom Clegg [Fri, 1 Feb 2019 21:23:07 +0000 (16:23 -0500)]
14325: Note assumption concurrent dispatchers share a VM size menu.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Fix test.
Tom Clegg [Fri, 1 Feb 2019 21:22:41 +0000 (16:22 -0500)]
14325: Fix test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago13306: Improved py2/3 str compatibility
Eric Biagiotti [Fri, 1 Feb 2019 18:45:25 +0000 (13:45 -0500)]
13306: Improved py2/3 str compatibility

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago13306: Additional dict item iteration improvements
Eric Biagiotti [Fri, 1 Feb 2019 18:33:14 +0000 (13:33 -0500)]
13306: Additional dict item iteration improvements

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago9945: Merge branch 'master' into 9945-make-python-package-dependency-free
Ward Vandewege [Fri, 1 Feb 2019 15:39:16 +0000 (10:39 -0500)]
9945: Merge branch 'master' into 9945-make-python-package-dependency-free

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago13306: Fix 12213-keepref test
Peter Amstutz [Thu, 31 Jan 2019 17:54:10 +0000 (12:54 -0500)]
13306: Fix 12213-keepref test

Test itself was buggy and seems to have been relying on undefined
behavior, py3 exposed the bug.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

5 years ago13306: Fixes futurize mistakes regarding PathMapper items()
Eric Biagiotti [Thu, 31 Jan 2019 17:16:42 +0000 (12:16 -0500)]
13306: Fixes futurize mistakes regarding PathMapper items()

Arvados-DCO-1.1-Signed-off-by: Eric Biagiotti <eric.biagiotti@gmail.com>

5 years ago9945: More changes based on review comments.
Ward Vandewege [Wed, 30 Jan 2019 21:14:52 +0000 (16:14 -0500)]
9945: More changes based on review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years agoMerge branch '14770-wb-acr-bad-param'
Lucas Di Pentima [Wed, 30 Jan 2019 20:53:42 +0000 (17:53 -0300)]
Merge branch '14770-wb-acr-bad-param'
Closes #14770

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoMerge branch '14738-tag-editor-fix-es5'
Lucas Di Pentima [Wed, 30 Jan 2019 20:18:30 +0000 (17:18 -0300)]
Merge branch '14738-tag-editor-fix-es5'
Closes #14738

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago9945: address more review comments.
Ward Vandewege [Tue, 29 Jan 2019 21:53:43 +0000 (16:53 -0500)]
9945: address more review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14738: Replaces double with single quotes for code style.
Lucas Di Pentima [Tue, 29 Jan 2019 22:48:15 +0000 (19:48 -0300)]
14738: Replaces double with single quotes for code style.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14738: Enhances code readability when concatenating strings.
Lucas Di Pentima [Tue, 29 Jan 2019 20:39:26 +0000 (17:39 -0300)]
14738: Enhances code readability when concatenating strings.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14738: Fixes the double-slash usage on requests to prevent 301 from controller
Lucas Di Pentima [Tue, 29 Jan 2019 19:25:02 +0000 (16:25 -0300)]
14738: Fixes the double-slash usage on requests to prevent 301 from controller

When a request is made to controller using double slashes, for example to
http://apiserver//arvados/v1/collections, arvados controller returns a 301
that breaks CORS.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoMerge branch '14718-api-login-salted-token'
Lucas Di Pentima [Tue, 29 Jan 2019 09:30:10 +0000 (06:30 -0300)]
Merge branch '14718-api-login-salted-token'
Closes #14718

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14718: Updates controller test to support josh_id's return_to new format.
Lucas Di Pentima [Mon, 28 Jan 2019 22:03:10 +0000 (19:03 -0300)]
14718: Updates controller test to support josh_id's return_to new format.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14718: Validates remote cluster id parameter on login endpoint & callback.
Lucas Di Pentima [Mon, 28 Jan 2019 21:58:06 +0000 (18:58 -0300)]
14718: Validates remote cluster id parameter on login endpoint & callback.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago9945: address a bunch of review comments.
Ward Vandewege [Wed, 23 Jan 2019 15:12:59 +0000 (10:12 -0500)]
9945: address a bunch of review comments.

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

5 years ago14718: Changes the way remote param is packed into return_to.
Lucas Di Pentima [Mon, 28 Jan 2019 20:12:33 +0000 (17:12 -0300)]
14718: Changes the way remote param is packed into return_to.

Also:
* Escapes the remote param for security reasons.
* Adds comments.
* Updates tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years agoMerge branch 'master' into 13306-arvados-cwl-runner-py3-support
Eric Biagiotti [Mon, 28 Jan 2019 15:34:10 +0000 (10:34 -0500)]
Merge branch 'master' into 13306-arvados-cwl-runner-py3-support

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago13306: Removing debug echo
Eric Biagiotti [Mon, 28 Jan 2019 15:14:30 +0000 (10:14 -0500)]
13306: Removing debug echo

Arvados-DCO-1.1-Signed-off-by:  Eric Biagiotti <ebiagiotti@veritasgenetics.com>

5 years ago14325: Clean up test suite logging.
Tom Clegg [Mon, 28 Jan 2019 07:26:49 +0000 (02:26 -0500)]
14325: Clean up test suite logging.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Change remaining LameInstanceSet uses to StubDriver.
Tom Clegg [Mon, 28 Jan 2019 07:19:27 +0000 (02:19 -0500)]
14325: Change remaining LameInstanceSet uses to StubDriver.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14718: Issue salted token when passing 'remote' param to login.
Lucas Di Pentima [Sat, 26 Jan 2019 00:04:58 +0000 (21:04 -0300)]
14718: Issue salted token when passing 'remote' param to login.

When logging in with a 'remote' parameter, it's encoded into the return_to
param passed to the SSO server so that it's received back after the user
is authenticated.
When the omniauth callback receives a remote parameter inside the return_to
url, it returns the salted version of the client token.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

5 years ago14325: Don't count busy workers with state=Unknown as Unallocated.
Tom Clegg [Fri, 25 Jan 2019 21:40:59 +0000 (16:40 -0500)]
14325: Don't count busy workers with state=Unknown as Unallocated.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Build crunch-dispatch-cloud package.
Tom Clegg [Fri, 25 Jan 2019 21:31:48 +0000 (16:31 -0500)]
14325: Build crunch-dispatch-cloud package.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Point to API details in interface doc comments.
Tom Clegg [Fri, 25 Jan 2019 21:28:31 +0000 (16:28 -0500)]
14325: Point to API details in interface doc comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

5 years ago14325: Test resuming worker pool state after restart.
Tom Clegg [Fri, 25 Jan 2019 20:24:19 +0000 (15:24 -0500)]
14325: Test resuming worker pool state after restart.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>