arvados.git
6 years agoAdd mypy-extensions to build.list refs #13627
Peter Amstutz [Tue, 19 Jun 2018 20:29:25 +0000 (16:29 -0400)]
Add mypy-extensions to build.list refs #13627

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13638-acr-version' refs #13638
Peter Amstutz [Tue, 19 Jun 2018 20:16:32 +0000 (16:16 -0400)]
Merge branch '13638-acr-version' refs #13638

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13638: Restore logic of arvados-cwl-runner version is max(sdk, acr)
Peter Amstutz [Tue, 19 Jun 2018 19:53:02 +0000 (15:53 -0400)]
13638: Restore logic of arvados-cwl-runner version is max(sdk, acr)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13627-update-cwltool' refs #13627
Peter Amstutz [Tue, 19 Jun 2018 19:21:11 +0000 (15:21 -0400)]
Merge branch '13627-update-cwltool' refs #13627

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13497-controller'
Tom Clegg [Tue, 19 Jun 2018 17:45:03 +0000 (13:45 -0400)]
Merge branch '13497-controller'

refs #13497

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13627: Tweak test to possibly avoid name clash
Peter Amstutz [Tue, 19 Jun 2018 17:44:45 +0000 (13:44 -0400)]
13627: Tweak test to possibly avoid name clash

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13497: Ensure every test run produces something in tmp/*.log.
Tom Clegg [Tue, 19 Jun 2018 17:43:16 +0000 (13:43 -0400)]
13497: Ensure every test run produces something in tmp/*.log.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Merge branch 'master' into 13497-controller
Tom Clegg [Tue, 19 Jun 2018 16:31:08 +0000 (12:31 -0400)]
13497: Merge branch 'master' into 13497-controller

refs #13497

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13579-keepstore-config-doc' refs #13579 refs #13580
Peter Amstutz [Mon, 18 Jun 2018 19:27:23 +0000 (15:27 -0400)]
Merge branch '13579-keepstore-config-doc' refs #13579 refs #13580

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13627: Fix tests after rebase
Peter Amstutz [Mon, 18 Jun 2018 19:22:42 +0000 (15:22 -0400)]
13627: Fix tests after rebase

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13627: Fix ArvadosWorkflow use of Builder
Peter Amstutz [Fri, 15 Jun 2018 20:58:50 +0000 (16:58 -0400)]
13627: Fix ArvadosWorkflow use of Builder

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13627: Fix crunch_script
Peter Amstutz [Fri, 15 Jun 2018 14:59:24 +0000 (10:59 -0400)]
13627: Fix crunch_script

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13627: Add missing file.
Peter Amstutz [Fri, 15 Jun 2018 14:49:45 +0000 (10:49 -0400)]
13627: Add missing file.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13627: Improve error reporting.
Peter Amstutz [Fri, 15 Jun 2018 14:40:43 +0000 (10:40 -0400)]
13627: Improve error reporting.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13627: Fix loadingContext used for reloading document.
Peter Amstutz [Fri, 15 Jun 2018 14:11:01 +0000 (10:11 -0400)]
13627: Fix loadingContext used for reloading document.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13627: a-c-r migration to cwltool loading/runtimeContext API
Peter Amstutz [Fri, 15 Jun 2018 02:38:57 +0000 (22:38 -0400)]
13627: a-c-r migration to cwltool loading/runtimeContext API

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoAPI fixup
Peter Amstutz [Thu, 14 Jun 2018 21:56:13 +0000 (17:56 -0400)]
API fixup

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13580: Add arvados-cwl-runner to storage class usage docs.
Peter Amstutz [Mon, 18 Jun 2018 18:36:33 +0000 (14:36 -0400)]
13580: Add arvados-cwl-runner to storage class usage docs.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13580: Add storage classes section to user guide
Peter Amstutz [Mon, 18 Jun 2018 14:54:05 +0000 (10:54 -0400)]
13580: Add storage classes section to user guide

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13429-cwl-runner-storage-classes-support'
Fuad Muhic [Mon, 18 Jun 2018 14:47:23 +0000 (16:47 +0200)]
Merge branch '13429-cwl-runner-storage-classes-support'

closes #13429

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years ago13579: Add a little more introductory material on allocating resources
Peter Amstutz [Mon, 18 Jun 2018 14:28:15 +0000 (10:28 -0400)]
13579: Add a little more introductory material on allocating resources
for keepstore

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch 'master' of git.curoverse.com:arvados into 13429-cwl-runner-storage...
Fuad Muhic [Mon, 18 Jun 2018 09:03:33 +0000 (11:03 +0200)]
Merge branch 'master' of git.curoverse.com:arvados into 13429-cwl-runner-storage-classes-support

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years agoAdd storage_classes tests for arvados_cwl_runner
Fuad Muhic [Mon, 18 Jun 2018 08:58:33 +0000 (10:58 +0200)]
Add storage_classes tests for arvados_cwl_runner

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years ago13497: Merge branch 'master' into 13497-controller
Tom Clegg [Fri, 15 Jun 2018 20:18:09 +0000 (16:18 -0400)]
13497: Merge branch 'master' into 13497-controller

refs #13497

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13581-cr-not-satisfiable-report'
Lucas Di Pentima [Fri, 15 Jun 2018 19:58:29 +0000 (16:58 -0300)]
Merge branch '13581-cr-not-satisfiable-report'
Closes #13581

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13497: Load env vars from /etc/arvados/environment in controller.
Tom Clegg [Fri, 15 Jun 2018 19:41:51 +0000 (15:41 -0400)]
13497: Load env vars from /etc/arvados/environment in controller.

Facilitates setting node profile via ARVADOS_NODE_PROFILE environment
var without editing the systemd unit file.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Rename SystemNodes to NodeProfiles in config.
Tom Clegg [Fri, 15 Jun 2018 19:26:24 +0000 (15:26 -0400)]
13497: Rename SystemNodes to NodeProfiles in config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Abort startup if Rails API cannot be found.
Tom Clegg [Fri, 15 Jun 2018 19:08:59 +0000 (15:08 -0400)]
13497: Abort startup if Rails API cannot be found.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Support "run-tests.sh --only go".
Tom Clegg [Fri, 15 Jun 2018 19:06:02 +0000 (15:06 -0400)]
13497: Support "run-tests.sh --only go".

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Bump version numbers for Go packages when lib/ changes.
Tom Clegg [Fri, 15 Jun 2018 19:05:17 +0000 (15:05 -0400)]
13497: Bump version numbers for Go packages when lib/ changes.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13579: Admin documentation setting up Azure resources
Nico Cesar [Thu, 14 Jun 2018 22:40:53 +0000 (18:40 -0400)]
13579: Admin documentation setting up Azure resources

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <ncesar@veritasgenetics.com>

6 years ago13497: Quote file paths in test suite nginx.conf.
Tom Clegg [Thu, 14 Jun 2018 21:03:24 +0000 (17:03 -0400)]
13497: Quote file paths in test suite nginx.conf.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Suppress nginx "info" logs from console.
Tom Clegg [Thu, 14 Jun 2018 21:02:10 +0000 (17:02 -0400)]
13497: Suppress nginx "info" logs from console.

(unless ARVADOS_DEBUG is set)

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Send test server logs to {workspace}/tmp/*.log.
Tom Clegg [Thu, 14 Jun 2018 20:29:11 +0000 (16:29 -0400)]
13497: Send test server logs to {workspace}/tmp/*.log.

Don't send them to console unless ARVADOS_DEBUG is set.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Add systemd unit to arvados-controller package.
Tom Clegg [Thu, 14 Jun 2018 19:37:13 +0000 (15:37 -0400)]
13497: Add systemd unit to arvados-controller package.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13579: Admin documentation about storage classes
Peter Amstutz [Thu, 14 Jun 2018 19:24:46 +0000 (15:24 -0400)]
13579: Admin documentation about storage classes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13497: Accept host key on command line.
Tom Clegg [Thu, 14 Jun 2018 19:23:08 +0000 (15:23 -0400)]
13497: Accept host key on command line.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Add controller to health check.
Tom Clegg [Thu, 14 Jun 2018 17:34:58 +0000 (13:34 -0400)]
13497: Add controller to health check.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Set usable path for nginx request body buffering.
Tom Clegg [Wed, 13 Jun 2018 20:59:52 +0000 (16:59 -0400)]
13497: Set usable path for nginx request body buffering.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Remove alternate integration test glue in Workbench.
Tom Clegg [Wed, 13 Jun 2018 20:43:41 +0000 (16:43 -0400)]
13497: Remove alternate integration test glue in Workbench.

Expect run-tests.sh to have set everything up correctly instead.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Route API traffic through controller in test suites.
Tom Clegg [Wed, 13 Jun 2018 19:51:30 +0000 (15:51 -0400)]
13497: Route API traffic through controller in test suites.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Don't propagate connection-oriented headers when proxying.
Tom Clegg [Wed, 13 Jun 2018 19:51:07 +0000 (15:51 -0400)]
13497: Don't propagate connection-oriented headers when proxying.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Send request body when proxying.
Tom Clegg [Wed, 13 Jun 2018 19:49:26 +0000 (15:49 -0400)]
13497: Send request body when proxying.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Add timeout for proxy requests.
Tom Clegg [Tue, 12 Jun 2018 20:39:41 +0000 (16:39 -0400)]
13497: Add timeout for proxy requests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Proxy requests to Rails API.
Tom Clegg [Tue, 12 Jun 2018 20:00:07 +0000 (16:00 -0400)]
13497: Proxy requests to Rails API.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Move common system service code to lib/service.
Tom Clegg [Tue, 12 Jun 2018 15:10:12 +0000 (11:10 -0400)]
13497: Move common system service code to lib/service.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13407-volume-replication'
Tom Clegg [Thu, 14 Jun 2018 17:16:37 +0000 (13:16 -0400)]
Merge branch '13407-volume-replication'

refs #13407

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13617-anm-instance-type-logging'
Lucas Di Pentima [Thu, 14 Jun 2018 17:09:34 +0000 (14:09 -0300)]
Merge branch '13617-anm-instance-type-logging'
Closes #13617

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agodocs wip
Peter Amstutz [Fri, 8 Jun 2018 18:29:35 +0000 (14:29 -0400)]
docs wip

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13579: Update from comments
Peter Amstutz [Thu, 14 Jun 2018 16:22:09 +0000 (12:22 -0400)]
13579: Update from comments

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13617: Replaces all logging about size names with size ids.
Lucas Di Pentima [Thu, 14 Jun 2018 15:39:08 +0000 (12:39 -0300)]
13617: Replaces all logging about size names with size ids.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13581: Adds log message when no instance types are configured.
Lucas Di Pentima [Thu, 14 Jun 2018 15:04:22 +0000 (12:04 -0300)]
13581: Adds log message when no instance types are configured.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '7478-anm-libcloud-deps-fix'
Lucas Di Pentima [Wed, 13 Jun 2018 20:04:15 +0000 (17:04 -0300)]
Merge branch '7478-anm-libcloud-deps-fix'
Refs #7478

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago7478: Fix nodemanager's libcloud install dependency.
Lucas Di Pentima [Wed, 13 Jun 2018 19:29:17 +0000 (16:29 -0300)]
7478: Fix nodemanager's libcloud install dependency.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '7478-invalid-size-not-defined'
Lucas Di Pentima [Wed, 13 Jun 2018 13:04:07 +0000 (10:04 -0300)]
Merge branch '7478-invalid-size-not-defined'
Refs #7478

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago7478: Fixes InvalidCloudSize creation. Adds wishlist related node info to logs.
Lucas Di Pentima [Wed, 13 Jun 2018 01:35:21 +0000 (22:35 -0300)]
7478: Fixes InvalidCloudSize creation. Adds wishlist related node info to logs.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '7478-anm-spot-instances'
Lucas Di Pentima [Tue, 12 Jun 2018 18:24:41 +0000 (15:24 -0300)]
Merge branch '7478-anm-spot-instances'
Closes #7478

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago7478: Moves invalid cloud size node's shutdown decision to proper method.
Lucas Di Pentima [Tue, 12 Jun 2018 17:44:24 +0000 (14:44 -0300)]
7478: Moves invalid cloud size node's shutdown decision to proper method.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13581: Available types reported to the user when CR is not satisfiable.
Lucas Di Pentima [Thu, 7 Jun 2018 17:11:00 +0000 (14:11 -0300)]
13581: Available types reported to the user when CR is not satisfiable.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13407: Test stats reporting for volumes with replication>1.
Tom Clegg [Tue, 12 Jun 2018 14:46:01 +0000 (10:46 -0400)]
13407: Test stats reporting for volumes with replication>1.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoUpdate storage_classes support for arvados_cwl_runner to work correctly
Fuad Muhic [Tue, 12 Jun 2018 13:10:23 +0000 (15:10 +0200)]
Update storage_classes support for arvados_cwl_runner to work correctly
when arvados_cwl_runner is run in submit mode.

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years ago7478: Fixes GCE driver's arvados_node_size tag handling.
Lucas Di Pentima [Mon, 11 Jun 2018 22:49:21 +0000 (19:49 -0300)]
7478: Fixes GCE driver's arvados_node_size tag handling.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13579: Document ManagementToken. Add information about trash behavior.
Peter Amstutz [Mon, 11 Jun 2018 19:27:55 +0000 (15:27 -0400)]
13579: Document ManagementToken.  Add information about trash behavior.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13579: Remove some example output because I don't know if it is up to date.
Peter Amstutz [Mon, 11 Jun 2018 19:04:20 +0000 (15:04 -0400)]
13579: Remove some example output because I don't know if it is up to date.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13579: Keepstore install documentation now describes using config.yml
Peter Amstutz [Mon, 11 Jun 2018 18:58:24 +0000 (14:58 -0400)]
13579: Keepstore install documentation now describes using config.yml

Add documentation for using S3-compatible object storage.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13407: Fix stats reporting for mounts with replication>1.
Tom Clegg [Mon, 11 Jun 2018 21:01:38 +0000 (17:01 -0400)]
13407: Fix stats reporting for mounts with replication>1.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago7478: Adds test to check that state is 'down' with 'invalid' size.
Lucas Di Pentima [Mon, 11 Jun 2018 20:51:38 +0000 (17:51 -0300)]
7478: Adds test to check that state is 'down' with 'invalid' size.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago7478: Adds tests on driver's create_node calls.
Lucas Di Pentima [Mon, 11 Jun 2018 19:47:50 +0000 (16:47 -0300)]
7478: Adds tests on driver's create_node calls.

* Check that arvados_node_size tag is passed
* On EC2 driver, check that ex_spot_market=True is used when requesting
spot instances.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13407: Take keepstore-reported volume replication into account.
Tom Clegg [Mon, 11 Jun 2018 19:36:21 +0000 (15:36 -0400)]
13407: Take keepstore-reported volume replication into account.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13562-group-properties' closes #13562
Peter Amstutz [Mon, 11 Jun 2018 19:32:22 +0000 (15:32 -0400)]
Merge branch '13562-group-properties' closes #13562

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch 'master' into 13562-group-properties
Peter Amstutz [Mon, 11 Jun 2018 19:31:56 +0000 (15:31 -0400)]
Merge branch 'master' into 13562-group-properties

6 years agoMerge branch '12960-migrate-properties' closes #12960
Peter Amstutz [Mon, 11 Jun 2018 19:30:05 +0000 (15:30 -0400)]
Merge branch '12960-migrate-properties' closes #12960

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago7478: Config load fix & test updates about instance type decoupling
Lucas Di Pentima [Mon, 11 Jun 2018 16:59:31 +0000 (13:59 -0300)]
7478: Config load fix & test updates about instance type decoupling

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch 'master' into 7478-anm-spot-instances
Lucas Di Pentima [Mon, 11 Jun 2018 15:34:22 +0000 (12:34 -0300)]
Merge branch 'master' into 7478-anm-spot-instances

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago7478: Assign invalid cloud sizes to nodes with stale arvados_node_size tags
Lucas Di Pentima [Mon, 11 Jun 2018 15:10:44 +0000 (12:10 -0300)]
7478: Assign invalid cloud sizes to nodes with stale arvados_node_size tags

When retrieving the node's list from the cloud provider, if the tag
refers to a non existant arvados cloud size, assign an invalid size
and return 'down' state when asked so that it can be properly shut down.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch 'master' of git.curoverse.com:arvados into 13429-cwl-runner-storage...
Fuad Muhic [Mon, 11 Jun 2018 13:50:27 +0000 (15:50 +0200)]
Merge branch 'master' of git.curoverse.com:arvados into 13429-cwl-runner-storage-classes-support

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years ago13594: Remove table lock.
Tom Clegg [Fri, 8 Jun 2018 19:05:12 +0000 (15:05 -0400)]
13594: Remove table lock.

refs #13594

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12960: Fix test due to slightly different serialization from jsonb
Peter Amstutz [Fri, 8 Jun 2018 18:59:41 +0000 (14:59 -0400)]
12960: Fix test due to slightly different serialization from jsonb

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13562: Migration needs to update full text search index on groups
Peter Amstutz [Fri, 8 Jun 2018 18:44:26 +0000 (14:44 -0400)]
13562: Migration needs to update full text search index on groups

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12960: Update documentation.
Peter Amstutz [Fri, 8 Jun 2018 14:13:03 +0000 (10:13 -0400)]
12960: Update documentation.

Also allow "properties" to be updated on committed container
requests (bugfix implementation to match documented behavior).

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13562: Update documentation
Peter Amstutz [Fri, 8 Jun 2018 13:15:34 +0000 (09:15 -0400)]
13562: Update documentation

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13562: Add "properties" field to groups, supports subproperty query.
Peter Amstutz [Fri, 8 Jun 2018 12:59:56 +0000 (08:59 -0400)]
13562: Add "properties" field to groups, supports subproperty query.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoChange multiple storage classes error handling in cwl_runner
Fuad Muhic [Fri, 8 Jun 2018 09:05:22 +0000 (11:05 +0200)]
Change multiple storage classes error handling in cwl_runner

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years agoMerge branch '11907-acr-stable-pdh' refs #11907
Peter Amstutz [Thu, 7 Jun 2018 20:58:57 +0000 (16:58 -0400)]
Merge branch '11907-acr-stable-pdh' refs #11907

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13480-anm-tagless-azure-node'
Lucas Di Pentima [Thu, 7 Jun 2018 19:52:42 +0000 (16:52 -0300)]
Merge branch '13480-anm-tagless-azure-node'
Closes #13480

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago11907: Fix timezone handling for HTTP timestamps.
Peter Amstutz [Thu, 7 Jun 2018 19:26:36 +0000 (15:26 -0400)]
11907: Fix timezone handling for HTTP timestamps.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13427-multiple-mounts'
Tom Clegg [Thu, 7 Jun 2018 19:24:04 +0000 (15:24 -0400)]
Merge branch '13427-multiple-mounts'

refs #13427

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Build arvados-server and arvados-controller packages.
Tom Clegg [Thu, 7 Jun 2018 19:23:05 +0000 (15:23 -0400)]
13497: Build arvados-server and arvados-controller packages.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13427: More symlink hack
Tom Clegg [Wed, 6 Jun 2018 19:25:45 +0000 (15:25 -0400)]
13427: More symlink hack

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Add arvados-server command.
Tom Clegg [Thu, 7 Jun 2018 14:20:29 +0000 (10:20 -0400)]
13497: Add arvados-server command.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Use basename($0) as subcommand, if it is one.
Tom Clegg [Thu, 7 Jun 2018 13:33:20 +0000 (09:33 -0400)]
13497: Use basename($0) as subcommand, if it is one.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Add controller, proxy to Rails API.
Tom Clegg [Thu, 7 Jun 2018 04:46:47 +0000 (00:46 -0400)]
13497: Add controller, proxy to Rails API.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12960: Migrate properties fields to jsonb to support subproperty filters.
Peter Amstutz [Thu, 7 Jun 2018 18:33:03 +0000 (14:33 -0400)]
12960: Migrate properties fields to jsonb to support subproperty filters.

Specifically: links.properties and container_requests.properties,
nodes.properties, and nodes.info.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago11907: Fix tests
Peter Amstutz [Thu, 7 Jun 2018 17:13:53 +0000 (13:13 -0400)]
11907: Fix tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13330-collection-save'
Fuad Muhic [Thu, 7 Jun 2018 15:20:43 +0000 (17:20 +0200)]
Merge branch '13330-collection-save'

refs #13330

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years ago11907: Make collections containing dependencies have predictable PDHs
Peter Amstutz [Thu, 7 Jun 2018 13:54:47 +0000 (09:54 -0400)]
11907: Make collections containing dependencies have predictable PDHs

Removes optimization that tries to avoid redundant file
uploads (decided complexity tradeoff isn't worth it.)  Collections
created from local file inputs longer use block packing.

Likely to invalidate job reuse for jobs submitted by past versions of
a-c-r, but will have more stable job reuse going forward.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '11907-uploadfile-no-pack' refs #11907
Peter Amstutz [Thu, 7 Jun 2018 14:38:41 +0000 (10:38 -0400)]
Merge branch '11907-uploadfile-no-pack' refs #11907

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago11907: Add option to uploadfiles to disable packing.
Peter Amstutz [Thu, 7 Jun 2018 13:44:16 +0000 (09:44 -0400)]
11907: Add option to uploadfiles to disable packing.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoFix ciso8601 issue in collections tests.
Fuad Muhic [Thu, 7 Jun 2018 09:39:46 +0000 (11:39 +0200)]
Fix ciso8601 issue in collections tests.

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years ago13427: Use same index result N times if a device is mounted N times.
Tom Clegg [Wed, 6 Jun 2018 21:01:53 +0000 (17:01 -0400)]
13427: Use same index result N times if a device is mounted N times.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>