arvados.git
6 years agoMerge branch 'master' into 13804-no-shutdown-wanted-nodes
Peter Amstutz [Tue, 17 Jul 2018 20:55:52 +0000 (16:55 -0400)]
Merge branch 'master' into 13804-no-shutdown-wanted-nodes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13804: Update comments for comments for "consecutive_idle_count"
Peter Amstutz [Tue, 17 Jul 2018 20:53:31 +0000 (16:53 -0400)]
13804: Update comments for comments for "consecutive_idle_count"

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13804: Fix tests
Peter Amstutz [Tue, 17 Jul 2018 18:47:01 +0000 (14:47 -0400)]
13804: Fix tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13822-nm-delayed-daemon' refs #13822
Peter Amstutz [Tue, 17 Jul 2018 15:40:38 +0000 (11:40 -0400)]
Merge branch '13822-nm-delayed-daemon' refs #13822

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch 'master' into 13822-nm-delayed-daemon
Peter Amstutz [Tue, 17 Jul 2018 14:26:29 +0000 (10:26 -0400)]
Merge branch 'master' into 13822-nm-delayed-daemon

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13804: Smarter shutdown behavior WIP
Peter Amstutz [Tue, 17 Jul 2018 13:51:23 +0000 (09:51 -0400)]
13804: Smarter shutdown behavior WIP

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13804: Try to cancel pending shutdowns if nodes are needed
Peter Amstutz [Mon, 16 Jul 2018 21:19:53 +0000 (17:19 -0400)]
13804: Try to cancel pending shutdowns if nodes are needed

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13804: Node must report as "idle" two consecutive times
Peter Amstutz [Mon, 16 Jul 2018 20:05:02 +0000 (16:05 -0400)]
13804: Node must report as "idle" two consecutive times

Gives idle nodes 1 poll period to be allocated by slurm before
becoming candidates for shutdown.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13822: Don't call list_sizes() in cloud client constructor.
Peter Amstutz [Mon, 16 Jul 2018 18:54:35 +0000 (14:54 -0400)]
13822: Don't call list_sizes() in cloud client constructor.

Also make subscribe() call to SetupActor asynchronous.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13799-install-doc-sections' refs #13799
Peter Amstutz [Mon, 16 Jul 2018 13:50:27 +0000 (09:50 -0400)]
Merge branch '13799-install-doc-sections' refs #13799

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13497-controller'
Tom Clegg [Fri, 13 Jul 2018 20:31:11 +0000 (16:31 -0400)]
Merge branch '13497-controller'

refs #13497

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Merge branch 'master' into 13497-controller
Tom Clegg [Fri, 13 Jul 2018 20:30:48 +0000 (16:30 -0400)]
13497: Merge branch 'master' into 13497-controller

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Add comments on odd Nginx config. Less confusing vhost name.
Tom Clegg [Fri, 13 Jul 2018 17:24:07 +0000 (13:24 -0400)]
13497: Add comments on odd Nginx config. Less confusing vhost name.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Improve nginx logging in test suite.
Tom Clegg [Fri, 13 Jul 2018 14:51:43 +0000 (10:51 -0400)]
13497: Improve nginx logging in test suite.

Include request scheme://host:port, elapsed time, and upstream server
type.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Avoid misdirecting POST to GET when request has double slash.
Tom Clegg [Thu, 12 Jul 2018 20:50:59 +0000 (16:50 -0400)]
13497: Avoid misdirecting POST to GET when request has double slash.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Use X-Forwarded-Proto as scheme for keep-web redirect URLs.
Tom Clegg [Thu, 12 Jul 2018 20:43:37 +0000 (16:43 -0400)]
13497: Use X-Forwarded-Proto as scheme for keep-web redirect URLs.

This avoids relying on the downstream proxy to rewrite redirects.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Fix Rails redirect targets.
Tom Clegg [Thu, 12 Jul 2018 18:09:59 +0000 (14:09 -0400)]
13497: Fix Rails redirect targets.

Rails relies on the X-Forwarded-Proto request header, so we need to
set that in the test suite's Nginx config, like we do in the install
guide.

Also tidy up needlessly divergent proxy directives in Nginx test
config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13799: More install doc refactor
Peter Amstutz [Thu, 12 Jul 2018 18:18:14 +0000 (14:18 -0400)]
13799: More install doc refactor

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13799: Install doc refactor WIP
Peter Amstutz [Thu, 12 Jul 2018 15:34:56 +0000 (11:34 -0400)]
13799: Install doc refactor WIP

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13497: Fix bypassing controller in test suite after calling reset().
Tom Clegg [Thu, 12 Jul 2018 15:06:45 +0000 (11:06 -0400)]
13497: Fix bypassing controller in test suite after calling reset().

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13690-composer-install' refs #13690
Peter Amstutz [Thu, 12 Jul 2018 13:57:30 +0000 (09:57 -0400)]
Merge branch '13690-composer-install' refs #13690

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13767-reserve-ram-doc' closes #13767
Peter Amstutz [Wed, 11 Jul 2018 19:34:08 +0000 (15:34 -0400)]
Merge branch '13767-reserve-ram-doc' closes #13767

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13767: Tweak text for ReserveExtraRAM to specify default value.
Peter Amstutz [Wed, 11 Jul 2018 19:29:42 +0000 (15:29 -0400)]
13767: Tweak text for ReserveExtraRAM to specify default value.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13497: Merge branch 'master' into 13497-controller
Tom Clegg [Wed, 11 Jul 2018 19:19:55 +0000 (15:19 -0400)]
13497: Merge branch 'master' into 13497-controller

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '12983-containerd' closes #12983
Peter Amstutz [Wed, 11 Jul 2018 19:17:53 +0000 (15:17 -0400)]
Merge branch '12983-containerd' closes #12983

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12983: Change break -> return to exit goroutine, add comment
Peter Amstutz [Wed, 11 Jul 2018 19:15:38 +0000 (15:15 -0400)]
12983: Change break -> return to exit goroutine, add comment

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13780-sprockets' closes #13780
Peter Amstutz [Wed, 11 Jul 2018 17:32:03 +0000 (13:32 -0400)]
Merge branch '13780-sprockets' closes #13780

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13497: 13779: Forward Host header, and don't follow redirects.
Tom Clegg [Wed, 11 Jul 2018 13:27:12 +0000 (09:27 -0400)]
13497: 13779: Forward Host header, and don't follow redirects.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoFix: subcommand not recognized in $0 when no CLI args are given.
Tom Clegg [Wed, 11 Jul 2018 03:00:06 +0000 (23:00 -0400)]
Fix: subcommand not recognized in $0 when no CLI args are given.

refs #13779

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13690: Add Composer install documentation
Peter Amstutz [Tue, 10 Jul 2018 20:16:44 +0000 (16:16 -0400)]
13690: Add Composer install documentation

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13780: Update sprockets gem
Peter Amstutz [Tue, 10 Jul 2018 19:04:28 +0000 (15:04 -0400)]
13780: Update sprockets gem

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13501-subprocess32'
Lucas Di Pentima [Tue, 10 Jul 2018 18:50:27 +0000 (15:50 -0300)]
Merge branch '13501-subprocess32'
Closes #13501

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '13668-api-wb-package-version'
Lucas Di Pentima [Tue, 10 Jul 2018 18:31:50 +0000 (15:31 -0300)]
Merge branch '13668-api-wb-package-version'
Closes #13668

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12983: Tweak error regex
Peter Amstutz [Tue, 10 Jul 2018 18:31:28 +0000 (14:31 -0400)]
12983: Tweak error regex

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12983: Add another error message to the "broken node" blacklist.
Peter Amstutz [Tue, 10 Jul 2018 18:27:38 +0000 (14:27 -0400)]
12983: Add another error message to the "broken node" blacklist.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12983: Command line option takes duration. Add tests.
Peter Amstutz [Tue, 10 Jul 2018 18:12:32 +0000 (14:12 -0400)]
12983: Command line option takes duration.  Add tests.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13668: Updates VersionHelper on workbench to read packageVersion key
Lucas Di Pentima [Tue, 10 Jul 2018 17:58:38 +0000 (14:58 -0300)]
13668: Updates VersionHelper on workbench to read packageVersion key

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13668: Replaced package_version with packageVersion on discovery doc.
Lucas Di Pentima [Tue, 10 Jul 2018 17:47:52 +0000 (14:47 -0300)]
13668: Replaced package_version with packageVersion on discovery doc.

Also, enhanced package version caching on api server & workbench.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12983: Periodically check for containerd
Peter Amstutz [Tue, 10 Jul 2018 13:49:17 +0000 (09:49 -0400)]
12983: Periodically check for containerd

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13330-cwl-intermediate-collections-cleanup'
Fuad Muhic [Tue, 10 Jul 2018 14:20:09 +0000 (16:20 +0200)]
Merge branch '13330-cwl-intermediate-collections-cleanup'

closes #13330

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years agoMerge branch 'master' of git.curoverse.com:arvados into 13330-cwl-intermediate-collec...
Fuad Muhic [Tue, 10 Jul 2018 10:48:03 +0000 (12:48 +0200)]
Merge branch 'master' of git.curoverse.com:arvados into 13330-cwl-intermediate-collections-cleanup

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years agoUpdate get_intermediate_collection_info and add owner_uuid to save_new
Fuad Muhic [Tue, 10 Jul 2018 10:33:43 +0000 (12:33 +0200)]
Update get_intermediate_collection_info and add owner_uuid to save_new
method in arvcontainer.py and arvjob.py

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years ago13668: Adds package version to workbench. Reports versions on dialog.
Lucas Di Pentima [Mon, 9 Jul 2018 21:01:19 +0000 (18:01 -0300)]
13668: Adds package version to workbench. Reports versions on dialog.

API & Workbench package versions are displayed on the 'Show version' &
'Report problem' dialogs.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13668: Adds support for package version on API server.
Lucas Di Pentima [Mon, 9 Jul 2018 20:24:56 +0000 (17:24 -0300)]
13668: Adds support for package version on API server.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13501: Adds subprocess32 install dependency on python-client for keepdocker.
Lucas Di Pentima [Mon, 9 Jul 2018 18:33:37 +0000 (15:33 -0300)]
13501: Adds subprocess32 install dependency on python-client for keepdocker.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13501: Replaces subprocess with subprocess32 on keepdocker.
Lucas Di Pentima [Mon, 9 Jul 2018 18:09:34 +0000 (15:09 -0300)]
13501: Replaces subprocess with subprocess32 on keepdocker.

Reverted subprocess32 usage on arvados_version.py files so that package
building scripts don't break.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13501: Replaces subprocess with subprocess32 on arvados-cwl-runner
Lucas Di Pentima [Mon, 9 Jul 2018 17:05:22 +0000 (14:05 -0300)]
13501: Replaces subprocess with subprocess32 on arvados-cwl-runner

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '13766-libyaml-workaround' refs #13766
Peter Amstutz [Mon, 9 Jul 2018 16:41:24 +0000 (12:41 -0400)]
Merge branch '13766-libyaml-workaround' refs #13766

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13767: Update crunch-dispatch-slurm install docs
Peter Amstutz [Mon, 9 Jul 2018 14:11:38 +0000 (10:11 -0400)]
13767: Update crunch-dispatch-slurm install docs

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoRemove _get_intermediate_collection_info method and create function
Fuad Muhic [Mon, 9 Jul 2018 13:08:59 +0000 (15:08 +0200)]
Remove _get_intermediate_collection_info method and create function
with same name

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years agoMerge branch '13681-wb-acr-submit-ram' closes #13681
Peter Amstutz [Mon, 9 Jul 2018 12:48:16 +0000 (08:48 -0400)]
Merge branch '13681-wb-acr-submit-ram' closes #13681

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13681: Fix workbench for workflows that don't have "hints"
Peter Amstutz [Fri, 6 Jul 2018 19:41:46 +0000 (15:41 -0400)]
13681: Fix workbench for workflows that don't have "hints"

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13681: Revert to yaml.round_trip_dump instead of json.dumps().
Peter Amstutz [Fri, 6 Jul 2018 17:48:34 +0000 (13:48 -0400)]
13681: Revert to yaml.round_trip_dump instead of json.dumps().

Also style tweaks.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13681: Add new test file
Peter Amstutz [Thu, 5 Jul 2018 20:28:13 +0000 (16:28 -0400)]
13681: Add new test file

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13681: Update documentation for arv:WorkflowRunnerResources
Peter Amstutz [Thu, 5 Jul 2018 19:15:16 +0000 (15:15 -0400)]
13681:  Update documentation for arv:WorkflowRunnerResources

Also bring default allocation for cwl-runner launched by workbench in
line with a-c-r command line (1 GiB / 1 core).

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13681: Can use --submit-runner-ram with --create/update-workflow
Peter Amstutz [Thu, 5 Jul 2018 19:03:41 +0000 (15:03 -0400)]
13681: Can use --submit-runner-ram with --create/update-workflow

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13681: Implement WorkflowRunnerResources hint
Peter Amstutz [Thu, 5 Jul 2018 18:39:13 +0000 (14:39 -0400)]
13681: Implement WorkflowRunnerResources hint

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13766: upload_workflow dumps to json
Peter Amstutz [Fri, 6 Jul 2018 22:12:29 +0000 (18:12 -0400)]
13766: upload_workflow dumps to json

Workaround for incompatibility between Python ruamel.yaml and Ruby
Psych/libyaml over ":" appearing in unquoted strings in "flow style"

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13501: Replaces subprocess module with subprocess32 on nodemanager.
Lucas Di Pentima [Fri, 6 Jul 2018 20:04:19 +0000 (17:04 -0300)]
13501: Replaces subprocess module with subprocess32 on nodemanager.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '13692-acr-error' closes #13692
Peter Amstutz [Fri, 6 Jul 2018 14:39:49 +0000 (10:39 -0400)]
Merge branch '13692-acr-error' closes #13692

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoFix "order" param docs for groups#contents.
Tom Clegg [Thu, 5 Jul 2018 21:25:43 +0000 (17:25 -0400)]
Fix "order" param docs for groups#contents.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13692: Make Python SDK error reporting more user friendly.
Peter Amstutz [Thu, 5 Jul 2018 21:03:11 +0000 (17:03 -0400)]
13692: Make Python SDK error reporting more user friendly.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13219-arv-cwl-schema-fix'
Lucas Di Pentima [Thu, 5 Jul 2018 19:31:46 +0000 (16:31 -0300)]
Merge branch '13219-arv-cwl-schema-fix'
Refs #13219

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13219: Adds documentation
Lucas Di Pentima [Thu, 5 Jul 2018 17:32:46 +0000 (14:32 -0300)]
13219: Adds documentation

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch 'master' of git.curoverse.com:arvados into 13330-cwl-intermediate-collec...
Fuad Muhic [Thu, 5 Jul 2018 15:36:24 +0000 (17:36 +0200)]
Merge branch 'master' of git.curoverse.com:arvados into 13330-cwl-intermediate-collections-cleanup

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years agoRemove trailig white-space
Fuad Muhic [Thu, 5 Jul 2018 15:20:51 +0000 (17:20 +0200)]
Remove trailig white-space

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years ago13219: Adds TimeLimit support on Arvados CWL schema.
Lucas Di Pentima [Tue, 3 Jul 2018 19:37:39 +0000 (16:37 -0300)]
13219: Adds TimeLimit support on Arvados CWL schema.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '13613-document-min-r-version'
Fuad Muhic [Tue, 3 Jul 2018 15:17:33 +0000 (17:17 +0200)]
Merge branch '13613-document-min-r-version'

closes #13613

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years agoMerge branch '13547-respect-insecure-flag-when-talking-ssl-to-keep'
Ward Vandewege [Tue, 3 Jul 2018 11:18:09 +0000 (07:18 -0400)]
Merge branch '13547-respect-insecure-flag-when-talking-ssl-to-keep'

closes #13547

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoFix startup warning by setting log_level explicitly.
Tom Clegg [Mon, 2 Jul 2018 19:47:29 +0000 (15:47 -0400)]
Fix startup warning by setting log_level explicitly.

fixes #11594

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13219-jobs-time-limit'
Lucas Di Pentima [Mon, 2 Jul 2018 18:12:32 +0000 (15:12 -0300)]
Merge branch '13219-jobs-time-limit'
Closes #13219

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13219: Simplifies test
Lucas Di Pentima [Mon, 2 Jul 2018 18:10:27 +0000 (15:10 -0300)]
13219: Simplifies test

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13219: Adds TimeLimit support on arvados-cwl-runner
Lucas Di Pentima [Mon, 2 Jul 2018 17:03:43 +0000 (14:03 -0300)]
13219: Adds TimeLimit support on arvados-cwl-runner

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoAdd tests for intermediate collections
Fuad Muhic [Mon, 2 Jul 2018 16:38:19 +0000 (18:38 +0200)]
Add tests for intermediate collections

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years agoFix crash in error handler.
Tom Clegg [Mon, 2 Jul 2018 15:16:19 +0000 (11:16 -0400)]
Fix crash in error handler.

fatal: ambiguous argument 'c97qk-8i9sb-nmca4v1scg9910o': unknown revision or path not in the working tree.
Use '--' to separate paths from revisions, like this:
'git <command> [<revision>...] -- [<file>...]'
bundler: failed to load command: ./script/crunch-dispatch.rb (./script/crunch-dispatch.rb)
NameError: undefined local variable or method `job' for #<CrunchDispatch:0x000000000534bdb8>
  /var/www/arvados-api/current/lib/crunch_dispatch.rb:321:in `tag_commit'

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13547: Test insecure-tls flag passed through to pycurl.
Tom Clegg [Mon, 2 Jul 2018 15:10:20 +0000 (11:10 -0400)]
13547: Test insecure-tls flag passed through to pycurl.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13547: Merge branch 'master' into 13547-respect-insecure-flag-when-talking-ssl-to...
Tom Clegg [Fri, 29 Jun 2018 20:48:33 +0000 (16:48 -0400)]
13547: Merge branch 'master' into 13547-respect-insecure-flag-when-talking-ssl-to-keep

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13569-size-prefixes'
Tom Clegg [Fri, 29 Jun 2018 20:46:45 +0000 (16:46 -0400)]
Merge branch '13569-size-prefixes'

closes #13569

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13569: Accept all JSON numbers (decimals, exponents), not just ints.
Tom Clegg [Fri, 29 Jun 2018 20:21:52 +0000 (16:21 -0400)]
13569: Accept all JSON numbers (decimals, exponents), not just ints.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13547: Avoid leaking insecure flag between different configs.
Tom Clegg [Fri, 29 Jun 2018 19:40:22 +0000 (15:40 -0400)]
13547: Avoid leaking insecure flag between different configs.

Even if the default configuration file/environment indicates a local
cluster that doesn't need verification, a program like arv-copy can
also connect to a remote cluster using a settings/config file that has
verification enabled. In this case, TLS verification should be
enabled.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13547: Fix up formatting.
Tom Clegg [Fri, 29 Jun 2018 18:52:48 +0000 (14:52 -0400)]
13547: Fix up formatting.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13569: Update dispatchcloud to use arvados.ByteSize.
Tom Clegg [Fri, 29 Jun 2018 16:50:22 +0000 (12:50 -0400)]
13569: Update dispatchcloud to use arvados.ByteSize.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13569: Accept metric/binary-prefixed units in RAM/scratch configs.
Tom Clegg [Thu, 28 Jun 2018 21:30:35 +0000 (17:30 -0400)]
13569: Accept metric/binary-prefixed units in RAM/scratch configs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13674: Don't build heavy error unless needed.
Tom Clegg [Fri, 22 Jun 2018 18:16:05 +0000 (14:16 -0400)]
13674: Don't build heavy error unless needed.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13674: Change InstanceTypes config from array to hash.
Tom Clegg [Wed, 20 Jun 2018 19:25:29 +0000 (15:25 -0400)]
13674: Change InstanceTypes config from array to hash.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13219: Moves time out code from dispatch to crunch-run
Lucas Di Pentima [Wed, 27 Jun 2018 20:43:58 +0000 (17:43 -0300)]
13219: Moves time out code from dispatch to crunch-run

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13219: Removes unnecessary default max_run_time scheduling parameter
Lucas Di Pentima [Wed, 27 Jun 2018 18:30:05 +0000 (15:30 -0300)]
13219: Removes unnecessary default max_run_time scheduling parameter

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '13649-spot-instances-doc'
Lucas Di Pentima [Wed, 27 Jun 2018 17:48:14 +0000 (14:48 -0300)]
Merge branch '13649-spot-instances-doc'
Refs #13649

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13649: Fixes in wording
Lucas Di Pentima [Wed, 27 Jun 2018 17:47:14 +0000 (14:47 -0300)]
13649: Fixes in wording

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13219: Checks for expired run time and cancel container if needed.
Lucas Di Pentima [Wed, 27 Jun 2018 13:16:23 +0000 (10:16 -0300)]
13219: Checks for expired run time and cancel container if needed.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13219: Adds default max_run_time value with validation, documentation and tests.
Lucas Di Pentima [Tue, 26 Jun 2018 17:12:03 +0000 (14:12 -0300)]
13219: Adds default max_run_time value with validation, documentation and tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMinikube is not supported yet by our Arvados on Kubernetes Helm Chart.
Ward Vandewege [Tue, 26 Jun 2018 15:43:10 +0000 (11:43 -0400)]
Minikube is not supported yet by our Arvados on Kubernetes Helm Chart.

refs #13650

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago13650: Merge branch '13650-document-arvados-kubernetes'
Ward Vandewege [Mon, 25 Jun 2018 20:53:17 +0000 (16:53 -0400)]
13650: Merge branch '13650-document-arvados-kubernetes'

refs #13650

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoFurther doc improvements for Arvados on Kubernetes.
Ward Vandewege [Mon, 25 Jun 2018 20:52:33 +0000 (16:52 -0400)]
Further doc improvements for Arvados on Kubernetes.

refs #13650

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago13649: Adds admin documentation describing how to set up spot instances.
Lucas Di Pentima [Mon, 25 Jun 2018 20:46:40 +0000 (17:46 -0300)]
13649: Adds admin documentation describing how to set up spot instances.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13650: Merge branch '13650-document-arvados-kubernetes'
Ward Vandewege [Mon, 25 Jun 2018 19:11:27 +0000 (15:11 -0400)]
13650: Merge branch '13650-document-arvados-kubernetes'

refs #13650

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago13650: Merge branch 'master' into 13650-document-arvados-kubernetes
Ward Vandewege [Mon, 25 Jun 2018 19:10:32 +0000 (15:10 -0400)]
13650: Merge branch 'master' into 13650-document-arvados-kubernetes

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago13650: Merge branch 'master' into 13650-document-arvados-kubernetes
Ward Vandewege [Mon, 25 Jun 2018 19:01:18 +0000 (15:01 -0400)]
13650: Merge branch 'master' into 13650-document-arvados-kubernetes

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoA series of documentation improvements based on review feedback.
Ward Vandewege [Mon, 25 Jun 2018 18:56:44 +0000 (14:56 -0400)]
A series of documentation improvements based on review feedback.

refs #13650

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoAdd basic documentation for the new Arvados on Kubernetes install option.
Ward Vandewege [Thu, 21 Jun 2018 18:44:40 +0000 (14:44 -0400)]
Add basic documentation for the new Arvados on Kubernetes install option.

refs #13650

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>