arvados.git
6 years agoMerge branch '13219-arv-cwl-schema-fix'
Lucas Di Pentima [Thu, 5 Jul 2018 19:31:46 +0000 (16:31 -0300)]
Merge branch '13219-arv-cwl-schema-fix'
Refs #13219

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13219: Adds documentation
Lucas Di Pentima [Thu, 5 Jul 2018 17:32:46 +0000 (14:32 -0300)]
13219: Adds documentation

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch 'master' of git.curoverse.com:arvados into 13330-cwl-intermediate-collec...
Fuad Muhic [Thu, 5 Jul 2018 15:36:24 +0000 (17:36 +0200)]
Merge branch 'master' of git.curoverse.com:arvados into 13330-cwl-intermediate-collections-cleanup

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years agoRemove trailig white-space
Fuad Muhic [Thu, 5 Jul 2018 15:20:51 +0000 (17:20 +0200)]
Remove trailig white-space

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years ago13219: Adds TimeLimit support on Arvados CWL schema.
Lucas Di Pentima [Tue, 3 Jul 2018 19:37:39 +0000 (16:37 -0300)]
13219: Adds TimeLimit support on Arvados CWL schema.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '13613-document-min-r-version'
Fuad Muhic [Tue, 3 Jul 2018 15:17:33 +0000 (17:17 +0200)]
Merge branch '13613-document-min-r-version'

closes #13613

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years agoMerge branch '13547-respect-insecure-flag-when-talking-ssl-to-keep'
Ward Vandewege [Tue, 3 Jul 2018 11:18:09 +0000 (07:18 -0400)]
Merge branch '13547-respect-insecure-flag-when-talking-ssl-to-keep'

closes #13547

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoFix startup warning by setting log_level explicitly.
Tom Clegg [Mon, 2 Jul 2018 19:47:29 +0000 (15:47 -0400)]
Fix startup warning by setting log_level explicitly.

fixes #11594

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13219-jobs-time-limit'
Lucas Di Pentima [Mon, 2 Jul 2018 18:12:32 +0000 (15:12 -0300)]
Merge branch '13219-jobs-time-limit'
Closes #13219

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13219: Simplifies test
Lucas Di Pentima [Mon, 2 Jul 2018 18:10:27 +0000 (15:10 -0300)]
13219: Simplifies test

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13219: Adds TimeLimit support on arvados-cwl-runner
Lucas Di Pentima [Mon, 2 Jul 2018 17:03:43 +0000 (14:03 -0300)]
13219: Adds TimeLimit support on arvados-cwl-runner

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoAdd tests for intermediate collections
Fuad Muhic [Mon, 2 Jul 2018 16:38:19 +0000 (18:38 +0200)]
Add tests for intermediate collections

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years agoFix crash in error handler.
Tom Clegg [Mon, 2 Jul 2018 15:16:19 +0000 (11:16 -0400)]
Fix crash in error handler.

fatal: ambiguous argument 'c97qk-8i9sb-nmca4v1scg9910o': unknown revision or path not in the working tree.
Use '--' to separate paths from revisions, like this:
'git <command> [<revision>...] -- [<file>...]'
bundler: failed to load command: ./script/crunch-dispatch.rb (./script/crunch-dispatch.rb)
NameError: undefined local variable or method `job' for #<CrunchDispatch:0x000000000534bdb8>
  /var/www/arvados-api/current/lib/crunch_dispatch.rb:321:in `tag_commit'

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13547: Test insecure-tls flag passed through to pycurl.
Tom Clegg [Mon, 2 Jul 2018 15:10:20 +0000 (11:10 -0400)]
13547: Test insecure-tls flag passed through to pycurl.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13547: Merge branch 'master' into 13547-respect-insecure-flag-when-talking-ssl-to...
Tom Clegg [Fri, 29 Jun 2018 20:48:33 +0000 (16:48 -0400)]
13547: Merge branch 'master' into 13547-respect-insecure-flag-when-talking-ssl-to-keep

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13569-size-prefixes'
Tom Clegg [Fri, 29 Jun 2018 20:46:45 +0000 (16:46 -0400)]
Merge branch '13569-size-prefixes'

closes #13569

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13569: Accept all JSON numbers (decimals, exponents), not just ints.
Tom Clegg [Fri, 29 Jun 2018 20:21:52 +0000 (16:21 -0400)]
13569: Accept all JSON numbers (decimals, exponents), not just ints.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13547: Avoid leaking insecure flag between different configs.
Tom Clegg [Fri, 29 Jun 2018 19:40:22 +0000 (15:40 -0400)]
13547: Avoid leaking insecure flag between different configs.

Even if the default configuration file/environment indicates a local
cluster that doesn't need verification, a program like arv-copy can
also connect to a remote cluster using a settings/config file that has
verification enabled. In this case, TLS verification should be
enabled.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13547: Fix up formatting.
Tom Clegg [Fri, 29 Jun 2018 18:52:48 +0000 (14:52 -0400)]
13547: Fix up formatting.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13569: Update dispatchcloud to use arvados.ByteSize.
Tom Clegg [Fri, 29 Jun 2018 16:50:22 +0000 (12:50 -0400)]
13569: Update dispatchcloud to use arvados.ByteSize.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13569: Accept metric/binary-prefixed units in RAM/scratch configs.
Tom Clegg [Thu, 28 Jun 2018 21:30:35 +0000 (17:30 -0400)]
13569: Accept metric/binary-prefixed units in RAM/scratch configs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13674: Don't build heavy error unless needed.
Tom Clegg [Fri, 22 Jun 2018 18:16:05 +0000 (14:16 -0400)]
13674: Don't build heavy error unless needed.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13674: Change InstanceTypes config from array to hash.
Tom Clegg [Wed, 20 Jun 2018 19:25:29 +0000 (15:25 -0400)]
13674: Change InstanceTypes config from array to hash.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13219: Moves time out code from dispatch to crunch-run
Lucas Di Pentima [Wed, 27 Jun 2018 20:43:58 +0000 (17:43 -0300)]
13219: Moves time out code from dispatch to crunch-run

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13219: Removes unnecessary default max_run_time scheduling parameter
Lucas Di Pentima [Wed, 27 Jun 2018 18:30:05 +0000 (15:30 -0300)]
13219: Removes unnecessary default max_run_time scheduling parameter

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '13649-spot-instances-doc'
Lucas Di Pentima [Wed, 27 Jun 2018 17:48:14 +0000 (14:48 -0300)]
Merge branch '13649-spot-instances-doc'
Refs #13649

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13649: Fixes in wording
Lucas Di Pentima [Wed, 27 Jun 2018 17:47:14 +0000 (14:47 -0300)]
13649: Fixes in wording

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13219: Checks for expired run time and cancel container if needed.
Lucas Di Pentima [Wed, 27 Jun 2018 13:16:23 +0000 (10:16 -0300)]
13219: Checks for expired run time and cancel container if needed.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agogetConnection now works correctly when ARVADOS_API_HOST_INSECURE is set to TRUE
Fuad Muhic [Wed, 27 Jun 2018 12:10:54 +0000 (14:10 +0200)]
getConnection now works correctly when ARVADOS_API_HOST_INSECURE is set to TRUE

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years ago13219: Adds default max_run_time value with validation, documentation and tests.
Lucas Di Pentima [Tue, 26 Jun 2018 17:12:03 +0000 (14:12 -0300)]
13219: Adds default max_run_time value with validation, documentation and tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMinikube is not supported yet by our Arvados on Kubernetes Helm Chart.
Ward Vandewege [Tue, 26 Jun 2018 15:43:10 +0000 (11:43 -0400)]
Minikube is not supported yet by our Arvados on Kubernetes Helm Chart.

refs #13650

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago13650: Merge branch '13650-document-arvados-kubernetes'
Ward Vandewege [Mon, 25 Jun 2018 20:53:17 +0000 (16:53 -0400)]
13650: Merge branch '13650-document-arvados-kubernetes'

refs #13650

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoFurther doc improvements for Arvados on Kubernetes.
Ward Vandewege [Mon, 25 Jun 2018 20:52:33 +0000 (16:52 -0400)]
Further doc improvements for Arvados on Kubernetes.

refs #13650

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago13649: Adds admin documentation describing how to set up spot instances.
Lucas Di Pentima [Mon, 25 Jun 2018 20:46:40 +0000 (17:46 -0300)]
13649: Adds admin documentation describing how to set up spot instances.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13650: Merge branch '13650-document-arvados-kubernetes'
Ward Vandewege [Mon, 25 Jun 2018 19:11:27 +0000 (15:11 -0400)]
13650: Merge branch '13650-document-arvados-kubernetes'

refs #13650

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago13650: Merge branch 'master' into 13650-document-arvados-kubernetes
Ward Vandewege [Mon, 25 Jun 2018 19:10:32 +0000 (15:10 -0400)]
13650: Merge branch 'master' into 13650-document-arvados-kubernetes

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago13650: Merge branch 'master' into 13650-document-arvados-kubernetes
Ward Vandewege [Mon, 25 Jun 2018 19:01:18 +0000 (15:01 -0400)]
13650: Merge branch 'master' into 13650-document-arvados-kubernetes

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoA series of documentation improvements based on review feedback.
Ward Vandewege [Mon, 25 Jun 2018 18:56:44 +0000 (14:56 -0400)]
A series of documentation improvements based on review feedback.

refs #13650

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoAdd basic documentation for the new Arvados on Kubernetes install option.
Ward Vandewege [Thu, 21 Jun 2018 18:44:40 +0000 (14:44 -0400)]
Add basic documentation for the new Arvados on Kubernetes install option.

refs #13650

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago13627: Make sure work_api is set on runtimeContext.
Peter Amstutz [Wed, 20 Jun 2018 17:19:47 +0000 (13:19 -0400)]
13627: Make sure work_api is set on runtimeContext.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13164: Fix priority of containers that have priority=0 due to races.
Tom Clegg [Mon, 18 Jun 2018 14:40:26 +0000 (10:40 -0400)]
13164: Fix priority of containers that have priority=0 due to races.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago7478: Replaces term 'preemptable' with 'preemptible'
Lucas Di Pentima [Tue, 19 Jun 2018 17:02:07 +0000 (14:02 -0300)]
7478: Replaces term 'preemptable' with 'preemptible'

Also added config & documentation on EC2 example config file.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoAdd mypy-extensions to build.list refs #13627
Peter Amstutz [Tue, 19 Jun 2018 20:29:25 +0000 (16:29 -0400)]
Add mypy-extensions to build.list refs #13627

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13255-account-activation' closes #13255
Peter Amstutz [Mon, 25 Jun 2018 15:11:04 +0000 (11:11 -0400)]
Merge branch '13255-account-activation' closes #13255

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch 'master' into 13255-account-activation
Peter Amstutz [Fri, 22 Jun 2018 20:20:42 +0000 (16:20 -0400)]
Merge branch 'master' into 13255-account-activation

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13255: Add documentation & test that remote users can be pre-activated.
Peter Amstutz [Fri, 22 Jun 2018 20:16:03 +0000 (16:16 -0400)]
13255: Add documentation & test that remote users can be pre-activated.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoEnsure $WORKSPACE/tmp/ exists. Fix unchecked error.
Tom Clegg [Fri, 22 Jun 2018 17:47:37 +0000 (13:47 -0400)]
Ensure $WORKSPACE/tmp/ exists. Fix unchecked error.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13649-preemptible-committed-child-cr'
Lucas Di Pentima [Fri, 22 Jun 2018 17:41:22 +0000 (14:41 -0300)]
Merge branch '13649-preemptible-committed-child-cr'
Refs #13649

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13649: Merges 2 tests into one.
Lucas Di Pentima [Fri, 22 Jun 2018 17:38:43 +0000 (14:38 -0300)]
13649: Merges 2 tests into one.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13255: Doc format tweaks
Peter Amstutz [Fri, 22 Jun 2018 15:41:50 +0000 (11:41 -0400)]
13255: Doc format tweaks

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13649: Fixes default preemptible parameter when submitting committed child CRs
Lucas Di Pentima [Tue, 19 Jun 2018 22:47:21 +0000 (19:47 -0300)]
13649: Fixes default preemptible parameter when submitting committed child CRs

Two problems fixed:
1) When submitting a committed child CR, its preemptible parameter is set.
2) Resolve a container for said child CR after the preemptible parameter setting.

Added tests for committed child CR submissions.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13255: Add test for auto_activate_users_from
Peter Amstutz [Fri, 22 Jun 2018 02:41:31 +0000 (22:41 -0400)]
13255: Add test for auto_activate_users_from

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13255: Implement auto_activate_users_from
Peter Amstutz [Thu, 21 Jun 2018 20:21:10 +0000 (16:21 -0400)]
13255: Implement auto_activate_users_from

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13255: More discussion of federated users in account activation
Peter Amstutz [Thu, 21 Jun 2018 19:48:28 +0000 (15:48 -0400)]
13255: More discussion of federated users in account activation

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13255: Edits
Peter Amstutz [Thu, 21 Jun 2018 17:50:59 +0000 (13:50 -0400)]
13255: Edits

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13255: Account activate docs wip
Peter Amstutz [Thu, 21 Jun 2018 16:58:25 +0000 (12:58 -0400)]
13255: Account activate docs wip

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoUpdate README to document min R version required for ArvadosR
Fuad Muhic [Thu, 21 Jun 2018 15:15:52 +0000 (17:15 +0200)]
Update README to document min R version required for ArvadosR

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years agoAdd runtime check for min R version.
Fuad Muhic [Thu, 21 Jun 2018 14:56:19 +0000 (16:56 +0200)]
Add runtime check for min R version.

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years agoMerge branch '13627-set-work-api' refs #13627
Peter Amstutz [Wed, 20 Jun 2018 17:51:10 +0000 (13:51 -0400)]
Merge branch '13627-set-work-api' refs #13627

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13627: Make sure work_api is set on runtimeContext.
Peter Amstutz [Wed, 20 Jun 2018 17:19:47 +0000 (13:19 -0400)]
13627: Make sure work_api is set on runtimeContext.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13164-fix-zero-priority-after-race'
Tom Clegg [Wed, 20 Jun 2018 13:25:25 +0000 (09:25 -0400)]
Merge branch '13164-fix-zero-priority-after-race'

refs #13164

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '7478-s-preemptable-preemptible'
Lucas Di Pentima [Tue, 19 Jun 2018 21:21:57 +0000 (18:21 -0300)]
Merge branch '7478-s-preemptable-preemptible'
Refs #7478

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoAdd mypy-extensions to build.list refs #13627
Peter Amstutz [Tue, 19 Jun 2018 20:29:25 +0000 (16:29 -0400)]
Add mypy-extensions to build.list refs #13627

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13638-acr-version' refs #13638
Peter Amstutz [Tue, 19 Jun 2018 20:16:32 +0000 (16:16 -0400)]
Merge branch '13638-acr-version' refs #13638

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13638: Restore logic of arvados-cwl-runner version is max(sdk, acr)
Peter Amstutz [Tue, 19 Jun 2018 19:53:02 +0000 (15:53 -0400)]
13638: Restore logic of arvados-cwl-runner version is max(sdk, acr)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13627-update-cwltool' refs #13627
Peter Amstutz [Tue, 19 Jun 2018 19:21:11 +0000 (15:21 -0400)]
Merge branch '13627-update-cwltool' refs #13627

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch 'master' into 7478-s-preemptable-preemptible
Lucas Di Pentima [Tue, 19 Jun 2018 18:31:24 +0000 (15:31 -0300)]
Merge branch 'master' into 7478-s-preemptable-preemptible

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '13497-controller'
Tom Clegg [Tue, 19 Jun 2018 17:45:03 +0000 (13:45 -0400)]
Merge branch '13497-controller'

refs #13497

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13627: Tweak test to possibly avoid name clash
Peter Amstutz [Tue, 19 Jun 2018 17:44:45 +0000 (13:44 -0400)]
13627: Tweak test to possibly avoid name clash

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13497: Ensure every test run produces something in tmp/*.log.
Tom Clegg [Tue, 19 Jun 2018 17:43:16 +0000 (13:43 -0400)]
13497: Ensure every test run produces something in tmp/*.log.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago7478: Replaces term 'preemptable' with 'preemptible'
Lucas Di Pentima [Tue, 19 Jun 2018 17:02:07 +0000 (14:02 -0300)]
7478: Replaces term 'preemptable' with 'preemptible'

Also added config & documentation on EC2 example config file.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13497: Merge branch 'master' into 13497-controller
Tom Clegg [Tue, 19 Jun 2018 16:31:08 +0000 (12:31 -0400)]
13497: Merge branch 'master' into 13497-controller

refs #13497

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13579-keepstore-config-doc' refs #13579 refs #13580
Peter Amstutz [Mon, 18 Jun 2018 19:27:23 +0000 (15:27 -0400)]
Merge branch '13579-keepstore-config-doc' refs #13579 refs #13580

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13627: Fix tests after rebase
Peter Amstutz [Mon, 18 Jun 2018 19:22:42 +0000 (15:22 -0400)]
13627: Fix tests after rebase

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13627: Fix ArvadosWorkflow use of Builder
Peter Amstutz [Fri, 15 Jun 2018 20:58:50 +0000 (16:58 -0400)]
13627: Fix ArvadosWorkflow use of Builder

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13627: Fix crunch_script
Peter Amstutz [Fri, 15 Jun 2018 14:59:24 +0000 (10:59 -0400)]
13627: Fix crunch_script

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13627: Add missing file.
Peter Amstutz [Fri, 15 Jun 2018 14:49:45 +0000 (10:49 -0400)]
13627: Add missing file.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13627: Improve error reporting.
Peter Amstutz [Fri, 15 Jun 2018 14:40:43 +0000 (10:40 -0400)]
13627: Improve error reporting.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13627: Fix loadingContext used for reloading document.
Peter Amstutz [Fri, 15 Jun 2018 14:11:01 +0000 (10:11 -0400)]
13627: Fix loadingContext used for reloading document.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13627: a-c-r migration to cwltool loading/runtimeContext API
Peter Amstutz [Fri, 15 Jun 2018 02:38:57 +0000 (22:38 -0400)]
13627: a-c-r migration to cwltool loading/runtimeContext API

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoAPI fixup
Peter Amstutz [Thu, 14 Jun 2018 21:56:13 +0000 (17:56 -0400)]
API fixup

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13580: Add arvados-cwl-runner to storage class usage docs.
Peter Amstutz [Mon, 18 Jun 2018 18:36:33 +0000 (14:36 -0400)]
13580: Add arvados-cwl-runner to storage class usage docs.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13580: Add storage classes section to user guide
Peter Amstutz [Mon, 18 Jun 2018 14:54:05 +0000 (10:54 -0400)]
13580: Add storage classes section to user guide

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13429-cwl-runner-storage-classes-support'
Fuad Muhic [Mon, 18 Jun 2018 14:47:23 +0000 (16:47 +0200)]
Merge branch '13429-cwl-runner-storage-classes-support'

closes #13429

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years ago13164: Fix priority of containers that have priority=0 due to races.
Tom Clegg [Mon, 18 Jun 2018 14:40:26 +0000 (10:40 -0400)]
13164: Fix priority of containers that have priority=0 due to races.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoUpdate intermediate collection name, properties and trash_at atrribute
Fuad Muhic [Mon, 18 Jun 2018 14:37:42 +0000 (16:37 +0200)]
Update intermediate collection name, properties and trash_at atrribute

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years ago13579: Add a little more introductory material on allocating resources
Peter Amstutz [Mon, 18 Jun 2018 14:28:15 +0000 (10:28 -0400)]
13579: Add a little more introductory material on allocating resources
for keepstore

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13330-intermediates-test' of git.curoverse.com:arvados into 13330-cwl...
Fuad Muhic [Mon, 18 Jun 2018 12:20:21 +0000 (14:20 +0200)]
Merge branch '13330-intermediates-test' of git.curoverse.com:arvados into 13330-cwl-intermediate-collections-cleanup

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years agoMerge branch 'master' of git.curoverse.com:arvados into 13429-cwl-runner-storage...
Fuad Muhic [Mon, 18 Jun 2018 09:03:33 +0000 (11:03 +0200)]
Merge branch 'master' of git.curoverse.com:arvados into 13429-cwl-runner-storage-classes-support

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years agoAdd storage_classes tests for arvados_cwl_runner
Fuad Muhic [Mon, 18 Jun 2018 08:58:33 +0000 (10:58 +0200)]
Add storage_classes tests for arvados_cwl_runner

Arvados-DCO-1.1-Signed-off-by: Fuad Muhic <fmuhic@capeannenterprises.com>

6 years ago13497: Merge branch 'master' into 13497-controller
Tom Clegg [Fri, 15 Jun 2018 20:18:09 +0000 (16:18 -0400)]
13497: Merge branch 'master' into 13497-controller

refs #13497

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13581-cr-not-satisfiable-report'
Lucas Di Pentima [Fri, 15 Jun 2018 19:58:29 +0000 (16:58 -0300)]
Merge branch '13581-cr-not-satisfiable-report'
Closes #13581

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13497: Load env vars from /etc/arvados/environment in controller.
Tom Clegg [Fri, 15 Jun 2018 19:41:51 +0000 (15:41 -0400)]
13497: Load env vars from /etc/arvados/environment in controller.

Facilitates setting node profile via ARVADOS_NODE_PROFILE environment
var without editing the systemd unit file.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Rename SystemNodes to NodeProfiles in config.
Tom Clegg [Fri, 15 Jun 2018 19:26:24 +0000 (15:26 -0400)]
13497: Rename SystemNodes to NodeProfiles in config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Abort startup if Rails API cannot be found.
Tom Clegg [Fri, 15 Jun 2018 19:08:59 +0000 (15:08 -0400)]
13497: Abort startup if Rails API cannot be found.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Support "run-tests.sh --only go".
Tom Clegg [Fri, 15 Jun 2018 19:06:02 +0000 (15:06 -0400)]
13497: Support "run-tests.sh --only go".

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Bump version numbers for Go packages when lib/ changes.
Tom Clegg [Fri, 15 Jun 2018 19:05:17 +0000 (15:05 -0400)]
13497: Bump version numbers for Go packages when lib/ changes.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13579: Admin documentation setting up Azure resources
Nico Cesar [Thu, 14 Jun 2018 22:40:53 +0000 (18:40 -0400)]
13579: Admin documentation setting up Azure resources

Arvados-DCO-1.1-Signed-off-by: Nico Cesar <ncesar@veritasgenetics.com>

6 years ago13497: Quote file paths in test suite nginx.conf.
Tom Clegg [Thu, 14 Jun 2018 21:03:24 +0000 (17:03 -0400)]
13497: Quote file paths in test suite nginx.conf.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago13497: Suppress nginx "info" logs from console.
Tom Clegg [Thu, 14 Jun 2018 21:02:10 +0000 (17:02 -0400)]
13497: Suppress nginx "info" logs from console.

(unless ARVADOS_DEBUG is set)

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>