arvados.git
7 years agocloses #10604
radhika [Tue, 6 Dec 2016 15:46:45 +0000 (10:46 -0500)]
closes #10604
Merge branch '10604-crunch2-user-guide'

7 years ago10604: rename tutorial-pipeline-workbench.html as tutorial-workbench-workbench.html
radhika [Tue, 6 Dec 2016 15:44:41 +0000 (10:44 -0500)]
10604: rename tutorial-pipeline-workbench.html as tutorial-workbench-workbench.html

7 years agoMerge branch 'master' into 10604-crunch2-user-guide
radhika [Tue, 6 Dec 2016 15:31:50 +0000 (10:31 -0500)]
Merge branch 'master' into 10604-crunch2-user-guide

7 years agoMerge branch '10519-cr-fiddlesticks' closes #10519
Peter Amstutz [Tue, 6 Dec 2016 14:46:11 +0000 (09:46 -0500)]
Merge branch '10519-cr-fiddlesticks' closes #10519

7 years agoMerge branch '10658-crunch-run-missing-files' closes #10658
Peter Amstutz [Tue, 6 Dec 2016 14:40:12 +0000 (09:40 -0500)]
Merge branch '10658-crunch-run-missing-files' closes #10658

7 years agoMerge branch '10649-squeue-stderr' closes #10649
Peter Amstutz [Tue, 6 Dec 2016 14:39:09 +0000 (09:39 -0500)]
Merge branch '10649-squeue-stderr' closes #10649

7 years agoFix typo in comment.
Ward Vandewege [Mon, 5 Dec 2016 22:13:22 +0000 (17:13 -0500)]
Fix typo in comment.

No issue #

7 years ago10519: added a test to check Run button when an empty workflow is used with no requir...
radhika [Fri, 2 Dec 2016 20:09:14 +0000 (15:09 -0500)]
10519: added a test to check Run button when an empty workflow is used with no required inputs.

7 years agoBump package iteration on arvados-docker-cleaner for dependency fix. no issue #
Peter Amstutz [Fri, 2 Dec 2016 20:05:08 +0000 (15:05 -0500)]
Bump package iteration on arvados-docker-cleaner for dependency fix.  no issue #

7 years agoPin websocket-client backport dependency to 0.37.0 to avoid tertiary dependency
Peter Amstutz [Fri, 2 Dec 2016 19:47:01 +0000 (14:47 -0500)]
Pin websocket-client backport dependency to 0.37.0 to avoid tertiary dependency
problems on debian7 and ubuntu1204.  no issue #

7 years agoMerge branch 'master' into 10519-cr-fiddlesticks
radhika [Fri, 2 Dec 2016 18:52:52 +0000 (13:52 -0500)]
Merge branch 'master' into 10519-cr-fiddlesticks

7 years agorefs #10293
radhika [Fri, 2 Dec 2016 18:52:13 +0000 (13:52 -0500)]
refs #10293
Merge branch '10293-cr-log-and-output-in-wb'

7 years agoMerge branch '5737-fix-broken-test-with-231'
Lucas Di Pentima [Fri, 2 Dec 2016 18:48:40 +0000 (15:48 -0300)]
Merge branch '5737-fix-broken-test-with-231'
refs #5737

7 years ago10293: update test assertion to expect output collection name, instead of pdh.
radhika [Fri, 2 Dec 2016 18:48:12 +0000 (13:48 -0500)]
10293: update test assertion to expect output collection name, instead of pdh.

7 years ago5737: Updated test so it pass on both 2.1 and 2.3 ruby versions.
Lucas Di Pentima [Fri, 2 Dec 2016 18:45:19 +0000 (15:45 -0300)]
5737: Updated test so it pass on both 2.1 and 2.3 ruby versions.

7 years agoMerge branch 'master' into 10293-cr-log-and-output-in-wb
radhika [Fri, 2 Dec 2016 18:33:20 +0000 (13:33 -0500)]
Merge branch 'master' into 10293-cr-log-and-output-in-wb

7 years agoUse regex to determine whether to print help text for arvbash.sh. refs #10655
Peter Amstutz [Fri, 2 Dec 2016 18:23:48 +0000 (13:23 -0500)]
Use regex to determine whether to print help text for arvbash.sh. refs #10655

7 years agoMerge branch '10655-arvbash' closes #10655
Peter Amstutz [Fri, 2 Dec 2016 18:17:33 +0000 (13:17 -0500)]
Merge branch '10655-arvbash' closes #10655

7 years agoMerge branch '10647-dev-jobs-image' closes #10647
Peter Amstutz [Fri, 2 Dec 2016 18:15:47 +0000 (13:15 -0500)]
Merge branch '10647-dev-jobs-image' closes #10647

7 years ago10604: add crunch1 only note to arv-copy documentation.
radhika [Fri, 2 Dec 2016 17:27:24 +0000 (12:27 -0500)]
10604: add crunch1 only note to arv-copy documentation.

7 years agoUpdate arvbox to work with passenger 5.0, refs #5737
Peter Amstutz [Fri, 2 Dec 2016 15:50:15 +0000 (10:50 -0500)]
Update arvbox to work with passenger 5.0, refs #5737

7 years ago10519: Don't fiddlesticks on uncomitted container request page if workflow or
Peter Amstutz [Fri, 2 Dec 2016 16:58:28 +0000 (11:58 -0500)]
10519: Don't fiddlesticks on uncomitted container request page if workflow or
cwl.input.json are missing.

7 years agoFix bug done.done() not returning output value. refs #10293
Peter Amstutz [Fri, 2 Dec 2016 16:07:08 +0000 (11:07 -0500)]
Fix bug done.done() not returning output value.  refs #10293

7 years ago10293: update container_work_unit to look for output_uuid and log_uuid for a containe...
radhika [Fri, 2 Dec 2016 16:02:07 +0000 (11:02 -0500)]
10293: update container_work_unit to look for output_uuid and log_uuid for a container_request, rather than using those from the associated container.

7 years ago10658: Put container into cancelled state on error during docker load or mount
Peter Amstutz [Fri, 2 Dec 2016 15:20:19 +0000 (10:20 -0500)]
10658: Put container into cancelled state on error during docker load or mount
setup.

7 years ago10658: Flush logs even when maintaining container in queued state.
Peter Amstutz [Fri, 2 Dec 2016 14:59:38 +0000 (09:59 -0500)]
10658: Flush logs even when maintaining container in queued state.

7 years ago10649: Make errors emitted by squeue and scancel show up in logs.
Peter Amstutz [Thu, 1 Dec 2016 17:56:17 +0000 (12:56 -0500)]
10649: Make errors emitted by squeue and scancel show up in logs.

8 years ago10655: Add arvbash to tools/
Peter Amstutz [Thu, 1 Dec 2016 22:22:30 +0000 (17:22 -0500)]
10655: Add arvbash to tools/

8 years ago10604: add pages to write and run workflows.
radhika [Thu, 1 Dec 2016 21:23:33 +0000 (16:23 -0500)]
10604: add pages to write and run workflows.

8 years agoMerge branch '5737-ruby231'
Lucas Di Pentima [Thu, 1 Dec 2016 20:35:30 +0000 (17:35 -0300)]
Merge branch '5737-ruby231'
refs #5737

8 years ago5737: Merge branch 'master' into 5737-ruby231
Lucas Di Pentima [Thu, 1 Dec 2016 19:34:10 +0000 (16:34 -0300)]
5737: Merge branch 'master' into 5737-ruby231

8 years agoMerge branch '10651-cwl-submit-runner-ram' refs #10651
Peter Amstutz [Thu, 1 Dec 2016 19:00:11 +0000 (14:00 -0500)]
Merge branch '10651-cwl-submit-runner-ram' refs #10651

8 years agoMerge branch 'origin-10293-cwl-cr-output' closes #10293
Peter Amstutz [Thu, 1 Dec 2016 18:59:45 +0000 (13:59 -0500)]
Merge branch 'origin-10293-cwl-cr-output' closes #10293

8 years ago10293: Update test_done to test more stuff and remove redundant test_done_use_existin...
Peter Amstutz [Thu, 1 Dec 2016 18:54:53 +0000 (13:54 -0500)]
10293: Update test_done to test more stuff and remove redundant test_done_use_existing_collection.

8 years ago10651: Check --submit-runner-ram has a valid value. Add tests.
Peter Amstutz [Thu, 1 Dec 2016 18:36:55 +0000 (13:36 -0500)]
10651: Check --submit-runner-ram has a valid value.  Add tests.

8 years ago10293: Fix error message when wrong --api provided.
Peter Amstutz [Thu, 1 Dec 2016 18:11:24 +0000 (13:11 -0500)]
10293: Fix error message when wrong --api provided.

8 years ago10651: Add --submit-runner-ram to specify amount of RAM that should be
Peter Amstutz [Thu, 1 Dec 2016 17:34:20 +0000 (12:34 -0500)]
10651: Add --submit-runner-ram to specify amount of RAM that should be
allocated for workflow runner job or container.

8 years ago10293: Avoid noisy and unhelpful error when cwl.output.json is missing.
Peter Amstutz [Wed, 30 Nov 2016 22:12:42 +0000 (17:12 -0500)]
10293: Avoid noisy and unhelpful error when cwl.output.json is missing.

8 years ago10293: Improve error messages for --api and unsupported InitialWorkDirRequirement.
Peter Amstutz [Wed, 30 Nov 2016 21:39:14 +0000 (16:39 -0500)]
10293: Improve error messages for --api and unsupported InitialWorkDirRequirement.

8 years ago10293: Don't try to json decode empty output file to reduce spurious errors.
Peter Amstutz [Wed, 30 Nov 2016 21:04:00 +0000 (16:04 -0500)]
10293: Don't try to json decode empty output file to reduce spurious errors.

8 years ago10293: Override workflow runner done() to get container from container request.
Peter Amstutz [Wed, 30 Nov 2016 20:52:38 +0000 (15:52 -0500)]
10293: Override workflow runner done() to get container from container request.

8 years ago10293: Bug fixes
Peter Amstutz [Wed, 30 Nov 2016 20:26:30 +0000 (15:26 -0500)]
10293: Bug fixes

* Now polling state on self.poll_api.container_requests() table
* Runner object puts "self" into processes table
* Don't report spurious ApiError when not running in container

8 years ago10604: Update the "Running a pipeline using Workbench" to talk about "workflows"
radhika [Wed, 30 Nov 2016 20:46:02 +0000 (15:46 -0500)]
10604: Update the "Running a pipeline using Workbench" to talk about "workflows"

8 years ago10647: Get necessary version of cwltool from sdk/cwl/setup.py instead of
Peter Amstutz [Wed, 30 Nov 2016 19:40:53 +0000 (14:40 -0500)]
10647: Get necessary version of cwltool from sdk/cwl/setup.py instead of
listing it in two places.

8 years ago10647: Image tag is most recent git hash of python sdk or arvados-cwl-runner.
Peter Amstutz [Wed, 30 Nov 2016 19:36:36 +0000 (14:36 -0500)]
10647: Image tag is most recent git hash of python sdk or arvados-cwl-runner.

8 years ago10647: Script + Dockerfile to build arvados/jobs image from local git checkout, for...
Peter Amstutz [Wed, 30 Nov 2016 19:25:58 +0000 (14:25 -0500)]
10647: Script + Dockerfile to build arvados/jobs image from local git checkout, for development.

8 years ago5737: Merge branch 'master' into 5737-ruby231
Lucas Di Pentima [Tue, 29 Nov 2016 15:52:05 +0000 (12:52 -0300)]
5737: Merge branch 'master' into 5737-ruby231

8 years agocloses #10518
radhika [Tue, 29 Nov 2016 15:48:17 +0000 (10:48 -0500)]
closes #10518
Merge branch '10518-crunch2-only-wb'

8 years agoMerge branch '10599-run-build-packages' closes #10599
Peter Amstutz [Tue, 29 Nov 2016 14:38:41 +0000 (09:38 -0500)]
Merge branch '10599-run-build-packages' closes #10599

8 years ago10599: Add run-build-packages-one-target.sh --only-build, run-build-packages looks...
Peter Amstutz [Wed, 23 Nov 2016 18:58:37 +0000 (13:58 -0500)]
10599: Add run-build-packages-one-target.sh --only-build, run-build-packages looks for $ONLY_BUILD in its environment.

8 years ago10518: update API groups_controller.contents method to exclude classes with index...
radhika [Tue, 29 Nov 2016 02:27:32 +0000 (21:27 -0500)]
10518: update API groups_controller.contents method to exclude classes with index disabled and update user guide to use "Run a process" instead of "Run a pipeline"

8 years ago5737: Fixed unused variable declarations.
Lucas Di Pentima [Mon, 28 Nov 2016 23:18:15 +0000 (20:18 -0300)]
5737: Fixed unused variable declarations.

8 years ago5737: Fixed several warning messages from running tests.
Lucas Di Pentima [Mon, 28 Nov 2016 22:48:10 +0000 (19:48 -0300)]
5737: Fixed several warning messages from running tests.

8 years ago5737: Fixed a bug in container reuse test code.
Lucas Di Pentima [Mon, 28 Nov 2016 22:45:55 +0000 (19:45 -0300)]
5737: Fixed a bug in container reuse test code.

8 years agoMerge branch '10630-no-json-debug-dump' refs #10630
Peter Amstutz [Mon, 28 Nov 2016 20:58:51 +0000 (15:58 -0500)]
Merge branch '10630-no-json-debug-dump' refs #10630

8 years ago10630: Bump cwltool version to completely skip debug statements that make
Peter Amstutz [Mon, 28 Nov 2016 20:56:23 +0000 (15:56 -0500)]
10630: Bump cwltool version to completely skip debug statements that make
expensive json.dumps() calls.

8 years ago5737: Fixes to remove ruby warnings when running collection api integration tests
Lucas Di Pentima [Mon, 28 Nov 2016 19:54:25 +0000 (16:54 -0300)]
5737: Fixes to remove ruby warnings when running collection api integration tests

8 years agoMerge branch '10586-writer-pool-deadlock' refs #10586
Tom Clegg [Mon, 28 Nov 2016 19:46:26 +0000 (14:46 -0500)]
Merge branch '10586-writer-pool-deadlock' refs #10586

8 years ago5737: Fixes to remove ruby warnings when running websocket integration tests.
Lucas Di Pentima [Mon, 28 Nov 2016 19:29:17 +0000 (16:29 -0300)]
5737: Fixes to remove ruby warnings when running websocket integration tests.

8 years ago10586: Add extra notify_all() as deadlock insurance.
Tom Clegg [Mon, 28 Nov 2016 18:46:28 +0000 (13:46 -0500)]
10586: Add extra notify_all() as deadlock insurance.

8 years ago10586: Fix misuse of "!=" to mean "is not".
Tom Clegg [Mon, 28 Nov 2016 18:46:10 +0000 (13:46 -0500)]
10586: Fix misuse of "!=" to mean "is not".

8 years ago10586: Do not pile on more errors in the service.finished() case.
Tom Clegg [Mon, 28 Nov 2016 18:44:52 +0000 (13:44 -0500)]
10586: Do not pile on more errors in the service.finished() case.

8 years ago5737: Explicitly passing PID file path to passenger so that the tests pass again.
Lucas Di Pentima [Mon, 28 Nov 2016 17:50:44 +0000 (14:50 -0300)]
5737: Explicitly passing PID file path to passenger so that the tests pass again.

8 years ago5737: Removed minitest: it wasn't really running the tests.
Lucas Di Pentima [Mon, 28 Nov 2016 17:49:23 +0000 (14:49 -0300)]
5737: Removed minitest: it wasn't really running the tests.

8 years agoInstall upgraded setuptools in arvbox, refs #10583
Peter Amstutz [Mon, 28 Nov 2016 14:50:41 +0000 (09:50 -0500)]
Install upgraded setuptools in arvbox, refs #10583

8 years agoMerge branch 'master' into 10293-cwl-cr-output
radhika [Mon, 28 Nov 2016 13:12:48 +0000 (08:12 -0500)]
Merge branch 'master' into 10293-cwl-cr-output

8 years ago10586: Suppress stack traces for expected http errors.
Tom Clegg [Fri, 25 Nov 2016 23:21:51 +0000 (18:21 -0500)]
10586: Suppress stack traces for expected http errors.

8 years ago10586: Fix deadlock in KeepWriterThreadPool.
Tom Clegg [Fri, 25 Nov 2016 23:10:16 +0000 (18:10 -0500)]
10586: Fix deadlock in KeepWriterThreadPool.

Previously, an unhandled exception in KeepWriterThread (including
KeepService.put()) would terminate the thread without calling
queue.task_done(), which would cause queue.join() to deadlock.

Additionally, this commit moves all of the "wait until work is needed"
logic from KeepWriterThread into KeepWriterQueue.

8 years agoUpdate arvados-cwl-runner with compatible dependencies, refs #10583
Peter Amstutz [Wed, 23 Nov 2016 23:56:55 +0000 (18:56 -0500)]
Update arvados-cwl-runner with compatible dependencies, refs #10583

8 years agorefs #10290
radhika [Wed, 23 Nov 2016 19:54:37 +0000 (14:54 -0500)]
refs #10290
Merge branch '10290-scheduling-parameters-doc'

8 years ago10290: scheduling_parameters documentation
radhika [Wed, 23 Nov 2016 19:52:38 +0000 (14:52 -0500)]
10290: scheduling_parameters documentation

8 years agoMerge branch '10484-count-clients' closes #10484
Tom Clegg [Wed, 23 Nov 2016 19:36:59 +0000 (14:36 -0500)]
Merge branch '10484-count-clients' closes #10484

8 years agoUpdate cwltool version with compatible dependencies, refs #10583
Peter Amstutz [Wed, 23 Nov 2016 19:18:24 +0000 (14:18 -0500)]
Update cwltool version with compatible dependencies, refs #10583

8 years ago10535: Fix race-to-deadlock bugs in tests.test_events: use threading.Event, not threa...
Tom Clegg [Wed, 23 Nov 2016 07:49:54 +0000 (02:49 -0500)]
10535: Fix race-to-deadlock bugs in tests.test_events: use threading.Event, not threading.Condition. refs #10535

8 years agorefs #10524
radhika [Tue, 22 Nov 2016 22:42:28 +0000 (17:42 -0500)]
refs #10524
Merge branch '10524-crunch2-workbench'

8 years ago10524: update test assertions
radhika [Tue, 22 Nov 2016 22:41:33 +0000 (17:41 -0500)]
10524: update test assertions

8 years agoMerge branch 'master' into 10293-cwl-cr-output
radhika [Tue, 22 Nov 2016 21:31:28 +0000 (16:31 -0500)]
Merge branch 'master' into 10293-cwl-cr-output

8 years ago10293: done_outputs in a try/except block
radhika [Tue, 22 Nov 2016 21:30:45 +0000 (16:30 -0500)]
10293: done_outputs in a try/except block

8 years agoMerge branch '10583-cwl-salad-ver' refs #10583
Peter Amstutz [Tue, 22 Nov 2016 21:26:17 +0000 (16:26 -0500)]
Merge branch '10583-cwl-salad-ver' refs #10583

8 years ago10583: Bump versions.
Peter Amstutz [Tue, 22 Nov 2016 20:25:21 +0000 (15:25 -0500)]
10583: Bump versions.

8 years ago10293: invoke output_callback in a try/except block
radhika [Tue, 22 Nov 2016 19:06:59 +0000 (14:06 -0500)]
10293: invoke output_callback in a try/except block

8 years agoMerge branch 'master' into 10293-cwl-cr-output
radhika [Tue, 22 Nov 2016 18:38:27 +0000 (13:38 -0500)]
Merge branch 'master' into 10293-cwl-cr-output

8 years agocloses #10524
radhika [Tue, 22 Nov 2016 18:35:54 +0000 (13:35 -0500)]
closes #10524
Merge branch '10524-crunch2-workbench'

8 years agoMerge branch '9897-log-block-prefetch-worker-exceptions' closes #9897
Tom Clegg [Tue, 22 Nov 2016 17:14:47 +0000 (12:14 -0500)]
Merge branch '9897-log-block-prefetch-worker-exceptions' closes #9897

8 years agoMerge branch '10473-keepstore-logrus' closes #10473
Tom Clegg [Tue, 22 Nov 2016 17:02:29 +0000 (12:02 -0500)]
Merge branch '10473-keepstore-logrus' closes #10473

8 years ago5737: Merge branch 'master' into 5737-ruby231
Lucas Di Pentima [Tue, 22 Nov 2016 16:40:45 +0000 (13:40 -0300)]
5737: Merge branch 'master' into 5737-ruby231

8 years agoMerge branch '10498-arvdocker-project-uuid' refs #10498
Peter Amstutz [Tue, 22 Nov 2016 16:40:36 +0000 (11:40 -0500)]
Merge branch '10498-arvdocker-project-uuid' refs #10498

8 years ago10498: Handle project_uuid of None in arv_docker_get_image.
Peter Amstutz [Tue, 22 Nov 2016 15:33:01 +0000 (10:33 -0500)]
10498: Handle project_uuid of None in arv_docker_get_image.

8 years ago10524: add additional test assertions to disabled_api_test
radhika [Tue, 22 Nov 2016 13:20:02 +0000 (08:20 -0500)]
10524: add additional test assertions to disabled_api_test

8 years ago9897: Changes as per discussion in #9897.
Colin Nolan [Tue, 22 Nov 2016 10:18:18 +0000 (10:18 +0000)]
9897: Changes as per discussion in #9897.

8 years agoArvbox sets PATH, GEM_HOME and GEM_PATH in common.sh. refs #10410
Peter Amstutz [Tue, 22 Nov 2016 02:08:11 +0000 (21:08 -0500)]
Arvbox sets PATH, GEM_HOME and GEM_PATH in common.sh.  refs #10410

8 years ago10484: Report current client count.
Tom Clegg [Mon, 21 Nov 2016 19:22:59 +0000 (14:22 -0500)]
10484: Report current client count.

8 years agoMerge branch '10473-keepstore-logrus' closes #10473
Tom Clegg [Mon, 21 Nov 2016 18:39:50 +0000 (13:39 -0500)]
Merge branch '10473-keepstore-logrus' closes #10473

8 years ago10473: Tune up text-format logging.
Tom Clegg [Sun, 20 Nov 2016 06:44:35 +0000 (01:44 -0500)]
10473: Tune up text-format logging.

8 years ago10473: Use fixed-point timestamps and more human-readable field ordering, hide "incom...
Tom Clegg [Sun, 20 Nov 2016 06:39:05 +0000 (01:39 -0500)]
10473: Use fixed-point timestamps and more human-readable field ordering, hide "incoming request" if level<debug.

8 years ago10473: Fixed-width timestamps.
Tom Clegg [Sun, 20 Nov 2016 05:30:16 +0000 (00:30 -0500)]
10473: Fixed-width timestamps.

8 years ago10473: Log requests/responses in JSON format by default; add config option for text...
Tom Clegg [Fri, 18 Nov 2016 06:49:47 +0000 (01:49 -0500)]
10473: Log requests/responses in JSON format by default; add config option for text format.

8 years ago10524: update tests to look for 'Run a process' button instead of 'Run a pipeline'
radhika [Mon, 21 Nov 2016 18:22:24 +0000 (13:22 -0500)]
10524: update tests to look for 'Run a process' button instead of 'Run a pipeline'

8 years agoMerge branch '10484-keepstore-stats' refs #10484
Tom Clegg [Mon, 21 Nov 2016 18:07:30 +0000 (13:07 -0500)]
Merge branch '10484-keepstore-stats' refs #10484

8 years ago10524: update workbench titles to use "processes" instead of "pipelines and processes...
radhika [Mon, 21 Nov 2016 18:02:07 +0000 (13:02 -0500)]
10524: update workbench titles to use "processes" instead of "pipelines and processes" when pipelines are disabled.