X-Git-Url: https://git.arvados.org/arvados.git/blobdiff_plain/d81ea65da05119d5c6480d373b5d42bbee8ae1ad..c7399ec7afdf0cfdd0f3177f410f102083a26e15:/doc/user/topics/tutorial-parallel.html.textile.liquid diff --git a/doc/user/topics/tutorial-parallel.html.textile.liquid b/doc/user/topics/tutorial-parallel.html.textile.liquid index 9be610358b..4ff402ea7f 100644 --- a/doc/user/topics/tutorial-parallel.html.textile.liquid +++ b/doc/user/topics/tutorial-parallel.html.textile.liquid @@ -3,8 +3,15 @@ layout: default navsection: userguide title: "Concurrent Crunch tasks" ... +{% comment %} +Copyright (C) The Arvados Authors. All rights reserved. -In the previous tutorials, we used @arvados.job_setup.one_task_per_input_file()@ to automatically create concurrent jobs by creating a separate task per file. For some types of jobs, you may need to split the work up differently, for example creating tasks to process different segments of a single large file. In this this tutorial will demonstrate how to create Crunch tasks directly. +SPDX-License-Identifier: CC-BY-SA-3.0 +{% endcomment %} + +{% include 'pipeline_deprecation_notice' %} + +In the previous tutorials, we used @arvados.job_setup.one_task_per_input_file()@ to automatically create concurrent jobs by creating a separate task per file. For some types of jobs, you may need to split the work up differently, for example creating tasks to process different segments of a single large file. This tutorial will demonstrate how to create Crunch tasks directly. Start by entering the @crunch_scripts@ directory of your Git repository: @@ -40,7 +47,7 @@ You should now be able to run your new script using Crunch, with "script" referr
~/$USER/crunch_scripts$ cat >~/the_job <<EOF
 {
  "script": "concurrent-hash.py",
- "repository": "$USER",
+ "repository": "$USER/$USER",
  "script_version": "master",
  "script_parameters":
  {