X-Git-Url: https://git.arvados.org/arvados.git/blobdiff_plain/99f067d87504c538932432aa5a8b7c62bfa244bf..385f300ba44bc186aa679d5aba543260e8ffee1e:/doc/user/tutorials/tutorial-job-debug.textile diff --git a/doc/user/tutorials/tutorial-job-debug.textile b/doc/user/tutorials/tutorial-job-debug.textile index af46ff870f..9ea454cde6 100644 --- a/doc/user/tutorials/tutorial-job-debug.textile +++ b/doc/user/tutorials/tutorial-job-debug.textile @@ -1,8 +1,9 @@ --- layout: default navsection: userguide -title: "Debug a Crunch script" -navorder: 114 +navmenu: Tutorials +title: "Debugging a Crunch script" +navorder: 14 --- h1. Tutorial: Debugging a Crunch script @@ -138,4 +139,18 @@ hello world +h3. Location of temporary files + +Crunch job tasks are supplied with @TASK_WORK@ and @JOB_WORK@ environment variables, to be used as scratch space. When running in local development mode using @arv-crunch-job@, Crunch sets these variables to point to directory called @crunch-job-{USERID}@ in @TMPDIR@ (or @/tmp@ if @TMPDIR@ is not set). + +* Set @TMPDIR@ to @/scratch@ to make Crunch use a directory like @/scratch/crunch-job-{USERID}/@ for temporary space. + +* Set @CRUNCH_TMP@ to @/scratch/foo@ to make Crunch use @/scratch/foo/@ for temporary space (omitting the default @crunch-job-{USERID}@ leaf name) + +h3. Testing job scripts without SDKs and Keep access + +Read and write data to @/tmp/@ instead of Keep. This only works with the Python SDK. + +notextile.
$ export KEEP_LOCAL_STORE=/tmp
+ Next, "parallel tasks.":tutorial-parallel.html