X-Git-Url: https://git.arvados.org/arvados.git/blobdiff_plain/609646134bcd8fc3a7fd500848220741ecc4a9d2..3854e6bfcd5344bce5ee0388248cb115e3c5e902:/doc/user/cwl/cwl-run-options.html.textile.liquid diff --git a/doc/user/cwl/cwl-run-options.html.textile.liquid b/doc/user/cwl/cwl-run-options.html.textile.liquid index c9b18e6df2..7598ab822e 100644 --- a/doc/user/cwl/cwl-run-options.html.textile.liquid +++ b/doc/user/cwl/cwl-run-options.html.textile.liquid @@ -3,6 +3,11 @@ layout: default navsection: userguide title: "Using arvados-cwl-runner" ... +{% comment %} +Copyright (C) The Arvados Authors. All rights reserved. + +SPDX-License-Identifier: CC-BY-SA-3.0 +{% endcomment %} The following command line options are available for @arvados-cwl-runner@: @@ -10,6 +15,7 @@ table(table table-bordered table-condensed). |_. Option |_. Description | |==--basedir== BASEDIR| Base directory used to resolve relative references in the input, default to directory of input object file or current directory (if inputs piped/provided on command line).| |==--version==| Print version and exit| +|==--validate==| Validate CWL document only.| |==--verbose==| Default logging| |==--quiet==| Only print warnings and errors.| |==--debug==| Print even more logging| @@ -30,7 +36,14 @@ table(table table-bordered table-condensed). |==--api== WORK_API| Select work submission API, one of 'jobs' or 'containers'. Default is 'jobs' if that API is available, otherwise 'containers'.| |==--compute-checksum==| Compute checksum of contents while collecting outputs| |==--submit-runner-ram== SUBMIT_RUNNER_RAM|RAM (in MiB) required for the workflow runner job (default 1024)| +|==--submit-runner-image== SUBMIT_RUNNER_IMAGE|Docker image for workflow runner job, default arvados/jobs| |==--name== NAME| Name to use for workflow execution instance.| +|==--on-error {stop,continue}|Desired workflow behavior when a step fails. One of 'stop' or 'continue'. Default is 'continue'.| +|==--enable-dev==| Enable loading and running development versions of CWL spec.| +|==--intermediate-output-ttl== N|If N > 0, intermediate output collections will be trashed N seconds after creation. Default is 0 (don't trash).| +|==--trash-intermediate==| Immediately trash intermediate outputs on workflow success.| +|==--no-trash-intermediate==|Do not trash intermediate outputs (default).| + h3. Specify workflow and output names @@ -92,3 +105,15 @@ arvados-cwl-runner 1.0.20160628195002, arvados-python-client 0.1.20160616015107, } + +h3. Automatically delete intermediate outputs + +Use the @--intermediate-output-ttl@ and @--trash-intermediate@ options to specify how long intermediate outputs should be kept (in seconds) and whether to trash them immediately upon successful workflow completion. + +Temporary collections will be trashed @intermediate-output-ttl@ seconds after creation. A value of zero (default) means intermediate output should be retained indefinitely. + +Note: arvados-cwl-runner currently does not take workflow dependencies into account when setting the TTL on an intermediate output collection. If the TTL is too short, it is possible for a collection to be trashed before downstream steps that consume it are started. The recommended minimum value for TTL is the expected duration for the entire the workflow. + +Using @--trash-intermediate@ without @--intermediate-output-ttl@ means that intermediate files will be trashed on successful completion, but will remain on workflow failure. + +Using @--intermediate-output-ttl@ without @--trash-intermediate@ means that intermediate files will be trashed only after the TTL expires (regardless of workflow success or failure).