X-Git-Url: https://git.arvados.org/arvados.git/blobdiff_plain/267477f569cd2632ea14d6fdd467760c669fc087..fdd933cb69ea44d6c705b47be62f0f985eff742c:/doc/user/cwl/federated-workflows.html.textile.liquid diff --git a/doc/user/cwl/federated-workflows.html.textile.liquid b/doc/user/cwl/federated-workflows.html.textile.liquid index a692bf4fff..7e2150dccb 100644 --- a/doc/user/cwl/federated-workflows.html.textile.liquid +++ b/doc/user/cwl/federated-workflows.html.textile.liquid @@ -9,12 +9,49 @@ Copyright (C) The Arvados Authors. All rights reserved. SPDX-License-Identifier: CC-BY-SA-3.0 {% endcomment %} -Arvados supports federated workflows, where different step of a running workflow execute on different clusters. This supports running analysis on geographically dispersed data (avoiding expensive data transfers by sending the computation to the data) or in "hybrid cloud" configurations where an on-premise cluster can expand its capabilities by sending work to a cloud-base cluster. +To support running analysis on geographically dispersed data (avoiding expensive data transfers by sending the computation to the data), and "hybrid cloud" configurations where an on-premise cluster can expand its capabilities by delegating work to a cloud-hosted cluster, Arvados supports federated workflows. In a federated workflow, different steps of a workflow may execute on different clusters. Arvados manages data transfer and delegation of credentials, so that all that is required is adding "arv:ClusterTarget":cwl-extensions.html#clustertarget hints to your existing workflow. -h2. Federated scatter/gather example +!(full-width)federated-workflow.svg! -
-+For more information, visit the "architecture":{{site.baseurl}}/architecture/federation.html and "admin":{{site.baseurl}}/admin/federation.html sections about Arvados federation. -
-+h2. Get the example files + +The tutorial files are located in the "documentation section of the Arvados source repository:":https://github.com/curoverse/arvados/tree/master/doc/user/cwl/federated or "see below":#fed-example + +
~$ git clone https://github.com/curoverse/arvados
+~$ cd arvados/doc/user/cwl/federated
+
+~$ arvados-cwl-runner federated.cwl shards.cwl
+
+