14440: Add project_uuid to ClusterTarget example
authorPeter Amstutz <pamstutz@veritasgenetics.com>
Wed, 21 Nov 2018 18:42:38 +0000 (13:42 -0500)
committerPeter Amstutz <pamstutz@veritasgenetics.com>
Mon, 26 Nov 2018 15:44:52 +0000 (10:44 -0500)
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

doc/user/cwl/federated-workflows.html.textile.liquid
doc/user/cwl/federated/federated.cwl
doc/user/cwl/federated/shards.yml

index 754011f467e391eeb07742a25db8ae27b82d134a..5f96702d74ee193a25ae1c860a0f6441bc04c920 100644 (file)
@@ -9,10 +9,12 @@ Copyright (C) The Arvados Authors. All rights reserved.
 SPDX-License-Identifier: CC-BY-SA-3.0
 {% endcomment %}
 
-Arvados supports federated workflows, where different steps of a running workflow may execute on different clusters.  Arvados manages data transfer and delegation of credentials, so this as easy as simply adding cluster target hints to your existing workflow.  This supports running analysis on geographically dispersed data (avoiding expensive data transfers by sending the computation to the data) and "hybrid cloud" configurations where an on-premise cluster can expand its capabilities by delegating work to a cloud-base cluster.
+To support running analysis on geographically dispersed data (avoiding expensive data transfers by sending the computation to the data) and "hybrid cloud" configurations where an on-premise cluster can expand its capabilities by delegating work to a cloud-base cluster, Arvados supports federated workflows.  In a federated workflow, different steps of a workflow may execute on different clusters.  Arvados manages data transfer and delegation of credentials, so this as easy as simply adding cluster target hints to your existing workflow.
 
 h2. Federated scatter/gather example
 
+
+
 {% codeblock as yaml %}
 {% include 'federated_cwl' %}
 {% endcodeblock %}
index 401acc5454651f3b4070aa5b7755019e9fdd3f56..0ede317adf58c14fe0af044523360065b2bc1ff0 100644 (file)
@@ -33,6 +33,7 @@ steps:
     hints:
       arv:ClusterTarget:
         cluster_id: $(inputs.shards.cluster)
+        project_uuid: $(inputs.shards.project)
     out: [out]
     run: md5sum.cwl
   gather-results:
index e0f548785625f2d03242ea90aa7ebb0f002f29ac..ed8a83ab3f6ba19527b4dbd926f0bb6e838aacc0 100644 (file)
@@ -1,15 +1,18 @@
 shards:
   - cluster: clsr1
+    project: clsr1-j7d0g-qxc4jcji7n4lafx
     file:
       class: File
       location: keep:485df2c5cec3207a32f49c42f1cdcca9+61/file-on-clsr1.dat
 
   - cluster: clsr2
+    project: clsr2-j7d0g-ivdrm1hyym21vkq
     file:
       class: File
       location: keep:ae6e9c3e9bfa52a0122ecb489d8198ff+61/file-on-clsr2.dat
 
   - cluster: clsr3
+    project: clsr3-j7d0g-e3njz2s53lyb0ka
     file:
       class: File
       location: keep:0b43a0ef9ea592d5d7b299978dfa8643+61/file-on-clsr3.dat