projects
/
arvados.git
/ blobdiff
summary
|
shortlog
|
log
|
commit
|
commitdiff
|
tree
raw
|
inline
| side by side
Merge branch '1868-tutorial-running-binary-progs'
[arvados.git]
/
doc
/
install
/
install-crunch-dispatch.textile
diff --git
a/doc/install/install-crunch-dispatch.textile
b/doc/install/install-crunch-dispatch.textile
index 08bcfe6af465adfd2aee12c1d98685be59abb96b..4c0209820f788361075dea6e2f59694633e37404 100644
(file)
--- a/
doc/install/install-crunch-dispatch.textile
+++ b/
doc/install/install-crunch-dispatch.textile
@@
-26,6
+26,20
@@
On compute nodes:
* @pip install --upgrade pyvcf@
* @pip install --upgrade pyvcf@
+h4. Redis
+
+On controller:
+
+* @apt-get install redis-server@
+
+h4. Crunch user account
+
+On compute nodes and controller:
+
+* @adduser crunch@
+
+The crunch user should have the same UID, GID, and home directory on all compute nodes and on the controller.
+
h4. Repositories
Crunch scripts must be in git repositories in @/var/cache/git/*/.git@ (or whatever is configured in @services/api/config/environments/production.rb@).
h4. Repositories
Crunch scripts must be in git repositories in @/var/cache/git/*/.git@ (or whatever is configured in @services/api/config/environments/production.rb@).
@@
-47,7
+61,7
@@
done
Once you have imported some commits, you should be able to create a new job:
<pre>
Once you have imported some commits, you should be able to create a new job:
<pre>
-read -rd
"\000"
newjob <<EOF; arv job create --job "$newjob"
+read -rd
$'\000'
newjob <<EOF; arv job create --job "$newjob"
{"script_parameters":{"input":"f815ec01d5d2f11cb12874ab2ed50daa"},
"script_version":"master",
"script":"hash"}
{"script_parameters":{"input":"f815ec01d5d2f11cb12874ab2ed50daa"},
"script_version":"master",
"script":"hash"}
@@
-74,7
+88,11
@@
Example @/var/service/arvados_crunch_dispatch/run@ script:
set -e
export PATH="$PATH":/path/to/arvados/services/crunch
export PERLLIB=/path/to/arvados/sdk/perl/lib:/path/to/warehouse-apps/libwarehouse-perl/lib
set -e
export PATH="$PATH":/path/to/arvados/services/crunch
export PERLLIB=/path/to/arvados/sdk/perl/lib:/path/to/warehouse-apps/libwarehouse-perl/lib
-export ARVADOS_API_HOST=xyzzy.arvadosapi.com
+export ARVADOS_API_HOST={{ site.arvados_api_host }}
+export PYTHONPATH=/path/to/arvados/src/sdk/python
+export CRUNCH_DISPATCH_LOCKFILE=/var/lock/crunch-dispatch
+
+fuser -TERM -k $CRUNCH_DISPATCH_LOCKFILE || true
## Only if your SSL cert is unverifiable:
# export ARVADOS_API_HOST_INSECURE=yes
## Only if your SSL cert is unverifiable:
# export ARVADOS_API_HOST_INSECURE=yes