X-Git-Url: https://git.arvados.org/arvados.git/blobdiff_plain/c0082c57cb7c5e67115e7b03c8c85f74b5b29d0d..39c17737ac69d7693684fe2f95bef0ec235a28bf:/doc/install/install-compute-node.html.textile.liquid diff --git a/doc/install/install-compute-node.html.textile.liquid b/doc/install/install-compute-node.html.textile.liquid index 767b8e3b81..02eb2168b0 100644 --- a/doc/install/install-compute-node.html.textile.liquid +++ b/doc/install/install-compute-node.html.textile.liquid @@ -3,60 +3,48 @@ layout: default navsection: installguide title: Install a compute node ... +{% comment %} +Copyright (C) The Arvados Authors. All rights reserved. + +SPDX-License-Identifier: CC-BY-SA-3.0 +{% endcomment %} h2. Install dependencies First, "add the appropriate package repository for your distribution":{{ site.baseurl }}/install/install-manual-prerequisites.html#repos. -On Debian-based systems: +{% include 'note_python_sc' %} + +On Red Hat-based systems: -
~$ sudo apt-get install perl python-virtualenv fuse python-arvados-python-client python-arvados-fuse crunchstat iptables ca-certificates
+
~$ echo 'exclude=python2-llfuse' | sudo tee -a /etc/yum.conf
+~$ sudo yum install perl python-virtualenv fuse python-arvados-python-client python-arvados-fuse crunchrunner crunchstat arvados-docker-cleaner iptables ca-certificates
 
-On Red Hat-based systems: +On Debian-based systems: -
~$ sudo yum install perl python27-python-virtualenv fuse python27-python-arvados-python-client python27-python-arvados-fuse crunchstat iptables ca-certificates
+
~$ sudo apt-get install perl python-virtualenv fuse python-arvados-python-client python-arvados-fuse crunchrunner crunchstat arvados-docker-cleaner iptables ca-certificates
 
-{% include 'note_python27_sc' %} - -h2. Set up Docker - -Compute nodes must have Docker installed to run jobs inside containers. This requires a relatively recent version of Linux (at least upstream version 3.10, or a distribution version with the appropriate patches backported). Follow the "Docker Engine installation documentation":https://docs.docker.com/ for your distribution. - -For Debian-based systems, the Arvados package repository includes a backported @docker.io@ package with a known-good version you can install. +{% include 'install_compute_docker' %} h2. Set up SLURM -Install SLURM following "the same process you used to install the Crunch dispatcher":{{ site.baseurl }}/install/install-crunch-dispatch.html#slurm. +Install SLURM following "the same process you used to install the Crunch dispatcher":install-crunch-dispatch.html#slurm. h2. Copy configuration files from the dispatcher (API server) -The @/etc/slurm-llnl/slurm.conf@ and @/etc/munge/munge.key@ files need to be identicaly across the dispatcher and all compute nodes. Copy the files you created in the "Install the Crunch dispatcher":{{site.baseurl}} step to this compute node. +The @slurm.conf@ and @/etc/munge/munge.key@ files need to be identical across the dispatcher and all compute nodes. Copy the files you created in the "Install the Crunch dispatcher":install-crunch-dispatch.html step to this compute node. -h2. Configure FUSE +{% include 'install_compute_fuse' %} -Install this file as @/etc/fuse.conf@: +{% include 'install_docker_cleaner' %} - -
-# Set the maximum number of FUSE mounts allowed to non-root users.
-# The default is 1000.
-#
-#mount_max = 1000
-
-# Allow non-root users to specify the 'allow_other' or 'allow_root'
-# mount options.
-#
-user_allow_other
-
-
- -h2. Crunch user account +h2. Add a Crunch user account Create a Crunch user account, and add it to the @fuse@ and @docker@ groups so it can use those tools: @@ -90,7 +78,9 @@ set -e if ! test -f /root/node.json ; then python - <<EOF import arvados, json, socket -node = arvados.api('v1').nodes().create(body={'hostname': socket.gethostname()}).execute() +fqdn = socket.getfqdn() +hostname, _, domain = fqdn.partition('.') +node = arvados.api('v1').nodes().create(body={'hostname': hostname, 'domain': domain}).execute() with open('/root/node.json', 'w') as node_file: json.dump(node, node_file, indent=2) EOF @@ -103,10 +93,10 @@ UUID=`grep \"uuid\" /root/node.json |cut -f4 -d\"` PING_SECRET=`grep \"ping_secret\" /root/node.json |cut -f4 -d\"` if ! test -f /etc/cron.d/node_ping ; then - echo "*/5 * * * * root /usr/bin/curl -k -d ping_secret=$PING_SECRET https://api/arvados/v1/nodes/$UUID/ping" > /etc/cron.d/node_ping + echo "*/5 * * * * root /usr/bin/curl -k -d ping_secret=$PING_SECRET https://$ARVADOS_API_HOST/arvados/v1/nodes/$UUID/ping" > /etc/cron.d/node_ping fi -/usr/bin/curl -k -d ping_secret=$PING_SECRET https://api/arvados/v1/nodes/$UUID/ping?ping_secret=$PING_SECRET +/usr/bin/curl -k -d ping_secret=$PING_SECRET https://$ARVADOS_API_HOST/arvados/v1/nodes/$UUID/ping?ping_secret=$PING_SECRET
@@ -120,4 +110,3 @@ And remove your token from the environment:
-