X-Git-Url: https://git.arvados.org/arvados.git/blobdiff_plain/e10ccaba824b4f60ddc516903304351496b5fdca..0af7e7b2ab33ad8766c4c0b537070dfddbadf37c:/doc/install/install-compute-node.html.textile.liquid?ds=inline diff --git a/doc/install/install-compute-node.html.textile.liquid b/doc/install/install-compute-node.html.textile.liquid index 25d047343b..f55bceb561 100644 --- a/doc/install/install-compute-node.html.textile.liquid +++ b/doc/install/install-compute-node.html.textile.liquid @@ -8,21 +8,29 @@ h2. Install dependencies First, "add the appropriate package repository for your distribution":{{ site.baseurl }}/install/install-manual-prerequisites.html#repos. -On Debian-based systems: +{% include 'note_python_sc' %} + +On CentOS 6 and RHEL 6: -
~$ sudo apt-get install perl python-virtualenv fuse python-arvados-python-client python-arvados-fuse crunchstat arvados-docker-cleaner iptables ca-certificates
+
~$ sudo yum install perl python27-python-virtualenv fuse python27-python-arvados-python-client python27-python-arvados-fuse crunchrunner crunchstat arvados-docker-cleaner iptables ca-certificates
 
-On Red Hat-based systems: +On other Red Hat-based systems: -
~$ sudo yum install perl python27-python-virtualenv fuse python27-python-arvados-python-client python27-python-arvados-fuse crunchstat arvados-docker-cleaner iptables ca-certificates
+
~$ echo 'exclude=python2-llfuse' | sudo tee -a /etc/yum.conf
+~$ sudo yum install perl python-virtualenv fuse python-arvados-python-client python-arvados-fuse crunchrunner crunchstat arvados-docker-cleaner iptables ca-certificates
 
-{% include 'note_python27_sc' %} +On Debian-based systems: + + +
~$ sudo apt-get install perl python-virtualenv fuse python-arvados-python-client python-arvados-fuse crunchrunner crunchstat arvados-docker-cleaner iptables ca-certificates
+
+
h2. Install Docker @@ -54,7 +62,7 @@ Install SLURM following "the same process you used to install the Crunch dispatc h2. Copy configuration files from the dispatcher (API server) -The @/etc/slurm-llnl/slurm.conf@ and @/etc/munge/munge.key@ files need to be identicaly across the dispatcher and all compute nodes. Copy the files you created in the "Install the Crunch dispatcher":install-crunch-dispatch.html step to this compute node. +The @slurm.conf@ and @/etc/munge/munge.key@ files need to be identical across the dispatcher and all compute nodes. Copy the files you created in the "Install the Crunch dispatcher":install-crunch-dispatch.html step to this compute node. h2. Configure FUSE @@ -79,22 +87,16 @@ h2. Configure the Docker cleaner The arvados-docker-cleaner program removes least recently used docker images as needed to keep disk usage below a configured limit. {% include 'notebox_begin' %} -This also removes all containers as soon as they exit, as if they were run with `docker run --rm`. If you need to debug or inspect containers after they stop, temporarily stop arvados-docker-cleaner or run it with the `--no-remove-stopped-containers` flag. +This also removes all containers as soon as they exit, as if they were run with @docker run --rm@. If you need to debug or inspect containers after they stop, temporarily stop arvados-docker-cleaner or run it with @--remove-stopped-containers never@. {% include 'notebox_end' %} -On Debian-based systems, install runit: - - -
~$ sudo apt-get install runit
-
-
- -On Red Hat-based systems, "install runit from source":http://smarden.org/runit/install.html or use an alternative daemon supervisor. +Install runit to supervise the Docker cleaner daemon. {% include 'install_runit' %} Configure runit to run the image cleaner using a suitable quota for your compute nodes and workload: -
~$ cd /etc/sv
+
~$ sudo mkdir -p /etc/sv
+~$ cd /etc/sv
 /etc/sv$ sudo mkdir arvados-docker-cleaner; cd arvados-docker-cleaner
 /etc/sv/arvados-docker-cleaner$ sudo mkdir log log/main
 /etc/sv/arvados-docker-cleaner$ sudo sh -c 'cat >log/run' <<'EOF'
@@ -103,9 +105,13 @@ exec svlogd -tt main
 EOF
 /etc/sv/arvados-docker-cleaner$ sudo sh -c 'cat >run' <<'EOF'
 #!/bin/sh
+if [ -d /opt/rh/python33 ]; then
+  source scl_source enable python33
+fi
 exec python3 -m arvados_docker.cleaner --quota 50G
 EOF
 /etc/sv/arvados-docker-cleaner$ sudo chmod +x run log/run
+/etc/sv/arvados-docker-cleaner$ sudo ln -s "$(pwd)" /etc/service/
 
@@ -152,8 +158,7 @@ if ! test -f /root/node.json ; then import arvados, json, socket fqdn = socket.getfqdn() hostname, _, domain = fqdn.partition('.') -ip_address = socket.gethostbyname(fqdn) -node = arvados.api('v1').nodes().create(body={'hostname': hostname, 'domain': domain, 'ip_address': ip_address}).execute() +node = arvados.api('v1').nodes().create(body={'hostname': hostname, 'domain': domain}).execute() with open('/root/node.json', 'w') as node_file: json.dump(node, node_file, indent=2) EOF @@ -183,4 +188,3 @@ And remove your token from the environment:
-