X-Git-Url: https://git.arvados.org/arvados.git/blobdiff_plain/78ddad37d72c6c3a728530dc6932fb91f7d81b87..2b41829bf0a889558c320121710ef3fd2e90ef7e:/doc/install/install-crunch-dispatch.html.textile.liquid diff --git a/doc/install/install-crunch-dispatch.html.textile.liquid b/doc/install/install-crunch-dispatch.html.textile.liquid index 4a695ca199..300f55ae17 100644 --- a/doc/install/install-crunch-dispatch.html.textile.liquid +++ b/doc/install/install-crunch-dispatch.html.textile.liquid @@ -5,25 +5,25 @@ title: Install the Crunch dispatcher ... - - The dispatcher normally runs on the same host/VM as the API server. -h4. Perl SDK dependencies +h2. Perl SDK dependencies Install the Perl SDK on the controller. * See "Perl SDK":{{site.baseurl}}/sdk/perl/index.html page for details. -h4. Python SDK dependencies +h2. Python SDK dependencies Install the Python SDK and CLI tools on controller and all compute nodes. * See "Python SDK":{{site.baseurl}}/sdk/python/sdk-python.html page for details. -h4. Slurm +h2(#slurm). Set up SLURM + +On the API server, install SLURM and munge, and generate a munge key. -On the API server, install slurm and munge, and generate a munge key: +On Debian-based systems:
~$ sudo /usr/bin/apt-get install slurm-llnl munge
@@ -31,7 +31,9 @@ On the API server, install slurm and munge, and generate a munge key:
 
-Now we need to give slurm a configuration file in @/etc/slurm-llnl/slurm.conf@. Here's an example: +On Red Hat-based systems, "install SLURM and munge from source following their installation guide":https://computing.llnl.gov/linux/slurm/quickstart_admin.html. + +Now we need to give SLURM a configuration file in @/etc/slurm-llnl/slurm.conf@. Here's an example:
@@ -85,15 +87,17 @@ PartitionName=compute Nodes=compute[0-255]
 
-Please make sure to update the value of the @ControlMachine@ parameter to the hostname of your dispatcher (api server). +Please make sure to update the value of the @ControlMachine@ parameter to the hostname of your dispatcher (API server). + +h2. Enable SLURM job dispatch -h4. Crunch user account +In your API server's @application.yml@ configuration file, add the line @crunch_job_wrapper: :slurm_immediate@ under the appropriate section. (The second colon is not a typo. It denotes a Ruby symbol.) -* @adduser crunch@ +h2. Crunch user account -The crunch user should have the same UID, GID, and home directory on all compute nodes and on the dispatcher (api server). +Run @sudo adduser crunch@. The crunch user should have the same UID, GID, and home directory on all compute nodes and on the dispatcher (API server). -h4. Repositories +h2. Git Repositories Crunch scripts must be in Git repositories in the directory configured as @git_repositories_dir@/*.git (see the "API server installation":install-api-server.html#git_repositories_dir). @@ -114,12 +118,12 @@ Without getting this error: ArgumentError: Specified script_version does not resolve to a commit -h4. Running jobs +h2. Running jobs * @services/api/script/crunch-dispatch.rb@ must be running. * @crunch-dispatch.rb@ needs @services/crunch/crunch-job@ in its @PATH@. -* @crunch-job@ needs @sdk/perl/lib@ and @warehouse-apps/libwarehouse-perl/lib@ in its @PERLLIB@ -* @crunch-job@ needs @ARVADOS_API_HOST@ (and, if necessary in a development environment, @ARVADOS_API_HOST_INSECURE@) +* @crunch-job@ needs the installation path of the Perl SDK in its @PERLLIB@. +* @crunch-job@ needs the @ARVADOS_API_HOST@ (and, if necessary in a development environment, @ARVADOS_API_HOST_INSECURE@) environment variable set. Example @/var/service/arvados_crunch_dispatch/run@ script: