From: Ward Vandewege Date: Tue, 26 Oct 2021 18:28:23 +0000 (-0400) Subject: Since CWL defaults to 256M of ram, make that the suggested amount for X-Git-Tag: 2.4.0~194 X-Git-Url: https://git.arvados.org/arvados.git/commitdiff_plain/aaabfc20e05a635a36be0049b38b2034f041398d Since CWL defaults to 256M of ram, make that the suggested amount for the `mksquashfs mem` setting in singularity.conf. No issue # Arvados-DCO-1.1-Signed-off-by: Ward Vandewege --- diff --git a/doc/_includes/_singularity_mksquashfs_configuration.liquid b/doc/_includes/_singularity_mksquashfs_configuration.liquid index dc0c394ba5..e31e801c17 100644 --- a/doc/_includes/_singularity_mksquashfs_configuration.liquid +++ b/doc/_includes/_singularity_mksquashfs_configuration.liquid @@ -12,4 +12,4 @@ This section is only relevant when using Singularity. Skip this section when usi {% include 'notebox_end' %} {% endif %} -Docker images are converted on the fly by @mksquashfs@, which can consume a considerable amount of RAM. The RAM usage of mksquashfs can be restricted in @/etc/singularity/singularity.conf@ with a line like @mksquashfs mem = 512M@. The amount of memory made available for mksquashfs should be configured lower than the smallest amount of memory requested by a container on the cluster to avoid the conversion being killed for using too much memory. +Docker images are converted on the fly by @mksquashfs@, which can consume a considerable amount of RAM. The RAM usage of mksquashfs can be restricted in @/etc/singularity/singularity.conf@ with a line like @mksquashfs mem = 256M@. The amount of memory made available for mksquashfs should be configured lower than the smallest amount of memory requested by a container on the cluster to avoid the conversion being killed for using too much memory. The default memory allocation in CWL is 256M, so that is also a good choice for the @mksquashfs mem@ setting. diff --git a/doc/install/crunch2-cloud/install-compute-node.html.textile.liquid b/doc/install/crunch2-cloud/install-compute-node.html.textile.liquid index 7c922e28d2..a56519fb1b 100644 --- a/doc/install/crunch2-cloud/install-compute-node.html.textile.liquid +++ b/doc/install/crunch2-cloud/install-compute-node.html.textile.liquid @@ -59,7 +59,7 @@ foktmqOY8MyctzFgXBpGTxPliGjqo8OkrOyQP2g+FL7v+Km31Xs61P8= {% include 'singularity_mksquashfs_configuration' %} -The desired amount of memory to make available for @mksquashfs@ can be configured in an argument to the build script, see the next section. It defaults to @512M@. +The desired amount of memory to make available for @mksquashfs@ can be configured in an argument to the build script, see the next section. It defaults to @256M@. h2(#building). The build script @@ -111,7 +111,7 @@ Options: Set this to "-dev" to track the unstable/dev Arvados repositories --public-key-file (required) Path to the public key file that a-d-c will use to log into the compute node - --mksquashfs-mem (default: 512M) + --mksquashfs-mem (default: 256M) Only relevant when using Singularity. This is the amount of memory mksquashfs is allowed to use. --debug Output debug information (default: false) diff --git a/tools/compute-images/build.sh b/tools/compute-images/build.sh index a714bafc1d..526db4906f 100755 --- a/tools/compute-images/build.sh +++ b/tools/compute-images/build.sh @@ -55,7 +55,7 @@ Options: Set this to "-dev" to track the unstable/dev Arvados repositories --public-key-file (required) Path to the public key file that a-d-c will use to log into the compute node - --mksquashfs-mem (default: 512M) + --mksquashfs-mem (default: 256M) Only relevant when using Singularity. This is the amount of memory mksquashfs is allowed to use. --debug Output debug information (default: false) @@ -80,7 +80,7 @@ DEBUG= SSH_USER= AWS_DEFAULT_REGION=us-east-1 PUBLIC_KEY_FILE= -MKSQUASHFS_MEM=512M +MKSQUASHFS_MEM=256M PARSEDOPTS=$(getopt --name "$0" --longoptions \ help,json-file:,arvados-cluster-id:,aws-source-ami:,aws-profile:,aws-secrets-file:,aws-region:,aws-vpc-id:,aws-subnet-id:,gcp-project-id:,gcp-account-file:,gcp-zone:,azure-secrets-file:,azure-resource-group:,azure-location:,azure-sku:,azure-cloud-environment:,ssh_user:,resolver:,reposuffix:,public-key-file:,mksquashfs-mem:,debug \