h2(#RAM). Understanding RAM requests for containers
-The @runtime_constraints@ section of a container specifies working RAM (@ram@) and keep cache (@keep_cache_ram@). If not specified, containers get a default keep cache (@container_default_keep_cache_ram@, default 256 MiB). The total RAM requested for a container is the sum of working RAM, keep cache, and an additional RAM reservation configured by the admin (@ReserveExtraRAM@ in the dispatcher configuration, default zero).
+The @runtime_constraints@ section of a container specifies working RAM (@ram@) and Keep cache (@keep_cache_ram@). If not specified, containers get a default Keep cache (@container_default_keep_cache_ram@, default 256 MiB). The total RAM requested for a container is the sum of working RAM, Keep cache, and an additional RAM reservation configured by the admin (@ReserveExtraRAM@ in the dispatcher configuration, default zero).
-The total RAM request is used to schedule containers onto compute nodes. On HPC systems, multiple containers may run on a multi-core node. RAM allocation limits may be enforced using kernel controls such as cgroups.
+The total RAM request is used to schedule containers onto compute nodes. RAM allocation limits are enforced using kernel controls such as cgroups. A container which requests 1 GiB RAM will only be permitted to allocate up to 1 GiB of RAM, even if scheduled on a 4 GiB node. On HPC systems, a multi-core node may run multiple containers at a time.
When running on the cloud, the memory request (along with CPU and disk) is used to select (and possibly boot) an instance type with adequate resources to run the container. Instance type RAM is derated 5% from the published specification to accomodate virtual machine, kernel and system services overhead.
h3. Calculate minimum instance type RAM for a container
- (RAM request + keep cache + ReserveExtraRAM) * (100/95)
+ (RAM request + Keep cache + ReserveExtraRAM) * (100/95)
-For example, for a 3 GiB request, default keep cache, and no extra RAM reserved:
+For example, for a 3 GiB request, default Keep cache, and no extra RAM reserved:
(3072 + 256) * 1.0526 = 3494 MiB
h3. Calculate the maximum requestable RAM for an instance type
- (Instance type RAM * (95/100)) - keep cache - ReserveExtraRAM
+ (Instance type RAM * (95/100)) - Keep cache - ReserveExtraRAM
-For example, for a 3.75 GiB node, default keep cache, and no extra RAM reserved:
+For example, for a 3.75 GiB node, default Keep cache, and no extra RAM reserved:
(3840 * 0.95) - 256 = 3392 MiB
To run on this instance type, the container can request at most 3392 MiB of working RAM.
-
-h2. Job API (deprecated)
-
-# To submit work, create a "job":{{site.baseurl}}/api/methods/jobs.html . If the same job has been submitted in the past, it will return an existing job in @Completed@ state.
-# The dispatcher process will notice a new job in @Queued@ state and attempt to allocate nodes to run the job.
-# The job executes.
-# Retrieve the @output@ field with the portable data hash of the collection with the output files of the job.
projects / arvados.git / blobdiff