navsection: userguide
title: Introduction to Crunch
...
+{% comment %}
+Copyright (C) The Arvados Authors. All rights reserved.
-h2. Prerequisites
+SPDX-License-Identifier: CC-BY-SA-3.0
+{% endcomment %}
The Arvados "Crunch" framework is designed to support processing very large data batches (gigabytes to terabytes) efficiently, and provides the following benefits:
* Increase concurrency by running tasks asynchronously, using many CPUs and network interfaces at once (especially beneficial for CPU-bound and I/O-bound tasks respectively).
* Interrupt and resume long-running jobs consisting of many short tasks.
* Maintain timing statistics automatically, so they're there when you want them.
-To get the most value out of this guide, you should be comfortable with the following:
+h2. Prerequisites
+
+To get the most value out of this section, you should be comfortable with the following:
# Using a secure shell client such as SSH or PuTTY to log on to a remote server
# Using the Unix command line shell, Bash
# Viewing and editing files using a unix text editor such as vi, Emacs, or nano
-# Programming in Python
# Revision control using Git
-We also recommend you read the "Arvados Platform Overview":https://arvados.org/projects/arvados/wiki#Platform-Overview for an introduction and background information about Arvados.
+We also recommend you read the "Arvados Platform Overview":https://dev.arvados.org/projects/arvados/wiki#Platform-Overview for an introduction and background information about Arvados.
projects / arvados.git / blobdiff