]> git.arvados.org - arvados.git/commit
12084: Fix dispatcher getting bogged down on "too many open files".
authorTom Clegg <tclegg@veritasgenetics.com>
Wed, 20 Sep 2017 02:14:37 +0000 (22:14 -0400)
committerTom Clegg <tclegg@veritasgenetics.com>
Wed, 20 Sep 2017 02:14:37 +0000 (22:14 -0400)
commit0888c5335f4e1868cdcebda6b6f76c2138978c6b
treea2a8c4af43e86847db64e914ef298f948056cf8b
parent6175b80719275d88f7c2bb0a8c15417dc9eb246b
12084: Fix dispatcher getting bogged down on "too many open files".

Previously, handling the "too many open files" error from popen3
consisted of sleeping 1 second and trying the next job in the
queue. When lots of jobs were queued, this meant getting stuck in
start_jobs() for a long time, futilely trying to start different jobs,
which all failed for the same reason.

Worse, being stuck here meant none of the working jobs could finish,
which meant no file descriptors could be freed.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
services/api/lib/crunch_dispatch.rb