Trials show performance difference is negligible between 11x 6MiB and
13x 5MiB. Given that, I figure lower concurrency wins because it
involves less processing.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
s3DefaultConnectTimeout = arvados.Duration(time.Minute)
maxClockSkew = 600 * time.Second
nearlyRFC1123 = "Mon, 2 Jan 2006 15:04:05 GMT"
- s3downloaderPartSize = 5 * 1024 * 1024
- s3downloaderReadConcurrency = 13
+ s3downloaderPartSize = 6 * 1024 * 1024
+ s3downloaderReadConcurrency = 11
s3uploaderPartSize = 5 * 1024 * 1024
s3uploaderWriteConcurrency = 5
)