Peter Amstutz [Fri, 24 Feb 2017 15:53:28 +0000 (10:53 -0500)]
9277: Container output check must be unscoped to include trashed collections.
Tom Clegg [Wed, 22 Feb 2017 21:36:50 +0000 (16:36 -0500)]
Merge branch '7995-keep-balance-docs'
closes #7995
Tom Clegg [Wed, 22 Feb 2017 21:33:35 +0000 (16:33 -0500)]
Remove pidfiles after shutting down test servers.
No issue #
Tom Clegg [Wed, 22 Feb 2017 18:19:09 +0000 (13:19 -0500)]
Merge branch '11097-reuse-impure'
closes #11097
Tom Clegg [Wed, 22 Feb 2017 16:45:35 +0000 (11:45 -0500)]
7995: Add note about one keep-balance process at a time.
Tom Clegg [Wed, 22 Feb 2017 16:29:48 +0000 (11:29 -0500)]
7995: Fix up dry-run instructions.
Tom Clegg [Wed, 22 Feb 2017 16:24:13 +0000 (11:24 -0500)]
7995: Fix up inconsistent "e.g." vs. "e.g.,".
Tom Clegg [Wed, 22 Feb 2017 16:02:32 +0000 (11:02 -0500)]
7995: Copy edits.
Tom Clegg [Wed, 22 Feb 2017 15:29:31 +0000 (10:29 -0500)]
Fix dispatch panic when processing an update after tracker has been closed/deleted.
refs #11151
Tom Morris [Tue, 21 Feb 2017 21:35:00 +0000 (16:35 -0500)]
A few copy edits
Tom Morris [Tue, 21 Feb 2017 21:34:07 +0000 (16:34 -0500)]
Document epydoc dependency
Tom Clegg [Tue, 21 Feb 2017 20:27:54 +0000 (15:27 -0500)]
11097: Clarify reuse query.
Tom Clegg [Tue, 21 Feb 2017 20:27:37 +0000 (15:27 -0500)]
11097: Update docs to reflect new container reuse behavior.
Tom Clegg [Mon, 20 Feb 2017 22:03:10 +0000 (17:03 -0500)]
7995: Add "dry run" note.
Peter Amstutz [Mon, 20 Feb 2017 21:18:44 +0000 (16:18 -0500)]
Merge branch '6520-pending-reason' refs #6520
Peter Amstutz [Mon, 20 Feb 2017 18:54:47 +0000 (13:54 -0500)]
6520: Add ReqNodeNotAvail to list of reasons (along with "Resources") to boot a new node.
Tom Clegg [Mon, 20 Feb 2017 20:45:40 +0000 (15:45 -0500)]
11097: Update test to match new behavior.
Tom Clegg [Mon, 20 Feb 2017 20:34:15 +0000 (15:34 -0500)]
11097: Merge branch 'master' into 11097-reuse-impure
Tom Clegg [Mon, 20 Feb 2017 15:41:52 +0000 (10:41 -0500)]
7995: Add keep-balance to install guide.
Tom Clegg [Fri, 17 Feb 2017 22:32:53 +0000 (17:32 -0500)]
Merge branch '11127-delete-trash-with-links'
refs #11127
Lucas Di Pentima [Fri, 17 Feb 2017 22:18:54 +0000 (19:18 -0300)]
Merge branch '11121-crunch-output-collection-owner'
Closes #11121
Lucas Di Pentima [Fri, 17 Feb 2017 22:17:40 +0000 (19:17 -0300)]
11121: Merge branch 'master' into 11121-crunch-output-collection-owner
Tom Clegg [Fri, 17 Feb 2017 21:17:26 +0000 (16:17 -0500)]
11127: Delete dependent links too when emptying trash.
Tom Clegg [Fri, 17 Feb 2017 19:49:13 +0000 (14:49 -0500)]
11127: Do not crash server if SweepTrashedCollections thread has an exception.
Peter Amstutz [Thu, 16 Feb 2017 21:44:22 +0000 (16:44 -0500)]
Merge branch '6520-nodemanager-crunchv2' refs #6520
Peter Amstutz [Thu, 16 Feb 2017 21:43:06 +0000 (16:43 -0500)]
6520: Crunch v1 recognizes 'mix' and 'drng' as busy states for
consistency (won't affect node manager behavior going forward, however.)
Peter Amstutz [Thu, 16 Feb 2017 21:34:00 +0000 (16:34 -0500)]
Merge branch '6520-skip-compute0' refs #6520
Peter Amstutz [Thu, 16 Feb 2017 21:31:43 +0000 (16:31 -0500)]
6520: Expand recognized 'busy' states.
Lucas Di Pentima [Thu, 16 Feb 2017 21:11:09 +0000 (18:11 -0300)]
11121: Added test.
Peter Amstutz [Thu, 16 Feb 2017 20:13:40 +0000 (15:13 -0500)]
Merge branch '9277-trash-container-outputs' closes #9277
Peter Amstutz [Thu, 16 Feb 2017 20:10:34 +0000 (15:10 -0500)]
6520: Explicitly mark node as 'down' before shutting down.
radhika [Thu, 16 Feb 2017 20:04:39 +0000 (15:04 -0500)]
closes #11104
Merge branch '11104-work-unit-expand-on-caret'
radhika [Thu, 16 Feb 2017 19:08:40 +0000 (14:08 -0500)]
11104: add fa-caret-down class to hyperlink rather than adding a span with icon.
Peter Amstutz [Thu, 16 Feb 2017 17:51:38 +0000 (12:51 -0500)]
9277: Include trashed collections when creating copy collection for container
request.
radhika [Thu, 16 Feb 2017 17:49:09 +0000 (12:49 -0500)]
closes #11103
Merge branch '11103-fts-crs'
radhika [Thu, 16 Feb 2017 17:48:11 +0000 (12:48 -0500)]
11103: ensure the index exists before attempting to drop it.
Peter Amstutz [Thu, 16 Feb 2017 17:00:30 +0000 (12:00 -0500)]
9277: crunch-run Log and output collections set is_trashed to true instead of
setting trash_at.
radhika [Thu, 16 Feb 2017 17:27:51 +0000 (12:27 -0500)]
11103: Omit mounts from container_requests and definition from workflows for full text search index.
Lucas Di Pentima [Thu, 16 Feb 2017 17:00:59 +0000 (14:00 -0300)]
11121: Add owner_uuid to output collection on crunch-job
Tom Clegg [Thu, 16 Feb 2017 15:17:34 +0000 (10:17 -0500)]
Merge branch '11017-docker-migration'
closes #11017
Tom Clegg [Wed, 15 Feb 2017 22:41:21 +0000 (17:41 -0500)]
Merge branch '10797-ruby-2.3'
closes #10797
Tom Clegg [Wed, 15 Feb 2017 22:40:40 +0000 (17:40 -0500)]
10797: Merge branch 'master' into 10797-ruby-2.3
Tom Clegg [Wed, 15 Feb 2017 22:40:16 +0000 (17:40 -0500)]
10797: Ruby 2.3.3
Ward Vandewege [Wed, 15 Feb 2017 22:35:40 +0000 (17:35 -0500)]
Update golang version to 1.7.5. Also make the equivalent changes to the
(new) ubuntu1604 build scripts.
refs #10797
Ward Vandewege [Wed, 15 Feb 2017 22:25:24 +0000 (17:25 -0500)]
Merge branch 'master' into 10797-ruby-2.3
refs #10797
Peter Amstutz [Wed, 15 Feb 2017 20:15:09 +0000 (15:15 -0500)]
6520: Don't ever assign compute0, start at slot 1 when assigning hostname.
Peter Amstutz [Wed, 15 Feb 2017 20:08:39 +0000 (15:08 -0500)]
6520: Check that hostname is set before setting weight.
Peter Amstutz [Wed, 15 Feb 2017 19:56:16 +0000 (14:56 -0500)]
6520: Apply node size fixup in CloudNodeListMonitorActor
Tom Clegg [Wed, 15 Feb 2017 19:47:57 +0000 (14:47 -0500)]
11097: Drop check for conflicting outputs when reusing completed containers.
Peter Amstutz [Wed, 15 Feb 2017 17:28:36 +0000 (12:28 -0500)]
6520: Update cloud_node.size to match server calculator configuration.
Tom Clegg [Wed, 15 Feb 2017 16:30:29 +0000 (11:30 -0500)]
11017: Add arv-migrate-docker19 to package.
Peter Amstutz [Wed, 15 Feb 2017 16:29:25 +0000 (11:29 -0500)]
6520: Assign weight to node based on price to preferentially schedule on
cheaper nodes.
Peter Amstutz [Tue, 14 Feb 2017 21:22:09 +0000 (16:22 -0500)]
6520: Add testcase using sinfo to set crunch_worker_state
Peter Amstutz [Tue, 14 Feb 2017 21:01:21 +0000 (16:01 -0500)]
6520: Add testcase getting wishlist from squeue.
Peter Amstutz [Mon, 6 Feb 2017 19:00:53 +0000 (14:00 -0500)]
6520: Call squeue to include slurm jobs in wishlist. Call sinfo to update
crunch_worker_state in arvados node records.
Tom Clegg [Tue, 14 Feb 2017 20:16:22 +0000 (15:16 -0500)]
11017: When compute nodes use image format v2, prefer migrated docker images.
Peter Amstutz [Tue, 14 Feb 2017 20:02:49 +0000 (15:02 -0500)]
Merge branch 'arvbox-docker-imgfmt' no issue #
Peter Amstutz [Tue, 14 Feb 2017 20:02:26 +0000 (15:02 -0500)]
Update test_with_arvbox script.
Peter Amstutz [Tue, 14 Feb 2017 19:11:20 +0000 (14:11 -0500)]
Set docker_image_formats to v1.
Peter Amstutz [Tue, 14 Feb 2017 17:09:13 +0000 (12:09 -0500)]
Merge branch 'fix-arvbox' no issue #
Peter Amstutz [Tue, 14 Feb 2017 16:05:56 +0000 (11:05 -0500)]
Fix arvbox build.
* Set up fuse groups separately.
* Separate generating superuser token from writing file so as not to write file on failure.
Tom Clegg [Tue, 14 Feb 2017 16:08:49 +0000 (11:08 -0500)]
Merge branch '10701-refactor-dispatch'
closes #10701
Tom Clegg [Tue, 14 Feb 2017 15:50:19 +0000 (10:50 -0500)]
10701: Update error text in test.
Tom Clegg [Tue, 14 Feb 2017 15:42:12 +0000 (10:42 -0500)]
10701: Improve comments and identifiers.
Tom Clegg [Mon, 13 Feb 2017 22:18:11 +0000 (17:18 -0500)]
11017: Add arv-migrate-docker19
Peter Amstutz [Mon, 13 Feb 2017 21:19:52 +0000 (16:19 -0500)]
Merge branch '9397-cwl-initialworkdir-crunchv2' closes #9397
Peter Amstutz [Mon, 13 Feb 2017 20:20:00 +0000 (15:20 -0500)]
9397: Improve container InitialWorkDir test.
Peter Amstutz [Fri, 10 Feb 2017 21:29:02 +0000 (16:29 -0500)]
9397: Fix keep URI splitting. Fix error when container has error log
collection with single file.
Peter Amstutz [Wed, 8 Feb 2017 16:11:42 +0000 (11:11 -0500)]
9397: arvados-cwl-runner implementation of InitialWorkDir on container API.
Peter Amstutz [Mon, 13 Feb 2017 19:34:15 +0000 (14:34 -0500)]
Update schema-salad pin. refs #10993
Peter Amstutz [Mon, 13 Feb 2017 18:03:47 +0000 (13:03 -0500)]
Update cwltool pin. closes #10993
Peter Amstutz [Mon, 13 Feb 2017 17:29:55 +0000 (12:29 -0500)]
Merge branch '9397-prepopulate-output-directory' refs #9397
Peter Amstutz [Mon, 13 Feb 2017 17:01:41 +0000 (12:01 -0500)]
Merge branch '10846-nodemanager-errors' closes #10846
Tom Clegg [Fri, 10 Feb 2017 23:03:10 +0000 (18:03 -0500)]
Merge branch '11088-keep-cache-units'
closes #11088
Tom Clegg [Fri, 10 Feb 2017 22:08:46 +0000 (17:08 -0500)]
Merge branch '11070-ws-listener-problem'
closes #11070
radhika [Fri, 10 Feb 2017 21:36:13 +0000 (16:36 -0500)]
closes #10903
Merge branch '10903-wb-cancel-cascade'
Tom Clegg [Fri, 10 Feb 2017 21:21:37 +0000 (16:21 -0500)]
11088: Fix keep_cache_ram units.
Lucas Di Pentima [Fri, 10 Feb 2017 21:00:22 +0000 (18:00 -0300)]
Merge branch '10956-arvput-pdh-fix'
Closes #10956
Lucas Di Pentima [Fri, 10 Feb 2017 19:18:21 +0000 (16:18 -0300)]
Merge branch '3900-trash-collections-delete-api'
Closes #3900
radhika [Fri, 10 Feb 2017 19:15:11 +0000 (14:15 -0500)]
closes #10945
Merge branch '10945-used-in-section-for-cwl-jobs'
radhika [Fri, 10 Feb 2017 19:08:50 +0000 (14:08 -0500)]
10903: support need_transaction for job and pipeline_instance cancel methods.
Peter Amstutz [Fri, 10 Feb 2017 18:51:42 +0000 (13:51 -0500)]
9397: Fix bind behavior to include Path. Update tests to check container binds
as well as output manifest.
Peter Amstutz [Fri, 10 Feb 2017 18:40:31 +0000 (13:40 -0500)]
9397: Adjust stream normalization to use just digest (no hints) to de-duplicate
block locators.
Tom Clegg [Fri, 10 Feb 2017 18:31:21 +0000 (13:31 -0500)]
10701: Get multiple pages of queue if necessary.
Tom Clegg [Fri, 10 Feb 2017 18:16:47 +0000 (13:16 -0500)]
10701: Fix chan type.
Tom Clegg [Fri, 10 Feb 2017 18:11:52 +0000 (13:11 -0500)]
10701: Add back MinRetryPeriod throttle. Update comments/identifiers.
Lucas Di Pentima [Fri, 10 Feb 2017 18:04:41 +0000 (15:04 -0300)]
3900: Merge branch 'master' into 3900-trash-collections-delete-api
Lucas Di Pentima [Fri, 10 Feb 2017 18:01:45 +0000 (15:01 -0300)]
3900: Flipped item.destroy call for semantics reasons
radhika [Fri, 10 Feb 2017 17:13:09 +0000 (12:13 -0500)]
10945: "Used in jobs" panel placement
Peter Amstutz [Fri, 10 Feb 2017 16:04:23 +0000 (11:04 -0500)]
Merge branch 'master' into origin-9397-prepopulate-output-directory
Peter Amstutz [Fri, 10 Feb 2017 16:03:42 +0000 (11:03 -0500)]
Merge branch '9397-go-manifest' refs #9397
Peter Amstutz [Fri, 10 Feb 2017 16:02:33 +0000 (11:02 -0500)]
9397: Update comment & tests for CollectionFileReader to reflect it is more
lenient in the paths it accepts as a result of updates to implementation of
manifest.FileSegmentIterByName.
Tom Clegg [Fri, 10 Feb 2017 09:56:28 +0000 (04:56 -0500)]
10701: cleanup
Tom Clegg [Fri, 10 Feb 2017 06:25:14 +0000 (01:25 -0500)]
10701: Refactor dispatch library.
radhika [Fri, 10 Feb 2017 00:06:40 +0000 (19:06 -0500)]
10945: show jobs in which this job is used in job#show page.
Peter Amstutz [Thu, 9 Feb 2017 21:58:23 +0000 (16:58 -0500)]
9397: Tweak method documentation for Extract()
Peter Amstutz [Thu, 9 Feb 2017 21:55:10 +0000 (16:55 -0500)]
9397: Update method documentation for Extract()
Lucas Di Pentima [Thu, 9 Feb 2017 21:47:01 +0000 (18:47 -0300)]
10956: Fixed cwl test mocks to match behaviour change on collection class.
Peter Amstutz [Thu, 9 Feb 2017 21:46:21 +0000 (16:46 -0500)]
9397: Fix major bug in firstBlock(). Refactor ManifestTextForPath() to
Extract(). Test returning errors from Extract().
Peter Amstutz [Thu, 9 Feb 2017 19:28:26 +0000 (14:28 -0500)]
9397: Fix collection.go to use blockdigest.LocatorPattern