]> git.arvados.org - arvados.git/log
arvados.git
8 years ago11002: Added note explaining why we're expecting a SystemExit to catch a SIGINT ...
Lucas Di Pentima [Mon, 27 Feb 2017 12:41:17 +0000 (09:41 -0300)]
11002: Added note explaining why we're expecting a SystemExit to catch a SIGINT (KeyboardInterrupt)

8 years ago11002: Don't save the state and log the stack trace before quitting upon catching...
Lucas Di Pentima [Thu, 23 Feb 2017 20:56:24 +0000 (17:56 -0300)]
11002: Don't save the state and log the stack trace before quitting upon catching an exception. Also, when receiving SIGINT (KeyboardInterrupt), just quit without any logging.
Updated tests to reflect this new behaviour.

8 years ago11002: Track this specific error with its own exception class, for future-proofing.
Lucas Di Pentima [Wed, 22 Feb 2017 18:26:16 +0000 (15:26 -0300)]
11002: Track this specific error with its own exception class, for future-proofing.

8 years ago11002: Do not try to save internal state when receiving a KeyboardInterrupt exception.
Lucas Di Pentima [Tue, 21 Feb 2017 17:41:58 +0000 (14:41 -0300)]
11002: Do not try to save internal state when receiving a KeyboardInterrupt exception.
Updated test accordingly.

8 years ago11002: Merge branch 'master' into 11002-arvput-crash-fix
Lucas Di Pentima [Tue, 21 Feb 2017 16:22:07 +0000 (13:22 -0300)]
11002: Merge branch 'master' into 11002-arvput-crash-fix

8 years ago11002: When trying to save the cache's state before quitting, if an exception
Lucas Di Pentima [Tue, 21 Feb 2017 13:00:19 +0000 (10:00 -0300)]
11002: When trying to save the cache's state before quitting, if an exception
is caught because of a BlockManager problem induced by an interruption,
print a warning message and quit without saving the last checkpoint.

8 years ago11002: Added missing assertion to test.
Lucas Di Pentima [Tue, 21 Feb 2017 12:54:07 +0000 (09:54 -0300)]
11002: Added missing assertion to test.

8 years ago11002: Improved test mocking a more suitable method and catching the specific excepti...
Lucas Di Pentima [Tue, 21 Feb 2017 11:41:07 +0000 (08:41 -0300)]
11002: Improved test mocking a more suitable method and catching the specific exception type.

8 years agoMerge branch '6520-pending-reason' refs #6520
Peter Amstutz [Mon, 20 Feb 2017 21:18:44 +0000 (16:18 -0500)]
Merge branch '6520-pending-reason' refs #6520

8 years ago6520: Add ReqNodeNotAvail to list of reasons (along with "Resources") to boot a new...
Peter Amstutz [Mon, 20 Feb 2017 18:54:47 +0000 (13:54 -0500)]
6520: Add ReqNodeNotAvail to list of reasons (along with "Resources") to boot a new node.

8 years ago11002: Added test to make the bug happen.
Lucas Di Pentima [Mon, 20 Feb 2017 20:25:05 +0000 (17:25 -0300)]
11002: Added test to make the bug happen.

8 years agoMerge branch '11127-delete-trash-with-links'
Tom Clegg [Fri, 17 Feb 2017 22:32:53 +0000 (17:32 -0500)]
Merge branch '11127-delete-trash-with-links'

refs #11127

8 years agoMerge branch '11121-crunch-output-collection-owner'
Lucas Di Pentima [Fri, 17 Feb 2017 22:18:54 +0000 (19:18 -0300)]
Merge branch '11121-crunch-output-collection-owner'
Closes #11121

8 years ago11121: Merge branch 'master' into 11121-crunch-output-collection-owner
Lucas Di Pentima [Fri, 17 Feb 2017 22:17:40 +0000 (19:17 -0300)]
11121: Merge branch 'master' into 11121-crunch-output-collection-owner

8 years ago11127: Delete dependent links too when emptying trash.
Tom Clegg [Fri, 17 Feb 2017 21:17:26 +0000 (16:17 -0500)]
11127: Delete dependent links too when emptying trash.

8 years ago11127: Do not crash server if SweepTrashedCollections thread has an exception.
Tom Clegg [Fri, 17 Feb 2017 19:49:13 +0000 (14:49 -0500)]
11127: Do not crash server if SweepTrashedCollections thread has an exception.

8 years agoMerge branch '6520-nodemanager-crunchv2' refs #6520
Peter Amstutz [Thu, 16 Feb 2017 21:44:22 +0000 (16:44 -0500)]
Merge branch '6520-nodemanager-crunchv2' refs #6520

8 years ago6520: Crunch v1 recognizes 'mix' and 'drng' as busy states for
Peter Amstutz [Thu, 16 Feb 2017 21:43:06 +0000 (16:43 -0500)]
6520: Crunch v1 recognizes 'mix' and 'drng' as busy states for
consistency (won't affect node manager behavior going forward, however.)

8 years agoMerge branch '6520-skip-compute0' refs #6520
Peter Amstutz [Thu, 16 Feb 2017 21:34:00 +0000 (16:34 -0500)]
Merge branch '6520-skip-compute0' refs #6520

8 years ago6520: Expand recognized 'busy' states.
Peter Amstutz [Thu, 16 Feb 2017 21:31:43 +0000 (16:31 -0500)]
6520: Expand recognized 'busy' states.

8 years ago11121: Added test.
Lucas Di Pentima [Thu, 16 Feb 2017 21:11:09 +0000 (18:11 -0300)]
11121: Added test.

8 years agoMerge branch '9277-trash-container-outputs' closes #9277
Peter Amstutz [Thu, 16 Feb 2017 20:13:40 +0000 (15:13 -0500)]
Merge branch '9277-trash-container-outputs' closes #9277

8 years ago6520: Explicitly mark node as 'down' before shutting down.
Peter Amstutz [Thu, 16 Feb 2017 20:10:34 +0000 (15:10 -0500)]
6520: Explicitly mark node as 'down' before shutting down.

8 years agocloses #11104
radhika [Thu, 16 Feb 2017 20:04:39 +0000 (15:04 -0500)]
closes #11104
Merge branch '11104-work-unit-expand-on-caret'

8 years ago11104: add fa-caret-down class to hyperlink rather than adding a span with icon.
radhika [Thu, 16 Feb 2017 19:08:40 +0000 (14:08 -0500)]
11104: add fa-caret-down class to hyperlink rather than adding a span with icon.

8 years ago9277: Include trashed collections when creating copy collection for container
Peter Amstutz [Thu, 16 Feb 2017 17:51:38 +0000 (12:51 -0500)]
9277: Include trashed collections when creating copy collection for container
request.

8 years agocloses #11103
radhika [Thu, 16 Feb 2017 17:49:09 +0000 (12:49 -0500)]
closes #11103
Merge branch '11103-fts-crs'

8 years ago11103: ensure the index exists before attempting to drop it.
radhika [Thu, 16 Feb 2017 17:48:11 +0000 (12:48 -0500)]
11103: ensure the index exists before attempting to drop it.

8 years ago9277: crunch-run Log and output collections set is_trashed to true instead of
Peter Amstutz [Thu, 16 Feb 2017 17:00:30 +0000 (12:00 -0500)]
9277: crunch-run Log and output collections set is_trashed to true instead of
setting trash_at.

8 years ago11103: Omit mounts from container_requests and definition from workflows for full...
radhika [Thu, 16 Feb 2017 17:27:51 +0000 (12:27 -0500)]
11103: Omit mounts from container_requests and definition from workflows for full text search index.

8 years ago11121: Add owner_uuid to output collection on crunch-job
Lucas Di Pentima [Thu, 16 Feb 2017 17:00:59 +0000 (14:00 -0300)]
11121: Add owner_uuid to output collection on crunch-job

8 years agoMerge branch '11017-docker-migration'
Tom Clegg [Thu, 16 Feb 2017 15:17:34 +0000 (10:17 -0500)]
Merge branch '11017-docker-migration'

closes #11017

8 years agoMerge branch '10797-ruby-2.3'
Tom Clegg [Wed, 15 Feb 2017 22:41:21 +0000 (17:41 -0500)]
Merge branch '10797-ruby-2.3'

closes #10797

8 years ago10797: Merge branch 'master' into 10797-ruby-2.3
Tom Clegg [Wed, 15 Feb 2017 22:40:40 +0000 (17:40 -0500)]
10797: Merge branch 'master' into 10797-ruby-2.3

8 years ago10797: Ruby 2.3.3
Tom Clegg [Wed, 15 Feb 2017 22:40:16 +0000 (17:40 -0500)]
10797: Ruby 2.3.3

8 years agoUpdate golang version to 1.7.5. Also make the equivalent changes to the
Ward Vandewege [Wed, 15 Feb 2017 22:35:40 +0000 (17:35 -0500)]
Update golang version to 1.7.5. Also make the equivalent changes to the
(new) ubuntu1604 build scripts.

refs #10797

8 years agoMerge branch 'master' into 10797-ruby-2.3
Ward Vandewege [Wed, 15 Feb 2017 22:25:24 +0000 (17:25 -0500)]
Merge branch 'master' into 10797-ruby-2.3

refs #10797

8 years ago6520: Don't ever assign compute0, start at slot 1 when assigning hostname.
Peter Amstutz [Wed, 15 Feb 2017 20:15:09 +0000 (15:15 -0500)]
6520: Don't ever assign compute0, start at slot 1 when assigning hostname.

8 years ago6520: Check that hostname is set before setting weight.
Peter Amstutz [Wed, 15 Feb 2017 20:08:39 +0000 (15:08 -0500)]
6520: Check that hostname is set before setting weight.

8 years ago6520: Apply node size fixup in CloudNodeListMonitorActor
Peter Amstutz [Wed, 15 Feb 2017 19:56:16 +0000 (14:56 -0500)]
6520: Apply node size fixup in CloudNodeListMonitorActor

8 years ago6520: Update cloud_node.size to match server calculator configuration.
Peter Amstutz [Wed, 15 Feb 2017 17:28:36 +0000 (12:28 -0500)]
6520: Update cloud_node.size to match server calculator configuration.

8 years ago11017: Add arv-migrate-docker19 to package.
Tom Clegg [Wed, 15 Feb 2017 16:30:29 +0000 (11:30 -0500)]
11017: Add arv-migrate-docker19 to package.

8 years ago6520: Assign weight to node based on price to preferentially schedule on
Peter Amstutz [Wed, 15 Feb 2017 16:29:25 +0000 (11:29 -0500)]
6520: Assign weight to node based on price to preferentially schedule on
cheaper nodes.

8 years ago6520: Add testcase using sinfo to set crunch_worker_state
Peter Amstutz [Tue, 14 Feb 2017 21:22:09 +0000 (16:22 -0500)]
6520: Add testcase using sinfo to set crunch_worker_state

8 years ago6520: Add testcase getting wishlist from squeue.
Peter Amstutz [Tue, 14 Feb 2017 21:01:21 +0000 (16:01 -0500)]
6520: Add testcase getting wishlist from squeue.

8 years ago6520: Call squeue to include slurm jobs in wishlist. Call sinfo to update
Peter Amstutz [Mon, 6 Feb 2017 19:00:53 +0000 (14:00 -0500)]
6520: Call squeue to include slurm jobs in wishlist.  Call sinfo to update
crunch_worker_state in arvados node records.

8 years ago11017: When compute nodes use image format v2, prefer migrated docker images.
Tom Clegg [Tue, 14 Feb 2017 20:16:22 +0000 (15:16 -0500)]
11017: When compute nodes use image format v2, prefer migrated docker images.

8 years agoMerge branch 'arvbox-docker-imgfmt' no issue #
Peter Amstutz [Tue, 14 Feb 2017 20:02:49 +0000 (15:02 -0500)]
Merge branch 'arvbox-docker-imgfmt' no issue #

8 years agoUpdate test_with_arvbox script.
Peter Amstutz [Tue, 14 Feb 2017 20:02:26 +0000 (15:02 -0500)]
Update test_with_arvbox script.

8 years agoSet docker_image_formats to v1.
Peter Amstutz [Tue, 14 Feb 2017 19:11:20 +0000 (14:11 -0500)]
Set docker_image_formats to v1.

8 years agoMerge branch 'fix-arvbox' no issue #
Peter Amstutz [Tue, 14 Feb 2017 17:09:13 +0000 (12:09 -0500)]
Merge branch 'fix-arvbox' no issue #

8 years agoFix arvbox build.
Peter Amstutz [Tue, 14 Feb 2017 16:05:56 +0000 (11:05 -0500)]
Fix arvbox build.

* Set up fuse groups separately.
* Separate generating superuser token from writing file so as not to write file on failure.

8 years agoMerge branch '10701-refactor-dispatch'
Tom Clegg [Tue, 14 Feb 2017 16:08:49 +0000 (11:08 -0500)]
Merge branch '10701-refactor-dispatch'

closes #10701

8 years ago10701: Update error text in test.
Tom Clegg [Tue, 14 Feb 2017 15:50:19 +0000 (10:50 -0500)]
10701: Update error text in test.

8 years ago10701: Improve comments and identifiers.
Tom Clegg [Tue, 14 Feb 2017 15:42:12 +0000 (10:42 -0500)]
10701: Improve comments and identifiers.

8 years ago11017: Add arv-migrate-docker19
Tom Clegg [Mon, 13 Feb 2017 22:18:11 +0000 (17:18 -0500)]
11017: Add arv-migrate-docker19

8 years agoMerge branch '9397-cwl-initialworkdir-crunchv2' closes #9397
Peter Amstutz [Mon, 13 Feb 2017 21:19:52 +0000 (16:19 -0500)]
Merge branch '9397-cwl-initialworkdir-crunchv2' closes #9397

8 years ago9397: Improve container InitialWorkDir test.
Peter Amstutz [Mon, 13 Feb 2017 20:20:00 +0000 (15:20 -0500)]
9397: Improve container InitialWorkDir test.

8 years ago9397: Fix keep URI splitting. Fix error when container has error log
Peter Amstutz [Fri, 10 Feb 2017 21:29:02 +0000 (16:29 -0500)]
9397: Fix keep URI splitting.  Fix error when container has error log
collection with single file.

8 years ago9397: arvados-cwl-runner implementation of InitialWorkDir on container API.
Peter Amstutz [Wed, 8 Feb 2017 16:11:42 +0000 (11:11 -0500)]
9397: arvados-cwl-runner implementation of InitialWorkDir on container API.

8 years agoUpdate schema-salad pin. refs #10993
Peter Amstutz [Mon, 13 Feb 2017 19:34:15 +0000 (14:34 -0500)]
Update schema-salad pin. refs #10993

8 years agoUpdate cwltool pin. closes #10993
Peter Amstutz [Mon, 13 Feb 2017 18:03:47 +0000 (13:03 -0500)]
Update cwltool pin. closes #10993

8 years agoMerge branch '9397-prepopulate-output-directory' refs #9397
Peter Amstutz [Mon, 13 Feb 2017 17:29:55 +0000 (12:29 -0500)]
Merge branch '9397-prepopulate-output-directory' refs #9397

8 years agoMerge branch '10846-nodemanager-errors' closes #10846
Peter Amstutz [Mon, 13 Feb 2017 17:01:41 +0000 (12:01 -0500)]
Merge branch '10846-nodemanager-errors' closes #10846

8 years agoMerge branch '11088-keep-cache-units'
Tom Clegg [Fri, 10 Feb 2017 23:03:10 +0000 (18:03 -0500)]
Merge branch '11088-keep-cache-units'

closes #11088

8 years agoMerge branch '11070-ws-listener-problem'
Tom Clegg [Fri, 10 Feb 2017 22:08:46 +0000 (17:08 -0500)]
Merge branch '11070-ws-listener-problem'

closes #11070

8 years agocloses #10903
radhika [Fri, 10 Feb 2017 21:36:13 +0000 (16:36 -0500)]
closes #10903
Merge branch '10903-wb-cancel-cascade'

8 years ago11088: Fix keep_cache_ram units.
Tom Clegg [Fri, 10 Feb 2017 21:21:37 +0000 (16:21 -0500)]
11088: Fix keep_cache_ram units.

8 years agoMerge branch '10956-arvput-pdh-fix'
Lucas Di Pentima [Fri, 10 Feb 2017 21:00:22 +0000 (18:00 -0300)]
Merge branch '10956-arvput-pdh-fix'
Closes #10956

8 years agoMerge branch '3900-trash-collections-delete-api'
Lucas Di Pentima [Fri, 10 Feb 2017 19:18:21 +0000 (16:18 -0300)]
Merge branch '3900-trash-collections-delete-api'
Closes #3900

8 years agocloses #10945
radhika [Fri, 10 Feb 2017 19:15:11 +0000 (14:15 -0500)]
closes #10945
Merge branch '10945-used-in-section-for-cwl-jobs'

8 years ago10903: support need_transaction for job and pipeline_instance cancel methods.
radhika [Fri, 10 Feb 2017 19:08:50 +0000 (14:08 -0500)]
10903: support need_transaction for job and pipeline_instance cancel methods.

8 years ago9397: Fix bind behavior to include Path. Update tests to check container binds
Peter Amstutz [Fri, 10 Feb 2017 18:51:42 +0000 (13:51 -0500)]
9397: Fix bind behavior to include Path.  Update tests to check container binds
as well as output manifest.

8 years ago9397: Adjust stream normalization to use just digest (no hints) to de-duplicate
Peter Amstutz [Fri, 10 Feb 2017 18:40:31 +0000 (13:40 -0500)]
9397: Adjust stream normalization to use just digest (no hints) to de-duplicate
block locators.

8 years ago10701: Get multiple pages of queue if necessary.
Tom Clegg [Fri, 10 Feb 2017 18:31:21 +0000 (13:31 -0500)]
10701: Get multiple pages of queue if necessary.

8 years ago10701: Fix chan type.
Tom Clegg [Fri, 10 Feb 2017 18:16:47 +0000 (13:16 -0500)]
10701: Fix chan type.

8 years ago10701: Add back MinRetryPeriod throttle. Update comments/identifiers.
Tom Clegg [Fri, 10 Feb 2017 18:11:52 +0000 (13:11 -0500)]
10701: Add back MinRetryPeriod throttle. Update comments/identifiers.

8 years ago3900: Merge branch 'master' into 3900-trash-collections-delete-api
Lucas Di Pentima [Fri, 10 Feb 2017 18:04:41 +0000 (15:04 -0300)]
3900: Merge branch 'master' into 3900-trash-collections-delete-api

8 years ago3900: Flipped item.destroy call for semantics reasons
Lucas Di Pentima [Fri, 10 Feb 2017 18:01:45 +0000 (15:01 -0300)]
3900: Flipped item.destroy call for semantics reasons

8 years ago10945: "Used in jobs" panel placement
radhika [Fri, 10 Feb 2017 17:13:09 +0000 (12:13 -0500)]
10945: "Used in jobs" panel placement

8 years agoMerge branch 'master' into origin-9397-prepopulate-output-directory
Peter Amstutz [Fri, 10 Feb 2017 16:04:23 +0000 (11:04 -0500)]
Merge branch 'master' into origin-9397-prepopulate-output-directory

8 years agoMerge branch '9397-go-manifest' refs #9397
Peter Amstutz [Fri, 10 Feb 2017 16:03:42 +0000 (11:03 -0500)]
Merge branch '9397-go-manifest' refs #9397

8 years ago9397: Update comment & tests for CollectionFileReader to reflect it is more
Peter Amstutz [Fri, 10 Feb 2017 16:02:33 +0000 (11:02 -0500)]
9397: Update comment & tests for CollectionFileReader to reflect it is more
lenient in the paths it accepts as a result of updates to implementation of
manifest.FileSegmentIterByName.

8 years ago10701: cleanup
Tom Clegg [Fri, 10 Feb 2017 09:56:28 +0000 (04:56 -0500)]
10701: cleanup

8 years ago10701: Refactor dispatch library.
Tom Clegg [Fri, 10 Feb 2017 06:25:14 +0000 (01:25 -0500)]
10701: Refactor dispatch library.

8 years ago10945: show jobs in which this job is used in job#show page.
radhika [Fri, 10 Feb 2017 00:06:40 +0000 (19:06 -0500)]
10945: show jobs in which this job is used in job#show page.

8 years ago9397: Tweak method documentation for Extract()
Peter Amstutz [Thu, 9 Feb 2017 21:58:23 +0000 (16:58 -0500)]
9397: Tweak method documentation for Extract()

8 years ago9397: Update method documentation for Extract()
Peter Amstutz [Thu, 9 Feb 2017 21:55:10 +0000 (16:55 -0500)]
9397: Update method documentation for Extract()

8 years ago10956: Fixed cwl test mocks to match behaviour change on collection class.
Lucas Di Pentima [Thu, 9 Feb 2017 21:47:01 +0000 (18:47 -0300)]
10956: Fixed cwl test mocks to match behaviour change on collection class.

8 years ago9397: Fix major bug in firstBlock(). Refactor ManifestTextForPath() to
Peter Amstutz [Thu, 9 Feb 2017 21:46:21 +0000 (16:46 -0500)]
9397: Fix major bug in firstBlock().  Refactor ManifestTextForPath() to
Extract().  Test returning errors from Extract().

8 years ago9397: Fix collection.go to use blockdigest.LocatorPattern
Peter Amstutz [Thu, 9 Feb 2017 19:28:26 +0000 (14:28 -0500)]
9397: Fix collection.go to use blockdigest.LocatorPattern

8 years ago9397: Fix collection.go to use blockdigest.LocatorPattern
Peter Amstutz [Thu, 9 Feb 2017 19:28:26 +0000 (14:28 -0500)]
9397: Fix collection.go to use blockdigest.LocatorPattern

8 years ago9397: Use ManifestTextForPath
Peter Amstutz [Thu, 9 Feb 2017 19:25:19 +0000 (14:25 -0500)]
9397: Use ManifestTextForPath

8 years agoMerge branch '9397-go-manifest' into origin-9397-prepopulate-output-directory
Peter Amstutz [Thu, 9 Feb 2017 19:11:53 +0000 (14:11 -0500)]
Merge branch '9397-go-manifest' into origin-9397-prepopulate-output-directory

8 years ago9397: Remove conflicting code for easier merge
Peter Amstutz [Thu, 9 Feb 2017 19:11:35 +0000 (14:11 -0500)]
9397: Remove conflicting code for easier merge

8 years ago10846: Specify whether to try to resume the node when cancelling shutdown
Peter Amstutz [Thu, 9 Feb 2017 18:46:14 +0000 (13:46 -0500)]
10846: Specify whether to try to resume the node when cancelling shutdown

8 years ago9397: Use idomatic loop form.
Peter Amstutz [Thu, 9 Feb 2017 18:25:40 +0000 (13:25 -0500)]
9397: Use idomatic loop form.

8 years ago9397: Move most functions into private API.
Peter Amstutz [Thu, 9 Feb 2017 18:21:28 +0000 (13:21 -0500)]
9397: Move most functions into private API.

* Document ManifestTextForPath().
* Check for invalid file segments, and fix tests that were using invalid file segments(!)

8 years ago10701: Tidy up error handling.
Tom Clegg [Thu, 9 Feb 2017 17:24:20 +0000 (12:24 -0500)]
10701: Tidy up error handling.

8 years ago10701: Fix edge case: scheduling_parameters.partitions=[]
Tom Clegg [Thu, 9 Feb 2017 17:15:30 +0000 (12:15 -0500)]
10701: Fix edge case: scheduling_parameters.partitions=[]