arvados.git
10 years ago4031: Find for collection dependencies even in the middle of script parameter
Peter Amstutz [Tue, 28 Oct 2014 18:18:10 +0000 (14:18 -0400)]
4031: Find for collection dependencies even in the middle of script parameter
fields.  Server side collections with same PDH into a single entry with a
special name.  Fix node descriptions, hyperlinks.  More options to eliminate
certain node types for certain graphs to make them easier to read.  Handle both
PDH and UUID when identifying collections.

10 years agoFix off-by-one error in Node Manager server calculations.
Brett Smith [Tue, 28 Oct 2014 17:32:05 +0000 (13:32 -0400)]
Fix off-by-one error in Node Manager server calculations.

This bug prevented Node Manager from starting nodes for a job that
requested a number of nodes equal to the daemon's max_nodes setting.
No issue #.

10 years ago4091: update jobs fixture to set same created_at timestamp for some of the jobs.
radhika [Tue, 28 Oct 2014 17:16:43 +0000 (13:16 -0400)]
4091: update jobs fixture to set same created_at timestamp for some of the jobs.

10 years ago4091: enhance code to handle the case where there are more than one item in the next...
radhika [Tue, 28 Oct 2014 16:18:17 +0000 (12:18 -0400)]
4091: enhance code to handle the case where there are more than one item in the next page matching the previous page's last object's created_at time.
Also, handle the case where the entire next page has the same created_at time as the previous page's last item; to keep things simple, stop scrolling in this case.

10 years ago4088: filter collection file view by regex
Tim Pierce [Tue, 28 Oct 2014 15:14:47 +0000 (11:14 -0400)]
4088: filter collection file view by regex

Added a "Filter" field for supplying a regular expression to filter
filenames. Updated integration tests.

10 years ago3824: Remove redundant addition of arvados package repo and key.
Tom Clegg [Tue, 28 Oct 2014 14:59:40 +0000 (10:59 -0400)]
3824: Remove redundant addition of arvados package repo and key.

10 years ago3824: Add sources.list file missing from commit:0f9aaf1
Tom Clegg [Tue, 28 Oct 2014 14:35:13 +0000 (10:35 -0400)]
3824: Add sources.list file missing from commit:0f9aaf1

10 years ago3618: remove unnecessary "raw" directive for the sort columns table header attribute
Phil Hodgson [Tue, 28 Oct 2014 10:48:46 +0000 (11:48 +0100)]
3618: remove unnecessary "raw" directive for the sort columns table header attribute

10 years ago3824: Fix up logging messages.
Tom Clegg [Tue, 28 Oct 2014 05:06:02 +0000 (01:06 -0400)]
3824: Fix up logging messages.

10 years ago3706: Merge branch 'master' into 3706-keep-warning
Tom Clegg [Tue, 28 Oct 2014 02:24:35 +0000 (22:24 -0400)]
3706: Merge branch 'master' into 3706-keep-warning

10 years ago3706: Remove automatic normalization. Add --normalize option to
Tom Clegg [Tue, 28 Oct 2014 02:20:22 +0000 (22:20 -0400)]
3706: Remove automatic normalization. Add --normalize option to
arv-put. Add normalize() and stripped_manifest() methods to
CollectionReader. Clean up normalize code.

10 years ago3706: Consolidate more regular expressions into util package.
Tom Clegg [Tue, 28 Oct 2014 02:12:53 +0000 (22:12 -0400)]
3706: Consolidate more regular expressions into util package.

10 years ago3706: Do not leave zero-length file segment at end of stream after finish_current_file().
Tom Clegg [Tue, 28 Oct 2014 02:08:24 +0000 (22:08 -0400)]
3706: Do not leave zero-length file segment at end of stream after finish_current_file().

10 years ago3706: In CollectionReader, try fetching manifests before/after API
Tom Clegg [Tue, 28 Oct 2014 02:04:54 +0000 (22:04 -0400)]
3706: In CollectionReader, try fetching manifests before/after API
server when the ID is a Keep locator with/without a permission hint
respectively. Do not display a warning if the manifest is found one
way or the other.

10 years ago4031: Refresh provenance helper graph generation to fix bugs and make better
Peter Amstutz [Mon, 27 Oct 2014 21:04:43 +0000 (17:04 -0400)]
4031: Refresh provenance helper graph generation to fix bugs and make better
use of available human readable names such as collections and components.  Added tests.

10 years ago4091: retain filters in project contents collections and similar tabs.
radhika [Mon, 27 Oct 2014 20:38:38 +0000 (16:38 -0400)]
4091: retain filters in project contents collections and similar tabs.

10 years agoMerge branch 'master' into 4091-test-infinite-scrolling
radhika [Mon, 27 Oct 2014 20:24:07 +0000 (16:24 -0400)]
Merge branch 'master' into 4091-test-infinite-scrolling

10 years ago4091: change project contents order from uuid to created_at.
radhika [Mon, 27 Oct 2014 20:23:21 +0000 (16:23 -0400)]
4091: change project contents order from uuid to created_at.

10 years agoMerge branch '4015-collection-chooser-portable-data-hash'
Tim Pierce [Mon, 27 Oct 2014 20:13:12 +0000 (16:13 -0400)]
Merge branch '4015-collection-chooser-portable-data-hash'

Fixes #4015.

10 years ago4015: update FUSE mount tests (again)
Tim Pierce [Mon, 27 Oct 2014 19:49:00 +0000 (15:49 -0400)]
4015: update FUSE mount tests (again)

10 years ago4015: simplify integration tests
Tim Pierce [Mon, 27 Oct 2014 18:06:12 +0000 (14:06 -0400)]
4015: simplify integration tests

Responding to code review in #4015-8:

We can (and should) test that the collection portable_data_hash is
recorded in individual tests without adding explicit new tests or
fixtures.

Updated test 'Create and run a pipeline' and the helper
create_and_run_pipeline_in_aproject to check that the collection
portable_data_hash, uuid and name have been recorded correctly in the
Advanced tab.

10 years agoMerge branch 'master' into 4091-test-infinite-scrolling
radhika [Mon, 27 Oct 2014 17:46:33 +0000 (13:46 -0400)]
Merge branch 'master' into 4091-test-infinite-scrolling

10 years agoMerge branch '4297-dispatch-load' refs #4297
Tom Clegg [Mon, 27 Oct 2014 17:35:34 +0000 (13:35 -0400)]
Merge branch '4297-dispatch-load' refs #4297

10 years ago3706: Silence fallback-to-keep warning, show both errors (API and Keep) if both fail.
Tom Clegg [Mon, 27 Oct 2014 17:35:28 +0000 (13:35 -0400)]
3706: Silence fallback-to-keep warning, show both errors (API and Keep) if both fail.

10 years ago4297: Merge branch 'master' into 4297-dispatch-load
Tom Clegg [Mon, 27 Oct 2014 16:54:16 +0000 (12:54 -0400)]
4297: Merge branch 'master' into 4297-dispatch-load

10 years ago4297: Rename @have_tags -> @job_tags, @have_commits -> @fetched_commits. Add comments.
Tom Clegg [Mon, 27 Oct 2014 16:53:28 +0000 (12:53 -0400)]
4297: Rename @have_tags -> @job_tags, @have_commits -> @fetched_commits. Add comments.

10 years ago4297: Use save! instead of save to ensure failures get logged.
Tom Clegg [Mon, 27 Oct 2014 16:52:52 +0000 (12:52 -0400)]
4297: Use save! instead of save to ensure failures get logged.

10 years ago3824: Use keep volumes big enough to store the arvados/jobs docker image. Do not...
Tom Clegg [Thu, 23 Oct 2014 20:39:07 +0000 (16:39 -0400)]
3824: Use keep volumes big enough to store the arvados/jobs docker image. Do not clobber settings.conf if not starting apiserver.

10 years ago3824: Do not say "There are jobs in the queue ahead of this one" if queue_position...
Tom Clegg [Thu, 23 Oct 2014 20:38:04 +0000 (16:38 -0400)]
3824: Do not say "There are  jobs in the queue ahead of this one" if queue_position is unknown.

10 years ago3824: Add dnsmasq to compute images, to make docker-in-docker work. refs #3333
Tom Clegg [Thu, 23 Oct 2014 20:35:05 +0000 (16:35 -0400)]
3824: Add dnsmasq to compute images, to make docker-in-docker work. refs #3333

10 years ago3824: Use a docker volume for TASK_WORK, clean up env var and tmp dir handling, impro...
Tom Clegg [Thu, 23 Oct 2014 17:19:31 +0000 (13:19 -0400)]
3824: Use a docker volume for TASK_WORK, clean up env var and tmp dir handling, improve logging.

10 years agocloses #4285
radhika [Mon, 27 Oct 2014 15:38:01 +0000 (11:38 -0400)]
closes #4285
Merge branch '4285-view-download-collection-subdir-files'

10 years ago4285: use regexp to prepent ./ to file path
radhika [Mon, 27 Oct 2014 15:28:19 +0000 (11:28 -0400)]
4285: use regexp to prepent ./ to file path

10 years ago3618: best guesses about which database columns could be used for sorting (not certai...
Phil Hodgson [Sun, 26 Oct 2014 12:25:02 +0000 (13:25 +0100)]
3618: best guesses about which database columns could be used for sorting (not certain about the descriptions, though, in many cases)

10 years ago3618: When changing to sorting on a different column, make sure the directional indic...
Phil Hodgson [Sun, 26 Oct 2014 12:24:19 +0000 (13:24 +0100)]
3618: When changing to sorting on a different column, make sure the directional indicator of the previous is removed.

10 years ago3618: Add Workbench integration test for sorting data collections
Phil Hodgson [Sat, 25 Oct 2014 18:57:02 +0000 (20:57 +0200)]
3618: Add Workbench integration test for sorting data collections

10 years ago3618: correctly propagate the ordering parameters when scrolling
Phil Hodgson [Sat, 25 Oct 2014 18:56:23 +0000 (20:56 +0200)]
3618: correctly propagate the ordering parameters when scrolling

10 years ago4285: prepend './' to file path being retrieved when it is in a subdir in a collection.
radhika [Sat, 25 Oct 2014 14:01:40 +0000 (10:01 -0400)]
4285: prepend './' to file path being retrieved when it is in a subdir in a collection.

10 years ago3618: Add some basic API server tests for the sort feature
Phil Hodgson [Sat, 25 Oct 2014 08:18:57 +0000 (10:18 +0200)]
3618: Add some basic API server tests for the sort feature

10 years agoMerge branch 'master' into 4091-test-infinite-scrolling
radhika [Fri, 24 Oct 2014 19:01:55 +0000 (15:01 -0400)]
Merge branch 'master' into 4091-test-infinite-scrolling

10 years ago4091: add offset to next page url
radhika [Fri, 24 Oct 2014 19:00:09 +0000 (15:00 -0400)]
4091: add offset to next page url

10 years agoMerge branch '3699-arv-copy'
Tim Pierce [Fri, 24 Oct 2014 17:58:15 +0000 (13:58 -0400)]
Merge branch '3699-arv-copy'

Refs #3699.

10 years ago3699: fix namespace clash: rename module to arv_copy
Tim Pierce [Fri, 24 Oct 2014 17:57:23 +0000 (13:57 -0400)]
3699: fix namespace clash: rename module to arv_copy

Prevents confusion with the Python 'copy' module.

No issue # (bug fix)

10 years ago3618: replace js use of == and != with the more predictable === and !==
Phil Hodgson [Fri, 24 Oct 2014 17:40:01 +0000 (19:40 +0200)]
3618: replace js use of == and != with the more predictable === and !==

10 years agoMerge branch '3699-arv-copy'
Tim Pierce [Fri, 24 Oct 2014 17:20:48 +0000 (13:20 -0400)]
Merge branch '3699-arv-copy'

Closes #3699.

10 years agoMerge branch 'master' into 4091-test-infinite-scrolling
radhika [Fri, 24 Oct 2014 14:19:19 +0000 (10:19 -0400)]
Merge branch 'master' into 4091-test-infinite-scrolling

10 years ago4091: adjust the test fixture to use less data to match the limit size of 100 for...
radhika [Fri, 24 Oct 2014 14:17:56 +0000 (10:17 -0400)]
4091: adjust the test fixture to use less data to match the limit size of 100 for the Jobs and pipelines tab in project.

10 years agoIncrease the timeout on "lots of events" websocket test. refs #4295
Peter Amstutz [Fri, 24 Oct 2014 14:13:56 +0000 (10:13 -0400)]
Increase the timeout on "lots of events" websocket test.  refs #4295

10 years agoMerge branch '4295-efficient-websockets' closes #4295
Peter Amstutz [Fri, 24 Oct 2014 13:03:07 +0000 (09:03 -0400)]
Merge branch '4295-efficient-websockets' closes #4295

10 years ago4295: Use EventMachine::schedule when there is potentially more events to send instea...
Peter Amstutz [Fri, 24 Oct 2014 13:02:40 +0000 (09:02 -0400)]
4295: Use EventMachine::schedule when there is potentially more events to send instead of pushing an event to the channel (which wakes up all listeners).

10 years ago4295: Fix typo in comment
Peter Amstutz [Fri, 24 Oct 2014 12:47:45 +0000 (08:47 -0400)]
4295: Fix typo in comment

10 years agoMerge branch 'master' into 3618-column-ordering
Phil Hodgson [Fri, 24 Oct 2014 12:06:45 +0000 (14:06 +0200)]
Merge branch 'master' into 3618-column-ordering

10 years agoMerge branch 'master' into 4091-test-infinite-scrolling
radhika [Fri, 24 Oct 2014 10:10:50 +0000 (06:10 -0400)]
Merge branch 'master' into 4091-test-infinite-scrolling

10 years agoMerge branch 'master' into 4015-collection-chooser-portable-data-hash
Tim Pierce [Thu, 23 Oct 2014 22:35:19 +0000 (18:35 -0400)]
Merge branch 'master' into 4015-collection-chooser-portable-data-hash

10 years ago4015: fix pipeline instance tests
Tim Pierce [Thu, 23 Oct 2014 22:34:03 +0000 (18:34 -0400)]
4015: fix pipeline instance tests

10 years agocloses #4195
radhika [Thu, 23 Oct 2014 22:01:02 +0000 (18:01 -0400)]
closes #4195
Merge branch '4195-pipeline-tutorial'

10 years agoMerge branch 'master' into 4195-pipeline-tutorial
radhika [Thu, 23 Oct 2014 22:00:12 +0000 (18:00 -0400)]
Merge branch 'master' into 4195-pipeline-tutorial

10 years ago4195: update workbench dashboard pic
radhika [Thu, 23 Oct 2014 21:59:04 +0000 (17:59 -0400)]
4195: update workbench dashboard pic

10 years agoMerge branch '4186-install-doc-improvements'
Ward Vandewege [Thu, 23 Oct 2014 21:32:00 +0000 (17:32 -0400)]
Merge branch '4186-install-doc-improvements'

refs #4186

10 years agoMerge branch 'master' into 4186-install-doc-improvements
Ward Vandewege [Thu, 23 Oct 2014 21:31:38 +0000 (17:31 -0400)]
Merge branch 'master' into 4186-install-doc-improvements

10 years agoMerge branch 'master' into 4195-pipeline-tutorial
radhika [Thu, 23 Oct 2014 21:24:29 +0000 (17:24 -0400)]
Merge branch 'master' into 4195-pipeline-tutorial

10 years agocloses #4228
radhika [Thu, 23 Oct 2014 21:23:00 +0000 (17:23 -0400)]
closes #4228
Merge branch '4228-collection-subdir-files'

10 years agoMerge branch 'master' into 4195-pipeline-tutorial
radhika [Thu, 23 Oct 2014 21:03:44 +0000 (17:03 -0400)]
Merge branch 'master' into 4195-pipeline-tutorial

10 years ago4015: test recording collection hashes for pipeline inputs
Tim Pierce [Thu, 23 Oct 2014 21:00:54 +0000 (17:00 -0400)]
4015: test recording collection hashes for pipeline inputs

10 years ago4015: use portable_data_hash to populate chooser
Tim Pierce [Wed, 22 Oct 2014 16:44:53 +0000 (12:44 -0400)]
4015: use portable_data_hash to populate chooser

10 years agoAdd install dependencies for the SSO server.
Ward Vandewege [Thu, 23 Oct 2014 20:58:53 +0000 (16:58 -0400)]
Add install dependencies for the SSO server.

refs #4186

10 years agoMerge branch 'master' into 4228-collection-subdir-files
radhika [Thu, 23 Oct 2014 20:52:06 +0000 (16:52 -0400)]
Merge branch 'master' into 4228-collection-subdir-files

Conflicts:
apps/workbench/test/integration/collections_test.rb

10 years agorefs #4227
radhika [Thu, 23 Oct 2014 20:36:32 +0000 (16:36 -0400)]
refs #4227
Merge branch '4227-test-fix'

10 years agoExplain the Keepstore's -permission-key-file argument and API server's
Ward Vandewege [Thu, 23 Oct 2014 20:29:31 +0000 (16:29 -0400)]
Explain the Keepstore's -permission-key-file argument and API server's
blob_signing_key configuration value.

refs #4186

10 years agono issue #
radhika [Thu, 23 Oct 2014 20:27:02 +0000 (16:27 -0400)]
no issue #

10 years agono issue #
radhika [Thu, 23 Oct 2014 20:24:00 +0000 (16:24 -0400)]
no issue #
Merge branch 'master' of git.curoverse.com:arvados

10 years agorefs #4227 - update strptime format for parsing pipeline start and finish time.
radhika [Thu, 23 Oct 2014 20:22:50 +0000 (16:22 -0400)]
refs #4227 - update strptime format for parsing pipeline start and finish time.

10 years ago4295: Abort on NoMemoryError
Peter Amstutz [Thu, 23 Oct 2014 20:22:48 +0000 (16:22 -0400)]
4295: Abort on NoMemoryError

10 years agoFirst set of improvements:
Ward Vandewege [Thu, 23 Oct 2014 19:59:23 +0000 (15:59 -0400)]
First set of improvements:

* Suggest skipping SSO server installation for now, until we upgrade that codebase

* Be more explicit about the desired values for arvados_login_base and
  arvados_v1_base in the workbench installation instructions.

refs #4186

10 years ago4295: Add test that large numbers of events are handled efficiently and correctly.
Peter Amstutz [Thu, 23 Oct 2014 19:52:04 +0000 (15:52 -0400)]
4295: Add test that large numbers of events are handled efficiently and correctly.

10 years agoMerge branch '4139-clean-api-node-cruft-wip'
Brett Smith [Thu, 23 Oct 2014 19:44:35 +0000 (15:44 -0400)]
Merge branch '4139-clean-api-node-cruft-wip'

Refs #4139, #4274.  Closes #4276.

10 years ago4139: Node create API requires a node parameter.
Brett Smith [Thu, 23 Oct 2014 19:36:52 +0000 (15:36 -0400)]
4139: Node create API requires a node parameter.

This makes it more consistent with other API create methods.

10 years ago4139: Remove cloud node setup code from API server.
Brett Smith [Tue, 21 Oct 2014 14:58:59 +0000 (10:58 -0400)]
4139: Remove cloud node setup code from API server.

This code has never been used in production, and its functionality has
officially been assumed by Node Manager.

10 years ago4297: Cache results of git-fetch-pack, git-tag, and API token
Tom Clegg [Thu, 23 Oct 2014 19:39:40 +0000 (15:39 -0400)]
4297: Cache results of git-fetch-pack, git-tag, and API token
creation. Fail jobs on git repo/version failures instead of retrying
forever.

10 years agorefs #4227 - rescue from any error in parsing pipeline start and finish time so that...
radhika [Thu, 23 Oct 2014 19:37:52 +0000 (15:37 -0400)]
refs #4227 - rescue from any error in parsing pipeline start and finish time so that jenkins runs do not choke on these failures.

10 years ago4295: Fixed tests
Peter Amstutz [Thu, 23 Oct 2014 19:29:09 +0000 (15:29 -0400)]
4295: Fixed tests

10 years ago4295: First pass at more efficient database utilization. A few tests fail.
Peter Amstutz [Thu, 23 Oct 2014 19:22:21 +0000 (15:22 -0400)]
4295: First pass at more efficient database utilization.  A few tests fail.

10 years ago4297: Do not update_node_status more than once per second.
Tom Clegg [Thu, 23 Oct 2014 18:53:24 +0000 (14:53 -0400)]
4297: Do not update_node_status more than once per second.

10 years agoIncrease limit for collections controller querying same portable_data_hash as
Peter Amstutz [Thu, 23 Oct 2014 17:53:31 +0000 (13:53 -0400)]
Increase limit for collections controller querying same portable_data_hash as
workaround to fix tests, refs #4058, but really needs a proper fix, refs #3400

10 years ago3699: figure out correct docker image to fetch
Tim Pierce [Thu, 23 Oct 2014 17:36:10 +0000 (13:36 -0400)]
3699: figure out correct docker image to fetch

Use arvados.commands.keepdocker.list_images_in_arv to figure out which
Docker image is represented by a given image name+tag.

10 years agoMerge branch '4058-workbench-collection-redirect' closes #4058
Peter Amstutz [Thu, 23 Oct 2014 15:18:54 +0000 (11:18 -0400)]
Merge branch '4058-workbench-collection-redirect' closes #4058

10 years ago4058: Typo fix "collection" -> "collections"
Peter Amstutz [Thu, 23 Oct 2014 15:18:29 +0000 (11:18 -0400)]
4058: Typo fix "collection" -> "collections"

10 years ago4058: Tweaked presentation per review feedback
Peter Amstutz [Thu, 23 Oct 2014 13:38:15 +0000 (09:38 -0400)]
4058: Tweaked presentation per review feedback

10 years ago4091: pass limit parameter from project tabs.
radhika [Thu, 23 Oct 2014 13:37:40 +0000 (09:37 -0400)]
4091: pass limit parameter from project tabs.

10 years agocloses #4026
radhika [Thu, 23 Oct 2014 02:25:46 +0000 (22:25 -0400)]
closes #4026
Merge branch '4026-project-move-admin'

10 years ago4026: simplify writable check
radhika [Thu, 23 Oct 2014 02:24:37 +0000 (22:24 -0400)]
4026: simplify writable check

10 years agoMerge branch 'master' into 4026-project-move-admin
radhika [Thu, 23 Oct 2014 00:10:17 +0000 (20:10 -0400)]
Merge branch 'master' into 4026-project-move-admin

10 years agoMerge branch 'master' into 4228-collection-subdir-files
radhika [Wed, 22 Oct 2014 23:38:11 +0000 (19:38 -0400)]
Merge branch 'master' into 4228-collection-subdir-files

10 years ago4228: add test for combining files from a collection subdir.
radhika [Wed, 22 Oct 2014 23:12:55 +0000 (19:12 -0400)]
4228: add test for combining files from a collection subdir.

10 years ago4228: fix arv_normalize input when a file in a subdir of a collection is being combined.
radhika [Wed, 22 Oct 2014 21:18:25 +0000 (17:18 -0400)]
4228: fix arv_normalize input when a file in a subdir of a collection is being combined.

10 years ago3699: copy docker image links
Tim Pierce [Wed, 22 Oct 2014 20:28:33 +0000 (16:28 -0400)]
3699: copy docker image links

copy_docker_images and copy_docker_image copy any docker image
collections and add 'docker_image_repo+tag' and 'docker_image_hash'
links as necessary at the destination.

10 years ago4228: fix arv_normalize input when a file in a subdir of a collection is being combined.
radhika [Wed, 22 Oct 2014 20:17:50 +0000 (16:17 -0400)]
4228: fix arv_normalize input when a file in a subdir of a collection is being combined.

10 years ago4137: Fix bad state reference in Node Manager daemon.
Brett Smith [Wed, 22 Oct 2014 19:13:09 +0000 (15:13 -0400)]
4137: Fix bad state reference in Node Manager daemon.

Refs #4137.

10 years agocloses #4227
radhika [Wed, 22 Oct 2014 18:57:27 +0000 (14:57 -0400)]
closes #4227
Merge branch '4227-date-display'

10 years agoMerge branch 'master' into 4227-date-display
radhika [Wed, 22 Oct 2014 18:55:55 +0000 (14:55 -0400)]
Merge branch 'master' into 4227-date-display

Conflicts:
apps/workbench/test/integration/projects_test.rb