arvados.git
10 years agoMerge branch 'master' into 3618-column-ordering
Phil Hodgson [Fri, 31 Oct 2014 12:56:01 +0000 (13:56 +0100)]
Merge branch 'master' into 3618-column-ordering

Conflicts (all resolved including fixes):
apps/workbench/app/controllers/projects_controller.rb
apps/workbench/app/views/projects/_show_jobs_and_pipelines.html.erb
apps/workbench/app/views/projects/_show_tab_contents.html.erb
services/api/app/controllers/arvados/v1/groups_controller.rb

10 years agoMerge branch '3824-crunch-container-setup' closes #3824
Tom Clegg [Thu, 30 Oct 2014 21:13:31 +0000 (17:13 -0400)]
Merge branch '3824-crunch-container-setup' closes #3824

10 years ago3824: Merge branch 'master' into 3824-crunch-container-setup
Tom Clegg [Thu, 30 Oct 2014 21:13:23 +0000 (17:13 -0400)]
3824: Merge branch 'master' into 3824-crunch-container-setup

10 years ago3824: Fix comment to state that tasks must not assume $TASK_KEEPMOUNT is /keep.
Tom Clegg [Thu, 30 Oct 2014 21:05:25 +0000 (17:05 -0400)]
3824: Fix comment to state that tasks must not assume $TASK_KEEPMOUNT is /keep.

10 years agoFix google-api-client version deps. No issue #
Tom Clegg [Thu, 30 Oct 2014 20:33:23 +0000 (16:33 -0400)]
Fix google-api-client version deps. No issue #

10 years agoMerge branch '4359-project-paging' closes #4359
Tom Clegg [Thu, 30 Oct 2014 20:30:56 +0000 (16:30 -0400)]
Merge branch '4359-project-paging' closes #4359

10 years agoMerge branch '4088-filterable-docs' refs #4088
Tom Clegg [Thu, 30 Oct 2014 20:13:35 +0000 (16:13 -0400)]
Merge branch '4088-filterable-docs' refs #4088

10 years ago3824: Import GPG key needed for RVM installation.
Tom Clegg [Thu, 30 Oct 2014 18:48:05 +0000 (14:48 -0400)]
3824: Import GPG key needed for RVM installation.

10 years ago3824: Remove redundant "apt-get update", standardize on "apt-get update -qq" and...
Tom Clegg [Thu, 30 Oct 2014 18:27:58 +0000 (14:27 -0400)]
3824: Remove redundant "apt-get update", standardize on "apt-get update -qq" and "apt-get install -qqy".

10 years ago3824: Set mode on /etc/fuse.conf in compute image.
Tom Clegg [Thu, 30 Oct 2014 18:04:14 +0000 (14:04 -0400)]
3824: Set mode on /etc/fuse.conf in compute image.

10 years ago4307: Workbench: only pipeline components are not editable after start.
Brett Smith [Thu, 30 Oct 2014 17:45:10 +0000 (13:45 -0400)]
4307: Workbench: only pipeline components are not editable after start.

This fixes a regression from d7fdbbab.  Closes #4307.

10 years ago4088: Add usage docs to filterable.js
Tom Clegg [Thu, 30 Oct 2014 17:43:34 +0000 (13:43 -0400)]
4088: Add usage docs to filterable.js

10 years ago3824: Bring back $! in error message, in case it's helpful.
Tom Clegg [Thu, 30 Oct 2014 17:05:17 +0000 (13:05 -0400)]
3824: Bring back $! in error message, in case it's helpful.

10 years ago3824: Merge branch 'master' into 3824-crunch-container-setup
Tom Clegg [Thu, 30 Oct 2014 17:02:56 +0000 (13:02 -0400)]
3824: Merge branch 'master' into 3824-crunch-container-setup

10 years ago3824: Use Data::Dumper instead of custom quoting to show srun/task exec args.
Tom Clegg [Thu, 30 Oct 2014 17:00:05 +0000 (13:00 -0400)]
3824: Use Data::Dumper instead of custom quoting to show srun/task exec args.

10 years ago4091: Use <=N instead of <N+1. Pass "uuid not in" filter to API instead of adding...
Tom Clegg [Wed, 29 Oct 2014 21:06:17 +0000 (17:06 -0400)]
4091: Use <=N instead of <N+1. Pass "uuid not in" filter to API instead of adding custom filter params.

10 years agocloses #4091
radhika [Wed, 29 Oct 2014 19:23:45 +0000 (15:23 -0400)]
closes #4091
Merge branch '4091-test-infinite-scrolling'

10 years agoMerge branch 'master' into 4091-test-infinite-scrolling
radhika [Wed, 29 Oct 2014 19:23:07 +0000 (15:23 -0400)]
Merge branch 'master' into 4091-test-infinite-scrolling

10 years ago4091: set the limit size to 50 for "Jobs and pipelines" tab.
radhika [Wed, 29 Oct 2014 19:21:45 +0000 (15:21 -0400)]
4091: set the limit size to 50 for "Jobs and pipelines" tab.

10 years agoFix Node Manager test bug introduced by last commit.
Brett Smith [Wed, 29 Oct 2014 18:58:59 +0000 (14:58 -0400)]
Fix Node Manager test bug introduced by last commit.

Bad Brett, only running specific tests.  No issue #.

10 years agoFix race condition in Node Manager shutdown tests.
Brett Smith [Wed, 29 Oct 2014 18:22:16 +0000 (14:22 -0400)]
Fix race condition in Node Manager shutdown tests.

ComputeNodeMonitorActor considers a shutdown when it's initialized.
Blocking on the subscription we send ensures that message is fully
processed before the tests continue.  This is important because
several of them change the shutdown state immediately after, and that
might be seen by the internal shutdown consideration without this.

No issue #, but see
<https://ci.curoverse.com/job/arvados-api-server/1027/console>.

10 years agoFix the goldang consarned FUSE tests again.
Tim Pierce [Wed, 29 Oct 2014 16:53:19 +0000 (12:53 -0400)]
Fix the goldang consarned FUSE tests again.

No issue #, dammit

10 years agoMerge branch '4088-collection-show-files-filter'
Tim Pierce [Wed, 29 Oct 2014 16:07:07 +0000 (12:07 -0400)]
Merge branch '4088-collection-show-files-filter'

Refs #4088.

10 years ago4088: filter only on files
Tim Pierce [Wed, 29 Oct 2014 15:40:52 +0000 (11:40 -0400)]
4088: filter only on files

Only apply the regex filter to files; continue to process subdirectories
as normal in order to keep the appropriate filename hierarchy.

10 years ago3618: Make tests pass: bugs were revealed in "Other objects" tab related to there...
Phil Hodgson [Wed, 29 Oct 2014 15:39:56 +0000 (16:39 +0100)]
3618: Make tests pass: bugs were revealed in "Other objects" tab related to there not being any sorting going on there, etc.; add checks for HTML5 history and for nulls and undefineds

10 years ago4088: fix alignment for right-floating input field
Tim Pierce [Wed, 29 Oct 2014 15:19:32 +0000 (11:19 -0400)]
4088: fix alignment for right-floating input field

10 years agoMerge branch 'master' into 3618-column-ordering
Phil Hodgson [Wed, 29 Oct 2014 11:21:14 +0000 (12:21 +0100)]
Merge branch 'master' into 3618-column-ordering

10 years ago3618: store in the browser history state the current sort settings for each tab
Phil Hodgson [Wed, 29 Oct 2014 11:20:08 +0000 (12:20 +0100)]
3618: store in the browser history state the current sort settings for each tab

10 years agoImprove config/application.yml.example for the API server and workbench:
Ward Vandewege [Wed, 29 Oct 2014 02:18:37 +0000 (22:18 -0400)]
Improve config/application.yml.example for the API server and workbench:

* API server: define prefix_uuid in development mode
* workbench: add a production section

No issue #

10 years ago4088: code review feedback
Tim Pierce [Tue, 28 Oct 2014 21:26:58 +0000 (17:26 -0400)]
4088: code review feedback

* Filter files by regex before .take(10000)
* Added "regular expression" placeholder in the filter input box
* Issue a Rails "alert" div if the regex could not be parsed
* Test that we're actually viewing a collection when no matches are
  found (and not a fiddlesticks page or something)

10 years agoFix off-by-one error in Node Manager server calculations.
Brett Smith [Tue, 28 Oct 2014 17:32:05 +0000 (13:32 -0400)]
Fix off-by-one error in Node Manager server calculations.

This bug prevented Node Manager from starting nodes for a job that
requested a number of nodes equal to the daemon's max_nodes setting.
No issue #.

10 years ago4091: update jobs fixture to set same created_at timestamp for some of the jobs.
radhika [Tue, 28 Oct 2014 17:16:43 +0000 (13:16 -0400)]
4091: update jobs fixture to set same created_at timestamp for some of the jobs.

10 years ago4091: enhance code to handle the case where there are more than one item in the next...
radhika [Tue, 28 Oct 2014 16:18:17 +0000 (12:18 -0400)]
4091: enhance code to handle the case where there are more than one item in the next page matching the previous page's last object's created_at time.
Also, handle the case where the entire next page has the same created_at time as the previous page's last item; to keep things simple, stop scrolling in this case.

10 years ago4088: filter collection file view by regex
Tim Pierce [Tue, 28 Oct 2014 15:14:47 +0000 (11:14 -0400)]
4088: filter collection file view by regex

Added a "Filter" field for supplying a regular expression to filter
filenames. Updated integration tests.

10 years ago3824: Remove redundant addition of arvados package repo and key.
Tom Clegg [Tue, 28 Oct 2014 14:59:40 +0000 (10:59 -0400)]
3824: Remove redundant addition of arvados package repo and key.

10 years ago3824: Add sources.list file missing from commit:0f9aaf1
Tom Clegg [Tue, 28 Oct 2014 14:35:13 +0000 (10:35 -0400)]
3824: Add sources.list file missing from commit:0f9aaf1

10 years ago3618: remove unnecessary "raw" directive for the sort columns table header attribute
Phil Hodgson [Tue, 28 Oct 2014 10:48:46 +0000 (11:48 +0100)]
3618: remove unnecessary "raw" directive for the sort columns table header attribute

10 years ago3824: Fix up logging messages.
Tom Clegg [Tue, 28 Oct 2014 05:06:02 +0000 (01:06 -0400)]
3824: Fix up logging messages.

10 years ago4091: retain filters in project contents collections and similar tabs.
radhika [Mon, 27 Oct 2014 20:38:38 +0000 (16:38 -0400)]
4091: retain filters in project contents collections and similar tabs.

10 years agoMerge branch 'master' into 4091-test-infinite-scrolling
radhika [Mon, 27 Oct 2014 20:24:07 +0000 (16:24 -0400)]
Merge branch 'master' into 4091-test-infinite-scrolling

10 years ago4091: change project contents order from uuid to created_at.
radhika [Mon, 27 Oct 2014 20:23:21 +0000 (16:23 -0400)]
4091: change project contents order from uuid to created_at.

10 years agoMerge branch '4015-collection-chooser-portable-data-hash'
Tim Pierce [Mon, 27 Oct 2014 20:13:12 +0000 (16:13 -0400)]
Merge branch '4015-collection-chooser-portable-data-hash'

Fixes #4015.

10 years ago4015: update FUSE mount tests (again)
Tim Pierce [Mon, 27 Oct 2014 19:49:00 +0000 (15:49 -0400)]
4015: update FUSE mount tests (again)

10 years ago4015: simplify integration tests
Tim Pierce [Mon, 27 Oct 2014 18:06:12 +0000 (14:06 -0400)]
4015: simplify integration tests

Responding to code review in #4015-8:

We can (and should) test that the collection portable_data_hash is
recorded in individual tests without adding explicit new tests or
fixtures.

Updated test 'Create and run a pipeline' and the helper
create_and_run_pipeline_in_aproject to check that the collection
portable_data_hash, uuid and name have been recorded correctly in the
Advanced tab.

10 years agoMerge branch 'master' into 4091-test-infinite-scrolling
radhika [Mon, 27 Oct 2014 17:46:33 +0000 (13:46 -0400)]
Merge branch 'master' into 4091-test-infinite-scrolling

10 years agoMerge branch '4297-dispatch-load' refs #4297
Tom Clegg [Mon, 27 Oct 2014 17:35:34 +0000 (13:35 -0400)]
Merge branch '4297-dispatch-load' refs #4297

10 years ago4297: Merge branch 'master' into 4297-dispatch-load
Tom Clegg [Mon, 27 Oct 2014 16:54:16 +0000 (12:54 -0400)]
4297: Merge branch 'master' into 4297-dispatch-load

10 years ago4297: Rename @have_tags -> @job_tags, @have_commits -> @fetched_commits. Add comments.
Tom Clegg [Mon, 27 Oct 2014 16:53:28 +0000 (12:53 -0400)]
4297: Rename @have_tags -> @job_tags, @have_commits -> @fetched_commits. Add comments.

10 years ago4297: Use save! instead of save to ensure failures get logged.
Tom Clegg [Mon, 27 Oct 2014 16:52:52 +0000 (12:52 -0400)]
4297: Use save! instead of save to ensure failures get logged.

10 years ago3824: Use keep volumes big enough to store the arvados/jobs docker image. Do not...
Tom Clegg [Thu, 23 Oct 2014 20:39:07 +0000 (16:39 -0400)]
3824: Use keep volumes big enough to store the arvados/jobs docker image. Do not clobber settings.conf if not starting apiserver.

10 years ago3824: Do not say "There are jobs in the queue ahead of this one" if queue_position...
Tom Clegg [Thu, 23 Oct 2014 20:38:04 +0000 (16:38 -0400)]
3824: Do not say "There are  jobs in the queue ahead of this one" if queue_position is unknown.

10 years ago3824: Add dnsmasq to compute images, to make docker-in-docker work. refs #3333
Tom Clegg [Thu, 23 Oct 2014 20:35:05 +0000 (16:35 -0400)]
3824: Add dnsmasq to compute images, to make docker-in-docker work. refs #3333

10 years ago3824: Use a docker volume for TASK_WORK, clean up env var and tmp dir handling, impro...
Tom Clegg [Thu, 23 Oct 2014 17:19:31 +0000 (13:19 -0400)]
3824: Use a docker volume for TASK_WORK, clean up env var and tmp dir handling, improve logging.

10 years agocloses #4285
radhika [Mon, 27 Oct 2014 15:38:01 +0000 (11:38 -0400)]
closes #4285
Merge branch '4285-view-download-collection-subdir-files'

10 years ago4285: use regexp to prepent ./ to file path
radhika [Mon, 27 Oct 2014 15:28:19 +0000 (11:28 -0400)]
4285: use regexp to prepent ./ to file path

10 years ago3618: best guesses about which database columns could be used for sorting (not certai...
Phil Hodgson [Sun, 26 Oct 2014 12:25:02 +0000 (13:25 +0100)]
3618: best guesses about which database columns could be used for sorting (not certain about the descriptions, though, in many cases)

10 years ago3618: When changing to sorting on a different column, make sure the directional indic...
Phil Hodgson [Sun, 26 Oct 2014 12:24:19 +0000 (13:24 +0100)]
3618: When changing to sorting on a different column, make sure the directional indicator of the previous is removed.

10 years ago3618: Add Workbench integration test for sorting data collections
Phil Hodgson [Sat, 25 Oct 2014 18:57:02 +0000 (20:57 +0200)]
3618: Add Workbench integration test for sorting data collections

10 years ago3618: correctly propagate the ordering parameters when scrolling
Phil Hodgson [Sat, 25 Oct 2014 18:56:23 +0000 (20:56 +0200)]
3618: correctly propagate the ordering parameters when scrolling

10 years ago4285: prepend './' to file path being retrieved when it is in a subdir in a collection.
radhika [Sat, 25 Oct 2014 14:01:40 +0000 (10:01 -0400)]
4285: prepend './' to file path being retrieved when it is in a subdir in a collection.

10 years ago3618: Add some basic API server tests for the sort feature
Phil Hodgson [Sat, 25 Oct 2014 08:18:57 +0000 (10:18 +0200)]
3618: Add some basic API server tests for the sort feature

10 years agoMerge branch 'master' into 4091-test-infinite-scrolling
radhika [Fri, 24 Oct 2014 19:01:55 +0000 (15:01 -0400)]
Merge branch 'master' into 4091-test-infinite-scrolling

10 years ago4091: add offset to next page url
radhika [Fri, 24 Oct 2014 19:00:09 +0000 (15:00 -0400)]
4091: add offset to next page url

10 years agoMerge branch '3699-arv-copy'
Tim Pierce [Fri, 24 Oct 2014 17:58:15 +0000 (13:58 -0400)]
Merge branch '3699-arv-copy'

Refs #3699.

10 years ago3699: fix namespace clash: rename module to arv_copy
Tim Pierce [Fri, 24 Oct 2014 17:57:23 +0000 (13:57 -0400)]
3699: fix namespace clash: rename module to arv_copy

Prevents confusion with the Python 'copy' module.

No issue # (bug fix)

10 years ago3618: replace js use of == and != with the more predictable === and !==
Phil Hodgson [Fri, 24 Oct 2014 17:40:01 +0000 (19:40 +0200)]
3618: replace js use of == and != with the more predictable === and !==

10 years agoMerge branch '3699-arv-copy'
Tim Pierce [Fri, 24 Oct 2014 17:20:48 +0000 (13:20 -0400)]
Merge branch '3699-arv-copy'

Closes #3699.

10 years agoMerge branch 'master' into 4091-test-infinite-scrolling
radhika [Fri, 24 Oct 2014 14:19:19 +0000 (10:19 -0400)]
Merge branch 'master' into 4091-test-infinite-scrolling

10 years ago4091: adjust the test fixture to use less data to match the limit size of 100 for...
radhika [Fri, 24 Oct 2014 14:17:56 +0000 (10:17 -0400)]
4091: adjust the test fixture to use less data to match the limit size of 100 for the Jobs and pipelines tab in project.

10 years agoIncrease the timeout on "lots of events" websocket test. refs #4295
Peter Amstutz [Fri, 24 Oct 2014 14:13:56 +0000 (10:13 -0400)]
Increase the timeout on "lots of events" websocket test.  refs #4295

10 years agoMerge branch '4295-efficient-websockets' closes #4295
Peter Amstutz [Fri, 24 Oct 2014 13:03:07 +0000 (09:03 -0400)]
Merge branch '4295-efficient-websockets' closes #4295

10 years ago4295: Use EventMachine::schedule when there is potentially more events to send instea...
Peter Amstutz [Fri, 24 Oct 2014 13:02:40 +0000 (09:02 -0400)]
4295: Use EventMachine::schedule when there is potentially more events to send instead of pushing an event to the channel (which wakes up all listeners).

10 years ago4295: Fix typo in comment
Peter Amstutz [Fri, 24 Oct 2014 12:47:45 +0000 (08:47 -0400)]
4295: Fix typo in comment

10 years agoMerge branch 'master' into 3618-column-ordering
Phil Hodgson [Fri, 24 Oct 2014 12:06:45 +0000 (14:06 +0200)]
Merge branch 'master' into 3618-column-ordering

10 years agoMerge branch 'master' into 4091-test-infinite-scrolling
radhika [Fri, 24 Oct 2014 10:10:50 +0000 (06:10 -0400)]
Merge branch 'master' into 4091-test-infinite-scrolling

10 years agoMerge branch 'master' into 4015-collection-chooser-portable-data-hash
Tim Pierce [Thu, 23 Oct 2014 22:35:19 +0000 (18:35 -0400)]
Merge branch 'master' into 4015-collection-chooser-portable-data-hash

10 years ago4015: fix pipeline instance tests
Tim Pierce [Thu, 23 Oct 2014 22:34:03 +0000 (18:34 -0400)]
4015: fix pipeline instance tests

10 years agocloses #4195
radhika [Thu, 23 Oct 2014 22:01:02 +0000 (18:01 -0400)]
closes #4195
Merge branch '4195-pipeline-tutorial'

10 years agoMerge branch 'master' into 4195-pipeline-tutorial
radhika [Thu, 23 Oct 2014 22:00:12 +0000 (18:00 -0400)]
Merge branch 'master' into 4195-pipeline-tutorial

10 years ago4195: update workbench dashboard pic
radhika [Thu, 23 Oct 2014 21:59:04 +0000 (17:59 -0400)]
4195: update workbench dashboard pic

10 years agoMerge branch '4186-install-doc-improvements'
Ward Vandewege [Thu, 23 Oct 2014 21:32:00 +0000 (17:32 -0400)]
Merge branch '4186-install-doc-improvements'

refs #4186

10 years agoMerge branch 'master' into 4186-install-doc-improvements
Ward Vandewege [Thu, 23 Oct 2014 21:31:38 +0000 (17:31 -0400)]
Merge branch 'master' into 4186-install-doc-improvements

10 years agoMerge branch 'master' into 4195-pipeline-tutorial
radhika [Thu, 23 Oct 2014 21:24:29 +0000 (17:24 -0400)]
Merge branch 'master' into 4195-pipeline-tutorial

10 years agocloses #4228
radhika [Thu, 23 Oct 2014 21:23:00 +0000 (17:23 -0400)]
closes #4228
Merge branch '4228-collection-subdir-files'

10 years agoMerge branch 'master' into 4195-pipeline-tutorial
radhika [Thu, 23 Oct 2014 21:03:44 +0000 (17:03 -0400)]
Merge branch 'master' into 4195-pipeline-tutorial

10 years ago4015: test recording collection hashes for pipeline inputs
Tim Pierce [Thu, 23 Oct 2014 21:00:54 +0000 (17:00 -0400)]
4015: test recording collection hashes for pipeline inputs

10 years ago4015: use portable_data_hash to populate chooser
Tim Pierce [Wed, 22 Oct 2014 16:44:53 +0000 (12:44 -0400)]
4015: use portable_data_hash to populate chooser

10 years agoAdd install dependencies for the SSO server.
Ward Vandewege [Thu, 23 Oct 2014 20:58:53 +0000 (16:58 -0400)]
Add install dependencies for the SSO server.

refs #4186

10 years agoMerge branch 'master' into 4228-collection-subdir-files
radhika [Thu, 23 Oct 2014 20:52:06 +0000 (16:52 -0400)]
Merge branch 'master' into 4228-collection-subdir-files

Conflicts:
apps/workbench/test/integration/collections_test.rb

10 years agorefs #4227
radhika [Thu, 23 Oct 2014 20:36:32 +0000 (16:36 -0400)]
refs #4227
Merge branch '4227-test-fix'

10 years agoExplain the Keepstore's -permission-key-file argument and API server's
Ward Vandewege [Thu, 23 Oct 2014 20:29:31 +0000 (16:29 -0400)]
Explain the Keepstore's -permission-key-file argument and API server's
blob_signing_key configuration value.

refs #4186

10 years agono issue #
radhika [Thu, 23 Oct 2014 20:27:02 +0000 (16:27 -0400)]
no issue #

10 years agono issue #
radhika [Thu, 23 Oct 2014 20:24:00 +0000 (16:24 -0400)]
no issue #
Merge branch 'master' of git.curoverse.com:arvados

10 years agorefs #4227 - update strptime format for parsing pipeline start and finish time.
radhika [Thu, 23 Oct 2014 20:22:50 +0000 (16:22 -0400)]
refs #4227 - update strptime format for parsing pipeline start and finish time.

10 years ago4295: Abort on NoMemoryError
Peter Amstutz [Thu, 23 Oct 2014 20:22:48 +0000 (16:22 -0400)]
4295: Abort on NoMemoryError

10 years agoFirst set of improvements:
Ward Vandewege [Thu, 23 Oct 2014 19:59:23 +0000 (15:59 -0400)]
First set of improvements:

* Suggest skipping SSO server installation for now, until we upgrade that codebase

* Be more explicit about the desired values for arvados_login_base and
  arvados_v1_base in the workbench installation instructions.

refs #4186

10 years ago4295: Add test that large numbers of events are handled efficiently and correctly.
Peter Amstutz [Thu, 23 Oct 2014 19:52:04 +0000 (15:52 -0400)]
4295: Add test that large numbers of events are handled efficiently and correctly.

10 years agoMerge branch '4139-clean-api-node-cruft-wip'
Brett Smith [Thu, 23 Oct 2014 19:44:35 +0000 (15:44 -0400)]
Merge branch '4139-clean-api-node-cruft-wip'

Refs #4139, #4274.  Closes #4276.

10 years ago4139: Node create API requires a node parameter.
Brett Smith [Thu, 23 Oct 2014 19:36:52 +0000 (15:36 -0400)]
4139: Node create API requires a node parameter.

This makes it more consistent with other API create methods.

10 years ago4139: Remove cloud node setup code from API server.
Brett Smith [Tue, 21 Oct 2014 14:58:59 +0000 (10:58 -0400)]
4139: Remove cloud node setup code from API server.

This code has never been used in production, and its functionality has
officially been assumed by Node Manager.