Misha Zatsman [Wed, 9 Apr 2014 20:44:50 +0000 (20:44 +0000)]
Added method to computed weighted cost of different replication levels. Added main method to aid in unit testing.
Misha Zatsman [Wed, 9 Apr 2014 16:56:55 +0000 (16:56 +0000)]
Started reporting unweighted persist usage based on requested replication, not actual replication. refs #2572
Misha Zatsman [Tue, 8 Apr 2014 17:30:27 +0000 (17:30 +0000)]
Added ability to disable server by specifying port 0. Started keeping api reponse just in case. Started tracking replication level for peristers (although still working on using it everywhere). Added maxdict to make replication tracking easier.
Misha Zatsman [Mon, 7 Apr 2014 18:28:57 +0000 (18:28 +0000)]
Added handler for collections. Also renamed byte_size to byteSize to follow method naming convention.
Misha Zatsman [Mon, 7 Apr 2014 16:57:52 +0000 (16:57 +0000)]
Added user page. Started using send_error. Added port flag.
Misha Zatsman [Sat, 5 Apr 2014 02:01:24 +0000 (02:01 +0000)]
Started using global to actually assign to global variables instead of local variables that shadow them. Added webserver and threads!
Misha Zatsman [Sat, 5 Apr 2014 00:43:06 +0000 (00:43 +0000)]
Moved main flow into loadAllData method to get ready for multithreading.
Misha Zatsman [Fri, 4 Apr 2014 22:03:45 +0000 (22:03 +0000)]
Added logging to datamanager, as a step towards writing http server.
Misha Zatsman [Tue, 1 Apr 2014 19:59:14 +0000 (19:59 +0000)]
Modified algorithm to take disk replication when counting usage.
Misha Zatsman [Tue, 1 Apr 2014 19:46:45 +0000 (19:46 +0000)]
Added manifest size to calculations.
Misha Zatsman [Tue, 1 Apr 2014 15:39:18 +0000 (15:39 +0000)]
Merge branch 'master' of git.curoverse.com:arvados into 1968-monitor-disk-usage
Tom Clegg [Tue, 1 Apr 2014 03:29:16 +0000 (23:29 -0400)]
Move keep mount point outside TASK_WORK directory to prevent conflict
with arvados.util.clear_tmp().
Tom Clegg [Tue, 1 Apr 2014 03:28:13 +0000 (23:28 -0400)]
Add repository=arvados now required by jobs.create.
Tom Clegg [Fri, 28 Mar 2014 21:14:52 +0000 (17:14 -0400)]
Bump arvados-cli version to use output_is_persistent feature. refs #1932
Tom Clegg [Fri, 28 Mar 2014 19:21:03 +0000 (15:21 -0400)]
Merge branch '1932-job-output-persistent'
closes #1932
Tom Clegg [Fri, 28 Mar 2014 18:52:18 +0000 (14:52 -0400)]
Fetch --tags, otherwise we miss out on commits that are tagged but are
not on a branch.
Tom Clegg [Fri, 28 Mar 2014 16:51:29 +0000 (12:51 -0400)]
Add dependency on latest arv-run-pipeline-instance.
Tom Clegg [Fri, 28 Mar 2014 16:31:14 +0000 (12:31 -0400)]
Clarify c_already_finished comments.
Tim Pierce [Fri, 28 Mar 2014 15:58:32 +0000 (11:58 -0400)]
Merge branch '2291-new-keepd-read-blocks'
Tim Pierce [Fri, 28 Mar 2014 15:56:08 +0000 (11:56 -0400)]
Addressing code review comments (refs #2485, refs #2295)
os.Remove(f.Name()) is clearer and less scary than os.Remove(PROC_MOUNTS).
Tim Pierce [Fri, 28 Mar 2014 15:08:11 +0000 (11:08 -0400)]
Unit test for FindKeepVolumes (refs #2295)
Tom Clegg [Fri, 28 Mar 2014 00:51:07 +0000 (20:51 -0400)]
Move "empty blob" magic number into a Collection class method, remove
some old unused code and commented-out debug statements.
Tom Clegg [Fri, 28 Mar 2014 00:30:08 +0000 (20:30 -0400)]
Fix some whitespace complaints.
Tom Clegg [Fri, 28 Mar 2014 00:25:07 +0000 (20:25 -0400)]
Merge branch 'master' into 1932-job-output-persistent
Conflicts:
doc/user/tutorials/tutorial-firstscript.html.textile.liquid
doc/user/tutorials/tutorial-new-pipeline.html.textile.liquid
sdk/cli/bin/arv-run-pipeline-instance
services/api/db/schema.rb
Tom Clegg [Thu, 27 Mar 2014 22:30:27 +0000 (18:30 -0400)]
Fix migration crash when script_version is nil.
Tom Clegg [Thu, 27 Mar 2014 21:59:34 +0000 (17:59 -0400)]
Ignore "cache directory does not exist" error when clearing cache at
server startup.
radhika chippada [Thu, 27 Mar 2014 21:20:55 +0000 (17:20 -0400)]
Merge branch '2068-reset-user'
radhika chippada [Thu, 27 Mar 2014 21:20:24 +0000 (17:20 -0400)]
reload object before unsetup
Brett Smith [Thu, 27 Mar 2014 21:12:47 +0000 (17:12 -0400)]
doc: Make index adorable.
It's so cute!
radhika chippada [Thu, 27 Mar 2014 19:04:46 +0000 (15:04 -0400)]
minor cleanup
radhika chippada [Thu, 27 Mar 2014 18:48:39 +0000 (14:48 -0400)]
Clean up the users controller
radhika chippada [Thu, 27 Mar 2014 17:47:48 +0000 (13:47 -0400)]
Update tests to match controller updates towards admin_required
radhika chippada [Thu, 27 Mar 2014 16:30:55 +0000 (12:30 -0400)]
Use before_filter admin_required in the users controller for setup and unsetup actions
radhika chippada [Thu, 27 Mar 2014 16:09:23 +0000 (12:09 -0400)]
Improve the api call invocation
radhika chippada [Thu, 27 Mar 2014 15:57:18 +0000 (11:57 -0400)]
Update UI to use button_to instead of link_to to deactivate the user
radhika chippada [Thu, 27 Mar 2014 15:44:53 +0000 (11:44 -0400)]
Merge branch 'master' into 2068-reset-user
radhika chippada [Thu, 27 Mar 2014 15:44:12 +0000 (11:44 -0400)]
Update the text on the deactivate link
radhika chippada [Thu, 27 Mar 2014 15:23:16 +0000 (11:23 -0400)]
Use post method instead of get method when invoking the unsetup method from the api server.
radhika chippada [Thu, 27 Mar 2014 15:05:08 +0000 (11:05 -0400)]
Story #2068: Invoke the user -> unsetup method when an admin user clicks on the deactivate button in workbench
radhika chippada [Thu, 27 Mar 2014 14:10:00 +0000 (10:10 -0400)]
Expose user unsetup method from the API server. Added functional tests.
Peter Amstutz [Thu, 27 Mar 2014 13:27:13 +0000 (09:27 -0400)]
Merged branch 1741-internal-git-repo into 2333-crunch-dispatch-token-management
Peter Amstutz [Thu, 27 Mar 2014 12:54:53 +0000 (08:54 -0400)]
Fixed dangling 'end'
Peter Amstutz [Thu, 27 Mar 2014 12:41:10 +0000 (08:41 -0400)]
Merge branch 'master' into 2333-crunch-dispatch-token-management
Peter Amstutz [Thu, 27 Mar 2014 12:41:01 +0000 (08:41 -0400)]
Stylistic changes based on comments from Tom/Brett
Peter Amstutz [Thu, 27 Mar 2014 12:37:33 +0000 (08:37 -0400)]
Merge branch '2051-nondeterministic-jobs'
Misha Zatsman [Thu, 27 Mar 2014 00:45:02 +0000 (00:45 +0000)]
Deleted unused code, added code to read blocks on keep server.
Misha Zatsman [Wed, 26 Mar 2014 23:11:43 +0000 (23:11 +0000)]
Updated message to be clearer.
Misha Zatsman [Wed, 26 Mar 2014 22:49:01 +0000 (22:49 +0000)]
Initial commit of datamanager.py command line utility. So far all information comes from the python SDK. Future versions will talk to the keep servers as well.
Tim Pierce [Wed, 26 Mar 2014 21:34:50 +0000 (17:34 -0400)]
Merge branch '2291-new-keepd-read-blocks' (fixes #2291)
Tim Pierce [Wed, 26 Mar 2014 21:06:59 +0000 (17:06 -0400)]
Incorporating code review comments (refs #2291, refs #2438)
Tim Pierce [Wed, 26 Mar 2014 20:58:49 +0000 (16:58 -0400)]
Improve readability of unit tests. (refs #2291)
Pass *testing.T object into setup/store functions to reduce
error-checking overhead.
Tom Clegg [Tue, 25 Mar 2014 22:50:31 +0000 (18:50 -0400)]
Add list of in-progress/planned SDKs.
Tom Clegg [Tue, 25 Mar 2014 22:36:17 +0000 (18:36 -0400)]
Add Ruby SDK page.
Tom Clegg [Tue, 25 Mar 2014 21:38:02 +0000 (17:38 -0400)]
Fix broken links and duplicate titles.
Tom Clegg [Mon, 10 Mar 2014 23:00:38 +0000 (19:00 -0400)]
Add command line SDK page.
Tom Clegg [Mon, 10 Mar 2014 22:33:17 +0000 (18:33 -0400)]
Add Perl SDK page.
Peter Amstutz [Wed, 26 Mar 2014 18:58:57 +0000 (14:58 -0400)]
Fixes "sec_error_reused_issuer_and_serial" SSL error in Firefox.
Peter Amstutz [Wed, 26 Mar 2014 18:19:10 +0000 (14:19 -0400)]
Added fix to workbench dashboard so that workbench integration tests pass.
Added slightly helpful failure message to test assertion.
Fixed non-normalized collection uuids in fixtures.
Peter Amstutz [Wed, 26 Mar 2014 17:16:37 +0000 (13:16 -0400)]
Merge branch 'master' into 2051-nondeterministic-jobs
Conflicts:
doc/README
doc/user/tutorials/tutorial-new-pipeline.html.textile.liquid
Peter Amstutz [Wed, 26 Mar 2014 12:57:00 +0000 (08:57 -0400)]
Added more tests and more aggressive input checking.
Tom Clegg [Tue, 25 Mar 2014 23:14:09 +0000 (19:14 -0400)]
Merge branch '2412-do-not-reuse-task-work-dirs'
Peter Amstutz [Tue, 25 Mar 2014 21:01:59 +0000 (17:01 -0400)]
Merge branch 'master' of git.clinicalfuture.com:arvados
Peter Amstutz [Tue, 25 Mar 2014 21:01:45 +0000 (17:01 -0400)]
Fixes #2047: Catch connection errors in 'arv' and report the error nicely
instead of dumping a backtrace.
Tim Pierce [Tue, 25 Mar 2014 20:57:37 +0000 (16:57 -0400)]
Incorporating comments from code review (refs #2438, refs #2291)
Peter Amstutz [Tue, 25 Mar 2014 20:51:57 +0000 (16:51 -0400)]
Reworked input validation on find_commit_range (for real this time!) and added tests.
Fixed descriptive text in tutorial-job1.
Removed dead code.
Brett Smith [Tue, 25 Mar 2014 20:11:48 +0000 (16:11 -0400)]
Merge branch '2288-smoke-test'
Peter Amstutz [Tue, 25 Mar 2014 19:24:55 +0000 (15:24 -0400)]
Removed trailing whitespace.
Peter Amstutz [Tue, 25 Mar 2014 19:24:15 +0000 (15:24 -0400)]
Fixed tests
Improved version string validation in find_commit_range
Removed spurious debugging flags
Removed dead code from commit.rb
Removed trailing whitespace
Fixed capitalization of Arvados in documentation
Brett Smith [Tue, 25 Mar 2014 19:10:24 +0000 (15:10 -0400)]
workbench: Timeout integration test Rails launch.
radhika chippada [Tue, 25 Mar 2014 18:50:38 +0000 (14:50 -0400)]
Merge branch 'master' into 2187-enhance-user-setup
radhika chippada [Tue, 25 Mar 2014 18:50:02 +0000 (14:50 -0400)]
Minor test updates
Peter Amstutz [Tue, 25 Mar 2014 18:40:01 +0000 (14:40 -0400)]
Merge branch 'master' into 2051-nondeterministic-jobs
Brett Smith [Tue, 25 Mar 2014 18:36:48 +0000 (14:36 -0400)]
workbench: Improve integration test Rails launch.
The previous version was susceptible to a race condition where it
would read the file after Rails created it, but before it actually
wrote a pid to it. This would cause the rake test task to kill itself
later by running Process.kill('TERM', 0).
radhika chippada [Tue, 25 Mar 2014 18:09:44 +0000 (14:09 -0400)]
The controller invokes the create links method from the model when working on an existing user.
Brett Smith [Tue, 25 Mar 2014 18:01:23 +0000 (14:01 -0400)]
workbench: Document deployment Bundle testing.
Tom Clegg [Tue, 25 Mar 2014 17:59:20 +0000 (13:59 -0400)]
Update controller action name in functional test. refs #1750
Tom Clegg [Tue, 25 Mar 2014 17:43:24 +0000 (13:43 -0400)]
Merge branch '1750-remove-old-schema-doc'
closes #1750
radhika chippada [Tue, 25 Mar 2014 17:23:28 +0000 (13:23 -0400)]
setup method in user model assumes that the user object passed in is valid and hence no longer tries to find it.
Tim Pierce [Tue, 25 Mar 2014 16:53:40 +0000 (12:53 -0400)]
Unit test TestGetBlockCorrupt. (refs #2291)
radhika chippada [Tue, 25 Mar 2014 16:32:35 +0000 (12:32 -0400)]
Ground work to remove found object logic from user model's setup method
Tom Clegg [Tue, 25 Mar 2014 16:20:18 +0000 (12:20 -0400)]
Merge branch 'master' into 1932-job-output-persistent
Tom Clegg [Tue, 25 Mar 2014 15:33:29 +0000 (11:33 -0400)]
Mark output as persistent at end of job, if Job record says to do so.
Tom Clegg [Tue, 25 Mar 2014 15:27:22 +0000 (11:27 -0400)]
Add/explain output_is_persistent flag in example pipelines.
Tom Clegg [Tue, 25 Mar 2014 15:27:07 +0000 (11:27 -0400)]
Fix reversed input/output in dependency explanation.
radhika chippada [Tue, 25 Mar 2014 14:55:54 +0000 (10:55 -0400)]
Update all functional tests to work with the new response format of List
Tim Pierce [Tue, 25 Mar 2014 14:32:15 +0000 (10:32 -0400)]
Added unit tests TestGetBlockOneKeepOK and TestGetBlockFail (refs #2291)
radhika chippada [Tue, 25 Mar 2014 03:20:05 +0000 (23:20 -0400)]
Update user model to return a List instead of HashList
radhika chippada [Mon, 24 Mar 2014 23:27:35 +0000 (19:27 -0400)]
some minor refactoring
radhika chippada [Mon, 24 Mar 2014 22:53:58 +0000 (18:53 -0400)]
When uuid is passed, openid_prefix can be optional
radhika chippada [Mon, 24 Mar 2014 22:10:32 +0000 (18:10 -0400)]
Merge branch 'master' into 2187-enhance-user-setup
radhika chippada [Mon, 24 Mar 2014 22:09:24 +0000 (18:09 -0400)]
More unit testing
radhika chippada [Mon, 24 Mar 2014 22:05:08 +0000 (18:05 -0400)]
Add unit test for user model
Tim Pierce [Mon, 24 Mar 2014 21:15:43 +0000 (17:15 -0400)]
Adding unit tests for GetBlock. (refs #2291)
Ward Vandewege [Mon, 24 Mar 2014 20:16:10 +0000 (16:16 -0400)]
Allow disabling of output for rake config:check via a QUIET environment
variable.
Ward Vandewege [Mon, 24 Mar 2014 19:55:29 +0000 (15:55 -0400)]
Do not print secrets in the config:check rake task.
radhika chippada [Mon, 24 Mar 2014 18:19:48 +0000 (14:19 -0400)]
Merge branch 'master' into 2187-enhance-user-setup
radhika chippada [Mon, 24 Mar 2014 18:17:39 +0000 (14:17 -0400)]
Include first link of a given type even on reruns of the setup method.
Tom Clegg [Mon, 24 Mar 2014 14:24:47 +0000 (10:24 -0400)]
Merge branch '2209-test-limit-offset'
closes #2209
Tom Clegg [Mon, 24 Mar 2014 14:22:20 +0000 (10:22 -0400)]
Merge branch '2290-user-activity'
closes #2290
radhika chippada [Mon, 24 Mar 2014 13:02:04 +0000 (09:02 -0400)]
Merge branch 'master' into 2187-enhance-user-setup
projects / arvados.git / log