arvados.git
10 years agoAdded alternate option to one_task_per_input_file to encode specification of input...
Peter Amstutz [Fri, 21 Feb 2014 16:23:46 +0000 (11:23 -0500)]
Added alternate option to one_task_per_input_file to encode specification of input files as collection/stream/file instead of raw manifest text.

10 years agoAdded StreamFileReader.as_manifest() back and added test for it.
Peter Amstutz [Fri, 21 Feb 2014 16:02:34 +0000 (11:02 -0500)]
Added StreamFileReader.as_manifest() back and added test for it.
Refactored manifest text generation a bit.

10 years agoget_job_param_mount() and get_task_param_mount() tested and working.
Peter Amstutz [Thu, 20 Feb 2014 19:33:09 +0000 (19:33 +0000)]
get_job_param_mount() and get_task_param_mount() tested and working.

10 years agoAdded symlink arv-mount, arv-normalize, arv-ls to cli/bin
Peter Amstutz [Thu, 20 Feb 2014 19:25:12 +0000 (19:25 +0000)]
Added symlink arv-mount, arv-normalize, arv-ls to cli/bin

10 years agoAdded get_job_param_mount() and get_task_param_mount()
Peter Amstutz [Thu, 20 Feb 2014 19:25:12 +0000 (14:25 -0500)]
Added get_job_param_mount() and get_task_param_mount()

10 years agoChanged JOB_WORK to TASK_WORK in mounting keep directory.
Peter Amstutz [Thu, 20 Feb 2014 19:18:01 +0000 (14:18 -0500)]
Changed JOB_WORK to TASK_WORK in mounting keep directory.

10 years agoAdded arv-mount
Peter Amstutz [Thu, 20 Feb 2014 18:39:50 +0000 (13:39 -0500)]
Added arv-mount

10 years ago--exec works
Peter Amstutz [Thu, 20 Feb 2014 15:27:33 +0000 (15:27 +0000)]
--exec works

10 years agoAdded --exec, needs testing.
Peter Amstutz [Thu, 20 Feb 2014 15:17:43 +0000 (10:17 -0500)]
Added --exec, needs testing.

10 years agoFixed caching so that reads by other threads for a block which is already
Peter Amstutz [Thu, 20 Feb 2014 03:15:44 +0000 (03:15 +0000)]
Fixed caching so that reads by other threads for a block which is already
being downloaded will block all threads until the block is downloaded.

10 years agocaching wip
Peter Amstutz [Wed, 19 Feb 2014 22:10:26 +0000 (22:10 +0000)]
caching wip

10 years agoAdded test for magic directories.
Peter Amstutz [Wed, 19 Feb 2014 20:29:30 +0000 (15:29 -0500)]
Added test for magic directories.

10 years agoAdded basic unit test for fuse mount.
Peter Amstutz [Wed, 19 Feb 2014 20:24:43 +0000 (15:24 -0500)]
Added basic unit test for fuse mount.

10 years agochanged fusepy to llfuse
Peter Amstutz [Wed, 19 Feb 2014 20:00:40 +0000 (20:00 +0000)]
changed fusepy to llfuse

10 years agoinstalling llfuse from pip instead of debian
Peter Amstutz [Wed, 19 Feb 2014 19:59:09 +0000 (19:59 +0000)]
installing llfuse from pip instead of debian

10 years agoAdded comments and some refactoring.
Peter Amstutz [Wed, 19 Feb 2014 14:46:22 +0000 (09:46 -0500)]
Added comments and some refactoring.

10 years agoRobustness improvements
peter [Tue, 18 Feb 2014 22:36:01 +0000 (22:36 +0000)]
Robustness improvements

10 years agoFuse driver works for mounting collections and reading files. Tested with jlake...
peter [Tue, 18 Feb 2014 21:07:37 +0000 (21:07 +0000)]
Fuse driver works for mounting collections and reading files.  Tested with jlake collection, spot checked m5dsum values of several files which matched the md5sum catalog in the jlake collection.

10 years agoWorking on fuse mount
Peter Amstutz [Tue, 18 Feb 2014 15:59:40 +0000 (10:59 -0500)]
Working on fuse mount

10 years agoDirectory browsing works, working on error handling for file reading.
Peter Amstutz [Tue, 18 Feb 2014 03:05:43 +0000 (22:05 -0500)]
Directory browsing works, working on error handling for file reading.

10 years agoWork in progress arv-mount based on llfuse and supporting directories listings.
Peter Amstutz [Mon, 17 Feb 2014 22:11:39 +0000 (17:11 -0500)]
Work in progress arv-mount based on llfuse and supporting directories listings.

10 years agoFixed file page to sort by stream name, then by file name
Peter Amstutz [Mon, 17 Feb 2014 20:29:28 +0000 (15:29 -0500)]
Fixed file page to sort by stream name, then by file name

10 years agoDo a partial normalization of file list before sending to client.
Peter Amstutz [Mon, 17 Feb 2014 20:13:48 +0000 (15:13 -0500)]
Do a partial normalization of file list before sending to client.

10 years agoPut some code into collection model to do normalization but I don't think that is...
Peter Amstutz [Mon, 17 Feb 2014 19:34:41 +0000 (14:34 -0500)]
Put some code into collection model to do normalization but I don't think that is the right place for it.

10 years agoAdded arv keep normalized
Peter Amstutz [Mon, 17 Feb 2014 19:06:00 +0000 (14:06 -0500)]
Added arv keep normalized

10 years agoAdded arv-normalize
Peter Amstutz [Mon, 17 Feb 2014 19:05:48 +0000 (14:05 -0500)]
Added arv-normalize

10 years agoadded -s option
Peter Amstutz [Mon, 17 Feb 2014 18:50:32 +0000 (18:50 +0000)]
added -s option

10 years agoimplemented arv-ls to replace whls
Peter Amstutz [Mon, 17 Feb 2014 18:41:51 +0000 (18:41 +0000)]
implemented arv-ls to replace whls

10 years agoWorking on arv-ls
Peter Amstutz [Mon, 17 Feb 2014 18:22:48 +0000 (13:22 -0500)]
Working on arv-ls

10 years agoTests pass
Peter Amstutz [Mon, 17 Feb 2014 16:52:21 +0000 (11:52 -0500)]
Tests pass

10 years agoAdded readfrom()
Peter Amstutz [Mon, 17 Feb 2014 03:21:31 +0000 (22:21 -0500)]
Added readfrom()

10 years agoUnit tests for arvados.locators_and_ranges
Peter Amstutz [Mon, 17 Feb 2014 03:14:04 +0000 (22:14 -0500)]
Unit tests for arvados.locators_and_ranges

10 years agoFixing things up
Peter Amstutz [Sat, 15 Feb 2014 00:56:36 +0000 (19:56 -0500)]
Fixing things up

10 years agoWork in progress
Peter Amstutz [Fri, 14 Feb 2014 22:11:55 +0000 (17:11 -0500)]
Work in progress

10 years agoCollections are now automatically normalized on both read and write. Tests updated.
Peter Amstutz [Fri, 14 Feb 2014 19:41:22 +0000 (14:41 -0500)]
Collections are now automatically normalized on both read and write.  Tests updated.

10 years agoNormalize method seems to work pretty well now.
Peter Amstutz [Fri, 14 Feb 2014 16:43:06 +0000 (11:43 -0500)]
Normalize method seems to work pretty well now.

10 years agoworking on normalization
Peter Amstutz [Thu, 13 Feb 2014 23:05:51 +0000 (23:05 +0000)]
working on normalization

10 years agoFixed {% include alert-stub %} that shouldn't have been there on a couple of pages.
Peter Amstutz [Thu, 13 Feb 2014 16:52:47 +0000 (16:52 +0000)]
Fixed {% include alert-stub %} that shouldn't have been there on a couple of pages.

10 years agoFix 404 at api_client_authorizations.create_system_auth and add tests.
Tom Clegg [Thu, 13 Feb 2014 16:01:57 +0000 (08:01 -0800)]
Fix 404 at api_client_authorizations.create_system_auth and add tests.

10 years agoMerge branch '2099-CORRECT-docker-stop-and-restart' (documentation update)
Tim Pierce [Thu, 13 Feb 2014 14:44:09 +0000 (09:44 -0500)]
Merge branch '2099-CORRECT-docker-stop-and-restart' (documentation update)

10 years agoUpdated Docker documentation to reference "arvdock". (refs #2099)
Tim Pierce [Thu, 13 Feb 2014 14:42:50 +0000 (09:42 -0500)]
Updated Docker documentation to reference "arvdock". (refs #2099)

10 years agoChange color of "running" job label to blue.
Tom Clegg [Wed, 12 Feb 2014 23:31:59 +0000 (15:31 -0800)]
Change color of "running" job label to blue.

10 years agoMerge branch '2096-demo-feedback'
Tom Clegg [Wed, 12 Feb 2014 22:03:24 +0000 (14:03 -0800)]
Merge branch '2096-demo-feedback'

10 years agoIn the pipeline instance comparison, do not blow up when a row component
Ward Vandewege [Wed, 12 Feb 2014 20:52:13 +0000 (15:52 -0500)]
In the pipeline instance comparison, do not blow up when a row component
is not defined (for example, when one or more of the pipeline instances
in the comparison has not yet been executed).

10 years agoMerge branch '2099-CORRECT-docker-stop-and-restart'
Tim Pierce [Wed, 12 Feb 2014 19:59:14 +0000 (14:59 -0500)]
Merge branch '2099-CORRECT-docker-stop-and-restart'

10 years agoMerge branch 'master' into 2096-demo-feedback
Tom Clegg [Wed, 12 Feb 2014 19:57:50 +0000 (11:57 -0800)]
Merge branch 'master' into 2096-demo-feedback

10 years agoShow owner name instead of uuid on pipeline_templates#index. Closes #2097
Tom Clegg [Wed, 12 Feb 2014 19:56:09 +0000 (11:56 -0800)]
Show owner name instead of uuid on pipeline_templates#index. Closes #2097

10 years agoHide "Create" button on pipeline_instances and pipeline_templates pages. Closes ...
Tom Clegg [Wed, 12 Feb 2014 19:52:46 +0000 (11:52 -0800)]
Hide "Create" button on pipeline_instances and pipeline_templates pages. Closes #2098

10 years agoLimit "compare" selection mechanism to 2 or 3 pipelines. Closes #2101
Tom Clegg [Wed, 12 Feb 2014 19:51:00 +0000 (11:51 -0800)]
Limit "compare" selection mechanism to 2 or 3 pipelines. Closes #2101

10 years agoAdd missing curly bracket in assets/stylesheets/application.css.scss
Ward Vandewege [Wed, 12 Feb 2014 19:49:03 +0000 (14:49 -0500)]
Add missing curly bracket in assets/stylesheets/application.css.scss

10 years agoRename clinicalfuture -> curoverse everywhere.
Ward Vandewege [Wed, 12 Feb 2014 19:41:39 +0000 (14:41 -0500)]
Rename clinicalfuture -> curoverse everywhere.

10 years agoFix up legend colors and labels on pipeline_instances > compare > graph.
Tom Clegg [Wed, 12 Feb 2014 19:40:21 +0000 (11:40 -0800)]
Fix up legend colors and labels on pipeline_instances > compare > graph.

10 years agoFix terminology agreement between left nav and elsewhere in docs/pages.
Tom Clegg [Wed, 12 Feb 2014 19:37:57 +0000 (11:37 -0800)]
Fix terminology agreement between left nav and elsewhere in docs/pages.

10 years agoMerge branch 'master' of git.clinicalfuture.com:arvados
Peter Amstutz [Wed, 12 Feb 2014 19:36:58 +0000 (14:36 -0500)]
Merge branch 'master' of git.clinicalfuture.com:arvados

10 years agoMake sure to abort nicely when run with a version of ruby older than 1.9.3
Ward Vandewege [Wed, 12 Feb 2014 19:36:24 +0000 (14:36 -0500)]
Make sure to abort nicely when run with a version of ruby older than 1.9.3

10 years agoFix pipeline_instances#show by renaming partial.
Tom Clegg [Wed, 12 Feb 2014 19:36:47 +0000 (11:36 -0800)]
Fix pipeline_instances#show by renaming partial.

10 years agoMerge branch '2061-update-docs'
Peter Amstutz [Wed, 12 Feb 2014 19:36:04 +0000 (14:36 -0500)]
Merge branch '2061-update-docs'

10 years agoRename to "arvdock" per code review.
Tim Pierce [Wed, 12 Feb 2014 19:35:06 +0000 (14:35 -0500)]
Rename to "arvdock" per code review.

10 years agoFinished updating tutorials for latest sprint
Peter Amstutz [Wed, 12 Feb 2014 19:33:07 +0000 (14:33 -0500)]
Finished updating tutorials for latest sprint

10 years agoCorrect comments to account for new verbs.
Tim Pierce [Wed, 12 Feb 2014 19:27:43 +0000 (14:27 -0500)]
Correct comments to account for new verbs.

10 years agoRenamed run.sh -> arvctl, added per-service "stop" and "restart" commands (fixes...
Tim Pierce [Wed, 12 Feb 2014 19:15:17 +0000 (14:15 -0500)]
Renamed run.sh -> arvctl, added per-service "stop" and "restart" commands (fixes #2099)

10 years agoFix regular expression for collection UUIDs to it can also handle with UUIDs like
Ward Vandewege [Wed, 12 Feb 2014 17:42:25 +0000 (12:42 -0500)]
Fix regular expression for collection UUIDs to it can also handle with UUIDs like

  8764db1235674a08afabcdef709f6c49+2986

10 years agoHack to fix job log links (because crunch still produces identifiers with +K@qr1hi)
Peter Amstutz [Wed, 12 Feb 2014 14:30:17 +0000 (09:30 -0500)]
Hack to fix job log links (because crunch still produces identifiers with +K@qr1hi)

10 years agoThe list-inactive-users.rb script has been moved to the puppet tree for
Ward Vandewege [Wed, 12 Feb 2014 14:22:19 +0000 (09:22 -0500)]
The list-inactive-users.rb script has been moved to the puppet tree for
now.

10 years agoFix git_dir path in CommitAncestor model. Fixes #2089
Tom Clegg [Wed, 12 Feb 2014 14:20:03 +0000 (06:20 -0800)]
Fix git_dir path in CommitAncestor model. Fixes #2089

10 years agoFill in missing example locators for crunch wrappers.
Tom Clegg [Wed, 12 Feb 2014 05:11:45 +0000 (21:11 -0800)]
Fill in missing example locators for crunch wrappers.

10 years agoAllow passing hashes as resource attributes. This lets crunch-job keep
Tom Clegg [Wed, 12 Feb 2014 05:07:52 +0000 (21:07 -0800)]
Allow passing hashes as resource attributes. This lets crunch-job keep
jobs.tasks_summary up to date.

10 years agoShow first 200 items on index page, not 1000.
Tom Clegg [Wed, 12 Feb 2014 01:07:39 +0000 (17:07 -0800)]
Show first 200 items on index page, not 1000.

10 years agoApply usual parameter encoding logic to method[request] parameter too.
Tom Clegg [Wed, 12 Feb 2014 00:56:55 +0000 (16:56 -0800)]
Apply usual parameter encoding logic to method[request] parameter too.

Amends fbd62569bca926fc12917eb60eada82a6d8a83b0

Fixes:

encountered object 'Arvados::ResourceProxy=HASH(0x31fb2f8)', but neither allow_blessed nor convert_blessed settings are enabled at arvados/sdk/perl/lib/Arvados/Request.pm line 42.

10 years agoReplace weird "loading" animation with a nice plain glyphicon.
Tom Clegg [Tue, 11 Feb 2014 23:58:57 +0000 (15:58 -0800)]
Replace weird "loading" animation with a nice plain glyphicon.

10 years agoMerge branch 'master' of git.curoverse.com:arvados
Ward Vandewege [Tue, 11 Feb 2014 22:43:21 +0000 (17:43 -0500)]
Merge branch 'master' of git.curoverse.com:arvados

10 years agoHandle the situation where config.workbench_address is unset more
Ward Vandewege [Tue, 11 Feb 2014 22:42:44 +0000 (17:42 -0500)]
Handle the situation where config.workbench_address is unset more
gracefully: do not try to redirect and blow up, instead send a
json-encoded error message.

10 years agoLook in method[request][properties][$ref] for resource object
Tom Clegg [Tue, 11 Feb 2014 22:28:32 +0000 (14:28 -0800)]
Look in method[request][properties][$ref] for resource object
argument.

Fixes #2084

10 years agoMerge branch 'master' of git.clinicalfuture.com:arvados
Tim Pierce [Tue, 11 Feb 2014 22:14:25 +0000 (17:14 -0500)]
Merge branch 'master' of git.clinicalfuture.com:arvados

10 years agoUpdate docserver build process for zenweb (refs #1786)
Tim Pierce [Tue, 11 Feb 2014 22:10:01 +0000 (17:10 -0500)]
Update docserver build process for zenweb (refs #1786)

10 years agoCan now click through to group pages on groups table
Peter Amstutz [Tue, 11 Feb 2014 21:24:05 +0000 (16:24 -0500)]
Can now click through to group pages on groups table

10 years agoFixed bug with incoming links not showing in metadata tab. Resolves #2080
Peter Amstutz [Tue, 11 Feb 2014 21:10:52 +0000 (16:10 -0500)]
Fixed bug with incoming links not showing in metadata tab.  Resolves #2080

10 years agoUpdating documentation
Peter Amstutz [Tue, 11 Feb 2014 20:59:00 +0000 (15:59 -0500)]
Updating documentation

10 years agoDismiss "paste your SSH key here" notification when key successfully saved.
Tom Clegg [Tue, 11 Feb 2014 20:02:00 +0000 (12:02 -0800)]
Dismiss "paste your SSH key here" notification when key successfully saved.

fixes #2079

10 years agoMerge branch '2072-workbench-docker'
Tim Pierce [Tue, 11 Feb 2014 19:40:59 +0000 (14:40 -0500)]
Merge branch '2072-workbench-docker'

10 years agoAdded missing workbench configuration directives to Docker (fixes #2072)
Tim Pierce [Tue, 11 Feb 2014 19:37:16 +0000 (14:37 -0500)]
Added missing workbench configuration directives to Docker (fixes #2072)

10 years agoMerge remote-tracking branch 'origin/master' into 2061-update-docs
Peter Amstutz [Tue, 11 Feb 2014 19:29:14 +0000 (14:29 -0500)]
Merge remote-tracking branch 'origin/master' into 2061-update-docs

10 years agoFixed bug with notification triggering on wrong condition. Also removed old "notific...
Peter Amstutz [Tue, 11 Feb 2014 19:08:25 +0000 (14:08 -0500)]
Fixed bug with notification triggering on wrong condition.  Also removed old "notifications" partial.

10 years agoMerge remote-tracking branch 'origin/master' into 2061-update-docs
Peter Amstutz [Tue, 11 Feb 2014 19:00:57 +0000 (14:00 -0500)]
Merge remote-tracking branch 'origin/master' into 2061-update-docs

10 years agoMerge branch '2070-read-remote-arvados'
Tom Clegg [Tue, 11 Feb 2014 17:59:48 +0000 (09:59 -0800)]
Merge branch '2070-read-remote-arvados'

closes #2070

10 years agoReturn log buffer "(not available)" instead of crashing if redis is down.
Tom Clegg [Tue, 11 Feb 2014 17:52:07 +0000 (09:52 -0800)]
Return log buffer "(not available)" instead of crashing if redis is down.

10 years agoUpdated theme to bootstrap 3 to match workbench. Started updating ssh keys tutorial.
Peter Amstutz [Tue, 11 Feb 2014 17:14:58 +0000 (12:14 -0500)]
Updated theme to bootstrap 3 to match workbench.  Started updating ssh keys tutorial.

10 years agoFix up incorrect dependency on google-api-client
Ward Vandewege [Tue, 11 Feb 2014 16:38:50 +0000 (11:38 -0500)]
Fix up incorrect dependency on google-api-client

10 years agoFix comment - location of arvados configuration file has changed.
Ward Vandewege [Tue, 11 Feb 2014 15:00:07 +0000 (10:00 -0500)]
Fix comment - location of arvados configuration file has changed.

10 years agoAdded "vendor" to doc generation ignore list for deployment situations
Peter Amstutz [Tue, 11 Feb 2014 14:50:03 +0000 (09:50 -0500)]
Added "vendor" to doc generation ignore list for deployment situations

10 years agoStarted updating docs page to bootstrap 3.0
Peter Amstutz [Tue, 11 Feb 2014 14:48:11 +0000 (09:48 -0500)]
Started updating docs page to bootstrap 3.0

10 years agoRemoved mkpydoc.sh which is obsoleted by Rakefile task
Peter Amstutz [Tue, 11 Feb 2014 14:26:33 +0000 (09:26 -0500)]
Removed mkpydoc.sh which is obsoleted by Rakefile task

10 years agoMerge branch 'master' of git.clinicalfuture.com:arvados
Peter Amstutz [Tue, 11 Feb 2014 14:23:55 +0000 (09:23 -0500)]
Merge branch 'master' of git.clinicalfuture.com:arvados

10 years agoPython documentation step will now report a warning if epydoc isn't in PATH.
Peter Amstutz [Tue, 11 Feb 2014 14:17:39 +0000 (09:17 -0500)]
Python documentation step will now report a warning if epydoc isn't in PATH.
Fixed liquid include errors.

10 years agoFix Gemfile(.lock) in sdk/cli
Ward Vandewege [Tue, 11 Feb 2014 02:39:36 +0000 (21:39 -0500)]
Fix Gemfile(.lock) in sdk/cli

10 years agoUpdate api/production.rb.in with changes from services/api.
Tim Pierce [Mon, 10 Feb 2014 22:28:39 +0000 (17:28 -0500)]
Update api/production.rb.in with changes from services/api.

10 years agoMerge branch '2008-show-log-buffer'
Tom Clegg [Mon, 10 Feb 2014 22:13:49 +0000 (14:13 -0800)]
Merge branch '2008-show-log-buffer'

closes #2008

10 years agoFix dashboard auto-refresh, and show last line of log_buffer (if any)
Tom Clegg [Mon, 10 Feb 2014 22:12:29 +0000 (14:12 -0800)]
Fix dashboard auto-refresh, and show last line of log_buffer (if any)
for jobs whose logs have not yet been written to Keep.

10 years agoInclude log buffer in Job API response.
Tom Clegg [Mon, 10 Feb 2014 21:47:33 +0000 (13:47 -0800)]
Include log buffer in Job API response.

10 years agoMerge remote-tracking branch 'origin/master' into 1786-replace-jekyll-with-zenweb
Peter Amstutz [Mon, 10 Feb 2014 21:42:30 +0000 (16:42 -0500)]
Merge remote-tracking branch 'origin/master' into 1786-replace-jekyll-with-zenweb