arvados.git
10 years agodoc: tutorial-job-debug update and style.
Brett Smith [Fri, 28 Mar 2014 20:51:36 +0000 (16:51 -0400)]
doc: tutorial-job-debug update and style.

* Jobs now require a "repository" parameter.
* Use environment variables to specify the job script.

10 years agodoc: Make running-pipeline-command up-to-date.
Brett Smith [Fri, 28 Mar 2014 19:47:52 +0000 (15:47 -0400)]
doc: Make running-pipeline-command up-to-date.

* @arv pipeline run@ now requires @--run-here@.
* Pipelines are now under Activity in Workbench navigation.
* The format of the example output has changed, along with all the
  Keep hashes.

10 years agodoc: Highlight "you" in reference JSON.
Brett Smith [Fri, 28 Mar 2014 14:31:59 +0000 (10:31 -0400)]
doc: Highlight "you" in reference JSON.

Since this reference provides users with raw example JSON, and doesn't
tell them to write it with @cat@, we can't rely on shell variable
expansion here.

10 years agodoc: Use $USER in tutorial JSON.
Brett Smith [Mon, 31 Mar 2014 13:51:42 +0000 (09:51 -0400)]
doc: Use $USER in tutorial JSON.

The tutorial encourages users to copy and paste command text.
However, most of the JSON needs to have a user-specific value for
"repository", which is easy to overlook.  Since we're telling users to
save JSON with @cat@, we can take advantage of shell variable
expansion to make the right thing happen automatically.

I added accompanying notes to help explain what's going on for people
who aren't copying instructions so literally.

Conflicts:
doc/user/tutorials/tutorial-firstscript.html.textile.liquid
doc/user/tutorials/tutorial-new-pipeline.html.textile.liquid

10 years agodoc: Tweak running-external-program style.
Brett Smith [Thu, 27 Mar 2014 20:00:09 +0000 (16:00 -0400)]
doc: Tweak running-external-program style.

10 years agodoc: tutorial-new-pipeline clarity.
Brett Smith [Mon, 31 Mar 2014 13:50:55 +0000 (09:50 -0400)]
doc: tutorial-new-pipeline clarity.

I renamed the "filter" job to "do_filter" to help disambiguate it a
little from "0-filter.py".

Conflicts:
doc/user/tutorials/tutorial-new-pipeline.html.textile.liquid

10 years agodoc: tutorial-firstscript style consistency.
Brett Smith [Mon, 31 Mar 2014 13:50:01 +0000 (09:50 -0400)]
doc: tutorial-firstscript style consistency.

Conflicts:
doc/user/tutorials/tutorial-firstscript.html.textile.liquid

10 years agodoc: tutorial-pipeline-workbench style+clarity.
Brett Smith [Thu, 27 Mar 2014 18:01:27 +0000 (14:01 -0400)]
doc: tutorial-pipeline-workbench style+clarity.

10 years agodoc: Fix tutorial-keep typos and consistency.
Brett Smith [Thu, 27 Mar 2014 16:46:19 +0000 (12:46 -0400)]
doc: Fix tutorial-keep typos and consistency.

10 years agodoc: Fix api-tokens typos and consistency.
Brett Smith [Thu, 27 Mar 2014 16:15:51 +0000 (12:15 -0400)]
doc: Fix api-tokens typos and consistency.

10 years agodoc: Fix ssh-access typos and consistency.
Brett Smith [Thu, 27 Mar 2014 15:56:55 +0000 (11:56 -0400)]
doc: Fix ssh-access typos and consistency.

10 years agodoc: Style and consistency in user/index.
Brett Smith [Thu, 27 Mar 2014 15:09:00 +0000 (11:09 -0400)]
doc: Style and consistency in user/index.

10 years agoMerge branch '2447-fix-workbench-search'
Tom Clegg [Wed, 2 Apr 2014 02:41:11 +0000 (22:41 -0400)]
Merge branch '2447-fix-workbench-search'

closes #2447

10 years agoFix searching on tables with no "name" column. Take care not to use
Tom Clegg [Wed, 2 Apr 2014 02:16:43 +0000 (22:16 -0400)]
Fix searching on tables with no "name" column. Take care not to use
string operators on incompatible column types when applying
where/filters.

10 years agoLoad ArvadosApiClient after configuration.
Tom Clegg [Wed, 2 Apr 2014 01:53:13 +0000 (21:53 -0400)]
Load ArvadosApiClient after configuration.

10 years agoMerge branch '2498-group-admin'
Tom Clegg [Wed, 2 Apr 2014 01:35:08 +0000 (21:35 -0400)]
Merge branch '2498-group-admin'

closes #2498

10 years agoFix down-migration: delete the system_group and automatically
Tom Clegg [Wed, 2 Apr 2014 01:27:37 +0000 (21:27 -0400)]
Fix down-migration: delete the system_group and automatically
generated links, and rename the migration.

10 years agoAdd migration to create system group in existing installations.
Tom Clegg [Wed, 2 Apr 2014 00:22:15 +0000 (20:22 -0400)]
Add migration to create system group in existing installations.

10 years agoAdd a system_group, and ensure it has can_manage permission on every
Tom Clegg [Tue, 1 Apr 2014 22:39:12 +0000 (18:39 -0400)]
Add a system_group, and ensure it has can_manage permission on every
existing and future user.

This lets us give a user access to all users' data (on read-only or
read+write basis) without also giving them system level privileges
with the is_admin flag (which would also let them override business
logic like UUID assignment).

10 years agoDocument group-level administrator semantics.
Tom Clegg [Tue, 1 Apr 2014 19:36:02 +0000 (15:36 -0400)]
Document group-level administrator semantics.

10 years agoSupport group-wide administrator privileges.
Tom Clegg [Tue, 1 Apr 2014 19:16:18 +0000 (15:16 -0400)]
Support group-wide administrator privileges.

If an admin user or group has permission to read/write/manage a target
user, the admin's permission extends to all other objects on which the
target user has permission.

10 years agoIncrease max #users shown on users/activity page.
Tom Clegg [Tue, 1 Apr 2014 17:22:38 +0000 (13:22 -0400)]
Increase max #users shown on  users/activity page.

10 years agoMove keep mount point outside TASK_WORK directory to prevent conflict
Tom Clegg [Tue, 1 Apr 2014 03:29:16 +0000 (23:29 -0400)]
Move keep mount point outside TASK_WORK directory to prevent conflict
with arvados.util.clear_tmp().

10 years agoAdd repository=arvados now required by jobs.create.
Tom Clegg [Tue, 1 Apr 2014 03:28:13 +0000 (23:28 -0400)]
Add repository=arvados now required by jobs.create.

10 years agoBump arvados-cli version to use output_is_persistent feature. refs #1932
Tom Clegg [Fri, 28 Mar 2014 21:14:52 +0000 (17:14 -0400)]
Bump arvados-cli version to use output_is_persistent feature. refs #1932

10 years agoMerge branch '1932-job-output-persistent'
Tom Clegg [Fri, 28 Mar 2014 19:21:03 +0000 (15:21 -0400)]
Merge branch '1932-job-output-persistent'

closes #1932

10 years agoFetch --tags, otherwise we miss out on commits that are tagged but are
Tom Clegg [Fri, 28 Mar 2014 18:52:18 +0000 (14:52 -0400)]
Fetch --tags, otherwise we miss out on commits that are tagged but are
not on a branch.

10 years agoAdd dependency on latest arv-run-pipeline-instance.
Tom Clegg [Fri, 28 Mar 2014 16:51:29 +0000 (12:51 -0400)]
Add dependency on latest arv-run-pipeline-instance.

10 years agoClarify c_already_finished comments.
Tom Clegg [Fri, 28 Mar 2014 16:31:14 +0000 (12:31 -0400)]
Clarify c_already_finished comments.

10 years agoMerge branch '2291-new-keepd-read-blocks'
Tim Pierce [Fri, 28 Mar 2014 15:58:32 +0000 (11:58 -0400)]
Merge branch '2291-new-keepd-read-blocks'

10 years agoAddressing code review comments (refs #2485, refs #2295)
Tim Pierce [Fri, 28 Mar 2014 15:56:08 +0000 (11:56 -0400)]
Addressing code review comments (refs #2485, refs #2295)

os.Remove(f.Name()) is clearer and less scary than os.Remove(PROC_MOUNTS).

10 years agoUnit test for FindKeepVolumes (refs #2295)
Tim Pierce [Fri, 28 Mar 2014 15:08:11 +0000 (11:08 -0400)]
Unit test for FindKeepVolumes (refs #2295)

10 years agoMove "empty blob" magic number into a Collection class method, remove
Tom Clegg [Fri, 28 Mar 2014 00:51:07 +0000 (20:51 -0400)]
Move "empty blob" magic number into a Collection class method, remove
some old unused code and commented-out debug statements.

10 years agoFix some whitespace complaints.
Tom Clegg [Fri, 28 Mar 2014 00:30:08 +0000 (20:30 -0400)]
Fix some whitespace complaints.

10 years agoMerge branch 'master' into 1932-job-output-persistent
Tom Clegg [Fri, 28 Mar 2014 00:25:07 +0000 (20:25 -0400)]
Merge branch 'master' into 1932-job-output-persistent

Conflicts:
doc/user/tutorials/tutorial-firstscript.html.textile.liquid
doc/user/tutorials/tutorial-new-pipeline.html.textile.liquid
sdk/cli/bin/arv-run-pipeline-instance
services/api/db/schema.rb

10 years agoFix migration crash when script_version is nil.
Tom Clegg [Thu, 27 Mar 2014 22:30:27 +0000 (18:30 -0400)]
Fix migration crash when script_version is nil.

10 years agoIgnore "cache directory does not exist" error when clearing cache at
Tom Clegg [Thu, 27 Mar 2014 21:59:34 +0000 (17:59 -0400)]
Ignore "cache directory does not exist" error when clearing cache at
server startup.

10 years agoMerge branch '2068-reset-user'
radhika chippada [Thu, 27 Mar 2014 21:20:55 +0000 (17:20 -0400)]
Merge branch '2068-reset-user'

10 years agoreload object before unsetup
radhika chippada [Thu, 27 Mar 2014 21:20:24 +0000 (17:20 -0400)]
reload object before unsetup

10 years agodoc: Make index adorable.
Brett Smith [Thu, 27 Mar 2014 21:12:47 +0000 (17:12 -0400)]
doc: Make index adorable.

It's so cute!

10 years agominor cleanup
radhika chippada [Thu, 27 Mar 2014 19:04:46 +0000 (15:04 -0400)]
minor cleanup

10 years agoClean up the users controller
radhika chippada [Thu, 27 Mar 2014 18:48:39 +0000 (14:48 -0400)]
Clean up the users controller

10 years agoUpdate tests to match controller updates towards admin_required
radhika chippada [Thu, 27 Mar 2014 17:47:48 +0000 (13:47 -0400)]
Update tests to match controller updates towards admin_required

10 years agoUse before_filter admin_required in the users controller for setup and unsetup actions
radhika chippada [Thu, 27 Mar 2014 16:30:55 +0000 (12:30 -0400)]
Use before_filter admin_required in the users controller for setup and unsetup actions

10 years agoImprove the api call invocation
radhika chippada [Thu, 27 Mar 2014 16:09:23 +0000 (12:09 -0400)]
Improve the api call invocation

10 years agoUpdate UI to use button_to instead of link_to to deactivate the user
radhika chippada [Thu, 27 Mar 2014 15:57:18 +0000 (11:57 -0400)]
Update UI to use button_to instead of link_to to deactivate the user

10 years agoMerge branch 'master' into 2068-reset-user
radhika chippada [Thu, 27 Mar 2014 15:44:53 +0000 (11:44 -0400)]
Merge branch 'master' into 2068-reset-user

10 years agoUpdate the text on the deactivate link
radhika chippada [Thu, 27 Mar 2014 15:44:12 +0000 (11:44 -0400)]
Update the text on the deactivate link

10 years agoUse post method instead of get method when invoking the unsetup method from the api...
radhika chippada [Thu, 27 Mar 2014 15:23:16 +0000 (11:23 -0400)]
Use post method instead of get method when invoking the unsetup method from the api server.

10 years agoStory #2068: Invoke the user -> unsetup method when an admin user clicks on the deact...
radhika chippada [Thu, 27 Mar 2014 15:05:08 +0000 (11:05 -0400)]
Story #2068: Invoke the user -> unsetup method when an admin user clicks on the deactivate button in workbench

10 years agoExpose user unsetup method from the API server. Added functional tests.
radhika chippada [Thu, 27 Mar 2014 14:10:00 +0000 (10:10 -0400)]
Expose user unsetup method from the API server. Added functional tests.

10 years agoMerged branch 1741-internal-git-repo into 2333-crunch-dispatch-token-management
Peter Amstutz [Thu, 27 Mar 2014 13:27:13 +0000 (09:27 -0400)]
Merged branch 1741-internal-git-repo into 2333-crunch-dispatch-token-management

10 years agoFixed dangling 'end'
Peter Amstutz [Thu, 27 Mar 2014 12:54:53 +0000 (08:54 -0400)]
Fixed dangling 'end'

10 years agoMerge branch 'master' into 2333-crunch-dispatch-token-management
Peter Amstutz [Thu, 27 Mar 2014 12:41:10 +0000 (08:41 -0400)]
Merge branch 'master' into 2333-crunch-dispatch-token-management

10 years agoStylistic changes based on comments from Tom/Brett
Peter Amstutz [Thu, 27 Mar 2014 12:41:01 +0000 (08:41 -0400)]
Stylistic changes based on comments from Tom/Brett

10 years agoMerge branch '2051-nondeterministic-jobs'
Peter Amstutz [Thu, 27 Mar 2014 12:37:33 +0000 (08:37 -0400)]
Merge branch '2051-nondeterministic-jobs'

10 years agoMerge branch '2291-new-keepd-read-blocks' (fixes #2291)
Tim Pierce [Wed, 26 Mar 2014 21:34:50 +0000 (17:34 -0400)]
Merge branch '2291-new-keepd-read-blocks' (fixes #2291)

10 years agoIncorporating code review comments (refs #2291, refs #2438)
Tim Pierce [Wed, 26 Mar 2014 21:06:59 +0000 (17:06 -0400)]
Incorporating code review comments (refs #2291, refs #2438)

10 years agoImprove readability of unit tests. (refs #2291)
Tim Pierce [Wed, 26 Mar 2014 20:58:49 +0000 (16:58 -0400)]
Improve readability of unit tests. (refs #2291)

Pass *testing.T object into setup/store functions to reduce
error-checking overhead.

10 years agoAdd list of in-progress/planned SDKs.
Tom Clegg [Tue, 25 Mar 2014 22:50:31 +0000 (18:50 -0400)]
Add list of in-progress/planned SDKs.

10 years agoAdd Ruby SDK page.
Tom Clegg [Tue, 25 Mar 2014 22:36:17 +0000 (18:36 -0400)]
Add Ruby SDK page.

10 years agoFix broken links and duplicate titles.
Tom Clegg [Tue, 25 Mar 2014 21:38:02 +0000 (17:38 -0400)]
Fix broken links and duplicate titles.

10 years agoAdd command line SDK page.
Tom Clegg [Mon, 10 Mar 2014 23:00:38 +0000 (19:00 -0400)]
Add command line SDK page.

10 years agoAdd Perl SDK page.
Tom Clegg [Mon, 10 Mar 2014 22:33:17 +0000 (18:33 -0400)]
Add Perl SDK page.

10 years agoFixes "sec_error_reused_issuer_and_serial" SSL error in Firefox.
Peter Amstutz [Wed, 26 Mar 2014 18:58:57 +0000 (14:58 -0400)]
Fixes "sec_error_reused_issuer_and_serial" SSL error in Firefox.

10 years agoAdded fix to workbench dashboard so that workbench integration tests pass.
Peter Amstutz [Wed, 26 Mar 2014 18:19:10 +0000 (14:19 -0400)]
Added fix to workbench dashboard so that workbench integration tests pass.
Added slightly helpful failure message to test assertion.
Fixed non-normalized collection uuids in fixtures.

10 years agoMerge branch 'master' into 2051-nondeterministic-jobs
Peter Amstutz [Wed, 26 Mar 2014 17:16:37 +0000 (13:16 -0400)]
Merge branch 'master' into 2051-nondeterministic-jobs

Conflicts:
doc/README
doc/user/tutorials/tutorial-new-pipeline.html.textile.liquid

10 years agoAdded more tests and more aggressive input checking.
Peter Amstutz [Wed, 26 Mar 2014 12:57:00 +0000 (08:57 -0400)]
Added more tests and more aggressive input checking.

10 years agoMerge branch '2412-do-not-reuse-task-work-dirs'
Tom Clegg [Tue, 25 Mar 2014 23:14:09 +0000 (19:14 -0400)]
Merge branch '2412-do-not-reuse-task-work-dirs'

10 years agoMerge branch 'master' of git.clinicalfuture.com:arvados
Peter Amstutz [Tue, 25 Mar 2014 21:01:59 +0000 (17:01 -0400)]
Merge branch 'master' of git.clinicalfuture.com:arvados

10 years agoFixes #2047: Catch connection errors in 'arv' and report the error nicely
Peter Amstutz [Tue, 25 Mar 2014 21:01:45 +0000 (17:01 -0400)]
Fixes #2047: Catch connection errors in 'arv' and report the error nicely
instead of dumping a backtrace.

10 years agoIncorporating comments from code review (refs #2438, refs #2291)
Tim Pierce [Tue, 25 Mar 2014 20:57:37 +0000 (16:57 -0400)]
Incorporating comments from code review (refs #2438, refs #2291)

10 years agoReworked input validation on find_commit_range (for real this time!) and added tests.
Peter Amstutz [Tue, 25 Mar 2014 20:51:57 +0000 (16:51 -0400)]
Reworked input validation on find_commit_range (for real this time!) and added tests.
Fixed descriptive text in tutorial-job1.
Removed dead code.

10 years agoMerge branch '2288-smoke-test'
Brett Smith [Tue, 25 Mar 2014 20:11:48 +0000 (16:11 -0400)]
Merge branch '2288-smoke-test'

10 years agoRemoved trailing whitespace.
Peter Amstutz [Tue, 25 Mar 2014 19:24:55 +0000 (15:24 -0400)]
Removed trailing whitespace.

10 years agoFixed tests
Peter Amstutz [Tue, 25 Mar 2014 19:24:15 +0000 (15:24 -0400)]
Fixed tests
Improved version string validation in find_commit_range
Removed spurious debugging flags
Removed dead code from commit.rb
Removed trailing whitespace
Fixed capitalization of Arvados in documentation

10 years agoworkbench: Timeout integration test Rails launch.
Brett Smith [Tue, 25 Mar 2014 19:10:24 +0000 (15:10 -0400)]
workbench: Timeout integration test Rails launch.

10 years agoMerge branch 'master' into 2187-enhance-user-setup
radhika chippada [Tue, 25 Mar 2014 18:50:38 +0000 (14:50 -0400)]
Merge branch 'master' into 2187-enhance-user-setup

10 years agoMinor test updates
radhika chippada [Tue, 25 Mar 2014 18:50:02 +0000 (14:50 -0400)]
Minor test updates

10 years agoMerge branch 'master' into 2051-nondeterministic-jobs
Peter Amstutz [Tue, 25 Mar 2014 18:40:01 +0000 (14:40 -0400)]
Merge branch 'master' into 2051-nondeterministic-jobs

10 years agoworkbench: Improve integration test Rails launch.
Brett Smith [Tue, 25 Mar 2014 18:36:48 +0000 (14:36 -0400)]
workbench: Improve integration test Rails launch.

The previous version was susceptible to a race condition where it
would read the file after Rails created it, but before it actually
wrote a pid to it.  This would cause the rake test task to kill itself
later by running Process.kill('TERM', 0).

10 years agoThe controller invokes the create links method from the model when working on an...
radhika chippada [Tue, 25 Mar 2014 18:09:44 +0000 (14:09 -0400)]
The controller invokes the create links method from the model when working on an existing user.

10 years agoworkbench: Document deployment Bundle testing.
Brett Smith [Tue, 25 Mar 2014 18:01:23 +0000 (14:01 -0400)]
workbench: Document deployment Bundle testing.

10 years agoUpdate controller action name in functional test. refs #1750
Tom Clegg [Tue, 25 Mar 2014 17:59:20 +0000 (13:59 -0400)]
Update controller action name in functional test. refs #1750

10 years agoMerge branch '1750-remove-old-schema-doc'
Tom Clegg [Tue, 25 Mar 2014 17:43:24 +0000 (13:43 -0400)]
Merge branch '1750-remove-old-schema-doc'

closes #1750

10 years agosetup method in user model assumes that the user object passed in is valid and hence...
radhika chippada [Tue, 25 Mar 2014 17:23:28 +0000 (13:23 -0400)]
setup method in user model assumes that the user object passed in is valid and hence no longer tries to find it.

10 years agoUnit test TestGetBlockCorrupt. (refs #2291)
Tim Pierce [Tue, 25 Mar 2014 16:53:40 +0000 (12:53 -0400)]
Unit test TestGetBlockCorrupt. (refs #2291)

10 years agoGround work to remove found object logic from user model's setup method
radhika chippada [Tue, 25 Mar 2014 16:32:35 +0000 (12:32 -0400)]
Ground work to remove found object logic from user model's setup method

10 years agoMerge branch 'master' into 1932-job-output-persistent
Tom Clegg [Tue, 25 Mar 2014 16:20:18 +0000 (12:20 -0400)]
Merge branch 'master' into 1932-job-output-persistent

10 years agoMark output as persistent at end of job, if Job record says to do so.
Tom Clegg [Tue, 25 Mar 2014 15:33:29 +0000 (11:33 -0400)]
Mark output as persistent at end of job, if Job record says to do so.

10 years agoAdd/explain output_is_persistent flag in example pipelines.
Tom Clegg [Tue, 25 Mar 2014 15:27:22 +0000 (11:27 -0400)]
Add/explain output_is_persistent flag in example pipelines.

10 years agoFix reversed input/output in dependency explanation.
Tom Clegg [Tue, 25 Mar 2014 15:27:07 +0000 (11:27 -0400)]
Fix reversed input/output in dependency explanation.

10 years agoUpdate all functional tests to work with the new response format of List
radhika chippada [Tue, 25 Mar 2014 14:55:54 +0000 (10:55 -0400)]
Update all functional tests to work with the new response format of List

10 years agoAdded unit tests TestGetBlockOneKeepOK and TestGetBlockFail (refs #2291)
Tim Pierce [Tue, 25 Mar 2014 14:32:15 +0000 (10:32 -0400)]
Added unit tests TestGetBlockOneKeepOK and TestGetBlockFail (refs #2291)

10 years agoUpdate user model to return a List instead of HashList
radhika chippada [Tue, 25 Mar 2014 03:20:05 +0000 (23:20 -0400)]
Update user model to return a List instead of HashList

10 years agosome minor refactoring
radhika chippada [Mon, 24 Mar 2014 23:27:35 +0000 (19:27 -0400)]
some minor refactoring

10 years agoWhen uuid is passed, openid_prefix can be optional
radhika chippada [Mon, 24 Mar 2014 22:53:58 +0000 (18:53 -0400)]
When uuid is passed, openid_prefix can be optional

10 years agoMerge branch 'master' into 2187-enhance-user-setup
radhika chippada [Mon, 24 Mar 2014 22:10:32 +0000 (18:10 -0400)]
Merge branch 'master' into 2187-enhance-user-setup

10 years agoMore unit testing
radhika chippada [Mon, 24 Mar 2014 22:09:24 +0000 (18:09 -0400)]
More unit testing

10 years agoAdd unit test for user model
radhika chippada [Mon, 24 Mar 2014 22:05:08 +0000 (18:05 -0400)]
Add unit test for user model