arvados.git
10 years agoAdding unit tests for GetBlock. (refs #2291)
Tim Pierce [Mon, 24 Mar 2014 21:15:43 +0000 (17:15 -0400)]
Adding unit tests for GetBlock. (refs #2291)

10 years agoAllow disabling of output for rake config:check via a QUIET environment
Ward Vandewege [Mon, 24 Mar 2014 20:16:10 +0000 (16:16 -0400)]
Allow disabling of output for rake config:check via a QUIET environment
variable.

10 years agoDo not print secrets in the config:check rake task.
Ward Vandewege [Mon, 24 Mar 2014 19:55:29 +0000 (15:55 -0400)]
Do not print secrets in the config:check rake task.

10 years agoMerge branch 'master' into 2187-enhance-user-setup
radhika chippada [Mon, 24 Mar 2014 18:19:48 +0000 (14:19 -0400)]
Merge branch 'master' into 2187-enhance-user-setup

10 years agoInclude first link of a given type even on reruns of the setup method.
radhika chippada [Mon, 24 Mar 2014 18:17:39 +0000 (14:17 -0400)]
Include first link of a given type even on reruns of the setup method.

10 years agoMerge branch '2209-test-limit-offset'
Tom Clegg [Mon, 24 Mar 2014 14:24:47 +0000 (10:24 -0400)]
Merge branch '2209-test-limit-offset'

closes #2209

10 years agoMerge branch '2290-user-activity'
Tom Clegg [Mon, 24 Mar 2014 14:22:20 +0000 (10:22 -0400)]
Merge branch '2290-user-activity'

closes #2290

10 years agoMerge branch 'master' into 2187-enhance-user-setup
radhika chippada [Mon, 24 Mar 2014 13:02:04 +0000 (09:02 -0400)]
Merge branch 'master' into 2187-enhance-user-setup

10 years agoRaise error if both uuid and user.email are omitted in input parameters
radhika chippada [Mon, 24 Mar 2014 12:58:50 +0000 (08:58 -0400)]
Raise error if both uuid and user.email are omitted in input parameters

10 years agoAvoid reusing per-task work directories.
Tom Clegg [Mon, 24 Mar 2014 06:17:42 +0000 (02:17 -0400)]
Avoid reusing per-task work directories.

10 years agoIndicate which outputs are marked "persistent" on pipeline provenance graphs.
Tom Clegg [Mon, 24 Mar 2014 05:59:08 +0000 (01:59 -0400)]
Indicate which outputs are marked "persistent" on pipeline provenance graphs.

10 years agoMake sure persistence links get added for persistent components, even
Tom Clegg [Mon, 24 Mar 2014 04:55:04 +0000 (00:55 -0400)]
Make sure persistence links get added for persistent components, even
when reusing jobs that are not marked persistent or belong to other
users.

10 years agoPropagate output_is_persistent flag from pipeline to job.
Tom Clegg [Mon, 24 Mar 2014 03:07:40 +0000 (23:07 -0400)]
Propagate output_is_persistent flag from pipeline to job.

10 years agoAdd output_is_persistent flags to example pipeline template.
Tom Clegg [Mon, 24 Mar 2014 03:03:32 +0000 (23:03 -0400)]
Add output_is_persistent flags to example pipeline template.

10 years agoAdd output_is_persistent attribute to job model.
Tom Clegg [Mon, 24 Mar 2014 03:02:43 +0000 (23:02 -0400)]
Add output_is_persistent attribute to job model.

10 years agoAdd tests for limit and offset parameters. refs #2075 refs #2209
Tom Clegg [Mon, 24 Mar 2014 02:38:05 +0000 (22:38 -0400)]
Add tests for limit and offset parameters. refs #2075 refs #2209

10 years agoAccept ...&filters=&... in query string as "none" instead of "unparseable JSON".
Tom Clegg [Mon, 24 Mar 2014 02:33:40 +0000 (22:33 -0400)]
Accept ...&filters=&... in query string as "none" instead of "unparseable JSON".

10 years agoRaise ArgumentError when required openid_prefix is not passed.
radhika chippada [Mon, 24 Mar 2014 01:17:26 +0000 (21:17 -0400)]
Raise ArgumentError when required openid_prefix is not passed.

10 years agoRaise exceptions on errors such as 'All users' group does not exist and a vm for...
radhika chippada [Sun, 23 Mar 2014 21:20:37 +0000 (17:20 -0400)]
Raise exceptions on errors such as 'All users' group does not exist and a vm for the vm_uuid param does not exist. Add additional functional tests and update previous tests accordingly.

10 years agoFix tabs in the test class
radhika chippada [Sun, 23 Mar 2014 20:51:59 +0000 (16:51 -0400)]
Fix tabs in the test class

10 years agoMake sure oid_login_perm exists when setup is executed for an existing user
radhika chippada [Sun, 23 Mar 2014 20:37:56 +0000 (16:37 -0400)]
Make sure oid_login_perm exists when setup is executed for an existing user

10 years agoInclude all the newly created link objects in the response from the setup method...
radhika chippada [Sun, 23 Mar 2014 19:50:13 +0000 (15:50 -0400)]
Include all the newly created link objects in the response from the setup method. Update all functional tests to verify links found in teh response.

10 years agoRepo name and VM are optional to the setup method
radhika chippada [Sun, 23 Mar 2014 03:44:04 +0000 (23:44 -0400)]
Repo name and VM are optional to the setup method

10 years agoRender 404 if no user is found for the uuid provided
radhika chippada [Sun, 23 Mar 2014 02:59:32 +0000 (22:59 -0400)]
Render 404 if no user is found for the uuid provided

10 years agoExpect openid_prefix from the clients instead of managing it on the api server.
radhika chippada [Sun, 23 Mar 2014 00:21:12 +0000 (20:21 -0400)]
Expect openid_prefix from the clients instead of managing it on the api server.

10 years agoAPI server: strip all arvados-specific settings from the .example
Ward Vandewege [Sat, 22 Mar 2014 14:59:17 +0000 (10:59 -0400)]
API server: strip all arvados-specific settings from the .example
environment files. These are now all configured via
application(.defaults).yml

10 years agoFix link, this fixes bug 2403
Ward Vandewege [Sat, 22 Mar 2014 14:32:24 +0000 (10:32 -0400)]
Fix link, this fixes bug 2403

10 years agoFix textile formatting.
Tom Clegg [Sat, 22 Mar 2014 02:14:46 +0000 (22:14 -0400)]
Fix textile formatting.

10 years agoFix up README, convert to textile.
Tom Clegg [Sat, 22 Mar 2014 00:38:23 +0000 (20:38 -0400)]
Fix up README, convert to textile.

10 years agoInitial checkin: simple Keep server handling block reads only. (refs #2291)
Tim Pierce [Fri, 21 Mar 2014 21:54:25 +0000 (17:54 -0400)]
Initial checkin: simple Keep server handling block reads only. (refs #2291)

10 years agoworkbench: Add basic smoke test.
Brett Smith [Fri, 21 Mar 2014 21:24:07 +0000 (17:24 -0400)]
workbench: Add basic smoke test.

This visits all the link on a user's front page and makes sure they
all return 200.

It's easy to extend this to crawl the entire site, checking for
success.  I've included the code for that.  We need to squash some
bugs and check the timing before we start doing that, though.

This overlaps api_client_authorizations_test, so I deleted that.

10 years agoworkbench: Add ids to other navbar dropdowns.
Brett Smith [Fri, 21 Mar 2014 20:22:55 +0000 (16:22 -0400)]
workbench: Add ids to other navbar dropdowns.

This makes them easier to click in integration tests.

10 years agoFixed paging so that it won't fail if the necessary methods are missing on the result...
Peter Amstutz [Fri, 21 Mar 2014 20:51:39 +0000 (16:51 -0400)]
Fixed paging so that it won't fail if the necessary methods are missing on the results object.

10 years agoAdd negative functional tests where a non-admin user invokes create or setup actions
radhika chippada [Fri, 21 Mar 2014 20:36:47 +0000 (16:36 -0400)]
Add negative functional tests where a non-admin user invokes create or setup actions

10 years agoTypo.
Ward Vandewege [Fri, 21 Mar 2014 20:16:35 +0000 (16:16 -0400)]
Typo.

10 years agoOne more print statement
radhika chippada [Fri, 21 Mar 2014 20:10:29 +0000 (16:10 -0400)]
One more print statement

10 years agoRemove print statement
radhika chippada [Fri, 21 Mar 2014 20:07:43 +0000 (16:07 -0400)]
Remove print statement

10 years agoPass openid_prefix to setup method only when -o option is used
radhika chippada [Fri, 21 Mar 2014 20:05:37 +0000 (16:05 -0400)]
Pass openid_prefix to setup method only when -o option is used

10 years agoMerge branch 'master' of git.curoverse.com:arvados
Ward Vandewege [Fri, 21 Mar 2014 20:03:38 +0000 (16:03 -0400)]
Merge branch 'master' of git.curoverse.com:arvados

10 years agoStrip all arvados-specific settings from the .example environment files.
Ward Vandewege [Fri, 21 Mar 2014 20:02:29 +0000 (16:02 -0400)]
Strip all arvados-specific settings from the .example environment files.
These are now all configured via application(.defaults).yml

10 years agoFixed pipeline templates page that was broken by paging merge.
Peter Amstutz [Fri, 21 Mar 2014 20:02:03 +0000 (16:02 -0400)]
Fixed pipeline templates page that was broken by paging merge.

10 years agosome more refactoring and attention to coding standards
radhika chippada [Fri, 21 Mar 2014 19:46:57 +0000 (15:46 -0400)]
some more refactoring and attention to coding standards

10 years agoMerge branch 'master' of git.clinicalfuture.com:arvados
Peter Amstutz [Fri, 21 Mar 2014 19:30:56 +0000 (15:30 -0400)]
Merge branch 'master' of git.clinicalfuture.com:arvados

10 years agoFixed syntax error typo. We need tests for crunch-dispatcher.rb!
Peter Amstutz [Fri, 21 Mar 2014 19:30:42 +0000 (15:30 -0400)]
Fixed syntax error typo.  We need tests for crunch-dispatcher.rb!

10 years agoAll functional tests passing with refactored code.
radhika chippada [Fri, 21 Mar 2014 19:13:57 +0000 (15:13 -0400)]
All functional tests passing with refactored code.

10 years agoworkbench: Add developer docs.
Brett Smith [Fri, 21 Mar 2014 19:00:15 +0000 (15:00 -0400)]
workbench: Add developer docs.

This adds a new README with information that's useful for people who
want to develop Workbench.  Right now it's just information about how
to run and write tests.  We can add to this as we go.

Some of this information was pulled from the installation guide.  I
also deleted Rails' stock README while I was at it.

10 years agoMerge branch '1750-use-supported-discovery-doc'
Tom Clegg [Fri, 21 Mar 2014 18:44:58 +0000 (14:44 -0400)]
Merge branch '1750-use-supported-discovery-doc'

refs #1750

10 years agoExpiring pipeline tokens works.
Peter Amstutz [Fri, 21 Mar 2014 18:11:36 +0000 (14:11 -0400)]
Expiring pipeline tokens works.

10 years agoWorking on re-using token per pipeline and expiring token when the pipeline is done.
Peter Amstutz [Fri, 21 Mar 2014 17:53:28 +0000 (13:53 -0400)]
Working on re-using token per pipeline and expiring token when the pipeline is done.

10 years agoMerge branch 'master' of git.clinicalfuture.com:arvados
Peter Amstutz [Fri, 21 Mar 2014 17:02:28 +0000 (13:02 -0400)]
Merge branch 'master' of git.clinicalfuture.com:arvados

# Please enter a commit message to explain why this merge is necessary,
# especially if it merges an updated upstream into a topic branch.
#
# Lines starting with '#' will be ignored, and an empty message aborts
# the commit.

10 years agoMerge branch 'master' of git.clinicalfuture.com:arvados
Peter Amstutz [Fri, 21 Mar 2014 16:57:04 +0000 (12:57 -0400)]
Merge branch 'master' of git.clinicalfuture.com:arvados

# Please enter a commit message to explain why this merge is necessary,
# especially if it merges an updated upstream into a topic branch.
#
# Lines starting with '#' will be ignored, and an empty message aborts
# the commit.

10 years agoMerge branch '2316-no-clear-tmp-flag'
Tom Clegg [Fri, 21 Mar 2014 16:56:08 +0000 (12:56 -0400)]
Merge branch '2316-no-clear-tmp-flag'

closes #2316
refs #2372

10 years agoMerge branch 'master' into 2316-no-clear-tmp-flag
Tom Clegg [Fri, 21 Mar 2014 16:55:29 +0000 (12:55 -0400)]
Merge branch 'master' into 2316-no-clear-tmp-flag

10 years agoRemove old schema#show method used by Workbench before
Tom Clegg [Fri, 21 Mar 2014 16:53:43 +0000 (12:53 -0400)]
Remove old schema#show method used by Workbench before
14ea55f217bbd7061fafc1fe69f4f453ad7c3e59.

10 years agoUse the supported discovery document instead of the old schema#show shim.
Tom Clegg [Fri, 21 Mar 2014 16:52:04 +0000 (12:52 -0400)]
Use the supported discovery document instead of the old schema#show shim.

10 years agoworkbench: Bundle integration env bugfix.
Brett Smith [Fri, 21 Mar 2014 15:47:06 +0000 (11:47 -0400)]
workbench: Bundle integration env bugfix.

The previous version did not unpack arguments correctly.

10 years agoWhen running with WEBrick, auto-generate a new self-signed SSL
Ward Vandewege [Fri, 21 Mar 2014 15:36:25 +0000 (11:36 -0400)]
When running with WEBrick, auto-generate a new self-signed SSL
certificate for each run, rather than hardcoding a path to a certificate
and key file.

10 years agoworkbench: Expound Bundle+integration interaction.
Brett Smith [Fri, 21 Mar 2014 15:34:05 +0000 (11:34 -0400)]
workbench: Expound Bundle+integration interaction.

Unsurprisingly, I don't write my best code and comments when I'm
frantically trying to fix the build.

10 years agoworkbench: Make SERVER_PID_PATH a constant.
Brett Smith [Fri, 21 Mar 2014 15:16:14 +0000 (11:16 -0400)]
workbench: Make SERVER_PID_PATH a constant.

10 years agoworkbench: Tweak integration test environment.
Brett Smith [Fri, 21 Mar 2014 15:12:53 +0000 (11:12 -0400)]
workbench: Tweak integration test environment.

RUBYLIB and RUBYOPT seem to be necessary on the build server.

10 years agoworkbench: Improve API server integration launch.
Brett Smith [Fri, 21 Mar 2014 14:26:16 +0000 (10:26 -0400)]
workbench: Improve API server integration launch.

The previous version sometimes tried (and failed) to find the server
pid before rails wrote it.  This provides some limited retry, and
avoids spawning a subshell too.

10 years agoworkbench: Improve integration test environment.
Brett Smith [Fri, 21 Mar 2014 14:25:26 +0000 (10:25 -0400)]
workbench: Improve integration test environment.

Removing too much from the environment causes builds to fail in
Jenkins.  Instead of using a whitelist of environment variables, use a
blacklist of variables that Bundle modifies.

10 years agoFixes bug loading API tokens page.
Peter Amstutz [Fri, 21 Mar 2014 14:25:19 +0000 (10:25 -0400)]
Fixes bug loading API tokens page.
Added test using our new workbench testing framework to make sure it doesn't happen again.

10 years agoAll tests passing
radhika chippada [Fri, 21 Mar 2014 13:15:01 +0000 (09:15 -0400)]
All tests passing

10 years agoMerge branch '2288-integration-tests'
Brett Smith [Fri, 21 Mar 2014 13:05:29 +0000 (09:05 -0400)]
Merge branch '2288-integration-tests'

10 years agotesting setup method implementation
radhika chippada [Fri, 21 Mar 2014 03:32:22 +0000 (23:32 -0400)]
testing setup method implementation

10 years agoMerge branch 'master' into 2187-enhance-user-setup
radhika chippada [Fri, 21 Mar 2014 00:51:07 +0000 (20:51 -0400)]
Merge branch 'master' into 2187-enhance-user-setup

10 years agosetup-new-user script using the setup method.
radhika chippada [Fri, 21 Mar 2014 00:49:14 +0000 (20:49 -0400)]
setup-new-user script using the setup method.

10 years agoUse setup method instead of create method to setup a new user
radhika chippada [Fri, 21 Mar 2014 00:06:07 +0000 (20:06 -0400)]
Use setup method instead of create method to setup a new user

10 years agoworkbench: Fix typo in application.default.yml.
Brett Smith [Thu, 20 Mar 2014 21:26:48 +0000 (17:26 -0400)]
workbench: Fix typo in application.default.yml.

10 years agoworkbench: Make integration test settings default.
Brett Smith [Thu, 20 Mar 2014 21:24:24 +0000 (17:24 -0400)]
workbench: Make integration test settings default.

We know that these settings should work out of the box, given the
settings in the API server's `rails` script.  Making them the default
makes it easier to get the tests running.

10 years agoUse flock() to prevent sharing crunch-tmp with another job in local dev mode.
Tom Clegg [Thu, 20 Mar 2014 21:23:43 +0000 (17:23 -0400)]
Use flock() to prevent sharing crunch-tmp with another job in local dev mode.

10 years agoUpdate the functional tests to use the setup method
radhika chippada [Thu, 20 Mar 2014 21:03:31 +0000 (17:03 -0400)]
Update the functional tests to use the setup method

10 years agoIntroduce a new setup method in the users controller
radhika chippada [Thu, 20 Mar 2014 20:07:48 +0000 (16:07 -0400)]
Introduce a new setup method in the users controller

10 years agoMerge branch '2193-fix-permissions-cache' (no functional changes, only unit tests)
Peter Amstutz [Thu, 20 Mar 2014 20:03:03 +0000 (16:03 -0400)]
Merge branch '2193-fix-permissions-cache' (no functional changes, only unit tests)

10 years agoMerge remote-tracking branch 'origin/master' into 2051-nondeterministic-jobs
Peter Amstutz [Thu, 20 Mar 2014 19:38:51 +0000 (15:38 -0400)]
Merge remote-tracking branch 'origin/master' into 2051-nondeterministic-jobs

10 years agoMerge branch '2278-crunch-dispatcher-monitor-processes'
Peter Amstutz [Thu, 20 Mar 2014 19:38:24 +0000 (15:38 -0400)]
Merge branch '2278-crunch-dispatcher-monitor-processes'

10 years agoSilly git staging.
Peter Amstutz [Thu, 20 Mar 2014 19:32:10 +0000 (15:32 -0400)]
Silly git staging.

10 years ago- Made a note about intentionally not setting "success"
Peter Amstutz [Thu, 20 Mar 2014 19:23:56 +0000 (15:23 -0400)]
- Made a note about intentionally not setting "success"
- Changed if c[:job][:success] == false to elsif
- Changed == nil to .nil?
- Removed whitespace

10 years agoEnforces that repository, script, script_version, script_parameters are provided.
Peter Amstutz [Thu, 20 Mar 2014 19:08:37 +0000 (15:08 -0400)]
Enforces that repository, script, script_version, script_parameters are provided.

10 years agoDocumentation fixes based on running linkchecker.
Peter Amstutz [Thu, 20 Mar 2014 19:02:09 +0000 (15:02 -0400)]
Documentation fixes based on running linkchecker.

10 years agoAdded documentation for jobs and pipelines, and updated docs to reflect that "reposit...
Peter Amstutz [Thu, 20 Mar 2014 19:01:25 +0000 (15:01 -0400)]
Added documentation for jobs and pipelines, and updated docs to reflect that "repository" has been split out from "script_version" and is now required.

10 years agoUse rails configuration for default openid prefix.
radhika chippada [Thu, 20 Mar 2014 15:07:24 +0000 (11:07 -0400)]
Use rails configuration for default openid prefix.

10 years agoMerge branch 'master' into 2187-enhance-user-setup
radhika chippada [Thu, 20 Mar 2014 14:19:01 +0000 (10:19 -0400)]
Merge branch 'master' into 2187-enhance-user-setup

10 years agoReplace tabs with spaces as per our coding standards
radhika chippada [Wed, 19 Mar 2014 21:03:07 +0000 (17:03 -0400)]
Replace tabs with spaces as per our coding standards

10 years agoClear rails cache on startup.
Peter Amstutz [Wed, 19 Mar 2014 20:33:03 +0000 (16:33 -0400)]
Clear rails cache on startup.

10 years agoRemove -n aka just probe option from the setup-new-user script as per Ward's core...
radhika chippada [Wed, 19 Mar 2014 20:32:58 +0000 (16:32 -0400)]
Remove -n aka just probe option from the setup-new-user script as per Ward's core review recommendation.

10 years ago* Added migration to break script_version into separate "repository" and "script_vers...
Peter Amstutz [Wed, 19 Mar 2014 20:32:36 +0000 (16:32 -0400)]
* Added migration to break script_version into separate "repository" and "script_version" fields
* Added "no_reuse" which tells API server not to reuse old jobs but does not taint the job by setting the "nondeterministic" flag
* arv-run-pipeline-instance now creates jobs directly and relies on API server to determine when it is appropriate to re-use old jobs

10 years agoUpdate comments in the tests
radhika chippada [Wed, 19 Mar 2014 20:18:54 +0000 (16:18 -0400)]
Update comments in the tests

10 years agoWhen create is invoked with user object as input, check if object exists for the...
radhika chippada [Wed, 19 Mar 2014 18:59:17 +0000 (14:59 -0400)]
When create is invoked with user object as input, check if object exists for the given uuid or email.

10 years agoworkbench: Document integration test dependencies.
Brett Smith [Wed, 19 Mar 2014 18:50:21 +0000 (14:50 -0400)]
workbench: Document integration test dependencies.

This adds appropriate notes to the installation guide, and suggestions
to application.yml.example.

10 years agoworkbench: Add basic login integration tests.
Brett Smith [Wed, 19 Mar 2014 16:24:37 +0000 (12:24 -0400)]
workbench: Add basic login integration tests.

10 years agoworkbench: Add VM integration tests.
Brett Smith [Wed, 19 Mar 2014 16:10:51 +0000 (12:10 -0400)]
workbench: Add VM integration tests.

This is the "start test" that Ward suggested I implement to start off.
It's easy but not trivial: it requires JavaScript support and filling
out a form.

10 years agoworkbench: Use Poltergeist for integration tests.
Brett Smith [Wed, 19 Mar 2014 16:09:51 +0000 (12:09 -0400)]
workbench: Use Poltergeist for integration tests.

This is faster and will enable us to run integration tests on the
build server.

PhantomJS (http://phantomjs.org/) has to be installed in the $PATH for
this to work.

10 years agoworkbench: Add integration test helper module.
Brett Smith [Wed, 19 Mar 2014 15:44:49 +0000 (11:44 -0400)]
workbench: Add integration test helper module.

This provide a base test class that provides the Capybara DSL and a
couple of convenience methods.  It also specifies a test runner class
that sets up the API server consistently, with the proper environment.

10 years agoWhen using user_param, the user object is not expected. If passed, it will be discarded.
radhika chippada [Wed, 19 Mar 2014 16:00:10 +0000 (12:00 -0400)]
When using user_param, the user object is not expected. If passed, it will be discarded.

10 years agoworkbench: Add Capybara gem for integration tests.
Brett Smith [Wed, 19 Mar 2014 15:42:30 +0000 (11:42 -0400)]
workbench: Add Capybara gem for integration tests.

10 years agoAdded tests for permissions to reuse jobs, tests for excluding commits.
Peter Amstutz [Wed, 19 Mar 2014 15:33:08 +0000 (11:33 -0400)]
Added tests for permissions to reuse jobs, tests for excluding commits.

10 years agoMore asserts for links
radhika chippada [Wed, 19 Mar 2014 15:12:53 +0000 (11:12 -0400)]
More asserts for links

10 years agoremove hard coded uuids from tests
radhika chippada [Wed, 19 Mar 2014 14:11:49 +0000 (10:11 -0400)]
remove hard coded uuids from tests