arvados.git
9 years agoMerge branch '4042-run-command-MxN' of git.curoverse.com:arvados into 4042-run-comman...
Peter Amstutz [Wed, 8 Oct 2014 18:50:12 +0000 (14:50 -0400)]
Merge branch '4042-run-command-MxN' of git.curoverse.com:arvados into 4042-run-command-MxN

# Please enter a commit message to explain why this merge is necessary,
# especially if it merges an updated upstream into a topic branch.
#
# Lines starting with '#' will be ignored, and an empty message aborts
# the commit.

9 years ago4042: Update documentation samples. Small fix to dry-run to allow supplying custom...
Peter Amstutz [Wed, 8 Oct 2014 18:49:54 +0000 (14:49 -0400)]
4042: Update documentation samples.  Small fix to dry-run to allow supplying custom TASK_KEEPMOUNT.

9 years ago4042: Rename bad reuse of 'p' to 'match' in expand_item. Finish describing
Peter Amstutz [Wed, 8 Oct 2014 15:12:57 +0000 (11:12 -0400)]
4042: Rename bad reuse of 'p' to 'match' in expand_item.  Finish describing
$(task.outdir).  Clarify that list functions take a user parameter name.  Fix
other spelling and grammatical errors in documentation.

9 years ago4042: When listing directory, return list of absolute paths
Peter Amstutz [Mon, 6 Oct 2014 20:30:29 +0000 (16:30 -0400)]
4042: When listing directory, return list of absolute paths

9 years ago4042: Add dry-run mode to run-command. Test and fix examples from documentation.
Peter Amstutz [Fri, 3 Oct 2014 19:44:50 +0000 (15:44 -0400)]
4042: Add dry-run mode to run-command.  Test and fix examples from documentation.

9 years ago4042: First draft document complete, need to verify that examples all work.
Peter Amstutz [Fri, 3 Oct 2014 17:43:56 +0000 (13:43 -0400)]
4042: First draft document complete, need to verify that examples all work.

9 years ago4042: Functions defined in get_items() now moved into expand_items()
Peter Amstutz [Fri, 3 Oct 2014 17:43:39 +0000 (13:43 -0400)]
4042: Functions defined in get_items() now moved into expand_items()

9 years ago4042: Subst will raise exceptions if files/directories don't exist.
Peter Amstutz [Fri, 3 Oct 2014 17:42:47 +0000 (13:42 -0400)]
4042: Subst will raise exceptions if files/directories don't exist.

9 years ago4042: Getting started on run-command reference
Peter Amstutz [Thu, 2 Oct 2014 21:11:23 +0000 (17:11 -0400)]
4042: Getting started on run-command reference

9 years ago4042: Start working on run-command reference page.
Peter Amstutz [Thu, 2 Oct 2014 20:29:55 +0000 (16:29 -0400)]
4042: Start working on run-command reference page.

9 years ago4042: another expand fix
Peter Amstutz [Thu, 2 Oct 2014 19:18:27 +0000 (15:18 -0400)]
4042: another expand fix

9 years ago4042: expand list fix
Peter Amstutz [Thu, 2 Oct 2014 19:15:08 +0000 (15:15 -0400)]
4042: expand list fix

9 years ago4042: add command pattern to list index
Peter Amstutz [Thu, 2 Oct 2014 19:12:14 +0000 (15:12 -0400)]
4042: add command pattern to list index

9 years ago4042: fix bad keys
Peter Amstutz [Thu, 2 Oct 2014 19:04:35 +0000 (15:04 -0400)]
4042: fix bad keys

9 years ago4042: fix bad syntax
Peter Amstutz [Thu, 2 Oct 2014 19:01:46 +0000 (15:01 -0400)]
4042: fix bad syntax

9 years ago4042: Add list index
Peter Amstutz [Thu, 2 Oct 2014 18:58:20 +0000 (14:58 -0400)]
4042: Add list index

9 years ago4042: add "extract"
Peter Amstutz [Thu, 2 Oct 2014 18:49:58 +0000 (14:49 -0400)]
4042: add "extract"

9 years ago4042: list handling bugfix
Peter Amstutz [Thu, 2 Oct 2014 18:02:21 +0000 (14:02 -0400)]
4042: list handling bugfix

9 years ago4042: Fix syntax error
Peter Amstutz [Thu, 2 Oct 2014 17:53:27 +0000 (13:53 -0400)]
4042: Fix syntax error

9 years ago4042: Add support for filter and group of lists
Peter Amstutz [Thu, 2 Oct 2014 17:44:47 +0000 (13:44 -0400)]
4042: Add support for filter and group of lists

9 years ago4042: task.foreach should now accept multiple parameters and generate tasks
Peter Amstutz [Thu, 2 Oct 2014 15:46:24 +0000 (11:46 -0400)]
4042: task.foreach should now accept multiple parameters and generate tasks
based on the cartesian product of all input lists.

9 years agoAdd test fixture to fix "test_cancel_someone_else's_visible_job" refs #3859
Peter Amstutz [Thu, 2 Oct 2014 13:22:28 +0000 (09:22 -0400)]
Add test fixture to fix "test_cancel_someone_else's_visible_job" refs #3859

9 years agoMerge branch '3859-api-job-lock-method' refs #3859
Peter Amstutz [Thu, 2 Oct 2014 02:01:19 +0000 (22:01 -0400)]
Merge branch '3859-api-job-lock-method' refs #3859

9 years agoMerge branch '3782-stub-file-content' refs #3782
Tom Clegg [Wed, 1 Oct 2014 19:36:46 +0000 (15:36 -0400)]
Merge branch '3782-stub-file-content' refs #3782

9 years ago3782: Merge branch 'master' into 3782-stub-file-content
Tom Clegg [Wed, 1 Oct 2014 19:35:33 +0000 (15:35 -0400)]
3782: Merge branch 'master' into 3782-stub-file-content

9 years ago3782: Use stubbed file content for "inactive user can retrieve user agreement" test.
Tom Clegg [Wed, 1 Oct 2014 19:12:07 +0000 (15:12 -0400)]
3782: Use stubbed file content for "inactive user can retrieve user agreement" test.

9 years agoMerge branch '4000-rerun-pipeline-changed-template'
Tim Pierce [Wed, 1 Oct 2014 18:59:30 +0000 (14:59 -0400)]
Merge branch '4000-rerun-pipeline-changed-template'

Closes #4000.

9 years ago4000: update both functional tests.
Tim Pierce [Wed, 1 Oct 2014 18:58:58 +0000 (14:58 -0400)]
4000: update both functional tests.

9 years ago4000: tighten up functional test
Tim Pierce [Wed, 1 Oct 2014 18:28:38 +0000 (14:28 -0400)]
4000: tighten up functional test

Updated the test to ensure that a copied pipeline instance actually has
the expected script_parameters from both the source instance and source
template, respectively.

9 years agoUse job state field instead of running/success columns. refs #3898
Peter Amstutz [Wed, 1 Oct 2014 18:23:21 +0000 (14:23 -0400)]
Use job state field instead of running/success columns. refs #3898

9 years ago3859: unit test for job state changes
Peter Amstutz [Wed, 1 Oct 2014 17:06:17 +0000 (13:06 -0400)]
3859: unit test for job state changes

9 years ago3782: Merge branch 'master' into 3782-stub-file-content
Tom Clegg [Wed, 1 Oct 2014 16:08:01 +0000 (12:08 -0400)]
3782: Merge branch 'master' into 3782-stub-file-content

9 years ago3782: Remove obsolete helper method.
Tom Clegg [Wed, 1 Oct 2014 16:07:58 +0000 (12:07 -0400)]
3782: Remove obsolete helper method.

9 years ago3859: Added AlreadyLockedError for job lock conflict. Added runningbarbaz
Peter Amstutz [Wed, 1 Oct 2014 15:23:37 +0000 (11:23 -0400)]
3859: Added AlreadyLockedError for job lock conflict.  Added runningbarbaz
fixture so test "cancel someone else's visible job" is testing the right thing.

9 years agoMerge branch '4004-restore-dashboard-buttons' closes #4004
Peter Amstutz [Wed, 1 Oct 2014 13:47:01 +0000 (09:47 -0400)]
Merge branch '4004-restore-dashboard-buttons' closes #4004

9 years ago4004: Add newlines for readability
Peter Amstutz [Wed, 1 Oct 2014 13:46:14 +0000 (09:46 -0400)]
4004: Add newlines for readability

9 years ago3899: Fix for counting complete/failed components refs #3899
Peter Amstutz [Wed, 1 Oct 2014 01:51:41 +0000 (21:51 -0400)]
3899: Fix for counting complete/failed components refs #3899

9 years ago3859: Add functional test for locking and fix tests broken by validate_state_change.
Peter Amstutz [Wed, 1 Oct 2014 01:30:56 +0000 (21:30 -0400)]
3859: Add functional test for locking and fix tests broken by validate_state_change.

9 years agoMerge branch 'master' into 3859-api-job-lock-method
Peter Amstutz [Wed, 1 Oct 2014 00:11:27 +0000 (20:11 -0400)]
Merge branch 'master' into 3859-api-job-lock-method

9 years ago4000: fix copying pipeline instances with newer templates
Tim Pierce [Tue, 30 Sep 2014 22:07:15 +0000 (18:07 -0400)]
4000: fix copying pipeline instances with newer templates

* When copying script parameters from a pipeline instance, check that
  the component exists in the source instance before blindly
  dereferencing it.
* Added tests for copying when components=use_latest and when
  script=use_same (the two edge cases exposed by this bug)

9 years ago3859: Cleaned up validate_state_change. Added unit test for job locking.
Peter Amstutz [Tue, 30 Sep 2014 20:56:52 +0000 (16:56 -0400)]
3859: Cleaned up validate_state_change.  Added unit test for job locking.

9 years ago4004: Rename "Compute status" to "Compute and job status". Added integration
Peter Amstutz [Tue, 30 Sep 2014 19:40:37 +0000 (15:40 -0400)]
4004: Rename "Compute status" to "Compute and job status".  Added integration
tests for buttons.  Reduced dashboard page rendering time by at least 25% by
batching certain API server requests (previously happing per-object),

9 years agoMerge branch '3961-uuid-assignment-not-permitted'
Tim Pierce [Tue, 30 Sep 2014 17:52:38 +0000 (13:52 -0400)]
Merge branch '3961-uuid-assignment-not-permitted'

Closes #3961.

9 years ago3961: fix FuseSharedTest
Tim Pierce [Tue, 30 Sep 2014 17:51:54 +0000 (13:51 -0400)]
3961: fix FuseSharedTest

Added new active_user collection to the FuseSharedTest.

9 years agoMerge branch '3961-uuid-assignment-not-permitted'
Tim Pierce [Tue, 30 Sep 2014 17:01:07 +0000 (13:01 -0400)]
Merge branch '3961-uuid-assignment-not-permitted'

Closes #3961.

9 years ago3961: more explicit assertions and error text
Tim Pierce [Tue, 30 Sep 2014 16:59:40 +0000 (12:59 -0400)]
3961: more explicit assertions and error text

9 years ago3782: Isolate file_enumerator stubbing to the current test. Introduce mocha.
Tom Clegg [Tue, 30 Sep 2014 14:57:13 +0000 (10:57 -0400)]
3782: Isolate file_enumerator stubbing to the current test. Introduce mocha.

9 years ago3961: test creating subprojects under home with duplicate names
Tim Pierce [Tue, 30 Sep 2014 04:42:16 +0000 (00:42 -0400)]
3961: test creating subprojects under home with duplicate names

New tests:
* unprivileged user creating a subproject under their home project, with
  an existing name, returns 422
* unprivileged user creating a subproject under their home project, with
  an existing name, and ensure_unique_name=true, succeeds

9 years ago3866: PySDK KeepClient accommodates services with IPv6 addresses.
Brett Smith [Mon, 29 Sep 2014 20:07:55 +0000 (16:07 -0400)]
3866: PySDK KeepClient accommodates services with IPv6 addresses.

I thought there was going to be a nicer way to construct URLs than
this, but urllib.urlunparse is still expecting the host+port as a
single string, so this approach is easier.  Closes #3866.

9 years agoMerge branch '3848-egg-default-git-tag-wip'
Brett Smith [Mon, 29 Sep 2014 16:28:36 +0000 (12:28 -0400)]
Merge branch '3848-egg-default-git-tag-wip'

Closes #3848, #3952.

9 years ago3848: Package version numbers use UTC timestamps.
Brett Smith [Fri, 26 Sep 2014 21:06:15 +0000 (17:06 -0400)]
3848: Package version numbers use UTC timestamps.

Per note-9 in the issue.

9 years ago3848: Python packages build with git tag by default.
Brett Smith [Mon, 22 Sep 2014 20:45:19 +0000 (16:45 -0400)]
3848: Python packages build with git tag by default.

This moves the build logic that we currently encode in Jenkins into
our setup.py, and makes it easier for developers to have versions in
sync with real users.

9 years agocloses #3889
radhika [Mon, 29 Sep 2014 15:13:50 +0000 (11:13 -0400)]
closes #3889
Merge branch '3889-functional-testing'

9 years ago3961: reset object UUID when ensure_unique_name is set
Tim Pierce [Mon, 29 Sep 2014 15:06:49 +0000 (11:06 -0400)]
3961: reset object UUID when ensure_unique_name is set

When saving an object that has to be renamed with ensure_unique_name,
force @object.uuid to nil so that validate_uuid will not be confused
into thinking we are trying to reassign the uuid.

9 years agoMerge branch 'master' into 3889-functional-testing
radhika [Mon, 29 Sep 2014 14:50:36 +0000 (10:50 -0400)]
Merge branch 'master' into 3889-functional-testing

9 years agoMerge branch '3616-live-stream' closes #3616
Tom Clegg [Mon, 29 Sep 2014 14:32:00 +0000 (10:32 -0400)]
Merge branch '3616-live-stream' closes #3616

9 years agoMerge branch 'master' into 3889-functional-testing
radhika [Sat, 27 Sep 2014 01:50:16 +0000 (21:50 -0400)]
Merge branch 'master' into 3889-functional-testing

9 years ago3889: add a new integration tester for users controller. Refactor code so that users...
radhika [Sat, 27 Sep 2014 01:48:51 +0000 (21:48 -0400)]
3889: add a new integration tester for users controller. Refactor code so that users functional and integration tests can reuse some of the helper methods.

9 years agoMerge branch '3871-non-ascii-project-names' closes #3871
Peter Amstutz [Fri, 26 Sep 2014 20:44:35 +0000 (16:44 -0400)]
Merge branch '3871-non-ascii-project-names' closes #3871

9 years ago3616: Use "ensure" to close response stream.
Tom Clegg [Fri, 26 Sep 2014 20:26:27 +0000 (16:26 -0400)]
3616: Use "ensure" to close response stream.

9 years ago3871: Pass on UnicodeEncodeError. Don't return those entries in the directory
Peter Amstutz [Fri, 26 Sep 2014 20:06:28 +0000 (16:06 -0400)]
3871: Pass on UnicodeEncodeError.  Don't return those entries in the directory
listing because the user won't be able to access them anyway.  Add --encoding
parameter to command line to allow the user to specify desired filesystem
encoding.

9 years agoMerge branch 'master' into 3889-functional-testing
radhika [Fri, 26 Sep 2014 20:03:30 +0000 (16:03 -0400)]
Merge branch 'master' into 3889-functional-testing

Conflicts:
services/fuse/tests/test_mount.py

9 years agoMerge branch '3901-component-rendering-errors'
Tim Pierce [Fri, 26 Sep 2014 19:51:10 +0000 (15:51 -0400)]
Merge branch '3901-component-rendering-errors'

Refs #3901.

9 years ago3616: Use ActionController::Live to avoid buffering entire response in memory.
Tom Clegg [Fri, 26 Sep 2014 19:46:09 +0000 (15:46 -0400)]
3616: Use ActionController::Live to avoid buffering entire response in memory.

9 years agoMerge branch 'master' into 3901-component-rendering-errors
Tim Pierce [Fri, 26 Sep 2014 19:42:12 +0000 (15:42 -0400)]
Merge branch 'master' into 3901-component-rendering-errors

Conflicts:
apps/workbench/app/helpers/pipeline_instances_helper.rb

9 years agocloses #3836
radhika [Fri, 26 Sep 2014 19:33:40 +0000 (15:33 -0400)]
closes #3836
Merge branch '3836-remove-collection-from-project-bug'

9 years agoMerge branch 'master' into 3836-remove-collection-from-project-bug
radhika [Fri, 26 Sep 2014 19:32:52 +0000 (15:32 -0400)]
Merge branch 'master' into 3836-remove-collection-from-project-bug

9 years ago3889: minor test assertion updates
radhika [Fri, 26 Sep 2014 19:30:33 +0000 (15:30 -0400)]
3889: minor test assertion updates

9 years ago3889: remove the job fixture "job_with_unnormalized_output_and_log" and instead use...
radhika [Fri, 26 Sep 2014 18:44:53 +0000 (14:44 -0400)]
3889: remove the job fixture "job_with_unnormalized_output_and_log" and instead use "foobar"

9 years ago3901: added unit test for pipeline rendering
Tim Pierce [Fri, 26 Sep 2014 17:45:43 +0000 (13:45 -0400)]
3901: added unit test for pipeline rendering

9 years agoMerge branch 'master' into 3889-functional-testing
radhika [Fri, 26 Sep 2014 17:35:14 +0000 (13:35 -0400)]
Merge branch 'master' into 3889-functional-testing

Conflicts:
services/api/test/fixtures/jobs.yml

9 years ago3889: some monir assertion updates.
radhika [Fri, 26 Sep 2014 17:24:56 +0000 (13:24 -0400)]
3889: some monir assertion updates.

9 years agoFix typo in error message. Refs #3961
Tom Clegg [Fri, 26 Sep 2014 15:29:38 +0000 (11:29 -0400)]
Fix typo in error message. Refs #3961

9 years agoMerge branch 'master' into 3859-api-job-lock-method
Peter Amstutz [Fri, 26 Sep 2014 15:02:06 +0000 (11:02 -0400)]
Merge branch 'master' into 3859-api-job-lock-method

Conflicts:
services/api/script/crunch-dispatch.rb

9 years ago3871: Encode/decode file and directory names to UTF-8
Peter Amstutz [Fri, 26 Sep 2014 14:53:42 +0000 (10:53 -0400)]
3871: Encode/decode file and directory names to UTF-8

9 years ago4004: Put "All jobs/pipelines/collections" buttons back onto dashboard. Also
Peter Amstutz [Fri, 26 Sep 2014 14:43:02 +0000 (10:43 -0400)]
4004: Put "All jobs/pipelines/collections" buttons back onto dashboard.  Also
tweak minimum height of top panels so they line up.

9 years agoMerge branch '3899-crunch-use-job-state' closes #3899
Peter Amstutz [Fri, 26 Sep 2014 14:31:49 +0000 (10:31 -0400)]
Merge branch '3899-crunch-use-job-state' closes #3899

9 years ago3899: Uncomment line that was commented out for debugging and committed by mistake.
Peter Amstutz [Fri, 26 Sep 2014 14:23:03 +0000 (10:23 -0400)]
3899: Uncomment line that was commented out for debugging and committed by mistake.

9 years ago3889: add "#{user} can get collection using portable data hash" test
radhika [Fri, 26 Sep 2014 14:22:24 +0000 (10:22 -0400)]
3889: add "#{user} can get collection using portable data hash" test

9 years ago3899: pipeline_instances_helper: Don't set :state if it's already set. Add newline...
Peter Amstutz [Fri, 26 Sep 2014 14:20:15 +0000 (10:20 -0400)]
3899: pipeline_instances_helper: Don't set :state if it's already set.  Add newline to jobs.yml.

9 years agoMerge branch '3168-crunch-git-fetch' closes #3168
Peter Amstutz [Fri, 26 Sep 2014 13:55:43 +0000 (09:55 -0400)]
Merge branch '3168-crunch-git-fetch' closes #3168

9 years agoRemove useless take() and untake() methods.
Peter Amstutz [Fri, 26 Sep 2014 13:48:58 +0000 (09:48 -0400)]
Remove useless take() and untake() methods.

9 years ago3168: Instead of crashing using save! log an error and go to the next job.
Peter Amstutz [Fri, 26 Sep 2014 13:47:52 +0000 (09:47 -0400)]
3168: Instead of crashing using save! log an error and go to the next job.

9 years agoMerge remote-tracking branch 'origin/master' into 3899-crunch-use-job-state
Peter Amstutz [Fri, 26 Sep 2014 13:01:22 +0000 (09:01 -0400)]
Merge remote-tracking branch 'origin/master' into 3899-crunch-use-job-state

9 years ago3899: jobs_controller uses state = Queued instead of multiple state columns.
Peter Amstutz [Fri, 26 Sep 2014 12:41:58 +0000 (08:41 -0400)]
3899: jobs_controller uses state = Queued instead of multiple state columns.
Updated fixture so that tests pass.

9 years agoMerge branch '3991-docker-workbench-address' closes #3991
Tom Clegg [Fri, 26 Sep 2014 05:46:50 +0000 (01:46 -0400)]
Merge branch '3991-docker-workbench-address' closes #3991

9 years ago3889: update the fuse test to expect the newly added pipeline instances.
radhika [Fri, 26 Sep 2014 02:25:16 +0000 (22:25 -0400)]
3889: update the fuse test to expect the newly added pipeline instances.

9 years ago3991: Merge branch 'master' into 3991-docker-workbench-address
Tom Clegg [Fri, 26 Sep 2014 01:55:17 +0000 (21:55 -0400)]
3991: Merge branch 'master' into 3991-docker-workbench-address

9 years ago3168: Fail on git tag collision instead of putting job back into the queue.
Peter Amstutz [Fri, 26 Sep 2014 01:26:27 +0000 (21:26 -0400)]
3168: Fail on git tag collision instead of putting job back into the queue.

9 years ago3899: Set :state in pipeline_instance_helper.rb and remove Job::state.
Peter Amstutz [Fri, 26 Sep 2014 00:41:41 +0000 (20:41 -0400)]
3899: Set :state in pipeline_instance_helper.rb and remove Job::state.

9 years ago3991: Fix config checks in admin_notifier.
Tom Clegg [Thu, 25 Sep 2014 23:46:08 +0000 (19:46 -0400)]
3991: Fix config checks in admin_notifier.

9 years agoMerge branch 'master' into 3889-functional-testing
radhika [Thu, 25 Sep 2014 21:12:55 +0000 (17:12 -0400)]
Merge branch 'master' into 3889-functional-testing

9 years ago3889: Since all offending tests are fixed, update test_helper to generate an error...
radhika [Thu, 25 Sep 2014 21:11:31 +0000 (17:11 -0400)]
3889: Since all offending tests are fixed, update test_helper to generate an error if any functional test performs more than one action in on test in the future.

9 years ago3889: update the test "update script_parameters one at a time using merge param"...
radhika [Thu, 25 Sep 2014 20:43:54 +0000 (16:43 -0400)]
3889: update the test "update script_parameters one at a time using merge param" to use fixture instead of create a new pipeline instance.

9 years ago3991: Change docker default to "no root url redirect". Make "not found" message more...
Tom Clegg [Thu, 25 Sep 2014 20:30:33 +0000 (16:30 -0400)]
3991: Change docker default to "no root url redirect". Make "not found" message more friendly.

9 years agoMerge branch 'master' into 3901-component-rendering-errors
Tim Pierce [Thu, 25 Sep 2014 20:20:48 +0000 (16:20 -0400)]
Merge branch 'master' into 3901-component-rendering-errors

9 years ago3901: allow job to be either Hash or Job
Tim Pierce [Thu, 25 Sep 2014 19:08:18 +0000 (15:08 -0400)]
3901: allow job to be either Hash or Job

Refactoring to ensure that a component "job" data structure may either
be a Hash (parsed directly from the component's JSON representation) or
a real Job object retrieved from the database.

When rendering a pipeline, parse the :started_at and :finished_at
timestamp fields, respectively, if necessary.

9 years ago3889: add fixture "pipeline_with_tagged_collection_input"
radhika [Thu, 25 Sep 2014 19:31:26 +0000 (15:31 -0400)]
3889: add fixture "pipeline_with_tagged_collection_input"

9 years ago3988: Add note to Job.state. Replace logic to compute state based on
Peter Amstutz [Thu, 25 Sep 2014 19:24:52 +0000 (15:24 -0400)]
3988: Add note to Job.state.  Replace logic to compute state based on
success/running columns with the same logic as used on apiserver.

9 years agobug fix: args_retries => args.retries
Tim Pierce [Thu, 25 Sep 2014 19:09:25 +0000 (15:09 -0400)]
bug fix: args_retries => args.retries

No issue #