arvados.git
10 years ago3644: Changed so ctime == mtime because ctime is not creation time (arg!).
Peter Amstutz [Fri, 5 Sep 2014 15:43:41 +0000 (11:43 -0400)]
3644: Changed so ctime == mtime because ctime is not creation time (arg!).
Added atime.  Tweaked timestamps behavior be a bit more useful.

10 years ago3644: fuse_arvados test pass.
Peter Amstutz [Fri, 5 Sep 2014 12:47:33 +0000 (08:47 -0400)]
3644: fuse_arvados test pass.

10 years ago3644: Add --by-id to invocation of arv-mount in crunch-job to get the same
Peter Amstutz [Thu, 4 Sep 2014 18:23:46 +0000 (14:23 -0400)]
3644: Add --by-id to invocation of arv-mount in crunch-job to get the same
behavior as before.

10 years ago3644: Added choose-your-own-adventure README files to the --all and --by-id
Peter Amstutz [Thu, 4 Sep 2014 18:22:25 +0000 (14:22 -0400)]
3644: Added choose-your-own-adventure README files to the --all and --by-id
directories.  Regular expressions are now compiled once at the top for
efficiency and readability.

10 years ago3644: Change metafiles to .arvados#collection and .arvados#project. Change
Peter Amstutz [Thu, 4 Sep 2014 17:31:26 +0000 (13:31 -0400)]
3644: Change metafiles to .arvados#collection and .arvados#project.  Change
--by-hash to be --by-id since it works with both uuids and portable data
hashes.

10 years ago3644: Add threadsafe arvados api access. arv-mount now releases llfuse global
Peter Amstutz [Thu, 4 Sep 2014 14:59:03 +0000 (10:59 -0400)]
3644: Add threadsafe arvados api access.  arv-mount now releases llfuse global
lock when performing network requests.

10 years ago3644: Tweak CollectionReader manifest text regular expression to use multiline
Peter Amstutz [Thu, 4 Sep 2014 14:51:04 +0000 (10:51 -0400)]
3644: Tweak CollectionReader manifest text regular expression to use multiline
match.

10 years ago3644: Tested, fixed various mount modes.
Peter Amstutz [Wed, 3 Sep 2014 19:55:06 +0000 (15:55 -0400)]
3644: Tested, fixed various mount modes.

10 years ago3644: Default mount mode now includes home, shared, by_hash, and by_tag.
Peter Amstutz [Wed, 3 Sep 2014 19:24:15 +0000 (15:24 -0400)]
3644: Default mount mode now includes home, shared, by_hash, and by_tag.

10 years ago3644: Re-added support for files with json contents of arvados objects.
Peter Amstutz [Wed, 3 Sep 2014 18:10:13 +0000 (14:10 -0400)]
3644: Re-added support for files with json contents of arvados objects.
Changed block size reported by getattr() use 512 byte blocks which is seems to
be necessary to get 'du' to compute the right results.

10 years ago3644: Collections work again, added .portable_data_hash and .manifest_text
Peter Amstutz [Wed, 3 Sep 2014 15:39:09 +0000 (11:39 -0400)]
3644: Collections work again, added .portable_data_hash and .manifest_text
virtual files to detect if a directory is a collection.

10 years ago3644: HomeDirectory and ProjectDirectories work, added filename sanitization.
Peter Amstutz [Wed, 3 Sep 2014 14:26:50 +0000 (10:26 -0400)]
3644: HomeDirectory and ProjectDirectories work, added filename sanitization.

10 years ago3644: Shared project list almost works, still debugging.
Peter Amstutz [Wed, 3 Sep 2014 02:32:39 +0000 (22:32 -0400)]
3644: Shared project list almost works, still debugging.

10 years ago3644: build_project_trees method ported from workbench, needs testing
Peter Amstutz [Tue, 2 Sep 2014 17:01:12 +0000 (13:01 -0400)]
3644: build_project_trees method ported from workbench, needs testing

10 years ago3644: Project and Home directory work. Added support for returning correct
Peter Amstutz [Fri, 29 Aug 2014 20:35:43 +0000 (16:35 -0400)]
3644: Project and Home directory work.  Added support for returning correct
timestamps on projects, collections, files.  Should be update
CollectionDirectory if the underlying collection record changes.  Fixed bugs.

10 years ago3644: Working on adding timestamps
Peter Amstutz [Thu, 28 Aug 2014 21:12:09 +0000 (17:12 -0400)]
3644: Working on adding timestamps

10 years ago3644: More renaming GroupDirectory to ProjectDirectory, removing name links.
Peter Amstutz [Thu, 28 Aug 2014 19:11:02 +0000 (15:11 -0400)]
3644: More renaming GroupDirectory to ProjectDirectory, removing name links.

10 years ago3644: Switched around command line parameters a bit. Will default to --home
Peter Amstutz [Thu, 28 Aug 2014 18:41:04 +0000 (14:41 -0400)]
3644: Switched around command line parameters a bit.  Will default to --home
now.  Renamed GroupsDirectory to HomeDirectory and GroupDirectory to
ProjectDirectory.

10 years agoRemove assertion testing for obsolete output_is_persistent field. refs #3342
Peter Amstutz [Thu, 28 Aug 2014 13:30:25 +0000 (09:30 -0400)]
Remove assertion testing for obsolete output_is_persistent field.  refs #3342

10 years agoSet Gemfile version target for arvados-cli to correct version. refs #3342
Peter Amstutz [Thu, 28 Aug 2014 12:53:12 +0000 (08:53 -0400)]
Set Gemfile version target for arvados-cli to correct version.  refs #3342

10 years agoRevert arvados gems to versions that actually exist. refs #3342
Tom Clegg [Wed, 27 Aug 2014 21:44:20 +0000 (17:44 -0400)]
Revert arvados gems to versions that actually exist. refs #3342

10 years agoMerge branch '3342-pipeline-output-current-project' closes #3342
Peter Amstutz [Wed, 27 Aug 2014 21:04:24 +0000 (17:04 -0400)]
Merge branch '3342-pipeline-output-current-project' closes #3342

10 years ago3342: Fix syntax error in pipeline_instance.rb. Restore code in crunch-job
Peter Amstutz [Wed, 27 Aug 2014 21:03:58 +0000 (17:03 -0400)]
3342: Fix syntax error in pipeline_instance.rb.  Restore code in crunch-job
that reads manifest text from arv-get pipe.

10 years agoMerge branch '3414-keep-pull-handler'
Tim Pierce [Wed, 27 Aug 2014 20:59:11 +0000 (16:59 -0400)]
Merge branch '3414-keep-pull-handler'

Closes #3414.

10 years ago3414: fix log typo
Tim Pierce [Wed, 27 Aug 2014 20:56:17 +0000 (16:56 -0400)]
3414: fix log typo

%s -> %v

10 years ago3342: Handle case in PipelineInstance#friendly_link_name where
Peter Amstutz [Wed, 27 Aug 2014 19:02:20 +0000 (15:02 -0400)]
3342: Handle case in PipelineInstance#friendly_link_name where
pipeline_template_uuid doesn't return a PipelineTemplate.  Removed unnecessary
code from crunch-job to calculate md5 hash of manifest_text (API server doesn't
require md5 hash to be provided with collection creation any more.)

10 years ago3414: update comment for code review
Tim Pierce [Wed, 27 Aug 2014 15:50:39 +0000 (11:50 -0400)]
3414: update comment for code review

10 years ago3342: Update documentation. Add "output_name", remove "output_is_persistent".
Peter Amstutz [Wed, 27 Aug 2014 14:38:08 +0000 (10:38 -0400)]
3342: Update documentation.  Add "output_name", remove "output_is_persistent".

10 years ago3342: Tweak pipeline component status rendering. Support "output_name":false
Peter Amstutz [Wed, 27 Aug 2014 13:33:07 +0000 (09:33 -0400)]
3342: Tweak pipeline component status rendering.  Support "output_name":false
to specify no output should be added to the current project.

10 years ago3342: Fix links to log files to use portable_data_hash. Remove spurious puts.
Peter Amstutz [Wed, 27 Aug 2014 13:07:30 +0000 (09:07 -0400)]
3342: Fix links to log files to use portable_data_hash.  Remove spurious puts.
Improve error logging.

10 years ago3414: rename replicator to pull_list
Tim Pierce [Wed, 27 Aug 2014 01:18:51 +0000 (21:18 -0400)]
3414: rename replicator to pull_list

Renamed replicator.Replicator to pull_list.Manager.

10 years ago3414: update for code review
Tim Pierce [Wed, 27 Aug 2014 00:50:01 +0000 (20:50 -0400)]
3414: update for code review

Added logging for pull lists.  Unsuccessful pull lists are logged with
an error, successful ones are logged with the new pull list.

Renamed the Replicator interface with GetList and SetList.

10 years agoMerge branch '3354-render-textile' closes #3354
Tom Clegg [Wed, 27 Aug 2014 00:26:02 +0000 (20:26 -0400)]
Merge branch '3354-render-textile' closes #3354

10 years ago3354: Merge branch 'master' into 3354-render-textile
Tom Clegg [Wed, 27 Aug 2014 00:13:41 +0000 (20:13 -0400)]
3354: Merge branch 'master' into 3354-render-textile

Conflicts:
apps/workbench/app/assets/stylesheets/application.css.scss
apps/workbench/app/helpers/application_helper.rb
apps/workbench/app/models/group.rb

10 years agoFix label for API endpoint. Re-order fields. refs #3112
Tom Clegg [Tue, 26 Aug 2014 22:57:37 +0000 (18:57 -0400)]
Fix label for API endpoint. Re-order fields. refs #3112

10 years agoEnsure source_version is a string, even when it consists entirely of decimal digits...
Tom Clegg [Tue, 26 Aug 2014 22:51:53 +0000 (18:51 -0400)]
Ensure source_version is a string, even when it consists entirely of decimal digits. refs #3112

10 years agoRun the task setup script inside the container (if any), instead of
Tom Clegg [Tue, 26 Aug 2014 18:15:15 +0000 (14:15 -0400)]
Run the task setup script inside the container (if any), instead of
running setup on the host, using bind-mount for CRUNCH_SRC, and
assuming other directories have already been set up in the docker
image.

No issue #

10 years agoMerge branch '3627-selectable-projects' closes #3627
Tom Clegg [Tue, 26 Aug 2014 23:51:26 +0000 (19:51 -0400)]
Merge branch '3627-selectable-projects' closes #3627

10 years ago3342: Fixing outputs
Peter Amstutz [Tue, 26 Aug 2014 21:12:35 +0000 (17:12 -0400)]
3342: Fixing outputs

10 years ago3342: Removing remaining traces of output_is_persistent. Added code in
Peter Amstutz [Tue, 26 Aug 2014 19:47:08 +0000 (15:47 -0400)]
3342: Removing remaining traces of output_is_persistent.  Added code in
arv-run-pipeline-instance to create collections owned by appropriate project.

10 years agorefs #3620
radhika [Tue, 26 Aug 2014 19:32:41 +0000 (15:32 -0400)]
refs #3620
Merge branch '3620-admin-only-gear-menu'

10 years ago3620: correct indentation when current user is available
radhika [Tue, 26 Aug 2014 19:28:23 +0000 (15:28 -0400)]
3620: correct indentation when current user is available

10 years ago3414: adding PullHandler and Replicator
Tim Pierce [Fri, 22 Aug 2014 15:12:53 +0000 (11:12 -0400)]
3414: adding PullHandler and Replicator

Added PullHandler and a "replicator" package to handle "PUT /pull" requests.

PUT /pull requests are routed to PullHandler, which authenticates the
request and validates the JSON in the request body. Valid requests are
sent to the replicator.

The Keepstore replicator runs a goroutine which repeatedly listens on
its input channel for a new pull list.

TestPullHandler tests each combination of: request from superuser;
request from ordinary user; properly formatted pull request; improperly
formatted pull request.  It checks the state of the replicator when done
to make sure that it has the expected number of pull requests.

3414: add replicator.

10 years agocloses #3620
radhika [Tue, 26 Aug 2014 18:47:46 +0000 (14:47 -0400)]
closes #3620
Merge branch '3620-admin-only-gear-menu'

10 years agoMerge branch 'master' into 3620-admin-only-gear-menu
radhika [Tue, 26 Aug 2014 18:45:43 +0000 (14:45 -0400)]
Merge branch 'master' into 3620-admin-only-gear-menu

10 years agocloses #3642
radhika [Tue, 26 Aug 2014 18:45:03 +0000 (14:45 -0400)]
closes #3642
Merge branch '3642-search-for-active-only'

10 years ago3620: change menu item role from presentation to menuitem for clickable links. http...
radhika [Tue, 26 Aug 2014 18:42:53 +0000 (14:42 -0400)]
3620: change menu item role from presentation to menuitem for clickable links. w3.org/TR/wai-aria/roles#role_definitions

10 years ago3342: Migration to remove obsolete output_is_persistent column from jobs.
Peter Amstutz [Tue, 26 Aug 2014 18:07:42 +0000 (14:07 -0400)]
3342: Migration to remove obsolete output_is_persistent column from jobs.

10 years agoMerge branch 'master' into 3642-search-for-active-only
radhika [Tue, 26 Aug 2014 18:04:48 +0000 (14:04 -0400)]
Merge branch 'master' into 3642-search-for-active-only

10 years agoMerge branch 'master' into 3620-admin-only-gear-menu
radhika [Tue, 26 Aug 2014 18:00:05 +0000 (14:00 -0400)]
Merge branch 'master' into 3620-admin-only-gear-menu

10 years agocloses #3112
radhika [Tue, 26 Aug 2014 17:57:50 +0000 (13:57 -0400)]
closes #3112
Merge branch '3112-report-bug'

10 years agoMerge branch 'master' into 3112-report-bug
radhika [Tue, 26 Aug 2014 17:57:19 +0000 (13:57 -0400)]
Merge branch 'master' into 3112-report-bug

10 years ago3112: 404 error page default message while reporting issue
radhika [Tue, 26 Aug 2014 17:56:30 +0000 (13:56 -0400)]
3112: 404 error page default message while reporting issue

10 years agoFixed missing import in robust_put. no issue #
Peter Amstutz [Tue, 26 Aug 2014 17:51:42 +0000 (13:51 -0400)]
Fixed missing import in robust_put.  no issue #

10 years ago3112: login_tests works with javascript driver
radhika [Tue, 26 Aug 2014 17:20:43 +0000 (13:20 -0400)]
3112: login_tests works with javascript driver

10 years ago3112: still the login_tests fails when ran in the entire suite
radhika [Tue, 26 Aug 2014 17:10:23 +0000 (13:10 -0400)]
3112: still the login_tests fails when ran in the entire suite

10 years ago3112: removed rack_test driver and added selenium driver. still the test "trying...
radhika [Tue, 26 Aug 2014 16:30:26 +0000 (12:30 -0400)]
3112: removed rack_test driver and added selenium driver. still the test "trying to use expired token redirects to login page" fails when the entire suite is tested, but passes when this one test file is executed.

10 years ago3112: add scrollbar to the report issue popup
radhika [Tue, 26 Aug 2014 16:10:05 +0000 (12:10 -0400)]
3112: add scrollbar to the report issue popup

10 years agoMerge branch 'master' into 3112-report-bug
radhika [Tue, 26 Aug 2014 15:42:01 +0000 (11:42 -0400)]
Merge branch 'master' into 3112-report-bug

10 years ago3112: skip filters in actions controller, instead of application controller
radhika [Tue, 26 Aug 2014 15:40:36 +0000 (11:40 -0400)]
3112: skip filters in actions controller, instead of application controller

10 years agoMerge branch '3136-stale-pipeline-instance-display' closes #3136
Peter Amstutz [Tue, 26 Aug 2014 15:36:12 +0000 (11:36 -0400)]
Merge branch '3136-stale-pipeline-instance-display' closes #3136

10 years ago3112: no need to reload after sending report.
radhika [Tue, 26 Aug 2014 15:32:59 +0000 (11:32 -0400)]
3112: no need to reload after sending report.

10 years agoMerge branch '3147-pysdk-retries'
Brett Smith [Tue, 26 Aug 2014 15:32:10 +0000 (11:32 -0400)]
Merge branch '3147-pysdk-retries'

Closes #3147.

10 years ago3147: Fix unwanted integer division in KeepClient logs.
Brett Smith [Tue, 26 Aug 2014 00:58:37 +0000 (20:58 -0400)]
3147: Fix unwanted integer division in KeepClient logs.

10 years ago3147: Add retry support to Python SDK's KeepClient.
Brett Smith [Fri, 22 Aug 2014 17:38:40 +0000 (13:38 -0400)]
3147: Add retry support to Python SDK's KeepClient.

10 years ago3147: Remove old Keep signing support from Python SDK.
Brett Smith [Fri, 22 Aug 2014 19:57:36 +0000 (15:57 -0400)]
3147: Remove old Keep signing support from Python SDK.

Per Tom.

10 years ago3147: Add check_http_response_success to Python SDK.
Brett Smith [Tue, 26 Aug 2014 13:46:46 +0000 (09:46 -0400)]
3147: Add check_http_response_success to Python SDK.

Other parts of the SDK need to end loops based on the result of an
HTTP request.  This function puts that logic in one place.

10 years ago3147: Add RetryLoop to the Python SDK.
Brett Smith [Tue, 26 Aug 2014 13:46:17 +0000 (09:46 -0400)]
3147: Add RetryLoop to the Python SDK.

This provides a general-purpose mechanism for us to retry all kinds of
operations.

10 years ago3147: Move fake Python HTTP response generation to arvados_testutil.
Brett Smith [Thu, 21 Aug 2014 15:13:23 +0000 (11:13 -0400)]
3147: Move fake Python HTTP response generation to arvados_testutil.

Other tests can use this functionality.

10 years ago3136: Use map to correctly get the list of uuids. Check that there is a job
Peter Amstutz [Tue, 26 Aug 2014 15:25:01 +0000 (11:25 -0400)]
3136: Use map to correctly get the list of uuids.  Check that there is a job
record before trying to use it.

10 years agoFix test. refs #3149
Tom Clegg [Tue, 26 Aug 2014 15:24:32 +0000 (11:24 -0400)]
Fix test. refs #3149

10 years agoMerge branch 'master' into 3112-report-bug
radhika [Tue, 26 Aug 2014 15:17:24 +0000 (11:17 -0400)]
Merge branch 'master' into 3112-report-bug

10 years agoFix migration and api templates that rely on changes that did not end up happening...
Tom Clegg [Tue, 26 Aug 2014 15:14:07 +0000 (11:14 -0400)]
Fix migration and api templates that rely on changes that did not end up happening. refs #3036

10 years agoMerge branch '3149-server-side-search' closes #3149
Tom Clegg [Tue, 26 Aug 2014 15:00:53 +0000 (11:00 -0400)]
Merge branch '3149-server-side-search' closes #3149

10 years ago3149: Merge branch 'master' into 3149-server-side-search
Tom Clegg [Tue, 26 Aug 2014 15:00:16 +0000 (11:00 -0400)]
3149: Merge branch 'master' into 3149-server-side-search

10 years agoSet up arvados env vars when running arv-normalize. No issue #
Tom Clegg [Tue, 26 Aug 2014 13:49:37 +0000 (09:49 -0400)]
Set up arvados env vars when running arv-normalize. No issue #

10 years agoMerge branch '3036-collection-uuids' closes #3036
Peter Amstutz [Tue, 26 Aug 2014 14:45:17 +0000 (10:45 -0400)]
Merge branch '3036-collection-uuids' closes #3036

10 years agoMerge branch 'master' into 3036-collection-uuids
Peter Amstutz [Tue, 26 Aug 2014 14:43:41 +0000 (10:43 -0400)]
Merge branch 'master' into 3036-collection-uuids

Conflicts:
services/api/test/fixtures/groups.yml

10 years ago3036: Fix merge conflicts. One python sdk test still fails.
Peter Amstutz [Tue, 26 Aug 2014 12:48:08 +0000 (08:48 -0400)]
3036: Fix merge conflicts.  One python sdk test still fails.

10 years agoMove styles out of tab partial. No issue #
Tom Clegg [Tue, 26 Aug 2014 05:41:53 +0000 (01:41 -0400)]
Move styles out of tab partial. No issue #

10 years agoPropagate query params to tab panes. No issue #
Tom Clegg [Tue, 26 Aug 2014 05:29:04 +0000 (01:29 -0400)]
Propagate query params to tab panes. No issue #

10 years agoRemove uuid-guessing code from "combine selected files". refs #3504
Tom Clegg [Tue, 26 Aug 2014 04:20:13 +0000 (00:20 -0400)]
Remove uuid-guessing code from "combine selected files". refs #3504

10 years agoDo not blow up in install stage when TASK_WORK is not set. No issue #
Tom Clegg [Tue, 26 Aug 2014 03:51:25 +0000 (23:51 -0400)]
Do not blow up in install stage when TASK_WORK is not set. No issue #

10 years agoDo not blow up when tmp directory already exists. No issue #
Tom Clegg [Tue, 26 Aug 2014 03:26:38 +0000 (23:26 -0400)]
Do not blow up when tmp directory already exists. No issue #

10 years agoMerge branch '3112-report-bug' into 3642-search-for-active-only
radhika [Tue, 26 Aug 2014 03:16:58 +0000 (23:16 -0400)]
Merge branch '3112-report-bug' into 3642-search-for-active-only

10 years agoMerge branch '3112-report-bug' into 3620-admin-only-gear-menu
radhika [Tue, 26 Aug 2014 03:16:22 +0000 (23:16 -0400)]
Merge branch '3112-report-bug' into 3620-admin-only-gear-menu

10 years ago3112: alert left justification
radhika [Tue, 26 Aug 2014 03:12:55 +0000 (23:12 -0400)]
3112: alert left justification

10 years agoMerge branch 'master' into 3112-report-bug
radhika [Tue, 26 Aug 2014 03:09:37 +0000 (23:09 -0400)]
Merge branch 'master' into 3112-report-bug

10 years ago3149: Clarify comments. Stick with a-b-c data keys where possible;
Tom Clegg [Tue, 26 Aug 2014 02:29:11 +0000 (22:29 -0400)]
3149: Clarify comments. Stick with a-b-c data keys where possible;
when not possible, explain why not.

10 years agoMerge branch '3149-filter-any' refs #3149
Tom Clegg [Tue, 26 Aug 2014 01:50:41 +0000 (21:50 -0400)]
Merge branch '3149-filter-any' refs #3149

10 years ago3149: Explain what "any" does as a filter attribute.
Tom Clegg [Tue, 26 Aug 2014 01:48:47 +0000 (21:48 -0400)]
3149: Explain what "any" does as a filter attribute.

10 years agoFix test fixtures breaking Workbench tests. refs #3171
Tom Clegg [Tue, 26 Aug 2014 01:33:57 +0000 (21:33 -0400)]
Fix test fixtures breaking Workbench tests. refs #3171

10 years agoMerge branch 'master' into 3112-report-bug
radhika [Tue, 26 Aug 2014 01:26:43 +0000 (21:26 -0400)]
Merge branch 'master' into 3112-report-bug

10 years agoDo not blow up when stdout!=subprocess.PIPE. no issue #
Tom Clegg [Tue, 26 Aug 2014 00:59:37 +0000 (20:59 -0400)]
Do not blow up when stdout!=subprocess.PIPE. no issue #

10 years agoMerge branch '3660-project-editable' closes #3660
Tom Clegg [Tue, 26 Aug 2014 00:41:43 +0000 (20:41 -0400)]
Merge branch '3660-project-editable' closes #3660

10 years ago3660: Clarify self-contradicting comment.
Tom Clegg [Tue, 26 Aug 2014 00:41:23 +0000 (20:41 -0400)]
3660: Clarify self-contradicting comment.

10 years agoUpdate Gemfile.lock. refs #3405
Tom Clegg [Tue, 26 Aug 2014 00:34:00 +0000 (20:34 -0400)]
Update Gemfile.lock. refs #3405

10 years agoMerge branch '3171-admin-groups' closes #3171
Tom Clegg [Tue, 26 Aug 2014 00:24:56 +0000 (20:24 -0400)]
Merge branch '3171-admin-groups' closes #3171

10 years agoInstead of munging TASK_WORK var, mkdir -p it (and therefore JOB_WORK)
Tom Clegg [Tue, 26 Aug 2014 00:24:12 +0000 (20:24 -0400)]
Instead of munging TASK_WORK var, mkdir -p it (and therefore JOB_WORK)
in setup script.

Without this, scripts that write to arvados.current_job().tmpdir
(i.e., JOB_WORK) fail.

No issue #

10 years agoMerge branch '3112-report-bug' into 3642-search-for-active-only
radhika [Mon, 25 Aug 2014 23:31:33 +0000 (19:31 -0400)]
Merge branch '3112-report-bug' into 3642-search-for-active-only