arvados.git
8 years ago9953: Ignore non-container events (volume, network) and events with no status, instea...
Tom Clegg [Fri, 23 Sep 2016 03:58:30 +0000 (23:58 -0400)]
9953: Ignore non-container events (volume, network) and events with no status, instead of crashing.

8 years agoUse our cached copy of phantomjs-1.9.7 instead of pulling it from https
Ward Vandewege [Wed, 28 Sep 2016 17:35:56 +0000 (13:35 -0400)]
Use our cached copy of phantomjs-1.9.7 instead of pulling it from https
upstream with flakey connectivity.

closes #10130

8 years agoMerge branch '9990-workbench-client-timeout' closes #9990
Tom Clegg [Wed, 28 Sep 2016 13:59:36 +0000 (09:59 -0400)]
Merge branch '9990-workbench-client-timeout' closes #9990

8 years ago9990: Add configs for Workbench API client timeouts.
Tom Clegg [Thu, 8 Sep 2016 14:41:37 +0000 (10:41 -0400)]
9990: Add configs for Workbench API client timeouts.

8 years agoMerge branch '10129-cwl-remove-listing' closes #10129
Peter Amstutz [Tue, 27 Sep 2016 20:36:58 +0000 (16:36 -0400)]
Merge branch '10129-cwl-remove-listing' closes #10129

8 years ago10129: Rename del_listing to trim_listing and add docstring about what it is
Peter Amstutz [Tue, 27 Sep 2016 20:30:27 +0000 (16:30 -0400)]
10129: Rename del_listing to trim_listing and add docstring about what it is
for.

8 years agoMerge branch '9912-config-yaml' closes #9912
Tom Clegg [Tue, 27 Sep 2016 20:11:22 +0000 (16:11 -0400)]
Merge branch '9912-config-yaml' closes #9912

8 years ago10129: Ensure that directory literals get preserved when trimming keep directory...
Peter Amstutz [Tue, 27 Sep 2016 19:57:40 +0000 (15:57 -0400)]
10129: Ensure that directory literals get preserved when trimming keep directory listings.

8 years ago9912: Support YAML config files. Change default config file paths to /etc/arvados...
Tom Clegg [Tue, 27 Sep 2016 18:00:21 +0000 (14:00 -0400)]
9912: Support YAML config files. Change default config file paths to /etc/arvados/foo/foo.yml.

8 years agoFix #10133, use "resolved" (keep reference) instead of target (filesystem
Peter Amstutz [Tue, 27 Sep 2016 17:42:04 +0000 (13:42 -0400)]
Fix #10133, use "resolved" (keep reference) instead of target (filesystem
path).  I think this was a merge conflict mistake.

8 years ago10129: Trim listing from Directory objects that are keep references, because
Peter Amstutz [Mon, 26 Sep 2016 20:49:27 +0000 (16:49 -0400)]
10129: Trim listing from Directory objects that are keep references, because
they can get very large.

8 years agoMerge branch '10081-update-cwl-runner' refs #10081
Peter Amstutz [Mon, 26 Sep 2016 21:17:35 +0000 (17:17 -0400)]
Merge branch '10081-update-cwl-runner'  refs #10081

8 years ago10081: Fix renamed methods.
Peter Amstutz [Mon, 26 Sep 2016 21:04:29 +0000 (17:04 -0400)]
10081: Fix renamed methods.

8 years agocloses #9514
radhika [Mon, 26 Sep 2016 20:03:17 +0000 (16:03 -0400)]
closes #9514
Merge branch '9514-only-delete-old-container-logs'

8 years agoMerge branch '9988-cwl-arv-hints' closes #9988
Peter Amstutz [Mon, 26 Sep 2016 19:30:39 +0000 (15:30 -0400)]
Merge branch '9988-cwl-arv-hints' closes #9988

8 years agoFix typo.
Peter Amstutz [Mon, 26 Sep 2016 19:30:17 +0000 (15:30 -0400)]
Fix typo.

8 years agoMerge branch '9950-arv-git-httpd-config' closes #9950
Tom Clegg [Mon, 26 Sep 2016 17:44:16 +0000 (13:44 -0400)]
Merge branch '9950-arv-git-httpd-config' closes #9950

8 years ago9950: Remove uses of environment variables.
Tom Clegg [Mon, 26 Sep 2016 16:24:46 +0000 (12:24 -0400)]
9950: Remove uses of environment variables.

8 years ago9950: Propagate Client.Insecure config to arvadosclient library via ARVADOS_API_HOST_...
Tom Clegg [Wed, 21 Sep 2016 18:34:05 +0000 (14:34 -0400)]
9950: Propagate Client.Insecure config to arvadosclient library via ARVADOS_API_HOST_INSECURE env var.

8 years ago9950: Add systemd unit file arv-git-httpd.service.
Tom Clegg [Wed, 21 Sep 2016 01:28:00 +0000 (21:28 -0400)]
9950: Add systemd unit file arv-git-httpd.service.

8 years ago9950: Rename Root config to RepoRoot.
Tom Clegg [Wed, 21 Sep 2016 13:35:27 +0000 (09:35 -0400)]
9950: Rename Root config to RepoRoot.

8 years ago9950: Load config from /etc/arvados/arv-git-httpd/config.json.
Tom Clegg [Wed, 21 Sep 2016 01:27:32 +0000 (21:27 -0400)]
9950: Load config from /etc/arvados/arv-git-httpd/config.json.

8 years agorefs #10028
radhika [Mon, 26 Sep 2016 14:53:38 +0000 (10:53 -0400)]
refs #10028
Merge branch '10028-search-uuid-prefix'

8 years ago9514: update delete_old_job_logs task also to use the better performing sql.
radhika [Mon, 26 Sep 2016 14:15:33 +0000 (10:15 -0400)]
9514: update delete_old_job_logs task also to use the better performing sql.

8 years agoMerge branch '10081-cwl-run-same-job' closes #10081
Peter Amstutz [Mon, 26 Sep 2016 12:42:43 +0000 (08:42 -0400)]
Merge branch '10081-cwl-run-same-job' closes #10081

8 years ago9514: Use sql to issue delete sql without getting ids in batch.
radhika [Sat, 24 Sep 2016 23:31:09 +0000 (19:31 -0400)]
9514: Use sql to issue delete sql without getting ids in batch.

8 years agoMerge branch '10124-fix-sleepy-tests' closes #10124
Tom Clegg [Sat, 24 Sep 2016 02:31:54 +0000 (22:31 -0400)]
Merge branch '10124-fix-sleepy-tests' closes #10124

8 years ago10124: Replace "sleep 1, then assert" with "retry assertion for up to 10 seconds".
Tom Clegg [Fri, 23 Sep 2016 18:50:23 +0000 (14:50 -0400)]
10124: Replace "sleep 1, then assert" with "retry assertion for up to 10 seconds".

8 years agoBump cwltool version in fpm_build refs #10088
Peter Amstutz [Fri, 23 Sep 2016 20:22:10 +0000 (16:22 -0400)]
Bump cwltool version in fpm_build refs #10088

8 years agoMerge branch '10081-cwl-run-same-job' into 9988-cwl-arv-hints
Peter Amstutz [Fri, 23 Sep 2016 20:20:07 +0000 (16:20 -0400)]
Merge branch '10081-cwl-run-same-job' into 9988-cwl-arv-hints

8 years agoMerge branch 'master' into 10081-cwl-run-same-job
Peter Amstutz [Fri, 23 Sep 2016 20:18:39 +0000 (16:18 -0400)]
Merge branch 'master' into 10081-cwl-run-same-job

Conflicts:
sdk/cwl/arvados_cwl/runner.py

8 years agoMerge branch '10088-cwl-dedup-deps' refs #10088
Peter Amstutz [Fri, 23 Sep 2016 20:14:06 +0000 (16:14 -0400)]
Merge branch '10088-cwl-dedup-deps' refs #10088

8 years ago10081: Change logical identifier for Arvados schema to http://arvados.org/cwl.
Peter Amstutz [Fri, 23 Sep 2016 18:27:35 +0000 (14:27 -0400)]
10081: Change logical identifier for Arvados schema to arvados.org/cwl.
Improve exception text when checking that locations are keep references.

8 years ago9514: if logs are not found in logs table, do not show the log div for a completed...
radhika [Fri, 23 Sep 2016 18:09:20 +0000 (14:09 -0400)]
9514: if logs are not found in logs table, do not show the log div for a completed container.

8 years ago10088: Updated cwltool deduplicates dependencies to avoid creating separate
Peter Amstutz [Fri, 23 Sep 2016 02:38:06 +0000 (22:38 -0400)]
10088: Updated cwltool deduplicates dependencies to avoid creating separate
collections for subdirectories.  Don't try to update file literals that arn't
in scandeps.

8 years agoUse longer timeout for flaky test.
Tom Clegg [Fri, 23 Sep 2016 16:06:54 +0000 (12:06 -0400)]
Use longer timeout for flaky test.

No issue #

8 years agogofmt. refs #9955
Tom Clegg [Fri, 23 Sep 2016 15:34:14 +0000 (11:34 -0400)]
gofmt. refs #9955

8 years ago9514: fixture correction
radhika [Fri, 23 Sep 2016 15:31:00 +0000 (11:31 -0400)]
9514: fixture correction

8 years agoMerge branch '9955-keepproxy-config' closes #9955
Tom Clegg [Fri, 23 Sep 2016 15:00:05 +0000 (11:00 -0400)]
Merge branch '9955-keepproxy-config' closes #9955

8 years agoMerge branch 'master' into 9514-only-delete-old-container-logs
radhika [Fri, 23 Sep 2016 14:09:13 +0000 (10:09 -0400)]
Merge branch 'master' into 9514-only-delete-old-container-logs

8 years ago10028: replace _____-uuid-prefix with site_config_uuid_prefix-uuid-prefix
radhika [Thu, 22 Sep 2016 23:16:12 +0000 (19:16 -0400)]
10028: replace _____-uuid-prefix with site_config_uuid_prefix-uuid-prefix

8 years agocloses #10036
radhika [Thu, 22 Sep 2016 18:32:16 +0000 (14:32 -0400)]
closes #10036
Merge branch '10036-canceled-container-state'

8 years ago10036: Use status label "Ready" for a canceled container request (priority 0), when...
radhika [Thu, 22 Sep 2016 02:50:24 +0000 (22:50 -0400)]
10036: Use status label "Ready" for a canceled container request (priority 0), when it's container_uuid is in Queued or Locked states.

8 years agoMerge branch '10037-useless-progress-bar'
Lucas Di Pentima [Thu, 22 Sep 2016 17:02:34 +0000 (14:02 -0300)]
Merge branch '10037-useless-progress-bar'
Closes #10037

8 years ago10037: Merge branch 'master' into 10037-useless-progress-bar
Lucas Di Pentima [Thu, 22 Sep 2016 17:01:40 +0000 (14:01 -0300)]
10037: Merge branch 'master' into 10037-useless-progress-bar

8 years ago10037: Changed test name to something more appropiate.
Lucas Di Pentima [Thu, 22 Sep 2016 17:00:37 +0000 (14:00 -0300)]
10037: Changed test name to something more appropiate.

8 years ago9988: Add arvados-specfic hints RuntimeConstraints and APIRequirement.
Peter Amstutz [Thu, 22 Sep 2016 16:29:33 +0000 (12:29 -0400)]
9988: Add arvados-specfic hints RuntimeConstraints and APIRequirement.

8 years agoMerge branch '10117-fuse-refcount' refs #10117
Peter Amstutz [Thu, 22 Sep 2016 16:39:44 +0000 (12:39 -0400)]
Merge branch '10117-fuse-refcount' refs #10117

8 years ago10117: Revert mistaken change to Gemfile.lock.
Peter Amstutz [Thu, 22 Sep 2016 16:38:17 +0000 (12:38 -0400)]
10117: Revert mistaken change to Gemfile.lock.

8 years ago10081: Rename cwl.input.json to cwl.input.yml, fix test.
Peter Amstutz [Thu, 22 Sep 2016 16:32:32 +0000 (12:32 -0400)]
10081: Rename cwl.input.json to cwl.input.yml, fix test.

8 years ago10117: Tweak behavior of has_ref(). Fix naming of CacheTest.
Peter Amstutz [Thu, 22 Sep 2016 15:38:21 +0000 (11:38 -0400)]
10117: Tweak behavior of has_ref().  Fix naming of CacheTest.

8 years ago10037: Test enhancement to check for other statuses on the dashboard, also adding...
Lucas Di Pentima [Thu, 22 Sep 2016 15:31:23 +0000 (12:31 -0300)]
10037: Test enhancement to check for other statuses on the dashboard, also adding pipeline instances on those checks.

8 years agoMerge branch 'master' into 10081-cwl-run-same-job
Peter Amstutz [Thu, 22 Sep 2016 13:58:57 +0000 (09:58 -0400)]
Merge branch 'master' into 10081-cwl-run-same-job

8 years agoUpdate cwltool again for bugfix, refs #10088
Peter Amstutz [Thu, 22 Sep 2016 13:57:56 +0000 (09:57 -0400)]
Update cwltool again for bugfix, refs #10088

8 years ago10037: Fixed alignment issues on the dashboard
Lucas Di Pentima [Thu, 22 Sep 2016 13:20:32 +0000 (10:20 -0300)]
10037: Fixed alignment issues on the dashboard

8 years ago10117: The check needs to be between clear() and the deletion from entries.
Peter Amstutz [Wed, 21 Sep 2016 22:10:54 +0000 (18:10 -0400)]
10117: The check needs to be between clear() and the deletion from entries.

8 years ago10117: Check that inode is in entries before trying to remove it, along with
Peter Amstutz [Wed, 21 Sep 2016 21:58:29 +0000 (17:58 -0400)]
10117: Check that inode is in entries before trying to remove it, along with
explanation why it is necessary.

8 years agoMerge branch '10029-wb-send-request-id'
Lucas Di Pentima [Wed, 21 Sep 2016 21:37:07 +0000 (18:37 -0300)]
Merge branch '10029-wb-send-request-id'
Closes #10029

8 years ago10029: Merge branch 'master' into 10029-wb-send-request-id
Lucas Di Pentima [Wed, 21 Sep 2016 21:36:04 +0000 (18:36 -0300)]
10029: Merge branch 'master' into 10029-wb-send-request-id

8 years ago10037: Fixed test because of the fixture dates changes made to allow some containers...
Lucas Di Pentima [Wed, 21 Sep 2016 21:20:20 +0000 (18:20 -0300)]
10037: Fixed test because of the fixture dates changes made to allow some containers to appear on the recent pipelines and processes list on the dashboard

8 years ago10037: Added test to check for progress bar showing only on running containers
Lucas Di Pentima [Wed, 21 Sep 2016 21:19:23 +0000 (18:19 -0300)]
10037: Added test to check for progress bar showing only on running containers

8 years ago10117: OrderedDict preserves insertion order, so use inode as key instead of cache_pr...
Peter Amstutz [Wed, 21 Sep 2016 19:51:34 +0000 (15:51 -0400)]
10117: OrderedDict preserves insertion order, so use inode as key instead of cache_priority.

8 years ago10117: Restore original semantics of invalidate() and add code comment, add
Peter Amstutz [Wed, 21 Sep 2016 18:55:53 +0000 (14:55 -0400)]
10117: Restore original semantics of invalidate() and add code comment, add
kernel_invalidate().

8 years ago10117: Additional refinement: a directory not in use but still referenced needs
Peter Amstutz [Wed, 21 Sep 2016 18:17:51 +0000 (14:17 -0400)]
10117: Additional refinement: a directory not in use but still referenced needs
to be invalidated before it can be cleared so that the kernel releases its
references.

8 years ago9955: Add keepproxy config file and systemd unit file.
Tom Clegg [Wed, 21 Sep 2016 18:07:30 +0000 (14:07 -0400)]
9955: Add keepproxy config file and systemd unit file.

8 years ago10117: Consider both use_count and ref_count and check subdirectories to determine...
Peter Amstutz [Wed, 21 Sep 2016 15:13:32 +0000 (11:13 -0400)]
10117: Consider both use_count and ref_count and check subdirectories to determine if it is safe to evict directory contents from cache.

8 years ago10029: Some changes/improvements described as follows:
Lucas Di Pentima [Wed, 21 Sep 2016 15:14:13 +0000 (12:14 -0300)]
10029: Some changes/improvements described as follows:
* client_session_id renamed to current_request_id
* before_filter moved to be the first one
* request id clearing after lograge is done logging it
* added test to check for the request being cleared correctly
* corrected test that check for request_id being passed to the api server

8 years ago9955: 9950: Add shim for using an arvados.Client to configure an arvadosclient.Arvado...
Tom Clegg [Wed, 21 Sep 2016 15:09:04 +0000 (11:09 -0400)]
9955: 9950: Add shim for using an arvados.Client to configure an arvadosclient.ArvadosClient.

8 years ago10037: Avoid showing progressbar on Workbench's Dashboard when a container is not...
Lucas Di Pentima [Wed, 21 Sep 2016 13:36:04 +0000 (10:36 -0300)]
10037: Avoid showing progressbar on Workbench's Dashboard when a container is not running, instead show it's state label.

8 years agoMerge branch '9957-keep-web-config' closes #9957
Tom Clegg [Wed, 21 Sep 2016 02:39:22 +0000 (22:39 -0400)]
Merge branch '9957-keep-web-config' closes #9957

8 years ago9957: Clarify AuthToken is not used.
Tom Clegg [Mon, 19 Sep 2016 18:16:14 +0000 (14:16 -0400)]
9957: Clarify AuthToken is not used.

8 years ago9957: Clarify anonymous token explanation.
Tom Clegg [Mon, 19 Sep 2016 17:55:08 +0000 (13:55 -0400)]
9957: Clarify anonymous token explanation.

8 years ago9957: Refactor keep-web to load config from a file, with legacy support for command...
Tom Clegg [Fri, 16 Sep 2016 03:41:39 +0000 (23:41 -0400)]
9957: Refactor keep-web to load config from a file, with legacy support for command line flags.

Add systemd unit file.

8 years agoUpdate cwltool version pin, refs #10088
Peter Amstutz [Tue, 20 Sep 2016 19:48:30 +0000 (15:48 -0400)]
Update cwltool version pin, refs #10088

8 years agoMerge branch '10088-raw-files' refs #10088
Peter Amstutz [Tue, 20 Sep 2016 12:22:25 +0000 (08:22 -0400)]
Merge branch '10088-raw-files' refs #10088

8 years ago10081: Upload dependencies. Fix keep paths. Ensure correct quoting.
Peter Amstutz [Tue, 20 Sep 2016 01:47:52 +0000 (21:47 -0400)]
10081: Upload dependencies.  Fix keep paths.  Ensure correct quoting.

8 years ago10081: Fix quoting issue with workflow & input object documents. Improve test
Peter Amstutz [Mon, 19 Sep 2016 20:08:56 +0000 (16:08 -0400)]
10081: Fix quoting issue with workflow & input object documents.  Improve test
for single-container subworkflow dispatch.

8 years ago10081: Dump as yaml instead of json. Add test for extracted subworkflow.
Peter Amstutz [Mon, 19 Sep 2016 18:58:55 +0000 (14:58 -0400)]
10081: Dump as yaml instead of json.  Add test for extracted subworkflow.

8 years agoMerge branch '9954-keep-balance-systemd' closes #9954
Tom Clegg [Mon, 19 Sep 2016 17:49:13 +0000 (13:49 -0400)]
Merge branch '9954-keep-balance-systemd' closes #9954

8 years agoMerge branch '10014-collection-error-detail' closes #10014
Tom Clegg [Mon, 19 Sep 2016 17:46:32 +0000 (13:46 -0400)]
Merge branch '10014-collection-error-detail' closes #10014

8 years ago10029: Added test to check for client_session_id parameter existence and format.
Lucas Di Pentima [Mon, 19 Sep 2016 17:43:12 +0000 (14:43 -0300)]
10029: Added test to check for client_session_id parameter existence and format.

8 years ago10014: Add error details. Use filesystem language ("directory") instead of "subcollec...
Tom Clegg [Fri, 16 Sep 2016 15:05:48 +0000 (11:05 -0400)]
10014: Add error details. Use filesystem language ("directory") instead of "subcollection".

8 years ago10014: Add details to various error messages.
Tom Clegg [Tue, 13 Sep 2016 20:25:36 +0000 (16:25 -0400)]
10014: Add details to various error messages.

8 years ago10081: Mock Collection class in TestWorkflow
Peter Amstutz [Mon, 19 Sep 2016 16:04:30 +0000 (12:04 -0400)]
10081: Mock Collection class in TestWorkflow

8 years agoMerge branch '10088-raw-files' into 10081-cwl-run-same-job
Peter Amstutz [Mon, 19 Sep 2016 15:56:21 +0000 (11:56 -0400)]
Merge branch '10088-raw-files' into 10081-cwl-run-same-job

8 years ago10088: Bump cwltool dependency for another bugfix to scandeps.
Peter Amstutz [Mon, 19 Sep 2016 15:35:17 +0000 (11:35 -0400)]
10088: Bump cwltool dependency for another bugfix to scandeps.

8 years ago10088: Bump cwltool dependency for bugfix to scandeps.
Peter Amstutz [Sun, 18 Sep 2016 01:26:36 +0000 (21:26 -0400)]
10088: Bump cwltool dependency for bugfix to scandeps.

8 years ago10088: upload_dependencies reads raw files to find actual dependencies
Peter Amstutz [Fri, 16 Sep 2016 21:37:13 +0000 (17:37 -0400)]
10088: upload_dependencies reads raw files to find actual dependencies

8 years ago10029: Added client_session_id to Workbench's client request log.
Lucas Di Pentima [Fri, 16 Sep 2016 17:59:12 +0000 (14:59 -0300)]
10029: Added client_session_id to Workbench's client request log.

8 years ago10081: Fix RunInSingleContainer test
Peter Amstutz [Fri, 16 Sep 2016 15:01:59 +0000 (11:01 -0400)]
10081: Fix RunInSingleContainer test

8 years ago10081: Custom extension of v1.0 schema to recognize RunInSingleContainer.
Peter Amstutz [Fri, 16 Sep 2016 14:54:14 +0000 (10:54 -0400)]
10081: Custom extension of v1.0 schema to recognize RunInSingleContainer.

8 years ago10081: Add test for recursively calling cwltool when arv:RunInSingleContainer
Peter Amstutz [Fri, 16 Sep 2016 13:54:45 +0000 (09:54 -0400)]
10081: Add test for recursively calling cwltool when arv:RunInSingleContainer
is provided.

8 years ago9514: add rake task to delete logs for old containers whose log is already stored...
radhika [Thu, 15 Sep 2016 22:30:31 +0000 (18:30 -0400)]
9514: add rake task to delete logs for old containers whose log is already stored in keep.

8 years ago10081: Update cwltool version for bugfix.
Peter Amstutz [Thu, 15 Sep 2016 21:04:22 +0000 (17:04 -0400)]
10081: Update cwltool version for bugfix.

8 years ago10081: Quote expression interpolations. Set hints and requirements.
Peter Amstutz [Thu, 15 Sep 2016 21:00:08 +0000 (17:00 -0400)]
10081: Quote expression interpolations.  Set hints and requirements.

8 years ago10029: Added a session id for every new workbench request, to be sent as a parameter...
Lucas Di Pentima [Thu, 15 Sep 2016 20:53:40 +0000 (17:53 -0300)]
10029: Added a session id for every new workbench request, to be sent as a parameter to the API server.

8 years ago10081: Submitting whole workflows as jobs WIP
Peter Amstutz [Thu, 15 Sep 2016 20:13:08 +0000 (16:13 -0400)]
10081: Submitting whole workflows as jobs WIP

8 years agorefs #9835
radhika [Thu, 15 Sep 2016 15:33:52 +0000 (11:33 -0400)]
refs #9835
Merge branch '9835-container-reuse-doc'

8 years ago9836: Add container reuse to ContainerRequest documentation.
radhika [Wed, 14 Sep 2016 13:14:28 +0000 (09:14 -0400)]
9836: Add container reuse to ContainerRequest documentation.

8 years agoFix arvados-cwl-runner tests, refs #9766
Peter Amstutz [Thu, 15 Sep 2016 15:29:09 +0000 (11:29 -0400)]
Fix arvados-cwl-runner tests, refs #9766