arvados.git
7 years ago10110: white space in doc 10110-arv-copy-workflow
radhika [Fri, 13 Jan 2017 01:57:52 +0000 (20:57 -0500)]
10110: white space in doc

7 years agoMerge branch 'master' into 10110-arv-copy-workflow
radhika [Fri, 13 Jan 2017 01:56:10 +0000 (20:56 -0500)]
Merge branch 'master' into 10110-arv-copy-workflow

7 years agocloses #10516
radhika [Fri, 13 Jan 2017 01:42:25 +0000 (20:42 -0500)]
closes #10516
Merge branch '10516-workbench-stats-logic'

7 years agoMerge branch '10881-build-python-futures-package' refs #10881
Peter Amstutz [Fri, 13 Jan 2017 15:44:45 +0000 (10:44 -0500)]
Merge branch '10881-build-python-futures-package' refs #10881

7 years ago10881: Add python-futures as explicit cwltest dependency and bump iteration.
Peter Amstutz [Fri, 13 Jan 2017 15:43:48 +0000 (10:43 -0500)]
10881: Add python-futures as explicit cwltest dependency and bump iteration.

7 years agoBuild the python-futures package, version 3.0.5, for our supported
Ward Vandewege [Fri, 13 Jan 2017 02:53:24 +0000 (21:53 -0500)]
Build the python-futures package, version 3.0.5, for our supported
distributions.

refs #10881

7 years agoMerge branch '10880-poll-test-races'
Tom Clegg [Fri, 13 Jan 2017 02:52:32 +0000 (21:52 -0500)]
Merge branch '10880-poll-test-races'

closes #10880

7 years ago10880: Fix races in event-polling tests.
Tom Clegg [Fri, 13 Jan 2017 02:46:38 +0000 (21:46 -0500)]
10880: Fix races in event-polling tests.

The polling tests were broken because the API stub was returning its
fake events during the "find recent log ID" probe, so they were being
thrown away by PollClient and never sent to the test case's callback
function.

Most of the tests kept passing anyway, though, because subscribe()
itself sends a synthetic {'status':200} event, and this was being
misconstrued as confirmation that an event had been retrieved from the
API stub.

The false positive was not reliable for test_callback(), though,
because it cleared callback_called and tested another event without
calling subscribe() again. Sometimes, because the first "wait for
event" wasn't really waiting, the test would feed the second event to
the stub before PollClient had a chance to do its ID probe, so both
events would be dropped and the second "wait for event" would fail.

With the "wait for event" code fixed, it is no longer necessary to
close the poll client before checking which filters were used to
retrieve events.

7 years ago10110: add ruamel.yaml to setup.py
radhika [Fri, 13 Jan 2017 01:33:06 +0000 (20:33 -0500)]
10110: add ruamel.yaml to setup.py

7 years agoMerge branch '10877-azure-base-url'
Tom Clegg [Fri, 13 Jan 2017 00:08:37 +0000 (19:08 -0500)]
Merge branch '10877-azure-base-url'

closes #10877

7 years ago10877: Add example using core.chinacloudapi.cn.
Tom Clegg [Thu, 12 Jan 2017 23:40:59 +0000 (18:40 -0500)]
10877: Add example using core.chinacloudapi.cn.

7 years ago10516: update work_unit test to compare cputime and walltime.
radhika [Thu, 12 Jan 2017 23:17:41 +0000 (18:17 -0500)]
10516: update work_unit test to compare cputime and walltime.

7 years ago10516: update test to expect 0 cputime, instead of nil.
radhika [Fri, 13 Jan 2017 00:28:51 +0000 (19:28 -0500)]
10516: update test to expect 0 cputime, instead of nil.

7 years ago10516: compute cputime recursively using cputime of any children.
radhika [Thu, 12 Jan 2017 23:44:18 +0000 (18:44 -0500)]
10516: compute cputime recursively using cputime of any children.

7 years ago10877: Configurable base URL for Azure storage, e.g., StorageBaseURL: core.usgovcloud...
Tom Clegg [Thu, 12 Jan 2017 23:03:30 +0000 (18:03 -0500)]
10877: Configurable base URL for Azure storage, e.g., StorageBaseURL: core.usgovcloudapi.net

7 years ago10110: also copy any docker images during arv-copy of a workflow and update documenta...
radhika [Wed, 4 Jan 2017 12:50:20 +0000 (07:50 -0500)]
10110: also copy any docker images during arv-copy of a workflow and update documentation.

7 years agorefs #10516
radhika [Wed, 4 Jan 2017 12:30:07 +0000 (07:30 -0500)]
refs #10516
Merge branch '10516-set-finished-at-on-finished-pipelines'

7 years agorefs #9831
radhika [Wed, 4 Jan 2017 12:23:36 +0000 (07:23 -0500)]
refs #9831
Merge branch '9831-fix-failing-workbench-test'

7 years agoMerge branch '10812-cwl-package-update' refs #10812
Peter Amstutz [Thu, 12 Jan 2017 19:47:03 +0000 (14:47 -0500)]
Merge branch '10812-cwl-package-update' refs #10812

7 years ago10812: Update arvados-cwl-runner dependencies. Remove pathlib2 from backports.
Peter Amstutz [Thu, 12 Jan 2017 17:39:25 +0000 (12:39 -0500)]
10812: Update arvados-cwl-runner dependencies.  Remove pathlib2 from backports.

7 years agoMerge branch '9831-faster-unique-name'
Tom Clegg [Thu, 12 Jan 2017 18:31:17 +0000 (13:31 -0500)]
Merge branch '9831-faster-unique-name'

closes #9831

7 years ago9831: Avoid attempting the same name twice, even if an attempt takes less than 1ms.
Tom Clegg [Thu, 12 Jan 2017 18:25:49 +0000 (13:25 -0500)]
9831: Avoid attempting the same name twice, even if an attempt takes less than 1ms.

7 years agoMerge branch '10869-cwl-keep-ref' refs #10869
Peter Amstutz [Thu, 12 Jan 2017 17:54:36 +0000 (12:54 -0500)]
Merge branch '10869-cwl-keep-ref' refs #10869

7 years ago9831: Use a timestamp instead of a serial number to come up with a unique name after...
Tom Clegg [Thu, 12 Jan 2017 17:43:01 +0000 (12:43 -0500)]
9831: Use a timestamp instead of a serial number to come up with a unique name after a name collision.

7 years agoMerge branch '10812-similar-collections-check' refs #10812
Peter Amstutz [Thu, 12 Jan 2017 17:34:20 +0000 (12:34 -0500)]
Merge branch '10812-similar-collections-check' refs #10812

7 years ago10869: Pass CollectionFetcher to load_tool in crunch_script so that it will recognize...
Peter Amstutz [Thu, 12 Jan 2017 16:14:24 +0000 (11:14 -0500)]
10869: Pass CollectionFetcher to load_tool in crunch_script so that it will recognize keep: URIs.

7 years agoMerge branch '9998-unsigned_manifest'
Tom Clegg [Thu, 12 Jan 2017 16:41:18 +0000 (11:41 -0500)]
Merge branch '9998-unsigned_manifest'

refs #9998

7 years agoMerge branch 'master' into 9998-unsigned_manifest
Tom Clegg [Thu, 12 Jan 2017 15:35:46 +0000 (10:35 -0500)]
Merge branch 'master' into 9998-unsigned_manifest

Conflicts:
services/api/app/models/collection.rb
services/keep-balance/collection.go

7 years agoMerge branch '10816-postgres-permissions'
Tom Clegg [Wed, 11 Jan 2017 22:06:48 +0000 (17:06 -0500)]
Merge branch '10816-postgres-permissions'

refs #10816

7 years ago10812: Fix check for collection reuse, same PDH and similar name.
Peter Amstutz [Wed, 11 Jan 2017 21:35:40 +0000 (16:35 -0500)]
10812: Fix check for collection reuse, same PDH and similar name.

7 years ago10816: Add comments to poorly-documented name/binds args to exec_query().
Tom Clegg [Wed, 11 Jan 2017 21:13:05 +0000 (16:13 -0500)]
10816: Add comments to poorly-documented name/binds args to exec_query().

7 years ago10816: Merge branch 'master' into 10816-postgres-permissions
Tom Clegg [Wed, 11 Jan 2017 20:27:10 +0000 (15:27 -0500)]
10816: Merge branch 'master' into 10816-postgres-permissions

7 years ago10816: Release savepoint after rollback. Use exec_query instead of execute. Move...
Tom Clegg [Wed, 11 Jan 2017 20:26:41 +0000 (15:26 -0500)]
10816: Release savepoint after rollback. Use exec_query instead of execute. Move perms_for_val to a class constant.

7 years ago10808: Fix crash in cache-ownership-mismatch warning message.
Tom Clegg [Wed, 11 Jan 2017 18:48:03 +0000 (13:48 -0500)]
10808: Fix crash in cache-ownership-mismatch warning message.

refs #10808

7 years agoMerge branch '10682-localfs-stats'
Tom Clegg [Wed, 11 Jan 2017 15:24:21 +0000 (10:24 -0500)]
Merge branch '10682-localfs-stats'

closes #10682

7 years ago10682: Track readdir ops.
Tom Clegg [Wed, 11 Jan 2017 15:24:14 +0000 (10:24 -0500)]
10682: Track readdir ops.

7 years ago10682: Report IO stats for filesystem-backed volumes.
Tom Clegg [Tue, 10 Jan 2017 20:51:34 +0000 (15:51 -0500)]
10682: Report IO stats for filesystem-backed volumes.

7 years agoPin the python-pathlib2 dependency to 2.1.0, because 2.2 introduces more
Ward Vandewege [Mon, 9 Jan 2017 21:52:18 +0000 (16:52 -0500)]
Pin the python-pathlib2 dependency to 2.1.0, because 2.2 introduces more
dependencies and we've already got enough of those.

No issue #

7 years ago10816: Use a recursive postgres query instead of building the permission graph in...
Tom Clegg [Sat, 7 Jan 2017 08:21:54 +0000 (03:21 -0500)]
10816: Use a recursive postgres query instead of building the permission graph in Ruby.

7 years agoMerge branch 'arvbox-tmp-cache' no issue #
Peter Amstutz [Mon, 9 Jan 2017 15:13:11 +0000 (10:13 -0500)]
Merge branch 'arvbox-tmp-cache' no issue #

7 years agoFix run-tests.sh --only-install option.
Tom Clegg [Mon, 9 Jan 2017 15:12:08 +0000 (10:12 -0500)]
Fix run-tests.sh --only-install option.

No issue #

7 years agoCreate tmp/cache dir after cleaning old one.
Peter Amstutz [Mon, 9 Jan 2017 15:06:04 +0000 (10:06 -0500)]
Create tmp/cache dir after cleaning old one.

7 years agoBump up rails package iteration.
Ward Vandewege [Fri, 6 Jan 2017 22:31:50 +0000 (17:31 -0500)]
Bump up rails package iteration.

refs #10838

7 years agoFix run-tests.sh --only option for the workbench suite.
Ward Vandewege [Fri, 6 Jan 2017 19:17:20 +0000 (14:17 -0500)]
Fix run-tests.sh --only option for the workbench suite.

refs #8345

7 years agoMerge branch '10793-cwl-continue-on-error' closes #10793
Peter Amstutz [Fri, 6 Jan 2017 18:41:11 +0000 (13:41 -0500)]
Merge branch '10793-cwl-continue-on-error' closes #10793

7 years ago10793: Ensure on_error is set if not present in job_order_object.
Peter Amstutz [Fri, 6 Jan 2017 18:40:32 +0000 (13:40 -0500)]
10793: Ensure on_error is set if not present in job_order_object.

7 years agoMerge branch '10838-fix-rails-package-postinst'
Ward Vandewege [Fri, 6 Jan 2017 18:39:55 +0000 (13:39 -0500)]
Merge branch '10838-fix-rails-package-postinst'

closes #10838

7 years agoIn our rails postinstall package script, preserve newlines when looking
Ward Vandewege [Fri, 6 Jan 2017 18:29:00 +0000 (13:29 -0500)]
In our rails postinstall package script, preserve newlines when looking
for the '^database:' line, so that we match every line of the rake
db:migrate:status output, not just the first one.

refs #10838

7 years agoMerge branch '10223-cr-set-output-name'
Lucas Di Pentima [Thu, 5 Jan 2017 22:05:36 +0000 (19:05 -0300)]
Merge branch '10223-cr-set-output-name'
Closes #10223

7 years ago10223: Added CR's output_name to FTS index
Lucas Di Pentima [Thu, 5 Jan 2017 21:23:03 +0000 (18:23 -0300)]
10223: Added CR's output_name to FTS index

7 years ago10223: Added test to check for missing full text search indexes
Lucas Di Pentima [Thu, 5 Jan 2017 20:59:28 +0000 (17:59 -0300)]
10223: Added test to check for missing full text search indexes

7 years ago10793: Fix to return tuple for alternate exit points --create/update-workflow and...
Peter Amstutz [Thu, 5 Jan 2017 20:29:57 +0000 (15:29 -0500)]
10793: Fix to return tuple for alternate exit points --create/update-workflow and --no-wait

7 years agoMerge branch '10808-admin-cancel-job'
Tom Clegg [Thu, 5 Jan 2017 17:42:22 +0000 (12:42 -0500)]
Merge branch '10808-admin-cancel-job'

refs #10808

7 years ago10808: Move comment.
Tom Clegg [Thu, 5 Jan 2017 17:42:04 +0000 (12:42 -0500)]
10808: Move comment.

7 years ago10793: Move output_callback to finally block to ensure it is always called.
Peter Amstutz [Thu, 5 Jan 2017 16:17:57 +0000 (11:17 -0500)]
10793: Move output_callback to finally block to ensure it is always called.

7 years ago10808: Exempt "change state to Cancelled" from "locked by uuid" protection.
Tom Clegg [Thu, 5 Jan 2017 15:55:53 +0000 (10:55 -0500)]
10808: Exempt "change state to Cancelled" from "locked by uuid" protection.

7 years ago10223: Added relevant explanation on the rollback command
Lucas Di Pentima [Thu, 5 Jan 2017 15:54:30 +0000 (12:54 -0300)]
10223: Added relevant explanation on the rollback command

7 years ago10793: Return output, status tuple from executor.
Peter Amstutz [Thu, 5 Jan 2017 15:45:30 +0000 (10:45 -0500)]
10793: Return output, status tuple from executor.

7 years ago10223: Test simplification: better name, assertion error description added, and use...
Lucas Di Pentima [Thu, 5 Jan 2017 15:43:17 +0000 (12:43 -0300)]
10223: Test simplification: better name, assertion error description added, and use of preexisting fixture.

7 years agoMerge branch '10808-file-cache-ownership'
Tom Clegg [Thu, 5 Jan 2017 15:09:13 +0000 (10:09 -0500)]
Merge branch '10808-file-cache-ownership'

refs #10808

7 years ago10793: Bump cwltool pin for workflow engine improvements. Propagate on-error
Peter Amstutz [Thu, 5 Jan 2017 14:59:53 +0000 (09:59 -0500)]
10793: Bump cwltool pin for workflow engine improvements.  Propagate on-error
behavior from command line to workflow runner job.

7 years ago10808: Avoid using the disk cache if a different user owns it (e.g., running a rake...
Tom Clegg [Wed, 4 Jan 2017 23:12:13 +0000 (18:12 -0500)]
10808: Avoid using the disk cache if a different user owns it (e.g., running a rake task or crunch-dispatch as root).

7 years ago10223: Merge branch 'master' into 10223-cr-set-output-name
Lucas Di Pentima [Wed, 4 Jan 2017 15:19:39 +0000 (12:19 -0300)]
10223: Merge branch 'master' into 10223-cr-set-output-name

7 years ago10223: Added support to CR output_name on cwl-runner. Updated test.
Lucas Di Pentima [Wed, 4 Jan 2017 14:25:20 +0000 (11:25 -0300)]
10223: Added support to CR output_name on cwl-runner. Updated test.

7 years ago9831: update test that started failing due to unique name collision logic update...
radhika [Wed, 4 Jan 2017 12:17:16 +0000 (07:17 -0500)]
9831: update test that started failing due to unique name collision logic update; removed the second "Create a new project" from test since this is already tested on the API server end.

7 years ago10516: set finished_at to updated_at on pipeline_instances if the pipeline is finishe...
radhika [Wed, 4 Jan 2017 12:03:31 +0000 (07:03 -0500)]
10516: set finished_at to updated_at on pipeline_instances if the pipeline is finished but the finished_at is not set.

7 years ago10110: arv-copy workflows
radhika [Wed, 4 Jan 2017 09:20:01 +0000 (04:20 -0500)]
10110: arv-copy workflows

7 years agoFix run-tests.sh --skip option.
Tom Clegg [Wed, 4 Jan 2017 03:47:14 +0000 (22:47 -0500)]
Fix run-tests.sh --skip option.

No issue #

7 years agoMerge branch '8345-revert-llfuse-to-0.41.1'
Tom Clegg [Wed, 4 Jan 2017 01:57:40 +0000 (20:57 -0500)]
Merge branch '8345-revert-llfuse-to-0.41.1'

refs #8345

7 years ago8345: Revert llfuse to 0.41.1.
Tom Clegg [Tue, 3 Jan 2017 20:05:20 +0000 (15:05 -0500)]
8345: Revert llfuse to 0.41.1.

7 years ago8345: Compatibility with llfuse 0.41 and 1.x.
Tom Clegg [Tue, 3 Jan 2017 15:50:41 +0000 (10:50 -0500)]
8345: Compatibility with llfuse 0.41 and 1.x.

7 years ago8345: Add run-tests.sh --repeat option.
Tom Clegg [Sun, 1 Jan 2017 01:38:02 +0000 (20:38 -0500)]
8345: Add run-tests.sh --repeat option.

7 years agoMerge branch '10795-get-zero-block'
Tom Clegg [Tue, 3 Jan 2017 21:40:11 +0000 (16:40 -0500)]
Merge branch '10795-get-zero-block'

refs #10795

7 years ago10795: For md5(""), skip the request and just return an empty reader.
Tom Clegg [Tue, 3 Jan 2017 21:35:58 +0000 (16:35 -0500)]
10795: For md5(""), skip the request and just return an empty reader.

7 years ago10795: Remove test-selector code (use -check.f instead).
Tom Clegg [Tue, 3 Jan 2017 21:33:19 +0000 (16:33 -0500)]
10795: Remove test-selector code (use -check.f instead).

7 years agoMerge branch '10682-azure-stats'
Tom Clegg [Tue, 3 Jan 2017 20:50:35 +0000 (15:50 -0500)]
Merge branch '10682-azure-stats'

refs #10682

7 years ago10682: Add GetMetadataOps and GetPropertiesOps to Azure backend stats.
Tom Clegg [Tue, 3 Jan 2017 20:49:46 +0000 (15:49 -0500)]
10682: Add GetMetadataOps and GetPropertiesOps to Azure backend stats.

7 years ago10682: Add comments to statsTicker.
Tom Clegg [Tue, 3 Jan 2017 15:34:27 +0000 (10:34 -0500)]
10682: Add comments to statsTicker.

7 years ago10682: Track Azure backend errors by type.
Tom Clegg [Mon, 2 Jan 2017 19:54:43 +0000 (14:54 -0500)]
10682: Track Azure backend errors by type.

7 years ago10682: Add backend stats for Azure volumes.
Tom Clegg [Mon, 2 Jan 2017 18:57:31 +0000 (13:57 -0500)]
10682: Add backend stats for Azure volumes.

7 years ago10223: Added output_name column to container_request. When being finalized, if output...
Lucas Di Pentima [Mon, 2 Jan 2017 21:14:33 +0000 (18:14 -0300)]
10223: Added output_name column to container_request. When being finalized, if output_name is set then the output
collection will be named accordingly. If there is a unique index violation, a date is added to its name.
Also, added output_name to CR search index.

7 years ago10682: Avoid invoking special "test mode" behavior in Azure SDK.
Tom Clegg [Mon, 2 Jan 2017 20:13:45 +0000 (15:13 -0500)]
10682: Avoid invoking special "test mode" behavior in Azure SDK.

Restores compatibility with latest azure-sdk-for-go.

refs #10682

7 years agorun-build-packages-all-targets.sh: Make sure to build all packages once not twice.
Ward Vandewege [Sat, 31 Dec 2016 21:35:38 +0000 (16:35 -0500)]
run-build-packages-all-targets.sh: Make sure to build all packages once not twice.

No issue #

7 years agoMerge branch '10786-remove-centos6-from-build-directory'
Ward Vandewege [Sat, 31 Dec 2016 21:34:44 +0000 (16:34 -0500)]
Merge branch '10786-remove-centos6-from-build-directory'

closes #10786

7 years agoRemove additional CentOS6 files.
Ward Vandewege [Sat, 31 Dec 2016 20:27:51 +0000 (15:27 -0500)]
Remove additional CentOS6 files.

refs #10786

7 years agoRemove CentOS6 support from the build directory.
Ward Vandewege [Thu, 29 Dec 2016 15:33:29 +0000 (10:33 -0500)]
Remove CentOS6 support from the build directory.

refs #10786

7 years agoMerge branch 'master' into 10786-remove-centos6-from-build-directory
Ward Vandewege [Sat, 31 Dec 2016 20:20:11 +0000 (15:20 -0500)]
Merge branch 'master' into 10786-remove-centos6-from-build-directory

7 years agoMerge branch '10467-client-disconnect' closes #10467
Tom Clegg [Fri, 30 Dec 2016 22:06:55 +0000 (17:06 -0500)]
Merge branch '10467-client-disconnect' closes #10467

7 years agoMerge branch '10790-crunch-job-log-timeout' refs #10790
Peter Amstutz [Fri, 30 Dec 2016 21:12:35 +0000 (16:12 -0500)]
Merge branch '10790-crunch-job-log-timeout' refs #10790

7 years ago10790: Increase timeout reading from arv-put.
Peter Amstutz [Fri, 30 Dec 2016 20:48:23 +0000 (15:48 -0500)]
10790: Increase timeout reading from arv-put.

7 years agoMerge branch '10538-trash-delete' closes #10538
Tom Clegg [Fri, 30 Dec 2016 20:17:02 +0000 (15:17 -0500)]
Merge branch '10538-trash-delete' closes #10538

7 years ago10538: Mention fixture names in comments when not using fixture finders.
Tom Clegg [Fri, 30 Dec 2016 20:16:31 +0000 (15:16 -0500)]
10538: Mention fixture names in comments when not using fixture finders.

7 years ago10467: Use BlockReader and BlockWriter interfaces instead of passing methods to get...
Tom Clegg [Fri, 30 Dec 2016 19:58:00 +0000 (14:58 -0500)]
10467: Use BlockReader and BlockWriter interfaces instead of passing methods to get/putWithPipe.

7 years ago10467: Remove debug printfs.
Tom Clegg [Fri, 30 Dec 2016 19:41:12 +0000 (14:41 -0500)]
10467: Remove debug printfs.

7 years ago10467: Remove unneeded errorReadCloser, make getter/putter interfaces more like Write...
Tom Clegg [Fri, 30 Dec 2016 19:39:52 +0000 (14:39 -0500)]
10467: Remove unneeded errorReadCloser, make getter/putter interfaces more like WriterTo/ReaderFrom.

7 years agoMerge branch '10497-cwl-job-logs' closes #10497
Peter Amstutz [Fri, 30 Dec 2016 19:12:27 +0000 (14:12 -0500)]
Merge branch '10497-cwl-job-logs' closes #10497

7 years agoMerge branch '10722-cwl-subworkflow' closes #10722
Peter Amstutz [Fri, 30 Dec 2016 19:12:16 +0000 (14:12 -0500)]
Merge branch '10722-cwl-subworkflow' closes #10722

7 years ago10538: Clarify error message.
Tom Clegg [Fri, 30 Dec 2016 18:39:07 +0000 (13:39 -0500)]
10538: Clarify error message.

7 years ago10538: Clear up default_trash_interval logic
Tom Clegg [Fri, 30 Dec 2016 18:38:26 +0000 (13:38 -0500)]
10538: Clear up default_trash_interval logic

7 years ago10538: Fix misspelled IsTrash -> IsTrashed
Tom Clegg [Fri, 30 Dec 2016 18:37:41 +0000 (13:37 -0500)]
10538: Fix misspelled IsTrash -> IsTrashed