radhika [Mon, 14 Sep 2015 19:11:47 +0000 (15:11 -0400)]
closes #7179
Merge branch '7179-generic-volume-tests'
radhika [Mon, 14 Sep 2015 14:31:47 +0000 (10:31 -0400)]
7179: Most of golint suggested updates are made. Some names such as "never_delete" are left alone.
Also suggestions such as "replace errors.New(fmt.Sprintf(...)) with fmt.Errorf(...)" are ignored.
radhika [Mon, 14 Sep 2015 13:33:13 +0000 (09:33 -0400)]
7179: some more golint suggested updates
radhika [Sat, 12 Sep 2015 15:02:22 +0000 (11:02 -0400)]
7179: several golint suggested updates such as "don't use ALL_CAPS in Go names; use CamelCase".
Now keepstore.go and handlers.go are almost lint free; a few such as blob_signature_ttl are not renamed at this time.
radhika [Sat, 12 Sep 2015 14:06:23 +0000 (10:06 -0400)]
7179: handler_test.go is now lint free according to golint.
radhika [Sat, 12 Sep 2015 13:32:29 +0000 (09:32 -0400)]
7179: Rather than using a DoGenericReadOnlyVolumeTests to test read-only volumes, update each test to either support
both read-only and writable modes, or skip a test if it is indended for the other mode. This helps ensure as many
tests as possible are executed in either case.
radhika [Sat, 12 Sep 2015 00:33:50 +0000 (20:33 -0400)]
7179: A few golint suggested updates. There are still a lot of golint complaints.
radhika [Fri, 11 Sep 2015 23:18:27 +0000 (19:18 -0400)]
7179: add TestUnixVolumeWithGenericTestsSerialized and some more updates.
radhika [Fri, 11 Sep 2015 20:46:07 +0000 (16:46 -0400)]
Merge branch '7179-generic-volume-tests' of git.curoverse.com:arvados into 7179-generic-volume-tests
Tom Clegg [Fri, 11 Sep 2015 20:13:53 +0000 (16:13 -0400)]
7179: Tighten Put requirements when overwriting existing data.
radhika [Fri, 11 Sep 2015 19:19:21 +0000 (15:19 -0400)]
Merge branch 'master' into 7179-generic-volume-tests
Tom Clegg [Fri, 11 Sep 2015 18:41:28 +0000 (14:41 -0400)]
Merge branch 'wtsi-hgi-fix/7310-git-v2-http-500-error-matches' fixes #7310
radhika [Fri, 11 Sep 2015 15:59:05 +0000 (11:59 -0400)]
7179: add generic volume test; as part of this exercise, moved some "generic" tests from volume_unix_test.go
into volume_generic_test.go so that we do not repeat these in all storage device related testing.
Joshua C. Randall [Fri, 11 Sep 2015 15:08:44 +0000 (15:08 +0000)]
7310: adds git v2 style regex to match http 500 error
radhika [Thu, 10 Sep 2015 14:59:48 +0000 (10:59 -0400)]
7179: list out the potential tests
Tom Clegg [Thu, 10 Sep 2015 00:49:30 +0000 (20:49 -0400)]
Merge branch '7179-test-mocks' refs #7179
Tom Clegg [Thu, 10 Sep 2015 00:48:53 +0000 (20:48 -0400)]
Merge branch 'master' into 7179-test-mocks
Conflicts:
services/keepstore/volume.go
services/keepstore/volume_unix_test.go
Tom Clegg [Wed, 9 Sep 2015 21:41:57 +0000 (17:41 -0400)]
7179: Improve comments.
Peter Amstutz [Wed, 9 Sep 2015 20:39:37 +0000 (16:39 -0400)]
Brown bag typo bugfix. refs #7031
Peter Amstutz [Wed, 9 Sep 2015 20:35:36 +0000 (16:35 -0400)]
Catch errors thrown by sync_node() in Azure driver refs #7031.
Tom Clegg [Wed, 9 Sep 2015 16:32:30 +0000 (12:32 -0400)]
7179: Improve description of how races must be handled.
Peter Amstutz [Wed, 9 Sep 2015 15:43:54 +0000 (11:43 -0400)]
Bump node manager libcloud pin to dev3 refs #7031
Tom Clegg [Wed, 9 Sep 2015 02:40:22 +0000 (22:40 -0400)]
Merge branch '7121-fix-deadlock' closes #7121
Tom Clegg [Tue, 8 Sep 2015 21:12:17 +0000 (17:12 -0400)]
7179: Add Volume interface specs.
Peter Amstutz [Tue, 8 Sep 2015 19:35:02 +0000 (15:35 -0400)]
Merge branch '7193-provision-azure-compute' closes #7193
Peter Amstutz [Tue, 8 Sep 2015 19:23:06 +0000 (15:23 -0400)]
7193: Tweak example config.
Brett Smith [Tue, 8 Sep 2015 19:13:50 +0000 (15:13 -0400)]
7225: ArvadosFile.flush() commits all underlying blocks.
Fix a typo that caused only the last block to be flushed.
Refs #7225.
Tom Clegg [Tue, 8 Sep 2015 18:04:14 +0000 (14:04 -0400)]
7121: Add collisionOrCorrupt->DiskHashError test cases where the mismatched data is in buf1.
Brett Smith [Tue, 8 Sep 2015 17:56:19 +0000 (13:56 -0400)]
7170: Fix Ruby configure switch typo.
--no-install-rdoc should be spelled --disable-install-rdoc.
Refs #7170.
Brett Smith [Tue, 8 Sep 2015 17:36:17 +0000 (13:36 -0400)]
Move arvados-api-server-upgrade.sh down in install guide.
Same rationale as
2a6a3720271a12bc8a47928ade5b2c641514ca44.
No issue #.
Tom Clegg [Tue, 8 Sep 2015 17:31:04 +0000 (13:31 -0400)]
7121: Add comment about why buffers must be returned.
Tom Clegg [Tue, 8 Sep 2015 15:32:47 +0000 (11:32 -0400)]
7121: Fixup log messages (remove excess \n, show which volume had a Get() error).
Tom Clegg [Tue, 8 Sep 2015 15:23:52 +0000 (11:23 -0400)]
7121: Log all errors (except the everyday "not found") encountered during CompareAndTouch().
Tom Clegg [Tue, 8 Sep 2015 15:22:50 +0000 (11:22 -0400)]
7121: Clarify expected behavior of Compare() in Volume interface.
Tom Clegg [Tue, 8 Sep 2015 15:16:44 +0000 (11:16 -0400)]
7121: Rename mutex_test.go -> mock_mutex_for_test.go
Tom Clegg [Tue, 8 Sep 2015 15:06:37 +0000 (11:06 -0400)]
7121: Update comment to match new argument name.
Tom Clegg [Tue, 8 Sep 2015 15:05:45 +0000 (11:05 -0400)]
7121: 7218: Get the serialize lock before opening a file.
In certain error cases (Stat() succeeds but Open() fails) this can
cause a failure to wait behind the serialize lock, but in normal
operation ("success" and "not found") it conserves open file handles
when there's a lot of contention for the serialize lock.
Tom Clegg [Thu, 3 Sep 2015 19:15:32 +0000 (15:15 -0400)]
7121: Test mutex usage with a mock instead of time.Sleep.
Tom Clegg [Tue, 8 Sep 2015 04:38:41 +0000 (00:38 -0400)]
7179: Start a set of generic volume tests.
Tom Clegg [Tue, 8 Sep 2015 04:08:14 +0000 (00:08 -0400)]
7179: Add TestableVolume interface, make UnixVolume tests a bit more reusable.
Tom Clegg [Thu, 3 Sep 2015 17:42:32 +0000 (13:42 -0400)]
7121: Return DiskHashError instead of CollisionError from Compare() where appropriate.
Tom Clegg [Thu, 3 Sep 2015 04:54:52 +0000 (00:54 -0400)]
7121: Replace Get(loc,true) with CompareAndTouch(). Add Compare method to Volume, UnixVolume, MockVolume.
Tom Clegg [Thu, 3 Sep 2015 03:19:23 +0000 (23:19 -0400)]
7121: Add test case to demonstrate deadlock.
Tom Clegg [Mon, 7 Sep 2015 18:10:30 +0000 (14:10 -0400)]
Merge branch '6263-gitolite-test' refs #6263
Tom Clegg [Mon, 7 Sep 2015 17:56:48 +0000 (13:56 -0400)]
Merge branch 'wtsi-hgi-fix/7205-arv-edit-tty-check'
refs #7205
Ward Vandewege [Sat, 5 Sep 2015 02:37:05 +0000 (22:37 -0400)]
Update docs to accomodate URL change for the Arvados redmine
installation. It now lives at dev.arvados.org.
refs #7187
Peter Amstutz [Fri, 4 Sep 2015 15:06:17 +0000 (11:06 -0400)]
7193: Use tags instead of _make_ping_url
Brett Smith [Fri, 4 Sep 2015 14:53:58 +0000 (10:53 -0400)]
Fix switch typo in arv-mount tutorial docs.
No issue #.
Peter Amstutz [Fri, 4 Sep 2015 14:45:34 +0000 (10:45 -0400)]
7193: Move ex_run_command to post_create_node()
Peter Amstutz [Fri, 4 Sep 2015 13:58:36 +0000 (09:58 -0400)]
7193: Bump dependency to dev2
Peter Amstutz [Fri, 4 Sep 2015 13:32:55 +0000 (09:32 -0400)]
7193: Set timestamp on ex_run_command to ensure that the provisioning script runs.
Joshua Randall [Fri, 4 Sep 2015 01:33:20 +0000 (02:33 +0100)]
Moves printing of `arv edit` messages out-of-band
Messages regarding update of object after edit are now
printed out-of-band to STDERR rather than to STDOUT
where they might mix with non-interactive "editors"
Joshua Randall [Fri, 4 Sep 2015 01:31:38 +0000 (02:31 +0100)]
Removes unnecessary check that stdout is a TTY
Peter Amstutz [Thu, 3 Sep 2015 14:40:34 +0000 (10:40 -0400)]
7193: Run provision script after creating node, not in sync_node, because
sync_node doesn't get called until the node has pinged!
Ward Vandewege [Thu, 3 Sep 2015 00:17:29 +0000 (20:17 -0400)]
arv-copy: Make the help text for the --src and --dst options more easily
intelligible.
No issue #
Peter Amstutz [Wed, 2 Sep 2015 20:43:29 +0000 (16:43 -0400)]
7193: Add ex_run_command
Tom Clegg [Wed, 2 Sep 2015 14:17:09 +0000 (10:17 -0400)]
6263: Rearrange test suites to share code better.
Brett Smith [Wed, 2 Sep 2015 13:52:06 +0000 (09:52 -0400)]
Merge branch '6638-python-backport-dependencies-wip'
Closes #6638.
Brett Smith [Wed, 26 Aug 2015 14:49:41 +0000 (10:49 -0400)]
6638: Remove C dependencies from our Python SDK.
Now that our backports properly declare their C dependencies, they're
no longer needed here.
Brett Smith [Wed, 26 Aug 2015 14:49:14 +0000 (10:49 -0400)]
6638: Python backports declare all their C dependencies.
See #6638 for discussion about how these dependency lists were
generated.
Tom Clegg [Wed, 2 Sep 2015 07:06:05 +0000 (03:06 -0400)]
6263: Add gitolite integration test. Fix existing tests to use bare repos on server side.
Tom Clegg [Tue, 1 Sep 2015 18:00:24 +0000 (14:00 -0400)]
Merge branch '6953-docker-image-cleaner' closes #6953
Peter Amstutz [Tue, 1 Sep 2015 13:15:28 +0000 (09:15 -0400)]
Fix import error for NodeAuthSSHKey refs #6507
Tom Clegg [Mon, 31 Aug 2015 18:51:51 +0000 (14:51 -0400)]
6953: Add arvados-docker-cleaner instructions to compute node setup page.
Peter Amstutz [Fri, 28 Aug 2015 15:38:37 +0000 (11:38 -0400)]
Merge branch '6507-node-manager-azure' closes #6507
Peter Amstutz [Fri, 28 Aug 2015 14:44:32 +0000 (10:44 -0400)]
Merge branch 'master' into 6507-node-manager-azure
Tom Clegg [Thu, 27 Aug 2015 21:17:36 +0000 (17:17 -0400)]
Merge branch '6997-keepstore-mem' refs #6997
Tom Clegg [Thu, 27 Aug 2015 21:14:28 +0000 (17:14 -0400)]
6997: Fix fencepost error causing race condition in test.
Tom Clegg [Thu, 27 Aug 2015 21:10:25 +0000 (17:10 -0400)]
6997: Add test case for (*UnixVolume)IndexTo().
Ward Vandewege [Thu, 27 Aug 2015 20:03:11 +0000 (16:03 -0400)]
Doc fix: protect against accidentally pulling in all versions of the
arvados/jobs image in versions of Docker before 1.3.
Cf. https://github.com/docker/docker/commit/
82b0c3e59ca12dd87bf2a9d88a63ff66e7d29fb4
closes #7150
Tom Clegg [Mon, 24 Aug 2015 00:05:43 +0000 (20:05 -0400)]
6997: Avoid unnecessarily inefficient dirent sorting (and a mismatch between index and store/fetch logic) by doing a custom traversal.
Tom Clegg [Thu, 27 Aug 2015 20:03:24 +0000 (16:03 -0400)]
Write "all interfaces, any port" as ":0" (not ":") for compatibility with Go 1.5. refs #6997
Peter Amstutz [Thu, 27 Aug 2015 18:23:06 +0000 (14:23 -0400)]
6507: Change version number for libcloud fork to 0.18.1.dev1 because local tags create too much trouble.
Tom Clegg [Thu, 27 Aug 2015 15:32:08 +0000 (11:32 -0400)]
Merge branch '6859-fix-invalid-manifests' refs #6859
Tom Clegg [Thu, 27 Aug 2015 15:31:14 +0000 (11:31 -0400)]
6859: Find locator-like strings even if not space-delimited.
Tom Clegg [Thu, 27 Aug 2015 14:45:33 +0000 (10:45 -0400)]
6859: Fix up module usage, mock backtick to test arv-put error handling.
Tom Clegg [Thu, 27 Aug 2015 13:41:05 +0000 (09:41 -0400)]
Merge branch '6263-arv-gitolite' refs #6263
Tom Clegg [Thu, 27 Aug 2015 01:44:57 +0000 (21:44 -0400)]
6263: gofmt
Tom Clegg [Thu, 27 Aug 2015 01:21:15 +0000 (21:21 -0400)]
6263: Update doc.go: mention gitolite-shell.
radhika [Thu, 27 Aug 2015 00:19:57 +0000 (20:19 -0400)]
6859: improve locator parsing to consider any terminating [[:xdigit:]]{32}; improve tests with more invalid locators.
radhika [Wed, 26 Aug 2015 22:06:17 +0000 (18:06 -0400)]
Merge branch 'master' into 6859-fix-invalid-manifests
Peter Amstutz [Wed, 26 Aug 2015 19:24:11 +0000 (15:24 -0400)]
6507: Filter out "tag_" from create_kwargs.
Peter Amstutz [Wed, 26 Aug 2015 19:23:35 +0000 (15:23 -0400)]
6507: Use dependency_links to specify custom libcloud package needed for azure support.
Tom Clegg [Wed, 26 Aug 2015 19:01:27 +0000 (15:01 -0400)]
6781: Pass tests regardless of whether an admin group exists on the test host. refs #6871
Tom Clegg [Wed, 26 Aug 2015 15:41:03 +0000 (11:41 -0400)]
Merge branch '6781-arvados-login-sync' refs #6781
Tom Clegg [Tue, 25 Aug 2015 19:10:57 +0000 (15:10 -0400)]
6781: Clarify "logins" vs. "get_all_logins" APIs by moving common code into render_logins_for.
Tom Clegg [Tue, 25 Aug 2015 17:51:17 +0000 (13:51 -0400)]
6781: Do not try /get_all_logins (the new /logins route is now 2 years old).
Ward Vandewege [Wed, 19 Aug 2015 21:04:02 +0000 (17:04 -0400)]
6781: Fix scope for user-sync script in documentation.
Tom Clegg [Fri, 14 Aug 2015 21:37:26 +0000 (17:37 -0400)]
6781: Add arvados-login-sync section to shell server install page.
Tom Clegg [Fri, 14 Aug 2015 04:44:52 +0000 (00:44 -0400)]
6781: Add test cases and packaging support.
Tom Clegg [Thu, 13 Aug 2015 15:56:21 +0000 (11:56 -0400)]
6781: Use env vars instead of yaml config file.
Ward Vandewege [Thu, 13 Aug 2015 14:46:57 +0000 (10:46 -0400)]
6781: Add arvados-login-sync (was update-shell-accounts.rb)
Brett Smith [Wed, 26 Aug 2015 01:29:10 +0000 (21:29 -0400)]
Merge branch '6940-workbench-centos-install-wip'
Closes #6940, #7053.
Brett Smith [Thu, 20 Aug 2015 16:59:56 +0000 (12:59 -0400)]
6940: Workbench install guide describes using Nginx with Software Collections.
Because Workbench invokes arv-get, it needs this configuration to find
arv-get in the Software Collection root.
Brett Smith [Thu, 20 Aug 2015 15:13:03 +0000 (11:13 -0400)]
6940: Move arvados-workbench-upgrade.sh down in install guide.
The script tries to restart Nginx, so Nginx should be set up first.
No issue #.
radhika [Tue, 25 Aug 2015 19:01:40 +0000 (15:01 -0400)]
6859: add test that creates and salvages a collection with invalid manifest text.
radhika [Tue, 25 Aug 2015 18:01:37 +0000 (14:01 -0400)]
Merge branch 'master' into 6859-fix-invalid-manifests
radhika [Tue, 25 Aug 2015 18:00:35 +0000 (14:00 -0400)]
6859: script does not catch expections during salvaging; instead they are propagated resulting in exit; update tests.
Peter Amstutz [Tue, 25 Aug 2015 17:07:41 +0000 (13:07 -0400)]
Fix up additional places in keepproxy install docs to use example
"keep$uuid_prefix.your.domain" consistently. refs #6918
Peter Amstutz [Tue, 25 Aug 2015 17:02:55 +0000 (13:02 -0400)]
6507: Remove unused imports, move _init_ssh_key() into base, set hostname tag on sync_node(), tweak tests.