arvados.git
8 years ago7179: Rather than using a DoGenericReadOnlyVolumeTests to test read-only volumes...
radhika [Sat, 12 Sep 2015 13:32:29 +0000 (09:32 -0400)]
7179: Rather than using a DoGenericReadOnlyVolumeTests to test read-only volumes, update each test to either support
both read-only and writable modes, or skip a test if it is indended for the other mode. This helps ensure as many
tests as possible are executed in either case.

8 years ago7179: A few golint suggested updates. There are still a lot of golint complaints.
radhika [Sat, 12 Sep 2015 00:33:50 +0000 (20:33 -0400)]
7179: A few golint suggested updates. There are still a lot of golint complaints.

8 years ago7179: add TestUnixVolumeWithGenericTestsSerialized and some more updates.
radhika [Fri, 11 Sep 2015 23:18:27 +0000 (19:18 -0400)]
7179: add TestUnixVolumeWithGenericTestsSerialized and some more updates.

8 years agoMerge branch '7179-generic-volume-tests' of git.curoverse.com:arvados into 7179-gener...
radhika [Fri, 11 Sep 2015 20:46:07 +0000 (16:46 -0400)]
Merge branch '7179-generic-volume-tests' of git.curoverse.com:arvados into 7179-generic-volume-tests

8 years ago7179: Tighten Put requirements when overwriting existing data.
Tom Clegg [Fri, 11 Sep 2015 20:13:53 +0000 (16:13 -0400)]
7179: Tighten Put requirements when overwriting existing data.

8 years agoMerge branch 'master' into 7179-generic-volume-tests
radhika [Fri, 11 Sep 2015 19:19:21 +0000 (15:19 -0400)]
Merge branch 'master' into 7179-generic-volume-tests

8 years agoMerge branch 'wtsi-hgi-fix/7310-git-v2-http-500-error-matches' fixes #7310
Tom Clegg [Fri, 11 Sep 2015 18:41:28 +0000 (14:41 -0400)]
Merge branch 'wtsi-hgi-fix/7310-git-v2-http-500-error-matches' fixes #7310

8 years ago7179: add generic volume test; as part of this exercise, moved some "generic" tests...
radhika [Fri, 11 Sep 2015 15:59:05 +0000 (11:59 -0400)]
7179: add generic volume test; as part of this exercise, moved some "generic" tests from volume_unix_test.go
into volume_generic_test.go so that we do not repeat these in all storage device related testing.

8 years ago7310: adds git v2 style regex to match http 500 error
Joshua C. Randall [Fri, 11 Sep 2015 15:08:44 +0000 (15:08 +0000)]
7310: adds git v2 style regex to match http 500 error

8 years ago7307: Fixes mocked up CGI output and adds comment regarding SplitHostPort error
Joshua C. Randall [Fri, 11 Sep 2015 12:46:16 +0000 (12:46 +0000)]
7307: Fixes mocked up CGI output and adds comment regarding SplitHostPort error

8 years ago6260: Reduced-replication test requires replication>=desired, not replication==len...
Tom Clegg [Thu, 10 Sep 2015 15:17:36 +0000 (11:17 -0400)]
6260: Reduced-replication test requires replication>=desired, not replication==len(keepServers).

8 years ago7179: list out the potential tests
radhika [Thu, 10 Sep 2015 14:59:48 +0000 (10:59 -0400)]
7179: list out the potential tests

8 years ago6260: Remove unnecessary Sleep()
Tom Clegg [Thu, 10 Sep 2015 14:54:45 +0000 (10:54 -0400)]
6260: Remove unnecessary Sleep()

8 years agoPuts pbr 1.7.0 on blacklist for services/dockercleaner
Joshua C. Randall [Thu, 10 Sep 2015 13:31:16 +0000 (14:31 +0100)]
Puts pbr 1.7.0 on blacklist for services/dockercleaner

8 years agoBlacklists pbr version 1.7.0 as it is not working with mock 1.3.0
Joshua C. Randall [Thu, 10 Sep 2015 11:37:25 +0000 (11:37 +0000)]
Blacklists pbr version 1.7.0 as it is not working with mock 1.3.0

8 years ago6260: no longer need the keep.data-manager-token-file
radhika [Thu, 10 Sep 2015 01:14:37 +0000 (21:14 -0400)]
6260: no longer need the keep.data-manager-token-file

8 years agoMerge branch '7179-test-mocks' refs #7179
Tom Clegg [Thu, 10 Sep 2015 00:49:30 +0000 (20:49 -0400)]
Merge branch '7179-test-mocks' refs #7179

8 years agoMerge branch 'master' into 7179-test-mocks
Tom Clegg [Thu, 10 Sep 2015 00:48:53 +0000 (20:48 -0400)]
Merge branch 'master' into 7179-test-mocks

Conflicts:
services/keepstore/volume.go
services/keepstore/volume_unix_test.go

9 years ago7179: Improve comments.
Tom Clegg [Wed, 9 Sep 2015 21:41:57 +0000 (17:41 -0400)]
7179: Improve comments.

9 years agoBrown bag typo bugfix. refs #7031
Peter Amstutz [Wed, 9 Sep 2015 20:39:37 +0000 (16:39 -0400)]
Brown bag typo bugfix.  refs #7031

9 years agoCatch errors thrown by sync_node() in Azure driver refs #7031.
Peter Amstutz [Wed, 9 Sep 2015 20:35:36 +0000 (16:35 -0400)]
Catch errors thrown by sync_node() in Azure driver refs #7031.

9 years ago6260: Fix up /status.json checks.
Tom Clegg [Wed, 9 Sep 2015 20:12:28 +0000 (16:12 -0400)]
6260: Fix up /status.json checks.

9 years ago6260: Simplify verifyBlocks logic.
Tom Clegg [Wed, 9 Sep 2015 19:09:46 +0000 (15:09 -0400)]
6260: Simplify verifyBlocks logic.

9 years ago6260: Remove test for impossible condition.
Tom Clegg [Wed, 9 Sep 2015 19:09:15 +0000 (15:09 -0400)]
6260: Remove test for impossible condition.

9 years ago6260: Fix up error messages.
Tom Clegg [Wed, 9 Sep 2015 19:09:05 +0000 (15:09 -0400)]
6260: Fix up error messages.

9 years ago6260: Remove extra hyphen from command line args.
Tom Clegg [Wed, 9 Sep 2015 19:08:31 +0000 (15:08 -0400)]
6260: Remove extra hyphen from command line args.

9 years ago6260: Just use the token loaded by the SDK (ARVADOS_API_TOKEN),
Tom Clegg [Wed, 9 Sep 2015 19:08:09 +0000 (15:08 -0400)]
6260: Just use the token loaded by the SDK (ARVADOS_API_TOKEN),
instead of requiring a token separately on the command line.

9 years ago7179: Improve description of how races must be handled.
Tom Clegg [Wed, 9 Sep 2015 16:32:30 +0000 (12:32 -0400)]
7179: Improve description of how races must be handled.

9 years agoBump node manager libcloud pin to dev3 refs #7031
Peter Amstutz [Wed, 9 Sep 2015 15:43:54 +0000 (11:43 -0400)]
Bump node manager libcloud pin to dev3 refs #7031

9 years agoMerge branch '7121-fix-deadlock' closes #7121
Tom Clegg [Wed, 9 Sep 2015 02:40:22 +0000 (22:40 -0400)]
Merge branch '7121-fix-deadlock' closes #7121

9 years ago6260: update datamanager.go to return error than Fatalf in some cases; add additional...
radhika [Wed, 9 Sep 2015 00:48:22 +0000 (20:48 -0400)]
6260: update datamanager.go to return error than Fatalf in some cases; add additional tests to test those errors raised.

9 years ago6260: Continue to force never_delete to be true until #6221 is resolved; in the meant...
radhika [Tue, 8 Sep 2015 22:18:19 +0000 (18:18 -0400)]
6260: Continue to force never_delete to be true until #6221 is resolved; in the meantime, let it be false during testing.

9 years agoMerge branch 'master' into 6260-test-datamanager
radhika [Tue, 8 Sep 2015 21:30:48 +0000 (17:30 -0400)]
Merge branch 'master' into 6260-test-datamanager

9 years ago6260: look for two replicas
radhika [Tue, 8 Sep 2015 21:30:14 +0000 (17:30 -0400)]
6260: look for two replicas

9 years ago7179: Add Volume interface specs.
Tom Clegg [Tue, 8 Sep 2015 21:12:17 +0000 (17:12 -0400)]
7179: Add Volume interface specs.

9 years agoMerge branch '7193-provision-azure-compute' closes #7193
Peter Amstutz [Tue, 8 Sep 2015 19:35:02 +0000 (15:35 -0400)]
Merge branch '7193-provision-azure-compute' closes #7193

9 years ago7193: Tweak example config.
Peter Amstutz [Tue, 8 Sep 2015 19:23:06 +0000 (15:23 -0400)]
7193: Tweak example config.

9 years ago7225: ArvadosFile.flush() commits all underlying blocks.
Brett Smith [Tue, 8 Sep 2015 19:13:50 +0000 (15:13 -0400)]
7225: ArvadosFile.flush() commits all underlying blocks.

Fix a typo that caused only the last block to be flushed.
Refs #7225.

9 years ago7121: Add collisionOrCorrupt->DiskHashError test cases where the mismatched data...
Tom Clegg [Tue, 8 Sep 2015 18:04:14 +0000 (14:04 -0400)]
7121: Add collisionOrCorrupt->DiskHashError test cases where the mismatched data is in buf1.

9 years ago7170: Fix Ruby configure switch typo.
Brett Smith [Tue, 8 Sep 2015 17:56:19 +0000 (13:56 -0400)]
7170: Fix Ruby configure switch typo.

--no-install-rdoc should be spelled --disable-install-rdoc.
Refs #7170.

9 years agoMove arvados-api-server-upgrade.sh down in install guide.
Brett Smith [Tue, 8 Sep 2015 17:36:17 +0000 (13:36 -0400)]
Move arvados-api-server-upgrade.sh down in install guide.

Same rationale as 2a6a3720271a12bc8a47928ade5b2c641514ca44.
No issue #.

9 years ago7121: Add comment about why buffers must be returned.
Tom Clegg [Tue, 8 Sep 2015 17:31:04 +0000 (13:31 -0400)]
7121: Add comment about why buffers must be returned.

9 years ago6260: break old blocks into used and unused sets to make it easy to understand code...
radhika [Tue, 8 Sep 2015 17:23:00 +0000 (13:23 -0400)]
6260: break old blocks into used and unused sets to make it easy to understand code and some more updates.

9 years agoMerge branch 'master' into 6260-test-datamanager
radhika [Tue, 8 Sep 2015 16:33:23 +0000 (12:33 -0400)]
Merge branch 'master' into 6260-test-datamanager

9 years ago7121: Fixup log messages (remove excess \n, show which volume had a Get() error).
Tom Clegg [Tue, 8 Sep 2015 15:32:47 +0000 (11:32 -0400)]
7121: Fixup log messages (remove excess \n, show which volume had a Get() error).

9 years ago7121: Log all errors (except the everyday "not found") encountered during CompareAndT...
Tom Clegg [Tue, 8 Sep 2015 15:23:52 +0000 (11:23 -0400)]
7121: Log all errors (except the everyday "not found") encountered during CompareAndTouch().

9 years ago7121: Clarify expected behavior of Compare() in Volume interface.
Tom Clegg [Tue, 8 Sep 2015 15:22:50 +0000 (11:22 -0400)]
7121: Clarify expected behavior of Compare() in Volume interface.

9 years ago7121: Rename mutex_test.go -> mock_mutex_for_test.go
Tom Clegg [Tue, 8 Sep 2015 15:16:44 +0000 (11:16 -0400)]
7121: Rename mutex_test.go -> mock_mutex_for_test.go

9 years ago7121: Update comment to match new argument name.
Tom Clegg [Tue, 8 Sep 2015 15:06:37 +0000 (11:06 -0400)]
7121: Update comment to match new argument name.

9 years ago7121: 7218: Get the serialize lock before opening a file.
Tom Clegg [Tue, 8 Sep 2015 15:05:45 +0000 (11:05 -0400)]
7121: 7218: Get the serialize lock before opening a file.

In certain error cases (Stat() succeeds but Open() fails) this can
cause a failure to wait behind the serialize lock, but in normal
operation ("success" and "not found") it conserves open file handles
when there's a lot of contention for the serialize lock.

9 years ago7121: Test mutex usage with a mock instead of time.Sleep.
Tom Clegg [Thu, 3 Sep 2015 19:15:32 +0000 (15:15 -0400)]
7121: Test mutex usage with a mock instead of time.Sleep.

9 years ago7179: Start a set of generic volume tests.
Tom Clegg [Tue, 8 Sep 2015 04:38:41 +0000 (00:38 -0400)]
7179: Start a set of generic volume tests.

9 years ago7179: Add TestableVolume interface, make UnixVolume tests a bit more reusable.
Tom Clegg [Tue, 8 Sep 2015 04:08:14 +0000 (00:08 -0400)]
7179: Add TestableVolume interface, make UnixVolume tests a bit more reusable.

9 years ago7121: Return DiskHashError instead of CollisionError from Compare() where appropriate.
Tom Clegg [Thu, 3 Sep 2015 17:42:32 +0000 (13:42 -0400)]
7121: Return DiskHashError instead of CollisionError from Compare() where appropriate.

9 years ago7121: Replace Get(loc,true) with CompareAndTouch(). Add Compare method to Volume...
Tom Clegg [Thu, 3 Sep 2015 04:54:52 +0000 (00:54 -0400)]
7121: Replace Get(loc,true) with CompareAndTouch(). Add Compare method to Volume, UnixVolume, MockVolume.

9 years ago7121: Add test case to demonstrate deadlock.
Tom Clegg [Thu, 3 Sep 2015 03:19:23 +0000 (23:19 -0400)]
7121: Add test case to demonstrate deadlock.

9 years agoMerge branch 'fix/7205-arv-edit-tty-check' into feature/arv-view
Joshua Randall [Mon, 7 Sep 2015 19:05:14 +0000 (20:05 +0100)]
Merge branch 'fix/7205-arv-edit-tty-check' into feature/arv-view

9 years agoAdds an abort if global_opts[:format] is not recognized
Joshua Randall [Mon, 7 Sep 2015 19:04:30 +0000 (20:04 +0100)]
Adds an abort if global_opts[:format] is not recognized

9 years agoMakes bin_path local
Joshua Randall [Mon, 7 Sep 2015 18:57:39 +0000 (19:57 +0100)]
Makes bin_path local

9 years agoMerge branch '6263-gitolite-test' refs #6263
Tom Clegg [Mon, 7 Sep 2015 18:10:30 +0000 (14:10 -0400)]
Merge branch '6263-gitolite-test' refs #6263

9 years agoMerge branch 'wtsi-hgi-fix/7205-arv-edit-tty-check'
Tom Clegg [Mon, 7 Sep 2015 17:56:48 +0000 (13:56 -0400)]
Merge branch 'wtsi-hgi-fix/7205-arv-edit-tty-check'

refs #7205

9 years agoChanges new feature name to `arv get`
Joshua Randall [Mon, 7 Sep 2015 14:47:16 +0000 (15:47 +0100)]
Changes new feature name to `arv get`

9 years agoUpdate docs to accomodate URL change for the Arvados redmine
Ward Vandewege [Sat, 5 Sep 2015 02:37:05 +0000 (22:37 -0400)]
Update docs to accomodate URL change for the Arvados redmine
installation. It now lives at dev.arvados.org.

refs #7187

9 years agoMerge remote-tracking branch 'hgi/develop' into fix/7205-arv-edit-tty-check
Joshua Randall [Fri, 4 Sep 2015 23:20:25 +0000 (00:20 +0100)]
Merge remote-tracking branch 'hgi/develop' into fix/7205-arv-edit-tty-check

Conflicts:
sdk/cli/bin/arv

9 years ago6260: add check in datamanager to ensure that the configured datamanager token belong...
radhika [Fri, 4 Sep 2015 17:31:45 +0000 (13:31 -0400)]
6260: add check in datamanager to ensure that the configured datamanager token belongs to an admin user.

9 years ago7193: Use tags instead of _make_ping_url
Peter Amstutz [Fri, 4 Sep 2015 15:06:17 +0000 (11:06 -0400)]
7193: Use tags instead of _make_ping_url

9 years agoFix switch typo in arv-mount tutorial docs.
Brett Smith [Fri, 4 Sep 2015 14:53:58 +0000 (10:53 -0400)]
Fix switch typo in arv-mount tutorial docs.

No issue #.

9 years ago7193: Move ex_run_command to post_create_node()
Peter Amstutz [Fri, 4 Sep 2015 14:45:34 +0000 (10:45 -0400)]
7193: Move ex_run_command to post_create_node()

9 years ago7193: Bump dependency to dev2
Peter Amstutz [Fri, 4 Sep 2015 13:58:36 +0000 (09:58 -0400)]
7193: Bump dependency to dev2

9 years ago7193: Set timestamp on ex_run_command to ensure that the provisioning script runs.
Peter Amstutz [Fri, 4 Sep 2015 13:32:55 +0000 (09:32 -0400)]
7193: Set timestamp on ex_run_command to ensure that the provisioning script runs.

9 years agoMerge pull request #2 from wtsi-hgi/feature/arv-view
Joshua C. Randall [Fri, 4 Sep 2015 09:55:37 +0000 (10:55 +0100)]
Merge pull request #2 from wtsi-hgi/feature/arv-view

Feature/arv view

9 years agoMoves printing of `arv edit` messages out-of-band
Joshua Randall [Fri, 4 Sep 2015 01:33:20 +0000 (02:33 +0100)]
Moves printing of `arv edit` messages out-of-band

Messages regarding update of object after edit are now
printed out-of-band to STDERR rather than to STDOUT
where they might mix with non-interactive "editors"

9 years agoRemoves unnecessary check that stdout is a TTY
Joshua Randall [Fri, 4 Sep 2015 01:31:38 +0000 (02:31 +0100)]
Removes unnecessary check that stdout is a TTY

9 years agoAdds `arv view` subcommand
Joshua Randall [Fri, 4 Sep 2015 01:22:45 +0000 (02:22 +0100)]
Adds `arv view` subcommand

Implements `arv view` feature as in https://arvados.org/issues/7204

Refactors portions of arv_edit into separate functions so arv_view
can share them.

9 years agoMerge branch 'master' into 6260-test-datamanager
radhika [Thu, 3 Sep 2015 19:53:07 +0000 (15:53 -0400)]
Merge branch 'master' into 6260-test-datamanager

9 years ago6260: TestPutAndGetBlocks is working.
radhika [Thu, 3 Sep 2015 19:39:33 +0000 (15:39 -0400)]
6260: TestPutAndGetBlocks is working.

9 years agoAdds error handling for command not found
Joshua Randall [Thu, 3 Sep 2015 17:40:50 +0000 (18:40 +0100)]
Adds error handling for command not found

Raises a "command not found" error if arv-* commands are not
found

9 years ago6260: do not force never_delete in keepstore
radhika [Thu, 3 Sep 2015 15:26:12 +0000 (11:26 -0400)]
6260: do not force never_delete in keepstore

9 years ago7193: Run provision script after creating node, not in sync_node, because
Peter Amstutz [Thu, 3 Sep 2015 14:40:34 +0000 (10:40 -0400)]
7193: Run provision script after creating node, not in sync_node, because
sync_node doesn't get called until the node has pinged!

9 years agoarv-copy: Make the help text for the --src and --dst options more easily
Ward Vandewege [Thu, 3 Sep 2015 00:17:29 +0000 (20:17 -0400)]
arv-copy: Make the help text for the --src and --dst options more easily
intelligible.

No issue #

9 years ago7193: Add ex_run_command
Peter Amstutz [Wed, 2 Sep 2015 20:43:29 +0000 (16:43 -0400)]
7193: Add ex_run_command

9 years ago6260: test updates
radhika [Wed, 2 Sep 2015 16:40:56 +0000 (12:40 -0400)]
6260: test updates

9 years ago5824: Enable blob signing in integration tests, and send keepstore logs to files.
Tom Clegg [Wed, 29 Jul 2015 08:41:26 +0000 (04:41 -0400)]
5824: Enable blob signing in integration tests, and send keepstore logs to files.

For some reason, sending keepstore logs to stdout seems to make
keepstore crash silently when invoked from a Go integration test. Work
around this by logging to disk, like we do with API server.

9 years agoMerge branch 'master' into 6260-test-datamanager
radhika [Wed, 2 Sep 2015 15:51:14 +0000 (11:51 -0400)]
Merge branch 'master' into 6260-test-datamanager

9 years ago6260: Add TestGetStatusRepeatedly
radhika [Wed, 2 Sep 2015 15:31:03 +0000 (11:31 -0400)]
6260: Add TestGetStatusRepeatedly

9 years ago6263: Rearrange test suites to share code better.
Tom Clegg [Wed, 2 Sep 2015 14:17:09 +0000 (10:17 -0400)]
6263: Rearrange test suites to share code better.

9 years agoMerge branch '6638-python-backport-dependencies-wip'
Brett Smith [Wed, 2 Sep 2015 13:52:06 +0000 (09:52 -0400)]
Merge branch '6638-python-backport-dependencies-wip'

Closes #6638.

9 years ago6638: Remove C dependencies from our Python SDK.
Brett Smith [Wed, 26 Aug 2015 14:49:41 +0000 (10:49 -0400)]
6638: Remove C dependencies from our Python SDK.

Now that our backports properly declare their C dependencies, they're
no longer needed here.

9 years ago6638: Python backports declare all their C dependencies.
Brett Smith [Wed, 26 Aug 2015 14:49:14 +0000 (10:49 -0400)]
6638: Python backports declare all their C dependencies.

See #6638 for discussion about how these dependency lists were
generated.

9 years ago6263: Add gitolite integration test. Fix existing tests to use bare repos on server...
Tom Clegg [Wed, 2 Sep 2015 07:06:05 +0000 (03:06 -0400)]
6263: Add gitolite integration test. Fix existing tests to use bare repos on server side.

9 years ago6260: status check added; still not working completely since invoking datamanager...
radhika [Tue, 1 Sep 2015 21:21:15 +0000 (17:21 -0400)]
6260: status check added; still not working completely since invoking datamanager singlerun issues.

9 years agoMerge branch '6953-docker-image-cleaner' closes #6953
Tom Clegg [Tue, 1 Sep 2015 18:00:24 +0000 (14:00 -0400)]
Merge branch '6953-docker-image-cleaner' closes #6953

9 years agoMerge branch 'master' into 6260-test-datamanager
radhika [Tue, 1 Sep 2015 14:54:33 +0000 (10:54 -0400)]
Merge branch 'master' into 6260-test-datamanager

9 years agoFix import error for NodeAuthSSHKey refs #6507
Peter Amstutz [Tue, 1 Sep 2015 13:15:28 +0000 (09:15 -0400)]
Fix import error for NodeAuthSSHKey refs #6507

9 years ago6953: Add arvados-docker-cleaner instructions to compute node setup page.
Tom Clegg [Mon, 31 Aug 2015 18:51:51 +0000 (14:51 -0400)]
6953: Add arvados-docker-cleaner instructions to compute node setup page.

9 years agoMerge branch '6507-node-manager-azure' closes #6507
Peter Amstutz [Fri, 28 Aug 2015 15:38:37 +0000 (11:38 -0400)]
Merge branch '6507-node-manager-azure' closes #6507

9 years agoMerge branch 'master' into 6507-node-manager-azure
Peter Amstutz [Fri, 28 Aug 2015 14:44:32 +0000 (10:44 -0400)]
Merge branch 'master' into 6507-node-manager-azure

9 years agoMerge branch '6997-keepstore-mem' refs #6997
Tom Clegg [Thu, 27 Aug 2015 21:17:36 +0000 (17:17 -0400)]
Merge branch '6997-keepstore-mem' refs #6997

9 years ago6997: Fix fencepost error causing race condition in test.
Tom Clegg [Thu, 27 Aug 2015 21:14:28 +0000 (17:14 -0400)]
6997: Fix fencepost error causing race condition in test.

9 years ago6997: Add test case for (*UnixVolume)IndexTo().
Tom Clegg [Thu, 27 Aug 2015 21:10:25 +0000 (17:10 -0400)]
6997: Add test case for (*UnixVolume)IndexTo().