Brett Smith [Fri, 16 May 2014 17:33:57 +0000 (13:33 -0400)]
2753: Remove older, unused Workbench provenance code.
I do not see any code that would directly render these partials;
they're not indirectly referenced in the pane list; and I can remove
the controller code and run all our tests without tripping on a
NoMethodError exception from a nil.
Peter Amstutz [Tue, 20 May 2014 18:11:15 +0000 (14:11 -0400)]
2776: Added test for keep_services/accessable route.
Peter Amstutz [Tue, 20 May 2014 17:54:21 +0000 (13:54 -0400)]
2776: Added 'accessable' route to 'keep_services'
Peter Amstutz [Tue, 20 May 2014 17:38:18 +0000 (13:38 -0400)]
2776: Added stub API documentation for keep_services table.
Peter Amstutz [Tue, 20 May 2014 17:30:08 +0000 (13:30 -0400)]
2776: Fixed run_test_server.py to work with new 'keep_services' model
Peter Amstutz [Tue, 20 May 2014 17:22:12 +0000 (13:22 -0400)]
2776: Fixed backwards-compatible inclusion of service_host/port/ssl_flag for keep_disks.
Peter Amstutz [Tue, 20 May 2014 15:37:33 +0000 (11:37 -0400)]
2776: Added Keep services page to workbench (uses default layouts)
Peter Amstutz [Tue, 20 May 2014 14:30:20 +0000 (10:30 -0400)]
2776: Added controller and route for keep_services, fixed tests.
Peter Amstutz [Tue, 20 May 2014 14:10:43 +0000 (10:10 -0400)]
2776: Added keep_services model and migration.
radhika [Tue, 20 May 2014 13:57:20 +0000 (09:57 -0400)]
2525: handling of array objects was not quite correct. it would not have worked if a pure array object that is not filters is passed in.
Tim Pierce [Tue, 13 May 2014 15:06:00 +0000 (11:06 -0400)]
2755: Verify permission signatures on create.
Phase 1 of #2755: when creating a new collection, verify any permission
signatures found in the manifest. Unsigned locators in the manifest are
implicitly permitted (to be disabled in Phase 4)
* New "Locator" class to parse, examine and manipulate Keep locators.
* Collections.create checks permission signatures in a manifest.
* Collections.show signs locators in a manifest.
* collections_controller_test.rb: new unit tests to exercise signed
manifests and related features:
- "create collection with signed manifest"
- "create collection with signed manifest and explicit TTL"
- "create fails with invalid signature"
- "create fails with uuid of signed manifest"
- "multiple locators per line"
- "multiple signed locators per line"
* application.yml.example: new configuration variables
- Rails.configuration.blob_signing_key
- Rails.configuration.blob_signing_ttl
(refs #2755)
Peter Amstutz [Mon, 19 May 2014 21:11:09 +0000 (17:11 -0400)]
2776: Started adding KeepServices model.
radhika [Mon, 19 May 2014 20:59:21 +0000 (16:59 -0400)]
Merge branch 'master' into 2756-eventbus-in-workbench
Tom Clegg [Mon, 19 May 2014 20:50:19 +0000 (16:50 -0400)]
Fix crash when saving api_client_authorization during migration.
Peter Amstutz [Mon, 19 May 2014 19:15:01 +0000 (15:15 -0400)]
2798: Finished writing documentation comment for buffer package.
Tom Clegg [Mon, 19 May 2014 18:57:37 +0000 (14:57 -0400)]
2352: Reset column information between adding a new serialized
attribute and using the model. Otherwise, Rails (4) fails to validate
the serialized attribute.
Peter Amstutz [Mon, 19 May 2014 18:56:27 +0000 (14:56 -0400)]
2798: Continued refactoring buffer reader into separate buffer package. Made
internal buffer management functions package-internal and added a public API.
Updated keepclient to use buffer package public API. Added HashCheckingReader
to provide transparent checking of checksums. Added more package and API
comments.
Tom Clegg [Mon, 19 May 2014 16:21:56 +0000 (12:21 -0400)]
Prevent admin from creating an object with empty string as UUID.
radhika [Sat, 17 May 2014 02:37:52 +0000 (22:37 -0400)]
Merge branch 'master' into 2756-eventbus-in-workbench
radhika [Sat, 17 May 2014 02:36:05 +0000 (22:36 -0400)]
2756: use meta tag to provide websocket url to event_log js file
Tim Pierce [Fri, 16 May 2014 19:29:31 +0000 (15:29 -0400)]
2770: terminate on SIGTERM.
When SIGTERM is received, the Keep server shuts down gracefully. (refs #2770)
Tom Clegg [Fri, 16 May 2014 19:28:20 +0000 (15:28 -0400)]
2809: Fix arvados_api_client usage in FileStreamer. refs #2809
radhika [Fri, 16 May 2014 17:40:01 +0000 (13:40 -0400)]
2756: much cleaner and leaner
radhika [Fri, 16 May 2014 15:38:44 +0000 (11:38 -0400)]
2756: event log div placement corrected.
Tom Clegg [Fri, 16 May 2014 14:57:32 +0000 (10:57 -0400)]
Remove debug log message. refs #1969
radhika [Fri, 16 May 2014 13:34:07 +0000 (09:34 -0400)]
2756: ws url storage does not have to be managed by each page subscribing for events. also, html class names to include arv in them.
radhika [Fri, 16 May 2014 04:25:50 +0000 (00:25 -0400)]
2756: trigger event when object is updated. process the messages on trigger.
radhika [Fri, 16 May 2014 02:11:00 +0000 (22:11 -0400)]
Merge branch 'master' into 2756-eventbus-in-workbench
radhika [Fri, 16 May 2014 02:09:45 +0000 (22:09 -0400)]
2756: subscribe for event log messages on ajax:complete or ready.
Tom Clegg [Fri, 16 May 2014 00:44:28 +0000 (20:44 -0400)]
2809: Fix disappearing ArvadosApiClient in development mode. refs #2809
Tom Clegg [Thu, 15 May 2014 21:14:15 +0000 (17:14 -0400)]
2755: Defer to CollectionReader to get manifests instead of going
directly to Keep (which only works when Keep has no permission
checks).
refs #2755
Ward Vandewege [Thu, 15 May 2014 21:11:08 +0000 (17:11 -0400)]
Merge branch '0000-arv-mount-bugfixes'
This closes #2831
Ward Vandewege [Thu, 15 May 2014 20:47:42 +0000 (16:47 -0400)]
CollectionReader can throw exceptions (for example, when passing an
argument that is not a manifest or collection UUID). Trap those and
print an error message, instead blowing up the fuse driver.
Peter Amstutz [Thu, 15 May 2014 20:47:14 +0000 (16:47 -0400)]
2798: Completed move of Transfer() related code out to 'buffer' package.
Peter Amstutz [Thu, 15 May 2014 20:42:33 +0000 (16:42 -0400)]
2798: Added AuthorizedGet(), Ask() and AuthorizedAsk(). Added BLOCKSIZE
constant and moved errors.New() declarations to the top of the file. Improved
test server runner. Changed some test methods to take copies of KeepClient
instead of pointer.
Peter Amstutz [Thu, 15 May 2014 20:36:18 +0000 (16:36 -0400)]
Moved non-keep-specific buffering code into a separate package.
Peter Amstutz [Thu, 15 May 2014 20:22:33 +0000 (16:22 -0400)]
1885: Renamed DiscoverKeepDisks to DiscoverKeepServers, moved error.New()
declarations to the top, changed some tests to use KeepClient copy instead of
pointer.
Ward Vandewege [Thu, 15 May 2014 20:18:38 +0000 (16:18 -0400)]
In daemon mode, arv-mount should set up the fuse connection before
forking to the background, so that any failures to set up are reported
to the user.
radhika [Thu, 15 May 2014 19:54:11 +0000 (15:54 -0400)]
Merge branch 'master' into 2756-eventbus-in-workbench
radhika [Thu, 15 May 2014 19:52:15 +0000 (15:52 -0400)]
2756: store websocket in window to facilitate reuse within page. also, remove elementId from map when leaving page.
Peter Amstutz [Thu, 15 May 2014 19:14:55 +0000 (15:14 -0400)]
1885: First commit of most complete keep proxy, no tests yet. Removed build.sh
in favor of go.sh that wraps 'go' with the desired GOPATH and 'go get'. Added
keepclient.Ask() method which does HTTP HEAD. Added AuthorizedGet() and
AuthorizedAsk() which provide signature and timestamp.
Tom Clegg [Thu, 15 May 2014 18:19:32 +0000 (14:19 -0400)]
2809: Merge branch '2809-workbench-rails4' refs #2809
Tom Clegg [Thu, 15 May 2014 18:19:06 +0000 (14:19 -0400)]
2809: Merge branch 'master' into 2809-workbench-rails4 refs #2809
Conflicts:
apps/workbench/app/models/arvados_api_client.rb
Tom Clegg [Thu, 15 May 2014 16:30:25 +0000 (12:30 -0400)]
2809: Move coffee-rails out of :assets section to make tests thread-safe.
Otherwise, when Rails decides to build assets while running the test
suite, we get:
WARN: tilt autoloading 'coffee_script' in a non thread-safe way; explicit require 'coffee_script' suggested.
Tom Clegg [Thu, 15 May 2014 16:26:10 +0000 (12:26 -0400)]
2809: Remove javascript and coffeescript boilerplate.
Tom Clegg [Wed, 14 May 2014 22:00:09 +0000 (18:00 -0400)]
2809: Remove some unnecessary sleep(0.1).
Tom Clegg [Wed, 14 May 2014 21:56:59 +0000 (17:56 -0400)]
2809: Rearrange "run API server during tests" to suit Minitest 5.
Also, use passenger instead of webrick.
Tom Clegg [Wed, 14 May 2014 20:35:39 +0000 (16:35 -0400)]
2809: Upgrade to Rails 4.1
Tom Clegg [Wed, 14 May 2014 18:21:05 +0000 (14:21 -0400)]
2809: Add wait_for_ajax after submitting forms, to avoid race condition.
Tom Clegg [Wed, 14 May 2014 17:26:42 +0000 (13:26 -0400)]
2809: Remove debug printfs, add comment explaining why so much "permit!"
Tom Clegg [Wed, 14 May 2014 17:25:24 +0000 (13:25 -0400)]
2809: Add note about harmless warning when installing the themes_for_rails gem.
Tom Clegg [Wed, 14 May 2014 17:08:04 +0000 (13:08 -0400)]
2809: Fix whitespace.
Tom Clegg [Sat, 10 May 2014 00:29:09 +0000 (20:29 -0400)]
2809: Turn off secret_key_base by default, instead of requiring it in config.
Tom Clegg [Sat, 10 May 2014 00:28:40 +0000 (20:28 -0400)]
2809: Fix load_config so it loads in time to set passenger configs.
Tom Clegg [Fri, 9 May 2014 18:38:39 +0000 (14:38 -0400)]
2809: Merge branch 'master' refs #2809
Conflicts:
apps/workbench/Gemfile.lock
apps/workbench/app/controllers/application_controller.rb
apps/workbench/app/models/arvados_api_client.rb
apps/workbench/app/models/group.rb
apps/workbench/app/models/user.rb
apps/workbench/app/views/layouts/application.html.erb
Tom Clegg [Thu, 15 May 2014 15:33:20 +0000 (11:33 -0400)]
2756: Fix "duplicate tab" behavior in Chrome.
Tom Clegg [Thu, 15 May 2014 15:09:43 +0000 (11:09 -0400)]
2756: Fix ajax refresh on pipeline instance page.
Peter Amstutz [Thu, 15 May 2014 14:01:50 +0000 (10:01 -0400)]
2751: Added code to recognize keep proxies in the keep_disks() response and set
using_proxy flag. Added support for 'X-Keep-Desired-Replication' and
'X-Keep-Replicas-Stored' HTTP headers. Added ARVADOS_KEEP_PROXY environment
variable.
Tom Clegg [Wed, 14 May 2014 22:07:40 +0000 (18:07 -0400)]
Merge branch '2762-owner-uuid-integrity'
closes #2762
Tom Clegg [Wed, 14 May 2014 22:02:51 +0000 (18:02 -0400)]
2762: Merge branch 'master' into 2762-owner-uuid-integrity
radhika [Wed, 14 May 2014 21:10:14 +0000 (17:10 -0400)]
2756: improve the data displayed in event log display area.
Tim Pierce [Tue, 13 May 2014 15:06:00 +0000 (11:06 -0400)]
2755: Verify permission signatures on create.
Phase 1 of #2755: when creating a new collection, verify any permission
signatures found in the manifest. Unsigned locators in the manifest are
implicitly permitted (to be disabled in Phase 4)
* Collections.create checks permission signatures in a manifest.
* Collections.show signs locators in a manifest.
* Unit test test_create_collection_with_signed_manifest exercises the
'create' and 'show' methods on a signed manifest.
* application.default.yml, application.yml.example: added configuration
variable Rails.configuration.permission_key.
radhika [Wed, 14 May 2014 20:31:26 +0000 (16:31 -0400)]
2756: check if browser supports websockets before creating the websockets connection.
radhika [Wed, 14 May 2014 20:16:09 +0000 (16:16 -0400)]
Merge branch 'master' into 2756-eventbus-in-workbench
radhika [Wed, 14 May 2014 20:14:59 +0000 (16:14 -0400)]
2756: Use event_log.js javascript asset to subscribe to websockets
Peter Amstutz [Wed, 14 May 2014 19:45:05 +0000 (15:45 -0400)]
Merge branch 'master' into 2798-go-keep-client
Peter Amstutz [Wed, 14 May 2014 19:32:09 +0000 (15:32 -0400)]
2798: Full integration test with real API server and Keep server succeeds.
Expanded return values a bit to include the URL that a block was actually
downloaded from on GET, and the number of replicas written on PUT.
Misha Zatsman [Wed, 14 May 2014 19:19:35 +0000 (19:19 +0000)]
Merge branch 'master' of git.curoverse.com:arvados
Peter Amstutz [Wed, 14 May 2014 19:14:00 +0000 (15:14 -0400)]
Added block GET, and tests.
radhika [Wed, 14 May 2014 18:34:18 +0000 (14:34 -0400)]
Merge branch 'master' into 2756-eventbus-in-workbench
Peter Amstutz [Wed, 14 May 2014 18:07:06 +0000 (14:07 -0400)]
2798: All PUT tests against stub server pass. Added explict setting of
Content-Length to avoid unnecessary chunked transfer encoding, and is also
necessary so slices can directly WriteTo() the socket.
Tom Clegg [Wed, 14 May 2014 18:05:15 +0000 (14:05 -0400)]
2762: Fix wrong class used in test case.
Tom Clegg [Wed, 14 May 2014 18:04:44 +0000 (14:04 -0400)]
2762: Finish enigmatic comment.
Tom Clegg [Wed, 14 May 2014 18:04:20 +0000 (14:04 -0400)]
2762: Move destroy_permission_links method to HasUuid.
Tim Pierce [Wed, 14 May 2014 17:02:30 +0000 (13:02 -0400)]
2328: fix log.Warning bug
oops.
Tim Pierce [Wed, 14 May 2014 16:24:46 +0000 (12:24 -0400)]
Merge branch '2328-keep-permission-flags' (closes #2328)
Misha Zatsman [Wed, 14 May 2014 00:58:43 +0000 (00:58 +0000)]
Merge branch '1968-monitor-disk-usage'
Lots of changes to datamanager. refs #2719
Tim Pierce [Wed, 14 May 2014 05:15:38 +0000 (01:15 -0400)]
2328: code review comments.
Peter Amstutz [Wed, 14 May 2014 02:36:19 +0000 (22:36 -0400)]
2798: Read requests from Transfer() now return a slice. Added BufferReader
WriteTo() but for some reason http.Request Body isn't using it.
Misha Zatsman [Wed, 14 May 2014 00:54:18 +0000 (00:54 +0000)]
Reversed histogram format, so timestamps come first.
Peter Amstutz [Wed, 14 May 2014 00:47:49 +0000 (20:47 -0400)]
2798: Added uploadToKeepServer() test
radhika [Tue, 13 May 2014 20:34:28 +0000 (16:34 -0400)]
2756: Display event log on pipeline_instance event log udpates.
Peter Amstutz [Tue, 13 May 2014 20:07:59 +0000 (16:07 -0400)]
2798: Checkpoint commit, tests for ReadIntoBuffer() and Transfer() pass.
Tom Clegg [Tue, 13 May 2014 19:21:10 +0000 (15:21 -0400)]
Really write log messages to logfile. refs #2221 commit:
ced5e21
Tom Clegg [Tue, 13 May 2014 18:45:42 +0000 (14:45 -0400)]
Fix job state cleanup in crunch-job failure case.
Tom Clegg [Tue, 13 May 2014 18:36:50 +0000 (14:36 -0400)]
2673: Use _method=GET hack to avoid combining request body with GET
method (but still support parameters too long to fit in a query
string).
Tim Pierce [Tue, 13 May 2014 18:25:37 +0000 (14:25 -0400)]
2328: more 80-column fixes
Tim Pierce [Tue, 13 May 2014 18:05:45 +0000 (14:05 -0400)]
2328: incorporate code review comments.
Wrap very long lines to 80 columns.
Describe each test failure more explicitly.
TestIndexHandler: Add /index/prefix tests for unauthenticated and
authenticated non-superusers.
TestGetHandler: initialize all variables in one var block.
main: failure to read permission key or data manager token is now a
fatal error.
Tom Clegg [Tue, 13 May 2014 17:37:17 +0000 (13:37 -0400)]
Specify required ruby version (>= 2.1.0) in gems.
Tom Clegg [Tue, 13 May 2014 17:30:31 +0000 (13:30 -0400)]
2673: Update bundle to ensure we get commit:
67f1781 at runtime.
Tom Clegg [Tue, 13 May 2014 17:13:58 +0000 (13:13 -0400)]
2673: Move auth to headers, avoid combining request body with GET method.
Tom Clegg [Tue, 13 May 2014 16:49:20 +0000 (12:49 -0400)]
2821: Add "delete" button to pipeline instances page. closes #2821
Tom Clegg [Tue, 13 May 2014 16:44:04 +0000 (12:44 -0400)]
2673: Update bundle to ensure we get commit:
7ff8586 at runtime.
Tom Clegg [Tue, 13 May 2014 14:13:45 +0000 (10:13 -0400)]
2638: Fix css syntax.
Peter Amstutz [Tue, 13 May 2014 13:07:05 +0000 (09:07 -0400)]
2798: Merged branch with code to read environment variables with branch working on Put support.
Merge remote-tracking branch 'origin/2798-go-keep-client' into 2798-go-keep-client
Conflicts:
sdk/go/src/arvados.org/keepclient/keepclient.go
sdk/go/src/arvados.org/keepclient/keepclient_test.go
Peter Amstutz [Mon, 12 May 2014 20:54:23 +0000 (16:54 -0400)]
2798: Work in progress connecting data read from input Reader to POST requests.
Tom Clegg [Mon, 12 May 2014 19:37:24 +0000 (15:37 -0400)]
Add self-signed.{key,pem} to .gitignore files.
Tom Clegg [Mon, 12 May 2014 19:28:58 +0000 (15:28 -0400)]
Merge branch '2673-no-request-body-in-get'
closes #2673
Tom Clegg [Mon, 12 May 2014 19:01:37 +0000 (15:01 -0400)]
2673: Move auth to headers, avoid combining request body with GET method.
Tom Clegg [Mon, 12 May 2014 17:43:09 +0000 (13:43 -0400)]
2754: Hide unhelpful "Add a new job" button.