mishaz [Tue, 19 May 2015 17:16:43 +0000 (17:16 +0000)]
Merge branch 'master' into 3408-production-datamanager
Because it's been a long time.
Radhika Chippada [Tue, 19 May 2015 03:24:46 +0000 (23:24 -0400)]
closes #4717
Merge branch '4717-read-only-keep-services-flag'
Radhika Chippada [Tue, 19 May 2015 03:11:59 +0000 (23:11 -0400)]
4717: rename writableRoots as writableLocalRoots.
Radhika Chippada [Tue, 19 May 2015 02:22:18 +0000 (22:22 -0400)]
Merge branch 'master' into 4717-read-only-keep-services-flag
Radhika Chippada [Tue, 19 May 2015 02:21:33 +0000 (22:21 -0400)]
closes #5720
Merge branch '5720-ajax-loading-error'
mishaz [Tue, 19 May 2015 00:54:29 +0000 (00:54 +0000)]
Added code for generating pull lists.
mishaz [Tue, 19 May 2015 00:37:11 +0000 (00:37 +0000)]
Made HostPort() an explicit method to print the HostPort, so that String() can change in the future.
Tom Clegg [Mon, 18 May 2015 17:36:27 +0000 (13:36 -0400)]
5720: Leave existing content in place (and schedule another reload) if a tab-refresh gets cancelled.
Nico Cesar [Fri, 15 May 2015 21:04:06 +0000 (17:04 -0400)]
Merge branch '5998-arvdock-bridge-option'
closes #5998
Nico Cesar [Fri, 15 May 2015 19:00:21 +0000 (15:00 -0400)]
$start_bridge -> $bridge
options modified
ip command refactored
refs #5998
Ward Vandewege [Fri, 15 May 2015 13:46:07 +0000 (09:46 -0400)]
Check in docker/sso/database.yml.in, forgotten in commit
ea7da293b0a10baef18cfc6e107c87a9c3b09546.
No issue #
Radhika Chippada [Fri, 15 May 2015 02:56:12 +0000 (22:56 -0400)]
Merge branch 'master' into 4717-read-only-keep-services-flag
Radhika Chippada [Fri, 15 May 2015 02:55:25 +0000 (22:55 -0400)]
4717: use keep_services -> read_only flag in python sdk.
Tom Clegg [Fri, 15 May 2015 02:11:49 +0000 (22:11 -0400)]
Merge branch '5748-max-buffers-leak-TC' refs #5748
Tom Clegg [Fri, 15 May 2015 02:10:02 +0000 (22:10 -0400)]
5748: gofmt fixes.
Tom Clegg [Fri, 15 May 2015 02:06:46 +0000 (22:06 -0400)]
5748: Time out leak tests after 20s.
Tom Clegg [Fri, 15 May 2015 01:52:12 +0000 (21:52 -0400)]
5748: Put() always takes a non-nil buf.
Brett Smith [Thu, 14 May 2015 22:32:02 +0000 (18:32 -0400)]
5915: Workbench tries the anonymous reader token first for collection wget listing.
This is necessary to make sure we provide a usable token to arv-get.
If we don't check the anonymous reader token first, we might decide
that another token is usable when in actuality, the reader token is
the one that worked. Closes #5915.
Peter Amstutz [Thu, 14 May 2015 21:01:13 +0000 (17:01 -0400)]
5748: Basic tests to check for bufferpool resource leaks
Peter Amstutz [Thu, 14 May 2015 20:02:43 +0000 (16:02 -0400)]
5748: Fix leaks in GetBlock error handling and PutBlock use of GetBlock where
buffers were not being returned to the buffer pool.
Radhika Chippada [Thu, 14 May 2015 16:39:42 +0000 (12:39 -0400)]
4717: just a couple minor tweaks
Radhika Chippada [Thu, 14 May 2015 16:32:12 +0000 (12:32 -0400)]
4717: writable roots in go sdk
Radhika Chippada [Thu, 14 May 2015 15:59:34 +0000 (11:59 -0400)]
Merge branch 'master' into 4717-read-only-keep-services-flag
Radhika Chippada [Thu, 14 May 2015 15:58:59 +0000 (11:58 -0400)]
closes #5645
Merge branch '5645-open-graph-meta-tags'
Radhika Chippada [Thu, 14 May 2015 15:56:49 +0000 (11:56 -0400)]
5645: updated comment
Radhika Chippada [Thu, 14 May 2015 13:23:25 +0000 (09:23 -0400)]
Merge branch 'master' into 5645-open-graph-meta-tags
Radhika Chippada [Thu, 14 May 2015 13:22:43 +0000 (09:22 -0400)]
5645: add og:site_name to the list of open graph meta tags added to the page.
Radhika Chippada [Wed, 13 May 2015 20:02:41 +0000 (16:02 -0400)]
4717: use keep_services -> read_only flag in go sdk.
mishaz [Tue, 12 May 2015 23:29:21 +0000 (23:29 +0000)]
Removed a comment that was accidentally copied in.
mishaz [Tue, 12 May 2015 23:27:19 +0000 (23:27 +0000)]
Switched collection_test.go to use the excellent gocheck framework after seeing it in arvadosclient_test.go.
Radhika Chippada [Tue, 12 May 2015 19:55:10 +0000 (15:55 -0400)]
4717: add read_only column for keep_services data model.
Nico Cesar [Tue, 12 May 2015 19:31:49 +0000 (15:31 -0400)]
Merge branch 'master' into 5998-arvdock-bridge-option
Nico Cesar [Tue, 12 May 2015 19:24:27 +0000 (15:24 -0400)]
trailing whitespaces
Nico Cesar [Tue, 12 May 2015 19:22:19 +0000 (15:22 -0400)]
fixing some trailing whitespaces
Ward Vandewege [Tue, 12 May 2015 19:12:46 +0000 (15:12 -0400)]
Fix sso docker container build, and enable local account creation for
this sso container uses.
No issue #
Nico Cesar [Tue, 12 May 2015 19:08:42 +0000 (15:08 -0400)]
initial version to have a --bridge parameter
also improves:
grep: The -P option is not supported if libpcre.so.3 is not available // Replaced -E making compatible
Radhika Chippada [Tue, 12 May 2015 17:50:31 +0000 (13:50 -0400)]
Merge branch 'master' into 5720-ajax-loading-error
Radhika Chippada [Tue, 12 May 2015 17:46:56 +0000 (13:46 -0400)]
5720: when jqxhr readyState == 0 or status == 0, instead of skipping show "Cancelled" message.
Radhika Chippada [Tue, 12 May 2015 17:39:05 +0000 (13:39 -0400)]
5720: when jqxhr readyState == 0 or status == 0, instead of skipping show "Cancelled" message.
Radhika Chippada [Tue, 12 May 2015 17:05:00 +0000 (13:05 -0400)]
5645: added open graph meta tags to page
Ward Vandewege [Tue, 12 May 2015 16:51:36 +0000 (12:51 -0400)]
Add instructions to generate assets to SSO installation page.
No issue #
Ward Vandewege [Tue, 12 May 2015 15:17:48 +0000 (11:17 -0400)]
Reorder SSO install documentation so that the rake db:setup call does
not fail because uuid_prefix and secret_token are not set yet.
No issue #
Ward Vandewege [Tue, 12 May 2015 14:48:26 +0000 (10:48 -0400)]
Even more SSO server install instructions.
No issue #
Ward Vandewege [Tue, 12 May 2015 14:27:51 +0000 (10:27 -0400)]
Update SSO server documentation to match current reality.
No issue #
Brett Smith [Mon, 11 May 2015 21:50:40 +0000 (17:50 -0400)]
Merge branch '5736-node-manager-easy-slot-cleanup-wip'
Refs #5736. Closes #5995.
Brett Smith [Mon, 11 May 2015 20:51:29 +0000 (16:51 -0400)]
5736: Node Manager cleans node records after shutting down a paired node.
This is an easy case to handle, and helps avoid exhausting SLURM
slot numbers.
Brett Smith [Mon, 11 May 2015 18:57:49 +0000 (14:57 -0400)]
5736: Fix typo in Node Manager test comments.
Brett Smith [Mon, 11 May 2015 21:35:58 +0000 (17:35 -0400)]
Merge branch '3793-clean-docker-images-wip'
Refs #3793. Closes #5857.
Brett Smith [Thu, 30 Apr 2015 13:19:15 +0000 (09:19 -0400)]
3793: Add Docker image cleaner service for compute nodes.
This service monitors Docker events. When a container is destroyed,
it deletes any images that are unused and exceed the configured
storage quota. This will prevent Docker images from growing
indefinitely on long-running compute nodes.
Peter Amstutz [Mon, 11 May 2015 21:11:01 +0000 (17:11 -0400)]
Merge branch '5992-keep-proxy-ignore-locator-hints' closes #5992
Peter Amstutz [Mon, 11 May 2015 20:38:23 +0000 (16:38 -0400)]
5992: keepproxy strips +K@{5} hints from locators before trying GET. +K@5-5-15
locators are preserved.
Radhika Chippada [Mon, 11 May 2015 17:33:53 +0000 (13:33 -0400)]
closes #3454
Merge branch '3454-default-docker-image'
Peter Amstutz [Mon, 11 May 2015 15:57:52 +0000 (11:57 -0400)]
Merge branch '3198-inode-cache' refs #3198
Radhika Chippada [Mon, 11 May 2015 15:17:02 +0000 (11:17 -0400)]
Merge branch 'master' into 3454-default-docker-image
Peter Amstutz [Mon, 11 May 2015 15:14:56 +0000 (11:14 -0400)]
3198: Fix Operation(inode_cache) init. Break up tests into a few smaller
tests. Added comment about how collection size is calculated.
Radhika Chippada [Mon, 11 May 2015 15:05:47 +0000 (11:05 -0400)]
refs #5682 : update arvados gem version
Radhika Chippada [Mon, 11 May 2015 15:02:19 +0000 (11:02 -0400)]
closes #5682
Merge branch '5682-download-file-error'
Radhika Chippada [Mon, 11 May 2015 15:01:21 +0000 (11:01 -0400)]
Merge branch 'master' into 5682-download-file-error
Radhika Chippada [Mon, 11 May 2015 15:00:32 +0000 (11:00 -0400)]
closes #4467
Merge branch '4467-project-contents-select-all'
Ward Vandewege [Sat, 9 May 2015 01:47:02 +0000 (21:47 -0400)]
Fix install instructions: create arvados repository.
closes #5988
Tom Clegg [Fri, 8 May 2015 18:09:03 +0000 (14:09 -0400)]
Merge branch '5748-max-buffers' refs #5748
Tom Clegg [Fri, 8 May 2015 18:08:19 +0000 (14:08 -0400)]
5748: Update keepstore install docs (-max-buffers, -blob-signing-key).
Tom Clegg [Fri, 8 May 2015 05:17:40 +0000 (01:17 -0400)]
5748: Log clock time for each request.
For successful responses, log the standard HTTP status text for the
response code (instead of logging "OK" for any status<400).
Tom Clegg [Thu, 7 May 2015 21:55:12 +0000 (17:55 -0400)]
5748: Check for errors when writing pidfile. Keep it locked while running.
* Handle SIGINT (the same way as SIGTERM)
* Improve startup/shutdown logs
Tom Clegg [Thu, 7 May 2015 16:38:12 +0000 (12:38 -0400)]
5748: Return the real decoder error for unparseable trash and pull requests.
Tom Clegg [Thu, 7 May 2015 14:40:44 +0000 (10:40 -0400)]
5748: Use a buffer pool instead of calling runtime.GC() during each GET.
Radhika Chippada [Fri, 8 May 2015 14:25:20 +0000 (10:25 -0400)]
5720: when jqxhr readyState == 0 or status == 0, it could be that the user has navigated away from the page; hence return instead of showing error.
Tom Clegg [Fri, 8 May 2015 06:42:08 +0000 (02:42 -0400)]
Merge branch '4882-no-host-when-container' closes #4882
Tom Clegg [Thu, 7 May 2015 02:57:06 +0000 (22:57 -0400)]
4882: If -cgroup-cid flag is given, only read container stats. If not given, only read host stats.
Radhika Chippada [Thu, 7 May 2015 21:15:03 +0000 (17:15 -0400)]
5682: update workbench arvados gem version
Radhika Chippada [Thu, 7 May 2015 21:06:54 +0000 (17:06 -0400)]
5682: move logic to check if '/' in filename into each_file_spec method from files method so that it is applied in all contexts using the each_file_spec method.
Peter Amstutz [Thu, 7 May 2015 20:07:45 +0000 (16:07 -0400)]
3198: Add --file-cache and --directory-cache to arv-mount to specify desired
cache limits.
Peter Amstutz [Thu, 7 May 2015 19:47:33 +0000 (15:47 -0400)]
3198: Inodes() and Operations() take InodeCache() object directly. Minimum
number of entries to retain is configurable. Added unit test of inode cache.
Radhika Chippada [Thu, 7 May 2015 19:21:11 +0000 (15:21 -0400)]
4467: Move select_all_items and unselect_all_items methods into selection.js
Radhika Chippada [Thu, 7 May 2015 18:29:28 +0000 (14:29 -0400)]
Merge branch 'master' into 4467-project-contents-select-all
Radhika Chippada [Thu, 7 May 2015 18:17:55 +0000 (14:17 -0400)]
3454: use configured default docker image when none found in a job's runtime_constraints.
Tom Clegg [Thu, 7 May 2015 17:47:16 +0000 (13:47 -0400)]
Merge branch '5745-serialize-content-only' closes #5745
Tom Clegg [Thu, 7 May 2015 16:48:48 +0000 (12:48 -0400)]
5745: Fix test order dependency (restore mocked methods), tidy up test data.
Tom Clegg [Wed, 6 May 2015 16:56:34 +0000 (12:56 -0400)]
5745: Serialize writes and data reads, but allow concurrent requests
to do read-only non-data operations (like finding existing blocks and
checking free disk space) which are likely to be cached by the OS and
therefore not involve any disk activity.
Also:
* Serialize Touch and Delete.
* Make sure to close and delete tempfiles on write errors.
* Update comments.
Tom Clegg [Thu, 7 May 2015 15:47:36 +0000 (11:47 -0400)]
Merge branch '5523-stats-error' closes #5523
Ward Vandewege [Wed, 6 May 2015 21:31:36 +0000 (17:31 -0400)]
Fix docker image build for SSO server after refactoring work in #5829.
refs #5829
Nancy Ouyang [Wed, 6 May 2015 21:28:05 +0000 (17:28 -0400)]
refs #5493: Merge branch '5493-fix-yellow-gif'
Nancy Ouyang [Wed, 6 May 2015 21:27:22 +0000 (17:27 -0400)]
5493: fix yellow gif
Tom Clegg [Wed, 6 May 2015 21:13:36 +0000 (17:13 -0400)]
Merge branch '5748-keepstore-leak' refs #5748
Tom Clegg [Wed, 6 May 2015 21:10:35 +0000 (17:10 -0400)]
5748: Clean up comments and variable names.
Tom Clegg [Wed, 6 May 2015 17:36:16 +0000 (13:36 -0400)]
5748: Write index data to http.ResponseWriter, instead of using string
concatenation to buffer the entire response.
Brett Smith [Wed, 6 May 2015 20:57:29 +0000 (16:57 -0400)]
Merge branch '5842-node-manager-tighten-successful-boot-criteria-wip'
Closes #5842, #5931.
Brett Smith [Wed, 6 May 2015 19:59:34 +0000 (15:59 -0400)]
5842: Node Manager only considers nodes busy if they're working.
Previously, Node Manager considered any non-idle node as busy,
including down nodes. This causes it to boot replacements for nodes
that are marked "down," even if that's because they're still
bootstrapping. Tighten the busy criteria to avoid booting excess
nodes.
It's easier to make this change now that Node Manager checks that
nodes have a functional Crunch worker state to be considered a
successful bootstrap. This means that any node that's down later is
in an unexpected state, and we should avoid messing with it.
Brett Smith [Wed, 6 May 2015 20:07:33 +0000 (16:07 -0400)]
5842: Node Manager shuts down booted nodes if they can't do compute work.
If a booted node is not able to do work (it's not idle or busy),
consider that a bootstrapping failure and shut it down, just like a
failure to pair with an Arvados node.
Ward Vandewege [Wed, 6 May 2015 20:17:49 +0000 (16:17 -0400)]
Merge branch '5926-parameterize-max-slots'
closes #5926
Ward Vandewege [Wed, 6 May 2015 20:16:53 +0000 (16:16 -0400)]
Improve comment in application.default.yml based on review feedback.
refs #5926
Ward Vandewege [Wed, 6 May 2015 19:46:28 +0000 (15:46 -0400)]
Make MAX_SLOTS a configurable parameter, and rename it to max_compute_nodes.
refs #5926
Tom Clegg [Wed, 6 May 2015 14:09:21 +0000 (10:09 -0400)]
5523: Say "notice" instead of "error" when stats file changes/appears/disappears.
Radhika Chippada [Wed, 6 May 2015 00:49:25 +0000 (20:49 -0400)]
4467: add test for "Select all" and "Unselect all" buttions in project tabs.
Radhika Chippada [Tue, 5 May 2015 20:03:24 +0000 (16:03 -0400)]
4467: add "select all" and "unselect all" buttons to project contents.
Radhika Chippada [Tue, 5 May 2015 19:35:58 +0000 (15:35 -0400)]
closes #5735
Merge branch '5735-edit-description-box-size'
Radhika Chippada [Tue, 5 May 2015 19:26:07 +0000 (15:26 -0400)]
5735: move tiptitle into nonhtml_options
Radhika Chippada [Tue, 5 May 2015 18:16:38 +0000 (14:16 -0400)]
Merge branch 'master' into 5735-edit-description-box-size
Radhika Chippada [Tue, 5 May 2015 18:12:54 +0000 (14:12 -0400)]
5735: add comment
Radhika Chippada [Tue, 5 May 2015 17:53:28 +0000 (13:53 -0400)]
5735: add a new nonhtml_options parameter to render_editable_attribute method,
which can be used to pass any non data-* custom attributes that are useful in
customizing the rendering of the editable attribute.