Nico Cesar [Tue, 12 May 2015 19:24:27 +0000 (15:24 -0400)]
trailing whitespaces
Nico Cesar [Tue, 12 May 2015 19:22:19 +0000 (15:22 -0400)]
fixing some trailing whitespaces
Nico Cesar [Tue, 12 May 2015 19:08:42 +0000 (15:08 -0400)]
initial version to have a --bridge parameter
also improves:
grep: The -P option is not supported if libpcre.so.3 is not available // Replaced -E making compatible
Ward Vandewege [Tue, 12 May 2015 14:27:51 +0000 (10:27 -0400)]
Update SSO server documentation to match current reality.
No issue #
Brett Smith [Mon, 11 May 2015 21:50:40 +0000 (17:50 -0400)]
Merge branch '5736-node-manager-easy-slot-cleanup-wip'
Refs #5736. Closes #5995.
Brett Smith [Mon, 11 May 2015 20:51:29 +0000 (16:51 -0400)]
5736: Node Manager cleans node records after shutting down a paired node.
This is an easy case to handle, and helps avoid exhausting SLURM
slot numbers.
Brett Smith [Mon, 11 May 2015 18:57:49 +0000 (14:57 -0400)]
5736: Fix typo in Node Manager test comments.
Brett Smith [Mon, 11 May 2015 21:35:58 +0000 (17:35 -0400)]
Merge branch '3793-clean-docker-images-wip'
Refs #3793. Closes #5857.
Brett Smith [Thu, 30 Apr 2015 13:19:15 +0000 (09:19 -0400)]
3793: Add Docker image cleaner service for compute nodes.
This service monitors Docker events. When a container is destroyed,
it deletes any images that are unused and exceed the configured
storage quota. This will prevent Docker images from growing
indefinitely on long-running compute nodes.
Peter Amstutz [Mon, 11 May 2015 21:11:01 +0000 (17:11 -0400)]
Merge branch '5992-keep-proxy-ignore-locator-hints' closes #5992
Peter Amstutz [Mon, 11 May 2015 20:38:23 +0000 (16:38 -0400)]
5992: keepproxy strips +K@{5} hints from locators before trying GET. +K@5-5-15
locators are preserved.
Radhika Chippada [Mon, 11 May 2015 17:33:53 +0000 (13:33 -0400)]
closes #3454
Merge branch '3454-default-docker-image'
Peter Amstutz [Mon, 11 May 2015 15:57:52 +0000 (11:57 -0400)]
Merge branch '3198-inode-cache' refs #3198
Radhika Chippada [Mon, 11 May 2015 15:17:02 +0000 (11:17 -0400)]
Merge branch 'master' into 3454-default-docker-image
Peter Amstutz [Mon, 11 May 2015 15:14:56 +0000 (11:14 -0400)]
3198: Fix Operation(inode_cache) init. Break up tests into a few smaller
tests. Added comment about how collection size is calculated.
Radhika Chippada [Mon, 11 May 2015 15:05:47 +0000 (11:05 -0400)]
refs #5682 : update arvados gem version
Radhika Chippada [Mon, 11 May 2015 15:02:19 +0000 (11:02 -0400)]
closes #5682
Merge branch '5682-download-file-error'
Radhika Chippada [Mon, 11 May 2015 15:01:21 +0000 (11:01 -0400)]
Merge branch 'master' into 5682-download-file-error
Radhika Chippada [Mon, 11 May 2015 15:00:32 +0000 (11:00 -0400)]
closes #4467
Merge branch '4467-project-contents-select-all'
Ward Vandewege [Sat, 9 May 2015 01:47:02 +0000 (21:47 -0400)]
Fix install instructions: create arvados repository.
closes #5988
Tom Clegg [Fri, 8 May 2015 18:09:03 +0000 (14:09 -0400)]
Merge branch '5748-max-buffers' refs #5748
Tom Clegg [Fri, 8 May 2015 18:08:19 +0000 (14:08 -0400)]
5748: Update keepstore install docs (-max-buffers, -blob-signing-key).
Tom Clegg [Fri, 8 May 2015 05:17:40 +0000 (01:17 -0400)]
5748: Log clock time for each request.
For successful responses, log the standard HTTP status text for the
response code (instead of logging "OK" for any status<400).
Tom Clegg [Thu, 7 May 2015 21:55:12 +0000 (17:55 -0400)]
5748: Check for errors when writing pidfile. Keep it locked while running.
* Handle SIGINT (the same way as SIGTERM)
* Improve startup/shutdown logs
Tom Clegg [Thu, 7 May 2015 16:38:12 +0000 (12:38 -0400)]
5748: Return the real decoder error for unparseable trash and pull requests.
Tom Clegg [Thu, 7 May 2015 14:40:44 +0000 (10:40 -0400)]
5748: Use a buffer pool instead of calling runtime.GC() during each GET.
Tom Clegg [Fri, 8 May 2015 06:42:08 +0000 (02:42 -0400)]
Merge branch '4882-no-host-when-container' closes #4882
Tom Clegg [Thu, 7 May 2015 02:57:06 +0000 (22:57 -0400)]
4882: If -cgroup-cid flag is given, only read container stats. If not given, only read host stats.
Radhika Chippada [Thu, 7 May 2015 21:15:03 +0000 (17:15 -0400)]
5682: update workbench arvados gem version
Radhika Chippada [Thu, 7 May 2015 21:06:54 +0000 (17:06 -0400)]
5682: move logic to check if '/' in filename into each_file_spec method from files method so that it is applied in all contexts using the each_file_spec method.
Peter Amstutz [Thu, 7 May 2015 20:07:45 +0000 (16:07 -0400)]
3198: Add --file-cache and --directory-cache to arv-mount to specify desired
cache limits.
Peter Amstutz [Thu, 7 May 2015 19:47:33 +0000 (15:47 -0400)]
3198: Inodes() and Operations() take InodeCache() object directly. Minimum
number of entries to retain is configurable. Added unit test of inode cache.
Radhika Chippada [Thu, 7 May 2015 19:21:11 +0000 (15:21 -0400)]
4467: Move select_all_items and unselect_all_items methods into selection.js
Radhika Chippada [Thu, 7 May 2015 18:29:28 +0000 (14:29 -0400)]
Merge branch 'master' into 4467-project-contents-select-all
Radhika Chippada [Thu, 7 May 2015 18:17:55 +0000 (14:17 -0400)]
3454: use configured default docker image when none found in a job's runtime_constraints.
Tom Clegg [Thu, 7 May 2015 17:47:16 +0000 (13:47 -0400)]
Merge branch '5745-serialize-content-only' closes #5745
Tom Clegg [Thu, 7 May 2015 16:48:48 +0000 (12:48 -0400)]
5745: Fix test order dependency (restore mocked methods), tidy up test data.
Tom Clegg [Wed, 6 May 2015 16:56:34 +0000 (12:56 -0400)]
5745: Serialize writes and data reads, but allow concurrent requests
to do read-only non-data operations (like finding existing blocks and
checking free disk space) which are likely to be cached by the OS and
therefore not involve any disk activity.
Also:
* Serialize Touch and Delete.
* Make sure to close and delete tempfiles on write errors.
* Update comments.
Tom Clegg [Thu, 7 May 2015 15:47:36 +0000 (11:47 -0400)]
Merge branch '5523-stats-error' closes #5523
Ward Vandewege [Wed, 6 May 2015 21:31:36 +0000 (17:31 -0400)]
Fix docker image build for SSO server after refactoring work in #5829.
refs #5829
Nancy Ouyang [Wed, 6 May 2015 21:28:05 +0000 (17:28 -0400)]
refs #5493: Merge branch '5493-fix-yellow-gif'
Nancy Ouyang [Wed, 6 May 2015 21:27:22 +0000 (17:27 -0400)]
5493: fix yellow gif
Tom Clegg [Wed, 6 May 2015 21:13:36 +0000 (17:13 -0400)]
Merge branch '5748-keepstore-leak' refs #5748
Tom Clegg [Wed, 6 May 2015 21:10:35 +0000 (17:10 -0400)]
5748: Clean up comments and variable names.
Tom Clegg [Wed, 6 May 2015 17:36:16 +0000 (13:36 -0400)]
5748: Write index data to http.ResponseWriter, instead of using string
concatenation to buffer the entire response.
Brett Smith [Wed, 6 May 2015 20:57:29 +0000 (16:57 -0400)]
Merge branch '5842-node-manager-tighten-successful-boot-criteria-wip'
Closes #5842, #5931.
Brett Smith [Wed, 6 May 2015 19:59:34 +0000 (15:59 -0400)]
5842: Node Manager only considers nodes busy if they're working.
Previously, Node Manager considered any non-idle node as busy,
including down nodes. This causes it to boot replacements for nodes
that are marked "down," even if that's because they're still
bootstrapping. Tighten the busy criteria to avoid booting excess
nodes.
It's easier to make this change now that Node Manager checks that
nodes have a functional Crunch worker state to be considered a
successful bootstrap. This means that any node that's down later is
in an unexpected state, and we should avoid messing with it.
Brett Smith [Wed, 6 May 2015 20:07:33 +0000 (16:07 -0400)]
5842: Node Manager shuts down booted nodes if they can't do compute work.
If a booted node is not able to do work (it's not idle or busy),
consider that a bootstrapping failure and shut it down, just like a
failure to pair with an Arvados node.
Ward Vandewege [Wed, 6 May 2015 20:17:49 +0000 (16:17 -0400)]
Merge branch '5926-parameterize-max-slots'
closes #5926
Ward Vandewege [Wed, 6 May 2015 20:16:53 +0000 (16:16 -0400)]
Improve comment in application.default.yml based on review feedback.
refs #5926
Ward Vandewege [Wed, 6 May 2015 19:46:28 +0000 (15:46 -0400)]
Make MAX_SLOTS a configurable parameter, and rename it to max_compute_nodes.
refs #5926
Tom Clegg [Wed, 6 May 2015 14:09:21 +0000 (10:09 -0400)]
5523: Say "notice" instead of "error" when stats file changes/appears/disappears.
Radhika Chippada [Wed, 6 May 2015 00:49:25 +0000 (20:49 -0400)]
4467: add test for "Select all" and "Unselect all" buttions in project tabs.
Radhika Chippada [Tue, 5 May 2015 20:03:24 +0000 (16:03 -0400)]
4467: add "select all" and "unselect all" buttons to project contents.
Radhika Chippada [Tue, 5 May 2015 19:35:58 +0000 (15:35 -0400)]
closes #5735
Merge branch '5735-edit-description-box-size'
Radhika Chippada [Tue, 5 May 2015 19:26:07 +0000 (15:26 -0400)]
5735: move tiptitle into nonhtml_options
Radhika Chippada [Tue, 5 May 2015 18:16:38 +0000 (14:16 -0400)]
Merge branch 'master' into 5735-edit-description-box-size
Radhika Chippada [Tue, 5 May 2015 18:12:54 +0000 (14:12 -0400)]
5735: add comment
Radhika Chippada [Tue, 5 May 2015 17:53:28 +0000 (13:53 -0400)]
5735: add a new nonhtml_options parameter to render_editable_attribute method,
which can be used to pass any non data-* custom attributes that are useful in
customizing the rendering of the editable attribute.
Radhika Chippada [Mon, 4 May 2015 23:59:35 +0000 (19:59 -0400)]
5735: use data- for button text and button class custom attributes.
Radhika Chippada [Mon, 4 May 2015 23:11:08 +0000 (19:11 -0400)]
5735: exclude btn* attributes from span tag.
Tom Clegg [Mon, 4 May 2015 20:46:17 +0000 (16:46 -0400)]
Merge branch '5724-blob-signature-ttl' closes #5724
Radhika Chippada [Mon, 4 May 2015 19:50:25 +0000 (15:50 -0400)]
Merge branch 'master' into 5735-edit-description-box-size
Radhika Chippada [Mon, 4 May 2015 19:48:55 +0000 (15:48 -0400)]
5735: use the inline css for description only so that any future inline css declarations are not impacted with this.
Brett Smith [Mon, 4 May 2015 17:07:19 +0000 (13:07 -0400)]
Merge branch '5752-arv-copy-preserve-docker-timestamps-wip'
Closes #5752, #5881.
Brett Smith [Fri, 1 May 2015 18:07:04 +0000 (14:07 -0400)]
5752: arv-copy preserves properties of docker_image links.
The properties include the image_timestamp, which tells Arvados when
the source image was created, rather than the containing collection.
The API server uses this information to determine which image is
newest.
Radhika Chippada [Mon, 4 May 2015 16:28:57 +0000 (12:28 -0400)]
Merge branch 'master' into 5735-edit-description-box-size
Peter Amstutz [Mon, 4 May 2015 15:40:10 +0000 (11:40 -0400)]
Merge branch '5787-run-command-checkin' refs #5787
Peter Amstutz [Mon, 4 May 2015 15:24:27 +0000 (11:24 -0400)]
5787: Change caught_error to last_error in vwd.py to return last exception that was caught. Fix typo.
Tom Clegg [Mon, 4 May 2015 15:18:37 +0000 (11:18 -0400)]
Merge branch '5893-helper-stdin' closes #5893
Tom Clegg [Mon, 4 May 2015 14:27:59 +0000 (10:27 -0400)]
Merge branch '5724-blob-signature-ttl' commit '
6fc44a6' refs #5724
Tom Clegg [Mon, 4 May 2015 14:27:41 +0000 (10:27 -0400)]
5724: Update reference to keepstore flag, now -blob-signature-ttl.
Peter Amstutz [Mon, 4 May 2015 13:07:33 +0000 (09:07 -0400)]
Merge branch '5562-pycurl-upload' closes #5562
Tom Clegg [Sat, 2 May 2015 06:49:44 +0000 (02:49 -0400)]
5893: Remove "disable repo browsing with git2" stuff.
git2 is no longer unreliable, now that we know the silent failures
meant "git credential helpers must consume their stdin".
Tom Clegg [Sat, 2 May 2015 06:16:19 +0000 (02:16 -0400)]
5893: Use git credential helpers for arv-git-httpd tests. Fix workbench helper.
The sporadic "git exited 128" errors -- very common in git2 and rare
in git1 -- seem to have been caused by git getting SIGPIPE when the
credential helper exited without consuming stdin. The solution is for
the credential helper to discard its standard input before exiting.
Tom Clegg [Sat, 2 May 2015 06:09:54 +0000 (02:09 -0400)]
5893: gofmt fixes. Fix some logs to print as strings, not byte arrays.
Tom Clegg [Fri, 1 May 2015 23:47:09 +0000 (19:47 -0400)]
5893: Add realm="git" to WWW-Authenticate header, cf. rfc2617
Peter Amstutz [Fri, 1 May 2015 21:07:33 +0000 (17:07 -0400)]
5787: Fix syntax error
Peter Amstutz [Fri, 1 May 2015 21:02:54 +0000 (17:02 -0400)]
5787: Error writing output will cause task to fail. Tweak documentation page.
Brett Smith [Fri, 1 May 2015 20:48:42 +0000 (16:48 -0400)]
Merge branch '5834-api-max-response-size-wip'
Closes #5834, #5871.
Brett Smith [Thu, 30 Apr 2015 22:23:21 +0000 (18:23 -0400)]
5834: Limit how much manifest text data API server will load for index.
This prevents situations where clients cause the API server to balloon
in memory use by requesting an index including many large manifest
texts. Data Manager has been doing this unwittingly lately.
Radhika Chippada [Fri, 1 May 2015 19:43:35 +0000 (15:43 -0400)]
5735: use inline editing for project description x-editable textarea.
Peter Amstutz [Fri, 1 May 2015 18:43:41 +0000 (14:43 -0400)]
5787: Write files that are pointed to by symlinks that are outside of Keep.
Catch exceptions. Update documentation.
Radhika Chippada [Fri, 1 May 2015 15:36:30 +0000 (11:36 -0400)]
closes #4458
Merge branch '4458-breadcrumbs-in-small-screens'
Radhika Chippada [Fri, 1 May 2015 15:35:17 +0000 (11:35 -0400)]
Merge branch 'master' into 4458-breadcrumbs-in-small-screens
Peter Amstutz [Fri, 1 May 2015 14:49:18 +0000 (10:49 -0400)]
5787: Copy to the right destination name, add docstring, fix syntax errors
Peter Amstutz [Fri, 1 May 2015 14:32:01 +0000 (10:32 -0400)]
5787: run-command uploading uses new collection API and supports symlinks into Keep
Radhika Chippada [Fri, 1 May 2015 14:26:40 +0000 (10:26 -0400)]
closes #5843
Merge branch '5843-subproject-deletion-owner-name-constraint'
Radhika Chippada [Fri, 1 May 2015 14:26:01 +0000 (10:26 -0400)]
Merge branch 'master' into 5843-subproject-deletion-owner-name-constraint
Tom Clegg [Fri, 1 May 2015 07:13:47 +0000 (03:13 -0400)]
5724: gofmt fixes.
Tom Clegg [Fri, 1 May 2015 07:11:46 +0000 (03:11 -0400)]
5724: Rename -permission-* flags to -blob-sign* to match apiserver. Tidy up some time-related code.
Tom Clegg [Fri, 1 May 2015 04:59:20 +0000 (00:59 -0400)]
5724: Add blobSignatureTtl to discovery doc. Add config comment/explanation.
Peter Amstutz [Thu, 30 Apr 2015 21:14:07 +0000 (17:14 -0400)]
5562: keepstub sends "100 Continue" to client. Fix test_write_three_replicas
to return a valid response body instead of None.
Peter Amstutz [Thu, 30 Apr 2015 20:38:24 +0000 (16:38 -0400)]
run-command list correct directory to be uploaded when $(task.cwd) != $(task.outdir)
no issue #
Peter Amstutz [Thu, 30 Apr 2015 18:39:46 +0000 (14:39 -0400)]
5562: Use cStringIO module which is more efficient than StringIO.
Peter Amstutz [Thu, 30 Apr 2015 20:21:49 +0000 (16:21 -0400)]
5562: Add comment about UPLOAD
Peter Amstutz [Thu, 30 Apr 2015 17:55:36 +0000 (13:55 -0400)]
5562: Add support for "Expect: 100-Continue" flow for PUT.
This tells cURL to wait for a "go ahead" from the Keep server (in the form of a
HTTP/1.1 "100 Continue" response) instead of sending the request body
immediately. This allows the server to reject the request if the request is
invalid or the server is read-only, without waiting for the client to send the
entire block.
Uses pycurl.UPLOAD to enable the 'PUT' and 'Expect: 100-continue" behavior.
Use INFILESIZE to sent Content-Length and use READFUNCTION to actually spool
the data.
Peter Amstutz [Thu, 30 Apr 2015 20:07:12 +0000 (16:07 -0400)]
Merge branch '3145-missing-content-length-error' closes #3145
Peter Amstutz [Thu, 30 Apr 2015 18:30:09 +0000 (14:30 -0400)]
Merge branch '5856-read-exact' closes #5856
Peter Amstutz [Thu, 30 Apr 2015 18:21:41 +0000 (14:21 -0400)]
5856: Tweak tests. Fix typo.