Peter Amstutz [Mon, 18 May 2015 18:27:07 +0000 (14:27 -0400)]
3198: Add docstring with overview of the architecture. Implement check_update
method wrapper and expand use_counter to every method containing a
llfuse.lock_released block. Add note about big_writes option.
Peter Amstutz [Mon, 18 May 2015 14:10:26 +0000 (10:10 -0400)]
3198: writeto() notifies with WRITE instead of MOD. WRITE doesn't invalidate the inode.
Move llfuse.lock_released down one level into individual fusefile and fusedir methods.
Add big_writes option, improves write speed by 2x!
Peter Amstutz [Thu, 14 May 2015 20:24:03 +0000 (16:24 -0400)]
Merge branch '5748-max-buffers-leak' into 3198-writable-fuse
Peter Amstutz [Thu, 14 May 2015 20:02:43 +0000 (16:02 -0400)]
5748: Fix leaks in GetBlock error handling and PutBlock use of GetBlock where
buffers were not being returned to the buffer pool.
Peter Amstutz [Thu, 14 May 2015 19:26:40 +0000 (15:26 -0400)]
Merge branch 'master' into 3198-writable-fuse
Peter Amstutz [Thu, 14 May 2015 19:21:27 +0000 (15:21 -0400)]
3198: Support setattr().
Peter Amstutz [Thu, 14 May 2015 18:43:02 +0000 (14:43 -0400)]
3198: Renaming collections in projects works. Improved conformance to POSIX semantics as best we can.
Radhika Chippada [Thu, 14 May 2015 15:58:59 +0000 (11:58 -0400)]
closes #5645
Merge branch '5645-open-graph-meta-tags'
Radhika Chippada [Thu, 14 May 2015 15:56:49 +0000 (11:56 -0400)]
5645: updated comment
Peter Amstutz [Thu, 14 May 2015 14:09:27 +0000 (10:09 -0400)]
3198: Start working on rename() for collections in projects
Radhika Chippada [Thu, 14 May 2015 13:23:25 +0000 (09:23 -0400)]
Merge branch 'master' into 5645-open-graph-meta-tags
Radhika Chippada [Thu, 14 May 2015 13:22:43 +0000 (09:22 -0400)]
5645: add og:site_name to the list of open graph meta tags added to the page.
Peter Amstutz [Wed, 13 May 2015 21:10:46 +0000 (17:10 -0400)]
3198: Support mkdir() and rmdir() to create collections on projects. Support
for rename() is pending.
All tests that open files are refactored to use multiprocess for syscalls to
avoid deadlocks.
Peter Amstutz [Wed, 13 May 2015 19:36:42 +0000 (15:36 -0400)]
3198: Serialize updates to avoid doing redundant API server calls.
Peter Amstutz [Wed, 13 May 2015 15:48:44 +0000 (11:48 -0400)]
3198: FuseMvDirBetweenCollectionsTest works
Peter Amstutz [Tue, 12 May 2015 21:13:47 +0000 (17:13 -0400)]
3198: Support efficient moving preserving inode, writing to unlinked files. Many new tests.
Ward Vandewege [Tue, 12 May 2015 19:12:46 +0000 (15:12 -0400)]
Fix sso docker container build, and enable local account creation for
this sso container uses.
No issue #
Peter Amstutz [Tue, 12 May 2015 17:05:38 +0000 (13:05 -0400)]
Merge branch 'master' into 3198-writable-fuse
Conflicts:
sdk/python/arvados/arvfile.py
sdk/python/arvados/keep.py
services/fuse/arvados_fuse/__init__.py
Radhika Chippada [Tue, 12 May 2015 17:05:00 +0000 (13:05 -0400)]
5645: added open graph meta tags to page
Ward Vandewege [Tue, 12 May 2015 16:51:36 +0000 (12:51 -0400)]
Add instructions to generate assets to SSO installation page.
No issue #
Ward Vandewege [Tue, 12 May 2015 15:17:48 +0000 (11:17 -0400)]
Reorder SSO install documentation so that the rake db:setup call does
not fail because uuid_prefix and secret_token are not set yet.
No issue #
Ward Vandewege [Tue, 12 May 2015 14:48:26 +0000 (10:48 -0400)]
Even more SSO server install instructions.
No issue #
Ward Vandewege [Tue, 12 May 2015 14:27:51 +0000 (10:27 -0400)]
Update SSO server documentation to match current reality.
No issue #
Brett Smith [Mon, 11 May 2015 21:50:40 +0000 (17:50 -0400)]
Merge branch '5736-node-manager-easy-slot-cleanup-wip'
Refs #5736. Closes #5995.
Brett Smith [Mon, 11 May 2015 20:51:29 +0000 (16:51 -0400)]
5736: Node Manager cleans node records after shutting down a paired node.
This is an easy case to handle, and helps avoid exhausting SLURM
slot numbers.
Brett Smith [Mon, 11 May 2015 18:57:49 +0000 (14:57 -0400)]
5736: Fix typo in Node Manager test comments.
Brett Smith [Mon, 11 May 2015 21:35:58 +0000 (17:35 -0400)]
Merge branch '3793-clean-docker-images-wip'
Refs #3793. Closes #5857.
Brett Smith [Thu, 30 Apr 2015 13:19:15 +0000 (09:19 -0400)]
3793: Add Docker image cleaner service for compute nodes.
This service monitors Docker events. When a container is destroyed,
it deletes any images that are unused and exceed the configured
storage quota. This will prevent Docker images from growing
indefinitely on long-running compute nodes.
Peter Amstutz [Mon, 11 May 2015 21:11:01 +0000 (17:11 -0400)]
Merge branch '5992-keep-proxy-ignore-locator-hints' closes #5992
Peter Amstutz [Mon, 11 May 2015 20:38:23 +0000 (16:38 -0400)]
5992: keepproxy strips +K@{5} hints from locators before trying GET. +K@5-5-15
locators are preserved.
Radhika Chippada [Mon, 11 May 2015 17:33:53 +0000 (13:33 -0400)]
closes #3454
Merge branch '3454-default-docker-image'
Peter Amstutz [Mon, 11 May 2015 15:57:52 +0000 (11:57 -0400)]
Merge branch '3198-inode-cache' refs #3198
Radhika Chippada [Mon, 11 May 2015 15:17:02 +0000 (11:17 -0400)]
Merge branch 'master' into 3454-default-docker-image
Peter Amstutz [Mon, 11 May 2015 15:14:56 +0000 (11:14 -0400)]
3198: Fix Operation(inode_cache) init. Break up tests into a few smaller
tests. Added comment about how collection size is calculated.
Radhika Chippada [Mon, 11 May 2015 15:05:47 +0000 (11:05 -0400)]
refs #5682 : update arvados gem version
Radhika Chippada [Mon, 11 May 2015 15:02:19 +0000 (11:02 -0400)]
closes #5682
Merge branch '5682-download-file-error'
Radhika Chippada [Mon, 11 May 2015 15:01:21 +0000 (11:01 -0400)]
Merge branch 'master' into 5682-download-file-error
Radhika Chippada [Mon, 11 May 2015 15:00:32 +0000 (11:00 -0400)]
closes #4467
Merge branch '4467-project-contents-select-all'
Ward Vandewege [Sat, 9 May 2015 01:47:02 +0000 (21:47 -0400)]
Fix install instructions: create arvados repository.
closes #5988
Tom Clegg [Fri, 8 May 2015 18:09:03 +0000 (14:09 -0400)]
Merge branch '5748-max-buffers' refs #5748
Tom Clegg [Fri, 8 May 2015 18:08:19 +0000 (14:08 -0400)]
5748: Update keepstore install docs (-max-buffers, -blob-signing-key).
Tom Clegg [Fri, 8 May 2015 05:17:40 +0000 (01:17 -0400)]
5748: Log clock time for each request.
For successful responses, log the standard HTTP status text for the
response code (instead of logging "OK" for any status<400).
Tom Clegg [Thu, 7 May 2015 21:55:12 +0000 (17:55 -0400)]
5748: Check for errors when writing pidfile. Keep it locked while running.
* Handle SIGINT (the same way as SIGTERM)
* Improve startup/shutdown logs
Tom Clegg [Thu, 7 May 2015 16:38:12 +0000 (12:38 -0400)]
5748: Return the real decoder error for unparseable trash and pull requests.
Tom Clegg [Thu, 7 May 2015 14:40:44 +0000 (10:40 -0400)]
5748: Use a buffer pool instead of calling runtime.GC() during each GET.
Tom Clegg [Fri, 8 May 2015 06:42:08 +0000 (02:42 -0400)]
Merge branch '4882-no-host-when-container' closes #4882
Tom Clegg [Thu, 7 May 2015 02:57:06 +0000 (22:57 -0400)]
4882: If -cgroup-cid flag is given, only read container stats. If not given, only read host stats.
Radhika Chippada [Thu, 7 May 2015 21:15:03 +0000 (17:15 -0400)]
5682: update workbench arvados gem version
Peter Amstutz [Thu, 7 May 2015 21:11:51 +0000 (17:11 -0400)]
Merge branch '3198-inode-cache' into 3198-writable-fuse, fix tests.
Conflicts:
services/fuse/arvados_fuse/__init__.py
services/fuse/arvados_fuse/fresh.py
services/fuse/tests/test_mount.py
Radhika Chippada [Thu, 7 May 2015 21:06:54 +0000 (17:06 -0400)]
5682: move logic to check if '/' in filename into each_file_spec method from files method so that it is applied in all contexts using the each_file_spec method.
Peter Amstutz [Thu, 7 May 2015 20:07:45 +0000 (16:07 -0400)]
3198: Add --file-cache and --directory-cache to arv-mount to specify desired
cache limits.
Peter Amstutz [Thu, 7 May 2015 19:47:33 +0000 (15:47 -0400)]
3198: Inodes() and Operations() take InodeCache() object directly. Minimum
number of entries to retain is configurable. Added unit test of inode cache.
Radhika Chippada [Thu, 7 May 2015 19:21:11 +0000 (15:21 -0400)]
4467: Move select_all_items and unselect_all_items methods into selection.js
Radhika Chippada [Thu, 7 May 2015 18:29:28 +0000 (14:29 -0400)]
Merge branch 'master' into 4467-project-contents-select-all
Radhika Chippada [Thu, 7 May 2015 18:17:55 +0000 (14:17 -0400)]
3454: use configured default docker image when none found in a job's runtime_constraints.
Tom Clegg [Thu, 7 May 2015 17:47:16 +0000 (13:47 -0400)]
Merge branch '5745-serialize-content-only' closes #5745
Tom Clegg [Thu, 7 May 2015 16:48:48 +0000 (12:48 -0400)]
5745: Fix test order dependency (restore mocked methods), tidy up test data.
Tom Clegg [Wed, 6 May 2015 16:56:34 +0000 (12:56 -0400)]
5745: Serialize writes and data reads, but allow concurrent requests
to do read-only non-data operations (like finding existing blocks and
checking free disk space) which are likely to be cached by the OS and
therefore not involve any disk activity.
Also:
* Serialize Touch and Delete.
* Make sure to close and delete tempfiles on write errors.
* Update comments.
Tom Clegg [Thu, 7 May 2015 15:47:36 +0000 (11:47 -0400)]
Merge branch '5523-stats-error' closes #5523
Ward Vandewege [Wed, 6 May 2015 21:31:36 +0000 (17:31 -0400)]
Fix docker image build for SSO server after refactoring work in #5829.
refs #5829
Nancy Ouyang [Wed, 6 May 2015 21:28:05 +0000 (17:28 -0400)]
refs #5493: Merge branch '5493-fix-yellow-gif'
Nancy Ouyang [Wed, 6 May 2015 21:27:22 +0000 (17:27 -0400)]
5493: fix yellow gif
Tom Clegg [Wed, 6 May 2015 21:13:36 +0000 (17:13 -0400)]
Merge branch '5748-keepstore-leak' refs #5748
Tom Clegg [Wed, 6 May 2015 21:10:35 +0000 (17:10 -0400)]
5748: Clean up comments and variable names.
Tom Clegg [Wed, 6 May 2015 17:36:16 +0000 (13:36 -0400)]
5748: Write index data to http.ResponseWriter, instead of using string
concatenation to buffer the entire response.
Brett Smith [Wed, 6 May 2015 20:57:29 +0000 (16:57 -0400)]
Merge branch '5842-node-manager-tighten-successful-boot-criteria-wip'
Closes #5842, #5931.
Brett Smith [Wed, 6 May 2015 19:59:34 +0000 (15:59 -0400)]
5842: Node Manager only considers nodes busy if they're working.
Previously, Node Manager considered any non-idle node as busy,
including down nodes. This causes it to boot replacements for nodes
that are marked "down," even if that's because they're still
bootstrapping. Tighten the busy criteria to avoid booting excess
nodes.
It's easier to make this change now that Node Manager checks that
nodes have a functional Crunch worker state to be considered a
successful bootstrap. This means that any node that's down later is
in an unexpected state, and we should avoid messing with it.
Brett Smith [Wed, 6 May 2015 20:07:33 +0000 (16:07 -0400)]
5842: Node Manager shuts down booted nodes if they can't do compute work.
If a booted node is not able to do work (it's not idle or busy),
consider that a bootstrapping failure and shut it down, just like a
failure to pair with an Arvados node.
Ward Vandewege [Wed, 6 May 2015 20:17:49 +0000 (16:17 -0400)]
Merge branch '5926-parameterize-max-slots'
closes #5926
Ward Vandewege [Wed, 6 May 2015 20:16:53 +0000 (16:16 -0400)]
Improve comment in application.default.yml based on review feedback.
refs #5926
Ward Vandewege [Wed, 6 May 2015 19:46:28 +0000 (15:46 -0400)]
Make MAX_SLOTS a configurable parameter, and rename it to max_compute_nodes.
refs #5926
Tom Clegg [Wed, 6 May 2015 14:09:21 +0000 (10:09 -0400)]
5523: Say "notice" instead of "error" when stats file changes/appears/disappears.
Radhika Chippada [Wed, 6 May 2015 00:49:25 +0000 (20:49 -0400)]
4467: add test for "Select all" and "Unselect all" buttions in project tabs.
Radhika Chippada [Tue, 5 May 2015 20:03:24 +0000 (16:03 -0400)]
4467: add "select all" and "unselect all" buttons to project contents.
Radhika Chippada [Tue, 5 May 2015 19:35:58 +0000 (15:35 -0400)]
closes #5735
Merge branch '5735-edit-description-box-size'
Radhika Chippada [Tue, 5 May 2015 19:26:07 +0000 (15:26 -0400)]
5735: move tiptitle into nonhtml_options
Radhika Chippada [Tue, 5 May 2015 18:16:38 +0000 (14:16 -0400)]
Merge branch 'master' into 5735-edit-description-box-size
Radhika Chippada [Tue, 5 May 2015 18:12:54 +0000 (14:12 -0400)]
5735: add comment
Radhika Chippada [Tue, 5 May 2015 17:53:28 +0000 (13:53 -0400)]
5735: add a new nonhtml_options parameter to render_editable_attribute method,
which can be used to pass any non data-* custom attributes that are useful in
customizing the rendering of the editable attribute.
Radhika Chippada [Mon, 4 May 2015 23:59:35 +0000 (19:59 -0400)]
5735: use data- for button text and button class custom attributes.
Radhika Chippada [Mon, 4 May 2015 23:11:08 +0000 (19:11 -0400)]
5735: exclude btn* attributes from span tag.
Tom Clegg [Mon, 4 May 2015 20:46:17 +0000 (16:46 -0400)]
Merge branch '5724-blob-signature-ttl' closes #5724
Radhika Chippada [Mon, 4 May 2015 19:50:25 +0000 (15:50 -0400)]
Merge branch 'master' into 5735-edit-description-box-size
Radhika Chippada [Mon, 4 May 2015 19:48:55 +0000 (15:48 -0400)]
5735: use the inline css for description only so that any future inline css declarations are not impacted with this.
Brett Smith [Mon, 4 May 2015 17:07:19 +0000 (13:07 -0400)]
Merge branch '5752-arv-copy-preserve-docker-timestamps-wip'
Closes #5752, #5881.
Brett Smith [Fri, 1 May 2015 18:07:04 +0000 (14:07 -0400)]
5752: arv-copy preserves properties of docker_image links.
The properties include the image_timestamp, which tells Arvados when
the source image was created, rather than the containing collection.
The API server uses this information to determine which image is
newest.
Radhika Chippada [Mon, 4 May 2015 16:28:57 +0000 (12:28 -0400)]
Merge branch 'master' into 5735-edit-description-box-size
Peter Amstutz [Mon, 4 May 2015 15:40:10 +0000 (11:40 -0400)]
Merge branch '5787-run-command-checkin' refs #5787
Peter Amstutz [Mon, 4 May 2015 15:24:27 +0000 (11:24 -0400)]
5787: Change caught_error to last_error in vwd.py to return last exception that was caught. Fix typo.
Tom Clegg [Mon, 4 May 2015 15:18:37 +0000 (11:18 -0400)]
Merge branch '5893-helper-stdin' closes #5893
Tom Clegg [Mon, 4 May 2015 14:27:59 +0000 (10:27 -0400)]
Merge branch '5724-blob-signature-ttl' commit '
6fc44a6' refs #5724
Tom Clegg [Mon, 4 May 2015 14:27:41 +0000 (10:27 -0400)]
5724: Update reference to keepstore flag, now -blob-signature-ttl.
Peter Amstutz [Mon, 4 May 2015 13:07:33 +0000 (09:07 -0400)]
Merge branch '5562-pycurl-upload' closes #5562
Tom Clegg [Sat, 2 May 2015 06:49:44 +0000 (02:49 -0400)]
5893: Remove "disable repo browsing with git2" stuff.
git2 is no longer unreliable, now that we know the silent failures
meant "git credential helpers must consume their stdin".
Tom Clegg [Sat, 2 May 2015 06:16:19 +0000 (02:16 -0400)]
5893: Use git credential helpers for arv-git-httpd tests. Fix workbench helper.
The sporadic "git exited 128" errors -- very common in git2 and rare
in git1 -- seem to have been caused by git getting SIGPIPE when the
credential helper exited without consuming stdin. The solution is for
the credential helper to discard its standard input before exiting.
Tom Clegg [Sat, 2 May 2015 06:09:54 +0000 (02:09 -0400)]
5893: gofmt fixes. Fix some logs to print as strings, not byte arrays.
Tom Clegg [Fri, 1 May 2015 23:47:09 +0000 (19:47 -0400)]
5893: Add realm="git" to WWW-Authenticate header, cf. rfc2617
Peter Amstutz [Fri, 1 May 2015 21:07:33 +0000 (17:07 -0400)]
5787: Fix syntax error
Peter Amstutz [Fri, 1 May 2015 21:02:54 +0000 (17:02 -0400)]
5787: Error writing output will cause task to fail. Tweak documentation page.
Brett Smith [Fri, 1 May 2015 20:48:42 +0000 (16:48 -0400)]
Merge branch '5834-api-max-response-size-wip'
Closes #5834, #5871.
projects / arvados.git / log