arvados.git
9 years agoMerge branch 'master' into 3408-production-datamanager
mishaz [Tue, 19 May 2015 17:16:43 +0000 (17:16 +0000)]
Merge branch 'master' into 3408-production-datamanager
Because it's been a long time.

9 years agocloses #4717
Radhika Chippada [Tue, 19 May 2015 03:24:46 +0000 (23:24 -0400)]
closes #4717
Merge branch '4717-read-only-keep-services-flag'

9 years ago4717: rename writableRoots as writableLocalRoots.
Radhika Chippada [Tue, 19 May 2015 03:11:59 +0000 (23:11 -0400)]
4717: rename writableRoots as writableLocalRoots.

9 years agoMerge branch 'master' into 4717-read-only-keep-services-flag
Radhika Chippada [Tue, 19 May 2015 02:22:18 +0000 (22:22 -0400)]
Merge branch 'master' into 4717-read-only-keep-services-flag

9 years agocloses #5720
Radhika Chippada [Tue, 19 May 2015 02:21:33 +0000 (22:21 -0400)]
closes #5720
Merge branch '5720-ajax-loading-error'

9 years agoAdded code for generating pull lists.
mishaz [Tue, 19 May 2015 00:54:29 +0000 (00:54 +0000)]
Added code for generating pull lists.

9 years agoMade HostPort() an explicit method to print the HostPort, so that String() can change...
mishaz [Tue, 19 May 2015 00:37:11 +0000 (00:37 +0000)]
Made HostPort() an explicit method to print the HostPort, so that String() can change in the future.

9 years ago5720: Leave existing content in place (and schedule another reload) if a tab-refresh...
Tom Clegg [Mon, 18 May 2015 17:36:27 +0000 (13:36 -0400)]
5720: Leave existing content in place (and schedule another reload) if a tab-refresh gets cancelled.

9 years agoMerge branch '5998-arvdock-bridge-option'
Nico Cesar [Fri, 15 May 2015 21:04:06 +0000 (17:04 -0400)]
Merge branch '5998-arvdock-bridge-option'

closes #5998

9 years ago$start_bridge -> $bridge
Nico Cesar [Fri, 15 May 2015 19:00:21 +0000 (15:00 -0400)]
$start_bridge -> $bridge

options modified

ip command refactored

refs #5998

9 years agoCheck in docker/sso/database.yml.in, forgotten in commit ea7da293b0a10baef18cfc6e107c...
Ward Vandewege [Fri, 15 May 2015 13:46:07 +0000 (09:46 -0400)]
Check in docker/sso/database.yml.in, forgotten in commit ea7da293b0a10baef18cfc6e107c87a9c3b09546.

No issue #

9 years agoMerge branch 'master' into 4717-read-only-keep-services-flag
Radhika Chippada [Fri, 15 May 2015 02:56:12 +0000 (22:56 -0400)]
Merge branch 'master' into 4717-read-only-keep-services-flag

9 years ago4717: use keep_services -> read_only flag in python sdk.
Radhika Chippada [Fri, 15 May 2015 02:55:25 +0000 (22:55 -0400)]
4717: use keep_services -> read_only flag in python sdk.

9 years agoMerge branch '5748-max-buffers-leak-TC' refs #5748
Tom Clegg [Fri, 15 May 2015 02:11:49 +0000 (22:11 -0400)]
Merge branch '5748-max-buffers-leak-TC' refs #5748

9 years ago5748: gofmt fixes.
Tom Clegg [Fri, 15 May 2015 02:10:02 +0000 (22:10 -0400)]
5748: gofmt fixes.

9 years ago5748: Time out leak tests after 20s.
Tom Clegg [Fri, 15 May 2015 02:06:46 +0000 (22:06 -0400)]
5748: Time out leak tests after 20s.

9 years ago5748: Put() always takes a non-nil buf.
Tom Clegg [Fri, 15 May 2015 01:52:12 +0000 (21:52 -0400)]
5748: Put() always takes a non-nil buf.

9 years ago5915: Workbench tries the anonymous reader token first for collection wget listing.
Brett Smith [Thu, 14 May 2015 22:32:02 +0000 (18:32 -0400)]
5915: Workbench tries the anonymous reader token first for collection wget listing.

This is necessary to make sure we provide a usable token to arv-get.
If we don't check the anonymous reader token first, we might decide
that another token is usable when in actuality, the reader token is
the one that worked.  Closes #5915.

9 years ago5748: Basic tests to check for bufferpool resource leaks
Peter Amstutz [Thu, 14 May 2015 21:01:13 +0000 (17:01 -0400)]
5748: Basic tests to check for bufferpool resource leaks

9 years ago5748: Fix leaks in GetBlock error handling and PutBlock use of GetBlock where
Peter Amstutz [Thu, 14 May 2015 20:02:43 +0000 (16:02 -0400)]
5748: Fix leaks in GetBlock error handling and PutBlock use of GetBlock where
buffers were not being returned to the buffer pool.

9 years ago4717: just a couple minor tweaks
Radhika Chippada [Thu, 14 May 2015 16:39:42 +0000 (12:39 -0400)]
4717: just a couple minor tweaks

9 years ago4717: writable roots in go sdk
Radhika Chippada [Thu, 14 May 2015 16:32:12 +0000 (12:32 -0400)]
4717: writable roots in go sdk

9 years agoMerge branch 'master' into 4717-read-only-keep-services-flag
Radhika Chippada [Thu, 14 May 2015 15:59:34 +0000 (11:59 -0400)]
Merge branch 'master' into 4717-read-only-keep-services-flag

9 years agocloses #5645
Radhika Chippada [Thu, 14 May 2015 15:58:59 +0000 (11:58 -0400)]
closes #5645
Merge branch '5645-open-graph-meta-tags'

9 years ago5645: updated comment
Radhika Chippada [Thu, 14 May 2015 15:56:49 +0000 (11:56 -0400)]
5645: updated comment

9 years agoMerge branch 'master' into 5645-open-graph-meta-tags
Radhika Chippada [Thu, 14 May 2015 13:23:25 +0000 (09:23 -0400)]
Merge branch 'master' into 5645-open-graph-meta-tags

9 years ago5645: add og:site_name to the list of open graph meta tags added to the page.
Radhika Chippada [Thu, 14 May 2015 13:22:43 +0000 (09:22 -0400)]
5645: add og:site_name to the list of open graph meta tags added to the page.

9 years ago4717: use keep_services -> read_only flag in go sdk.
Radhika Chippada [Wed, 13 May 2015 20:02:41 +0000 (16:02 -0400)]
4717: use keep_services -> read_only flag in go sdk.

9 years agoRemoved a comment that was accidentally copied in.
mishaz [Tue, 12 May 2015 23:29:21 +0000 (23:29 +0000)]
Removed a comment that was accidentally copied in.

9 years agoSwitched collection_test.go to use the excellent gocheck framework after seeing it...
mishaz [Tue, 12 May 2015 23:27:19 +0000 (23:27 +0000)]
Switched collection_test.go to use the excellent gocheck framework after seeing it in arvadosclient_test.go.

9 years ago4717: add read_only column for keep_services data model.
Radhika Chippada [Tue, 12 May 2015 19:55:10 +0000 (15:55 -0400)]
4717: add read_only column for keep_services data model.

9 years agoMerge branch 'master' into 5998-arvdock-bridge-option
Nico Cesar [Tue, 12 May 2015 19:31:49 +0000 (15:31 -0400)]
Merge branch 'master' into 5998-arvdock-bridge-option

9 years agotrailing whitespaces
Nico Cesar [Tue, 12 May 2015 19:24:27 +0000 (15:24 -0400)]
trailing whitespaces

9 years agofixing some trailing whitespaces
Nico Cesar [Tue, 12 May 2015 19:22:19 +0000 (15:22 -0400)]
fixing some trailing whitespaces

9 years agoFix sso docker container build, and enable local account creation for
Ward Vandewege [Tue, 12 May 2015 19:12:46 +0000 (15:12 -0400)]
Fix sso docker container build, and enable local account creation for
this sso container uses.

No issue #

9 years agoinitial version to have a --bridge parameter
Nico Cesar [Tue, 12 May 2015 19:08:42 +0000 (15:08 -0400)]
initial version to have a --bridge parameter

also improves:
  grep: The -P option is not supported if libpcre.so.3 is not available  // Replaced -E making compatible

9 years agoMerge branch 'master' into 5720-ajax-loading-error
Radhika Chippada [Tue, 12 May 2015 17:50:31 +0000 (13:50 -0400)]
Merge branch 'master' into 5720-ajax-loading-error

9 years ago5720: when jqxhr readyState == 0 or status == 0, instead of skipping show "Cancelled...
Radhika Chippada [Tue, 12 May 2015 17:46:56 +0000 (13:46 -0400)]
5720:  when jqxhr readyState == 0 or status == 0, instead of skipping show "Cancelled" message.

9 years ago5720: when jqxhr readyState == 0 or status == 0, instead of skipping show "Cancelled...
Radhika Chippada [Tue, 12 May 2015 17:39:05 +0000 (13:39 -0400)]
5720: when jqxhr readyState == 0 or status == 0, instead of skipping show "Cancelled" message.

9 years ago5645: added open graph meta tags to page
Radhika Chippada [Tue, 12 May 2015 17:05:00 +0000 (13:05 -0400)]
5645: added open graph meta tags to page

9 years agoAdd instructions to generate assets to SSO installation page.
Ward Vandewege [Tue, 12 May 2015 16:51:36 +0000 (12:51 -0400)]
Add instructions to generate assets to SSO installation page.

No issue #

9 years agoReorder SSO install documentation so that the rake db:setup call does
Ward Vandewege [Tue, 12 May 2015 15:17:48 +0000 (11:17 -0400)]
Reorder SSO install documentation so that the rake db:setup call does
not fail because uuid_prefix and secret_token are not set yet.

No issue #

9 years agoEven more SSO server install instructions.
Ward Vandewege [Tue, 12 May 2015 14:48:26 +0000 (10:48 -0400)]
Even more SSO server install instructions.

No issue #

9 years agoUpdate SSO server documentation to match current reality.
Ward Vandewege [Tue, 12 May 2015 14:27:51 +0000 (10:27 -0400)]
Update SSO server documentation to match current reality.

No issue #

9 years agoMerge branch '5736-node-manager-easy-slot-cleanup-wip'
Brett Smith [Mon, 11 May 2015 21:50:40 +0000 (17:50 -0400)]
Merge branch '5736-node-manager-easy-slot-cleanup-wip'

Refs #5736.  Closes #5995.

9 years ago5736: Node Manager cleans node records after shutting down a paired node.
Brett Smith [Mon, 11 May 2015 20:51:29 +0000 (16:51 -0400)]
5736: Node Manager cleans node records after shutting down a paired node.

This is an easy case to handle, and helps avoid exhausting SLURM
slot numbers.

9 years ago5736: Fix typo in Node Manager test comments.
Brett Smith [Mon, 11 May 2015 18:57:49 +0000 (14:57 -0400)]
5736: Fix typo in Node Manager test comments.

9 years agoMerge branch '3793-clean-docker-images-wip'
Brett Smith [Mon, 11 May 2015 21:35:58 +0000 (17:35 -0400)]
Merge branch '3793-clean-docker-images-wip'

Refs #3793.  Closes #5857.

9 years ago3793: Add Docker image cleaner service for compute nodes.
Brett Smith [Thu, 30 Apr 2015 13:19:15 +0000 (09:19 -0400)]
3793: Add Docker image cleaner service for compute nodes.

This service monitors Docker events.  When a container is destroyed,
it deletes any images that are unused and exceed the configured
storage quota.  This will prevent Docker images from growing
indefinitely on long-running compute nodes.

9 years agoMerge branch '5992-keep-proxy-ignore-locator-hints' closes #5992
Peter Amstutz [Mon, 11 May 2015 21:11:01 +0000 (17:11 -0400)]
Merge branch '5992-keep-proxy-ignore-locator-hints' closes #5992

9 years ago5992: keepproxy strips +K@{5} hints from locators before trying GET. +K@5-5-15
Peter Amstutz [Mon, 11 May 2015 20:38:23 +0000 (16:38 -0400)]
5992: keepproxy strips +K@{5} hints from locators before trying GET.  +K@5-5-15
locators are preserved.

9 years agocloses #3454
Radhika Chippada [Mon, 11 May 2015 17:33:53 +0000 (13:33 -0400)]
closes #3454
Merge branch '3454-default-docker-image'

9 years agoMerge branch '3198-inode-cache' refs #3198
Peter Amstutz [Mon, 11 May 2015 15:57:52 +0000 (11:57 -0400)]
Merge branch '3198-inode-cache' refs #3198

9 years agoMerge branch 'master' into 3454-default-docker-image
Radhika Chippada [Mon, 11 May 2015 15:17:02 +0000 (11:17 -0400)]
Merge branch 'master' into 3454-default-docker-image

9 years ago3198: Fix Operation(inode_cache) init. Break up tests into a few smaller
Peter Amstutz [Mon, 11 May 2015 15:14:56 +0000 (11:14 -0400)]
3198: Fix Operation(inode_cache) init.  Break up tests into a few smaller
tests.  Added comment about how collection size is calculated.

9 years agorefs #5682 : update arvados gem version
Radhika Chippada [Mon, 11 May 2015 15:05:47 +0000 (11:05 -0400)]
refs #5682 : update arvados gem version

9 years agocloses #5682
Radhika Chippada [Mon, 11 May 2015 15:02:19 +0000 (11:02 -0400)]
closes #5682
Merge branch '5682-download-file-error'

9 years agoMerge branch 'master' into 5682-download-file-error
Radhika Chippada [Mon, 11 May 2015 15:01:21 +0000 (11:01 -0400)]
Merge branch 'master' into 5682-download-file-error

9 years agocloses #4467
Radhika Chippada [Mon, 11 May 2015 15:00:32 +0000 (11:00 -0400)]
closes #4467
Merge branch '4467-project-contents-select-all'

9 years agoFix install instructions: create arvados repository.
Ward Vandewege [Sat, 9 May 2015 01:47:02 +0000 (21:47 -0400)]
Fix install instructions: create arvados repository.

closes #5988

9 years agoMerge branch '5748-max-buffers' refs #5748
Tom Clegg [Fri, 8 May 2015 18:09:03 +0000 (14:09 -0400)]
Merge branch '5748-max-buffers' refs #5748

9 years ago5748: Update keepstore install docs (-max-buffers, -blob-signing-key).
Tom Clegg [Fri, 8 May 2015 18:08:19 +0000 (14:08 -0400)]
5748: Update keepstore install docs (-max-buffers, -blob-signing-key).

9 years ago5748: Log clock time for each request.
Tom Clegg [Fri, 8 May 2015 05:17:40 +0000 (01:17 -0400)]
5748: Log clock time for each request.

For successful responses, log the standard HTTP status text for the
response code (instead of logging "OK" for any status<400).

9 years ago5748: Check for errors when writing pidfile. Keep it locked while running.
Tom Clegg [Thu, 7 May 2015 21:55:12 +0000 (17:55 -0400)]
5748: Check for errors when writing pidfile. Keep it locked while running.

* Handle SIGINT (the same way as SIGTERM)

* Improve startup/shutdown logs

9 years ago5748: Return the real decoder error for unparseable trash and pull requests.
Tom Clegg [Thu, 7 May 2015 16:38:12 +0000 (12:38 -0400)]
5748: Return the real decoder error for unparseable trash and pull requests.

9 years ago5748: Use a buffer pool instead of calling runtime.GC() during each GET.
Tom Clegg [Thu, 7 May 2015 14:40:44 +0000 (10:40 -0400)]
5748: Use a buffer pool instead of calling runtime.GC() during each GET.

9 years ago5720: when jqxhr readyState == 0 or status == 0, it could be that the user has naviga...
Radhika Chippada [Fri, 8 May 2015 14:25:20 +0000 (10:25 -0400)]
5720: when jqxhr readyState == 0 or status == 0, it could be that the user has navigated away from the page; hence return instead of showing error.

9 years agoMerge branch '4882-no-host-when-container' closes #4882
Tom Clegg [Fri, 8 May 2015 06:42:08 +0000 (02:42 -0400)]
Merge branch '4882-no-host-when-container' closes #4882

9 years ago4882: If -cgroup-cid flag is given, only read container stats. If not given, only...
Tom Clegg [Thu, 7 May 2015 02:57:06 +0000 (22:57 -0400)]
4882: If -cgroup-cid flag is given, only read container stats. If not given, only read host stats.

9 years ago5682: update workbench arvados gem version
Radhika Chippada [Thu, 7 May 2015 21:15:03 +0000 (17:15 -0400)]
5682: update workbench arvados gem version

9 years ago5682: move logic to check if '/' in filename into each_file_spec method from files...
Radhika Chippada [Thu, 7 May 2015 21:06:54 +0000 (17:06 -0400)]
5682: move logic to check if '/' in filename into each_file_spec method from files method so that it is applied in all contexts using the each_file_spec method.

9 years ago3198: Add --file-cache and --directory-cache to arv-mount to specify desired
Peter Amstutz [Thu, 7 May 2015 20:07:45 +0000 (16:07 -0400)]
3198: Add --file-cache and --directory-cache to arv-mount to specify desired
cache limits.

9 years ago3198: Inodes() and Operations() take InodeCache() object directly. Minimum
Peter Amstutz [Thu, 7 May 2015 19:47:33 +0000 (15:47 -0400)]
3198: Inodes() and Operations() take InodeCache() object directly.  Minimum
number of entries to retain is configurable.  Added unit test of inode cache.

9 years ago4467: Move select_all_items and unselect_all_items methods into selection.js
Radhika Chippada [Thu, 7 May 2015 19:21:11 +0000 (15:21 -0400)]
4467: Move select_all_items and unselect_all_items methods into selection.js

9 years agoMerge branch 'master' into 4467-project-contents-select-all
Radhika Chippada [Thu, 7 May 2015 18:29:28 +0000 (14:29 -0400)]
Merge branch 'master' into 4467-project-contents-select-all

9 years ago3454: use configured default docker image when none found in a job's runtime_constraints.
Radhika Chippada [Thu, 7 May 2015 18:17:55 +0000 (14:17 -0400)]
3454: use configured default docker image when none found in a job's runtime_constraints.

9 years agoMerge branch '5745-serialize-content-only' closes #5745
Tom Clegg [Thu, 7 May 2015 17:47:16 +0000 (13:47 -0400)]
Merge branch '5745-serialize-content-only' closes #5745

9 years ago5745: Fix test order dependency (restore mocked methods), tidy up test data.
Tom Clegg [Thu, 7 May 2015 16:48:48 +0000 (12:48 -0400)]
5745: Fix test order dependency (restore mocked methods), tidy up test data.

9 years ago5745: Serialize writes and data reads, but allow concurrent requests
Tom Clegg [Wed, 6 May 2015 16:56:34 +0000 (12:56 -0400)]
5745: Serialize writes and data reads, but allow concurrent requests
to do read-only non-data operations (like finding existing blocks and
checking free disk space) which are likely to be cached by the OS and
therefore not involve any disk activity.

Also:
* Serialize Touch and Delete.
* Make sure to close and delete tempfiles on write errors.
* Update comments.

9 years agoMerge branch '5523-stats-error' closes #5523
Tom Clegg [Thu, 7 May 2015 15:47:36 +0000 (11:47 -0400)]
Merge branch '5523-stats-error' closes #5523

9 years agoFix docker image build for SSO server after refactoring work in #5829.
Ward Vandewege [Wed, 6 May 2015 21:31:36 +0000 (17:31 -0400)]
Fix docker image build for SSO server after refactoring work in #5829.

refs #5829

9 years agorefs #5493: Merge branch '5493-fix-yellow-gif'
Nancy Ouyang [Wed, 6 May 2015 21:28:05 +0000 (17:28 -0400)]
refs #5493: Merge branch '5493-fix-yellow-gif'

9 years ago5493: fix yellow gif
Nancy Ouyang [Wed, 6 May 2015 21:27:22 +0000 (17:27 -0400)]
5493: fix yellow gif

9 years agoMerge branch '5748-keepstore-leak' refs #5748
Tom Clegg [Wed, 6 May 2015 21:13:36 +0000 (17:13 -0400)]
Merge branch '5748-keepstore-leak' refs #5748

9 years ago5748: Clean up comments and variable names.
Tom Clegg [Wed, 6 May 2015 21:10:35 +0000 (17:10 -0400)]
5748: Clean up comments and variable names.

9 years ago5748: Write index data to http.ResponseWriter, instead of using string
Tom Clegg [Wed, 6 May 2015 17:36:16 +0000 (13:36 -0400)]
5748: Write index data to http.ResponseWriter, instead of using string
concatenation to buffer the entire response.

9 years agoMerge branch '5842-node-manager-tighten-successful-boot-criteria-wip'
Brett Smith [Wed, 6 May 2015 20:57:29 +0000 (16:57 -0400)]
Merge branch '5842-node-manager-tighten-successful-boot-criteria-wip'

Closes #5842, #5931.

9 years ago5842: Node Manager only considers nodes busy if they're working.
Brett Smith [Wed, 6 May 2015 19:59:34 +0000 (15:59 -0400)]
5842: Node Manager only considers nodes busy if they're working.

Previously, Node Manager considered any non-idle node as busy,
including down nodes.  This causes it to boot replacements for nodes
that are marked "down," even if that's because they're still
bootstrapping.  Tighten the busy criteria to avoid booting excess
nodes.

It's easier to make this change now that Node Manager checks that
nodes have a functional Crunch worker state to be considered a
successful bootstrap.  This means that any node that's down later is
in an unexpected state, and we should avoid messing with it.

9 years ago5842: Node Manager shuts down booted nodes if they can't do compute work.
Brett Smith [Wed, 6 May 2015 20:07:33 +0000 (16:07 -0400)]
5842: Node Manager shuts down booted nodes if they can't do compute work.

If a booted node is not able to do work (it's not idle or busy),
consider that a bootstrapping failure and shut it down, just like a
failure to pair with an Arvados node.

9 years agoMerge branch '5926-parameterize-max-slots'
Ward Vandewege [Wed, 6 May 2015 20:17:49 +0000 (16:17 -0400)]
Merge branch '5926-parameterize-max-slots'

closes #5926

9 years agoImprove comment in application.default.yml based on review feedback.
Ward Vandewege [Wed, 6 May 2015 20:16:53 +0000 (16:16 -0400)]
Improve comment in application.default.yml based on review feedback.

refs #5926

9 years agoMake MAX_SLOTS a configurable parameter, and rename it to max_compute_nodes.
Ward Vandewege [Wed, 6 May 2015 19:46:28 +0000 (15:46 -0400)]
Make MAX_SLOTS a configurable parameter, and rename it to max_compute_nodes.

refs #5926

9 years ago5523: Say "notice" instead of "error" when stats file changes/appears/disappears.
Tom Clegg [Wed, 6 May 2015 14:09:21 +0000 (10:09 -0400)]
5523: Say "notice" instead of "error" when stats file changes/appears/disappears.

9 years ago4467: add test for "Select all" and "Unselect all" buttions in project tabs.
Radhika Chippada [Wed, 6 May 2015 00:49:25 +0000 (20:49 -0400)]
4467: add test for "Select all" and "Unselect all" buttions in project tabs.

9 years ago4467: add "select all" and "unselect all" buttons to project contents.
Radhika Chippada [Tue, 5 May 2015 20:03:24 +0000 (16:03 -0400)]
4467: add "select all" and "unselect all" buttons to project contents.

9 years agocloses #5735
Radhika Chippada [Tue, 5 May 2015 19:35:58 +0000 (15:35 -0400)]
closes #5735
Merge branch '5735-edit-description-box-size'

9 years ago5735: move tiptitle into nonhtml_options
Radhika Chippada [Tue, 5 May 2015 19:26:07 +0000 (15:26 -0400)]
5735: move tiptitle into nonhtml_options

9 years agoMerge branch 'master' into 5735-edit-description-box-size
Radhika Chippada [Tue, 5 May 2015 18:16:38 +0000 (14:16 -0400)]
Merge branch 'master' into 5735-edit-description-box-size

9 years ago5735: add comment
Radhika Chippada [Tue, 5 May 2015 18:12:54 +0000 (14:12 -0400)]
5735: add comment

9 years ago5735: add a new nonhtml_options parameter to render_editable_attribute method,
Radhika Chippada [Tue, 5 May 2015 17:53:28 +0000 (13:53 -0400)]
5735: add a new nonhtml_options parameter to render_editable_attribute method,
which can be used to pass any non data-* custom attributes that are useful in
customizing the rendering of the editable attribute.