Tom Clegg [Sat, 25 Nov 2017 07:17:18 +0000 (02:17 -0500)]
Merge branch '12475-asyncbuf'
refs #12475
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Sat, 25 Nov 2017 07:16:05 +0000 (02:16 -0500)]
12475: Merge branch 'master' into 12475-asyncbuf
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Sat, 25 Nov 2017 07:05:36 +0000 (02:05 -0500)]
12475: Return non-nil error at EOF even if len(p)==0.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Fri, 24 Nov 2017 15:29:25 +0000 (10:29 -0500)]
Merge branch '12627-token-scope'
fixes #12627
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Fri, 24 Nov 2017 06:10:56 +0000 (01:10 -0500)]
12627: Any token can permit scope, if acting as the right user.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Thu, 23 Nov 2017 18:52:46 +0000 (13:52 -0500)]
12627: Set current_user from first valid reader_token
...if primary session token is missing or invalid.
Workbench relies on this for anonymous access.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Lucas Di Pentima [Thu, 23 Nov 2017 19:22:21 +0000 (16:22 -0300)]
Merge branch '12519-multisite-project-search'
Closes #12519
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Lucas Di Pentima [Thu, 23 Nov 2017 19:13:10 +0000 (16:13 -0300)]
12519: Code simplification
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Tom Clegg [Thu, 23 Nov 2017 18:35:39 +0000 (13:35 -0500)]
Merge branch '12627-token-scope'
fixes #12627
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Thu, 23 Nov 2017 14:33:34 +0000 (09:33 -0500)]
12475: Faster asyncbuf.
Unlock earlier so multiple readers can copy bytes concurrently.
100 readers: improves from 4.5 GB/s to 17 GB/s
1 reader: unchanged 0.75 GB/s
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Thu, 23 Nov 2017 06:04:38 +0000 (01:04 -0500)]
12475: Add TestManyFailedPuts with a short timeout.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Thu, 23 Nov 2017 04:11:43 +0000 (23:11 -0500)]
12475: Rewrite streamer -> asyncbuf.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Wed, 22 Nov 2017 22:49:08 +0000 (17:49 -0500)]
12627: Ensure current_user relates to the token that permits scope.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Lucas Di Pentima [Wed, 22 Nov 2017 21:34:54 +0000 (18:34 -0300)]
12519: Remove trailing slash when guessing the workbench url.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Peter Amstutz [Wed, 22 Nov 2017 20:30:56 +0000 (15:30 -0500)]
Merge branch '12377-arvbox-composer' refs #12377
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Wed, 22 Nov 2017 19:31:53 +0000 (14:31 -0500)]
Set composer config. Bump SSO script for updated passenger.
Lucas Di Pentima [Tue, 21 Nov 2017 23:06:25 +0000 (20:06 -0300)]
Merge branch '12318-update-libcloud-pin'
Closes #12318
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Lucas Di Pentima [Tue, 21 Nov 2017 21:52:50 +0000 (18:52 -0300)]
12519: Activate every search results' tooltip on creation.
Removed unnecessary code.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Ward Vandewege [Tue, 21 Nov 2017 19:12:11 +0000 (14:12 -0500)]
Merge branch '12513-make-dashboard-fast-again'
refs #12513
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Tue, 21 Nov 2017 19:11:33 +0000 (14:11 -0500)]
Merge branch 'master' into 12513-make-dashboard-fast-again
refs #12513
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Tue, 21 Nov 2017 19:08:50 +0000 (14:08 -0500)]
Match the actual name of the CR in the
ApplicationLayoutTest#test_visit_dashboard_as_* tests, rather than the
state of the CR. It's confusing that the name is 'running'!
refs #12513
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Tue, 21 Nov 2017 19:03:47 +0000 (14:03 -0500)]
Make sure to apply the text-overflow-ellipsis class to the name of
running container requests, too.
refs #12513
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Lucas Di Pentima [Tue, 21 Nov 2017 18:11:30 +0000 (15:11 -0300)]
12519: Make Capybara happy by using a different kind of for loop.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Lucas Di Pentima [Tue, 21 Nov 2017 16:18:39 +0000 (13:18 -0300)]
12519: Use icons on 'show' buttons instead of 'C'/'P' labels.
Added bootstrap-style tooltips.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Ward Vandewege [Tue, 21 Nov 2017 14:28:16 +0000 (09:28 -0500)]
Add another missing dependency to the sanity check in run-tests.sh.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Tom Clegg [Tue, 21 Nov 2017 14:15:56 +0000 (09:15 -0500)]
12519: Move multisite search page to /search
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Ward Vandewege [Sun, 19 Nov 2017 23:53:32 +0000 (18:53 -0500)]
Add missing dependencies to the sanity check in run-tests.sh.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Sun, 19 Nov 2017 20:13:56 +0000 (15:13 -0500)]
12513: Fix 2 more tests.
refs #12513
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Lucas Di Pentima [Sat, 18 Nov 2017 00:13:23 +0000 (21:13 -0300)]
12519: Moved multisite search to its own URL
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Tom Clegg [Fri, 17 Nov 2017 21:51:22 +0000 (16:51 -0500)]
Merge branch '12530-faster-scopes-filter'
closes #12530
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Lucas Di Pentima [Fri, 17 Nov 2017 20:58:35 +0000 (17:58 -0300)]
12519: Updated search box placeholder message
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Lucas Di Pentima [Fri, 17 Nov 2017 20:53:38 +0000 (17:53 -0300)]
12519: Simplified code by nesting an additional MergingLoader
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Lucas Di Pentima [Fri, 17 Nov 2017 17:19:08 +0000 (14:19 -0300)]
12318: Merge branch 'master' into 12318-update-libcloud-pin
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Lucas Di Pentima [Fri, 17 Nov 2017 17:16:48 +0000 (14:16 -0300)]
12318: Updated integration test to correctly raise a RateLimitReachedError
exception, matching libcloud updates.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Peter Amstutz [Thu, 16 Nov 2017 19:07:37 +0000 (14:07 -0500)]
Bump schema-salad for extension schema loading bugfix. refs #11163
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Lucas Di Pentima [Thu, 16 Nov 2017 20:15:17 +0000 (17:15 -0300)]
12519: Added project search to multisite search
First draft, for approach validaton purposes.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Tom Clegg [Thu, 16 Nov 2017 18:59:05 +0000 (13:59 -0500)]
12530: Speed up query by skipping unneeded ActiveRecord loading.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Peter Amstutz [Thu, 16 Nov 2017 14:54:47 +0000 (09:54 -0500)]
Merge branch '12601-pathmap-subwf' closes #12601
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Ward Vandewege [Wed, 15 Nov 2017 21:44:50 +0000 (16:44 -0500)]
Merge branch '10767-remove-puma-gem'
refs #10767
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Wed, 15 Nov 2017 20:03:33 +0000 (15:03 -0500)]
Remove puma from the API server Gemfile.
refs #10767
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Peter Amstutz [Wed, 15 Nov 2017 18:34:32 +0000 (13:34 -0500)]
12601: Add test
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Wed, 15 Nov 2017 15:56:00 +0000 (10:56 -0500)]
12601: Apply pathmap to job order for RunInSingleContainer subwf.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Tom Clegg [Mon, 13 Nov 2017 19:57:29 +0000 (14:57 -0500)]
12513: Update tests, remove more unused code.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Mon, 13 Nov 2017 15:38:50 +0000 (10:38 -0500)]
Merge branch '12515-use-configured-wb'
closes #12515
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Mon, 13 Nov 2017 15:38:34 +0000 (10:38 -0500)]
Merge branch '12515-configured-workbench-address'
refs #12515
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Lucas Di Pentima [Fri, 10 Nov 2017 17:42:03 +0000 (14:42 -0300)]
12318: Use libcloud fork 2.2.2.dev3
Includes a fix for delete_old_vhd, limit number of retries on
destroy_node & a fix on Retry-After header handling on
exceptions.
Refs #12318, #12452, #12324
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Tom Clegg [Thu, 9 Nov 2017 20:40:45 +0000 (15:40 -0500)]
Add missing module name.
refs #11220
fixes #12590
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Thu, 9 Nov 2017 18:26:09 +0000 (13:26 -0500)]
12515: Add discovery doc test.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Wed, 8 Nov 2017 21:53:22 +0000 (16:53 -0500)]
12515: Use workbenchUrl advertised by API server discovery doc.
Fall back to guessing "workbench."+apiHost (as before) if discovery
doc does not offer a workbenchUrl (e.g., API server is too old).
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Tue, 31 Oct 2017 17:56:07 +0000 (13:56 -0400)]
12515: Advertise Workbench address in discovery doc.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Peter Amstutz [Wed, 8 Nov 2017 17:08:54 +0000 (12:08 -0500)]
Merge branch '12568-cwl-collection-cache' closes #12568
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Wed, 8 Nov 2017 17:02:02 +0000 (12:02 -0500)]
Merge branch '12538-crunchrun-kill-arvmount' closes #12538
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Tom Clegg [Wed, 8 Nov 2017 16:07:58 +0000 (11:07 -0500)]
Merge branch '12306-dont-stat-mounts'
fixes #12306
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Peter Amstutz [Wed, 8 Nov 2017 15:36:37 +0000 (10:36 -0500)]
12538: Put cleanup back into separate defer
* Always report unmount command
* Send kill signal to arv-mount on timeout (but don't wait for it)
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Tue, 7 Nov 2017 15:14:40 +0000 (10:14 -0500)]
12538: Refactor crunch-run shutdown
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Mon, 6 Nov 2017 21:41:05 +0000 (16:41 -0500)]
12538: Refactor and assume arv-mount --unmount does all the hard work.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Fri, 3 Nov 2017 20:14:42 +0000 (16:14 -0400)]
12538: Refactor force-unmount behavior.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Fri, 3 Nov 2017 19:04:00 +0000 (15:04 -0400)]
12538: Fix tests.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Fri, 3 Nov 2017 15:34:46 +0000 (11:34 -0400)]
12538: Make handling of arv-mount process more robust
* If initial "fusermount -u -z" of arv-mount dir times out, use "arv-mount --unmount"
* If that doesn't work, send sigkill to arv-mount and then run "fusermount -u
-z" again
* Refactor "stop container if arv-mount terminates" behavior
* Make arv-mount logging channel work as intended and enable crunchstat for arv-mount.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Thu, 2 Nov 2017 21:52:58 +0000 (17:52 -0400)]
Force kill arv-mount wip
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Tom Clegg [Tue, 7 Nov 2017 23:10:13 +0000 (18:10 -0500)]
12306: Resolve any readable symlinks on unmount path.
This avoids getting stuck in realpath/lstat in certain cases: e.g.,
the mount point is $HOME/keep, $HOME is "/home/foo", and "/home" is a
symlink to "/data/home".
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Peter Amstutz [Tue, 7 Nov 2017 20:52:08 +0000 (15:52 -0500)]
12568: Reduce min_entries
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Tue, 7 Nov 2017 18:58:16 +0000 (13:58 -0500)]
12568: Update test to check which collection gets evicted
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Tue, 7 Nov 2017 18:52:28 +0000 (13:52 -0500)]
12568: Add test for collection cache management behavior
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Tue, 7 Nov 2017 16:43:16 +0000 (11:43 -0500)]
12568: Mange collection cache to avoid excessive memory usage.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Tom Clegg [Mon, 6 Nov 2017 21:44:07 +0000 (16:44 -0500)]
12306: Resolve relative paths early, to avoid realpath() later.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Mon, 6 Nov 2017 21:11:02 +0000 (16:11 -0500)]
Merge branch '11994-no-sysfs-fuse'
fixes #11994
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Lucas Di Pentima [Mon, 6 Nov 2017 20:15:49 +0000 (17:15 -0300)]
Merge branch '12533-token-n-ip-logging'
Closes #12533
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Lucas Di Pentima [Mon, 6 Nov 2017 20:13:57 +0000 (17:13 -0300)]
12533: Use @remote_ip to take into account the reverse proxy
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Tom Clegg [Mon, 6 Nov 2017 18:16:02 +0000 (13:16 -0500)]
11994: Fix wrong class in "except ENOENT" handler.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Fri, 3 Nov 2017 18:18:36 +0000 (14:18 -0400)]
12306: Avoid calling realpath/lstat unnecessarily during --unmount.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Lucas Di Pentima [Fri, 3 Nov 2017 20:05:16 +0000 (17:05 -0300)]
12533: Add client IP address & authorization token UUID to the logs.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Tom Clegg [Fri, 3 Nov 2017 18:46:29 +0000 (14:46 -0400)]
11220: Fix test setup.
refs #11220
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Fri, 3 Nov 2017 17:18:40 +0000 (13:18 -0400)]
Merge branch '12551-check-open-errors'
fixes #12551
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Fri, 3 Nov 2017 15:27:38 +0000 (11:27 -0400)]
Merge branch '11220-manifest-fetch-error'
closes #11220
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Fri, 3 Nov 2017 14:45:04 +0000 (10:45 -0400)]
12551: Check for errors after calling open().
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Thu, 2 Nov 2017 19:55:26 +0000 (15:55 -0400)]
Merge branch '12546-skip-container-children'
fixes #12546
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Thu, 2 Nov 2017 19:45:24 +0000 (15:45 -0400)]
Merge branch '12478-duration-fmt'
fixes #12478
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Thu, 2 Nov 2017 19:09:28 +0000 (15:09 -0400)]
12546: Update help message.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Thu, 2 Nov 2017 19:05:34 +0000 (15:05 -0400)]
12546: Obey --skip-child-jobs flag for containers, too.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Thu, 2 Nov 2017 17:59:42 +0000 (13:59 -0400)]
12478: Fix time-offset formatting + use more natural tick intervals.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Tom Clegg [Thu, 2 Nov 2017 16:04:31 +0000 (12:04 -0400)]
Merge branch '12462-search-hyphen'
fixes #12462
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Lucas Di Pentima [Thu, 2 Nov 2017 15:56:01 +0000 (12:56 -0300)]
Merge branch '12533-row-lock-contention'
Refs #12533
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Lucas Di Pentima [Thu, 2 Nov 2017 15:54:56 +0000 (12:54 -0300)]
Merge branch 'master' into 12533-row-lock-contention
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Tom Clegg [Thu, 2 Nov 2017 15:06:25 +0000 (11:06 -0400)]
Merge branch '12167-workbench-request-id'
refs #12167
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Lucas Di Pentima [Thu, 2 Nov 2017 14:57:45 +0000 (11:57 -0300)]
Merge branch '12018-sync-groups-tool'
Closes #12018
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Lucas Di Pentima [Thu, 2 Nov 2017 14:56:50 +0000 (11:56 -0300)]
Merge branch 'master' into 12018-sync-groups-tool
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Peter Amstutz [Thu, 2 Nov 2017 14:53:17 +0000 (10:53 -0400)]
Merge branch '12183-crunch-run-symlinks' closes #12183
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Thu, 2 Nov 2017 14:52:15 +0000 (10:52 -0400)]
12183: Tweak documenation for clarity.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Lucas Di Pentima [Thu, 2 Nov 2017 14:48:03 +0000 (11:48 -0300)]
12533: Do not update the API Client Authorization record to avoid
row contention when lots of jobs are queued with the same token.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>
Peter Amstutz [Thu, 2 Nov 2017 14:02:55 +0000 (10:02 -0400)]
12183: Fix section headers.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Thu, 2 Nov 2017 13:32:40 +0000 (09:32 -0400)]
12183: Fix renamed symbol
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Wed, 1 Nov 2017 21:10:20 +0000 (17:10 -0400)]
12183: Update documentation.
Improve error message about follow symlink chains that are too long.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Mon, 16 Oct 2017 20:39:36 +0000 (16:39 -0400)]
12183: Handle circular directory symlinks
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Mon, 16 Oct 2017 19:26:55 +0000 (15:26 -0400)]
12183: Fix tests.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Mon, 16 Oct 2017 18:22:58 +0000 (14:22 -0400)]
12183: Refactor derefOutputSymlink into its own method.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Thu, 5 Oct 2017 14:40:04 +0000 (10:40 -0400)]
12183: Add comment about purpose of "relocated"
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Thu, 5 Oct 2017 12:47:04 +0000 (08:47 -0400)]
12183: Refactor file upload so there is one walk to handle both symlinks and
regular files.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Mon, 2 Oct 2017 20:07:18 +0000 (16:07 -0400)]
12183: Simplify walking symlinks in upload.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Peter Amstutz [Mon, 2 Oct 2017 19:34:38 +0000 (15:34 -0400)]
12183: Improve error handling if unable to delete symlinks marked for deletion.
Add unit test for EvalSymlinks.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>