arvados.git
6 years agoMerge branch '12018-sync-groups-tool'
Lucas Di Pentima [Thu, 2 Nov 2017 14:57:45 +0000 (11:57 -0300)]
Merge branch '12018-sync-groups-tool'
Closes #12018

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch 'master' into 12018-sync-groups-tool
Lucas Di Pentima [Thu, 2 Nov 2017 14:56:50 +0000 (11:56 -0300)]
Merge branch 'master' into 12018-sync-groups-tool

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '12183-crunch-run-symlinks' closes #12183
Peter Amstutz [Thu, 2 Nov 2017 14:53:17 +0000 (10:53 -0400)]
Merge branch '12183-crunch-run-symlinks'  closes #12183

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12183: Tweak documenation for clarity.
Peter Amstutz [Thu, 2 Nov 2017 14:52:15 +0000 (10:52 -0400)]
12183: Tweak documenation for clarity.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12183: Fix section headers.
Peter Amstutz [Thu, 2 Nov 2017 14:02:55 +0000 (10:02 -0400)]
12183: Fix section headers.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12183: Fix renamed symbol
Peter Amstutz [Thu, 2 Nov 2017 13:32:40 +0000 (09:32 -0400)]
12183: Fix renamed symbol

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12183: Update documentation.
Peter Amstutz [Wed, 1 Nov 2017 21:10:20 +0000 (17:10 -0400)]
12183: Update documentation.

Improve error message about follow symlink chains that are too long.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12183: Handle circular directory symlinks
Peter Amstutz [Mon, 16 Oct 2017 20:39:36 +0000 (16:39 -0400)]
12183: Handle circular directory symlinks

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12183: Fix tests.
Peter Amstutz [Mon, 16 Oct 2017 19:26:55 +0000 (15:26 -0400)]
12183: Fix tests.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12183: Refactor derefOutputSymlink into its own method.
Peter Amstutz [Mon, 16 Oct 2017 18:22:58 +0000 (14:22 -0400)]
12183:  Refactor derefOutputSymlink into its own method.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12183: Add comment about purpose of "relocated"
Peter Amstutz [Thu, 5 Oct 2017 14:40:04 +0000 (10:40 -0400)]
12183: Add comment about purpose of "relocated"

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12183: Refactor file upload so there is one walk to handle both symlinks and
Peter Amstutz [Thu, 5 Oct 2017 12:47:04 +0000 (08:47 -0400)]
12183: Refactor file upload so there is one walk to handle both symlinks and
regular files.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12183: Simplify walking symlinks in upload.
Peter Amstutz [Mon, 2 Oct 2017 20:07:18 +0000 (16:07 -0400)]
12183: Simplify walking symlinks in upload.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12183: Improve error handling if unable to delete symlinks marked for deletion.
Peter Amstutz [Mon, 2 Oct 2017 19:34:38 +0000 (15:34 -0400)]
12183: Improve error handling if unable to delete symlinks marked for deletion.

Add unit test for EvalSymlinks.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12183: Support uploading symlinks to directories.
Peter Amstutz [Fri, 29 Sep 2017 20:06:59 +0000 (16:06 -0400)]
12183: Support uploading symlinks to directories.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12183: Evaluate symlinks to handle chained links and absolute paths.
Peter Amstutz [Fri, 29 Sep 2017 19:11:46 +0000 (15:11 -0400)]
12183: Evaluate symlinks to handle chained links and absolute paths.

Ensure that all symlinks either resolve within the output directory or to a
keep mount.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '12494-arv-git-cors' closes #12494
Peter Amstutz [Wed, 1 Nov 2017 16:54:02 +0000 (12:54 -0400)]
Merge branch '12494-arv-git-cors' closes #12494

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12494: Add CORS test.
Tom Clegg [Wed, 1 Nov 2017 07:58:36 +0000 (03:58 -0400)]
12494: Add CORS test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12018: Added API server start/stop calls to test suite.
Lucas Di Pentima [Tue, 31 Oct 2017 21:07:01 +0000 (18:07 -0300)]
12018: Added API server start/stop calls to test suite.
Removed manual database cleanup in favour of using the database
reset endpoint after every test run.
Moved tool config set up code from the suite set up call to the test
set up, because the database get reset to fixture state after every
test run.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12018: Set up fields per record, so it won't try to guess it from
Lucas Di Pentima [Tue, 31 Oct 2017 14:00:28 +0000 (11:00 -0300)]
12018: Set up fields per record, so it won't try to guess it from
the first one being read.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12018: Enhanced readability of ProcessFile() function.
Lucas Di Pentima [Tue, 31 Oct 2017 02:17:42 +0000 (23:17 -0300)]
12018: Enhanced readability of ProcessFile() function.
Added test using usernames instead of emails.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12018: Enhanced error message when having a parse error.
Lucas Di Pentima [Mon, 30 Oct 2017 22:42:06 +0000 (19:42 -0300)]
12018: Enhanced error message when having a parse error.
Added test cleanup.
Added test to confirm records with empty fields are ignored.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12018: Moved Link & LinkList types to GoSDK arvados package
Lucas Di Pentima [Mon, 30 Oct 2017 21:17:52 +0000 (18:17 -0300)]
12018: Moved Link & LinkList types to GoSDK arvados package

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12018: Fixed positional argument handling.
Lucas Di Pentima [Mon, 30 Oct 2017 14:35:58 +0000 (11:35 -0300)]
12018: Fixed positional argument handling.
Fixed & added tests.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '12462-search-periods'
Tom Clegg [Mon, 30 Oct 2017 13:19:36 +0000 (09:19 -0400)]
Merge branch '12462-search-periods'

refs #12462

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMigration for indexes on containers and container_requests.
Peter Amstutz [Fri, 27 Oct 2017 18:42:03 +0000 (14:42 -0400)]
Migration for indexes on containers and container_requests.

refs #12500

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12018: Changed the input file parameter to be positional.
Lucas Di Pentima [Thu, 26 Oct 2017 20:31:26 +0000 (17:31 -0300)]
12018: Changed the input file parameter to be positional.
Enhanced usage message.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12018: Create synchronized remote groups as "role" groups.
Lucas Di Pentima [Thu, 26 Oct 2017 18:21:36 +0000 (15:21 -0300)]
12018: Create synchronized remote groups as "role" groups.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12018: Fixed membership removal call. Added input validation.
Lucas Di Pentima [Thu, 26 Oct 2017 16:25:37 +0000 (13:25 -0300)]
12018: Fixed membership removal call. Added input validation.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12494: Add CORS header support to arv-git-httpd
Peter Amstutz [Thu, 26 Oct 2017 14:08:57 +0000 (10:08 -0400)]
12494: Add CORS header support to arv-git-httpd

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoHandle rails 5 deprecation warning in services/api.
Ward Vandewege [Wed, 25 Oct 2017 23:30:14 +0000 (19:30 -0400)]
Handle rails 5 deprecation warning in services/api.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago12018: CSV file processing code separated to its own function.
Lucas Di Pentima [Wed, 25 Oct 2017 15:21:15 +0000 (12:21 -0300)]
12018: CSV file processing code separated to its own function.
Fixed members permission link, replaced "manage" with "can_write".

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12018: Splitted api client calls to their own funcs.
Lucas Di Pentima [Wed, 25 Oct 2017 14:22:58 +0000 (11:22 -0300)]
12018: Splitted api client calls to their own funcs.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12018: Added basic tests
Lucas Di Pentima [Wed, 25 Oct 2017 02:54:30 +0000 (23:54 -0300)]
12018: Added basic tests

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12018: Move remote group retrieving and member removal code to
Lucas Di Pentima [Wed, 25 Oct 2017 01:11:31 +0000 (22:11 -0300)]
12018: Move remote group retrieving and member removal code to
separate functions.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12018: Split setup code on its own functions
Lucas Di Pentima [Tue, 24 Oct 2017 21:37:42 +0000 (18:37 -0300)]
12018: Split setup code on its own functions

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '12125-fuse-project-trash' refs #12125
Peter Amstutz [Tue, 24 Oct 2017 14:25:22 +0000 (10:25 -0400)]
Merge branch '12125-fuse-project-trash' refs #12125

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12018: User, UserList, Group & GroupList types go into Go SDK.
Lucas Di Pentima [Tue, 24 Oct 2017 12:07:04 +0000 (09:07 -0300)]
12018: User, UserList, Group & GroupList types go into Go SDK.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12018: Group membership need two-way links between the user and
Lucas Di Pentima [Mon, 23 Oct 2017 23:56:13 +0000 (20:56 -0300)]
12018: Group membership need two-way links between the user and
the group. On group members loading, check that both links exist.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12018: Do not tag remote groups with tag links. Use the parent
Lucas Di Pentima [Mon, 23 Oct 2017 22:30:54 +0000 (19:30 -0300)]
12018: Do not tag remote groups with tag links. Use the parent
group as an indication that the group is synced from a remote
source.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '12125-workbench-project-trash' refs #12125
Peter Amstutz [Mon, 23 Oct 2017 20:03:17 +0000 (16:03 -0400)]
Merge branch '12125-workbench-project-trash' refs #12125

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12018: Stop using arvadosclient in favor of arvados package for API
Lucas Di Pentima [Mon, 23 Oct 2017 19:36:54 +0000 (16:36 -0300)]
12018: Stop using arvadosclient in favor of arvados package for API
server access.
Drop "-retries" parameter as it's not supported on the newer SDK.
Use specific types for resources instead of [][]string.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12125: Add test deleting project via API updates FUSE.
Peter Amstutz [Mon, 23 Oct 2017 19:27:57 +0000 (15:27 -0400)]
12125: Add test deleting project via API updates FUSE.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12125: Recognize that projects (groups) can be trashed, too.
Peter Amstutz [Wed, 4 Oct 2017 12:35:02 +0000 (08:35 -0400)]
12125: Recognize that projects (groups) can be trashed, too.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12125: Don't offer to untrash item if it isn't trash
Peter Amstutz [Mon, 23 Oct 2017 12:44:15 +0000 (08:44 -0400)]
12125: Don't offer to untrash item if it isn't trash

Ensure that it behaves in a reasonable way if user has access to an item via a
sideways permission link instead of the usual ownership hierarchy.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12125: Update trash tests
Peter Amstutz [Fri, 20 Oct 2017 20:37:10 +0000 (16:37 -0400)]
12125: Update trash tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '12216-webdav-list'
Tom Clegg [Fri, 20 Oct 2017 19:02:25 +0000 (15:02 -0400)]
Merge branch '12216-webdav-list'

closes #12216

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12462: Fix full-text search for terms like "foo.bar".
Tom Clegg [Fri, 20 Oct 2017 17:59:45 +0000 (13:59 -0400)]
12462: Fix full-text search for terms like "foo.bar".

A search for a filename like "foo.bar" should match text "foo.bar" --
but "foo.bar" was transformed to "foo:* & bar:*", and since "." is a
word character, "bar:*" did not match "foo.bar".

Now "foo.bar" is transformed to "foo.bar:*".

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12216: Merge branch 'master' into 12216-webdav-list
Tom Clegg [Fri, 20 Oct 2017 17:55:54 +0000 (13:55 -0400)]
12216: Merge branch 'master' into 12216-webdav-list

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12216: Add cadaver to arvbox.
Tom Clegg [Fri, 20 Oct 2017 17:18:45 +0000 (13:18 -0400)]
12216: Add cadaver to arvbox.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12216: Document UUIDTTL in help message.
Tom Clegg [Fri, 20 Oct 2017 15:40:25 +0000 (11:40 -0400)]
12216: Document UUIDTTL in help message.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12018: resourceList interface simplification. Code re-stying.
Lucas Di Pentima [Fri, 20 Oct 2017 14:33:04 +0000 (11:33 -0300)]
12018: resourceList interface simplification. Code re-stying.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12125: Added note about searching for collections within trash.
Peter Amstutz [Fri, 20 Oct 2017 14:23:08 +0000 (10:23 -0400)]
12125: Added note about searching for collections within trash.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12125: Don't show checkbox for items located within trashed project.
Peter Amstutz [Fri, 20 Oct 2017 14:17:05 +0000 (10:17 -0400)]
12125: Don't show checkbox for items located within trashed project.

They can't be untrashed directly.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12125: 404 page searches owners to find actual trashed object.
Peter Amstutz [Thu, 19 Oct 2017 22:01:33 +0000 (18:01 -0400)]
12125: 404 page searches owners to find actual trashed object.

Change untrash behavior so that untrash button always directs to 404 page for
untrash confirmation.  Provides better consistency of UX and ensures that
multiple levels of trash (such as a trashed collection within a trashed
project) are handled.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12018: Simplify ListAll()
Lucas Di Pentima [Fri, 20 Oct 2017 02:32:59 +0000 (23:32 -0300)]
12018: Simplify ListAll()

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12018: Manage two way links for group memberships.
Lucas Di Pentima [Fri, 20 Oct 2017 00:41:25 +0000 (21:41 -0300)]
12018: Manage two way links for group memberships.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12018: Various updates, described below:
Lucas Di Pentima [Thu, 19 Oct 2017 22:06:47 +0000 (19:06 -0300)]
12018: Various updates, described below:

* Code styling.
* Added system_user as permission links owner.
* Improved userId option handling.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12125: Can search within trashed projects.
Peter Amstutz [Mon, 9 Oct 2017 20:41:05 +0000 (16:41 -0400)]
12125: Can search within trashed projects.

Don't show items within trashed projects in the complete list, but do make it
possible to search for them.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12125: Displaying only trashed collections sort of works.
Peter Amstutz [Fri, 6 Oct 2017 23:04:43 +0000 (19:04 -0400)]
12125: Displaying only trashed collections sort of works.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12125: Expand test case.
Peter Amstutz [Wed, 4 Oct 2017 12:23:00 +0000 (08:23 -0400)]
12125: Expand test case.

Tests trashing project and checking that it shows up on the trash page.  Tests
UI using both trash/recycle buttons and using selections.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12125: Adding test
Peter Amstutz [Wed, 4 Oct 2017 01:05:54 +0000 (21:05 -0400)]
12125: Adding test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12125: Adjust table layout
Peter Amstutz [Tue, 3 Oct 2017 17:17:00 +0000 (13:17 -0400)]
12125: Adjust table layout

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

Reviewed-by: Peter Amstutz <peter.amstutz@curoverse.com>
6 years ago12125: Missing file
Peter Amstutz [Tue, 3 Oct 2017 14:06:24 +0000 (10:06 -0400)]
12125: Missing file

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12125: Restore "move trashed items to home" behavior for now.
Peter Amstutz [Mon, 18 Sep 2017 13:55:07 +0000 (09:55 -0400)]
12125: Restore "move trashed items to home" behavior for now.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12125: Fix 404 page when not showing a specific object.
Peter Amstutz [Fri, 15 Sep 2017 12:33:22 +0000 (08:33 -0400)]
12125: Fix 404 page when not showing a specific object.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12125: Workbench 404 page checks if item is in the trash.
Peter Amstutz [Fri, 15 Sep 2017 02:11:22 +0000 (22:11 -0400)]
12125: Workbench 404 page checks if item is in the trash.

Provides a convenient button to untrash it.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12125: Can browse trashed projects & untrash them.
Peter Amstutz [Fri, 15 Sep 2017 01:35:40 +0000 (21:35 -0400)]
12125: Can browse trashed projects & untrash them.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12125: Initial work, separate collection and project trash tabs.
Peter Amstutz [Fri, 15 Sep 2017 00:36:24 +0000 (20:36 -0400)]
12125: Initial work, separate collection and project trash tabs.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoUpdate libcloud pin for VHD delete bugfix. refs #12324 1.1.0
Peter Amstutz [Thu, 19 Oct 2017 20:36:08 +0000 (16:36 -0400)]
Update libcloud pin for VHD delete bugfix.  refs #12324

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '12461-cache-race'
Tom Clegg [Thu, 19 Oct 2017 18:15:47 +0000 (14:15 -0400)]
Merge branch '12461-cache-race'

refs #12461

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoFix wrong HTTP status code for early "impossible path" check.
Tom Clegg [Thu, 19 Oct 2017 18:12:07 +0000 (14:12 -0400)]
Fix wrong HTTP status code for early "impossible path" check.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '12467-read-imgload-response' closes #12467
Peter Amstutz [Thu, 19 Oct 2017 18:09:34 +0000 (14:09 -0400)]
Merge branch '12467-read-imgload-response' closes #12467

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12467: Fix log messages. Defer response.Body.Close().
Peter Amstutz [Thu, 19 Oct 2017 17:59:24 +0000 (13:59 -0400)]
12467: Fix log messages.  Defer response.Body.Close().

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12467: Wait for response that image loading is complete
Peter Amstutz [Thu, 19 Oct 2017 17:35:23 +0000 (13:35 -0400)]
12467: Wait for response that image loading is complete

Need to do this before trying to start container.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '12446-dispatcher-query' closes #12446
Peter Amstutz [Thu, 19 Oct 2017 15:41:40 +0000 (11:41 -0400)]
Merge branch '12446-dispatcher-query' closes #12446

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12446: Avoid listing every container uuid in status query.
Peter Amstutz [Tue, 17 Oct 2017 14:30:42 +0000 (10:30 -0400)]
12446: Avoid listing every container uuid in status query.

6 years ago12018: Skip CSV register if one of its fields is empty
Lucas Di Pentima [Wed, 18 Oct 2017 22:39:14 +0000 (19:39 -0300)]
12018: Skip CSV register if one of its fields is empty

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12018: Removed superfluous check
Lucas Di Pentima [Wed, 18 Oct 2017 21:36:22 +0000 (18:36 -0300)]
12018: Removed superfluous check

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12018: Added flag to specify a parent group UUID. When not given,
Lucas Di Pentima [Wed, 18 Oct 2017 21:32:28 +0000 (18:32 -0300)]
12018: Added flag to specify a parent group UUID. When not given,
it tries to search for a default & system owned group, or create
one if none found.
Group List & Create operations adjusted to use the correct parent
group as owner.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago12461: Avoid race bug in Rails file cache.
Tom Clegg [Wed, 18 Oct 2017 19:37:54 +0000 (15:37 -0400)]
12461: Avoid race bug in Rails file cache.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12018: Several changes, listed below:
Lucas Di Pentima [Wed, 18 Oct 2017 17:17:01 +0000 (14:17 -0300)]
12018: Several changes, listed below:
* Removed initial Python version.
* Removed superfluous input files checks and moved file opening
to be before any API calls, to avoid doing them is there's a problem
with the file.
* Added user, group & link types so they're populated by json decoding.
* Cleaned up ListAll() func so it can work with different resource
types.
* Changed usage of set style types from map[string]struct{} to be
map[string]bool to simplify membership checking.
* Corrected error messages to start with lowercase.
* Added more debug messages for -verbose mode.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago11260: Fix tests.
Tom Clegg [Tue, 17 Oct 2017 19:49:14 +0000 (15:49 -0400)]
11260: Fix tests.

refs #11260

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoComment out sdk/go/health from run-tests.sh until it is fixed.
Peter Amstutz [Wed, 18 Oct 2017 13:38:56 +0000 (09:38 -0400)]
Comment out sdk/go/health from run-tests.sh until it is fixed.

refs #12260

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '12452-nm-unpaired-down' refs #12452
Peter Amstutz [Tue, 17 Oct 2017 19:23:25 +0000 (15:23 -0400)]
Merge branch '12452-nm-unpaired-down' refs #12452

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12216: Merge branch 'master' into 12216-webdav-list
Tom Clegg [Tue, 17 Oct 2017 15:08:27 +0000 (11:08 -0400)]
12216: Merge branch 'master' into 12216-webdav-list

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12216: Separate config for uuid->pdh cache TTL, default 5 seconds.
Tom Clegg [Tue, 17 Oct 2017 15:06:16 +0000 (11:06 -0400)]
12216: Separate config for uuid->pdh cache TTL, default 5 seconds.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12452: Fix test
Peter Amstutz [Tue, 17 Oct 2017 14:50:23 +0000 (10:50 -0400)]
12452: Fix test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '12260-system-health'
Tom Clegg [Tue, 17 Oct 2017 14:24:19 +0000 (10:24 -0400)]
Merge branch '12260-system-health'

refs #12260

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12260: Build arvados-health package.
Tom Clegg [Tue, 17 Oct 2017 14:23:37 +0000 (10:23 -0400)]
12260: Build arvados-health package.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12260: Merge branch 'master' into 12260-system-health
Tom Clegg [Tue, 17 Oct 2017 13:06:50 +0000 (09:06 -0400)]
12260: Merge branch 'master' into 12260-system-health

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12452: Consider unpaired node older than boot grace period 'down'.
Peter Amstutz [Mon, 16 Oct 2017 19:50:36 +0000 (15:50 -0400)]
12452: Consider unpaired node older than boot grace period 'down'.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12216: Allow Authorization header in cross-origin requests.
Tom Clegg [Mon, 16 Oct 2017 18:03:30 +0000 (14:03 -0400)]
12216: Allow Authorization header in cross-origin requests.

This allows browser-based applications to send tokens in Authorization
headers. This is the only token-passing mechanism that neither exposes
the token inappropriately in proxy/server logs nor interferes with
webdav's use of request bodies.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '12447-crunch-run-leak' closes #12447
Peter Amstutz [Mon, 16 Oct 2017 18:01:50 +0000 (14:01 -0400)]
Merge branch '12447-crunch-run-leak' closes #12447

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12447: Simplify BlockCache locking.
Peter Amstutz [Mon, 16 Oct 2017 17:13:44 +0000 (13:13 -0400)]
12447: Simplify BlockCache locking.

Close response body when content-length is missing.

Tweak messages related to crunch-run -memprofile.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12447: Require Content-Length in KeepClient.Get
Peter Amstutz [Mon, 16 Oct 2017 17:00:55 +0000 (13:00 -0400)]
12447: Require Content-Length in KeepClient.Get

Fix test stub to report Content-Length.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12260: Update comments to match real func/type names.
Tom Clegg [Mon, 16 Oct 2017 14:44:54 +0000 (10:44 -0400)]
12260: Update comments to match real func/type names.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12447: Fix typo shadowing 'data' in BlockCache.Get
Peter Amstutz [Mon, 16 Oct 2017 14:41:18 +0000 (10:41 -0400)]
12447: Fix typo shadowing 'data' in BlockCache.Get

Move locking to BlockCache.setup()

Tweak tests to bind explicitly to loopback address.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago12216: Fix crash at path "/c=foo"
Tom Clegg [Sun, 15 Oct 2017 17:17:06 +0000 (13:17 -0400)]
12216: Fix crash at path "/c=foo"

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago12447: Remove .Bytes()
Peter Amstutz [Sat, 14 Oct 2017 16:47:42 +0000 (12:47 -0400)]
12447: Remove .Bytes()

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>