Tom Clegg [Wed, 12 Apr 2017 19:01:07 +0000 (15:01 -0400)]
11308: Merge branch 'master' into 11308-python3
Conflicts:
sdk/python/arvados/__init__.py
sdk/python/arvados/api.py
sdk/python/arvados/commands/ls.py
sdk/python/arvados/keep.py
sdk/python/setup.py
sdk/python/tests/test_arv_ls.py
Tom Clegg [Wed, 12 Apr 2017 16:02:14 +0000 (12:02 -0400)]
11308: Remove unused import.
Tom Clegg [Wed, 12 Apr 2017 15:37:54 +0000 (11:37 -0400)]
11349: Fix section name in example configs.
refs #11349
Peter Amstutz [Tue, 11 Apr 2017 23:03:52 +0000 (19:03 -0400)]
cwl/test_with_arvbox.sh pulls arvados/jobs:latest refs #11457
Peter Amstutz [Tue, 11 Apr 2017 22:00:25 +0000 (18:00 -0400)]
Build SSO packages for Ubuntu 1604. refs #11457
Tom Clegg [Tue, 11 Apr 2017 18:31:42 +0000 (14:31 -0400)]
Build packages for python "future" module.
refs #11349
refs #11308
radhika [Tue, 11 Apr 2017 18:34:46 +0000 (14:34 -0400)]
refs #8465
Merge branch '8465-stderr-redirection'
radhika [Tue, 11 Apr 2017 18:08:21 +0000 (14:08 -0400)]
Merge branch 'master' into 8465-stderr-redirection
Tom Clegg [Tue, 11 Apr 2017 15:33:17 +0000 (11:33 -0400)]
Merge branch '11349-nodemanager-status-api'
refs #11349
Tom Clegg [Tue, 11 Apr 2017 15:17:05 +0000 (11:17 -0400)]
11349: Move assertion outside loop for clarity.
Tom Clegg [Tue, 11 Apr 2017 15:16:50 +0000 (11:16 -0400)]
11349: Warn if management/status server is not enabled.
Lucas Di Pentima [Tue, 11 Apr 2017 13:33:24 +0000 (10:33 -0300)]
Merge branch '6304-dns-update-fix'
Closes #6304
Lucas Di Pentima [Tue, 11 Apr 2017 13:32:10 +0000 (10:32 -0300)]
6304: Change assertion type for better failure message.
Tom Clegg [Tue, 11 Apr 2017 02:04:00 +0000 (22:04 -0400)]
11308: Fix bytes vs. strings in test case.
Tom Clegg [Tue, 11 Apr 2017 00:23:04 +0000 (20:23 -0400)]
11308: Remove superfluous parens.
Tom Clegg [Tue, 11 Apr 2017 00:22:42 +0000 (20:22 -0400)]
11308: Avoid Python2-inefficient list() operations.
Tom Clegg [Tue, 11 Apr 2017 00:22:03 +0000 (20:22 -0400)]
11308: Fix futurize misinterpretation.
Tom Clegg [Tue, 11 Apr 2017 00:21:19 +0000 (20:21 -0400)]
11308: Put back exception handling
Tom Clegg [Mon, 10 Apr 2017 19:45:40 +0000 (15:45 -0400)]
Secure link to google search.
No issue #
Lucas Di Pentima [Mon, 10 Apr 2017 17:58:08 +0000 (14:58 -0300)]
6304: Merge branch 'master' into 6304-dns-update-fix
Lucas Di Pentima [Mon, 10 Apr 2017 17:56:04 +0000 (14:56 -0300)]
6304: Corrected test setup to make it pass.
Added a separator to the temp file so that its name is more readable.
radhika [Mon, 10 Apr 2017 17:33:11 +0000 (13:33 -0400)]
Merge branch '8465-stdin-redirection' into 8465-stderr-redirection
radhika [Mon, 10 Apr 2017 17:32:22 +0000 (13:32 -0400)]
8465: test cleanup
Lucas Di Pentima [Mon, 10 Apr 2017 16:51:28 +0000 (13:51 -0300)]
6304: Clean up temp files that could exist in case of writing errors.
Also added a test for this case, not working properly atm.
Peter Amstutz [Mon, 10 Apr 2017 14:59:05 +0000 (10:59 -0400)]
Merge branch '11332-cwl-url-quoting' refs #11332
Peter Amstutz [Mon, 10 Apr 2017 14:58:33 +0000 (10:58 -0400)]
11332: Add @ to quote safelist.
Tom Clegg [Mon, 10 Apr 2017 14:20:31 +0000 (10:20 -0400)]
11349: Report wishlist size in status["nodes_wish"].
Peter Amstutz [Mon, 10 Apr 2017 14:07:23 +0000 (10:07 -0400)]
11332: Use urllib quote/unquote to handle special chars (e.g. '#')
Tom Clegg [Fri, 7 Apr 2017 19:20:04 +0000 (15:20 -0400)]
11349: Add management server with /status.json
Peter Amstutz [Fri, 7 Apr 2017 21:06:01 +0000 (17:06 -0400)]
8465: Set proper container flags to provide data on stdin.
Peter Amstutz [Fri, 7 Apr 2017 19:26:54 +0000 (15:26 -0400)]
Merge branch '11237-google-api-python-client' refs #11237
Peter Amstutz [Fri, 7 Apr 2017 18:31:21 +0000 (14:31 -0400)]
11237: Tweak version dependencies.
Peter Amstutz [Fri, 7 Apr 2017 18:21:35 +0000 (14:21 -0400)]
11237: Don't build oauth2client on ubuntu1604
Peter Amstutz [Fri, 7 Apr 2017 18:18:57 +0000 (14:18 -0400)]
11237: Bump google-api-python-client to 1.6.2 for better compatability across
oauth2client and Python versions.
Tom Clegg [Fri, 7 Apr 2017 17:23:57 +0000 (13:23 -0400)]
Merge branch '11209-unmount-subtype'
refs #11209
Peter Amstutz [Fri, 7 Apr 2017 15:43:56 +0000 (11:43 -0400)]
Increase ping delay in WatchdogActorTest to try and reduce spurious test failures. no issue #
Peter Amstutz [Fri, 7 Apr 2017 15:36:30 +0000 (11:36 -0400)]
Add check that gnutls.h is available so pycurl can compile. no issue #
Javier BĂ©rtoli [Fri, 7 Apr 2017 11:29:21 +0000 (08:29 -0300)]
Ensure chown does not fail on disappearing files and dirs
refs #11363
Tom Clegg [Fri, 7 Apr 2017 07:41:53 +0000 (03:41 -0400)]
11209: Restrict --unmount* operations to given --subtype.
Add warnings about affecting other fuse mounts with --unmount flags.
radhika [Fri, 7 Apr 2017 00:12:59 +0000 (20:12 -0400)]
8465: added stderr redirection and tests
Peter Amstutz [Thu, 6 Apr 2017 21:23:10 +0000 (17:23 -0400)]
Add missing test file refs #11423
Tom Clegg [Thu, 6 Apr 2017 20:47:18 +0000 (16:47 -0400)]
Merge branch '8104-pycurl-721'
closes #8104
Tom Clegg [Thu, 6 Apr 2017 20:43:36 +0000 (16:43 -0400)]
8104: Do not close sockets after giving them to pycurl. Reverts
7b31dd40b31bdbf7473b50fd407cd6f636657c69.
Tom Clegg [Thu, 6 Apr 2017 20:20:56 +0000 (16:20 -0400)]
8104: Drop unnecessary lambda.
radhika [Thu, 6 Apr 2017 20:13:38 +0000 (16:13 -0400)]
8465: do not wait in the go routine while doing io.Copy of stdin and also invoke runner.stop on error.
Tom Clegg [Thu, 6 Apr 2017 19:42:36 +0000 (15:42 -0400)]
8104: Stop building pycurl package for ubuntu1604.
Peter Amstutz [Thu, 6 Apr 2017 19:46:18 +0000 (15:46 -0400)]
Merge branch '11423-cwl-collection-dir-ref' closes #11423
Peter Amstutz [Thu, 6 Apr 2017 19:43:38 +0000 (15:43 -0400)]
11423: Restore check to use pdh_path because it is only supposed to match Files
references.
Lucas Di Pentima [Thu, 6 Apr 2017 19:17:43 +0000 (16:17 -0300)]
Merge branch '7824-arvls-arvput-collection-api-usage'
Closes #7824
Lucas Di Pentima [Thu, 6 Apr 2017 19:15:25 +0000 (16:15 -0300)]
7824: Merge branch 'master' into 7824-arvls-arvput-collection-api-usage
Tom Clegg [Thu, 6 Apr 2017 18:49:29 +0000 (14:49 -0400)]
8104: Remove pycurl<7.21.5 dependency.
Tom Clegg [Thu, 6 Apr 2017 18:38:44 +0000 (14:38 -0400)]
8104: OPENSOCKETFUNCTION accepts calls from pycurl 7.21.
Tom Clegg [Mon, 3 Apr 2017 05:06:08 +0000 (01:06 -0400)]
11308: Close socket after pycurl.
radhika [Thu, 6 Apr 2017 18:28:57 +0000 (14:28 -0400)]
Merge branch 'master' into 8465-stdin-redirection
radhika [Thu, 6 Apr 2017 18:28:00 +0000 (14:28 -0400)]
8465: test clean up
Peter Amstutz [Thu, 6 Apr 2017 15:58:38 +0000 (11:58 -0400)]
11423: Fix bug checking existence of Directories which refer to root of keep collections.
Peter Amstutz [Thu, 6 Apr 2017 13:05:41 +0000 (09:05 -0400)]
Merge branch '11413-nodemanager-gce-fixes' refs #11413
Tom Clegg [Thu, 6 Apr 2017 05:34:39 +0000 (01:34 -0400)]
11308: Make imports epydoc-parseable.
radhika [Wed, 5 Apr 2017 23:53:28 +0000 (19:53 -0400)]
8465: added stdin redirection for json mount.
Tom Clegg [Wed, 5 Apr 2017 19:38:40 +0000 (15:38 -0400)]
11308: Remove superfluous hashbangs
Tom Clegg [Wed, 5 Apr 2017 19:29:06 +0000 (15:29 -0400)]
11308: Move stub server setup to keepstub.StubKeepServers.
Tom Clegg [Wed, 5 Apr 2017 19:28:07 +0000 (15:28 -0400)]
11308: Fix misleading argument name.
Tom Clegg [Wed, 5 Apr 2017 19:12:45 +0000 (15:12 -0400)]
11308: Fix useless assertion.
Tom Clegg [Wed, 5 Apr 2017 19:12:18 +0000 (15:12 -0400)]
11308: Fix exception handling in test case.
Tom Clegg [Wed, 5 Apr 2017 19:05:10 +0000 (15:05 -0400)]
11308: Raise exception on invalid/unsupported open() mode.
Lucas Di Pentima [Wed, 5 Apr 2017 17:23:49 +0000 (14:23 -0300)]
6304: Avoid possible dns update race condition by writing the temp file with unique name to avoid collisions.
Catch IO specific exceptions when trying to write the config files.
Added test to assert that no config file is written when the update command is not set up but the config dir is.
Lucas Di Pentima [Tue, 4 Apr 2017 21:08:39 +0000 (18:08 -0300)]
7824: Added test cases.
radhika [Tue, 4 Apr 2017 20:48:12 +0000 (16:48 -0400)]
8465: added stdin redirection for collection
Peter Amstutz [Tue, 4 Apr 2017 18:03:08 +0000 (14:03 -0400)]
11413: Use getattr() in exception handler.
Tom Clegg [Tue, 4 Apr 2017 17:12:23 +0000 (13:12 -0400)]
11308: Create missing temp dir. Unset proxy env during tests.
Tom Clegg [Tue, 4 Apr 2017 17:11:41 +0000 (13:11 -0400)]
11308: Remove obsolete test setup steps.
Peter Amstutz [Tue, 4 Apr 2017 15:40:58 +0000 (11:40 -0400)]
11413: Wrap destroy_node with similar logic to create_node: on exception check
the node list to determine if the node was actually destroyed successfully.
Tom Clegg [Tue, 4 Apr 2017 15:39:30 +0000 (11:39 -0400)]
Merge branch '11100-cr-output-ttl'
refs #11100
Peter Amstutz [Tue, 4 Apr 2017 15:21:57 +0000 (11:21 -0400)]
11413: Fix issues with node manager on GCE:
* Always override Node.size with CloudSizeWrapper
* Get updated node record before setting metadata to minimize 'Supplied
fingerprint does not match current metadata fingerprint.' error.
* Use ex_set_node_metadata() instead of issuing request directly.
Tom Clegg [Tue, 4 Apr 2017 06:39:44 +0000 (02:39 -0400)]
11308: Fix key order sensitivity.
Tom Clegg [Tue, 4 Apr 2017 01:50:54 +0000 (21:50 -0400)]
11308: Update assertion to accommodate different exception in py3.
Tom Clegg [Tue, 4 Apr 2017 01:50:30 +0000 (21:50 -0400)]
11308: Add stderr assertion for easier debugging.
Tom Clegg [Mon, 3 Apr 2017 21:45:30 +0000 (17:45 -0400)]
11308: Fix keepstub bugs and Python 3 compatibility.
Tom Clegg [Mon, 3 Apr 2017 21:36:54 +0000 (17:36 -0400)]
11308: pep8
Tom Clegg [Mon, 3 Apr 2017 05:06:08 +0000 (01:06 -0400)]
11308: Close socket after pycurl.
Tom Clegg [Sun, 2 Apr 2017 23:40:26 +0000 (19:40 -0400)]
11308: Expect full class name in traceback.
Tom Clegg [Sun, 2 Apr 2017 23:11:06 +0000 (19:11 -0400)]
11308: assertRegexpMatches -> assertRegex
Tom Clegg [Sun, 2 Apr 2017 20:28:46 +0000 (16:28 -0400)]
11308: Fix traceback.format_exc() usage.
Tom Clegg [Sun, 2 Apr 2017 05:26:36 +0000 (01:26 -0400)]
11308: Fix string/bytes confusion for Python 3
Lucas Di Pentima [Mon, 3 Apr 2017 21:16:08 +0000 (18:16 -0300)]
7824: Now a subdirectory can be asked to be listed. Also, enhanced error message when asking for a non existant collection.
Lucas Di Pentima [Mon, 3 Apr 2017 20:45:34 +0000 (17:45 -0300)]
7824: Several improvements:
* Added error reporting on cases where the user ask for downloading a nonexisting file/subdir inside a collection.
* Enhanced error message when the user ask to download a non existing collection.
* Improved the collection traversal when downloading a subcollection.
* Exit with an error message when asking for a subcollection name without the trailing '/'.
* Error out if asking to get a subcollection with '-' as destination.
* Test updated.
Peter Amstutz [Mon, 3 Apr 2017 20:21:28 +0000 (16:21 -0400)]
Merge branch '11407-go-sdk-debug' closes #11407
Peter Amstutz [Mon, 3 Apr 2017 19:26:50 +0000 (15:26 -0400)]
11407: keepclient checks for ARVADOS_DEBUG and enables debugging.
Lucas Di Pentima [Mon, 3 Apr 2017 18:07:48 +0000 (15:07 -0300)]
7824: Log errors when trying to read the collection specified.
Lucas Di Pentima [Mon, 3 Apr 2017 17:52:36 +0000 (14:52 -0300)]
7824: Closing file when finished writing
Tom Clegg [Sun, 2 Apr 2017 07:19:11 +0000 (03:19 -0400)]
11308: run-tests --skip python2
Tom Clegg [Sat, 1 Apr 2017 22:00:33 +0000 (18:00 -0400)]
11308: Fix deprecated logger.warn -> logger.warning.
Tom Clegg [Sat, 1 Apr 2017 21:52:05 +0000 (17:52 -0400)]
11308: md5 -> hashlib.
Tom Clegg [Sat, 1 Apr 2017 06:36:46 +0000 (02:36 -0400)]
11308: Fix bytes vs. str problems.
Tom Clegg [Sat, 1 Apr 2017 06:36:08 +0000 (02:36 -0400)]
11308: Fix variable name conflict.
Tom Clegg [Sat, 1 Apr 2017 06:11:08 +0000 (02:11 -0400)]
11308: Eliminate old_div().
Tom Clegg [Sat, 1 Apr 2017 21:37:23 +0000 (17:37 -0400)]
11308: Import future module.
Tom Clegg [Sat, 1 Apr 2017 05:49:09 +0000 (01:49 -0400)]
11308: Update python-gflags.
Tom Clegg [Sat, 1 Apr 2017 05:48:37 +0000 (01:48 -0400)]
11308: md5 to hashlib.
Tom Clegg [Sat, 1 Apr 2017 05:48:02 +0000 (01:48 -0400)]
11308: UserDict to Python 3.