Brett Smith [Sun, 10 Jan 2016 03:34:18 +0000 (22:34 -0500)]
7991: pip build process detects if --no-use-wheel is supported.
Refs #7991.
Brett Smith [Sun, 10 Jan 2016 03:33:34 +0000 (22:33 -0500)]
7991: Update error message for pip build errors.
Refs #7991.
Brett Smith [Fri, 8 Jan 2016 22:20:05 +0000 (17:20 -0500)]
Merge branch '7991-google-api-python-client-perms-wip'
Closes #7991, #8136.
Brett Smith [Fri, 8 Jan 2016 20:58:28 +0000 (15:58 -0500)]
7991: Fix permissions of google-api-python-client egg info files.
Ward Vandewege [Thu, 7 Jan 2016 00:38:28 +0000 (19:38 -0500)]
Make sure not to silence package installation during the test-packages
stage, so that we can see actual failure messages if there is a problem.
No issue #
Brett Smith [Wed, 6 Jan 2016 14:36:14 +0000 (09:36 -0500)]
8104: Pin the pycurl backport version.
Refs #8104.
Tom Clegg [Mon, 14 Dec 2015 21:56:28 +0000 (16:56 -0500)]
Merge branch '7901-crunchstat-summary' refs #7901
Tom Clegg [Thu, 10 Dec 2015 21:00:17 +0000 (16:00 -0500)]
7901: Add crunchstat-summary
Brett Smith [Thu, 10 Dec 2015 20:52:32 +0000 (15:52 -0500)]
7961: SSO postinst script uses bash.
Closes #7961.
Brett Smith [Wed, 9 Dec 2015 17:43:58 +0000 (12:43 -0500)]
7953: Update test procedure for CentOS 6 packages.
Don't install any Software Collections in the Dockerfile, just the
Software Collections tools. Test that our packages correctly declare
their dependency on the relevant Software Collection, and that it gets
pulled in. We want to tell users to install this way, so this makes
sure it's working.
Refs #7953, #7957.
Brett Smith [Tue, 8 Dec 2015 01:55:59 +0000 (20:55 -0500)]
Merge branch '7829-package-licenses-wip'
Refs #7829. Closes #7913.
Brett Smith [Mon, 7 Dec 2015 20:36:32 +0000 (15:36 -0500)]
7829: Add licenses to Arvados software packages.
Brett Smith [Mon, 7 Dec 2015 20:31:09 +0000 (15:31 -0500)]
7953: Fix Docker image to test CentOS 6.6 packages.
Follows the same rationale as
bebf531a2cb9cf08843d6ac4d4ae2238d58efc2b.
Refs #7953.
Brett Smith [Mon, 7 Dec 2015 17:00:29 +0000 (12:00 -0500)]
Merge branch '7953-centos-scl-fix-wip'
Refs #7953. Closes #7955.
Brett Smith [Mon, 7 Dec 2015 15:06:02 +0000 (10:06 -0500)]
7953: Fix Docker image to build CentOS 6.6 packages.
* Follow the Software Collections documentation at
<https://wiki.centos.org/AdditionalResources/Repositories/SCL>.
This downgrades us to Python 3.3, but that shouldn't be a
problem, since we test and build packages for Debian 7 which uses
Python 3.2. On the plus side, it removes an external dependency
on softwarecollections.org.
* The python-pip package disappeared. I don't know where it went.
Maybe there were changes to the underlying centos:6 Docker image?
Install it manually.
Ward Vandewege [Fri, 4 Dec 2015 15:14:22 +0000 (10:14 -0500)]
Default run-deploy.sh to ssh port 22, and provide a command line option
to change the port.
No issue #
radhika [Wed, 2 Dec 2015 17:51:10 +0000 (12:51 -0500)]
refs #7710
Merge branch '7710-add-go-sdk-crunchrunner'
Brett Smith [Tue, 1 Dec 2015 22:13:20 +0000 (17:13 -0500)]
7839: Stop backporting requests for Python 2.
This is no longer needed now that our Keep client is built on top of
pycurl. Confirmed by building all our Python packages from source
into a fresh virtualenv. requests does not appear in `pip freeze`.
requests is still needed for Python 3 because docker-py uses it.
Closes #7839.
radhika [Tue, 1 Dec 2015 18:35:41 +0000 (13:35 -0500)]
7710: add crunchrunner to gostuff
radhika [Thu, 26 Nov 2015 15:45:53 +0000 (10:45 -0500)]
refs #7253
Merge branch '7253-add-go-sdk-manifest'
radhika [Thu, 26 Nov 2015 05:53:55 +0000 (00:53 -0500)]
Merge branch 'master' into 7253-add-go-sdk-manifest
radhika [Wed, 25 Nov 2015 22:19:04 +0000 (17:19 -0500)]
7253: add sdk/go/blockdigest to gostuff
Tom Clegg [Wed, 25 Nov 2015 20:05:20 +0000 (15:05 -0500)]
Force pbr<1.7.0 when installing mock.
No issue #
radhika [Wed, 25 Nov 2015 15:21:50 +0000 (10:21 -0500)]
7253: add sdk/go/manifest to gostuff
radhika [Mon, 23 Nov 2015 19:18:55 +0000 (14:18 -0500)]
refs #7490
Merge branch '7490-datamanager-test'
radhika [Thu, 12 Nov 2015 18:06:27 +0000 (13:06 -0500)]
7490: add services/datamanager/keep to gostuff
Tom Clegg [Wed, 11 Nov 2015 17:14:51 +0000 (12:14 -0500)]
Merge branch '5824-keep-web-workbench' refs #5824
Peter Amstutz [Wed, 11 Nov 2015 14:20:36 +0000 (09:20 -0500)]
Merge branch '7593-arvados-cwl-runner' refs #7593
Tom Clegg [Tue, 10 Nov 2015 02:18:12 +0000 (21:18 -0500)]
Merge branch '7722-build-keep-rsync' closes #7722
Nico Cesar [Mon, 9 Nov 2015 21:48:34 +0000 (16:48 -0500)]
Merge branch '7591-httplib2-perms-fix-wip'
refs #7591
Brett Smith [Sat, 7 Nov 2015 16:49:17 +0000 (11:49 -0500)]
7591: Workaround bad permissions in the httplib2 backport.
Tom Clegg [Fri, 6 Nov 2015 21:55:38 +0000 (16:55 -0500)]
5824: Merge branch 'master' into 5824-keep-web-workbench
Tom Clegg [Fri, 6 Nov 2015 17:41:24 +0000 (12:41 -0500)]
Add libwww-perl and python mock dependencies, so tests can run on ubuntu 14.04
If we let setuptools install mock for us (because it's listed in
tests_require), "python setup.py test" fails:
running test
Searching for mock>=1.0
Best match: mock 1.3.0
Processing mock-1.3.0-py2.7.egg
Using /tmp/arvados/sdk/python/.eggs/mock-1.3.0-py2.7.egg
Traceback (most recent call last):
File "setup.py", line 49, in <module>
cmdclass={'egg_info': tagger},
[...]
File "/tmp/.cache/arvados-build/VENVDIR/local/lib/python2.7/site-packages/pkg_resources/__init__.py", line 2910, in scan_list
raise RequirementParseError(msg, line, "at", line[p:])
pkg_resources.RequirementParseError: Expected version spec in funcsigs;python_version<"3.3" at ;python_version<"3.3
No issue #
Tom Clegg [Thu, 5 Nov 2015 06:19:13 +0000 (01:19 -0500)]
7722: Build keep-rsync package. Deduplicate go->fpm recipe.
Ward Vandewege [Wed, 4 Nov 2015 14:50:42 +0000 (09:50 -0500)]
arvados-api-server-upgrade.sh fix: do not try to chmod the cache
directory if it doesn't exist. This avoids an error on fresh install.
Rails will create the cache directory if it doesn't exist.
No issue #
Tom Clegg [Wed, 4 Nov 2015 04:54:39 +0000 (23:54 -0500)]
Merge branch '5824-keep-web'
refs #5824
Tom Clegg [Sat, 17 Oct 2015 07:02:03 +0000 (03:02 -0400)]
5824: Start keep-web service for Workbench integration tests.
Tom Clegg [Wed, 4 Nov 2015 04:50:44 +0000 (23:50 -0500)]
5824: Add services/keep-web
Peter Amstutz [Thu, 29 Oct 2015 16:28:15 +0000 (12:28 -0400)]
Remove unnecessary yum update. touch RPM database to work around overlayfs bug.
refs #7370
Peter Amstutz [Thu, 29 Oct 2015 15:55:03 +0000 (11:55 -0400)]
Obsoleted by run-build-packages-all-targets.sh --test-packages refs #7370
Nico Cesar [Thu, 29 Oct 2015 15:42:37 +0000 (11:42 -0400)]
reverted hkp port 80 explicitly
no issue #
Ward Vandewege [Wed, 28 Oct 2015 21:21:06 +0000 (17:21 -0400)]
Make sure that the CentOS 6 test script actually does the yum update call.
refs #7370
Peter Amstutz [Wed, 28 Oct 2015 15:26:29 +0000 (11:26 -0400)]
7593: Add sdk/cwl to package building.
Ward Vandewege [Tue, 27 Oct 2015 19:16:17 +0000 (15:16 -0400)]
Add python-pip to the Arvados build images.
this is a dependency for #7591 (refs #7591)
Nico Cesar [Tue, 27 Oct 2015 15:14:16 +0000 (11:14 -0400)]
hkp://pool.sks-keyservers.net:80 is needed to use the transaparent proxy
no issue #
Ward Vandewege [Sat, 24 Oct 2015 02:24:51 +0000 (22:24 -0400)]
Fix path issue when running run-build-packages-all-targets.sh from
another directory.
refs #7370
Ward Vandewege [Fri, 23 Oct 2015 20:31:18 +0000 (16:31 -0400)]
Make sure bundle is installed in arvados-api-server-upgrade.sh,
arvados-workbench-upgrade.sh and arvados-sso-server.postinst
No issue #
Peter Amstutz [Fri, 23 Oct 2015 14:29:02 +0000 (10:29 -0400)]
Merge branch '7370-package-install-testing' closes #7370
Ward Vandewege [Wed, 21 Oct 2015 01:18:23 +0000 (21:18 -0400)]
Shut up dpkg-scanpackages warnings.
refs #7370
Brett Smith [Mon, 19 Oct 2015 16:53:20 +0000 (12:53 -0400)]
Backport pbr < 1.0 on CentOS 6.
The lockfile backport grew a dependency on pbr < 1.0 in their version
0.11. No issue #.
Peter Amstutz [Fri, 16 Oct 2015 18:29:57 +0000 (14:29 -0400)]
7370: run-build-packages-all-targets hands off to run-build-packages-one-target, suppports --test-packages option.
Peter Amstutz [Thu, 15 Oct 2015 20:40:54 +0000 (16:40 -0400)]
7370: Fix centos6 package builder container.
Peter Amstutz [Thu, 15 Oct 2015 20:24:07 +0000 (16:24 -0400)]
Merge branch 'master' into 7370-package-install-testing
Conflicts:
jenkins/run-build-packages-one-target.sh
Peter Amstutz [Thu, 15 Oct 2015 20:21:56 +0000 (16:21 -0400)]
7370: Refactoring way the package test is set up and executed.
radhika [Thu, 15 Oct 2015 16:38:41 +0000 (12:38 -0400)]
refs #7167
Merge branch '7167-keep-rsync-test-setup'
radhika [Thu, 15 Oct 2015 16:36:16 +0000 (12:36 -0400)]
Merge branch 'master' into 7167-keep-rsync-test-setup
Brett Smith [Thu, 15 Oct 2015 15:57:43 +0000 (11:57 -0400)]
Merge branch '7341-deploy-retries-puppet-agent-wip'
Closes #7341, #7549.
Peter Amstutz [Thu, 15 Oct 2015 14:40:17 +0000 (10:40 -0400)]
Merge branch 'master' into 7370-package-install-testing
Brett Smith [Wed, 14 Oct 2015 22:18:58 +0000 (18:18 -0400)]
7341: run-deploy.sh retries failed Puppet agent runs.
It simply keeps retrying any failure until ten minutes have passed,
per Nico's suggestion in the comments.
Bonus bugfix: make sure run_puppet's ECODE variable gets set to the
exit status of Puppet (or the wrapper script), and not tee.
Ward Vandewege [Tue, 13 Oct 2015 14:18:55 +0000 (10:18 -0400)]
Make sure to run the arvados-api-server-upgrade.sh and
arvados-workbench-upgrade.sh scripts in the RVM environment in
run-deploy.sh.
no issue #
Ward Vandewege [Fri, 9 Oct 2015 17:09:20 +0000 (13:09 -0400)]
Make it possible to pass --debug through to the script run inside the Docker
build containers.
No issue #
Ward Vandewege [Fri, 9 Oct 2015 17:02:39 +0000 (13:02 -0400)]
Ensure proper permissions on /usr/local/arvados/src in the arvados-src package.
refs #7397
radhika [Fri, 9 Oct 2015 14:36:48 +0000 (10:36 -0400)]
Merge branch 'master' into 7167-keep-rsync-test-setup
Nico Cesar [Wed, 7 Oct 2015 14:09:16 +0000 (10:09 -0400)]
7460: c97qk doesnt need mailchimp deployed. this caused deploy to fail in Ubuntu
refs #7460
Peter Amstutz [Wed, 7 Oct 2015 14:07:25 +0000 (10:07 -0400)]
Run CWL tests for both draft-2 and draft-3. No issue #
Peter Amstutz [Wed, 7 Oct 2015 14:02:43 +0000 (10:02 -0400)]
Update cwl builder process for repository reorganization. No issue #
Peter Amstutz [Mon, 5 Oct 2015 18:21:04 +0000 (14:21 -0400)]
Update pin of libcloud fork to dev4 refs #7286
Brett Smith [Mon, 5 Oct 2015 17:14:00 +0000 (13:14 -0400)]
Merge branch '7451-dont-recreate-venv3dir-wip'
Refs #7451. Closes #7452.
Brett Smith [Mon, 5 Oct 2015 16:53:42 +0000 (12:53 -0400)]
7451: Improve virtualenv setup in run-tests.sh.
The code to build the Python 3 virtualenv didn't check to see whether
the virtualenv already existed first. When reusing a Python 3
virtualenv, pip would get downgraded and start failing.
Refactor the virtualenv setup code to avoid this duplication and these
sorts of bugs.
While I was at it: rather than trying to parse package versions
ourselves to figure out when to upgrade setuptools and pip, just tell
pip the versions we want. 'pip>=7' is an approximation of what we're
currently doing. The main thing we care about is that we get a
version new enough to work with setuptools 18.
Tom Clegg [Mon, 5 Oct 2015 16:48:56 +0000 (12:48 -0400)]
Fix incorrect line numbers on compile errors reported by "go test" in coverage mode. No issue #
radhika [Mon, 5 Oct 2015 11:37:48 +0000 (07:37 -0400)]
7167: add keep-rsync to gostuff.
Brett Smith [Wed, 30 Sep 2015 15:11:59 +0000 (11:11 -0400)]
7356: CentOS 6 needs a Python 3 backport for websocket-client.
Refs #7356.
Ward Vandewege [Tue, 29 Sep 2015 17:49:35 +0000 (13:49 -0400)]
Merge branch '7330-postinst-for-sso-server'
refs #7330
Ward Vandewege [Tue, 29 Sep 2015 01:00:32 +0000 (21:00 -0400)]
More fixes for the SSO server packages.
refs #7330
Ward Vandewege [Mon, 28 Sep 2015 21:42:58 +0000 (17:42 -0400)]
A number of additional tweaks.
refs #7330
Ward Vandewege [Mon, 28 Sep 2015 04:23:16 +0000 (00:23 -0400)]
Add support for CentOS6 to the improved SSO packages.
refs #7330
Ward Vandewege [Sun, 27 Sep 2015 19:59:56 +0000 (15:59 -0400)]
Initial version of run-test-packages-sso.sh
refs #7330
Ward Vandewege [Sun, 27 Sep 2015 19:29:15 +0000 (15:29 -0400)]
Remove bash-ism from arvados-sso-server.postinst.
refs #7330
Ward Vandewege [Sun, 27 Sep 2015 15:22:32 +0000 (11:22 -0400)]
Add prerm and postrm scripts, various cleanups.
refs #7330
Ward Vandewege [Sat, 26 Sep 2015 01:42:29 +0000 (21:42 -0400)]
First commit.
refs #7330
Ward Vandewege [Fri, 25 Sep 2015 16:05:33 +0000 (12:05 -0400)]
Fix the test that avoids running puppet multiple times on installations
where workbench runs on the API server.
No issue #
Brett Smith [Thu, 24 Sep 2015 16:01:20 +0000 (12:01 -0400)]
7322: Don't backport virtualenv for Arvados.
The Arvados code only needs virtualenv 1.7, which is provided with all
of our supported distros.
run-tests.sh requires 1.8.3 to use the --setuptools switch, but that
can be handled without publishing a backported package.
Refs #7322.
Peter Amstutz [Wed, 23 Sep 2015 17:02:43 +0000 (13:02 -0400)]
Merge branch '7228-group-writable-tmp-cache' refs #7228
Peter Amstutz [Wed, 23 Sep 2015 13:09:25 +0000 (09:09 -0400)]
7228: Add chmod -R 2775 $RELEASE_PATH/tmp/cache/ so that cache is group writable.
Ward Vandewege [Mon, 21 Sep 2015 20:56:57 +0000 (16:56 -0400)]
Make the build step for our libcloud package a lot less noisy by default.
No issue #
Brett Smith [Wed, 16 Sep 2015 20:33:28 +0000 (16:33 -0400)]
Close unclosed quotes in arvados-api-server-upgrade.sh.
No issue #.
Brett Smith [Wed, 16 Sep 2015 19:25:40 +0000 (15:25 -0400)]
Merge branch 'pr/1'
Closes #7261.
radhika [Mon, 14 Sep 2015 22:56:43 +0000 (18:56 -0400)]
refs #6260
Merge branch '6260-test-datamanager'
radhika [Mon, 14 Sep 2015 22:53:16 +0000 (18:53 -0400)]
6260: since datamanager no longer needs the data-manager-token-file (only keep server does), remove the run-tests.sh update for this.
Tom Clegg [Sat, 12 Sep 2015 02:25:30 +0000 (22:25 -0400)]
Merge branch '7311-temp-base' closes #7311
Tom Clegg [Fri, 11 Sep 2015 21:04:53 +0000 (17:04 -0400)]
7311: Do not forget to make temp dirs.
Tom Clegg [Fri, 11 Sep 2015 14:44:16 +0000 (10:44 -0400)]
7311: Make recognizable temp dirs under a single base; allow override with --temp DIR
Joshua C. Randall [Thu, 10 Sep 2015 20:20:04 +0000 (20:20 +0000)]
Adds setuptools/pip upgrade in python3 virtualenv
Moves ruby environment setup to after python3 virtualenv
setup, because otherwise activating the python3 virtualenv
breaks ruby.
Peter Amstutz [Wed, 9 Sep 2015 15:42:39 +0000 (11:42 -0400)]
Add libcloud-pin and update to dev3 refs #7031
radhika [Tue, 8 Sep 2015 21:26:12 +0000 (17:26 -0400)]
6260: append to testargs, instead of replacing.
radhika [Tue, 8 Sep 2015 16:34:54 +0000 (12:34 -0400)]
Merge branch 'master' into 6260-test-datamanager
Peter Amstutz [Tue, 8 Sep 2015 13:44:21 +0000 (09:44 -0400)]
Merge branch '7031-build-forked-libcloud' refs #7031
Peter Amstutz [Tue, 8 Sep 2015 13:43:20 +0000 (09:43 -0400)]
Merge branch 'master' into 7031-build-forked-libcloud
Tom Clegg [Mon, 7 Sep 2015 18:13:18 +0000 (14:13 -0400)]
Merge branch '6263-go-coverage' refs #6263
Tom Clegg [Mon, 7 Sep 2015 18:10:53 +0000 (14:10 -0400)]
Merge branch '6263-gitolite-test' refs #6263
projects / arvados-dev.git / log