Tom Clegg [Fri, 6 Nov 2015 21:55:38 +0000 (16:55 -0500)]
5824: Merge branch 'master' into 5824-keep-web-workbench
Tom Clegg [Fri, 6 Nov 2015 17:41:24 +0000 (12:41 -0500)]
Add libwww-perl and python mock dependencies, so tests can run on ubuntu 14.04
If we let setuptools install mock for us (because it's listed in
tests_require), "python setup.py test" fails:
running test
Searching for mock>=1.0
Best match: mock 1.3.0
Processing mock-1.3.0-py2.7.egg
Using /tmp/arvados/sdk/python/.eggs/mock-1.3.0-py2.7.egg
Traceback (most recent call last):
File "setup.py", line 49, in <module>
cmdclass={'egg_info': tagger},
[...]
File "/tmp/.cache/arvados-build/VENVDIR/local/lib/python2.7/site-packages/pkg_resources/__init__.py", line 2910, in scan_list
raise RequirementParseError(msg, line, "at", line[p:])
pkg_resources.RequirementParseError: Expected version spec in funcsigs;python_version<"3.3" at ;python_version<"3.3
No issue #
Ward Vandewege [Wed, 4 Nov 2015 14:50:42 +0000 (09:50 -0500)]
arvados-api-server-upgrade.sh fix: do not try to chmod the cache
directory if it doesn't exist. This avoids an error on fresh install.
Rails will create the cache directory if it doesn't exist.
No issue #
Tom Clegg [Wed, 4 Nov 2015 04:54:39 +0000 (23:54 -0500)]
Merge branch '5824-keep-web'
refs #5824
Tom Clegg [Sat, 17 Oct 2015 07:02:03 +0000 (03:02 -0400)]
5824: Start keep-web service for Workbench integration tests.
Tom Clegg [Wed, 4 Nov 2015 04:50:44 +0000 (23:50 -0500)]
5824: Add services/keep-web
Peter Amstutz [Thu, 29 Oct 2015 16:28:15 +0000 (12:28 -0400)]
Remove unnecessary yum update. touch RPM database to work around overlayfs bug.
refs #7370
Peter Amstutz [Thu, 29 Oct 2015 15:55:03 +0000 (11:55 -0400)]
Obsoleted by run-build-packages-all-targets.sh --test-packages refs #7370
Nico Cesar [Thu, 29 Oct 2015 15:42:37 +0000 (11:42 -0400)]
reverted hkp port 80 explicitly
no issue #
Ward Vandewege [Wed, 28 Oct 2015 21:21:06 +0000 (17:21 -0400)]
Make sure that the CentOS 6 test script actually does the yum update call.
refs #7370
Ward Vandewege [Tue, 27 Oct 2015 19:16:17 +0000 (15:16 -0400)]
Add python-pip to the Arvados build images.
this is a dependency for #7591 (refs #7591)
Nico Cesar [Tue, 27 Oct 2015 15:14:16 +0000 (11:14 -0400)]
hkp://pool.sks-keyservers.net:80 is needed to use the transaparent proxy
no issue #
Ward Vandewege [Sat, 24 Oct 2015 02:24:51 +0000 (22:24 -0400)]
Fix path issue when running run-build-packages-all-targets.sh from
another directory.
refs #7370
Ward Vandewege [Fri, 23 Oct 2015 20:31:18 +0000 (16:31 -0400)]
Make sure bundle is installed in arvados-api-server-upgrade.sh,
arvados-workbench-upgrade.sh and arvados-sso-server.postinst
No issue #
Peter Amstutz [Fri, 23 Oct 2015 14:29:02 +0000 (10:29 -0400)]
Merge branch '7370-package-install-testing' closes #7370
Ward Vandewege [Wed, 21 Oct 2015 01:18:23 +0000 (21:18 -0400)]
Shut up dpkg-scanpackages warnings.
refs #7370
Brett Smith [Mon, 19 Oct 2015 16:53:20 +0000 (12:53 -0400)]
Backport pbr < 1.0 on CentOS 6.
The lockfile backport grew a dependency on pbr < 1.0 in their version
0.11. No issue #.
Peter Amstutz [Fri, 16 Oct 2015 18:29:57 +0000 (14:29 -0400)]
7370: run-build-packages-all-targets hands off to run-build-packages-one-target, suppports --test-packages option.
Peter Amstutz [Thu, 15 Oct 2015 20:40:54 +0000 (16:40 -0400)]
7370: Fix centos6 package builder container.
Peter Amstutz [Thu, 15 Oct 2015 20:24:07 +0000 (16:24 -0400)]
Merge branch 'master' into 7370-package-install-testing
Conflicts:
jenkins/run-build-packages-one-target.sh
Peter Amstutz [Thu, 15 Oct 2015 20:21:56 +0000 (16:21 -0400)]
7370: Refactoring way the package test is set up and executed.
radhika [Thu, 15 Oct 2015 16:38:41 +0000 (12:38 -0400)]
refs #7167
Merge branch '7167-keep-rsync-test-setup'
radhika [Thu, 15 Oct 2015 16:36:16 +0000 (12:36 -0400)]
Merge branch 'master' into 7167-keep-rsync-test-setup
Brett Smith [Thu, 15 Oct 2015 15:57:43 +0000 (11:57 -0400)]
Merge branch '7341-deploy-retries-puppet-agent-wip'
Closes #7341, #7549.
Peter Amstutz [Thu, 15 Oct 2015 14:40:17 +0000 (10:40 -0400)]
Merge branch 'master' into 7370-package-install-testing
Brett Smith [Wed, 14 Oct 2015 22:18:58 +0000 (18:18 -0400)]
7341: run-deploy.sh retries failed Puppet agent runs.
It simply keeps retrying any failure until ten minutes have passed,
per Nico's suggestion in the comments.
Bonus bugfix: make sure run_puppet's ECODE variable gets set to the
exit status of Puppet (or the wrapper script), and not tee.
Ward Vandewege [Tue, 13 Oct 2015 14:18:55 +0000 (10:18 -0400)]
Make sure to run the arvados-api-server-upgrade.sh and
arvados-workbench-upgrade.sh scripts in the RVM environment in
run-deploy.sh.
no issue #
Ward Vandewege [Fri, 9 Oct 2015 17:09:20 +0000 (13:09 -0400)]
Make it possible to pass --debug through to the script run inside the Docker
build containers.
No issue #
Ward Vandewege [Fri, 9 Oct 2015 17:02:39 +0000 (13:02 -0400)]
Ensure proper permissions on /usr/local/arvados/src in the arvados-src package.
refs #7397
radhika [Fri, 9 Oct 2015 14:36:48 +0000 (10:36 -0400)]
Merge branch 'master' into 7167-keep-rsync-test-setup
Nico Cesar [Wed, 7 Oct 2015 14:09:16 +0000 (10:09 -0400)]
7460: c97qk doesnt need mailchimp deployed. this caused deploy to fail in Ubuntu
refs #7460
Peter Amstutz [Wed, 7 Oct 2015 14:07:25 +0000 (10:07 -0400)]
Run CWL tests for both draft-2 and draft-3. No issue #
Peter Amstutz [Wed, 7 Oct 2015 14:02:43 +0000 (10:02 -0400)]
Update cwl builder process for repository reorganization. No issue #
Peter Amstutz [Mon, 5 Oct 2015 18:21:04 +0000 (14:21 -0400)]
Update pin of libcloud fork to dev4 refs #7286
Brett Smith [Mon, 5 Oct 2015 17:14:00 +0000 (13:14 -0400)]
Merge branch '7451-dont-recreate-venv3dir-wip'
Refs #7451. Closes #7452.
Brett Smith [Mon, 5 Oct 2015 16:53:42 +0000 (12:53 -0400)]
7451: Improve virtualenv setup in run-tests.sh.
The code to build the Python 3 virtualenv didn't check to see whether
the virtualenv already existed first. When reusing a Python 3
virtualenv, pip would get downgraded and start failing.
Refactor the virtualenv setup code to avoid this duplication and these
sorts of bugs.
While I was at it: rather than trying to parse package versions
ourselves to figure out when to upgrade setuptools and pip, just tell
pip the versions we want. 'pip>=7' is an approximation of what we're
currently doing. The main thing we care about is that we get a
version new enough to work with setuptools 18.
Tom Clegg [Mon, 5 Oct 2015 16:48:56 +0000 (12:48 -0400)]
Fix incorrect line numbers on compile errors reported by "go test" in coverage mode. No issue #
radhika [Mon, 5 Oct 2015 11:37:48 +0000 (07:37 -0400)]
7167: add keep-rsync to gostuff.
Brett Smith [Wed, 30 Sep 2015 15:11:59 +0000 (11:11 -0400)]
7356: CentOS 6 needs a Python 3 backport for websocket-client.
Refs #7356.
Ward Vandewege [Tue, 29 Sep 2015 17:49:35 +0000 (13:49 -0400)]
Merge branch '7330-postinst-for-sso-server'
refs #7330
Ward Vandewege [Tue, 29 Sep 2015 01:00:32 +0000 (21:00 -0400)]
More fixes for the SSO server packages.
refs #7330
Ward Vandewege [Mon, 28 Sep 2015 21:42:58 +0000 (17:42 -0400)]
A number of additional tweaks.
refs #7330
Ward Vandewege [Mon, 28 Sep 2015 04:23:16 +0000 (00:23 -0400)]
Add support for CentOS6 to the improved SSO packages.
refs #7330
Ward Vandewege [Sun, 27 Sep 2015 19:59:56 +0000 (15:59 -0400)]
Initial version of run-test-packages-sso.sh
refs #7330
Ward Vandewege [Sun, 27 Sep 2015 19:29:15 +0000 (15:29 -0400)]
Remove bash-ism from arvados-sso-server.postinst.
refs #7330
Ward Vandewege [Sun, 27 Sep 2015 15:22:32 +0000 (11:22 -0400)]
Add prerm and postrm scripts, various cleanups.
refs #7330
Ward Vandewege [Sat, 26 Sep 2015 01:42:29 +0000 (21:42 -0400)]
First commit.
refs #7330
Ward Vandewege [Fri, 25 Sep 2015 16:05:33 +0000 (12:05 -0400)]
Fix the test that avoids running puppet multiple times on installations
where workbench runs on the API server.
No issue #
Brett Smith [Thu, 24 Sep 2015 16:01:20 +0000 (12:01 -0400)]
7322: Don't backport virtualenv for Arvados.
The Arvados code only needs virtualenv 1.7, which is provided with all
of our supported distros.
run-tests.sh requires 1.8.3 to use the --setuptools switch, but that
can be handled without publishing a backported package.
Refs #7322.
Peter Amstutz [Wed, 23 Sep 2015 17:02:43 +0000 (13:02 -0400)]
Merge branch '7228-group-writable-tmp-cache' refs #7228
Peter Amstutz [Wed, 23 Sep 2015 13:09:25 +0000 (09:09 -0400)]
7228: Add chmod -R 2775 $RELEASE_PATH/tmp/cache/ so that cache is group writable.
Ward Vandewege [Mon, 21 Sep 2015 20:56:57 +0000 (16:56 -0400)]
Make the build step for our libcloud package a lot less noisy by default.
No issue #
Brett Smith [Wed, 16 Sep 2015 20:33:28 +0000 (16:33 -0400)]
Close unclosed quotes in arvados-api-server-upgrade.sh.
No issue #.
Brett Smith [Wed, 16 Sep 2015 19:25:40 +0000 (15:25 -0400)]
Merge branch 'pr/1'
Closes #7261.
radhika [Mon, 14 Sep 2015 22:56:43 +0000 (18:56 -0400)]
refs #6260
Merge branch '6260-test-datamanager'
radhika [Mon, 14 Sep 2015 22:53:16 +0000 (18:53 -0400)]
6260: since datamanager no longer needs the data-manager-token-file (only keep server does), remove the run-tests.sh update for this.
Tom Clegg [Sat, 12 Sep 2015 02:25:30 +0000 (22:25 -0400)]
Merge branch '7311-temp-base' closes #7311
Tom Clegg [Fri, 11 Sep 2015 21:04:53 +0000 (17:04 -0400)]
7311: Do not forget to make temp dirs.
Tom Clegg [Fri, 11 Sep 2015 14:44:16 +0000 (10:44 -0400)]
7311: Make recognizable temp dirs under a single base; allow override with --temp DIR
Joshua C. Randall [Thu, 10 Sep 2015 20:20:04 +0000 (20:20 +0000)]
Adds setuptools/pip upgrade in python3 virtualenv
Moves ruby environment setup to after python3 virtualenv
setup, because otherwise activating the python3 virtualenv
breaks ruby.
Peter Amstutz [Wed, 9 Sep 2015 15:42:39 +0000 (11:42 -0400)]
Add libcloud-pin and update to dev3 refs #7031
radhika [Tue, 8 Sep 2015 21:26:12 +0000 (17:26 -0400)]
6260: append to testargs, instead of replacing.
radhika [Tue, 8 Sep 2015 16:34:54 +0000 (12:34 -0400)]
Merge branch 'master' into 6260-test-datamanager
Peter Amstutz [Tue, 8 Sep 2015 13:44:21 +0000 (09:44 -0400)]
Merge branch '7031-build-forked-libcloud' refs #7031
Peter Amstutz [Tue, 8 Sep 2015 13:43:20 +0000 (09:43 -0400)]
Merge branch 'master' into 7031-build-forked-libcloud
Tom Clegg [Mon, 7 Sep 2015 18:13:18 +0000 (14:13 -0400)]
Merge branch '6263-go-coverage' refs #6263
Tom Clegg [Mon, 7 Sep 2015 18:10:53 +0000 (14:10 -0400)]
Merge branch '6263-gitolite-test' refs #6263
Ward Vandewege [Fri, 4 Sep 2015 15:04:17 +0000 (11:04 -0400)]
Make sure the library can always be found.
No issue #
Peter Amstutz [Fri, 4 Sep 2015 14:00:23 +0000 (10:00 -0400)]
Bump version to dev2
Peter Amstutz [Mon, 31 Aug 2015 18:10:53 +0000 (14:10 -0400)]
7031: Fix python prefix
Peter Amstutz [Mon, 31 Aug 2015 17:38:37 +0000 (13:38 -0400)]
7031: Check out our forked libcloud from git and make packages from that.
radhika [Thu, 3 Sep 2015 19:55:31 +0000 (15:55 -0400)]
Merge branch 'master' into 6260-test-datamanager
Ward Vandewege [Thu, 3 Sep 2015 14:06:16 +0000 (10:06 -0400)]
Another tweak to the scopes required for run-deploy.sh to do its thing.
No issue #
Ward Vandewege [Wed, 2 Sep 2015 21:05:35 +0000 (17:05 -0400)]
Fix documented scope needed for run-deploy.sh
No issue #
Tom Clegg [Wed, 2 Sep 2015 06:48:18 +0000 (02:48 -0400)]
6263: Skip re-installing virtualenv if it is already set up. Upgrade pip along with setuptools.
Tom Clegg [Wed, 2 Sep 2015 04:49:33 +0000 (00:49 -0400)]
6263: Check for gitolite in sanity checks.
Ward Vandewege [Tue, 1 Sep 2015 20:57:06 +0000 (16:57 -0400)]
Merge branch '6939-package-sso-server'
closes #6939
Ward Vandewege [Tue, 1 Sep 2015 20:56:17 +0000 (16:56 -0400)]
Merge branch 'master' into 6939-package-sso-server
Conflicts:
jenkins/run-build-packages-all-targets.sh
refs #6939
Ward Vandewege [Tue, 1 Sep 2015 18:52:01 +0000 (14:52 -0400)]
Split out shared functions into a new run-library.sh.
refs #6939
Ward Vandewege [Tue, 1 Sep 2015 18:33:18 +0000 (14:33 -0400)]
First batch of improvements based on review feedback.
refs #6939
Ward Vandewege [Mon, 31 Aug 2015 21:04:23 +0000 (17:04 -0400)]
Add build script for the new Arvados SSO server package.
Also make the run-build-packages-all-targets.sh script a bit smarter so
that we can use it to build the SSO server package.
Add a run-build-packages-one-target.sh script to build any of our
Arvados packages for just one target.
refs #6939
Peter Amstutz [Mon, 31 Aug 2015 19:23:00 +0000 (15:23 -0400)]
Tests compatible libcloud package is installed.
Peter Amstutz [Mon, 31 Aug 2015 15:18:05 +0000 (11:18 -0400)]
Log package dependencies for each shared object. Add -q so make the logs a bit
less chatty.
Peter Amstutz [Sat, 29 Aug 2015 19:15:55 +0000 (15:15 -0400)]
Sets up local repositories for both centos (yum) and debian (apt), installs
from there as if an end user would.
Peter Amstutz [Fri, 28 Aug 2015 21:18:20 +0000 (17:18 -0400)]
Script to automatically test python package installation on clean Docker
images.
Ward Vandewege [Fri, 28 Aug 2015 15:37:35 +0000 (11:37 -0400)]
Optimization: do not run bundle install for the API server package when
we aren't including the vendor directory in the package we're building.
No issue #
Ward Vandewege [Fri, 28 Aug 2015 15:37:35 +0000 (11:37 -0400)]
Optimization: do not run bundle install for the API server package when
we aren't including the vendor directory in the package we're building.
No issue #
Peter Amstutz [Fri, 28 Aug 2015 14:40:06 +0000 (10:40 -0400)]
Preinstall forked version of libcloud, because nodemanager "pip install" won't
pick it up by default. refs #6507
Ward Vandewege [Fri, 28 Aug 2015 13:51:43 +0000 (09:51 -0400)]
run-build-packages-all-targets.sh should abort of WORKSPACE is not set.
No issue #
Ward Vandewege [Fri, 28 Aug 2015 13:51:43 +0000 (09:51 -0400)]
run-build-packages-all-targets.sh should abort of WORKSPACE is not set.
No issue #
Tom Clegg [Thu, 27 Aug 2015 19:47:45 +0000 (15:47 -0400)]
6263: Generate Go coverage reports in $WORKSPACE/tmp/coverage-*
Ward Vandewege [Thu, 27 Aug 2015 18:51:29 +0000 (14:51 -0400)]
Update/clarify package assumptions for api server and workbench.
No issue #
Tom Clegg [Wed, 26 Aug 2015 15:29:32 +0000 (11:29 -0400)]
Merge branch '6781-arvados-login-sync' refs #6781
Ward Vandewege [Wed, 19 Aug 2015 18:49:00 +0000 (14:49 -0400)]
Stop building broken debs for our gems. We don't use them and they have
never worked. We can reintroduce a working version later.
refs #6781
Tom Clegg [Thu, 13 Aug 2015 15:02:51 +0000 (11:02 -0400)]
6781: Add arvados-login-sync.
radhika [Tue, 25 Aug 2015 16:38:35 +0000 (12:38 -0400)]
6260: add datamanager to run-tests.sh
Nico Cesar [Mon, 24 Aug 2015 21:35:20 +0000 (17:35 -0400)]
7041: pyvcf was missing from backports in trusty
refs #7041
Brett Smith [Thu, 20 Aug 2015 15:20:54 +0000 (11:20 -0400)]
6940: Use nginx as WWW_OWNER on Red Hat distributions.
We recommend deploying with Nginx, and this script interacts with
Nginx. The default Nginx configuration that Phusion ships runs as the
nginx user on these distros. Use that as the WWW_OWNER.
Ideally we want to move to a more sophisticated place where we
introspect the Web server configuration and use the same server it
does. But for now, this is an improvement.
No issue #, but discovered when working on #6940. I cleared this with
Ward.
Tom Clegg [Fri, 14 Aug 2015 21:32:58 +0000 (17:32 -0400)]
Merge branch '6638-backport-deps' refs #6638
Ward Vandewege [Fri, 14 Aug 2015 19:22:07 +0000 (15:22 -0400)]
Make sure to also deploy switchyard.
No issue #
projects / arvados-dev.git / log