Peter Amstutz [Wed, 11 Nov 2015 14:20:36 +0000 (09:20 -0500)]
Merge branch '7593-arvados-cwl-runner' refs #7593
Tom Clegg [Tue, 10 Nov 2015 02:18:12 +0000 (21:18 -0500)]
Merge branch '7722-build-keep-rsync' closes #7722
Nico Cesar [Mon, 9 Nov 2015 21:48:34 +0000 (16:48 -0500)]
Merge branch '7591-httplib2-perms-fix-wip'
refs #7591
Brett Smith [Sat, 7 Nov 2015 16:49:17 +0000 (11:49 -0500)]
7591: Workaround bad permissions in the httplib2 backport.
Tom Clegg [Fri, 6 Nov 2015 17:41:24 +0000 (12:41 -0500)]
Add libwww-perl and python mock dependencies, so tests can run on ubuntu 14.04
If we let setuptools install mock for us (because it's listed in
tests_require), "python setup.py test" fails:
running test
Searching for mock>=1.0
Best match: mock 1.3.0
Processing mock-1.3.0-py2.7.egg
Using /tmp/arvados/sdk/python/.eggs/mock-1.3.0-py2.7.egg
Traceback (most recent call last):
File "setup.py", line 49, in <module>
cmdclass={'egg_info': tagger},
[...]
File "/tmp/.cache/arvados-build/VENVDIR/local/lib/python2.7/site-packages/pkg_resources/__init__.py", line 2910, in scan_list
raise RequirementParseError(msg, line, "at", line[p:])
pkg_resources.RequirementParseError: Expected version spec in funcsigs;python_version<"3.3" at ;python_version<"3.3
No issue #
Tom Clegg [Thu, 5 Nov 2015 06:19:13 +0000 (01:19 -0500)]
7722: Build keep-rsync package. Deduplicate go->fpm recipe.
Ward Vandewege [Wed, 4 Nov 2015 14:50:42 +0000 (09:50 -0500)]
arvados-api-server-upgrade.sh fix: do not try to chmod the cache
directory if it doesn't exist. This avoids an error on fresh install.
Rails will create the cache directory if it doesn't exist.
No issue #
Tom Clegg [Wed, 4 Nov 2015 04:54:39 +0000 (23:54 -0500)]
Merge branch '5824-keep-web'
refs #5824
Tom Clegg [Wed, 4 Nov 2015 04:50:44 +0000 (23:50 -0500)]
5824: Add services/keep-web
Peter Amstutz [Thu, 29 Oct 2015 16:28:15 +0000 (12:28 -0400)]
Remove unnecessary yum update. touch RPM database to work around overlayfs bug.
refs #7370
Peter Amstutz [Thu, 29 Oct 2015 15:55:03 +0000 (11:55 -0400)]
Obsoleted by run-build-packages-all-targets.sh --test-packages refs #7370
Nico Cesar [Thu, 29 Oct 2015 15:42:37 +0000 (11:42 -0400)]
reverted hkp port 80 explicitly
no issue #
Ward Vandewege [Wed, 28 Oct 2015 21:21:06 +0000 (17:21 -0400)]
Make sure that the CentOS 6 test script actually does the yum update call.
refs #7370
Peter Amstutz [Wed, 28 Oct 2015 15:26:29 +0000 (11:26 -0400)]
7593: Add sdk/cwl to package building.
Ward Vandewege [Tue, 27 Oct 2015 19:16:17 +0000 (15:16 -0400)]
Add python-pip to the Arvados build images.
this is a dependency for #7591 (refs #7591)
Nico Cesar [Tue, 27 Oct 2015 15:14:16 +0000 (11:14 -0400)]
hkp://pool.sks-keyservers.net:80 is needed to use the transaparent proxy
no issue #
Ward Vandewege [Sat, 24 Oct 2015 02:24:51 +0000 (22:24 -0400)]
Fix path issue when running run-build-packages-all-targets.sh from
another directory.
refs #7370
Ward Vandewege [Fri, 23 Oct 2015 20:31:18 +0000 (16:31 -0400)]
Make sure bundle is installed in arvados-api-server-upgrade.sh,
arvados-workbench-upgrade.sh and arvados-sso-server.postinst
No issue #
Peter Amstutz [Fri, 23 Oct 2015 14:29:02 +0000 (10:29 -0400)]
Merge branch '7370-package-install-testing' closes #7370
Ward Vandewege [Wed, 21 Oct 2015 01:18:23 +0000 (21:18 -0400)]
Shut up dpkg-scanpackages warnings.
refs #7370
Brett Smith [Mon, 19 Oct 2015 16:53:20 +0000 (12:53 -0400)]
Backport pbr < 1.0 on CentOS 6.
The lockfile backport grew a dependency on pbr < 1.0 in their version
0.11. No issue #.
Peter Amstutz [Fri, 16 Oct 2015 18:29:57 +0000 (14:29 -0400)]
7370: run-build-packages-all-targets hands off to run-build-packages-one-target, suppports --test-packages option.
Peter Amstutz [Thu, 15 Oct 2015 20:40:54 +0000 (16:40 -0400)]
7370: Fix centos6 package builder container.
Peter Amstutz [Thu, 15 Oct 2015 20:24:07 +0000 (16:24 -0400)]
Merge branch 'master' into 7370-package-install-testing
Conflicts:
jenkins/run-build-packages-one-target.sh
Peter Amstutz [Thu, 15 Oct 2015 20:21:56 +0000 (16:21 -0400)]
7370: Refactoring way the package test is set up and executed.
radhika [Thu, 15 Oct 2015 16:38:41 +0000 (12:38 -0400)]
refs #7167
Merge branch '7167-keep-rsync-test-setup'
radhika [Thu, 15 Oct 2015 16:36:16 +0000 (12:36 -0400)]
Merge branch 'master' into 7167-keep-rsync-test-setup
Brett Smith [Thu, 15 Oct 2015 15:57:43 +0000 (11:57 -0400)]
Merge branch '7341-deploy-retries-puppet-agent-wip'
Closes #7341, #7549.
Peter Amstutz [Thu, 15 Oct 2015 14:40:17 +0000 (10:40 -0400)]
Merge branch 'master' into 7370-package-install-testing
Brett Smith [Wed, 14 Oct 2015 22:18:58 +0000 (18:18 -0400)]
7341: run-deploy.sh retries failed Puppet agent runs.
It simply keeps retrying any failure until ten minutes have passed,
per Nico's suggestion in the comments.
Bonus bugfix: make sure run_puppet's ECODE variable gets set to the
exit status of Puppet (or the wrapper script), and not tee.
Ward Vandewege [Tue, 13 Oct 2015 14:18:55 +0000 (10:18 -0400)]
Make sure to run the arvados-api-server-upgrade.sh and
arvados-workbench-upgrade.sh scripts in the RVM environment in
run-deploy.sh.
no issue #
Ward Vandewege [Fri, 9 Oct 2015 17:09:20 +0000 (13:09 -0400)]
Make it possible to pass --debug through to the script run inside the Docker
build containers.
No issue #
Ward Vandewege [Fri, 9 Oct 2015 17:02:39 +0000 (13:02 -0400)]
Ensure proper permissions on /usr/local/arvados/src in the arvados-src package.
refs #7397
radhika [Fri, 9 Oct 2015 14:36:48 +0000 (10:36 -0400)]
Merge branch 'master' into 7167-keep-rsync-test-setup
Nico Cesar [Wed, 7 Oct 2015 14:09:16 +0000 (10:09 -0400)]
7460: c97qk doesnt need mailchimp deployed. this caused deploy to fail in Ubuntu
refs #7460
Peter Amstutz [Wed, 7 Oct 2015 14:07:25 +0000 (10:07 -0400)]
Run CWL tests for both draft-2 and draft-3. No issue #
Peter Amstutz [Wed, 7 Oct 2015 14:02:43 +0000 (10:02 -0400)]
Update cwl builder process for repository reorganization. No issue #
Peter Amstutz [Mon, 5 Oct 2015 18:21:04 +0000 (14:21 -0400)]
Update pin of libcloud fork to dev4 refs #7286
Brett Smith [Mon, 5 Oct 2015 17:14:00 +0000 (13:14 -0400)]
Merge branch '7451-dont-recreate-venv3dir-wip'
Refs #7451. Closes #7452.
Brett Smith [Mon, 5 Oct 2015 16:53:42 +0000 (12:53 -0400)]
7451: Improve virtualenv setup in run-tests.sh.
The code to build the Python 3 virtualenv didn't check to see whether
the virtualenv already existed first. When reusing a Python 3
virtualenv, pip would get downgraded and start failing.
Refactor the virtualenv setup code to avoid this duplication and these
sorts of bugs.
While I was at it: rather than trying to parse package versions
ourselves to figure out when to upgrade setuptools and pip, just tell
pip the versions we want. 'pip>=7' is an approximation of what we're
currently doing. The main thing we care about is that we get a
version new enough to work with setuptools 18.
Tom Clegg [Mon, 5 Oct 2015 16:48:56 +0000 (12:48 -0400)]
Fix incorrect line numbers on compile errors reported by "go test" in coverage mode. No issue #
radhika [Mon, 5 Oct 2015 11:37:48 +0000 (07:37 -0400)]
7167: add keep-rsync to gostuff.
Brett Smith [Wed, 30 Sep 2015 15:11:59 +0000 (11:11 -0400)]
7356: CentOS 6 needs a Python 3 backport for websocket-client.
Refs #7356.
Ward Vandewege [Tue, 29 Sep 2015 17:49:35 +0000 (13:49 -0400)]
Merge branch '7330-postinst-for-sso-server'
refs #7330
Ward Vandewege [Tue, 29 Sep 2015 01:00:32 +0000 (21:00 -0400)]
More fixes for the SSO server packages.
refs #7330
Ward Vandewege [Mon, 28 Sep 2015 21:42:58 +0000 (17:42 -0400)]
A number of additional tweaks.
refs #7330
Ward Vandewege [Mon, 28 Sep 2015 04:23:16 +0000 (00:23 -0400)]
Add support for CentOS6 to the improved SSO packages.
refs #7330
Ward Vandewege [Sun, 27 Sep 2015 19:59:56 +0000 (15:59 -0400)]
Initial version of run-test-packages-sso.sh
refs #7330
Ward Vandewege [Sun, 27 Sep 2015 19:29:15 +0000 (15:29 -0400)]
Remove bash-ism from arvados-sso-server.postinst.
refs #7330
Ward Vandewege [Sun, 27 Sep 2015 15:22:32 +0000 (11:22 -0400)]
Add prerm and postrm scripts, various cleanups.
refs #7330
Ward Vandewege [Sat, 26 Sep 2015 01:42:29 +0000 (21:42 -0400)]
First commit.
refs #7330
Ward Vandewege [Fri, 25 Sep 2015 16:05:33 +0000 (12:05 -0400)]
Fix the test that avoids running puppet multiple times on installations
where workbench runs on the API server.
No issue #
Brett Smith [Thu, 24 Sep 2015 16:01:20 +0000 (12:01 -0400)]
7322: Don't backport virtualenv for Arvados.
The Arvados code only needs virtualenv 1.7, which is provided with all
of our supported distros.
run-tests.sh requires 1.8.3 to use the --setuptools switch, but that
can be handled without publishing a backported package.
Refs #7322.
Peter Amstutz [Wed, 23 Sep 2015 17:02:43 +0000 (13:02 -0400)]
Merge branch '7228-group-writable-tmp-cache' refs #7228
Peter Amstutz [Wed, 23 Sep 2015 13:09:25 +0000 (09:09 -0400)]
7228: Add chmod -R 2775 $RELEASE_PATH/tmp/cache/ so that cache is group writable.
Ward Vandewege [Mon, 21 Sep 2015 20:56:57 +0000 (16:56 -0400)]
Make the build step for our libcloud package a lot less noisy by default.
No issue #
Brett Smith [Wed, 16 Sep 2015 20:33:28 +0000 (16:33 -0400)]
Close unclosed quotes in arvados-api-server-upgrade.sh.
No issue #.
Brett Smith [Wed, 16 Sep 2015 19:25:40 +0000 (15:25 -0400)]
Merge branch 'pr/1'
Closes #7261.
radhika [Mon, 14 Sep 2015 22:56:43 +0000 (18:56 -0400)]
refs #6260
Merge branch '6260-test-datamanager'
radhika [Mon, 14 Sep 2015 22:53:16 +0000 (18:53 -0400)]
6260: since datamanager no longer needs the data-manager-token-file (only keep server does), remove the run-tests.sh update for this.
Tom Clegg [Sat, 12 Sep 2015 02:25:30 +0000 (22:25 -0400)]
Merge branch '7311-temp-base' closes #7311
Tom Clegg [Fri, 11 Sep 2015 21:04:53 +0000 (17:04 -0400)]
7311: Do not forget to make temp dirs.
Tom Clegg [Fri, 11 Sep 2015 14:44:16 +0000 (10:44 -0400)]
7311: Make recognizable temp dirs under a single base; allow override with --temp DIR
Joshua C. Randall [Thu, 10 Sep 2015 20:20:04 +0000 (20:20 +0000)]
Adds setuptools/pip upgrade in python3 virtualenv
Moves ruby environment setup to after python3 virtualenv
setup, because otherwise activating the python3 virtualenv
breaks ruby.
Peter Amstutz [Wed, 9 Sep 2015 15:42:39 +0000 (11:42 -0400)]
Add libcloud-pin and update to dev3 refs #7031
radhika [Tue, 8 Sep 2015 21:26:12 +0000 (17:26 -0400)]
6260: append to testargs, instead of replacing.
radhika [Tue, 8 Sep 2015 16:34:54 +0000 (12:34 -0400)]
Merge branch 'master' into 6260-test-datamanager
Peter Amstutz [Tue, 8 Sep 2015 13:44:21 +0000 (09:44 -0400)]
Merge branch '7031-build-forked-libcloud' refs #7031
Peter Amstutz [Tue, 8 Sep 2015 13:43:20 +0000 (09:43 -0400)]
Merge branch 'master' into 7031-build-forked-libcloud
Tom Clegg [Mon, 7 Sep 2015 18:13:18 +0000 (14:13 -0400)]
Merge branch '6263-go-coverage' refs #6263
Tom Clegg [Mon, 7 Sep 2015 18:10:53 +0000 (14:10 -0400)]
Merge branch '6263-gitolite-test' refs #6263
Ward Vandewege [Fri, 4 Sep 2015 15:04:17 +0000 (11:04 -0400)]
Make sure the library can always be found.
No issue #
Peter Amstutz [Fri, 4 Sep 2015 14:00:23 +0000 (10:00 -0400)]
Bump version to dev2
Peter Amstutz [Mon, 31 Aug 2015 18:10:53 +0000 (14:10 -0400)]
7031: Fix python prefix
Peter Amstutz [Mon, 31 Aug 2015 17:38:37 +0000 (13:38 -0400)]
7031: Check out our forked libcloud from git and make packages from that.
radhika [Thu, 3 Sep 2015 19:55:31 +0000 (15:55 -0400)]
Merge branch 'master' into 6260-test-datamanager
Ward Vandewege [Thu, 3 Sep 2015 14:06:16 +0000 (10:06 -0400)]
Another tweak to the scopes required for run-deploy.sh to do its thing.
No issue #
Ward Vandewege [Wed, 2 Sep 2015 21:05:35 +0000 (17:05 -0400)]
Fix documented scope needed for run-deploy.sh
No issue #
Tom Clegg [Wed, 2 Sep 2015 06:48:18 +0000 (02:48 -0400)]
6263: Skip re-installing virtualenv if it is already set up. Upgrade pip along with setuptools.
Tom Clegg [Wed, 2 Sep 2015 04:49:33 +0000 (00:49 -0400)]
6263: Check for gitolite in sanity checks.
Ward Vandewege [Tue, 1 Sep 2015 20:57:06 +0000 (16:57 -0400)]
Merge branch '6939-package-sso-server'
closes #6939
Ward Vandewege [Tue, 1 Sep 2015 20:56:17 +0000 (16:56 -0400)]
Merge branch 'master' into 6939-package-sso-server
Conflicts:
jenkins/run-build-packages-all-targets.sh
refs #6939
Ward Vandewege [Tue, 1 Sep 2015 18:52:01 +0000 (14:52 -0400)]
Split out shared functions into a new run-library.sh.
refs #6939
Ward Vandewege [Tue, 1 Sep 2015 18:33:18 +0000 (14:33 -0400)]
First batch of improvements based on review feedback.
refs #6939
Ward Vandewege [Mon, 31 Aug 2015 21:04:23 +0000 (17:04 -0400)]
Add build script for the new Arvados SSO server package.
Also make the run-build-packages-all-targets.sh script a bit smarter so
that we can use it to build the SSO server package.
Add a run-build-packages-one-target.sh script to build any of our
Arvados packages for just one target.
refs #6939
Peter Amstutz [Mon, 31 Aug 2015 19:23:00 +0000 (15:23 -0400)]
Tests compatible libcloud package is installed.
Peter Amstutz [Mon, 31 Aug 2015 15:18:05 +0000 (11:18 -0400)]
Log package dependencies for each shared object. Add -q so make the logs a bit
less chatty.
Peter Amstutz [Sat, 29 Aug 2015 19:15:55 +0000 (15:15 -0400)]
Sets up local repositories for both centos (yum) and debian (apt), installs
from there as if an end user would.
Peter Amstutz [Fri, 28 Aug 2015 21:18:20 +0000 (17:18 -0400)]
Script to automatically test python package installation on clean Docker
images.
Ward Vandewege [Fri, 28 Aug 2015 15:37:35 +0000 (11:37 -0400)]
Optimization: do not run bundle install for the API server package when
we aren't including the vendor directory in the package we're building.
No issue #
Ward Vandewege [Fri, 28 Aug 2015 15:37:35 +0000 (11:37 -0400)]
Optimization: do not run bundle install for the API server package when
we aren't including the vendor directory in the package we're building.
No issue #
Peter Amstutz [Fri, 28 Aug 2015 14:40:06 +0000 (10:40 -0400)]
Preinstall forked version of libcloud, because nodemanager "pip install" won't
pick it up by default. refs #6507
Ward Vandewege [Fri, 28 Aug 2015 13:51:43 +0000 (09:51 -0400)]
run-build-packages-all-targets.sh should abort of WORKSPACE is not set.
No issue #
Ward Vandewege [Fri, 28 Aug 2015 13:51:43 +0000 (09:51 -0400)]
run-build-packages-all-targets.sh should abort of WORKSPACE is not set.
No issue #
Tom Clegg [Thu, 27 Aug 2015 19:47:45 +0000 (15:47 -0400)]
6263: Generate Go coverage reports in $WORKSPACE/tmp/coverage-*
Ward Vandewege [Thu, 27 Aug 2015 18:51:29 +0000 (14:51 -0400)]
Update/clarify package assumptions for api server and workbench.
No issue #
Tom Clegg [Wed, 26 Aug 2015 15:29:32 +0000 (11:29 -0400)]
Merge branch '6781-arvados-login-sync' refs #6781
Ward Vandewege [Wed, 19 Aug 2015 18:49:00 +0000 (14:49 -0400)]
Stop building broken debs for our gems. We don't use them and they have
never worked. We can reintroduce a working version later.
refs #6781
Tom Clegg [Thu, 13 Aug 2015 15:02:51 +0000 (11:02 -0400)]
6781: Add arvados-login-sync.
radhika [Tue, 25 Aug 2015 16:38:35 +0000 (12:38 -0400)]
6260: add datamanager to run-tests.sh
projects / arvados-dev.git / log