arvados.git
9 years agoAdd README, COPYING and agpl-3.0.txt.
Ward Vandewege [Sun, 5 Oct 2014 14:17:01 +0000 (10:17 -0400)]
Add README, COPYING and agpl-3.0.txt.

No issue #

9 years agoMake run-deploy.sh do a bit more work to update the rest of the staging
Ward Vandewege [Sat, 4 Oct 2014 01:29:43 +0000 (21:29 -0400)]
Make run-deploy.sh do a bit more work to update the rest of the staging
cluster.

No issue #

9 years agoDeal with Jenkins' new, tight umask in a more thorough way.
Ward Vandewege [Fri, 3 Oct 2014 00:15:35 +0000 (20:15 -0400)]
Deal with Jenkins' new, tight umask in a more thorough way.

No issue #

9 years agoMake sure our generated packages are world-readable, otherwise they
Ward Vandewege [Wed, 1 Oct 2014 21:22:51 +0000 (17:22 -0400)]
Make sure our generated packages are world-readable, otherwise they
won't be useful in the package repo.

No issue #

9 years agoAdd new run-diagnostics-suite.sh jenkins script.
Ward Vandewege [Wed, 1 Oct 2014 20:28:42 +0000 (16:28 -0400)]
Add new run-diagnostics-suite.sh jenkins script.

No issue #

9 years agoMerge branch '4038-commit-hooks-accept-fixes'
Tim Pierce [Tue, 30 Sep 2014 17:27:41 +0000 (13:27 -0400)]
Merge branch '4038-commit-hooks-accept-fixes'

Closes #4038.

9 years ago4038: add "fixes #" to acceptable merge commit messages
Tim Pierce [Tue, 30 Sep 2014 17:10:32 +0000 (13:10 -0400)]
4038: add "fixes #" to acceptable merge commit messages

9 years ago3848: Stop manually tagging Python builds.
Brett Smith [Mon, 29 Sep 2014 16:25:53 +0000 (12:25 -0400)]
3848: Stop manually tagging Python builds.

This is now done in setup.py.  Refs #3848.

9 years agoImprovements to our package building script: fill in more of the
Ward Vandewege [Sat, 27 Sep 2014 01:40:08 +0000 (21:40 -0400)]
Improvements to our package building script: fill in more of the
metadata fields on the deb packages.

No issue #

9 years agorun-tests.sh uses virtualenv's activate script.
Brett Smith [Tue, 23 Sep 2014 14:56:57 +0000 (10:56 -0400)]
run-tests.sh uses virtualenv's activate script.

The activate script takes care of additional isolation steps, like
clearing $PYTHONHOME and rehashing $PATH.  Prefer that over simply
setting $PATH ourselves.  No issue #.

9 years agoFix another -z that should have been -n. refs #3894
Tom Clegg [Tue, 23 Sep 2014 14:21:30 +0000 (10:21 -0400)]
Fix another -z that should have been -n. refs #3894

9 years agoMerge branch '3894-improve-run-tests' closes #3894
Tom Clegg [Mon, 22 Sep 2014 20:34:22 +0000 (16:34 -0400)]
Merge branch '3894-improve-run-tests' closes #3894

9 years ago3894: Add comments about CONFIGSRC in --help text.
Tom Clegg [Mon, 22 Sep 2014 19:40:00 +0000 (15:40 -0400)]
3894: Add comments about CONFIGSRC in --help text.

9 years ago3894: Fix -n that should have been -z. Flatten condition.
Tom Clegg [Mon, 22 Sep 2014 19:37:03 +0000 (15:37 -0400)]
3894: Fix -n that should have been -z. Flatten condition.

9 years ago3894: Use --first-parent and readable timestamp in fuse package as
Tom Clegg [Mon, 22 Sep 2014 19:32:50 +0000 (15:32 -0400)]
3894: Use --first-parent and readable timestamp in fuse package as
well. Use "tr -dc | cut" to eliminate the horrible list of byte
positions. Fix git command to use the desired human-readable timestamp
format.

9 years ago3894: Use readable timestamp (yyyymmddhhmmss) for python package
Tom Clegg [Mon, 22 Sep 2014 15:07:13 +0000 (11:07 -0400)]
3894: Use readable timestamp (yyyymmddhhmmss) for python package
version, and use first-parent to ensure each merge to master results
in a higher version number.

9 years ago3894: Remove bundle install stage from sdk/cli.
Tom Clegg [Mon, 22 Sep 2014 15:05:39 +0000 (11:05 -0400)]
3894: Remove bundle install stage from sdk/cli.

9 years ago3894: Move report_outcomes to a function.
Tom Clegg [Mon, 22 Sep 2014 15:04:08 +0000 (11:04 -0400)]
3894: Move report_outcomes to a function.

9 years ago3894: Use $GEMHOME tmpdir instead of user's $HOME for userspace gem installs.
Tom Clegg [Sat, 20 Sep 2014 03:39:11 +0000 (23:39 -0400)]
3894: Use $GEMHOME tmpdir instead of user's $HOME for userspace gem installs.

9 years ago3894: Add --help message.
Tom Clegg [Sat, 20 Sep 2014 03:35:30 +0000 (23:35 -0400)]
3894: Add --help message.

9 years agoMake regexp to match fpm's output slightly more robust.
Ward Vandewege [Fri, 19 Sep 2014 20:46:10 +0000 (16:46 -0400)]
Make regexp to match fpm's output slightly more robust.

no issue #

9 years agoSwitch from PRM to freight for publishing our packages. It's way, way
Ward Vandewege [Fri, 19 Sep 2014 20:23:16 +0000 (16:23 -0400)]
Switch from PRM to freight for publishing our packages. It's way, way
faster.

no issue #

9 years agoCopy only the debs that were generated to the remote server.
Ward Vandewege [Fri, 19 Sep 2014 16:05:41 +0000 (12:05 -0400)]
Copy only the debs that were generated to the remote server.

No issue #

9 years ago3894: Fix sequence: do all installs, then all tests.
Tom Clegg [Fri, 19 Sep 2014 14:57:20 +0000 (10:57 -0400)]
3894: Fix sequence: do all installs, then all tests.

9 years ago3894: Use gem install --user-install to avoid sudo/rvm requirement
Tom Clegg [Fri, 19 Sep 2014 14:56:27 +0000 (10:56 -0400)]
3894: Use gem install --user-install to avoid sudo/rvm requirement

9 years ago3894: Scrub PYTHONPATH
Tom Clegg [Fri, 19 Sep 2014 14:54:11 +0000 (10:54 -0400)]
3894: Scrub PYTHONPATH

9 years ago3894: Use mktemp instead of $WORKSPACE/tmpgit for test repo
Tom Clegg [Fri, 19 Sep 2014 14:26:53 +0000 (10:26 -0400)]
3894: Use mktemp instead of $WORKSPACE/tmpgit for test repo

9 years ago3894: Fix backward empty/nonempty logic.
Tom Clegg [Thu, 18 Sep 2014 21:00:58 +0000 (17:00 -0400)]
3894: Fix backward empty/nonempty logic.

9 years ago3894: Do not create and abandon new temp dirs if caller has already
Tom Clegg [Thu, 18 Sep 2014 17:35:06 +0000 (13:35 -0400)]
3894: Do not create and abandon new temp dirs if caller has already
provided existing ones. Never delete temp dirs supplied by caller even
if the caller (like the help text) forgets to specify --leave-temp.

9 years ago3894: Accept WORKSPACE=foo on command line. Copy config from CONFIGSRC
Tom Clegg [Thu, 18 Sep 2014 17:14:50 +0000 (13:14 -0400)]
3894: Accept WORKSPACE=foo on command line. Copy config from CONFIGSRC
instead of hard-coded location. Skip this if they don't exist in the
previously hard-coded location and CONFIGSRC is not given.

9 years agoUndo two hunks that I accidentally committed in 565c31196f3ccd4346c8a1ac1e19b1deda22eea6.
Ward Vandewege [Wed, 17 Sep 2014 03:14:56 +0000 (23:14 -0400)]
Undo two hunks that I accidentally committed in 565c31196f3ccd4346c8a1ac1e19b1deda22eea6.

no issue #

9 years agoAdd some robustness in the postgresql department.
Ward Vandewege [Wed, 17 Sep 2014 01:42:47 +0000 (21:42 -0400)]
Add some robustness in the postgresql department.

no issue #

9 years agoOnly install the latest gem (i.e. the one we just built).
Ward Vandewege [Tue, 16 Sep 2014 21:01:29 +0000 (17:01 -0400)]
Only install the latest gem (i.e. the one we just built).

No issue #

9 years agoAlso build our java-bwa-samtools docker image.
Ward Vandewege [Tue, 16 Sep 2014 20:52:01 +0000 (16:52 -0400)]
Also build our java-bwa-samtools docker image.

no issue #

9 years agoFixes for the deploy stage of the build pipeline: actually upgrade our
Ward Vandewege [Fri, 12 Sep 2014 20:33:14 +0000 (16:33 -0400)]
Fixes for the deploy stage of the build pipeline: actually upgrade our
debian packages and gems.

no issue #

9 years agoSave a bit of time: do not install RI and RDoc for the gems we install
Ward Vandewege [Sat, 6 Sep 2014 04:06:15 +0000 (00:06 -0400)]
Save a bit of time: do not install RI and RDoc for the gems we install
during testing.

no issue #

9 years agoInstall & test Ruby SDK, then use that version for other tests.
Brett Smith [Thu, 4 Sep 2014 20:13:31 +0000 (16:13 -0400)]
Install & test Ruby SDK, then use that version for other tests.

This commit gives our Ruby SDK the same treatment as other parts of
our build process: we build and install it early, then test it.  We
use that built version to run other tests, to make sure all the
components are synced up throughout the run.

This required turning off `bundle install --deployment`, because
Bundler will not use locally installed Gems in that mode.  This does
make our build process a little less like what we use in production,
but the benefits of consistent testing and tightening the build
loop (you can update a Gem and dependent Gemfiles in one push) seem
worth that cost.

Refs #3720.

9 years agoFix environment variable setting on command line. no issue #
Peter Amstutz [Thu, 4 Sep 2014 21:11:09 +0000 (17:11 -0400)]
Fix environment variable setting on command line.  no issue #

9 years agoFix $leave_temp in clear_temp() no issue #
Peter Amstutz [Thu, 28 Aug 2014 19:21:31 +0000 (15:21 -0400)]
Fix $leave_temp in clear_temp() no issue #

9 years agoEnhanced run-tests.sh command line supporting choosing specific Python and Ruby
Peter Amstutz [Tue, 26 Aug 2014 14:43:06 +0000 (10:43 -0400)]
Enhanced run-tests.sh command line supporting choosing specific Python and Ruby
tests, and re-using temp directories. no issue #

9 years agoDeclare empty variables up top to avoid bash parsing errors. no issue #
Peter Amstutz [Thu, 21 Aug 2014 16:00:09 +0000 (12:00 -0400)]
Declare empty variables up top to avoid bash parsing errors.  no issue #

9 years agoPermit setting environment variables on command line. Added workbench_test,
Peter Amstutz [Thu, 21 Aug 2014 14:21:39 +0000 (10:21 -0400)]
Permit setting environment variables on command line.  Added workbench_test,
apiserver_test and cli_test variables to provide parameters to the respective
rake tests.  no issue #

9 years agoUnset ARVADOS_ variable from the environment before running tests. no issue #
Peter Amstutz [Wed, 20 Aug 2014 19:21:06 +0000 (15:21 -0400)]
Unset ARVADOS_ variable from the environment before running tests.  no issue #

9 years agoFix failure detection for python tests. No issue #
Tom Clegg [Tue, 19 Aug 2014 20:26:32 +0000 (16:26 -0400)]
Fix failure detection for python tests. No issue #

9 years agoInstall py test deps even if py tests fail. Make docs skippable. No issue #
Tom Clegg [Tue, 19 Aug 2014 19:04:56 +0000 (15:04 -0400)]
Install py test deps even if py tests fail. Make docs skippable. No issue #

9 years agoMerge branch 'skip-args'
Ward Vandewege [Tue, 19 Aug 2014 14:22:58 +0000 (10:22 -0400)]
Merge branch 'skip-args'

no issue #

9 years agoFix swapped install/test sections for fuse.
Tom Clegg [Mon, 18 Aug 2014 18:37:45 +0000 (14:37 -0400)]
Fix swapped install/test sections for fuse.

9 years agoDisplay elapsed time for each test/install.
Tom Clegg [Mon, 18 Aug 2014 14:48:19 +0000 (10:48 -0400)]
Display elapsed time for each test/install.

9 years agoAdd missing "install fuse" and "test workbench".
Tom Clegg [Mon, 18 Aug 2014 14:48:00 +0000 (10:48 -0400)]
Add missing "install fuse" and "test workbench".

9 years agoCleanup, add some error checks, add --skip and --only args.
Tom Clegg [Sat, 16 Aug 2014 06:00:23 +0000 (02:00 -0400)]
Cleanup, add some error checks, add --skip and --only args.

9 years agoRemove duplicated cleanup commands; the realclean target takes care of
Ward Vandewege [Fri, 15 Aug 2014 23:34:44 +0000 (19:34 -0400)]
Remove duplicated cleanup commands; the realclean target takes care of
that now.

no issue #

9 years agokeep is now called keepstore
Ward Vandewege [Fri, 15 Aug 2014 13:23:54 +0000 (09:23 -0400)]
keep is now called keepstore

refs #3551

9 years agoMerge branch '3551-go-layout'
Ward Vandewege [Fri, 15 Aug 2014 12:51:33 +0000 (08:51 -0400)]
Merge branch '3551-go-layout'

refs #3551

9 years ago3551: Install Python and Go bits, force installation of Python test dependencies...
Tom Clegg [Thu, 14 Aug 2014 22:46:37 +0000 (18:46 -0400)]
3551: Install Python and Go bits, force installation of Python test dependencies, *then* run tests.

9 years ago3551: Fix dependency cycle: Install Python SDK, then install+test Go stuff, then...
Tom Clegg [Thu, 14 Aug 2014 21:18:33 +0000 (17:18 -0400)]
3551: Fix dependency cycle: Install Python SDK, then install+test Go stuff, then test Python SDK.

9 years ago3551: Test and install keepstore before Python SDK.
Tom Clegg [Thu, 14 Aug 2014 20:30:56 +0000 (16:30 -0400)]
3551: Test and install keepstore before Python SDK.

9 years ago3551: Clean up temp dir.
Tom Clegg [Thu, 14 Aug 2014 20:30:13 +0000 (16:30 -0400)]
3551: Clean up temp dir.

9 years agoMerge branch '3551-go-layout'
Ward Vandewege [Thu, 14 Aug 2014 20:00:28 +0000 (16:00 -0400)]
Merge branch '3551-go-layout'

refs #3551

9 years ago3551: Use mktemp for GOPATH. Update run-build-packages.sh with new Go recipes.
Tom Clegg [Thu, 14 Aug 2014 19:45:27 +0000 (15:45 -0400)]
3551: Use mktemp for GOPATH. Update run-build-packages.sh with new Go recipes.

9 years agoMerge branch '3551-go-layout'
Ward Vandewege [Thu, 14 Aug 2014 19:29:36 +0000 (15:29 -0400)]
Merge branch '3551-go-layout'

refs #3551

9 years agoMerge branch 'master' into 3551-go-layout
Ward Vandewege [Thu, 14 Aug 2014 19:25:04 +0000 (15:25 -0400)]
Merge branch 'master' into 3551-go-layout

9 years agoMake use of the realclean build.sh feature to build the docker images.
Ward Vandewege [Thu, 14 Aug 2014 19:24:09 +0000 (15:24 -0400)]
Make use of the realclean build.sh feature to build the docker images.

no issue #

9 years ago3551: Dry up pass/fail checks with a checkexit() function.
Tom Clegg [Thu, 14 Aug 2014 19:21:17 +0000 (15:21 -0400)]
3551: Dry up pass/fail checks with a checkexit() function.

9 years agoUpdate Go tests to new layout, rename keepstore, add missing tests for keepproxy...
Tom Clegg [Thu, 14 Aug 2014 17:13:18 +0000 (13:13 -0400)]
Update Go tests to new layout, rename keepstore, add missing tests for keepproxy and Go SDK libraries. refs #3551

9 years agoPython egg build fix for the sdist rotate command
Ward Vandewege [Fri, 18 Jul 2014 14:05:35 +0000 (10:05 -0400)]
Python egg build fix for the sdist rotate command

Refs #3252

9 years agoUpdate Python package test procedure.
Brett Smith [Fri, 18 Jul 2014 13:27:54 +0000 (09:27 -0400)]
Update Python package test procedure.

Refs #3252 simplifies the way we express Python package dependencies.
This lets us invoke tests directly from setup.py, so do that.

9 years agoMake sure to bring the arvados debian packages up to the latest version
Ward Vandewege [Mon, 7 Jul 2014 19:11:37 +0000 (15:11 -0400)]
Make sure to bring the arvados debian packages up to the latest version
when deploying via jenkins.

no issue #

9 years agoMake sure to exit with $EXITCODE
Ward Vandewege [Tue, 1 Jul 2014 19:38:00 +0000 (15:38 -0400)]
Make sure to exit with $EXITCODE

no issue #

9 years agoAdd docker test script.
Ward Vandewege [Tue, 1 Jul 2014 15:41:17 +0000 (11:41 -0400)]
Add docker test script.

no issue #

9 years agoMake sure the arvados-src package actually contains the latest source. Duh.
Ward Vandewege [Mon, 30 Jun 2014 17:35:51 +0000 (13:35 -0400)]
Make sure the arvados-src package actually contains the latest source. Duh.

no issue #

9 years agoRemove superfluous directory from arvados-src path.
Ward Vandewege [Fri, 13 Jun 2014 15:16:38 +0000 (11:16 -0400)]
Remove superfluous directory from arvados-src path.

No issue #

9 years agoBuild a new arvados-src package.
Ward Vandewege [Fri, 13 Jun 2014 14:49:46 +0000 (10:49 -0400)]
Build a new arvados-src package.

No issue #

9 years agoMerge branch 'new-git-hooks'
Ward Vandewege [Thu, 5 Jun 2014 18:27:34 +0000 (14:27 -0400)]
Merge branch 'new-git-hooks'

no issue #

9 years agoA few fixes:
Ward Vandewege [Thu, 5 Jun 2014 18:25:47 +0000 (14:25 -0400)]
A few fixes:

a) clarify error message when doing a fast-forward merge rejection

b) reduce number of gratuitous newlines

c) do not test for issue numbers when a fast-forward merge is being
attempted, because that test will complain about every commit, obscuring
the real problem (the fast-forward merge)

9 years agoMerge branch 'new-git-hooks' of git.curoverse.com:arvados-dev into new-git-hooks
Ward Vandewege [Thu, 5 Jun 2014 17:52:39 +0000 (13:52 -0400)]
Merge branch 'new-git-hooks' of git.curoverse.com:arvados-dev into new-git-hooks

9 years agoAdded mention of git reset to instructions for remerging/rebasing.
Peter Amstutz [Thu, 5 Jun 2014 15:43:26 +0000 (11:43 -0400)]
Added mention of git reset to instructions for remerging/rebasing.

9 years agoDisallow commits that merge local and remote master, in order to maintain
Peter Amstutz [Thu, 5 Jun 2014 15:41:22 +0000 (11:41 -0400)]
Disallow commits that merge local and remote master, in order to maintain
linear history of master.

9 years agoAdded pattern to permit commits that merge master heads.
Peter Amstutz [Thu, 5 Jun 2014 15:26:01 +0000 (11:26 -0400)]
Added pattern to permit commits that merge master heads.

9 years agoProposed new git hook policy: only applies to first-parent, enforces master is
Peter Amstutz [Thu, 5 Jun 2014 15:09:54 +0000 (11:09 -0400)]
Proposed new git hook policy: only applies to first-parent, enforces master is
first parent on all merges, enforces issue number (or explicitly stating no
issue number) on all master commits.

9 years agoBuild crunchstat package.
Ward Vandewege [Wed, 4 Jun 2014 20:33:10 +0000 (16:33 -0400)]
Build crunchstat package.

9 years agoInitial commit of the scripts used in our Jenkins pipelines.
Ward Vandewege [Tue, 3 Jun 2014 15:25:10 +0000 (11:25 -0400)]
Initial commit of the scripts used in our Jenkins pipelines.

9 years agoOnly check master, because bad things happen otherwise.
Ward Vandewege [Wed, 28 May 2014 16:01:16 +0000 (12:01 -0400)]
Only check master, because bad things happen otherwise.

9 years agoCoding standards hook, initial commit.
Ward Vandewege [Wed, 28 May 2014 15:45:43 +0000 (11:45 -0400)]
Coding standards hook, initial commit.