Ward Vandewege [Thu, 26 Apr 2018 02:22:11 +0000 (22:22 -0400)]
Support -j argument on run-cwl-test.sh script, to parallelize the CWL
tests.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Fernando Monserrat [Fri, 9 Feb 2018 20:30:47 +0000 (17:30 -0300)]
refs #13038 fix script permission
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>
Fernando Monserrat [Fri, 9 Feb 2018 20:25:41 +0000 (17:25 -0300)]
"Merge branch '13038-build-package-r'".
refs #13038
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>
Fernando Monserrat [Fri, 9 Feb 2018 20:21:05 +0000 (17:21 -0300)]
#13056 fix missing quote
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>
Fernando Monserrat [Fri, 9 Feb 2018 20:02:44 +0000 (17:02 -0300)]
#13056 add packaing for R
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>
Fernando Monserrat [Fri, 9 Feb 2018 16:55:44 +0000 (13:55 -0300)]
#13056 update destination path on public
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>
Fernando Monserrat [Thu, 8 Feb 2018 20:05:57 +0000 (17:05 -0300)]
#13038 package r sdk and upload it to public
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>
Nico Cesar [Tue, 9 Jan 2018 18:30:46 +0000 (13:30 -0500)]
12353: composer build script
refs #12353
Arvados-DCO-1.1-Signed-off-by: Nico Cesar <ncesar@veritasgenetics.com>
Nico Cesar [Tue, 9 Jan 2018 18:28:04 +0000 (13:28 -0500)]
11020: deploying https://ci.curoverse.com/job/pipeline-cleanup
refs #11020
Arvados-DCO-1.1-Signed-off-by: Nico Cesar <ncesar@veritasgenetics.com>
Ward Vandewege [Tue, 9 Jan 2018 03:05:28 +0000 (22:05 -0500)]
When a branch is being deleted, do not enforce the commit blacklist in
all the commits that are being deleted.
refs #11020
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Tue, 9 Jan 2018 02:52:45 +0000 (21:52 -0500)]
When a branch is being deleted, do not enforce the DCO signoff in all
the commits that are being deleted.
refs #11020
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Tue, 9 Jan 2018 02:38:48 +0000 (21:38 -0500)]
Make the DCO signoff script less verbose, and make it handle new
branches correctly.
refs #11020
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Fernando Monserrat [Fri, 17 Nov 2017 17:48:31 +0000 (14:48 -0300)]
refs #1572: commit not committed changes on ci server bringing up to date
update to avoid overwritte uncommited changes on ci
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>
Javier Bértoli [Fri, 17 Nov 2017 15:27:21 +0000 (12:27 -0300)]
Merge branch '11572-separate-repositories'
refs #11572
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@veritasgenetics.com>
Nico Cesar [Wed, 4 Oct 2017 14:23:35 +0000 (10:23 -0400)]
Merge branch '11878-separate-centos-repositories'
refs #11878
Arvados-DCO-1.1-Signed-off-by: Nico Cesar <ncesar@veritasgenetics.com>
Javier Bértoli [Thu, 28 Sep 2017 18:41:02 +0000 (15:41 -0300)]
Separate dev/prod repos for Centos
refs #11878
Ward Vandewege [Thu, 28 Sep 2017 14:47:16 +0000 (10:47 -0400)]
arvados-version-server was moved to the arvados-org repository.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Mon, 25 Sep 2017 00:34:40 +0000 (20:34 -0400)]
Make the short git hash length a configuration parameter, and default it
to 7 (which is the historical default for our packages).
For Debian Stretch, we're now using 9, but our pinning is done in such a
way that the extra characters at the end of the package name are no
problem.
refs #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Sun, 24 Sep 2017 18:39:41 +0000 (14:39 -0400)]
Newer git version (2.11.0) default to 9 characters for the abbreviated
git hash. Explicitly select a minimum of 9 in the code, and adjust tests
to have 9 characters for the return value that is checked.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Tom Clegg [Sat, 23 Sep 2017 02:46:09 +0000 (22:46 -0400)]
Add regexp to recognize new error text.
No issue #
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Javier Bértoli [Thu, 14 Sep 2017 12:51:50 +0000 (09:51 -0300)]
Add missing debian9 target
no issue #
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@veritasgenetics.com>
Javier Bértoli [Wed, 6 Sep 2017 11:03:30 +0000 (08:03 -0300)]
Add stretch to freight
refs #11572
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@veritasgenetics.com>
Tom Clegg [Wed, 26 Jul 2017 17:24:50 +0000 (13:24 -0400)]
Add regexp to recognize new error text.
No issue #
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Wed, 26 Jul 2017 17:17:44 +0000 (13:17 -0400)]
Propagate stderr from child process.
No issue #
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Nico Cesar [Tue, 18 Jul 2017 17:34:07 +0000 (13:34 -0400)]
11980: debian9 is part of the suite
refs #11980
Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curoverse.com>
Nico Cesar [Tue, 18 Jul 2017 17:28:46 +0000 (13:28 -0400)]
Merge branch '11332-arv-cwl-integration-testing'
refs #11332
Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curoverse.com>
Nico Cesar [Tue, 18 Jul 2017 17:24:52 +0000 (13:24 -0400)]
11980: debian9 as a new target
refs #11980
Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curoverse.com>
Javier Bértoli [Mon, 26 Jun 2017 15:35:27 +0000 (12:35 -0300)]
Revert Centos repositories changes. They will be modified later.
refs #11572
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <javier@curoverse.com>
Javier Bértoli [Fri, 23 Jun 2017 18:16:58 +0000 (15:16 -0300)]
Rename repositories to separate stable/dev
refs #11572
Ward Vandewege [Tue, 13 Jun 2017 18:41:59 +0000 (14:41 -0400)]
Add two git hooks to respectively enforce or warn about the DCO signoff
line in each git commit.
refs #2411
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curoverse.com>
Ward Vandewege [Wed, 26 Apr 2017 15:23:00 +0000 (11:23 -0400)]
Remove old tapestry test file, it has been moved to the Tapestry
repository.
No issue #
Ward Vandewege [Mon, 17 Apr 2017 00:11:29 +0000 (20:11 -0400)]
Merge branch '00000-a-v-s-cleanups'
No issue #
Ward Vandewege [Mon, 17 Apr 2017 00:02:06 +0000 (20:02 -0400)]
Merge branch 'master' into 00000-a-v-s-cleanups
Peter Amstutz [Mon, 10 Apr 2017 20:22:12 +0000 (16:22 -0400)]
Add --disable-reuse to run-cwl-test.sh/arvados-cwl-runner-with-checksum.sh refs #11332
Peter Amstutz [Fri, 7 Apr 2017 13:52:21 +0000 (09:52 -0400)]
11332: Check exit code after running CWL conformance tests
Peter Amstutz [Fri, 7 Apr 2017 13:42:22 +0000 (09:42 -0400)]
11332: Add /arvados/v1/repositories to token scope documentation of
run-cwl-test.sh. Refactor into --scopes option.
Peter Amstutz [Thu, 6 Apr 2017 21:23:58 +0000 (17:23 -0400)]
Merge branch '11332-arv-cwl-integration-testing' refs #11332
Peter Amstutz [Thu, 6 Apr 2017 21:21:01 +0000 (17:21 -0400)]
11332: clone repos with --depth 1 to reduce bandwidth/disk usage.
Peter Amstutz [Thu, 6 Apr 2017 16:52:21 +0000 (12:52 -0400)]
11332: Run arvados-specific CWL integration tests defined in
arvados/sdk/cwl/tests/arvados-tests.yml
Javier Bértoli [Thu, 30 Mar 2017 21:27:07 +0000 (18:27 -0300)]
Make delete script a little more verbose. Update remote branches before deleting
refs #11020
Ward Vandewege [Thu, 23 Mar 2017 21:05:48 +0000 (17:05 -0400)]
arvados-version-server:
* more refactoring
No issue #
Peter Amstutz [Mon, 20 Mar 2017 16:56:26 +0000 (12:56 -0400)]
install-arvados-jobs-image: Delete check for Docker image+repo already exists
because it incorrectly skips upload in circumstances when the image+repo exists
but associated with the wrong different image hash (such as wrong image
format). refs #8567
Ward Vandewege [Fri, 24 Feb 2017 22:57:47 +0000 (17:57 -0500)]
arvados-version-server:
* style improvements: don't stutter
* test improvement: stop printing log output during tests
No issue #
Ward Vandewege [Tue, 21 Feb 2017 21:39:02 +0000 (16:39 -0500)]
Fix detection of version of arvados/jobs image to install.
No issue #
Ward Vandewege [Tue, 14 Feb 2017 18:27:32 +0000 (13:27 -0500)]
Add a new component, arvados-version-server.
No issue #
Ward Vandewege [Tue, 14 Feb 2017 18:25:00 +0000 (13:25 -0500)]
Add copyright notices to (almost) all files in this repository.
No issue #
Ward Vandewege [Tue, 14 Feb 2017 18:19:54 +0000 (13:19 -0500)]
Remove unused easy-docker-install.sh script.
No issue #
Ward Vandewege [Tue, 14 Feb 2017 16:15:38 +0000 (11:15 -0500)]
Docker 1.13 doesn't support tag --force anymore. Detect that.
No issue #
Ward Vandewege [Tue, 14 Feb 2017 15:35:34 +0000 (10:35 -0500)]
The docker tag -f flag is now --force.
No issue #
Javier Bértoli [Wed, 1 Feb 2017 14:59:12 +0000 (11:59 -0300)]
Merge branch '9050-script-to-delete-merged-branches'
refs #9050
Nico Cesar [Tue, 31 Jan 2017 22:15:48 +0000 (17:15 -0500)]
Merge branch '10769-diagnostics-9tee4'
refs #10769
Ward Vandewege [Sat, 28 Jan 2017 16:56:56 +0000 (11:56 -0500)]
Remove centos6 from our package upload script.
refs #10786
Ward Vandewege [Sat, 28 Jan 2017 16:56:05 +0000 (11:56 -0500)]
Remove debian7 from our package upload script.
refs #10785
Nico Cesar [Fri, 27 Jan 2017 13:51:31 +0000 (08:51 -0500)]
10769: added diagnostics for container requests in 9tee4
refs #10769
Ward Vandewege [Fri, 27 Jan 2017 00:43:50 +0000 (19:43 -0500)]
Add support for ubuntu1604 to run_upload_packages.py.
refs #10980
Ward Vandewege [Mon, 23 Jan 2017 18:55:50 +0000 (13:55 -0500)]
Abort diagnostics suite with prejudice if the git checkout fails.
No issue #
Ward Vandewege [Mon, 23 Jan 2017 18:35:21 +0000 (13:35 -0500)]
Abort performance suite with prejudice if the git checkout fails.
No issue #
Javier Bértoli [Thu, 19 Jan 2017 20:45:37 +0000 (17:45 -0300)]
Add script to delete merged branches
refs #9050
Ward Vandewege [Fri, 23 Dec 2016 13:39:02 +0000 (08:39 -0500)]
We now have improved mailchimp plugin packaging, this hack is no longer needed.
refs #9982
Nico Cesar [Fri, 2 Dec 2016 13:21:25 +0000 (08:21 -0500)]
parameters were not well parsed
refs #10657
Ward Vandewege [Thu, 1 Dec 2016 15:46:53 +0000 (10:46 -0500)]
Add additional scopes needed to run cwl tests on Crunch_v2
refs #10113
Ward Vandewege [Tue, 29 Nov 2016 18:11:04 +0000 (13:11 -0500)]
run-deploy.sh: make the concurrency of running puppet a configurable parameter.
No issue #
Peter Amstutz [Fri, 4 Nov 2016 14:06:09 +0000 (10:06 -0400)]
Improve error handling and reporting in run-cwl-test.sh script. no issue #
Peter Amstutz [Wed, 26 Oct 2016 16:09:44 +0000 (12:09 -0400)]
Merge branch '10194-arvados-jobs-version' refs #10194
Peter Amstutz [Tue, 25 Oct 2016 20:31:46 +0000 (16:31 -0400)]
10194: Make sure to install the version of arvados/jobs that arvados_cwl expects.
Tom Clegg [Wed, 19 Oct 2016 11:27:50 +0000 (07:27 -0400)]
Remove excess params in debug message. No issue #
Tom Clegg [Wed, 19 Oct 2016 11:23:22 +0000 (07:23 -0400)]
Bug fixes. No issue #
* Fix syntax errors and logging bug
* Use docker tag --force flag only if offered by docker tag --help
* Detect/fix wrong group_class (bug in install docs)
Tom Clegg [Tue, 18 Oct 2016 16:54:24 +0000 (12:54 -0400)]
Add install-arvados-jobs-image script. No issue #
Ward Vandewege [Fri, 14 Oct 2016 13:36:30 +0000 (09:36 -0400)]
run-cwl-test.sh needs one more permission in its scoped token.
No issue #
Ward Vandewege [Thu, 22 Sep 2016 21:22:17 +0000 (17:22 -0400)]
Add required permissions for run-cwl-test.sh
refs #9459
Ward Vandewege [Thu, 22 Sep 2016 20:59:22 +0000 (16:59 -0400)]
Upgrade run-cwl-test.sh a bit:
* no longer run as root on the destination (ugh, seriously!)
* make it set up its requirements itself if they aren't present
No issue #
Nico Cesar [Thu, 25 Aug 2016 19:20:00 +0000 (15:20 -0400)]
fixed bug on the way we deploy docker arvados/jobs image.
The group wasn't added to arvados/jobs image, making the query of CWL runs using an old image, with an old cwl-runner
refs #9856
Peter Amstutz [Wed, 17 Aug 2016 14:15:22 +0000 (10:15 -0400)]
Merge branch '9784-update-scopes' closes #9784
Peter Amstutz [Mon, 15 Aug 2016 20:10:15 +0000 (20:10 +0000)]
Remove CWL test exclusions, no issue #
Peter Amstutz [Mon, 15 Aug 2016 18:30:35 +0000 (14:30 -0400)]
9784: Update scopes to the ones actually in use by CI.
Tom Clegg [Thu, 28 Jul 2016 18:45:42 +0000 (14:45 -0400)]
Use wrapper to enable checksums in cwl conformance tests.
refs #9552
Nico Cesar [Sun, 17 Jul 2016 20:29:51 +0000 (16:29 -0400)]
added run-cwl-test.sh for running cwl-test on the clusters
refs #9459
Ward Vandewege [Sat, 16 Jul 2016 20:12:19 +0000 (16:12 -0400)]
Make sure to tag the docker image as latest even if it already exists.
refs #9254
Nico Cesar [Wed, 29 Jun 2016 18:23:33 +0000 (14:23 -0400)]
Merge branch '9254-latest-tag'
refs #9254
Nico Cesar [Wed, 29 Jun 2016 17:35:52 +0000 (13:35 -0400)]
9254: adding latest tag https://dev.arvados.org/issues/9254#note-4
refs #9254
Nico Cesar [Thu, 16 Jun 2016 18:42:02 +0000 (14:42 -0400)]
Merge branch '8750-run-deploy-in-parallel'
closes #8750
Brett Smith [Wed, 15 Jun 2016 17:59:40 +0000 (13:59 -0400)]
run_upload_packages: Improve names around run_and_grep.
No issue #, just easier to comprehend I hope.
Brett Smith [Wed, 15 Jun 2016 17:54:12 +0000 (13:54 -0400)]
run_upload_packages ensures destination scp directory exists.
This prevents build failures like
<https://ci.curoverse.com/job/build-packages-sso/24/console>.
No issue #.
Brett Smith [Wed, 15 Jun 2016 15:30:17 +0000 (11:30 -0400)]
Merge branch '9309-python-redundant-upload-wip'
Refs #9309. Closes #9393.
Nico Cesar [Tue, 14 Jun 2016 15:33:53 +0000 (11:33 -0400)]
8750: parallel deploy is working
in the old code there was a serial excecution that collected exitcodes
EXITCODE=$(($EXITCODE + $ECODE))
in the new code we'll have to re-think this. But this first commit actually deploys in parallel
Brett Smith [Fri, 10 Jun 2016 15:43:00 +0000 (11:43 -0400)]
9309: run_upload_packages checks for re-upload errors from PyPI.
We are getting this new error after upgrading ci to jessie.
Brett Smith [Wed, 1 Jun 2016 19:27:38 +0000 (15:27 -0400)]
Merge branch '9309-centos7-uplaods-wip'
Refs #9309.
Brett Smith [Sat, 28 May 2016 03:31:56 +0000 (23:31 -0400)]
9309: Add support for uploading centos7 packages.
Brett Smith [Sat, 28 May 2016 03:24:13 +0000 (23:24 -0400)]
9224: Update each TimestampFile after upload.
This is a follow-up to
2fecb120e5b9be7a85f209e90114731f3e95f709.
Ward Vandewege [Tue, 17 May 2016 01:00:08 +0000 (21:00 -0400)]
Remove a bunch of files that were moved to the arvados repository.
No issue #
Ward Vandewege [Tue, 17 May 2016 00:54:39 +0000 (20:54 -0400)]
We need a per-target last_upload timestamp file.
refs #9224
Peter Amstutz [Wed, 20 Apr 2016 20:24:29 +0000 (16:24 -0400)]
CWL build script maintenance. refs #8980
Nico Cesar [Sat, 26 Mar 2016 00:42:17 +0000 (20:42 -0400)]
adding an extra script for parallel puppet runs
refs #8750
Ward Vandewege [Sat, 19 Mar 2016 16:41:54 +0000 (12:41 -0400)]
The upload script now uses a per-distro tmp directory.
No issue #
Tom Clegg [Wed, 16 Mar 2016 07:43:06 +0000 (03:43 -0400)]
Fix backports dir search for PACKAGE="llfuse==0.41.1". refs #8345
Tom Clegg [Fri, 11 Mar 2016 18:35:13 +0000 (13:35 -0500)]
Merge branch '8345-llfuse-unpin' refs #8345
Tom Clegg [Fri, 11 Mar 2016 17:28:53 +0000 (12:28 -0500)]
8345: Need "yum install -y" to reliably install rpm packages.
Tom Clegg [Fri, 11 Mar 2016 07:15:10 +0000 (02:15 -0500)]
8345: 8491: Downgrade to llfuse 0.41 until #8345 gets sorted out (but keep the fuse backports).
Ward Vandewege [Thu, 10 Mar 2016 19:06:38 +0000 (14:06 -0500)]
Get the go binary from a http url instead of https, so that our
transparent proxy can cache it.
No issue #
Ward Vandewege [Thu, 10 Mar 2016 19:05:21 +0000 (14:05 -0500)]
Build package for arvados-cwl-runner.
refs #8671
projects / arvados-dev.git / log