Ward Vandewege [Wed, 5 Feb 2020 21:24:02 +0000 (16:24 -0500)]
Run docker tag latest on the node from which we will run arv-keepdocker
tag latest.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>
Ward Vandewege [Wed, 5 Feb 2020 16:56:21 +0000 (11:56 -0500)]
Make sure all the ssh calls in run-deploy.sh use the supplied connection
parameters
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>
Peter Amstutz [Thu, 30 Jan 2020 16:23:49 +0000 (11:23 -0500)]
Update deploy script to include API server for ce8i5
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Wed, 29 Jan 2020 21:10:35 +0000 (21:10 +0000)]
run deploy workbench2 for ce8i5
Peter Amstutz [Mon, 27 Jan 2020 22:55:08 +0000 (17:55 -0500)]
Increase js eval timeout for run-cwl-tests another up to 60s
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Mon, 27 Jan 2020 14:58:12 +0000 (09:58 -0500)]
Increase js eval timeout for run-cwl-tests
Remove unused legacy run-cwl-test script
no issue #
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Fri, 24 Jan 2020 16:29:04 +0000 (11:29 -0500)]
Fix target check
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Fri, 24 Jan 2020 16:22:58 +0000 (11:22 -0500)]
Make dev/testing selectable instead of having a second copy-pasted script
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Thu, 9 Jan 2020 20:52:10 +0000 (15:52 -0500)]
Simplify PACKAGE_LIST sed line
no issue #
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Thu, 9 Jan 2020 19:57:23 +0000 (19:57 +0000)]
upload_packages_testing_to_stable.sh add trailing '*' to package patterns
run-cwl-test.sh: log ssh command on DEBUG
no issue #
Ward Vandewege [Tue, 7 Jan 2020 15:36:39 +0000 (10:36 -0500)]
Bugfix in run-deploy.sh: the run_command needs to return its output.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>
Ward Vandewege [Fri, 20 Dec 2019 00:39:37 +0000 (19:39 -0500)]
ce8i5 now has a shell node, too.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>
Ward Vandewege [Thu, 19 Dec 2019 19:53:48 +0000 (14:53 -0500)]
Add support for unmanaged-by-puppet clusters to the deploy script, and
also specifically support ce8i5.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>
Ward Vandewege [Thu, 19 Dec 2019 15:24:24 +0000 (10:24 -0500)]
Fix comment in run-deploy.sh
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>
Fernando Monserrat [Wed, 20 Nov 2019 18:37:34 +0000 (15:37 -0300)]
Add support for Debian 10 (aka 'Buster') to run_upload_packages.py
refs #15845
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>
Ward Vandewege [Wed, 25 Sep 2019 17:44:51 +0000 (13:44 -0400)]
run-deploy.sh improvements:
* make sure all arv-keepdocker calls include the project id.
* add some extra verbosity before arv-keepdocker call to tag the arvados/jobs image that exists
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Wed, 25 Sep 2019 17:05:54 +0000 (13:05 -0400)]
run-deploy.sh fix: be consistent in how we call arv-keepdocker.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Fri, 13 Sep 2019 13:55:12 +0000 (09:55 -0400)]
run-deploy fixes:
* when getting GIT_COMMIT, exclude stderr
* unload RVM before running puppet
refs #15630
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Thu, 2 May 2019 15:10:21 +0000 (11:10 -0400)]
Be consistent about how we run the arv command.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Thu, 2 May 2019 15:00:48 +0000 (11:00 -0400)]
run-deploy.sh should also handle pre-1.4 installations.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Thu, 2 May 2019 14:17:01 +0000 (10:17 -0400)]
Fix ARVADOS_API_TOKEN munging in logs.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Fernando Monserrat [Tue, 5 Mar 2019 21:12:32 +0000 (18:12 -0300)]
refs #14891 .Merge branch '14891-upload-to-testing-repo'
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>
Fernando Monserrat [Tue, 5 Mar 2019 21:11:06 +0000 (18:11 -0300)]
issue #14891 add scripts to publish packages from testing to stable
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>
Fernando Monserrat [Tue, 5 Mar 2019 19:16:10 +0000 (16:16 -0300)]
issue #14891 adding python script to upload release candidates to testing repo
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>
Ward Vandewege [Thu, 7 Feb 2019 17:41:23 +0000 (12:41 -0500)]
Now python-arvados-cwl-runner includes a virtualenv, make sure to use its
python executable when importing the arvados_cwl python module.
refs #9945
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Thu, 11 Oct 2018 16:26:39 +0000 (12:26 -0400)]
Run CWL tests on the containers API.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Thu, 23 Aug 2018 13:26:48 +0000 (09:26 -0400)]
Add support for ubuntu 18.04 (aka 'bionic') to run_upload_packages.py
refs #13823
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Peter Amstutz [Mon, 13 Aug 2018 19:59:45 +0000 (15:59 -0400)]
Increase the timeout on a single CWL test to 900 seconds (15 minutes)
This is to accomodate the observation that occasionally waiting for a
compute node to become available exceeds a 10 minute test timeout, but
had it had a little more time the test would have succeeded.
no issue #
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>
Ward Vandewege [Tue, 19 Jun 2018 17:44:21 +0000 (13:44 -0400)]
Add option to deploy just one node to the run_deploy.sh script.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Fri, 15 Jun 2018 19:22:11 +0000 (15:22 -0400)]
* Add a 'local' mode to jenkins/run-cwl-test.sh, where arvados-cwl-runner runs
locally
* Make fewer assumptions about the remote Arvados cluster.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Fri, 25 May 2018 20:48:14 +0000 (16:48 -0400)]
When enforcing copyright headers, do not consider commits that are already part
of the git history of the repository.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Wed, 23 May 2018 21:47:20 +0000 (17:47 -0400)]
Change the pattern matching for our copyright header so that it doesn't croak
on files that are copyright someone else.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Wed, 23 May 2018 21:21:16 +0000 (17:21 -0400)]
Be a little more verbose about the presence of the copyright header check.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Wed, 23 May 2018 21:17:15 +0000 (17:17 -0400)]
Add a git hook to ensure that all commits adhere to the copyright header
convention for the Arvados project.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Thu, 26 Apr 2018 02:22:11 +0000 (22:22 -0400)]
Support -j argument on run-cwl-test.sh script, to parallelize the CWL
tests.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Fernando Monserrat [Fri, 9 Feb 2018 20:30:47 +0000 (17:30 -0300)]
refs #13038 fix script permission
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>
Fernando Monserrat [Fri, 9 Feb 2018 20:25:41 +0000 (17:25 -0300)]
"Merge branch '13038-build-package-r'".
refs #13038
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>
Fernando Monserrat [Fri, 9 Feb 2018 20:21:05 +0000 (17:21 -0300)]
#13056 fix missing quote
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>
Fernando Monserrat [Fri, 9 Feb 2018 20:02:44 +0000 (17:02 -0300)]
#13056 add packaing for R
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>
Fernando Monserrat [Fri, 9 Feb 2018 16:55:44 +0000 (13:55 -0300)]
#13056 update destination path on public
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>
Fernando Monserrat [Thu, 8 Feb 2018 20:05:57 +0000 (17:05 -0300)]
#13038 package r sdk and upload it to public
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>
Nico Cesar [Tue, 9 Jan 2018 18:30:46 +0000 (13:30 -0500)]
12353: composer build script
refs #12353
Arvados-DCO-1.1-Signed-off-by: Nico Cesar <ncesar@veritasgenetics.com>
Nico Cesar [Tue, 9 Jan 2018 18:28:04 +0000 (13:28 -0500)]
11020: deploying https://ci.curoverse.com/job/pipeline-cleanup
refs #11020
Arvados-DCO-1.1-Signed-off-by: Nico Cesar <ncesar@veritasgenetics.com>
Ward Vandewege [Tue, 9 Jan 2018 03:05:28 +0000 (22:05 -0500)]
When a branch is being deleted, do not enforce the commit blacklist in
all the commits that are being deleted.
refs #11020
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Tue, 9 Jan 2018 02:52:45 +0000 (21:52 -0500)]
When a branch is being deleted, do not enforce the DCO signoff in all
the commits that are being deleted.
refs #11020
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Tue, 9 Jan 2018 02:38:48 +0000 (21:38 -0500)]
Make the DCO signoff script less verbose, and make it handle new
branches correctly.
refs #11020
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Fernando Monserrat [Fri, 17 Nov 2017 17:48:31 +0000 (14:48 -0300)]
refs #1572: commit not committed changes on ci server bringing up to date
update to avoid overwritte uncommited changes on ci
Arvados-DCO-1.1-Signed-off-by: Fernando Monserrat <fmonserrat@veritasgenetics.com>
Javier Bértoli [Fri, 17 Nov 2017 15:27:21 +0000 (12:27 -0300)]
Merge branch '11572-separate-repositories'
refs #11572
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@veritasgenetics.com>
Nico Cesar [Wed, 4 Oct 2017 14:23:35 +0000 (10:23 -0400)]
Merge branch '11878-separate-centos-repositories'
refs #11878
Arvados-DCO-1.1-Signed-off-by: Nico Cesar <ncesar@veritasgenetics.com>
Javier Bértoli [Thu, 28 Sep 2017 18:41:02 +0000 (15:41 -0300)]
Separate dev/prod repos for Centos
refs #11878
Ward Vandewege [Thu, 28 Sep 2017 14:47:16 +0000 (10:47 -0400)]
arvados-version-server was moved to the arvados-org repository.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Mon, 25 Sep 2017 00:34:40 +0000 (20:34 -0400)]
Make the short git hash length a configuration parameter, and default it
to 7 (which is the historical default for our packages).
For Debian Stretch, we're now using 9, but our pinning is done in such a
way that the extra characters at the end of the package name are no
problem.
refs #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Ward Vandewege [Sun, 24 Sep 2017 18:39:41 +0000 (14:39 -0400)]
Newer git version (2.11.0) default to 9 characters for the abbreviated
git hash. Explicitly select a minimum of 9 in the code, and adjust tests
to have 9 characters for the return value that is checked.
No issue #
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>
Tom Clegg [Sat, 23 Sep 2017 02:46:09 +0000 (22:46 -0400)]
Add regexp to recognize new error text.
No issue #
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>
Javier Bértoli [Thu, 14 Sep 2017 12:51:50 +0000 (09:51 -0300)]
Add missing debian9 target
no issue #
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@veritasgenetics.com>
Javier Bértoli [Wed, 6 Sep 2017 11:03:30 +0000 (08:03 -0300)]
Add stretch to freight
refs #11572
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <jbertoli@veritasgenetics.com>
Tom Clegg [Wed, 26 Jul 2017 17:24:50 +0000 (13:24 -0400)]
Add regexp to recognize new error text.
No issue #
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Wed, 26 Jul 2017 17:17:44 +0000 (13:17 -0400)]
Propagate stderr from child process.
No issue #
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Nico Cesar [Tue, 18 Jul 2017 17:34:07 +0000 (13:34 -0400)]
11980: debian9 is part of the suite
refs #11980
Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curoverse.com>
Nico Cesar [Tue, 18 Jul 2017 17:28:46 +0000 (13:28 -0400)]
Merge branch '11332-arv-cwl-integration-testing'
refs #11332
Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curoverse.com>
Nico Cesar [Tue, 18 Jul 2017 17:24:52 +0000 (13:24 -0400)]
11980: debian9 as a new target
refs #11980
Arvados-DCO-1.1-Signed-off-by: Nico Cesar <nico@curoverse.com>
Javier Bértoli [Mon, 26 Jun 2017 15:35:27 +0000 (12:35 -0300)]
Revert Centos repositories changes. They will be modified later.
refs #11572
Arvados-DCO-1.1-Signed-off-by: Javier Bértoli <javier@curoverse.com>
Javier Bértoli [Fri, 23 Jun 2017 18:16:58 +0000 (15:16 -0300)]
Rename repositories to separate stable/dev
refs #11572
Ward Vandewege [Tue, 13 Jun 2017 18:41:59 +0000 (14:41 -0400)]
Add two git hooks to respectively enforce or warn about the DCO signoff
line in each git commit.
refs #2411
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curoverse.com>
Ward Vandewege [Wed, 26 Apr 2017 15:23:00 +0000 (11:23 -0400)]
Remove old tapestry test file, it has been moved to the Tapestry
repository.
No issue #
Ward Vandewege [Mon, 17 Apr 2017 00:11:29 +0000 (20:11 -0400)]
Merge branch '00000-a-v-s-cleanups'
No issue #
Ward Vandewege [Mon, 17 Apr 2017 00:02:06 +0000 (20:02 -0400)]
Merge branch 'master' into 00000-a-v-s-cleanups
Peter Amstutz [Mon, 10 Apr 2017 20:22:12 +0000 (16:22 -0400)]
Add --disable-reuse to run-cwl-test.sh/arvados-cwl-runner-with-checksum.sh refs #11332
Peter Amstutz [Fri, 7 Apr 2017 13:52:21 +0000 (09:52 -0400)]
11332: Check exit code after running CWL conformance tests
Peter Amstutz [Fri, 7 Apr 2017 13:42:22 +0000 (09:42 -0400)]
11332: Add /arvados/v1/repositories to token scope documentation of
run-cwl-test.sh. Refactor into --scopes option.
Peter Amstutz [Thu, 6 Apr 2017 21:23:58 +0000 (17:23 -0400)]
Merge branch '11332-arv-cwl-integration-testing' refs #11332
Peter Amstutz [Thu, 6 Apr 2017 21:21:01 +0000 (17:21 -0400)]
11332: clone repos with --depth 1 to reduce bandwidth/disk usage.
Peter Amstutz [Thu, 6 Apr 2017 16:52:21 +0000 (12:52 -0400)]
11332: Run arvados-specific CWL integration tests defined in
arvados/sdk/cwl/tests/arvados-tests.yml
Javier Bértoli [Thu, 30 Mar 2017 21:27:07 +0000 (18:27 -0300)]
Make delete script a little more verbose. Update remote branches before deleting
refs #11020
Ward Vandewege [Thu, 23 Mar 2017 21:05:48 +0000 (17:05 -0400)]
arvados-version-server:
* more refactoring
No issue #
Peter Amstutz [Mon, 20 Mar 2017 16:56:26 +0000 (12:56 -0400)]
install-arvados-jobs-image: Delete check for Docker image+repo already exists
because it incorrectly skips upload in circumstances when the image+repo exists
but associated with the wrong different image hash (such as wrong image
format). refs #8567
Ward Vandewege [Fri, 24 Feb 2017 22:57:47 +0000 (17:57 -0500)]
arvados-version-server:
* style improvements: don't stutter
* test improvement: stop printing log output during tests
No issue #
Ward Vandewege [Tue, 21 Feb 2017 21:39:02 +0000 (16:39 -0500)]
Fix detection of version of arvados/jobs image to install.
No issue #
Ward Vandewege [Tue, 14 Feb 2017 18:27:32 +0000 (13:27 -0500)]
Add a new component, arvados-version-server.
No issue #
Ward Vandewege [Tue, 14 Feb 2017 18:25:00 +0000 (13:25 -0500)]
Add copyright notices to (almost) all files in this repository.
No issue #
Ward Vandewege [Tue, 14 Feb 2017 18:19:54 +0000 (13:19 -0500)]
Remove unused easy-docker-install.sh script.
No issue #
Ward Vandewege [Tue, 14 Feb 2017 16:15:38 +0000 (11:15 -0500)]
Docker 1.13 doesn't support tag --force anymore. Detect that.
No issue #
Ward Vandewege [Tue, 14 Feb 2017 15:35:34 +0000 (10:35 -0500)]
The docker tag -f flag is now --force.
No issue #
Javier Bértoli [Wed, 1 Feb 2017 14:59:12 +0000 (11:59 -0300)]
Merge branch '9050-script-to-delete-merged-branches'
refs #9050
Nico Cesar [Tue, 31 Jan 2017 22:15:48 +0000 (17:15 -0500)]
Merge branch '10769-diagnostics-9tee4'
refs #10769
Ward Vandewege [Sat, 28 Jan 2017 16:56:56 +0000 (11:56 -0500)]
Remove centos6 from our package upload script.
refs #10786
Ward Vandewege [Sat, 28 Jan 2017 16:56:05 +0000 (11:56 -0500)]
Remove debian7 from our package upload script.
refs #10785
Nico Cesar [Fri, 27 Jan 2017 13:51:31 +0000 (08:51 -0500)]
10769: added diagnostics for container requests in 9tee4
refs #10769
Ward Vandewege [Fri, 27 Jan 2017 00:43:50 +0000 (19:43 -0500)]
Add support for ubuntu1604 to run_upload_packages.py.
refs #10980
Ward Vandewege [Mon, 23 Jan 2017 18:55:50 +0000 (13:55 -0500)]
Abort diagnostics suite with prejudice if the git checkout fails.
No issue #
Ward Vandewege [Mon, 23 Jan 2017 18:35:21 +0000 (13:35 -0500)]
Abort performance suite with prejudice if the git checkout fails.
No issue #
Javier Bértoli [Thu, 19 Jan 2017 20:45:37 +0000 (17:45 -0300)]
Add script to delete merged branches
refs #9050
Ward Vandewege [Fri, 23 Dec 2016 13:39:02 +0000 (08:39 -0500)]
We now have improved mailchimp plugin packaging, this hack is no longer needed.
refs #9982
Nico Cesar [Fri, 2 Dec 2016 13:21:25 +0000 (08:21 -0500)]
parameters were not well parsed
refs #10657
Ward Vandewege [Thu, 1 Dec 2016 15:46:53 +0000 (10:46 -0500)]
Add additional scopes needed to run cwl tests on Crunch_v2
refs #10113
Ward Vandewege [Tue, 29 Nov 2016 18:11:04 +0000 (13:11 -0500)]
run-deploy.sh: make the concurrency of running puppet a configurable parameter.
No issue #
Peter Amstutz [Fri, 4 Nov 2016 14:06:09 +0000 (10:06 -0400)]
Improve error handling and reporting in run-cwl-test.sh script. no issue #
Peter Amstutz [Wed, 26 Oct 2016 16:09:44 +0000 (12:09 -0400)]
Merge branch '10194-arvados-jobs-version' refs #10194
Peter Amstutz [Tue, 25 Oct 2016 20:31:46 +0000 (16:31 -0400)]
10194: Make sure to install the version of arvados/jobs that arvados_cwl expects.
Tom Clegg [Wed, 19 Oct 2016 11:27:50 +0000 (07:27 -0400)]
Remove excess params in debug message. No issue #
projects / arvados-dev.git / log