Tom Clegg [Tue, 19 Nov 2013 20:19:53 +0000 (12:19 -0800)]
Refuse to stream responses unless request Accept header has text/plain
or */*. Closes #1604
Tom Clegg [Tue, 19 Nov 2013 20:18:12 +0000 (12:18 -0800)]
Send "Accept: application/json" header with API requests. refs #1604
Tim Pierce [Tue, 19 Nov 2013 20:15:31 +0000 (15:15 -0500)]
Merge branch 'master' of git.clinicalfuture.com:arvados
Tim Pierce [Tue, 19 Nov 2013 20:15:04 +0000 (15:15 -0500)]
Updated Makefile for more accurate dependency management.
Tom Clegg [Tue, 19 Nov 2013 18:00:49 +0000 (10:00 -0800)]
Move api/job-tasks to api/crunch-scripts and add some explanation
Tom Clegg [Tue, 19 Nov 2013 17:21:32 +0000 (09:21 -0800)]
Fix navorder of API resource pages
Tim Pierce [Tue, 19 Nov 2013 17:44:34 +0000 (12:44 -0500)]
Merge branch 'master' of git.clinicalfuture.com:arvados
Conflicts:
docker/base/Dockerfile
Tim Pierce [Tue, 19 Nov 2013 17:35:58 +0000 (12:35 -0500)]
Added Makefile to track dependencies for Docker images.
Ward Vandewege [Tue, 19 Nov 2013 17:22:17 +0000 (12:22 -0500)]
Update the dockserver Dockerfile to take advantage of the doc/Gemfile,
as well as the fact that locale generation and the DEBIAN_FRONTEND
environment variable are now set in the base container.
Ward Vandewege [Tue, 19 Nov 2013 17:21:43 +0000 (12:21 -0500)]
Merge branch 'master' of git.clinicalfuture.com:arvados
Ward Vandewege [Tue, 19 Nov 2013 17:21:14 +0000 (12:21 -0500)]
Move UTF-8 locale generation and the DEBIAN_FRONTEND environment setting
into the base image.
Tom Clegg [Tue, 19 Nov 2013 17:09:51 +0000 (09:09 -0800)]
Fix job script attribute (not script_name), and update script_version
notes to match current code
Tom Clegg [Tue, 19 Nov 2013 16:54:50 +0000 (08:54 -0800)]
Do not re-attempt failed job tasks, unless there is some reason to
believe the failure is temporary (i.e., exit value 111 or slurm
failure). closes #1619
Tom Clegg [Tue, 19 Nov 2013 16:45:36 +0000 (08:45 -0800)]
Update development-mode crunch-job notes
Tom Clegg [Tue, 19 Nov 2013 16:43:21 +0000 (08:43 -0800)]
add doc/Gemfile
Tom Clegg [Tue, 19 Nov 2013 16:42:29 +0000 (08:42 -0800)]
Document user#event_stream. closes #1605
Ward Vandewege [Tue, 19 Nov 2013 16:25:07 +0000 (11:25 -0500)]
* OMNIAUTH_APP_SECRET is no longer used
* We include an omniauth-to-openid gateway container now ('sso')
Tom Clegg [Tue, 19 Nov 2013 09:04:58 +0000 (01:04 -0800)]
Add threading locks in Keep client
Tom Clegg [Tue, 19 Nov 2013 09:02:46 +0000 (01:02 -0800)]
remove unused class DataReader
Tom Clegg [Tue, 19 Nov 2013 08:38:38 +0000 (00:38 -0800)]
Ensure script_version matches before satisfying pipeline component with a job.
Tom Clegg [Tue, 19 Nov 2013 08:37:03 +0000 (00:37 -0800)]
Add /users/:uuid/event_stream action to subscribe to per-user channel
Tom Clegg [Tue, 19 Nov 2013 08:16:22 +0000 (00:16 -0800)]
Send job log messages to owner_uuid redis channel
Tom Clegg [Tue, 19 Nov 2013 00:40:40 +0000 (16:40 -0800)]
Read pipeline template from local file if --template arg is not a uuid
Ward Vandewege [Tue, 19 Nov 2013 03:30:19 +0000 (22:30 -0500)]
un-comment ADD line for api.tar
Ward Vandewege [Tue, 19 Nov 2013 03:24:03 +0000 (22:24 -0500)]
Let API server use SSO container.
This doesn't work quite yet - need to sort out inter-container
communication. But it's very close now.
Ward Vandewege [Tue, 19 Nov 2013 03:23:44 +0000 (22:23 -0500)]
Fixes for SSO rails app.
Ward Vandewege [Tue, 19 Nov 2013 02:51:38 +0000 (21:51 -0500)]
Generated files shouldn't have been committed.
Ward Vandewege [Mon, 18 Nov 2013 22:25:29 +0000 (17:25 -0500)]
Merge branch 'master' of git.clinicalfuture.com:arvados
Conflicts:
docker/build.sh
docker/config.yml.example
Tim Pierce [Mon, 18 Nov 2013 21:50:38 +0000 (16:50 -0500)]
Merge branch '1579-keep-server-in-docker' of git.clinicalfuture.com:arvados into 1579-keep-server-in-docker
Tim Pierce [Mon, 18 Nov 2013 20:06:21 +0000 (15:06 -0500)]
Install warehouse-apps into arvados/warehouse directly from github source.
Tim Pierce [Fri, 15 Nov 2013 23:52:56 +0000 (18:52 -0500)]
Add prerequisites for Keep server described in
https://github.com/clinicalfuture/warehouse-apps/blob/master/libwarehouse-perl/server/INSTALL
Tim Pierce [Thu, 14 Nov 2013 22:54:55 +0000 (17:54 -0500)]
Add supervisor to start keepd when container is launched.
Update README with deploy instructions for Keep.
Tim Pierce [Thu, 14 Nov 2013 20:49:18 +0000 (15:49 -0500)]
Build an arvados/warehouse container with locally checked out warehouse-apps
code.
The warehouse-apps repo at git://github.com/clinicalfuture/warehouse-apps.git
must be checked out at the same level as the arvados repo.
Tim Pierce [Fri, 8 Nov 2013 22:30:59 +0000 (17:30 -0500)]
Initial checkin for building warehouse-apps.
Tim Pierce [Thu, 14 Nov 2013 07:10:05 +0000 (02:10 -0500)]
Deploy containers with working copy of sources.
Tom Clegg [Mon, 18 Nov 2013 20:49:13 +0000 (12:49 -0800)]
Revert anjlab-bootstrap-rails to version 2 because bootstrap-editable
is not ready for bootstrap 3 yet.
Tim Pierce [Mon, 18 Nov 2013 20:06:21 +0000 (15:06 -0500)]
Install warehouse-apps into arvados/warehouse directly from github source.
Tom Clegg [Mon, 18 Nov 2013 19:53:00 +0000 (11:53 -0800)]
Move @redis.exists and .getrange outside .subscribe block. Otherwise
they fail silently and the client does not get any of the buffered log
messages.
Ward Vandewege [Mon, 18 Nov 2013 19:49:21 +0000 (14:49 -0500)]
Add SSO docker container
Ward Vandewege [Mon, 18 Nov 2013 19:47:35 +0000 (14:47 -0500)]
Bring the name of the workbench secret token config variable in line.
Tom Clegg [Mon, 18 Nov 2013 19:38:10 +0000 (11:38 -0800)]
Avoid Rails cache when polling database for latest node/job state
Ward Vandewege [Mon, 18 Nov 2013 19:36:38 +0000 (14:36 -0500)]
Merge branch 'master' of git.clinicalfuture.com:arvados
Ward Vandewege [Mon, 18 Nov 2013 19:36:15 +0000 (14:36 -0500)]
Also auto-generate _SECRET config variables when they are unset, like we
do for _PW config variables.
Tom Clegg [Mon, 18 Nov 2013 19:21:30 +0000 (11:21 -0800)]
Add Admin/Nodes page
Tom Clegg [Mon, 18 Nov 2013 19:09:44 +0000 (11:09 -0800)]
Include privileged attributes in node#ping response
Tom Clegg [Mon, 18 Nov 2013 18:21:28 +0000 (10:21 -0800)]
add tests for node#ping, fix response when ping_secret is invalid
Tom Clegg [Mon, 18 Nov 2013 18:20:44 +0000 (10:20 -0800)]
Fix crash building api response when user is nil
Tom Clegg [Mon, 18 Nov 2013 04:58:23 +0000 (20:58 -0800)]
Merge branch '1600-native-keep-client'
Tom Clegg [Fri, 15 Nov 2013 16:40:46 +0000 (08:40 -0800)]
Obey ARVADOS_API_HOST_INSECURE and use the debian trusted CA list if
available (instead of skipping certificate validation because Python's
CA list does not include the one we need).
Tom Clegg [Fri, 15 Nov 2013 16:31:54 +0000 (08:31 -0800)]
Allow all active users to retrieve list of keep nodes.
refs #1599
Tom Clegg [Mon, 18 Nov 2013 04:55:19 +0000 (20:55 -0800)]
turn on logging if ARVADOS_DEBUG environment variable exists
Tom Clegg [Mon, 18 Nov 2013 04:54:35 +0000 (20:54 -0800)]
Use hash to determine probe order
Tom Clegg [Mon, 18 Nov 2013 04:28:55 +0000 (20:28 -0800)]
Add test case for reading and writing small Keep blocks
Tom Clegg [Mon, 18 Nov 2013 04:26:23 +0000 (20:26 -0800)]
Use httplib2 to connect to Keep instead of executing whget/whput
Tom Clegg [Fri, 15 Nov 2013 16:40:46 +0000 (08:40 -0800)]
Obey ARVADOS_API_HOST_INSECURE and use the debian trusted CA list if
available (instead of skipping certificate validation because Python's
CA list does not include the one we need).
Tim Pierce [Fri, 15 Nov 2013 23:52:56 +0000 (18:52 -0500)]
Add prerequisites for Keep server described in
https://github.com/clinicalfuture/warehouse-apps/blob/master/libwarehouse-perl/server/INSTALL
Ward Vandewege [Fri, 15 Nov 2013 21:49:35 +0000 (16:49 -0500)]
Improve error handling for login operations.
Tom Clegg [Fri, 15 Nov 2013 16:31:54 +0000 (08:31 -0800)]
Allow all active users to retrieve list of keep nodes.
refs #1599
Tom Clegg [Fri, 15 Nov 2013 16:13:41 +0000 (08:13 -0800)]
fix error message scraping regexp
Tom Clegg [Fri, 15 Nov 2013 15:51:45 +0000 (07:51 -0800)]
Use more current slurm environment variable name in error message scraping
Tom Clegg [Fri, 15 Nov 2013 15:51:02 +0000 (07:51 -0800)]
fix over-compensation for attempts counter when task fails on suspect node
Tom Clegg [Fri, 15 Nov 2013 15:45:20 +0000 (07:45 -0800)]
reduce default #attempts per job task from 9 to 2
Tom Clegg [Fri, 15 Nov 2013 08:15:57 +0000 (00:15 -0800)]
fix loop label syntax error introduced in
7c4460b82b8abadc5144f758a9f36ce0f42893e8
Tim Pierce [Thu, 14 Nov 2013 22:54:55 +0000 (17:54 -0500)]
Add supervisor to start keepd when container is launched.
Update README with deploy instructions for Keep.
Tim Pierce [Thu, 14 Nov 2013 20:49:18 +0000 (15:49 -0500)]
Build an arvados/warehouse container with locally checked out warehouse-apps
code.
The warehouse-apps repo at git://github.com/clinicalfuture/warehouse-apps.git
must be checked out at the same level as the arvados repo.
Tim Pierce [Thu, 14 Nov 2013 17:35:48 +0000 (12:35 -0500)]
Merge branch '1579-keep-server-in-docker' of git.clinicalfuture.com:arvados into 1579-keep-server-in-docker
Rebasing 1579-keep-server-in-docker from 1578-api-server-in-docker
(which has much better Docker support to work from).
Tom Clegg [Thu, 14 Nov 2013 16:50:13 +0000 (08:50 -0800)]
add discovery document test
Tom Clegg [Thu, 14 Nov 2013 16:49:58 +0000 (08:49 -0800)]
delete cached discovery document during boot, so doc matches running code
Tom Clegg [Thu, 14 Nov 2013 16:49:02 +0000 (08:49 -0800)]
update discovery document generator for rails 3.2
Tom Clegg [Thu, 14 Nov 2013 16:48:22 +0000 (08:48 -0800)]
add generatedAt field to discovery document
Tim Pierce [Thu, 14 Nov 2013 07:10:05 +0000 (02:10 -0500)]
Deploy containers with working copy of sources.
Tim Pierce [Wed, 13 Nov 2013 18:31:57 +0000 (13:31 -0500)]
Merge branch 'master' of git.clinicalfuture.com:arvados
Tim Pierce [Wed, 13 Nov 2013 18:31:21 +0000 (13:31 -0500)]
Break out deploying vs. installation instructions.
Ward Vandewege [Wed, 13 Nov 2013 17:59:02 +0000 (12:59 -0500)]
Merge branch 'master' of git.clinicalfuture.com:arvados
Conflicts:
docker/workbench/Dockerfile
Ward Vandewege [Wed, 13 Nov 2013 17:43:20 +0000 (12:43 -0500)]
Add workbench server to build.sh and run.sh
Ward Vandewege [Wed, 13 Nov 2013 17:42:23 +0000 (12:42 -0500)]
docserver container updates:
* use base arvados Debian image
* simplify Dockerfile
Ward Vandewege [Wed, 13 Nov 2013 17:11:57 +0000 (12:11 -0500)]
Fix Dockerfile comments.
Ward Vandewege [Mon, 11 Nov 2013 22:33:12 +0000 (17:33 -0500)]
Add docker image with workbench server.
Tim Pierce [Wed, 13 Nov 2013 15:04:03 +0000 (10:04 -0500)]
Merge branch 'master' of git.clinicalfuture.com:arvados
Tim Pierce [Wed, 13 Nov 2013 15:03:05 +0000 (10:03 -0500)]
Precompile Rails assets.
Make sure mod_ssl is enabled in Apache.
Ward Vandewege [Mon, 11 Nov 2013 22:33:12 +0000 (17:33 -0500)]
Add docker image with workbench server.
Tim Pierce [Tue, 12 Nov 2013 01:52:16 +0000 (20:52 -0500)]
Merge branch '1578-api-server-in-docker'
Tim Pierce [Mon, 11 Nov 2013 23:11:45 +0000 (18:11 -0500)]
Set nameservers at config time.
Tim Pierce [Mon, 11 Nov 2013 23:11:05 +0000 (18:11 -0500)]
Merge branch '1578-api-server-in-docker' of git.clinicalfuture.com:arvados into 1578-api-server-in-docker
Conflicts:
docker/config.rb
Tim Pierce [Mon, 11 Nov 2013 23:05:19 +0000 (18:05 -0500)]
Copied Apache vhost config from qr1hi.
Ward Vandewege [Mon, 11 Nov 2013 22:24:28 +0000 (17:24 -0500)]
We want to be able to handle naked
false
in config.rb's variable substitution.
Ward Vandewege [Mon, 11 Nov 2013 22:12:40 +0000 (17:12 -0500)]
Add sass explicitly
Ward Vandewege [Mon, 11 Nov 2013 21:41:39 +0000 (16:41 -0500)]
Style improvements -- rubocop
Ward Vandewege [Mon, 11 Nov 2013 21:38:03 +0000 (16:38 -0500)]
Allow up to 10 levels of nesting for variable substitution in config.rb
Tim Pierce [Mon, 11 Nov 2013 21:38:01 +0000 (16:38 -0500)]
Rename config.yml to config.yml.example (easier to keep real configuration
settings out of the repo)
Ward Vandewege [Mon, 11 Nov 2013 19:03:17 +0000 (14:03 -0500)]
We don't need the pg gem in workbench.
Tom Clegg [Mon, 11 Nov 2013 18:52:16 +0000 (10:52 -0800)]
add log_stream_href attribute to Job resource
Ward Vandewege [Mon, 11 Nov 2013 17:52:46 +0000 (12:52 -0500)]
Fix deprecation warning:
do not use ActionController::UnknownAction
Ward Vandewege [Mon, 11 Nov 2013 17:52:09 +0000 (12:52 -0500)]
We don't use the bootstrap-rails gem, and it does not exist anymore.
Ward Vandewege [Mon, 11 Nov 2013 17:52:46 +0000 (12:52 -0500)]
Fix deprecation warning:
do not use ActionController::UnknownAction
Ward Vandewege [Mon, 11 Nov 2013 17:52:09 +0000 (12:52 -0500)]
We don't use the bootstrap-rails gem, and it does not exist anymore.
Tim Pierce [Mon, 11 Nov 2013 17:32:45 +0000 (12:32 -0500)]
Use supervisord to start postgres + apache2 when the api
container is launched.
Move generated files to an api/generated directory for
easier ignoring.
Tim Pierce [Fri, 8 Nov 2013 22:36:15 +0000 (17:36 -0500)]
Start the API container with supervisor, running postgres & apache2.
Reduce commands in Dockerfiles to stay under the 42-layer limit for AUFS
(https://github.com/dotcloud/docker/issues/1171)
Tim Pierce [Fri, 8 Nov 2013 22:30:59 +0000 (17:30 -0500)]
Initial checkin for building warehouse-apps.
Tom Clegg [Fri, 8 Nov 2013 22:00:33 +0000 (14:00 -0800)]
Catch AbstractController::ActionNotFound instead of deprecated
ActionController::UnknownAction
See http://guides.rubyonrails.org/3_2_release_notes.html