Tom Clegg [Fri, 15 Nov 2013 16:40:46 +0000 (08:40 -0800)]
Obey ARVADOS_API_HOST_INSECURE and use the debian trusted CA list if
available (instead of skipping certificate validation because Python's
CA list does not include the one we need).
Tom Clegg [Fri, 15 Nov 2013 16:31:54 +0000 (08:31 -0800)]
Allow all active users to retrieve list of keep nodes.
refs #1599
Tom Clegg [Fri, 15 Nov 2013 16:13:41 +0000 (08:13 -0800)]
fix error message scraping regexp
Tom Clegg [Fri, 15 Nov 2013 15:51:45 +0000 (07:51 -0800)]
Use more current slurm environment variable name in error message scraping
Tom Clegg [Fri, 15 Nov 2013 15:51:02 +0000 (07:51 -0800)]
fix over-compensation for attempts counter when task fails on suspect node
Tom Clegg [Fri, 15 Nov 2013 15:45:20 +0000 (07:45 -0800)]
reduce default #attempts per job task from 9 to 2
Tom Clegg [Fri, 15 Nov 2013 08:15:57 +0000 (00:15 -0800)]
fix loop label syntax error introduced in
7c4460b82b8abadc5144f758a9f36ce0f42893e8
Tom Clegg [Thu, 14 Nov 2013 16:50:13 +0000 (08:50 -0800)]
add discovery document test
Tom Clegg [Thu, 14 Nov 2013 16:49:58 +0000 (08:49 -0800)]
delete cached discovery document during boot, so doc matches running code
Tom Clegg [Thu, 14 Nov 2013 16:49:02 +0000 (08:49 -0800)]
update discovery document generator for rails 3.2
Tom Clegg [Thu, 14 Nov 2013 16:48:22 +0000 (08:48 -0800)]
add generatedAt field to discovery document
Tim Pierce [Wed, 13 Nov 2013 18:31:57 +0000 (13:31 -0500)]
Merge branch 'master' of git.clinicalfuture.com:arvados
Tim Pierce [Wed, 13 Nov 2013 18:31:21 +0000 (13:31 -0500)]
Break out deploying vs. installation instructions.
Ward Vandewege [Wed, 13 Nov 2013 17:59:02 +0000 (12:59 -0500)]
Merge branch 'master' of git.clinicalfuture.com:arvados
Conflicts:
docker/workbench/Dockerfile
Ward Vandewege [Wed, 13 Nov 2013 17:43:20 +0000 (12:43 -0500)]
Add workbench server to build.sh and run.sh
Ward Vandewege [Wed, 13 Nov 2013 17:42:23 +0000 (12:42 -0500)]
docserver container updates:
* use base arvados Debian image
* simplify Dockerfile
Ward Vandewege [Wed, 13 Nov 2013 17:11:57 +0000 (12:11 -0500)]
Fix Dockerfile comments.
Ward Vandewege [Mon, 11 Nov 2013 22:33:12 +0000 (17:33 -0500)]
Add docker image with workbench server.
Tim Pierce [Wed, 13 Nov 2013 15:04:03 +0000 (10:04 -0500)]
Merge branch 'master' of git.clinicalfuture.com:arvados
Tim Pierce [Wed, 13 Nov 2013 15:03:05 +0000 (10:03 -0500)]
Precompile Rails assets.
Make sure mod_ssl is enabled in Apache.
Ward Vandewege [Mon, 11 Nov 2013 22:33:12 +0000 (17:33 -0500)]
Add docker image with workbench server.
Tim Pierce [Tue, 12 Nov 2013 01:52:16 +0000 (20:52 -0500)]
Merge branch '1578-api-server-in-docker'
Tim Pierce [Mon, 11 Nov 2013 23:11:45 +0000 (18:11 -0500)]
Set nameservers at config time.
Tim Pierce [Mon, 11 Nov 2013 23:11:05 +0000 (18:11 -0500)]
Merge branch '1578-api-server-in-docker' of git.clinicalfuture.com:arvados into 1578-api-server-in-docker
Conflicts:
docker/config.rb
Tim Pierce [Mon, 11 Nov 2013 23:05:19 +0000 (18:05 -0500)]
Copied Apache vhost config from qr1hi.
Ward Vandewege [Mon, 11 Nov 2013 22:24:28 +0000 (17:24 -0500)]
We want to be able to handle naked
false
in config.rb's variable substitution.
Ward Vandewege [Mon, 11 Nov 2013 22:12:40 +0000 (17:12 -0500)]
Add sass explicitly
Ward Vandewege [Mon, 11 Nov 2013 21:41:39 +0000 (16:41 -0500)]
Style improvements -- rubocop
Ward Vandewege [Mon, 11 Nov 2013 21:38:03 +0000 (16:38 -0500)]
Allow up to 10 levels of nesting for variable substitution in config.rb
Tim Pierce [Mon, 11 Nov 2013 21:38:01 +0000 (16:38 -0500)]
Rename config.yml to config.yml.example (easier to keep real configuration
settings out of the repo)
Ward Vandewege [Mon, 11 Nov 2013 19:03:17 +0000 (14:03 -0500)]
We don't need the pg gem in workbench.
Tom Clegg [Mon, 11 Nov 2013 18:52:16 +0000 (10:52 -0800)]
add log_stream_href attribute to Job resource
Ward Vandewege [Mon, 11 Nov 2013 17:52:46 +0000 (12:52 -0500)]
Fix deprecation warning:
do not use ActionController::UnknownAction
Ward Vandewege [Mon, 11 Nov 2013 17:52:09 +0000 (12:52 -0500)]
We don't use the bootstrap-rails gem, and it does not exist anymore.
Ward Vandewege [Mon, 11 Nov 2013 17:52:46 +0000 (12:52 -0500)]
Fix deprecation warning:
do not use ActionController::UnknownAction
Ward Vandewege [Mon, 11 Nov 2013 17:52:09 +0000 (12:52 -0500)]
We don't use the bootstrap-rails gem, and it does not exist anymore.
Tim Pierce [Mon, 11 Nov 2013 17:32:45 +0000 (12:32 -0500)]
Use supervisord to start postgres + apache2 when the api
container is launched.
Move generated files to an api/generated directory for
easier ignoring.
Tim Pierce [Fri, 8 Nov 2013 22:36:15 +0000 (17:36 -0500)]
Start the API container with supervisor, running postgres & apache2.
Reduce commands in Dockerfiles to stay under the 42-layer limit for AUFS
(https://github.com/dotcloud/docker/issues/1171)
Tom Clegg [Fri, 8 Nov 2013 22:00:33 +0000 (14:00 -0800)]
Catch AbstractController::ActionNotFound instead of deprecated
ActionController::UnknownAction
See http://guides.rubyonrails.org/3_2_release_notes.html
Tom Clegg [Fri, 8 Nov 2013 21:16:18 +0000 (13:16 -0800)]
add crunch_worker_state to Node api response. refs #1586
Tom Clegg [Fri, 8 Nov 2013 21:14:13 +0000 (13:14 -0800)]
fix tests and behavior for nodes#list as called by inactive user. refs #1594
Tim Pierce [Fri, 8 Nov 2013 16:12:14 +0000 (11:12 -0500)]
Fix passenger filename.
Tim Pierce [Fri, 8 Nov 2013 06:45:55 +0000 (01:45 -0500)]
Configure Apache and Passenger.
Tim Pierce [Fri, 8 Nov 2013 04:26:30 +0000 (23:26 -0500)]
Bug fixes.
Tim Pierce [Thu, 7 Nov 2013 22:41:45 +0000 (17:41 -0500)]
Specify all configuration settings in config.yml.
* Added README with step-by-step build instructions.
* config.rb substitutes config.yml variables in *.in files.
Ward Vandewege [Thu, 7 Nov 2013 22:18:30 +0000 (17:18 -0500)]
Add docker arvados/docserver build.
This closes #1580
Tom Clegg [Thu, 7 Nov 2013 17:15:01 +0000 (09:15 -0800)]
Use current_user to select API response template. fixes #1594
Tom Clegg [Thu, 7 Nov 2013 17:27:03 +0000 (09:27 -0800)]
Preload all models at startup. Otherwise, in non-production mode,
Rails crashes trying to instantiate cached objects before loading the
relevant classes.
http://aaronvb.com/articles/37-rails-caching-and-undefined-class-module
Tom Clegg [Thu, 7 Nov 2013 17:24:09 +0000 (09:24 -0800)]
Add "not null" constraint to timestamp columns.
"When the timestamps method creates the created_at and updated_at
columns, it makes them non-nullable by default."
http://guides.rubyonrails.org/3_2_release_notes.html
Tom Clegg [Thu, 7 Nov 2013 17:20:51 +0000 (09:20 -0800)]
Remove "test user needs createdb privilege" workaround.
It doesn't seem to work any more in Rails 3.2. Just accept that your
test user needs to own the test db and have the createdb privilege.
ALTER ROLE arvados_test_user CREATEDB
Tim Pierce [Wed, 6 Nov 2013 23:11:51 +0000 (18:11 -0500)]
Merging the postgres container back into the api container (simpler
and more consistent with best practices).
'docker build -t arvados/api api' now builds a container with postgres
and apache2, and installs the API Rails database.
To have this container start multiple services at run time
(i.e. postgres + apache2) the popular solution is to make supervisord
the entrypoint for the container.
Tim Pierce [Wed, 6 Nov 2013 20:45:59 +0000 (15:45 -0500)]
Splitting out containers into arvados/base, arvados/postgresql and arvados/api.
Tim Pierce [Wed, 6 Nov 2013 14:44:52 +0000 (09:44 -0500)]
Merge branch 'master' of git.clinicalfuture.com:arvados
Tim Pierce [Tue, 5 Nov 2013 21:35:28 +0000 (16:35 -0500)]
Rename "cfi" docker images to "arvados"
Some fixes for PostgreSQL and gem installation.
Tom Clegg [Tue, 5 Nov 2013 20:41:45 +0000 (12:41 -0800)]
upgrade to latest Rails 3.2
Tim Pierce [Tue, 5 Nov 2013 18:47:53 +0000 (13:47 -0500)]
Post-install configuration script for PostgreSQL.
Tim Pierce [Tue, 5 Nov 2013 18:43:34 +0000 (13:43 -0500)]
Use PostgreSQL, not MySQL.
Tim Pierce [Mon, 4 Nov 2013 22:58:39 +0000 (17:58 -0500)]
Initial build files for Docker images with Arvados support.
docker/build.sh will build two Docker images locally:
cfi/debian - a base Debian Wheezy image
cfi/base - cfi/debian, rvm, rails, MySQL, Arvados source code
Tim Pierce [Mon, 4 Nov 2013 22:28:37 +0000 (17:28 -0500)]
Updating install and use documentation.
Tom Clegg [Mon, 4 Nov 2013 22:17:35 +0000 (14:17 -0800)]
upgrade gem dependencies
Tom Clegg [Mon, 4 Nov 2013 22:17:29 +0000 (14:17 -0800)]
upgrade gem dependencies
Tom Clegg [Mon, 4 Nov 2013 22:17:01 +0000 (14:17 -0800)]
include "href" key for each object in API response
Tom Clegg [Mon, 4 Nov 2013 22:14:42 +0000 (14:14 -0800)]
improve error message when API response is valid JSON but not a hash
Tom Clegg [Mon, 4 Nov 2013 21:29:53 +0000 (13:29 -0800)]
in log_tail_follow, emit recent messages at top of live stream. fixes #1590
Tom Clegg [Mon, 4 Nov 2013 18:03:37 +0000 (10:03 -0800)]
store the last ~512 KiB of job log messages in a redis buffer. fixes #1589
Tom Clegg [Mon, 4 Nov 2013 17:56:33 +0000 (09:56 -0800)]
improve error message when crunch-job is not found
Tom Clegg [Fri, 1 Nov 2013 06:16:19 +0000 (23:16 -0700)]
send queue/worker stats while waiting for job to start. fixes #1591
Tom Clegg [Fri, 1 Nov 2013 05:29:29 +0000 (22:29 -0700)]
update node info[:slurm_state] when running sinfo. fixes #1606
Tom Clegg [Fri, 1 Nov 2013 04:41:59 +0000 (21:41 -0700)]
allow crunch-job caller to override CRUNCH_TMP. fixes #1593
Tom Clegg [Mon, 21 Oct 2013 16:32:47 +0000 (12:32 -0400)]
fix infinite exec loop
Tom Clegg [Mon, 21 Oct 2013 15:56:37 +0000 (11:56 -0400)]
fix infinite loop if CONT signal received while todo is empty
Tom Clegg [Mon, 7 Oct 2013 19:21:22 +0000 (15:21 -0400)]
upgrade gem versions in Gemfile.lock
Tom Clegg [Mon, 7 Oct 2013 19:20:14 +0000 (15:20 -0400)]
set/unset ARVADOS_API_HOST_INSECURE in cli setup instructions
Tom Clegg [Mon, 7 Oct 2013 18:12:12 +0000 (14:12 -0400)]
rename jobs.resource_limits to runtime_constraints
Tom Clegg [Mon, 7 Oct 2013 14:26:53 +0000 (10:26 -0400)]
add Real Time Genomics pipeline template
Tom Clegg [Mon, 9 Sep 2013 16:16:28 +0000 (12:16 -0400)]
add crunch scripts for Real Time Genomics pipeline
Tom Clegg [Fri, 27 Sep 2013 04:30:52 +0000 (00:30 -0400)]
add note about running crunch jobs with no git repo at all
Tom Clegg [Fri, 27 Sep 2013 04:21:49 +0000 (00:21 -0400)]
Migrate the test database to 0 instead of trying to "drop database".
This way, the database credentials used for testing do not need
create/drop database privileges.
Tom Clegg [Fri, 27 Sep 2013 04:20:33 +0000 (00:20 -0400)]
add a few fixtures and tests for API. refs #1517 refs #1510
Tom Clegg [Fri, 27 Sep 2013 04:29:35 +0000 (00:29 -0400)]
fix down-migration: add_column should have been remove_column
Tom Clegg [Fri, 27 Sep 2013 04:26:28 +0000 (00:26 -0400)]
Ignore failure in data-migration part of old schema migration.
The migration should succeed if the Metadatum model did not exist in
the version of the project that was used to run the migration.
Tom Clegg [Fri, 27 Sep 2013 04:25:31 +0000 (00:25 -0400)]
Fix exception if api_client_authorization does not reference a valid user.
Tom Clegg [Thu, 26 Sep 2013 02:33:18 +0000 (22:33 -0400)]
add local job debugging tutorial. closes #1515
Tom Clegg [Thu, 26 Sep 2013 02:04:31 +0000 (22:04 -0400)]
fix exception when script_version is nil
Tom Clegg [Thu, 26 Sep 2013 01:57:01 +0000 (21:57 -0400)]
add ruby wrapper around crunch-job
Tom Clegg [Thu, 26 Sep 2013 01:16:17 +0000 (21:16 -0400)]
move crunch-job to arv-crunch-job and add to arvados-cli gem
Tom Clegg [Tue, 24 Sep 2013 22:13:05 +0000 (18:13 -0400)]
fill in intro-to-git page
Tom Clegg [Tue, 24 Sep 2013 21:44:25 +0000 (17:44 -0400)]
update API tokens doc to match current API tokens page
Tom Clegg [Tue, 24 Sep 2013 17:30:20 +0000 (13:30 -0400)]
do not munge hash keys in client-provided request. fixes #1516
Tom Clegg [Tue, 24 Sep 2013 17:28:22 +0000 (13:28 -0400)]
test API update semantics, confirm put/get cycle preserves components{} hash
refs #1517
Tom Clegg [Tue, 24 Sep 2013 17:25:09 +0000 (13:25 -0400)]
update "correct answer" hashes in collection tests - see
3f431d852579ee433197fb1c29e6db374ccb4b9e
Tom Clegg [Tue, 17 Sep 2013 01:59:04 +0000 (21:59 -0400)]
During task setup, if it exists, run /crunch_scripts/install instead
of /install.sh
Tom Clegg [Mon, 16 Sep 2013 21:56:38 +0000 (17:56 -0400)]
pass api_token and pipeline_instance in request body instead of query string
Tom Clegg [Mon, 16 Sep 2013 21:41:01 +0000 (17:41 -0400)]
Modify API discovery document and CLI tool so resource objects can be
supplied in the request body (instead of the query string) for Create
and Update methods.
Tom Clegg [Fri, 13 Sep 2013 04:44:20 +0000 (00:44 -0400)]
escape spaces in manifest filenames
Tom Clegg [Thu, 12 Sep 2013 19:55:14 +0000 (15:55 -0400)]
add CollectionWriter.write_directory_tree()
Tom Clegg [Wed, 11 Sep 2013 23:04:23 +0000 (19:04 -0400)]
maintain directory structure in collection_extract
Tom Clegg [Wed, 11 Sep 2013 21:58:51 +0000 (17:58 -0400)]
fix extra empty stream in all_streams() response
Tom Clegg [Wed, 11 Sep 2013 22:57:52 +0000 (18:57 -0400)]
overwrite existing files in stream_extract
Tom Clegg [Wed, 11 Sep 2013 02:29:11 +0000 (22:29 -0400)]
add util.listdir_recursive()