arvados.git
10 years agoWe don't need the pg gem in workbench.
Ward Vandewege [Mon, 11 Nov 2013 19:03:17 +0000 (14:03 -0500)]
We don't need the pg gem in workbench.

10 years agoadd log_stream_href attribute to Job resource
Tom Clegg [Mon, 11 Nov 2013 18:52:16 +0000 (10:52 -0800)]
add log_stream_href attribute to Job resource

10 years agoFix deprecation warning:
Ward Vandewege [Mon, 11 Nov 2013 17:52:46 +0000 (12:52 -0500)]
Fix deprecation warning:

  do not use ActionController::UnknownAction

10 years agoWe don't use the bootstrap-rails gem, and it does not exist anymore.
Ward Vandewege [Mon, 11 Nov 2013 17:52:09 +0000 (12:52 -0500)]
We don't use the bootstrap-rails gem, and it does not exist anymore.

10 years agoCatch AbstractController::ActionNotFound instead of deprecated
Tom Clegg [Fri, 8 Nov 2013 22:00:33 +0000 (14:00 -0800)]
Catch AbstractController::ActionNotFound instead of deprecated
ActionController::UnknownAction

See http://guides.rubyonrails.org/3_2_release_notes.html

10 years agoadd crunch_worker_state to Node api response. refs #1586
Tom Clegg [Fri, 8 Nov 2013 21:16:18 +0000 (13:16 -0800)]
add crunch_worker_state to Node api response. refs #1586

10 years agofix tests and behavior for nodes#list as called by inactive user. refs #1594
Tom Clegg [Fri, 8 Nov 2013 21:14:13 +0000 (13:14 -0800)]
fix tests and behavior for nodes#list as called by inactive user. refs #1594

10 years agoAdd docker arvados/docserver build.
Ward Vandewege [Thu, 7 Nov 2013 22:18:30 +0000 (17:18 -0500)]
Add docker arvados/docserver build.

This closes #1580

10 years agoUse current_user to select API response template. fixes #1594
Tom Clegg [Thu, 7 Nov 2013 17:15:01 +0000 (09:15 -0800)]
Use current_user to select API response template. fixes #1594

10 years agoPreload all models at startup. Otherwise, in non-production mode,
Tom Clegg [Thu, 7 Nov 2013 17:27:03 +0000 (09:27 -0800)]
Preload all models at startup. Otherwise, in non-production mode,
Rails crashes trying to instantiate cached objects before loading the
relevant classes.

http://aaronvb.com/articles/37-rails-caching-and-undefined-class-module

10 years agoAdd "not null" constraint to timestamp columns.
Tom Clegg [Thu, 7 Nov 2013 17:24:09 +0000 (09:24 -0800)]
Add "not null" constraint to timestamp columns.

"When the timestamps method creates the created_at and updated_at
columns, it makes them non-nullable by default."

http://guides.rubyonrails.org/3_2_release_notes.html

10 years agoRemove "test user needs createdb privilege" workaround.
Tom Clegg [Thu, 7 Nov 2013 17:20:51 +0000 (09:20 -0800)]
Remove "test user needs createdb privilege" workaround.

It doesn't seem to work any more in Rails 3.2. Just accept that your
test user needs to own the test db and have the createdb privilege.

ALTER ROLE arvados_test_user CREATEDB

10 years agoMerging the postgres container back into the api container (simpler
Tim Pierce [Wed, 6 Nov 2013 23:11:51 +0000 (18:11 -0500)]
Merging the postgres container back into the api container (simpler
and more consistent with best practices).

'docker build -t arvados/api api' now builds a container with postgres
and apache2, and installs the API Rails database.

To have this container start multiple services at run time
(i.e. postgres + apache2) the popular solution is to make supervisord
the entrypoint for the container.

10 years agoSplitting out containers into arvados/base, arvados/postgresql and arvados/api.
Tim Pierce [Wed, 6 Nov 2013 20:45:59 +0000 (15:45 -0500)]
Splitting out containers into arvados/base, arvados/postgresql and arvados/api.

10 years agoMerge branch 'master' of git.clinicalfuture.com:arvados
Tim Pierce [Wed, 6 Nov 2013 14:44:52 +0000 (09:44 -0500)]
Merge branch 'master' of git.clinicalfuture.com:arvados

10 years agoRename "cfi" docker images to "arvados"
Tim Pierce [Tue, 5 Nov 2013 21:35:28 +0000 (16:35 -0500)]
Rename "cfi" docker images to "arvados"

Some fixes for PostgreSQL and gem installation.

10 years agoupgrade to latest Rails 3.2
Tom Clegg [Tue, 5 Nov 2013 20:41:45 +0000 (12:41 -0800)]
upgrade to latest Rails 3.2

10 years agoPost-install configuration script for PostgreSQL.
Tim Pierce [Tue, 5 Nov 2013 18:47:53 +0000 (13:47 -0500)]
Post-install configuration script for PostgreSQL.

10 years agoUse PostgreSQL, not MySQL.
Tim Pierce [Tue, 5 Nov 2013 18:43:34 +0000 (13:43 -0500)]
Use PostgreSQL, not MySQL.

10 years agoInitial build files for Docker images with Arvados support.
Tim Pierce [Mon, 4 Nov 2013 22:58:39 +0000 (17:58 -0500)]
Initial build files for Docker images with Arvados support.

docker/build.sh will build two Docker images locally:
  cfi/debian - a base Debian Wheezy image
  cfi/base   - cfi/debian, rvm, rails, MySQL, Arvados source code

10 years agoUpdating install and use documentation.
Tim Pierce [Mon, 4 Nov 2013 22:28:37 +0000 (17:28 -0500)]
Updating install and use documentation.

10 years agoupgrade gem dependencies
Tom Clegg [Mon, 4 Nov 2013 22:17:35 +0000 (14:17 -0800)]
upgrade gem dependencies

10 years agoupgrade gem dependencies
Tom Clegg [Mon, 4 Nov 2013 22:17:29 +0000 (14:17 -0800)]
upgrade gem dependencies

10 years agoinclude "href" key for each object in API response
Tom Clegg [Mon, 4 Nov 2013 22:17:01 +0000 (14:17 -0800)]
include "href" key for each object in API response

10 years agoimprove error message when API response is valid JSON but not a hash
Tom Clegg [Mon, 4 Nov 2013 22:14:42 +0000 (14:14 -0800)]
improve error message when API response is valid JSON but not a hash

10 years agoin log_tail_follow, emit recent messages at top of live stream. fixes #1590
Tom Clegg [Mon, 4 Nov 2013 21:29:53 +0000 (13:29 -0800)]
in log_tail_follow, emit recent messages at top of live stream. fixes #1590

10 years agostore the last ~512 KiB of job log messages in a redis buffer. fixes #1589
Tom Clegg [Mon, 4 Nov 2013 18:03:37 +0000 (10:03 -0800)]
store the last ~512 KiB of job log messages in a redis buffer. fixes #1589

10 years agoimprove error message when crunch-job is not found
Tom Clegg [Mon, 4 Nov 2013 17:56:33 +0000 (09:56 -0800)]
improve error message when crunch-job is not found

10 years agosend queue/worker stats while waiting for job to start. fixes #1591
Tom Clegg [Fri, 1 Nov 2013 06:16:19 +0000 (23:16 -0700)]
send queue/worker stats while waiting for job to start. fixes #1591

10 years agoupdate node info[:slurm_state] when running sinfo. fixes #1606
Tom Clegg [Fri, 1 Nov 2013 05:29:29 +0000 (22:29 -0700)]
update node info[:slurm_state] when running sinfo. fixes #1606

10 years agoallow crunch-job caller to override CRUNCH_TMP. fixes #1593
Tom Clegg [Fri, 1 Nov 2013 04:41:59 +0000 (21:41 -0700)]
allow crunch-job caller to override CRUNCH_TMP. fixes #1593

10 years agofix infinite exec loop
Tom Clegg [Mon, 21 Oct 2013 16:32:47 +0000 (12:32 -0400)]
fix infinite exec loop

10 years agofix infinite loop if CONT signal received while todo is empty
Tom Clegg [Mon, 21 Oct 2013 15:56:37 +0000 (11:56 -0400)]
fix infinite loop if CONT signal received while todo is empty

10 years agoupgrade gem versions in Gemfile.lock
Tom Clegg [Mon, 7 Oct 2013 19:21:22 +0000 (15:21 -0400)]
upgrade gem versions in Gemfile.lock

10 years agoset/unset ARVADOS_API_HOST_INSECURE in cli setup instructions
Tom Clegg [Mon, 7 Oct 2013 19:20:14 +0000 (15:20 -0400)]
set/unset ARVADOS_API_HOST_INSECURE in cli setup instructions

10 years agorename jobs.resource_limits to runtime_constraints
Tom Clegg [Mon, 7 Oct 2013 18:12:12 +0000 (14:12 -0400)]
rename jobs.resource_limits to runtime_constraints

10 years agoadd Real Time Genomics pipeline template
Tom Clegg [Mon, 7 Oct 2013 14:26:53 +0000 (10:26 -0400)]
add Real Time Genomics pipeline template

10 years agoadd crunch scripts for Real Time Genomics pipeline
Tom Clegg [Mon, 9 Sep 2013 16:16:28 +0000 (12:16 -0400)]
add crunch scripts for Real Time Genomics pipeline

10 years agoadd note about running crunch jobs with no git repo at all
Tom Clegg [Fri, 27 Sep 2013 04:30:52 +0000 (00:30 -0400)]
add note about running crunch jobs with no git repo at all

10 years agoMigrate the test database to 0 instead of trying to "drop database".
Tom Clegg [Fri, 27 Sep 2013 04:21:49 +0000 (00:21 -0400)]
Migrate the test database to 0 instead of trying to "drop database".

This way, the database credentials used for testing do not need
create/drop database privileges.

10 years agoadd a few fixtures and tests for API. refs #1517 refs #1510
Tom Clegg [Fri, 27 Sep 2013 04:20:33 +0000 (00:20 -0400)]
add a few fixtures and tests for API. refs #1517 refs #1510

10 years agofix down-migration: add_column should have been remove_column
Tom Clegg [Fri, 27 Sep 2013 04:29:35 +0000 (00:29 -0400)]
fix down-migration: add_column should have been remove_column

10 years agoIgnore failure in data-migration part of old schema migration.
Tom Clegg [Fri, 27 Sep 2013 04:26:28 +0000 (00:26 -0400)]
Ignore failure in data-migration part of old schema migration.

The migration should succeed if the Metadatum model did not exist in
the version of the project that was used to run the migration.

10 years agoFix exception if api_client_authorization does not reference a valid user.
Tom Clegg [Fri, 27 Sep 2013 04:25:31 +0000 (00:25 -0400)]
Fix exception if api_client_authorization does not reference a valid user.

10 years agoadd local job debugging tutorial. closes #1515
Tom Clegg [Thu, 26 Sep 2013 02:33:18 +0000 (22:33 -0400)]
add local job debugging tutorial. closes #1515

10 years agofix exception when script_version is nil
Tom Clegg [Thu, 26 Sep 2013 02:04:31 +0000 (22:04 -0400)]
fix exception when script_version is nil

10 years agoadd ruby wrapper around crunch-job
Tom Clegg [Thu, 26 Sep 2013 01:57:01 +0000 (21:57 -0400)]
add ruby wrapper around crunch-job

10 years agomove crunch-job to arv-crunch-job and add to arvados-cli gem
Tom Clegg [Thu, 26 Sep 2013 01:16:17 +0000 (21:16 -0400)]
move crunch-job to arv-crunch-job and add to arvados-cli gem

10 years agofill in intro-to-git page
Tom Clegg [Tue, 24 Sep 2013 22:13:05 +0000 (18:13 -0400)]
fill in intro-to-git page

10 years agoupdate API tokens doc to match current API tokens page
Tom Clegg [Tue, 24 Sep 2013 21:44:25 +0000 (17:44 -0400)]
update API tokens doc to match current API tokens page

10 years agodo not munge hash keys in client-provided request. fixes #1516
Tom Clegg [Tue, 24 Sep 2013 17:30:20 +0000 (13:30 -0400)]
do not munge hash keys in client-provided request. fixes #1516

10 years agotest API update semantics, confirm put/get cycle preserves components{} hash
Tom Clegg [Tue, 24 Sep 2013 17:28:22 +0000 (13:28 -0400)]
test API update semantics, confirm put/get cycle preserves components{} hash
refs #1517

10 years agoupdate "correct answer" hashes in collection tests - see 3f431d852579ee433197fb1c29e6...
Tom Clegg [Tue, 24 Sep 2013 17:25:09 +0000 (13:25 -0400)]
update "correct answer" hashes in collection tests - see 3f431d852579ee433197fb1c29e6db374ccb4b9e

10 years agoDuring task setup, if it exists, run /crunch_scripts/install instead
Tom Clegg [Tue, 17 Sep 2013 01:59:04 +0000 (21:59 -0400)]
During task setup, if it exists, run /crunch_scripts/install instead
of /install.sh

10 years agopass api_token and pipeline_instance in request body instead of query string
Tom Clegg [Mon, 16 Sep 2013 21:56:38 +0000 (17:56 -0400)]
pass api_token and pipeline_instance in request body instead of query string

10 years agoModify API discovery document and CLI tool so resource objects can be
Tom Clegg [Mon, 16 Sep 2013 21:41:01 +0000 (17:41 -0400)]
Modify API discovery document and CLI tool so resource objects can be
supplied in the request body (instead of the query string) for Create
and Update methods.

10 years agoescape spaces in manifest filenames
Tom Clegg [Fri, 13 Sep 2013 04:44:20 +0000 (00:44 -0400)]
escape spaces in manifest filenames

10 years agoadd CollectionWriter.write_directory_tree()
Tom Clegg [Thu, 12 Sep 2013 19:55:14 +0000 (15:55 -0400)]
add CollectionWriter.write_directory_tree()

10 years agomaintain directory structure in collection_extract
Tom Clegg [Wed, 11 Sep 2013 23:04:23 +0000 (19:04 -0400)]
maintain directory structure in collection_extract

10 years agofix extra empty stream in all_streams() response
Tom Clegg [Wed, 11 Sep 2013 21:58:51 +0000 (17:58 -0400)]
fix extra empty stream in all_streams() response

10 years agooverwrite existing files in stream_extract
Tom Clegg [Wed, 11 Sep 2013 22:57:52 +0000 (18:57 -0400)]
overwrite existing files in stream_extract

10 years agoadd util.listdir_recursive()
Tom Clegg [Wed, 11 Sep 2013 02:29:11 +0000 (22:29 -0400)]
add util.listdir_recursive()

10 years agofix os.path.dirname usage
Tom Clegg [Wed, 11 Sep 2013 02:08:58 +0000 (22:08 -0400)]
fix os.path.dirname usage

10 years agofix out of scope function use
Tom Clegg [Wed, 11 Sep 2013 02:08:00 +0000 (22:08 -0400)]
fix out of scope function use

10 years agomkdir -p in collection_extract()
Tom Clegg [Wed, 11 Sep 2013 23:01:04 +0000 (19:01 -0400)]
mkdir -p in collection_extract()

10 years agoadd one-task-per-stream utils
Tom Clegg [Tue, 10 Sep 2013 19:54:47 +0000 (15:54 -0400)]
add one-task-per-stream utils

10 years agofix stream names in CollectionWriter
Tom Clegg [Tue, 10 Sep 2013 18:53:02 +0000 (14:53 -0400)]
fix stream names in CollectionWriter

10 years agouse . as default stream name
Tom Clegg [Tue, 10 Sep 2013 13:58:32 +0000 (09:58 -0400)]
use . as default stream name

10 years agofix infinite loop in flush_data
Tom Clegg [Tue, 10 Sep 2013 05:19:56 +0000 (01:19 -0400)]
fix infinite loop in flush_data

10 years agoallow caller to override std* pipes in run_command
Tom Clegg [Mon, 9 Sep 2013 20:54:26 +0000 (16:54 -0400)]
allow caller to override std* pipes in run_command

10 years agoadd zipball_extract
Tom Clegg [Mon, 9 Sep 2013 19:08:59 +0000 (15:08 -0400)]
add zipball_extract

10 years agoadd crunch_scripts/file-select
Tom Clegg [Mon, 9 Sep 2013 16:16:18 +0000 (12:16 -0400)]
add crunch_scripts/file-select

10 years agoRevert "remove extra newline"
Tom Clegg [Thu, 5 Sep 2013 17:14:48 +0000 (13:14 -0400)]
Revert "remove extra newline"

This reverts commit 3a803d6306dfe68a664246fc93b87d72b171909d.

10 years agoreplace compute_node_security_group config with generic compute_node_ec2run_args
Tom Clegg [Thu, 5 Sep 2013 13:56:36 +0000 (09:56 -0400)]
replace compute_node_security_group config with generic compute_node_ec2run_args

10 years agoTypo in the 'create virtual machine' command.
Ward Vandewege [Wed, 28 Aug 2013 03:12:00 +0000 (23:12 -0400)]
Typo in the 'create virtual machine' command.

10 years agofix :id -> {uuid} subst in discovery doc when generating from rails routes
Tom Clegg [Thu, 22 Aug 2013 14:45:47 +0000 (10:45 -0400)]
fix :id -> {uuid} subst in discovery doc when generating from rails routes

10 years agoallow admin to change object UUIDs
Tom Clegg [Tue, 13 Aug 2013 14:35:51 +0000 (10:35 -0400)]
allow admin to change object UUIDs

10 years agouse ssh -T to silence pty warning
Tom Clegg [Thu, 1 Aug 2013 23:10:02 +0000 (19:10 -0400)]
use ssh -T to silence pty warning

10 years agofix spelling of arv argument
Tom Clegg [Thu, 1 Aug 2013 23:08:26 +0000 (19:08 -0400)]
fix spelling of arv argument

10 years agoclean up jobs page, add expand/collapse
Tom Clegg [Thu, 1 Aug 2013 23:06:58 +0000 (19:06 -0400)]
clean up jobs page, add expand/collapse

10 years agotone down css on jobs index
Tom Clegg [Thu, 1 Aug 2013 18:04:29 +0000 (14:04 -0400)]
tone down css on jobs index

10 years agofix uuid column heading on jobs index
Tom Clegg [Thu, 1 Aug 2013 17:59:47 +0000 (13:59 -0400)]
fix uuid column heading on jobs index

10 years agoupdate crunch install doc
Tom Clegg [Wed, 31 Jul 2013 21:50:12 +0000 (17:50 -0400)]
update crunch install doc

10 years agolock CRUNCH_DISPATCH_LOCKFILE while running, if provided
Tom Clegg [Wed, 31 Jul 2013 21:43:47 +0000 (17:43 -0400)]
lock CRUNCH_DISPATCH_LOCKFILE while running, if provided

10 years agoadd links beside editable object uuids
Tom Clegg [Wed, 31 Jul 2013 15:19:13 +0000 (11:19 -0400)]
add links beside editable object uuids

10 years agoput back :find_object_by_uuid in virtual_machines controller
Tom Clegg [Wed, 31 Jul 2013 03:30:17 +0000 (23:30 -0400)]
put back :find_object_by_uuid in virtual_machines controller

10 years agofix exception in get_all_logins when user has no authorized_keys
Tom Clegg [Wed, 31 Jul 2013 03:23:58 +0000 (23:23 -0400)]
fix exception in get_all_logins when user has no authorized_keys

10 years agogitignore arvados-cli gem
Tom Clegg [Tue, 30 Jul 2013 23:40:53 +0000 (19:40 -0400)]
gitignore arvados-cli gem

10 years agoadd auth scopes
Tom Clegg [Tue, 30 Jul 2013 18:34:05 +0000 (14:34 -0400)]
add auth scopes

10 years agofix example ssh command
Tom Clegg [Wed, 24 Jul 2013 15:21:51 +0000 (11:21 -0400)]
fix example ssh command

10 years agoshow copy-paste-friendly current token at top of API Tokens page
Tom Clegg [Tue, 23 Jul 2013 16:09:14 +0000 (12:09 -0400)]
show copy-paste-friendly current token at top of API Tokens page

10 years agoclean up SDK examples
Tom Clegg [Tue, 23 Jul 2013 16:08:17 +0000 (12:08 -0400)]
clean up SDK examples

10 years agofix top nav extra padding with responsive + small window
Tom Clegg [Mon, 22 Jul 2013 15:56:20 +0000 (11:56 -0400)]
fix top nav extra padding with responsive + small window

10 years agofix bash "read -d" usage
Tom Clegg [Mon, 22 Jul 2013 14:29:19 +0000 (10:29 -0400)]
fix bash "read -d" usage

10 years agofix backward-compatible env var
Tom Clegg [Mon, 22 Jul 2013 14:09:24 +0000 (10:09 -0400)]
fix backward-compatible env var

10 years agosay "interrupt" nicely instead of a stack trace on ^C
Tom Clegg [Thu, 18 Jul 2013 21:31:08 +0000 (17:31 -0400)]
say "interrupt" nicely instead of a stack trace on ^C

10 years agoadd --no-reuse and --no-reuse-finished options to arv-run-pipeline-instance
Tom Clegg [Thu, 18 Jul 2013 21:07:18 +0000 (17:07 -0400)]
add --no-reuse and --no-reuse-finished options to arv-run-pipeline-instance

10 years agoadded PuTTY instructions to docs site
Samuel Shapiro [Thu, 18 Jul 2013 19:33:40 +0000 (15:33 -0400)]
added PuTTY instructions to docs site

10 years agoFix numbering of tutorials on workbench landing page.
Ward Vandewege [Thu, 18 Jul 2013 13:52:11 +0000 (09:52 -0400)]
Fix numbering of tutorials on workbench landing page.

10 years agouse find() instead of where() to get a single object
Tom Clegg [Wed, 17 Jul 2013 19:04:39 +0000 (15:04 -0400)]
use find() instead of where() to get a single object