Peter Amstutz [Fri, 17 Jun 2016 20:41:03 +0000 (16:41 -0400)]
9427: Add connection limit.
Peter Amstutz [Fri, 17 Jun 2016 20:12:15 +0000 (16:12 -0400)]
9427: Websockets now uses a thread per connection for database query and
sending outgoing messages. This minimizes interference by slow clients or
clients that are "replaying the world" with a last_log_id far in the past.
radhika [Fri, 17 Jun 2016 15:13:28 +0000 (11:13 -0400)]
closes #9372
Merge branch '9372-container-display'
radhika [Fri, 17 Jun 2016 15:13:12 +0000 (11:13 -0400)]
Merge branch 'master' into 9372-container-display
radhika [Fri, 17 Jun 2016 15:11:48 +0000 (11:11 -0400)]
9372: improve container_work_unit -> uri method to check if @proxied will respond_to table_name instead of using a rescue.
radhika [Thu, 16 Jun 2016 14:32:21 +0000 (10:32 -0400)]
9372: The children of a Container will be ContainerRequests to which this is the requesting_container_uuid.
radhika [Thu, 16 Jun 2016 12:17:46 +0000 (08:17 -0400)]
9372: variable names and comments.
Brett Smith [Thu, 16 Jun 2016 02:47:05 +0000 (22:47 -0400)]
9408: Restore build-essential and ruby-dev to arvbox.
These were previously being pulled in as Recommends, and they're
necessary to build gems for the demo image.
Refs #9408.
Lucas Di Pentima [Thu, 16 Jun 2016 01:51:07 +0000 (22:51 -0300)]
Merge branch '9417-asserttrue-for-value-comparison'
Closes #9417
Lucas Di Pentima [Wed, 15 Jun 2016 19:27:23 +0000 (16:27 -0300)]
9417: Replaced assertTrue() with assertEqual() on RetryNeedsMultipleServices's tests
Tom Clegg [Wed, 15 Jun 2016 19:40:58 +0000 (15:40 -0400)]
Merge branch '9395-keep-balance-page-size'
closes #9395
Tom Clegg [Wed, 15 Jun 2016 19:40:28 +0000 (15:40 -0400)]
9395: Fix encoding of integers in query params.
Tom Clegg [Wed, 15 Jun 2016 14:53:01 +0000 (10:53 -0400)]
9395: Explain CollectionBatchSize and CollectionBuffers in -help message.
Tom Clegg [Mon, 13 Jun 2016 14:31:39 +0000 (10:31 -0400)]
9395: Add CollectionBuffers config to keep-balance.
Tom Clegg [Mon, 13 Jun 2016 14:30:23 +0000 (10:30 -0400)]
9395: Add CollectionBatchSize config to keep-balance.
Peter Amstutz [Wed, 15 Jun 2016 19:38:34 +0000 (15:38 -0400)]
Add missing arvbox package "sudo" refs #9408
Peter Amstutz [Wed, 15 Jun 2016 19:15:50 +0000 (15:15 -0400)]
Use "less -R" in "arvbox log" so that color codes from api server logs display
properly. no issue #
Brett Smith [Wed, 15 Jun 2016 18:31:38 +0000 (14:31 -0400)]
Merge branch '9309-centos-7-install-guide-wip'
Refs #9309. Closes #9368.
Brett Smith [Wed, 8 Jun 2016 21:28:24 +0000 (17:28 -0400)]
9309: Add CentOS 7 to Install Guide.
Peter Amstutz [Wed, 15 Jun 2016 18:02:39 +0000 (14:02 -0400)]
Add missing package 'less'. Also reduce crunch-dispatch-local poll interval to 3 seconds. no issue #
radhika [Wed, 15 Jun 2016 17:39:52 +0000 (13:39 -0400)]
Merge branch 'master' into 9372-container-display
Lucas Di Pentima [Wed, 15 Jun 2016 17:35:34 +0000 (14:35 -0300)]
Merge branch '9408-arvbox-dockerfile-pulls-unnecessary-packages'
refs #9408
radhika [Wed, 15 Jun 2016 17:27:43 +0000 (13:27 -0400)]
9372: Corrected dashboard display to list container_requests, not containers as implementd in #9318.
Brett Smith [Wed, 15 Jun 2016 17:04:37 +0000 (13:04 -0400)]
9309: Bump Rails package iteration.
To accommodate systemd support in the package scripts.
Refs #9309.
Brett Smith [Wed, 15 Jun 2016 16:58:31 +0000 (12:58 -0400)]
Package build directories get same owner as $WORKSPACE.
Since this script runs as root inside the Docker container, the
directory created on the previous line is normally owned by root too.
This causes trouble when the package tests run later and try to create
repository information inside the directory. See, e.g.,
<https://ci.curoverse.com/job/build-packages-sso/23/consoleFull> for a
build that failed because of this.
No issue #.
Brett Smith [Wed, 15 Jun 2016 15:52:00 +0000 (11:52 -0400)]
Merge branch '9309-centos-7-rails-scripts-wip'
Refs #9309. Closes #9351, #9345.
Brett Smith [Fri, 3 Jun 2016 19:34:25 +0000 (15:34 -0400)]
9345: Use same script to test all Rails packages.
We want to simplify the SSO test script for a variety of reasons. We
don't want the package to depend on the PostgreSQL server; testing
proper PostgreSQL server configuration is a little out of scope for
this; and it's difficult to execute the test in a CentOS 7 Docker
image. This commit has the SSO server follow the same test strategy
as other Rails servers.
Brett Smith [Fri, 3 Jun 2016 18:50:59 +0000 (14:50 -0400)]
9309: Add systemd support to Rails package scripts.
Lucas Di Pentima [Wed, 15 Jun 2016 13:58:02 +0000 (10:58 -0300)]
9408: Added apt-get flag to avoid installing 'Recommended:' packages, it's better to have an explicit dependency list. Also, added bzip2 that was being pulled implicitly and it's needed.
Tom Clegg [Wed, 15 Jun 2016 13:51:55 +0000 (09:51 -0400)]
Merge branch '9374-go-sdk'
refs #9374
Tom Clegg [Wed, 15 Jun 2016 13:47:59 +0000 (09:47 -0400)]
9374: Remove unused receivers.
Tom Clegg [Tue, 14 Jun 2016 14:30:06 +0000 (10:30 -0400)]
9374: Fix uses of "this" as receiver name.
Tom Clegg [Tue, 14 Jun 2016 14:24:21 +0000 (10:24 -0400)]
9374: Use arvados.Collection instead of own CollectionRecord.
Tom Clegg [Mon, 13 Jun 2016 19:03:50 +0000 (15:03 -0400)]
9374: Propagate API transaction error details from response body to caller.
Tom Clegg [Fri, 10 Jun 2016 03:18:24 +0000 (23:18 -0400)]
9374: Add arvados.APIClientAuthorization.
Tom Clegg [Fri, 10 Jun 2016 03:04:50 +0000 (23:04 -0400)]
9374: Consolidate various Container structs as arvados.Container.
radhika [Tue, 14 Jun 2016 22:11:29 +0000 (18:11 -0400)]
9372: name and description can be edited on containers and container_requests despite the state.
Peter Amstutz [Tue, 14 Jun 2016 20:24:55 +0000 (16:24 -0400)]
Merge branch '9388-websocket-every-notify' closes #9388
Peter Amstutz [Tue, 14 Jun 2016 20:17:14 +0000 (16:17 -0400)]
Merge branch '8442-crunch-run-enable-net' refs #8442
Peter Amstutz [Tue, 14 Jun 2016 19:53:21 +0000 (15:53 -0400)]
9388: Reset sent_ids for consistency
Peter Amstutz [Tue, 14 Jun 2016 19:48:08 +0000 (15:48 -0400)]
9388: Add ws.notify_queue to ensure that notifies occurring during "catch up"
will get delivered in the correct order after catch up completes.
Peter Amstutz [Tue, 14 Jun 2016 17:28:32 +0000 (13:28 -0400)]
9388: Only record log ids sent during "catch up" phase, to avoid duplicates.
radhika [Tue, 14 Jun 2016 17:26:21 +0000 (13:26 -0400)]
9372: test cancel button for jobs and container_requests.
radhika [Tue, 14 Jun 2016 14:15:17 +0000 (10:15 -0400)]
Merge branch 'master' into 9372-container-display
radhika [Tue, 14 Jun 2016 14:14:18 +0000 (10:14 -0400)]
closes #9274
Merge branch '9274-requesting-container-uuid'
Brett Smith [Tue, 14 Jun 2016 13:47:53 +0000 (09:47 -0400)]
Merge branch '9370-crunch2-packages-wip'
Closes #9370, #9382.
Brett Smith [Fri, 10 Jun 2016 20:02:50 +0000 (16:02 -0400)]
9370: Package Crunch v2 dispatch services.
Brett Smith [Fri, 10 Jun 2016 19:57:05 +0000 (15:57 -0400)]
9370: Alphabetize the package_go_binary list.
radhika [Tue, 14 Jun 2016 03:10:51 +0000 (23:10 -0400)]
9372: container display
Peter Amstutz [Mon, 13 Jun 2016 20:31:49 +0000 (16:31 -0400)]
8442: Enable net when API is enabled.
Nico Cesar [Mon, 13 Jun 2016 14:47:21 +0000 (10:47 -0400)]
bumped the selenium driver version to 2.53.1 to see if we can manage our way out failed builds
no issue #
Brett Smith [Mon, 13 Jun 2016 14:16:07 +0000 (10:16 -0400)]
9309: Bugfix Ruby source install instructions for CentOS.
* Add missing `make` dependency.
* Add `-i` to `sudo gem install` throughout. Red Hat adds /usr/local
paths to $PATH in `/etc/profile`, so we need `-i` to find `gem`.
Refs #9309.
radhika [Sat, 11 Jun 2016 03:53:44 +0000 (23:53 -0400)]
refs #9318
Merge branch '9318-dashboard-uses-work-units'
radhika [Sat, 11 Jun 2016 03:52:02 +0000 (23:52 -0400)]
9318: fixed outputs display issue where "outpus: []" is being shown when there are no outputs.
radhika [Fri, 10 Jun 2016 17:43:03 +0000 (13:43 -0400)]
9274: while creating a ContainerRequest, set requesting_container_uuid based on the token.
Peter Amstutz [Fri, 10 Jun 2016 14:45:19 +0000 (10:45 -0400)]
9388: Record every log id sent and don't send duplicates.
radhika [Fri, 10 Jun 2016 14:23:55 +0000 (10:23 -0400)]
closes #9318, closes #8650
Merge branch '9318-dashboard-uses-work-units'
radhika [Fri, 10 Jun 2016 14:23:29 +0000 (10:23 -0400)]
Merge branch 'master' into 9318-dashboard-uses-work-units
Peter Amstutz [Thu, 9 Jun 2016 21:55:37 +0000 (17:55 -0400)]
9388: Process each notify individually instead attempting to batch them up.
Prior to this commit, websockets used to try to send log events out in batches,
by getting all logs with an id greater than last log that was sent.
Unfortunately, under concurrent database writes, logs from uncommited
transactions may not appear in the query even if logs with larger ids do
appear. This results in the uncommitted log never being sent out because
subsequent batch sends would not consider logs prior to the last log id that
was sent (which, in this case, is higher than the log that was missed.)
This commit eliminates the batching behavior. Because NOTIFY includes the log
id of a specific record that was committed, consider only the log record with
that id and process events in the order that the NOTIFY events arrive. This
means events may be delivered out of numeric order (although they now more
closely reflect the "actual" order, e.g. the order that the events were
actually committed to the database).
"Catch ups" where the client has specified a last_log_id and needs to have past
logs replayed continue to be sent in batches.
Brett Smith [Fri, 10 Jun 2016 03:23:35 +0000 (23:23 -0400)]
9187: Add priorities to crunch-dispatch-local test containers.
This is necessary to keep the tests working after
2c4ff054b533c62ecdb269963d3ab0af20d2df8b.
Otherwise, crunch-dispatch-local declines to do anything with them.
Refs #9187.
Peter Amstutz [Thu, 9 Jun 2016 20:21:59 +0000 (16:21 -0400)]
Merge branch '9187-requeued-containers' closes #9187
Peter Amstutz [Thu, 9 Jun 2016 20:21:36 +0000 (16:21 -0400)]
9187: Add comments.
radhika [Thu, 9 Jun 2016 20:16:06 +0000 (16:16 -0400)]
9318: Update the compute node status pane to make sure the Details option is only offered when there are any active nodes.
radhika [Thu, 9 Jun 2016 17:58:58 +0000 (13:58 -0400)]
Merge branch 'master' into 9318-dashboard-uses-work-units
radhika [Thu, 9 Jun 2016 17:57:39 +0000 (13:57 -0400)]
9318: remove :output method in favor of :outputs method and correct the logic for various object models.
Tom Clegg [Thu, 9 Jun 2016 14:21:29 +0000 (10:21 -0400)]
Merge branch '9278-expiring-collections'
refs #9278
Tom Clegg [Wed, 8 Jun 2016 13:52:30 +0000 (09:52 -0400)]
9278: Ensure locator signatures expire no later than expires_at.
Tom Clegg [Tue, 7 Jun 2016 17:59:29 +0000 (13:59 -0400)]
9278: Expose expires_at in API response.
Tom Clegg [Tue, 7 Jun 2016 17:59:19 +0000 (13:59 -0400)]
9278: Set expires_at=now if a client sets it to a time in the past.
The definition of "now" in the default collection scope changes from
current_timestamp (time the current transaction started) to
statement_timestamp() (time the current statement started) so a test
case can expire a collection and then confirm that it is not in the
default scope, all within a single test transaction.
Brett Smith [Wed, 8 Jun 2016 21:29:37 +0000 (17:29 -0400)]
Merge branch '9309-postgresql-install-guide-wip'
Refs #9309. Closes #9367.
Brett Smith [Wed, 8 Jun 2016 17:17:43 +0000 (13:17 -0400)]
9309: Separate PostgreSQL setup page in Install Guide.
This provides us with a few benefits:
* We have a place to discuss the different deployment options
installers have around PostgreSQL.
* PostgreSQL setup is very distro-specific (and it's going to get
worse when we add CentOS 7), so this can take some of that noise out
of the Rails server install guides.
* People who want to try new things, like cloud database services,
get a clearer separation of the install process and the database
setup process.
Peter Amstutz [Wed, 8 Jun 2016 15:46:12 +0000 (11:46 -0400)]
9187: Don't try to take lock on containers with priority 0.
Peter Amstutz [Wed, 8 Jun 2016 15:20:21 +0000 (11:20 -0400)]
9187: If a container is reported Queued, but we are monitoring it, stop monitoring it.
radhika [Wed, 8 Jun 2016 14:37:14 +0000 (10:37 -0400)]
Merge branch '8650-container-work-unit' into 9318-dashboard-uses-work-units
radhika [Wed, 8 Jun 2016 14:31:45 +0000 (10:31 -0400)]
8650: test and fixture update
radhika [Wed, 8 Jun 2016 14:25:36 +0000 (10:25 -0400)]
Merge branch 'master' into 8650-container-work-unit
radhika [Wed, 8 Jun 2016 14:23:15 +0000 (10:23 -0400)]
closes #8087
Merge branch 'wtsi-hgi-8087-arv-cli-request-body-from-file'
radhika [Wed, 8 Jun 2016 11:23:19 +0000 (07:23 -0400)]
Merge branch 'master' into wtsi-hgi-8087-arv-cli-request-body-from-file
radhika [Wed, 8 Jun 2016 11:19:36 +0000 (07:19 -0400)]
Merge branch '8087-arv-cli-request-body-from-file' of https://github.com/wtsi-hgi/arvados into wtsi-hgi-8087-arv-cli-request-body-from-file
radhika [Wed, 8 Jun 2016 03:26:46 +0000 (23:26 -0400)]
Merge branch 'master' into 9318-dashboard-uses-work-units
radhika [Wed, 8 Jun 2016 03:26:15 +0000 (23:26 -0400)]
refs #8876
Merge branch '8876-work-unit'
radhika [Wed, 8 Jun 2016 03:23:43 +0000 (23:23 -0400)]
8876: Pass work unit to determine_wallclock_runtime, not the original object.
radhika [Tue, 7 Jun 2016 21:07:38 +0000 (17:07 -0400)]
Merge branch 'master' into 9318-dashboard-uses-work-units
radhika [Tue, 7 Jun 2016 21:07:04 +0000 (17:07 -0400)]
closes #8876
Merge branch '8876-work-unit'
radhika [Tue, 7 Jun 2016 21:00:41 +0000 (17:00 -0400)]
8876: remove show_child_summary and replace it with is_running?
Peter Amstutz [Tue, 7 Jun 2016 20:43:19 +0000 (16:43 -0400)]
Bugfix submitting cwl jobs with arvados-cwl-runner refs #9275
Peter Amstutz [Tue, 7 Jun 2016 20:24:37 +0000 (16:24 -0400)]
Merge branch '9275-cwl-runner-creates-jobs' closes #9275
Peter Amstutz [Tue, 7 Jun 2016 20:17:49 +0000 (16:17 -0400)]
9275: Initial pipeline/job component update from response
radhika [Tue, 7 Jun 2016 17:23:12 +0000 (13:23 -0400)]
Merge branch '8650-container-work-unit' into 9318-dashboard-uses-work-units
radhika [Tue, 7 Jun 2016 17:22:50 +0000 (13:22 -0400)]
Merge branch '8876-work-unit' into 8650-container-work-unit
radhika [Tue, 7 Jun 2016 16:55:59 +0000 (12:55 -0400)]
8876: when computing cpu and running times, use the work unit's start and finished times if there are no children.
radhika [Tue, 7 Jun 2016 15:43:00 +0000 (11:43 -0400)]
9318: running and finished containers and fixtures updated.
radhika [Tue, 7 Jun 2016 02:40:01 +0000 (22:40 -0400)]
9275: Update the update_pipeline_component method to check if pipeline is null.
radhika [Tue, 7 Jun 2016 00:49:46 +0000 (20:49 -0400)]
Merge branch '8650-container-work-unit' into 9318-dashboard-uses-work-units
Conflicts:
apps/workbench/app/models/proxy_work_unit.rb
radhika [Tue, 7 Jun 2016 00:37:01 +0000 (20:37 -0400)]
8650: some more methods in ContainerWorkUnit
radhika [Tue, 7 Jun 2016 00:29:30 +0000 (20:29 -0400)]
Merge branch '8876-work-unit' into 8650-container-work-unit
radhika [Tue, 7 Jun 2016 00:28:21 +0000 (20:28 -0400)]
8876: Use JobWorkUnit for pipeline components and cleanup.
radhika [Mon, 6 Jun 2016 19:50:58 +0000 (15:50 -0400)]
9275: add record to cwl_runner_job as components
Peter Amstutz [Mon, 6 Jun 2016 19:26:03 +0000 (15:26 -0400)]
Merge branch '9187-crunchv2-dispatching' closes #9187
Peter Amstutz [Mon, 6 Jun 2016 18:46:37 +0000 (14:46 -0400)]
Merge branch 'master' into 9187-crunchv2-dispatching
projects / arvados.git / log