peter [Thu, 19 Jun 2014 13:16:30 +0000 (13:16 +0000)]
2883: Changed "task-output" category to "task-print" and "output" to
"diagnostic" in the UI text based on AWZ feedback.
peter [Thu, 19 Jun 2014 12:56:34 +0000 (12:56 +0000)]
2883: Fixed variable being used before it was declared, and fixed assignment of
ids to rows.
Peter Amstutz [Wed, 18 Jun 2014 21:08:11 +0000 (17:08 -0400)]
Merge branch '2883-job-log-viewer' of git.curoverse.com:arvados into origin-2883-job-log-viewer
Conflicts:
apps/workbench/app/views/jobs/_show_log.html.erb
Peter Amstutz [Wed, 18 Jun 2014 20:56:43 +0000 (16:56 -0400)]
Add error handling when log collection is not found. refs #3027.
Peter Amstutz [Wed, 18 Jun 2014 14:41:43 +0000 (14:41 +0000)]
2883: Use smart scrolling so keep the sorting and filtering selections on the
page when scrolling the output.
Peter Amstutz [Wed, 18 Jun 2014 14:05:00 +0000 (10:05 -0400)]
Merge branch 'master' into origin-2883-job-log-viewer
Peter Amstutz [Wed, 18 Jun 2014 14:04:12 +0000 (10:04 -0400)]
Fixed smart scrolling as intended for svg divs. refs #2919
radhika [Tue, 17 Jun 2014 23:31:55 +0000 (19:31 -0400)]
closes #2896
Merge branch '2896-websocket-cli'
radhika [Tue, 17 Jun 2014 23:30:54 +0000 (19:30 -0400)]
Merge branch 'master' into 2896-websocket-cli
Brett Smith [Tue, 17 Jun 2014 20:06:43 +0000 (16:06 -0400)]
crunch-job passes ARVADOS envvars to Docker.
No issue #.
Tim Pierce [Tue, 17 Jun 2014 19:42:45 +0000 (15:42 -0400)]
Merge branch '2936-job-progress-bar'
Closes #2936.
Tim Pierce [Tue, 17 Jun 2014 19:03:07 +0000 (15:03 -0400)]
2936: fix job progress bars
Add edge case settings for when a crunch job could not be started, or
when no tasks were ever created.
Calculate percent_total_tasks as a float, to ensure that it will be
nonzero even if there are more than 100 tasks altogether. Calculate
percentages of individual task progress with .ceil to ensure that there
will be at least 1% shown for each nonzero task status.
Refs #2936
radhika [Tue, 17 Jun 2014 17:58:48 +0000 (13:58 -0400)]
Merge branch 'master' into 2896-websocket-cli
radhika [Tue, 17 Jun 2014 17:58:12 +0000 (13:58 -0400)]
2896: add logging to events.py
Tim Pierce [Tue, 17 Jun 2014 17:16:55 +0000 (13:16 -0400)]
Merge branch '2934-limit-crunch-logs-bugfix'
Refs #2934.
Tim Pierce [Tue, 17 Jun 2014 17:15:28 +0000 (13:15 -0400)]
2934: add crunch-dispatch default settings
Add default values to application.default.yml for:
* crunch_limit_log_events_per_job
* crunch_limit_log_event_bytes_per_job
* crunch_log_bytes_per_event
* crunch_log_seconds_between_events
Refs #2934.
radhika [Tue, 17 Jun 2014 15:45:06 +0000 (11:45 -0400)]
Merge branch 'master' into 2896-websocket-cli
radhika [Tue, 17 Jun 2014 15:43:38 +0000 (11:43 -0400)]
2896: incorporate review comments: add logging, enhance creating filter object.
Peter Amstutz [Tue, 17 Jun 2014 14:21:41 +0000 (14:21 +0000)]
Fixed bug in Keep proxy when talking to Keep server that doesn't report
Content-Length correctly. no issue #
Tim Pierce [Tue, 17 Jun 2014 13:57:00 +0000 (09:57 -0400)]
2936: improve progress bar for failed jobs
Ensure that:
* All job progress bars reflect at least one task. If a job has no
tasks at all (done, failed, finished, or todo) that should be
considered a failed job, so render a progress bar as though one task
ran and failed.
* A failed job (j[:success] == false) always shows at least one failed
task. If a job is marked as failed but has no failed tasks, then
pretend there was one failed task so at least some red will appear in
the progress bar.
Fixes #2936.
Peter Amstutz [Tue, 17 Jun 2014 13:43:48 +0000 (09:43 -0400)]
Ajax load of tab panels now includes any query parameters the page was
originally loaded with. Also fixed related problem where the 'compare' route
of pipeline_instances controller wasn't aware of tab partials. closes #3013
Peter Amstutz [Tue, 17 Jun 2014 13:11:20 +0000 (13:11 +0000)]
2883: Improved pagination control a bit, added search.
Peter Amstutz [Tue, 17 Jun 2014 02:22:43 +0000 (02:22 +0000)]
2883: Added pagination for large logs.
Peter Amstutz [Mon, 16 Jun 2014 20:59:16 +0000 (20:59 +0000)]
2883: Added big red "show failed tasks" button.
Peter Amstutz [Mon, 16 Jun 2014 20:31:38 +0000 (20:31 +0000)]
2883: Distinguish between complete/incomplete and success/failure.
radhika [Mon, 16 Jun 2014 19:58:40 +0000 (15:58 -0400)]
2896: Add test file. Currently, the test only checks that arv-ws command is available and the options.
Peter Amstutz [Mon, 16 Jun 2014 19:54:07 +0000 (19:54 +0000)]
2883: Added node slots as its own column.
Brett Smith [Mon, 16 Jun 2014 19:27:26 +0000 (15:27 -0400)]
Merge branch '2879-job-api-docker-images'
Closes #2923, #3010.
radhika [Mon, 16 Jun 2014 19:18:31 +0000 (15:18 -0400)]
Merge branch 'master' into 2896-websocket-cli
Brett Smith [Thu, 12 Jun 2014 19:52:21 +0000 (15:52 -0400)]
2879: crunch-job uses Job Docker information provided by API server.
Brett Smith [Wed, 11 Jun 2014 21:43:27 +0000 (17:43 -0400)]
2879: API server maps Job Docker image constraints to Collections.
Doing this translation in the API server helps ensure that one piece
of software makes one consistent decision about which Docker image
should be used to run the Job.
Brett Smith [Mon, 16 Jun 2014 14:27:38 +0000 (10:27 -0400)]
2879: Let ArvadosModel.readable_by callers specify table name.
This makes it possible to use readable_by in queries with arbitrary
joins.
Brett Smith [Thu, 12 Jun 2014 14:10:24 +0000 (10:10 -0400)]
2879: Fix SLURM node separator when installing Docker images.
Brett Smith [Fri, 13 Jun 2014 17:40:45 +0000 (13:40 -0400)]
2879: Store Docker image repo+tag together in one tag.
It doesn't make sense to query the tag independently of the
repository, and this change will make the common case of querying both
together easier.
radhika [Mon, 16 Jun 2014 19:17:20 +0000 (15:17 -0400)]
2896: add arv-ws cli tool to arv.
Peter Amstutz [Mon, 16 Jun 2014 19:11:08 +0000 (19:11 +0000)]
2883: Added overview, node column and sort by node, style tweaks.
Tim Pierce [Mon, 16 Jun 2014 17:27:54 +0000 (13:27 -0400)]
Merge branch '2934-limit-crunch-logs'
Closes #2934
Tim Pierce [Mon, 16 Jun 2014 17:19:32 +0000 (13:19 -0400)]
2934: document stderr messages for commit tests
Some unit tests for the Commit models issue alarming but expected git
error messages on stderr. Added comments documenting these in
commits_controller_test.rb.
Refs #2934.
Peter Amstutz [Mon, 16 Jun 2014 15:46:06 +0000 (15:46 +0000)]
2883: Fix pattern for discovering success/failure of tasks.
Peter Amstutz [Mon, 16 Jun 2014 15:43:20 +0000 (15:43 +0000)]
2883: Fixes secondary key sort bug. Adds filtering on successful/failed tasks.
Tim Pierce [Mon, 16 Jun 2014 14:56:44 +0000 (10:56 -0400)]
2934: add crunch_dispatch_test repository
Move files for crunch_dispatch_test to their own test fixture
repository.
Refs #2934.
Peter Amstutz [Mon, 16 Jun 2014 14:19:04 +0000 (14:19 +0000)]
Merge remote-tracking branch 'origin/origin-2883-job-log-viewer' into 2883-job-log-viewer
Peter Amstutz [Mon, 16 Jun 2014 13:56:38 +0000 (09:56 -0400)]
some refactoring and added detection of task success or failure
Peter Amstutz [Mon, 16 Jun 2014 13:56:38 +0000 (09:56 -0400)]
2883: Added radio buttons to filter tasks by success/failure.
Tim Pierce [Fri, 13 Jun 2014 21:24:42 +0000 (17:24 -0400)]
Merge branch 'master' into 2934-limit-crunch-logs
Refs #2934
Tom Clegg [Fri, 13 Jun 2014 20:06:48 +0000 (16:06 -0400)]
Fix infinite scroll in chooser. refs #2872
Tim Pierce [Fri, 13 Jun 2014 19:08:48 +0000 (15:08 -0400)]
2934: add "bar" repository to test fixture
Add the "bar" repository to test/fixtures/repositories.yml so
CrunchDispatchTest may create a job using a commit from that
repository. (Change lost in a bad rebase.)
Refs #2934
Tim Pierce [Fri, 13 Jun 2014 18:03:04 +0000 (14:03 -0400)]
2934: count events and bytes in-memory
To avoid thrashing the database, crunch-dispatch.rb counts log events
and bytes in RAM instead of reading the database each time.
Refs #2934.
Peter Amstutz [Fri, 13 Jun 2014 17:31:04 +0000 (13:31 -0400)]
Fix fuse driver tests broken by changes to test fixtures. no issue #
Tom Clegg [Fri, 13 Jun 2014 15:12:10 +0000 (11:12 -0400)]
2872: Merge branch '2872-folder-nav' closes #2872
Tom Clegg [Fri, 13 Jun 2014 14:44:42 +0000 (10:44 -0400)]
2872: Add data binding for project names in dropdown.
Tim Pierce [Fri, 13 Jun 2014 14:44:21 +0000 (10:44 -0400)]
2934: add launch_crunch_dispatch to integration test
Added functionality for launching crunch-dispatch in
crunch_dispatch_test.rb while integration tests are running.
Refs #2934.
Tim Pierce [Fri, 13 Jun 2014 14:39:00 +0000 (10:39 -0400)]
Merge branch '2934-limit-crunch-logs' of git.curoverse.com:arvados into 2934-limit-crunch-logs
Fixing broken rebase
Tom Clegg [Fri, 13 Jun 2014 14:33:07 +0000 (10:33 -0400)]
2872: Merge branch 'master' into 2872-folder-nav
Conflicts:
apps/workbench/app/controllers/jobs_controller.rb
Peter Amstutz [Fri, 13 Jun 2014 14:13:39 +0000 (10:13 -0400)]
Merge branch 'origin-2883-job-log-viewer' closes #2883
Tom Clegg [Fri, 13 Jun 2014 14:11:26 +0000 (10:11 -0400)]
2753: Fix param name (filter -> filters).
Peter Amstutz [Fri, 13 Jun 2014 14:10:40 +0000 (10:10 -0400)]
2883: Moved addToLogViewer function out of the template and into assets and
reformatted it properly.
Tom Clegg [Fri, 13 Jun 2014 14:05:15 +0000 (10:05 -0400)]
2872: Redirect to parent project after deleting a subproject.
Tom Clegg [Fri, 13 Jun 2014 14:01:11 +0000 (10:01 -0400)]
2872: Fix provenance graph double-smart-scroll.
Tom Clegg [Fri, 13 Jun 2014 13:58:01 +0000 (09:58 -0400)]
2961: Fix crash on pipeline_instances/compare.
Tom Clegg [Fri, 13 Jun 2014 02:24:14 +0000 (22:24 -0400)]
2872: Fix test, to match fixed fixture.
Tom Clegg [Fri, 13 Jun 2014 00:53:05 +0000 (20:53 -0400)]
2872: Move project_tree code into helper_methods, fix up tests.
Tom Clegg [Thu, 12 Jun 2014 22:03:26 +0000 (18:03 -0400)]
2872: Fix bugs, tweak formatting
Brett Smith [Thu, 12 Jun 2014 19:45:36 +0000 (15:45 -0400)]
Merge branch '2879-docker-image-installer'
Refs #2879. Closes #2998, #3006.
Brett Smith [Thu, 12 Jun 2014 19:36:18 +0000 (15:36 -0400)]
2879: arv-keepdocker reports a better error for ambiguous hashes.
Refs #2879.
Brett Smith [Thu, 12 Jun 2014 18:51:23 +0000 (14:51 -0400)]
2879: Clarify Docker image search behavior in Keep installer.
Brett Smith [Thu, 12 Jun 2014 18:44:55 +0000 (14:44 -0400)]
2879: Docker Keep installer returns 0 if image already installed.
Brett Smith [Tue, 10 Jun 2014 20:34:01 +0000 (16:34 -0400)]
2879: Add arv-keepdocker command.
This puts a Docker image in Keep, and makes Arvados links to help find
the Collection by the image's names.
Brett Smith [Tue, 10 Jun 2014 15:09:42 +0000 (11:09 -0400)]
2879: arv-put main() returns what it prints.
This will enable other tools to reuse the results.
Brett Smith [Mon, 9 Jun 2014 16:02:01 +0000 (12:02 -0400)]
2879: Move Python is_hex function to arvados.util.
Brett Smith [Mon, 9 Jun 2014 15:13:39 +0000 (11:13 -0400)]
2879: Split arv-put's ArgumentParser into module segments.
This will let us use different pieces as a parent parser for other
tools, which I plan to do for the Docker image uploader.
Brett Smith [Mon, 9 Jun 2014 15:06:20 +0000 (11:06 -0400)]
2879: Factor out arv-put's cache creation to a utility library.
This function will be useful for the Docker image uploader, and
probably other tools as well.
Tom Clegg [Thu, 12 Jun 2014 19:21:59 +0000 (15:21 -0400)]
2755: Merge branch '2755-require-keep-permission' refs #2755
Tom Clegg [Thu, 12 Jun 2014 19:14:22 +0000 (15:14 -0400)]
2755: Fix handling of stripped/orig manifest text.
peter [Thu, 12 Jun 2014 19:11:53 +0000 (19:11 +0000)]
2883: Added filtering for crunchstat, slurm log lines.
Tom Clegg [Thu, 12 Jun 2014 19:00:13 +0000 (15:00 -0400)]
2755: Preserve blob signatures in manifest_text passed to collections.create.
Peter Amstutz [Thu, 12 Jun 2014 18:49:22 +0000 (14:49 -0400)]
Expanded search path for cgroup stats, changed command line interface a bit.
Also adjusted polling interval to every 10 seconds istead of every 1 second.
refs #2882
Peter Amstutz [Thu, 12 Jun 2014 18:18:48 +0000 (14:18 -0400)]
Bugfix in logging which cgroup stats files it uses. refs #2882
Peter Amstutz [Thu, 12 Jun 2014 18:16:19 +0000 (14:16 -0400)]
Bugfix searching for cgroup stats files. refs #2882
Peter Amstutz [Thu, 12 Jun 2014 18:04:08 +0000 (14:04 -0400)]
Crunchstat logs where it reads its stats from. refs #2882
Peter Amstutz [Thu, 12 Jun 2014 17:58:35 +0000 (13:58 -0400)]
Runs crunch script using "stdbuf -o0 -e0" so stdout and stderr are unbuffered,
solves problem of stdout showing up out of order and with incorrect time stamps
in logs. no issue #
Tom Clegg [Thu, 12 Jun 2014 17:36:10 +0000 (13:36 -0400)]
2755: Fix unfinished comment.
Tom Clegg [Thu, 12 Jun 2014 16:49:43 +0000 (12:49 -0400)]
2872: Fix selector in test case.
Tom Clegg [Thu, 12 Jun 2014 15:36:21 +0000 (11:36 -0400)]
2872: Add "move to project" button, fix "copy to project" behavior
(really copy, instead of adding a link).
Tom Clegg [Thu, 12 Jun 2014 15:35:28 +0000 (11:35 -0400)]
2872: Fix "remove" icon and pencil icon placement.
Tom Clegg [Thu, 12 Jun 2014 15:30:25 +0000 (11:30 -0400)]
2872: Muster all the "move" and "add" buttons up to the right side of the tabs.
Tom Clegg [Thu, 12 Jun 2014 15:29:01 +0000 (11:29 -0400)]
2872: Show projectless jobs/pipelines in "recent" list too.
Peter Amstutz [Thu, 12 Jun 2014 15:14:03 +0000 (11:14 -0400)]
Made a note about user how permissions are applied when attempting to create a
token for another user. Test for this case already exists. closes #2350.
Tom Clegg [Thu, 12 Jun 2014 14:40:00 +0000 (10:40 -0400)]
2872: Fix tests broken in merge.
Tim Pierce [Tue, 10 Jun 2014 14:37:35 +0000 (10:37 -0400)]
2934: add limits for crunch job log generation.
* crunch_limit_log_events_per_job
* crunch_limit_log_event_bytes_per_job
Limit the number of events a job may log, and the total number of
bytes a job may log.
* crunch_log_bytes_per_event
* crunch_log_seconds_between_events
Set minimum logging thresholds: event logs will only be flushed to the
database when at least crunch_log_bytes_per_event have been generated,
or crunch_log_seconds_between_events have passed.
Integration test CrunchDispatchTest exercised creating a job.
Refs #2934.
Peter Amstutz [Thu, 12 Jun 2014 14:23:42 +0000 (10:23 -0400)]
Merge branch 'origin-2882-job-process-stats' refs #2882
Peter Amstutz [Thu, 12 Jun 2014 14:19:18 +0000 (10:19 -0400)]
2882: Search subdirectories of cgroup for stats, because compute0 has a
slightly different cgroup layout from what's on my workstation (wtf?).
Peter Amstutz [Thu, 12 Jun 2014 13:56:52 +0000 (09:56 -0400)]
2883: Removed commented out code related to live loading (saved it to another branch).
Tom Clegg [Thu, 12 Jun 2014 03:57:37 +0000 (23:57 -0400)]
2872: Merge branch 'master' into 2872-folder-nav
Conflicts:
apps/workbench/app/assets/javascripts/pipeline_instances.js
apps/workbench/app/controllers/application_controller.rb
apps/workbench/app/controllers/collections_controller.rb
apps/workbench/app/controllers/jobs_controller.rb
apps/workbench/app/helpers/application_helper.rb
apps/workbench/app/models/job.rb
apps/workbench/app/views/application/_content.html.erb
apps/workbench/app/views/application/_show_metadata.html.erb
apps/workbench/app/views/pipeline_instances/_show_components.html.erb
Tom Clegg [Thu, 12 Jun 2014 03:31:41 +0000 (23:31 -0400)]
2872: Fix bookmark bar causing spurious window width.
peter [Thu, 12 Jun 2014 02:22:44 +0000 (02:22 +0000)]
2883: Adjusted task type column width. Commented out code for working with
live-updating logs, it almost works but there are some complications.
Tom Clegg [Thu, 12 Jun 2014 02:18:24 +0000 (22:18 -0400)]
2755: Add api server config to enable mandatory Keep signatures.
peter [Thu, 12 Jun 2014 01:59:12 +0000 (01:59 +0000)]
2883: Adjust timestamp display based on timezone and locale.
Peter Amstutz [Wed, 11 Jun 2014 21:12:15 +0000 (21:12 +0000)]
2883: Live updating log wip
Peter Amstutz [Wed, 11 Jun 2014 20:13:22 +0000 (20:13 +0000)]
2883: Styling column widths so they don't jump around when filters are turned
on and off.
projects / arvados.git / log