arvados.git
9 years ago3618: best guesses about which database columns could be used for sorting (not certai...
Phil Hodgson [Sun, 26 Oct 2014 12:25:02 +0000 (13:25 +0100)]
3618: best guesses about which database columns could be used for sorting (not certain about the descriptions, though, in many cases)

9 years ago3618: When changing to sorting on a different column, make sure the directional indic...
Phil Hodgson [Sun, 26 Oct 2014 12:24:19 +0000 (13:24 +0100)]
3618: When changing to sorting on a different column, make sure the directional indicator of the previous is removed.

9 years ago3618: Add Workbench integration test for sorting data collections
Phil Hodgson [Sat, 25 Oct 2014 18:57:02 +0000 (20:57 +0200)]
3618: Add Workbench integration test for sorting data collections

9 years ago3618: correctly propagate the ordering parameters when scrolling
Phil Hodgson [Sat, 25 Oct 2014 18:56:23 +0000 (20:56 +0200)]
3618: correctly propagate the ordering parameters when scrolling

9 years ago3618: Add some basic API server tests for the sort feature
Phil Hodgson [Sat, 25 Oct 2014 08:18:57 +0000 (10:18 +0200)]
3618: Add some basic API server tests for the sort feature

9 years ago3618: replace js use of == and != with the more predictable === and !==
Phil Hodgson [Fri, 24 Oct 2014 17:40:01 +0000 (19:40 +0200)]
3618: replace js use of == and != with the more predictable === and !==

9 years agoMerge branch 'master' into 3618-column-ordering
Phil Hodgson [Fri, 24 Oct 2014 12:06:45 +0000 (14:06 +0200)]
Merge branch 'master' into 3618-column-ordering

9 years agocloses #4195
radhika [Thu, 23 Oct 2014 22:01:02 +0000 (18:01 -0400)]
closes #4195
Merge branch '4195-pipeline-tutorial'

9 years agoMerge branch 'master' into 4195-pipeline-tutorial
radhika [Thu, 23 Oct 2014 22:00:12 +0000 (18:00 -0400)]
Merge branch 'master' into 4195-pipeline-tutorial

9 years ago4195: update workbench dashboard pic
radhika [Thu, 23 Oct 2014 21:59:04 +0000 (17:59 -0400)]
4195: update workbench dashboard pic

9 years agoMerge branch '4186-install-doc-improvements'
Ward Vandewege [Thu, 23 Oct 2014 21:32:00 +0000 (17:32 -0400)]
Merge branch '4186-install-doc-improvements'

refs #4186

9 years agoMerge branch 'master' into 4186-install-doc-improvements
Ward Vandewege [Thu, 23 Oct 2014 21:31:38 +0000 (17:31 -0400)]
Merge branch 'master' into 4186-install-doc-improvements

9 years agoMerge branch 'master' into 4195-pipeline-tutorial
radhika [Thu, 23 Oct 2014 21:24:29 +0000 (17:24 -0400)]
Merge branch 'master' into 4195-pipeline-tutorial

9 years agocloses #4228
radhika [Thu, 23 Oct 2014 21:23:00 +0000 (17:23 -0400)]
closes #4228
Merge branch '4228-collection-subdir-files'

9 years agoMerge branch 'master' into 4195-pipeline-tutorial
radhika [Thu, 23 Oct 2014 21:03:44 +0000 (17:03 -0400)]
Merge branch 'master' into 4195-pipeline-tutorial

9 years agoAdd install dependencies for the SSO server.
Ward Vandewege [Thu, 23 Oct 2014 20:58:53 +0000 (16:58 -0400)]
Add install dependencies for the SSO server.

refs #4186

9 years agoMerge branch 'master' into 4228-collection-subdir-files
radhika [Thu, 23 Oct 2014 20:52:06 +0000 (16:52 -0400)]
Merge branch 'master' into 4228-collection-subdir-files

Conflicts:
apps/workbench/test/integration/collections_test.rb

9 years agorefs #4227
radhika [Thu, 23 Oct 2014 20:36:32 +0000 (16:36 -0400)]
refs #4227
Merge branch '4227-test-fix'

9 years agoExplain the Keepstore's -permission-key-file argument and API server's
Ward Vandewege [Thu, 23 Oct 2014 20:29:31 +0000 (16:29 -0400)]
Explain the Keepstore's -permission-key-file argument and API server's
blob_signing_key configuration value.

refs #4186

9 years agono issue #
radhika [Thu, 23 Oct 2014 20:27:02 +0000 (16:27 -0400)]
no issue #

9 years agono issue #
radhika [Thu, 23 Oct 2014 20:24:00 +0000 (16:24 -0400)]
no issue #
Merge branch 'master' of git.curoverse.com:arvados

9 years agorefs #4227 - update strptime format for parsing pipeline start and finish time.
radhika [Thu, 23 Oct 2014 20:22:50 +0000 (16:22 -0400)]
refs #4227 - update strptime format for parsing pipeline start and finish time.

9 years agoFirst set of improvements:
Ward Vandewege [Thu, 23 Oct 2014 19:59:23 +0000 (15:59 -0400)]
First set of improvements:

* Suggest skipping SSO server installation for now, until we upgrade that codebase

* Be more explicit about the desired values for arvados_login_base and
  arvados_v1_base in the workbench installation instructions.

refs #4186

9 years agoMerge branch '4139-clean-api-node-cruft-wip'
Brett Smith [Thu, 23 Oct 2014 19:44:35 +0000 (15:44 -0400)]
Merge branch '4139-clean-api-node-cruft-wip'

Refs #4139, #4274.  Closes #4276.

9 years ago4139: Node create API requires a node parameter.
Brett Smith [Thu, 23 Oct 2014 19:36:52 +0000 (15:36 -0400)]
4139: Node create API requires a node parameter.

This makes it more consistent with other API create methods.

9 years ago4139: Remove cloud node setup code from API server.
Brett Smith [Tue, 21 Oct 2014 14:58:59 +0000 (10:58 -0400)]
4139: Remove cloud node setup code from API server.

This code has never been used in production, and its functionality has
officially been assumed by Node Manager.

9 years agorefs #4227 - rescue from any error in parsing pipeline start and finish time so that...
radhika [Thu, 23 Oct 2014 19:37:52 +0000 (15:37 -0400)]
refs #4227 - rescue from any error in parsing pipeline start and finish time so that jenkins runs do not choke on these failures.

9 years agoIncrease limit for collections controller querying same portable_data_hash as
Peter Amstutz [Thu, 23 Oct 2014 17:53:31 +0000 (13:53 -0400)]
Increase limit for collections controller querying same portable_data_hash as
workaround to fix tests, refs #4058, but really needs a proper fix, refs #3400

9 years agoMerge branch '4058-workbench-collection-redirect' closes #4058
Peter Amstutz [Thu, 23 Oct 2014 15:18:54 +0000 (11:18 -0400)]
Merge branch '4058-workbench-collection-redirect' closes #4058

9 years ago4058: Typo fix "collection" -> "collections"
Peter Amstutz [Thu, 23 Oct 2014 15:18:29 +0000 (11:18 -0400)]
4058: Typo fix "collection" -> "collections"

9 years ago4058: Tweaked presentation per review feedback
Peter Amstutz [Thu, 23 Oct 2014 13:38:15 +0000 (09:38 -0400)]
4058: Tweaked presentation per review feedback

9 years agocloses #4026
radhika [Thu, 23 Oct 2014 02:25:46 +0000 (22:25 -0400)]
closes #4026
Merge branch '4026-project-move-admin'

9 years ago4026: simplify writable check
radhika [Thu, 23 Oct 2014 02:24:37 +0000 (22:24 -0400)]
4026: simplify writable check

9 years agoMerge branch 'master' into 4026-project-move-admin
radhika [Thu, 23 Oct 2014 00:10:17 +0000 (20:10 -0400)]
Merge branch 'master' into 4026-project-move-admin

9 years agoMerge branch 'master' into 4228-collection-subdir-files
radhika [Wed, 22 Oct 2014 23:38:11 +0000 (19:38 -0400)]
Merge branch 'master' into 4228-collection-subdir-files

9 years ago4228: add test for combining files from a collection subdir.
radhika [Wed, 22 Oct 2014 23:12:55 +0000 (19:12 -0400)]
4228: add test for combining files from a collection subdir.

9 years ago4228: fix arv_normalize input when a file in a subdir of a collection is being combined.
radhika [Wed, 22 Oct 2014 21:18:25 +0000 (17:18 -0400)]
4228: fix arv_normalize input when a file in a subdir of a collection is being combined.

9 years ago4228: fix arv_normalize input when a file in a subdir of a collection is being combined.
radhika [Wed, 22 Oct 2014 20:17:50 +0000 (16:17 -0400)]
4228: fix arv_normalize input when a file in a subdir of a collection is being combined.

9 years ago4137: Fix bad state reference in Node Manager daemon.
Brett Smith [Wed, 22 Oct 2014 19:13:09 +0000 (15:13 -0400)]
4137: Fix bad state reference in Node Manager daemon.

Refs #4137.

9 years agocloses #4227
radhika [Wed, 22 Oct 2014 18:57:27 +0000 (14:57 -0400)]
closes #4227
Merge branch '4227-date-display'

9 years agoMerge branch 'master' into 4227-date-display
radhika [Wed, 22 Oct 2014 18:55:55 +0000 (14:55 -0400)]
Merge branch 'master' into 4227-date-display

Conflicts:
apps/workbench/test/integration/projects_test.rb

9 years agorefs #4091 - comment out the test that is failing intermittently in jenkins env.
radhika [Wed, 22 Oct 2014 18:46:34 +0000 (14:46 -0400)]
refs #4091 - comment out the test that is failing intermittently in jenkins env.

9 years ago4139: Fix race condition in Node Manager tests.
Brett Smith [Wed, 22 Oct 2014 18:28:45 +0000 (14:28 -0400)]
4139: Fix race condition in Node Manager tests.

Get a reference to the monitor mock earlier, before the daemon starts
working with it.  Otherwise, we might get inconsistent state results.

Refs #4139.

9 years agoReport "swap" memory statistic if kernel provides it. refs #4185
Tom Clegg [Wed, 22 Oct 2014 18:01:10 +0000 (14:01 -0400)]
Report "swap" memory statistic if kernel provides it. refs #4185

9 years ago4227: much simplified date display test
radhika [Wed, 22 Oct 2014 17:12:10 +0000 (13:12 -0400)]
4227: much simplified date display test

9 years agoMerge branch 'master' into 4227-date-display
radhika [Wed, 22 Oct 2014 15:55:02 +0000 (11:55 -0400)]
Merge branch 'master' into 4227-date-display

9 years agoMerge branch '3826-crunchstat-netstats' closes #3826
Tom Clegg [Wed, 22 Oct 2014 15:01:55 +0000 (11:01 -0400)]
Merge branch '3826-crunchstat-netstats' closes #3826

9 years ago3826: Merge branch 'master' into 3826-crunchstat-netstats
Tom Clegg [Wed, 22 Oct 2014 14:57:03 +0000 (10:57 -0400)]
3826: Merge branch 'master' into 3826-crunchstat-netstats

9 years agoMerge branch '4139-node-manager-race-fix-wip'
Brett Smith [Wed, 22 Oct 2014 14:35:21 +0000 (10:35 -0400)]
Merge branch '4139-node-manager-race-fix-wip'

Refs #4139, #4275.

9 years ago4139: Node Manager more closely tracks nodes it boots.
Brett Smith [Wed, 22 Oct 2014 14:34:23 +0000 (10:34 -0400)]
4139: Node Manager more closely tracks nodes it boots.

When using Node Manager on EC2, we saw a race condition where a node
would finish setting up, but would not be returned in node listings
right away.  This adds a "booted" node state to the daemon, where a
node booted by Node Manager is assumed to be up and running unless it
disappears from the listing *after* being listed.  It's escalated to
the normal workflow after it appears in a listing.

9 years ago4139: Node Manager supports subscribing to shutdown events.
Brett Smith [Wed, 22 Oct 2014 14:02:33 +0000 (10:02 -0400)]
4139: Node Manager supports subscribing to shutdown events.

This is necessary to fix a race condition.  The daemon needs to be
able to track nodes that it has booted even if they don't appear in
listings.

9 years agoMerge branch 'master' into 4195-pipeline-tutorial
radhika [Tue, 21 Oct 2014 22:12:44 +0000 (18:12 -0400)]
Merge branch 'master' into 4195-pipeline-tutorial

9 years ago4195: fix the tutorial to match the latest dashboard ui.
radhika [Tue, 21 Oct 2014 22:11:45 +0000 (18:11 -0400)]
4195: fix the tutorial to match the latest dashboard ui.

9 years agoMerge branch '4266-log-performance' refs #4266
Tom Clegg [Tue, 21 Oct 2014 21:28:53 +0000 (17:28 -0400)]
Merge branch '4266-log-performance' refs #4266

9 years ago4266: Merge branch 'master' into 4266-log-performance
Tom Clegg [Tue, 21 Oct 2014 21:12:07 +0000 (17:12 -0400)]
4266: Merge branch 'master' into 4266-log-performance

9 years ago4266: Add word missing from comment.
Tom Clegg [Tue, 21 Oct 2014 20:36:13 +0000 (16:36 -0400)]
4266: Add word missing from comment.

9 years ago4266: Use each_line as enumerator instead of building an array with lines.each.
Tom Clegg [Tue, 21 Oct 2014 20:35:41 +0000 (16:35 -0400)]
4266: Use each_line as enumerator instead of building an array with lines.each.

9 years ago4266: Add missing "next" statement, oops.
Tom Clegg [Tue, 21 Oct 2014 20:34:53 +0000 (16:34 -0400)]
4266: Add missing "next" statement, oops.

9 years ago4227: update fixtures to use bigger finish times
radhika [Tue, 21 Oct 2014 19:57:47 +0000 (15:57 -0400)]
4227: update fixtures to use bigger finish times

9 years agoMerge branch 'master' of git.curoverse.com:arvados into 4227-date-display
radhika [Tue, 21 Oct 2014 19:44:46 +0000 (15:44 -0400)]
Merge branch 'master' of git.curoverse.com:arvados into 4227-date-display

9 years agoMerge branch '4139-node-manager-polling-logging-wip'
Brett Smith [Tue, 21 Oct 2014 18:35:49 +0000 (14:35 -0400)]
Merge branch '4139-node-manager-polling-logging-wip'

Refs #4275, #4139.

9 years ago4139: Improve scheduling of Node Manager polls.
Brett Smith [Tue, 21 Oct 2014 18:31:44 +0000 (14:31 -0400)]
4139: Improve scheduling of Node Manager polls.

* Catch all exceptions, so that we keep polling no matter what
  happens.  Use CLIENT_ERRORS as a hint about how much logging we
  need.
* Make the next poll time calculation a little less stateful and
  easier to follow.
* Add tests for poll scheduling.

9 years ago4139: Improve logging in Node Manager poll actors.
Brett Smith [Tue, 21 Oct 2014 18:13:37 +0000 (14:13 -0400)]
4139: Improve logging in Node Manager poll actors.

9 years ago4139: Node Manager callback actor avoids redundant delivery calls.
Brett Smith [Tue, 21 Oct 2014 15:19:05 +0000 (11:19 -0400)]
4139: Node Manager callback actor avoids redundant delivery calls.

This helps make it more responsive when it receives a shutdown
request.

9 years ago4227: some more test and fixture updates.
radhika [Tue, 21 Oct 2014 17:48:35 +0000 (13:48 -0400)]
4227: some more test and fixture updates.

9 years ago4266: Tweak long-line handling.
Tom Clegg [Tue, 21 Oct 2014 17:46:00 +0000 (13:46 -0400)]
4266: Tweak long-line handling.

9 years ago4266: Fix OOM when stderr has a lot of data with no newlines.
Tom Clegg [Tue, 21 Oct 2014 17:29:05 +0000 (13:29 -0400)]
4266: Fix OOM when stderr has a lot of data with no newlines.

9 years ago4227: minor test upadtes
radhika [Tue, 21 Oct 2014 17:28:57 +0000 (13:28 -0400)]
4227: minor test upadtes

9 years ago4266: Clean up streambuf.split(newline) loop.
Tom Clegg [Tue, 21 Oct 2014 17:05:36 +0000 (13:05 -0400)]
4266: Clean up streambuf.split(newline) loop.

9 years agoMerge branch 'master' into 4227-date-display
radhika [Tue, 21 Oct 2014 17:00:01 +0000 (13:00 -0400)]
Merge branch 'master' into 4227-date-display

9 years agocloses #4054
radhika [Tue, 21 Oct 2014 16:56:33 +0000 (12:56 -0400)]
closes #4054
Merge branch '4054-sharing-email'

9 years ago4091: the test with 200 jobs and 10 pipelines is failing in jenkins env. reduce the...
radhika [Tue, 21 Oct 2014 16:54:32 +0000 (12:54 -0400)]
4091: the test with 200 jobs and 10 pipelines is failing in jenkins env. reduce the number of pipelines to 2 to see if shorter runtime helps.

9 years agoMerge branch 'master' into 4054-sharing-email
radhika [Tue, 21 Oct 2014 16:48:35 +0000 (12:48 -0400)]
Merge branch 'master' into 4054-sharing-email

9 years ago4227: AM / PM indicator fix
radhika [Tue, 21 Oct 2014 16:47:37 +0000 (12:47 -0400)]
4227: AM / PM indicator fix

9 years agoArvados python SDK: do not blow up when HOME is not set.
Ward Vandewege [Tue, 21 Oct 2014 14:11:43 +0000 (10:11 -0400)]
Arvados python SDK: do not blow up when HOME is not set.

No issue #

9 years ago4266: Fix log processing performance.
Tom Clegg [Mon, 20 Oct 2014 21:30:30 +0000 (17:30 -0400)]
4266: Fix log processing performance.

* Remove "max log table entries per job" limit (and its horrible
  memory leak).

* When logs are coming fast, but under all throttle thresholds, group
  them into fewer rows in the logs table.

* Optimize performance by making a short code path when any threshold
  is exceeded. Now capable of ~200 MiB/s (of 100-character lines) on
  lappy386.

* Bring stream buffer back up to a reasonable size, add a comment to
  protect it from future style tweaks.

* Simplify time calculations by storing time-to-reopen-throttle
  instead of time-throttle-last-opened.

* Log "# bytes skipped" to stderr (sysadmin logs) too, not just the
  logs table.

9 years agoMerge branch '3787-docker-docs' closes #3787
Peter Amstutz [Mon, 20 Oct 2014 19:36:36 +0000 (15:36 -0400)]
Merge branch '3787-docker-docs' closes #3787

9 years ago3787: docker group -> @docker@ group for consistency
Peter Amstutz [Mon, 20 Oct 2014 19:35:48 +0000 (15:35 -0400)]
3787: docker group -> @docker@ group for consistency

9 years ago3787: Add note about needing to be in docker group. A few other minor text tweaks.
Peter Amstutz [Mon, 20 Oct 2014 19:23:21 +0000 (15:23 -0400)]
3787: Add note about needing to be in docker group.  A few other minor text tweaks.

9 years ago3787: Update title, grammar, add "Share Docker images", add job-pipeline-ref.html...
Peter Amstutz [Mon, 20 Oct 2014 18:12:41 +0000 (14:12 -0400)]
3787: Update title, grammar, add "Share Docker images", add job-pipeline-ref.html based on review feedback.

9 years agoMerge branch 'master' into 4026-project-move-admin
radhika [Mon, 20 Oct 2014 17:49:08 +0000 (13:49 -0400)]
Merge branch 'master' into 4026-project-move-admin

Conflicts:
apps/workbench/test/integration/projects_test.rb

9 years agoMerge branch 'master' into 4054-sharing-email
radhika [Mon, 20 Oct 2014 17:34:10 +0000 (13:34 -0400)]
Merge branch 'master' into 4054-sharing-email

9 years ago3826: Merge branch 'master' into 3826-crunchstat-netstats
Tom Clegg [Mon, 20 Oct 2014 16:34:58 +0000 (12:34 -0400)]
3826: Merge branch 'master' into 3826-crunchstat-netstats

9 years ago3826: Fix confusing reuse of variable name.
Tom Clegg [Mon, 20 Oct 2014 16:18:48 +0000 (12:18 -0400)]
3826: Fix confusing reuse of variable name.

9 years ago3826: Use strconv instead of scanner + sscanf.
Tom Clegg [Mon, 20 Oct 2014 16:18:13 +0000 (12:18 -0400)]
3826: Use strconv instead of scanner + sscanf.

9 years ago3826: Use global logChan. Use ioutil.ReadFile.
Tom Clegg [Mon, 20 Oct 2014 16:10:12 +0000 (12:10 -0400)]
3826: Use global logChan. Use ioutil.ReadFile.

9 years ago3826: Clean up slice initialization.
Tom Clegg [Mon, 20 Oct 2014 15:57:27 +0000 (11:57 -0400)]
3826: Clean up slice initialization.

9 years ago4058: Tests for portable data hash redirection and multiple matches page.
Peter Amstutz [Mon, 20 Oct 2014 15:39:13 +0000 (11:39 -0400)]
4058: Tests for portable data hash redirection and multiple matches page.

9 years agocloses #4062
radhika [Mon, 20 Oct 2014 15:25:19 +0000 (11:25 -0400)]
closes #4062
Merge branch '4062-infinite-scroll-repeat-TC'

9 years ago4062: Do not clobber next_page_url filters with local filters.
Tom Clegg [Mon, 20 Oct 2014 14:47:32 +0000 (10:47 -0400)]
4062: Do not clobber next_page_url filters with local filters.

9 years ago4058: If a portable data hash correpsonds to a single collection, automatically
Peter Amstutz [Mon, 20 Oct 2014 14:45:10 +0000 (10:45 -0400)]
4058: If a portable data hash correpsonds to a single collection, automatically
redirect to the collection page.  If not, show a special "menu" page listing
the matching collections.

9 years ago4062: Merge branch 'master' into 4062-infinite-scroll-repeat-TC
Tom Clegg [Mon, 20 Oct 2014 14:24:10 +0000 (10:24 -0400)]
4062: Merge branch 'master' into 4062-infinite-scroll-repeat-TC

9 years ago4026: admin user can move a project under another user's home project.
radhika [Mon, 20 Oct 2014 13:22:35 +0000 (09:22 -0400)]
4026: admin user can move a project under another user's home project.

9 years ago4054: minor test update
radhika [Sat, 18 Oct 2014 00:37:34 +0000 (20:37 -0400)]
4054: minor test update

9 years agoMerge branch 'master' into 4054-sharing-email
radhika [Sat, 18 Oct 2014 00:09:29 +0000 (20:09 -0400)]
Merge branch 'master' into 4054-sharing-email

9 years ago4054: show email address in sharing tab and update test to verify.
radhika [Fri, 17 Oct 2014 22:40:28 +0000 (18:40 -0400)]
4054: show email address in sharing tab and update test to verify.

9 years agoMerge branch '3698-invalid-output-of' closes #3698
Peter Amstutz [Fri, 17 Oct 2014 20:54:31 +0000 (16:54 -0400)]
Merge branch '3698-invalid-output-of' closes #3698

9 years agoMake sure to use httpclient 2.5.0 or higher for Workbench. Older
Ward Vandewege [Fri, 17 Oct 2014 19:47:11 +0000 (15:47 -0400)]
Make sure to use httpclient 2.5.0 or higher for Workbench. Older
versions force the use of SSLv3, which is no longer advisable now that
Poodle is a thing.

No issue #

9 years ago3698: Fix: components keys are symbols, not strings. Tweaked error message to
Peter Amstutz [Fri, 17 Oct 2014 19:36:49 +0000 (15:36 -0400)]
3698: Fix: components keys are symbols, not strings.  Tweaked error message to
tell you what the invalid output_of actually is.

9 years ago3698: Add check that output_of refers to an actual component.
Peter Amstutz [Fri, 17 Oct 2014 19:17:01 +0000 (15:17 -0400)]
3698: Add check that output_of refers to an actual component.