Nancy Ouyang [Tue, 14 Apr 2015 03:10:20 +0000 (23:10 -0400)]
5440: reword quickstart
Nancy Ouyang [Tue, 14 Apr 2015 02:35:49 +0000 (22:35 -0400)]
linkfix, reword quickstart section on homepage
Nancy Ouyang [Tue, 14 Apr 2015 02:04:53 +0000 (22:04 -0400)]
5440: remove all links to /start temporarily to avoid confusing user
Put in quickstart sections on docs homepage for both 1) public pipeline 2) pipeline developers
Revert changes made in #5090 (home title back to "Arvados Docs", topnav link to "arvados.org")
Refactor /user/index.html, removing references to /start and directing new users to homepage quickstart section
Nancy Ouyang [Tue, 14 Apr 2015 00:26:18 +0000 (20:26 -0400)]
Merge branch 'master' of git.curoverse.com:arvados into 5440-remove-doc-getting-started
Tom Clegg [Mon, 13 Apr 2015 21:05:44 +0000 (17:05 -0400)]
Merge branch '5414-keep-service-hints' refs #5414
Radhika Chippada [Mon, 13 Apr 2015 20:53:35 +0000 (16:53 -0400)]
refs #5493
Merge branch '5493-getting-started-modal'
Radhika Chippada [Mon, 13 Apr 2015 20:51:32 +0000 (16:51 -0400)]
5493: popup size
Radhika Chippada [Mon, 13 Apr 2015 20:47:35 +0000 (16:47 -0400)]
5493: popup size and a typo
Radhika Chippada [Mon, 13 Apr 2015 20:34:20 +0000 (16:34 -0400)]
5493: make popup size fixed
Radhika Chippada [Mon, 13 Apr 2015 20:25:21 +0000 (16:25 -0400)]
5493: public pipeline wiki page link added in page 3
Tom Clegg [Mon, 13 Apr 2015 20:24:02 +0000 (16:24 -0400)]
5414: Merge branch 'master' into 5414-keep-service-hints
Nancy Ouyang [Mon, 13 Apr 2015 20:11:31 +0000 (16:11 -0400)]
1 2 3 ul>ol 3rd page
Radhika Chippada [Mon, 13 Apr 2015 20:09:54 +0000 (16:09 -0400)]
5493: that did not sit well
Radhika Chippada [Mon, 13 Apr 2015 19:53:56 +0000 (15:53 -0400)]
5493: remove confusing btn class on explanation button spans to not show hand mouse cursor
Nancy Ouyang [Mon, 13 Apr 2015 19:50:18 +0000 (15:50 -0400)]
Merge branch 'master' of git.curoverse.com:arvados into 5440-remove-doc-getting-started
Radhika Chippada [Mon, 13 Apr 2015 19:47:29 +0000 (15:47 -0400)]
Merge branch 'master' into 5493-getting-started-modal
Nancy Ouyang [Mon, 13 Apr 2015 19:39:29 +0000 (15:39 -0400)]
typo
Nancy Ouyang [Mon, 13 Apr 2015 19:31:06 +0000 (15:31 -0400)]
dashed line
Nancy Ouyang [Mon, 13 Apr 2015 19:16:45 +0000 (15:16 -0400)]
format pg 3, 4
Nancy Ouyang [Mon, 13 Apr 2015 18:20:33 +0000 (14:20 -0400)]
minor format changes
Nancy Ouyang [Mon, 13 Apr 2015 18:16:41 +0000 (14:16 -0400)]
formatted first 2 pages
Tom Clegg [Mon, 13 Apr 2015 17:49:04 +0000 (13:49 -0400)]
5414: Rename zz_preload* to preload*; alphabetical names are not needed any more.
Tom Clegg [Mon, 13 Apr 2015 17:48:40 +0000 (13:48 -0400)]
5414: Rename zz_load* to load*; alphabetical names are not needed any more.
Tom Clegg [Mon, 13 Apr 2015 17:47:03 +0000 (13:47 -0400)]
5414: Control initializer load order using require_relative instead of alphabetical filenames.
Tom Clegg [Mon, 13 Apr 2015 17:28:05 +0000 (13:28 -0400)]
5414: Add test case for unrecognized/future hints.
Brett Smith [Mon, 13 Apr 2015 17:22:37 +0000 (13:22 -0400)]
5614: Update Workbench Gemfile for new Ruby SDK.
Refs #5614.
Tom Clegg [Mon, 13 Apr 2015 17:22:34 +0000 (13:22 -0400)]
5414: Fix up formatting.
Brett Smith [Mon, 13 Apr 2015 17:21:15 +0000 (13:21 -0400)]
Merge branch '5614-workbench-optimize-combine-collections-wip'
Refs #5614, #4943. Closes #5686.
Brett Smith [Wed, 8 Apr 2015 20:37:58 +0000 (16:37 -0400)]
5614: Improve Workbench combine collections performance.
* Get links with API list calls, instead of fetching each one
individually.
* Get a list mapping portable data hashes to UUIDs, and add a single
UUID per portable data hash to the fetch list. This helps us avoid
downloading multiple copies the same manifest text, and is probably
the single-biggest win in this entire commit for most use cases.
* Use the Ruby SDK to build the new collection. This lets us avoid
spawning new arv-normalize processes, and piping large manifests to
them. It also lets us build the entire collection and normalize
only when we're done.
* Use Oj instead of JSON.
Brett Smith [Mon, 13 Apr 2015 15:59:51 +0000 (11:59 -0400)]
5614: Workbench renders error flash separately from others.
Brett Smith [Wed, 8 Apr 2015 20:00:57 +0000 (16:00 -0400)]
5614: Use assert_includes more in Workbench tests for better diagnostics.
Brett Smith [Wed, 8 Apr 2015 19:42:53 +0000 (15:42 -0400)]
5614: Ruby SDK cp_r method creates streams as needed.
Brett Smith [Tue, 7 Apr 2015 19:50:31 +0000 (15:50 -0400)]
5614: Add Collection#each_file to Ruby SDK.
Brett Smith [Tue, 7 Apr 2015 19:29:40 +0000 (15:29 -0400)]
5614: Add Collection#exist? to Ruby SDK.
Peter Amstutz [Mon, 13 Apr 2015 17:10:09 +0000 (13:10 -0400)]
Merge branch '5692-pysdk-manifest-text-flush' closes #5692
Peter Amstutz [Mon, 13 Apr 2015 16:51:53 +0000 (12:51 -0400)]
5692: Don't call _get_manifest_text from test if we don't need to.
Nancy Ouyang [Mon, 13 Apr 2015 16:39:19 +0000 (12:39 -0400)]
dropped a header
Nancy Ouyang [Mon, 13 Apr 2015 16:37:50 +0000 (12:37 -0400)]
text content done; formatting needed
Radhika Chippada [Mon, 13 Apr 2015 16:02:12 +0000 (12:02 -0400)]
refs #5365
Merge branch '5365-not-link-unreadables'
Radhika Chippada [Mon, 13 Apr 2015 16:01:33 +0000 (12:01 -0400)]
5365: when the attrvalue is not a uuid, link_to_if_arvados_object
Peter Amstutz [Mon, 13 Apr 2015 15:23:09 +0000 (11:23 -0400)]
5692: Move implementation to internal _get_manifest_text(). Fix typos.
Peter Amstutz [Mon, 13 Apr 2015 14:18:16 +0000 (10:18 -0400)]
5692: Add flush flag to manifest_text() which calls commit_all(). Added
portable_manifest_text() which returns the stripped, normalized manifest text
free of side effects. Fixed tests.
Radhika Chippada [Sun, 12 Apr 2015 21:32:00 +0000 (17:32 -0400)]
closes #5365
Merge branch '5365-not-link-unreadables'
Radhika Chippada [Sun, 12 Apr 2015 21:29:28 +0000 (17:29 -0400)]
5365: add back data-toggle along with link disabled for Log tab.
Radhika Chippada [Sun, 12 Apr 2015 13:06:38 +0000 (09:06 -0400)]
5365: missed one updated signature update
Radhika Chippada [Sun, 12 Apr 2015 03:06:31 +0000 (23:06 -0400)]
5365: updated signature for link_to_arvados_object_if_readable
Peter Amstutz [Fri, 10 Apr 2015 20:24:22 +0000 (16:24 -0400)]
5692: Backed out commit_all() from Collection.manifest_text().
Collection.save() and Collection.save_new() now return unstripped manifest
text.
Peter Amstutz [Fri, 10 Apr 2015 19:27:05 +0000 (15:27 -0400)]
5692: Collection.manifest_text(strip=False) will flush open files and wait for
all blocks to be committed in order to return a manifest text with valid
authorization tokens. Fix tests affected by the change.
Nancy Ouyang [Fri, 10 Apr 2015 17:33:47 +0000 (13:33 -0400)]
Merge branch '5493-getting-started-modal' of git.curoverse.com:arvados into 5493-getting-started-modal
Conflicts:
apps/workbench/app/views/getting_started/_getting_started_popup.html.erb
Nancy Ouyang [Fri, 10 Apr 2015 17:32:42 +0000 (13:32 -0400)]
fix merge conflicts
Nancy Ouyang [Fri, 10 Apr 2015 16:57:39 +0000 (12:57 -0400)]
first page prototype
Radhika Chippada [Thu, 9 Apr 2015 15:54:59 +0000 (11:54 -0400)]
5365: do not link to docker_image_locator if not readable; also preload these.
Radhika Chippada [Thu, 9 Apr 2015 14:13:11 +0000 (10:13 -0400)]
Merge branch 'master' into 5365-not-link-unreadables
Radhika Chippada [Thu, 9 Apr 2015 14:08:36 +0000 (10:08 -0400)]
5365: add controller tests for preload_for_pdhs and collection_for_pdh methods
Radhika Chippada [Thu, 9 Apr 2015 13:37:46 +0000 (09:37 -0400)]
5365: preload editable component inputs
Radhika Chippada [Wed, 8 Apr 2015 23:48:13 +0000 (19:48 -0400)]
5365: add @distinct handling to workbench select queries and use this to preload portable_data_hashes as well.
Tom Clegg [Wed, 8 Apr 2015 18:40:42 +0000 (14:40 -0400)]
Merge branch '5416-git-config' refs #5416
Tom Clegg [Wed, 8 Apr 2015 16:41:31 +0000 (12:41 -0400)]
5416: Improve logging.
Tom Clegg [Wed, 8 Apr 2015 16:03:44 +0000 (12:03 -0400)]
5416: Do not blow up tests when git global config is uninitialized.
Tom Clegg [Wed, 8 Apr 2015 15:40:21 +0000 (11:40 -0400)]
5414: Do not blow up if local config file is empty.
Tom Clegg [Wed, 8 Apr 2015 15:39:48 +0000 (11:39 -0400)]
5414: Use reflect.DeepEqual instead of comparing serialized maps.
Tom Clegg [Wed, 1 Apr 2015 15:48:39 +0000 (11:48 -0400)]
5414: Add TestGetWithLocalServiceHint.
Tom Clegg [Wed, 1 Apr 2015 15:48:12 +0000 (11:48 -0400)]
5414: Clean up Locator / MakeLocator() API.
Tom Clegg [Sun, 29 Mar 2015 00:26:00 +0000 (20:26 -0400)]
5414: Add client support for Keep service hints.
Also, some incidental improvements in nearby code:
* Consistent logging in keepproxy, with one reusable logging statement
instead of a different statement/format for each outcome.
* In sdk/go/keepclient, remove public AuthorizedGet and AuthorizedAsk
methods. Instead, Get() and Ask() accept a locator (with or without
a permission token) and do the right thing. Callers don't have to
parse locators to decide which method to call.
* In sdk/go/keepclient, use an RWMutex instead of atomic.LoadPointer()
and unsafe.Pointer() to update KeepClient root maps safely.
* In sdk/go/keepclient, DiscoverKeepServers() doesn't return the new
root maps, just an error. In normal usage, the caller only cares
whether discovery was successful.
Also, some Go style fixes in nearby code:
* Use pointer receivers for all KeepClient methods.
https://golang.org/doc/faq#methods_on_values_or_pointers
* Use receiver name "kc", not "this".
https://github.com/golang/go/wiki/CodeReviewComments#receiver-names
* Handle errors first, use minimal indentation for normal code path.
https://github.com/golang/go/wiki/CodeReviewComments#indent-error-flow
Radhika Chippada [Wed, 8 Apr 2015 14:37:01 +0000 (10:37 -0400)]
Merge branch 'master' into 5493-getting-started-modal
Radhika Chippada [Wed, 8 Apr 2015 14:24:30 +0000 (10:24 -0400)]
5365: Additional test verifications for Log tab display.
Brett Smith [Wed, 8 Apr 2015 13:47:09 +0000 (09:47 -0400)]
Merge branch '5642-crunch-job-swap-limits-wip'
Closes #5642, #5664.
Brett Smith [Wed, 8 Apr 2015 13:46:51 +0000 (09:46 -0400)]
5642: crunch-job uses higher memory limit when running few tasks.
This gives a task all of the node's RAM when it's the only task
running this round, which is more in line with user expectations.
Brett Smith [Wed, 8 Apr 2015 13:46:23 +0000 (09:46 -0400)]
5642: Explicitly make all swap available under Docker in crunch-job.
Without this, Docker 1.2 through 1.5 send subprocesses SIGKILL if they
exceed the memory limit. Refer to #5642 for an example.
--memory-swap is pretty new (newer than 1.3.3), so we don't want to
require it. At the same time, we don't want to impose any memory
limits if we can't use it, because killing subprocesses that exceed a
--memory limit is too strict. This commit arranges to use both
--memory and --memory-swap only if the latter is available.
Radhika Chippada [Wed, 8 Apr 2015 13:43:23 +0000 (09:43 -0400)]
5365: trailing white space
Radhika Chippada [Wed, 8 Apr 2015 13:37:18 +0000 (09:37 -0400)]
Merge branch 'master' into 5365-not-link-unreadables
Radhika Chippada [Wed, 8 Apr 2015 13:35:55 +0000 (09:35 -0400)]
5365: preload output collection uuids and jobs to help improve performance when loading large pipelines.
Brett Smith [Tue, 7 Apr 2015 21:43:10 +0000 (17:43 -0400)]
Include arvados/collection in the Ruby SDK gem.
No issue #.
Radhika Chippada [Tue, 7 Apr 2015 18:05:43 +0000 (14:05 -0400)]
5365: preload jobs during pipeline display to improve performance.
Radhika Chippada [Tue, 7 Apr 2015 14:46:55 +0000 (10:46 -0400)]
Merge branch 'master' into 5365-not-link-unreadables
Radhika Chippada [Tue, 7 Apr 2015 14:46:16 +0000 (10:46 -0400)]
5365: refactor link to object if readable logic
Brett Smith [Tue, 7 Apr 2015 14:34:31 +0000 (10:34 -0400)]
Merge branch '5653-arv-copy-multiple-branches-wip'
Closes #5653, #5673.
Brett Smith [Mon, 6 Apr 2015 18:27:21 +0000 (14:27 -0400)]
5653: arv-copy copies multiple commits from the same repository+pipeline.
arv-copy previously used the repository name alone to determine which
job scripts it had already copied to the destination. If a pipeline
used unrelated commits from the same repository, it would skip copying
over all but the first. Track script versions throughout the copy
process and make sure all of them are copied to the destination
repository.
Brett Smith [Tue, 7 Apr 2015 13:57:19 +0000 (09:57 -0400)]
Merge branch '5352-crunch-dispatch-salloc-tempfail-wip'
Closes #5352, #5670.
Brett Smith [Sun, 5 Apr 2015 21:10:22 +0000 (17:10 -0400)]
5352: crunch-dispatch treats node allocation failure as temporary.
Imagine a scenario where multiple crunch-dispatch processes are
sitting idle, then suddenly a new job appears in the queue. They will
all race to dispatch the job. When this happens, we frequently see
that salloc fails for most of them, because they all requested the
same node(s) and only the winner will get them. crunch-dispatch has
no way to know the exit code "came from" salloc and not crunch-job,
and so marks the job failed.
This patch sets the SLURM_EXIT_IMMEDIATE environment variable to make
salloc use exit code 75 when the allocation fails. crunch-dispatch
already recognizes this exit code as a temporary failure, and will
leave the Arvados job record unchanged. Refer to salloc(1) and the
long comment in Dispatch#reap_children.
Radhika Chippada [Mon, 6 Apr 2015 23:49:10 +0000 (19:49 -0400)]
Merge branch 'master' into 5365-not-link-unreadables
Conflicts:
apps/workbench/test/integration/anonymous_access_test.rb
Radhika Chippada [Mon, 6 Apr 2015 23:43:56 +0000 (19:43 -0400)]
5365: job link in pipeline instance page
Radhika Chippada [Mon, 6 Apr 2015 20:58:05 +0000 (16:58 -0400)]
closes #5565
Merge branch '5565-breadcrumbs-in-anonyymous-view'
Radhika Chippada [Mon, 6 Apr 2015 20:54:22 +0000 (16:54 -0400)]
5565: show parent project hierarchy in breadcrumbs in anonymous view; not just current objects's parent.
Radhika Chippada [Mon, 6 Apr 2015 20:48:36 +0000 (16:48 -0400)]
Merge branch 'master' into 5565-breadcrumbs-in-anonyymous-view
Radhika Chippada [Mon, 6 Apr 2015 20:16:02 +0000 (16:16 -0400)]
closes #5492
Merge branch '5492-home-project-in-my-account'
Radhika Chippada [Mon, 6 Apr 2015 20:15:14 +0000 (16:15 -0400)]
Merge branch 'master' into 5492-home-project-in-my-account
Radhika Chippada [Mon, 6 Apr 2015 19:31:49 +0000 (15:31 -0400)]
Merge branch 'master' into 5565-breadcrumbs-in-anonyymous-view
Radhika Chippada [Mon, 6 Apr 2015 19:29:07 +0000 (15:29 -0400)]
5565: show trimmed down version of breadcrumbs in anonymous view.
Brett Smith [Mon, 6 Apr 2015 17:49:29 +0000 (13:49 -0400)]
Tighten up DNS check in arvdock.
I got arvdock stuck in an infinite loop because I had the right
nameserver line in /etc/resolv.conf, except it was commented out, so
arvdock kept checking for a name that it would never find. Use awk to
find and check the first functional nameserver line instead.
No issue #.
Radhika Chippada [Mon, 6 Apr 2015 16:43:54 +0000 (12:43 -0400)]
5492: add "Home project" link to my account menu.
Radhika Chippada [Mon, 6 Apr 2015 15:58:47 +0000 (11:58 -0400)]
Merge branch 'master' into 5365-not-link-unreadables
Radhika Chippada [Mon, 6 Apr 2015 15:58:26 +0000 (11:58 -0400)]
5365: white space
Brett Smith [Mon, 6 Apr 2015 15:38:08 +0000 (11:38 -0400)]
Add missing global declaration in arv-copy.
No issue #.
Radhika Chippada [Mon, 6 Apr 2015 15:04:11 +0000 (11:04 -0400)]
5365: couple more integration tests to access Log tab from within the Job page.
Radhika Chippada [Mon, 6 Apr 2015 14:15:39 +0000 (10:15 -0400)]
5365: additional test assertions for pipeline log tab display
Radhika Chippada [Mon, 6 Apr 2015 13:25:47 +0000 (09:25 -0400)]
Merge branch 'master' into 5365-not-link-unreadables
Brett Smith [Sun, 5 Apr 2015 21:39:33 +0000 (17:39 -0400)]
Fix debug log formatting in PySDK.
When multiple arguments are passed to a logger method, the first
argument is expected to be a printf-style format string, with the
remaining arguments expected to fill in the formatters.
No issue #.
Brett Smith [Sun, 5 Apr 2015 20:34:00 +0000 (16:34 -0400)]
5518: PySDK arvados.util must import arvados.
Closes #5518.
Radhika Chippada [Fri, 3 Apr 2015 21:29:08 +0000 (17:29 -0400)]
5365: add integration test to verify Log tab and other unreadable properties are disabled in anonymous view.
projects / arvados.git / log