Lucas Di Pentima [Fri, 16 Jun 2017 18:02:44 +0000 (15:02 -0300)]
Merge branch '11557-acr-output-col-perms'
Closes #11557
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@curoverse.com>
Lucas Di Pentima [Fri, 16 Jun 2017 17:12:16 +0000 (14:12 -0300)]
11557: Fixed the way that can_read permission link is created. Updated test.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@curoverse.com>
Lucas Di Pentima [Fri, 16 Jun 2017 16:34:13 +0000 (13:34 -0300)]
11557: Merge branch 'master' into 11557-acr-output-col-perms
Tom Clegg [Fri, 16 Jun 2017 13:43:49 +0000 (09:43 -0400)]
Merge branch '11283-available-slot-query'
closes #11283
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Fri, 16 Jun 2017 13:34:08 +0000 (09:34 -0400)]
11283: Add explanatory comment to SQL query.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Thu, 15 Jun 2017 20:19:54 +0000 (16:19 -0400)]
Merge branch '11729-cache-miss'
refs #11729
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Wed, 14 Jun 2017 21:46:01 +0000 (17:46 -0400)]
11729: Avoid refetching manifest in forceReload case
...if uuid->pdh cache turns out not to be expired.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Lucas Di Pentima [Thu, 15 Jun 2017 16:17:50 +0000 (13:17 -0300)]
11557: Fixed can_read link creation, updated test to check this behavior.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@curoverse.com>
Tom Clegg [Thu, 15 Jun 2017 16:11:13 +0000 (12:11 -0400)]
Merge branch '10557-auto-setup'
refs #10557
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Wed, 14 Jun 2017 20:10:07 +0000 (16:10 -0400)]
11283: Fix exec_query() usage for rails4.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Wed, 19 Apr 2017 14:44:21 +0000 (10:44 -0400)]
11283: Fix "available slot number" query.
Fixes repetitive queries and excessive Postgres and Rails log
messages:
2017-04-10 16:39:09 UTC [4734-1] arvados@arvados_test ERROR: duplicate key value violates unique constraint "index_nodes_on_slot_number"
PG::UniqueViolation: ERROR: duplicate key value violates unique constraint "index_nodes_on_slot_number"
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Wed, 14 Jun 2017 15:38:03 +0000 (11:38 -0400)]
10557: Remove redundant hook condition.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Wed, 14 Jun 2017 15:26:27 +0000 (11:26 -0400)]
Merge branch '2411-check-copyright'
refs #2411
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Thu, 1 Jun 2017 18:50:17 +0000 (14:50 -0400)]
2411: Add build/check-copyright-notices.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Wed, 14 Jun 2017 15:14:37 +0000 (11:14 -0400)]
Merge branch '11803-repo-perms'
refs #11803
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Wed, 14 Jun 2017 01:02:17 +0000 (21:02 -0400)]
10557: Always run user setup procedure when is_active becomes true.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Wed, 14 Jun 2017 01:01:41 +0000 (21:01 -0400)]
10557: Tidy up some user setup code.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Peter Amstutz [Tue, 13 Jun 2017 19:37:45 +0000 (15:37 -0400)]
test_with_arvbox.sh tags selected arvados/jobs version as latest refs #11458
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
Peter Amstutz [Tue, 13 Jun 2017 17:21:23 +0000 (13:21 -0400)]
Add --compute-checksum to test_with_arvbox.sh command line extras refs #11458
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
Tom Clegg [Tue, 13 Jun 2017 15:48:49 +0000 (11:48 -0400)]
11803: Get group permissions with 1 query instead of N queries.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Peter Amstutz [Tue, 13 Jun 2017 14:48:24 +0000 (10:48 -0400)]
Remove apt-get clean when starting frorm bare debian image. no issue #
Peter Amstutz [Tue, 13 Jun 2017 14:31:25 +0000 (10:31 -0400)]
Ensure that /var/cache/apt/archives is present so arvbox apt-get will work. no issue #
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
Peter Amstutz [Mon, 12 Jun 2017 14:02:42 +0000 (10:02 -0400)]
Remove node manager integration test wait check for quota set (event ordering), refs #10312
Peter Amstutz [Mon, 12 Jun 2017 13:35:20 +0000 (09:35 -0400)]
Fix integration test again, refs #10312
Peter Amstutz [Mon, 12 Jun 2017 13:12:30 +0000 (09:12 -0400)]
Fix integration test, refs #10312
Peter Amstutz [Sat, 10 Jun 2017 01:30:44 +0000 (21:30 -0400)]
Merge branch '11345-nodemanager-retry-after' refs #11345
Peter Amstutz [Sat, 10 Jun 2017 01:30:29 +0000 (21:30 -0400)]
Merge branch '10847-nodemanager-shutdown' refs #10847
Peter Amstutz [Sat, 10 Jun 2017 01:29:59 +0000 (21:29 -0400)]
Merge branch '10312-nodemanager-quotas' refs #10312
Peter Amstutz [Sat, 10 Jun 2017 01:24:46 +0000 (21:24 -0400)]
Merge branch '11642-null-job-log' refs #11642
Lucas Di Pentima [Fri, 9 Jun 2017 21:11:15 +0000 (18:11 -0300)]
11557: Moved logic to done.done(). Updated related tests.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@curoverse.com>
Peter Amstutz [Fri, 9 Jun 2017 20:03:09 +0000 (16:03 -0400)]
11642: Jobs where log is unreadable (but not null) are not offered for reuse
but are taken into account in check for consistent outputs.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
Peter Amstutz [Thu, 8 Jun 2017 20:56:10 +0000 (16:56 -0400)]
11345: Clamp retry-after to (0, max_retry_wait). Deindent retry_wrapper a bit for readability.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
Peter Amstutz [Fri, 9 Jun 2017 18:25:59 +0000 (14:25 -0400)]
11642: Don't reuse completed jobs where output or log is null or not readable by current user.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
Peter Amstutz [Fri, 9 Jun 2017 17:27:51 +0000 (13:27 -0400)]
11642: Increase arv-put retries. Job considered failure if unable to save job log.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
radhika [Fri, 9 Jun 2017 18:12:01 +0000 (14:12 -0400)]
closes #11821
Merge branch '11821-discovery-doc-updates'
radhika [Fri, 9 Jun 2017 15:56:45 +0000 (11:56 -0400)]
11821: add include_trash for collections.index and recursive for groups.contents to discovery doc
Peter Amstutz [Thu, 8 Jun 2017 17:13:58 +0000 (13:13 -0400)]
11345: Fix race-prone test test_issue_slurm_drain_retry
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
Peter Amstutz [Tue, 6 Jun 2017 20:22:02 +0000 (16:22 -0400)]
11345: Fix unit tests after refactoring error types.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
Peter Amstutz [Tue, 6 Jun 2017 18:05:44 +0000 (14:05 -0400)]
11345: Simplify and consolodate retry for API throttling errors.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
radhika [Thu, 8 Jun 2017 19:34:25 +0000 (15:34 -0400)]
closes #11837
Merge branch '11837-trash-access'
Tom Clegg [Thu, 8 Jun 2017 18:21:21 +0000 (14:21 -0400)]
11837: Fix "include_trash" scope and test case.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
radhika [Thu, 8 Jun 2017 17:15:52 +0000 (13:15 -0400)]
11837: write tests
Peter Amstutz [Thu, 8 Jun 2017 15:55:08 +0000 (11:55 -0400)]
10847: Don't log everything from node manager unless test fails.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
radhika [Wed, 7 Jun 2017 21:18:15 +0000 (17:18 -0400)]
refs #9587
Merge branch '9587-trash-page'
radhika [Wed, 7 Jun 2017 21:16:34 +0000 (17:16 -0400)]
9587: Show "delete_at" timestamp instead of "created_at" timestamp in trash page
Peter Amstutz [Wed, 31 May 2017 19:37:15 +0000 (15:37 -0400)]
10847: Daemon shutdown now stops most actors, only waits for setup actors.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
Tom Clegg [Wed, 7 Jun 2017 15:39:22 +0000 (11:39 -0400)]
Merge branch '11809-keep-web-cache'
closes #11809
Tom Clegg [Wed, 7 Jun 2017 15:28:22 +0000 (11:28 -0400)]
11809: Add tests for /status.json.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Peter Amstutz [Wed, 7 Jun 2017 14:57:25 +0000 (10:57 -0400)]
10312: Add example jobs_queue and slurm_queue options to example node manager configurations.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
Peter Amstutz [Wed, 7 Jun 2017 14:53:43 +0000 (10:53 -0400)]
10312: Add some comments to node manager integration test.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
Tom Clegg [Wed, 7 Jun 2017 14:51:15 +0000 (10:51 -0400)]
11809: Merge branch 'master' into 11809-keep-web-cache
Tom Clegg [Wed, 7 Jun 2017 14:47:37 +0000 (10:47 -0400)]
11809: Skip lookups in forceReload case. Add forceReload tests.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Wed, 7 Jun 2017 14:32:09 +0000 (10:32 -0400)]
11809: Increase default cache sizes.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
radhika [Wed, 7 Jun 2017 14:30:22 +0000 (10:30 -0400)]
closes #11652
Merge branch '11652-recursive-contents-wb'
radhika [Wed, 7 Jun 2017 14:29:30 +0000 (10:29 -0400)]
11652: fix comment on test
Tom Clegg [Wed, 7 Jun 2017 14:27:59 +0000 (10:27 -0400)]
11809: Prune collection cache asynchronously.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Wed, 7 Jun 2017 14:27:06 +0000 (10:27 -0400)]
11809: Rename FooEntries -> MaxFooEntries in cache config.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Wed, 7 Jun 2017 14:23:41 +0000 (10:23 -0400)]
11809: Add /status.json handler.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Lucas Di Pentima [Wed, 7 Jun 2017 13:45:53 +0000 (10:45 -0300)]
11557: Merge branch 'master' into 11557-acr-output-col-perms
radhika [Tue, 6 Jun 2017 19:49:34 +0000 (15:49 -0400)]
Merge branch 'master' into 11652-recursive-contents-wb
Tom Clegg [Tue, 6 Jun 2017 19:22:57 +0000 (15:22 -0400)]
Merge branch '11652-recursive-contents'
refs #11652
Tom Clegg [Tue, 6 Jun 2017 19:21:28 +0000 (15:21 -0400)]
11809: More cache tests.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Tue, 6 Jun 2017 19:12:53 +0000 (15:12 -0400)]
11809: Add unit test for cache.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Tue, 6 Jun 2017 17:53:36 +0000 (13:53 -0400)]
11652: Merge branch 'master' into 11652-recursive-contents
Tom Clegg [Tue, 6 Jun 2017 17:53:25 +0000 (13:53 -0400)]
11652: Add tests for non-recursive and home-project cases.
radhika [Tue, 6 Jun 2017 17:06:19 +0000 (13:06 -0400)]
11652: use "recursive=true" in workbench search requests
Tom Clegg [Tue, 6 Jun 2017 15:57:34 +0000 (11:57 -0400)]
11809: Cache permission and collection lookups.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
radhika [Tue, 6 Jun 2017 15:17:29 +0000 (11:17 -0400)]
Merge branch 'master' into 11652-recursive-contents
radhika [Tue, 6 Jun 2017 15:07:36 +0000 (11:07 -0400)]
closes #9587
Merge branch '9587-trash-page'
radhika [Tue, 6 Jun 2017 15:01:06 +0000 (11:01 -0400)]
9587: rename pane name to "Recent trash"
Peter Amstutz [Tue, 6 Jun 2017 13:31:46 +0000 (09:31 -0400)]
10312: Add services/nodemanager-integration to test list
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
radhika [Tue, 6 Jun 2017 00:40:46 +0000 (20:40 -0400)]
9587: sort the trash page rows by trash_at timestamp
radhika [Tue, 6 Jun 2017 00:29:18 +0000 (20:29 -0400)]
Merge branch 'master' into 9587-trash-page
radhika [Mon, 5 Jun 2017 22:58:03 +0000 (18:58 -0400)]
closes #9587
Merge branch '9587-trash-page'
radhika [Fri, 2 Jun 2017 21:31:04 +0000 (17:31 -0400)]
9587: sort order issue
radhika [Wed, 31 May 2017 19:03:53 +0000 (15:03 -0400)]
9587: expose untrash api
radhika [Tue, 30 May 2017 22:35:06 +0000 (18:35 -0400)]
9587: trash page
Peter Amstutz [Mon, 5 Jun 2017 20:40:30 +0000 (16:40 -0400)]
10312: Fix unit tests.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
Peter Amstutz [Fri, 2 Jun 2017 21:35:15 +0000 (17:35 -0400)]
10312: Tests pass for booting single node, multiple nodes, hitting quota, quota
probe. Add node manager integration to run-tests.sh.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
radhika [Mon, 5 Jun 2017 17:00:02 +0000 (13:00 -0400)]
closes #4921
Merge branch '4921-clear-modal-preview-pane'
Tom Clegg [Mon, 5 Jun 2017 14:06:26 +0000 (10:06 -0400)]
Merge branch '9005-share-discovery'
closes #9005
Lucas Di Pentima [Mon, 5 Jun 2017 13:43:07 +0000 (10:43 -0300)]
11557: Don't assume log, output and components are always present on a job record.
This was causing some tests to fail.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@curoverse.com>
Lucas Di Pentima [Mon, 5 Jun 2017 12:54:29 +0000 (09:54 -0300)]
11557: Create can_read link on reused jobs
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@curoverse.com>
Lucas Di Pentima [Mon, 5 Jun 2017 12:20:20 +0000 (09:20 -0300)]
11557: Added log collection copying to local project when reusing jobs
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@curoverse.com>
radhika [Sat, 3 Jun 2017 15:08:39 +0000 (11:08 -0400)]
4921: also clear preview pane when a project is selected from projects dropdown menu
radhika [Fri, 2 Jun 2017 21:45:06 +0000 (17:45 -0400)]
9587: show trash page contents in Recent tab pane
radhika [Fri, 2 Jun 2017 21:31:04 +0000 (17:31 -0400)]
9587: sort order issue
Tom Clegg [Fri, 2 Jun 2017 19:43:28 +0000 (15:43 -0400)]
9005: Serve keep_services/accessible regardless of auth status.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Fri, 2 Jun 2017 18:58:28 +0000 (14:58 -0400)]
11652: Update API docs.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Fri, 2 Jun 2017 18:53:20 +0000 (14:53 -0400)]
11652: Add "recursive" flag to groups#contents controller.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
radhika [Fri, 2 Jun 2017 17:55:06 +0000 (13:55 -0400)]
closes #4921
Merge branch '4921-clear-modal-preview-pane'
Peter Amstutz [Fri, 2 Jun 2017 15:58:55 +0000 (11:58 -0400)]
10312: Integration test framework for node manager, runs full node manager with
fake cloud driver and monitors logging output.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
Lucas Di Pentima [Fri, 2 Jun 2017 02:15:37 +0000 (23:15 -0300)]
11557: Copy reused job's output to a collection on specified project (or Home project by default)
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@curoverse.com>
Tom Clegg [Thu, 1 Jun 2017 21:37:37 +0000 (17:37 -0400)]
9005: Replace matchTrue regexp with StringBool func.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Peter Amstutz [Thu, 1 Jun 2017 21:37:09 +0000 (17:37 -0400)]
10312: Adding ability to substitute fake libcloud driver but run full node manager for integration testing.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
radhika [Thu, 1 Jun 2017 20:09:24 +0000 (16:09 -0400)]
4921: clear preview pane when the selectable container is cleared
Tom Clegg [Thu, 1 Jun 2017 19:31:26 +0000 (15:31 -0400)]
9005: Restore "refresh services on SIGHUP" to keepproxy.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Tom Clegg [Thu, 1 Jun 2017 19:26:42 +0000 (15:26 -0400)]
9005: Rename ClearCache to RefreshServiceDiscovery
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curoverse.com>
Peter Amstutz [Thu, 1 Jun 2017 14:07:49 +0000 (10:07 -0400)]
10312: Identify error message that look like we are hitting a quota or account limit. Set soft node quota in order to stop trying to boot new nodes until the total node count goes down. Probe node quota upward when at the soft limit and able to boot nodes successfully.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curoverse.com>
radhika [Thu, 1 Jun 2017 18:05:46 +0000 (14:05 -0400)]
9587: include "owner" in trash rows; update trash icon.