arvados.git
6 years ago14360: Move single-worker Pool methods to worker type.
Tom Clegg [Wed, 7 Nov 2018 19:10:01 +0000 (14:10 -0500)]
14360: Move single-worker Pool methods to worker type.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Note race in docs, fix flaky test.
Tom Clegg [Tue, 6 Nov 2018 22:01:06 +0000 (17:01 -0500)]
14360: Note race in docs, fix flaky test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Add "idle" state.
Tom Clegg [Tue, 6 Nov 2018 21:17:58 +0000 (16:17 -0500)]
14360: Add "idle" state.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Fix concurrent map access in tests.
Tom Clegg [Tue, 30 Oct 2018 20:37:31 +0000 (16:37 -0400)]
14360: Fix concurrent map access in tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Move slurm-only code to crunch-dispatch-slurm.
Tom Clegg [Tue, 30 Oct 2018 20:35:34 +0000 (16:35 -0400)]
14360: Move slurm-only code to crunch-dispatch-slurm.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Fail Create calls fast during quota quarantine.
Tom Clegg [Tue, 30 Oct 2018 20:12:11 +0000 (16:12 -0400)]
14360: Fail Create calls fast during quota quarantine.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Remove redundant wp.unallocated field.
Tom Clegg [Tue, 30 Oct 2018 20:08:47 +0000 (16:08 -0400)]
14360: Remove redundant wp.unallocated field.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Remove redundant wkr.booted flag.
Tom Clegg [Tue, 30 Oct 2018 19:35:07 +0000 (15:35 -0400)]
14360: Remove redundant wkr.booted flag.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Ensure signals don't pass to child in startup race.
Tom Clegg [Tue, 30 Oct 2018 18:32:24 +0000 (14:32 -0400)]
14360: Ensure signals don't pass to child in startup race.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Fix mismatched flag name, -nodetach -> -detached.
Tom Clegg [Tue, 30 Oct 2018 18:18:35 +0000 (14:18 -0400)]
14360: Fix mismatched flag name, -nodetach -> -detached.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Encapsulate scheduler object.
Tom Clegg [Tue, 30 Oct 2018 17:50:30 +0000 (13:50 -0400)]
14360: Encapsulate scheduler object.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Cancel containers asynchronously in Sync cleanup.
Tom Clegg [Mon, 29 Oct 2018 17:13:37 +0000 (13:13 -0400)]
14360: Cancel containers asynchronously in Sync cleanup.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Log level debug->warning for unexpected condition.
Tom Clegg [Mon, 29 Oct 2018 17:12:48 +0000 (13:12 -0400)]
14360: Log level debug->warning for unexpected condition.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Improve comments.
Tom Clegg [Mon, 29 Oct 2018 15:28:42 +0000 (11:28 -0400)]
14360: Improve comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Add missing mutex lock.
Tom Clegg [Mon, 29 Oct 2018 15:17:05 +0000 (11:17 -0400)]
14360: Add missing mutex lock.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Rename View to InstanceView.
Tom Clegg [Mon, 29 Oct 2018 15:08:45 +0000 (11:08 -0400)]
14360: Rename View to InstanceView.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Rename keeplocal -> dontupdate, add explanation.
Tom Clegg [Sat, 27 Oct 2018 05:58:29 +0000 (01:58 -0400)]
14360: Rename keeplocal -> dontupdate, add explanation.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Update busy/lastUUID/running together. Clarify race comment.
Tom Clegg [Sat, 27 Oct 2018 05:41:11 +0000 (01:41 -0400)]
14360: Update busy/lastUUID/running together. Clarify race comment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Move monitoring API test from lame driver to stub driver.
Tom Clegg [Sat, 27 Oct 2018 05:19:05 +0000 (01:19 -0400)]
14360: Move monitoring API test from lame driver to stub driver.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Move shutdown-if-broken check to its own func.
Tom Clegg [Sat, 27 Oct 2018 05:18:36 +0000 (01:18 -0400)]
14360: Move shutdown-if-broken check to its own func.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Just notify once per sync.
Tom Clegg [Sat, 27 Oct 2018 05:17:39 +0000 (01:17 -0400)]
14360: Just notify once per sync.

Sync holds the mutex so none of the notifications are delivered until
sync is done anyway.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Cut excess time.Now() calls.
Tom Clegg [Sat, 27 Oct 2018 04:31:43 +0000 (00:31 -0400)]
14360: Cut excess time.Now() calls.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Split up long run func.
Tom Clegg [Sat, 27 Oct 2018 04:30:16 +0000 (00:30 -0400)]
14360: Split up long run func.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Use consts for tag keys.
Tom Clegg [Sat, 27 Oct 2018 04:29:26 +0000 (00:29 -0400)]
14360: Use consts for tag keys.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Close SSH connections when no longer needed.
Tom Clegg [Sat, 27 Oct 2018 04:28:17 +0000 (00:28 -0400)]
14360: Close SSH connections when no longer needed.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Clarify sync loop timing.
Tom Clegg [Sat, 27 Oct 2018 00:27:20 +0000 (20:27 -0400)]
14360: Clarify sync loop timing.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Update readme.
Tom Clegg [Sat, 27 Oct 2018 00:18:27 +0000 (20:18 -0400)]
14360: Update readme.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Add explicit Start method to dispatcher.
Tom Clegg [Sat, 27 Oct 2018 00:09:09 +0000 (20:09 -0400)]
14360: Add explicit Start method to dispatcher.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Fix tests.
Tom Clegg [Fri, 26 Oct 2018 06:05:45 +0000 (02:05 -0400)]
14360: Fix tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Initial version of dispatch-cloud.
Tom Clegg [Thu, 25 Oct 2018 05:34:35 +0000 (01:34 -0400)]
14360: Initial version of dispatch-cloud.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMake geckodriver sanity check non-fatal.
Tom Clegg [Fri, 26 Oct 2018 00:54:00 +0000 (20:54 -0400)]
Make geckodriver sanity check non-fatal.

Allows non-workbench test runs to pass without geckodriver.

refs #14407

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoFix crash in test cleanup.
Tom Clegg [Fri, 26 Oct 2018 00:49:48 +0000 (20:49 -0400)]
Fix crash in test cleanup.

refs #14407

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14398-error-deadlock'
Tom Clegg [Thu, 25 Oct 2018 21:46:54 +0000 (17:46 -0400)]
Merge branch '14398-error-deadlock'

fixes #14398

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14407-selenium'
Tom Clegg [Thu, 25 Oct 2018 21:12:36 +0000 (17:12 -0400)]
Merge branch '14407-selenium'

refs #14407

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14388-overreplication'
Tom Clegg [Thu, 25 Oct 2018 20:00:09 +0000 (16:00 -0400)]
Merge branch '14388-overreplication'

fixes #14388

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14407: Add geckodriver to arvbox image.
Tom Clegg [Thu, 25 Oct 2018 19:56:43 +0000 (15:56 -0400)]
14407: Add geckodriver to arvbox image.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14407: Fix "too much recursion" error.
Tom Clegg [Thu, 25 Oct 2018 19:52:21 +0000 (15:52 -0400)]
14407: Fix "too much recursion" error.

The recursion error comes from evaluate_script() trying to serialize
the magical jQuery response. We don't need to see that response so
we can use execute_script() instead.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14407: Upgrade selenium-webdriver, add geckodriver.
Tom Clegg [Thu, 25 Oct 2018 19:24:28 +0000 (15:24 -0400)]
14407: Upgrade selenium-webdriver, add geckodriver.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14398: Fix deadlock on error in GetCurrentState.
Tom Clegg [Wed, 24 Oct 2018 19:59:31 +0000 (15:59 -0400)]
14398: Fix deadlock on error in GetCurrentState.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14388: Merge branch 'master' into 14388-overreplication
Tom Clegg [Wed, 24 Oct 2018 17:03:20 +0000 (13:03 -0400)]
14388: Merge branch 'master' into 14388-overreplication

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14299-keep-balance-past-versions'
Lucas Di Pentima [Wed, 24 Oct 2018 16:16:34 +0000 (13:16 -0300)]
Merge branch '14299-keep-balance-past-versions'
Closes #14299

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14299: Use include_old_versions in keep-balance to avoid losing blocks.
Lucas Di Pentima [Tue, 23 Oct 2018 22:19:07 +0000 (19:19 -0300)]
14299: Use include_old_versions in keep-balance to avoid losing blocks.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14388: Don't prefer positions that are only temporarily untrashable.
Tom Clegg [Tue, 23 Oct 2018 18:30:42 +0000 (14:30 -0400)]
14388: Don't prefer positions that are only temporarily untrashable.

If old copies exist in the preferred positions, and a new copy is
written to a worse position, keep the old copies and wait for the new
copy to become eligible for trash.

Previously, an old copy would be deleted. This would bring replication
down to the desired level in the short term, but would also cause
extra pulling/copying in the future to restore the optimal copy, and
introduce extra probes for all clients in the meantime.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14388: Fix typo.
Tom Clegg [Tue, 23 Oct 2018 18:28:39 +0000 (14:28 -0400)]
14388: Fix typo.

Condition (si.want != si.want) should have been (si.want != sj.want).

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14388: Fix log message.
Tom Clegg [Tue, 23 Oct 2018 18:25:37 +0000 (14:25 -0400)]
14388: Fix log message.

When a volume with replication=2 has 15 objects, report them as "15
entries / 2x / 30 replicas", rather than "15 replicas", so the numbers
agree with the other logs/stats about replica counts.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13561-collection-versions-doc'
Lucas Di Pentima [Tue, 23 Oct 2018 13:56:18 +0000 (10:56 -0300)]
Merge branch '13561-collection-versions-doc'
Closes #13561

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Rephrased some sentences to avoid confusion.
Lucas Di Pentima [Tue, 23 Oct 2018 13:55:12 +0000 (10:55 -0300)]
13561: Rephrased some sentences to avoid confusion.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '13561-trashed-collection-versions-fix'
Lucas Di Pentima [Mon, 22 Oct 2018 16:29:27 +0000 (13:29 -0300)]
Merge branch '13561-trashed-collection-versions-fix'
Refs #13561

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Formatting fixes, examples enhancements & additions.
Lucas Di Pentima [Mon, 22 Oct 2018 15:21:55 +0000 (12:21 -0300)]
13561: Formatting fixes, examples enhancements & additions.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14260-expired-token-delete' refs #14260
Peter Amstutz [Fri, 19 Oct 2018 14:11:33 +0000 (10:11 -0400)]
Merge branch '14260-expired-token-delete' refs #14260

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Use straight SQL DELETE instead of destroy_all
Peter Amstutz [Fri, 19 Oct 2018 14:06:50 +0000 (10:06 -0400)]
14260: Use straight SQL DELETE instead of destroy_all

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13561: Code cleanup.
Lucas Di Pentima [Thu, 18 Oct 2018 23:20:19 +0000 (20:20 -0300)]
13561: Code cleanup.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Exclude past versions regardless of user & include_trash setting.
Lucas Di Pentima [Thu, 18 Oct 2018 22:46:18 +0000 (19:46 -0300)]
13561: Exclude past versions regardless of user & include_trash setting.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14260-runtime-token' refs #14260
Peter Amstutz [Thu, 18 Oct 2018 17:44:35 +0000 (13:44 -0400)]
Merge branch '14260-runtime-token' refs #14260

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14366-crunch2-upgrade' refs #14366
Peter Amstutz [Thu, 18 Oct 2018 17:42:13 +0000 (13:42 -0400)]
Merge branch '14366-crunch2-upgrade' refs #14366

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Remove redundant schema_migrations in structure.sql
Peter Amstutz [Thu, 18 Oct 2018 17:18:19 +0000 (13:18 -0400)]
14260: Remove redundant schema_migrations in structure.sql

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Sort runtime_auth_scopes
Peter Amstutz [Thu, 18 Oct 2018 16:20:50 +0000 (12:20 -0400)]
14260: Sort runtime_auth_scopes

Container.for_current_token returns nil or a Container (not an active
record query).

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch 'master' into 14260-runtime-token
Peter Amstutz [Thu, 18 Oct 2018 15:58:57 +0000 (11:58 -0400)]
Merge branch 'master' into 14260-runtime-token

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13561: Re-phrase user guide & add admin guide section.
Lucas Di Pentima [Wed, 10 Oct 2018 20:12:27 +0000 (17:12 -0300)]
13561: Re-phrase user guide & add admin guide section.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Update documentation on collection versioning.
Lucas Di Pentima [Fri, 5 Oct 2018 18:55:41 +0000 (15:55 -0300)]
13561: Update documentation on collection versioning.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '13561-collection-versions-fixes'
Lucas Di Pentima [Wed, 17 Oct 2018 20:12:48 +0000 (17:12 -0300)]
Merge branch '13561-collection-versions-fixes'
Refs #13561

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14366: Add "upgrade to containers api" to "upgrading" section
Peter Amstutz [Wed, 17 Oct 2018 19:54:00 +0000 (15:54 -0400)]
14366: Add "upgrade to containers api" to "upgrading" section

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14366: Improve wording of "upgrading to containers API" section
Peter Amstutz [Wed, 17 Oct 2018 19:43:15 +0000 (15:43 -0400)]
14366: Improve wording of "upgrading to containers API" section

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13561: Raise exception instead of ignoring versioning attributes updates.
Lucas Di Pentima [Wed, 17 Oct 2018 18:51:36 +0000 (15:51 -0300)]
13561: Raise exception instead of ignoring versioning attributes updates.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Fixes api to get a collection with its past versions.
Lucas Di Pentima [Wed, 17 Oct 2018 18:05:50 +0000 (15:05 -0300)]
13561: Fixes api to get a collection with its past versions.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoFor the package test docker images, sanitize how we get the rvm GPG key,
Ward Vandewege [Wed, 17 Oct 2018 01:38:54 +0000 (21:38 -0400)]
For the package test docker images, sanitize how we get the rvm GPG key,
and remove a dependency on the GPG keyservers which are flakey.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoAdd a systemd service file to arvados-node-manager.
Ward Vandewege [Tue, 16 Oct 2018 20:49:15 +0000 (16:49 -0400)]
Add a systemd service file to arvados-node-manager.

Reset package iteration number for arvados-node-manager to version 1.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoRemove spurious output from run-build-packages.sh
Ward Vandewege [Tue, 16 Oct 2018 20:38:01 +0000 (16:38 -0400)]
Remove spurious output from run-build-packages.sh

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14344: bump package version for arvados-docker-cleaner so that we get a new
Ward Vandewege [Tue, 16 Oct 2018 20:37:00 +0000 (16:37 -0400)]
14344: bump package version for arvados-docker-cleaner so that we get a new
package built with the systemd service file.

refs #14344

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14344: Merge branch '14344-fix-rpm-vs-deb-detection'
Ward Vandewege [Tue, 16 Oct 2018 19:48:44 +0000 (15:48 -0400)]
14344: Merge branch '14344-fix-rpm-vs-deb-detection'

closes #14344

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14344: Move "set -e" back to top.
Tom Clegg [Tue, 16 Oct 2018 13:35:17 +0000 (09:35 -0400)]
14344: Move "set -e" back to top.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoFix the detection of rpm vs deb systems.
Ward Vandewege [Tue, 16 Oct 2018 01:49:30 +0000 (21:49 -0400)]
Fix the detection of rpm vs deb systems.

refs #14344

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoMerge branch '14285-keep-balance-metrics'
Tom Clegg [Tue, 16 Oct 2018 17:24:04 +0000 (13:24 -0400)]
Merge branch '14285-keep-balance-metrics'

closes #14285

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14285: Update admin/metrics docs.
Tom Clegg [Mon, 15 Oct 2018 21:36:03 +0000 (17:36 -0400)]
14285: Update admin/metrics docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14285: Add deduplication ratio to keep-balance metrics.
Tom Clegg [Mon, 15 Oct 2018 21:02:22 +0000 (17:02 -0400)]
14285: Add deduplication ratio to keep-balance metrics.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoFix missing namespace in metric names.
Tom Clegg [Tue, 16 Oct 2018 15:41:54 +0000 (11:41 -0400)]
Fix missing namespace in metric names.

refs #14285

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoRevert change to setup.py for arvados-docker-cleaner, pip doesn't agree with
Ward Vandewege [Mon, 15 Oct 2018 23:06:17 +0000 (19:06 -0400)]
Revert change to setup.py for arvados-docker-cleaner, pip doesn't agree with
it...

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14260: secret_mounts works with runtime_token (really this time)
Peter Amstutz [Mon, 15 Oct 2018 21:11:11 +0000 (17:11 -0400)]
14260: secret_mounts works with runtime_token (really this time)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14338-workbench-flag-to-disable-repositories'
Ward Vandewege [Mon, 15 Oct 2018 21:06:04 +0000 (17:06 -0400)]
Merge branch '14338-workbench-flag-to-disable-repositories'

closes #14338

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoAdd a flag to hide repositories entries in the Workbench menus. This is useful
Ward Vandewege [Fri, 12 Oct 2018 15:15:44 +0000 (11:15 -0400)]
Add a flag to hide repositories entries in the Workbench menus. This is useful
in a scenario where the jobs api is disabled and there are no local git
repositories. Local git repositories are optional when using the containers api.

refs #14338

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14260: secret_mounts works with runtime_token
Peter Amstutz [Mon, 15 Oct 2018 20:53:40 +0000 (16:53 -0400)]
14260: secret_mounts works with runtime_token

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: add runtime_user_uuid and runtime_auth_scopes to API response
Peter Amstutz [Mon, 15 Oct 2018 20:47:38 +0000 (16:47 -0400)]
14260: add runtime_user_uuid and runtime_auth_scopes to API response

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMake sure that the arvados-docker-cleaner systemd service file is installed in
Ward Vandewege [Mon, 15 Oct 2018 20:36:07 +0000 (16:36 -0400)]
Make sure that the arvados-docker-cleaner systemd service file is installed in
the correct directory.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14260: Bugfix for runtime_token/secret_mounts and retries
Peter Amstutz [Mon, 15 Oct 2018 20:20:39 +0000 (16:20 -0400)]
14260: Bugfix for runtime_token/secret_mounts and retries

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14285-keep-balance-metrics'
Tom Clegg [Mon, 15 Oct 2018 20:09:36 +0000 (16:09 -0400)]
Merge branch '14285-keep-balance-metrics'

refs #14285

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14285: Merge branch 'master' into 14285-keep-balance-metrics
Tom Clegg [Mon, 15 Oct 2018 20:08:22 +0000 (16:08 -0400)]
14285: Merge branch 'master' into 14285-keep-balance-metrics

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoWebshell requires the short hostname for the shell server object.
Ward Vandewege [Mon, 15 Oct 2018 19:39:14 +0000 (15:39 -0400)]
Webshell requires the short hostname for the shell server object.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoThe `arv group create` command doesn't set group_class by default, and we need
Ward Vandewege [Fri, 12 Oct 2018 20:01:44 +0000 (16:01 -0400)]
The `arv group create` command doesn't set group_class by default, and we need
that field set to 'project' for the 'Arvados Standard Docker Images' project.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoSmall documentation fixes.
Ward Vandewege [Fri, 12 Oct 2018 19:53:37 +0000 (15:53 -0400)]
Small documentation fixes.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoMerge branch '14086-keepweb-serve-past-versions'
Lucas Di Pentima [Mon, 15 Oct 2018 18:10:20 +0000 (15:10 -0300)]
Merge branch '14086-keepweb-serve-past-versions'
Closes #14086

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14285: Add tests for LoadToken and RequireLiteralToken.
Tom Clegg [Mon, 15 Oct 2018 17:50:10 +0000 (13:50 -0400)]
14285: Add tests for LoadToken and RequireLiteralToken.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14260: Fix workbench functionals test
Peter Amstutz [Mon, 15 Oct 2018 17:36:02 +0000 (13:36 -0400)]
14260: Fix workbench functionals test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14086: Add tests to prove that keep-web can serve past collection versions.
Lucas Di Pentima [Mon, 15 Oct 2018 17:02:29 +0000 (14:02 -0300)]
14086: Add tests to prove that keep-web can serve past collection versions.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14260: Fix tests.
Peter Amstutz [Mon, 15 Oct 2018 16:09:35 +0000 (12:09 -0400)]
14260: Fix tests.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14285: Merge branch 'master' into 14285-keep-balance-metrics
Tom Clegg [Mon, 15 Oct 2018 15:23:18 +0000 (11:23 -0400)]
14285: Merge branch 'master' into 14285-keep-balance-metrics

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14260: Add invalid remote token test
Peter Amstutz [Mon, 15 Oct 2018 15:09:58 +0000 (11:09 -0400)]
14260: Add invalid remote token test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Additional validation when container uuid is provided in token
Peter Amstutz [Mon, 15 Oct 2018 15:02:38 +0000 (11:02 -0400)]
14260: Additional validation when container uuid is provided in token

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Update API doc for runtime_* fields (token/user_uuid/auth_scopes)
Peter Amstutz [Fri, 12 Oct 2018 21:34:47 +0000 (17:34 -0400)]
14260: Update API doc for runtime_* fields (token/user_uuid/auth_scopes)

Also add missing documentation for secret_mounts.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: crunch-run constructs a v2 token with added container uuid
Peter Amstutz [Fri, 12 Oct 2018 21:07:33 +0000 (17:07 -0400)]
14260: crunch-run constructs a v2 token with added container uuid

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Container auth tokens must have the container uuid in the 4th position
Peter Amstutz [Fri, 12 Oct 2018 21:01:23 +0000 (17:01 -0400)]
14260: Container auth tokens must have the container uuid in the 4th position

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>