arvados.git
6 years ago14360: Move monitoring API test from lame driver to stub driver.
Tom Clegg [Sat, 27 Oct 2018 05:19:05 +0000 (01:19 -0400)]
14360: Move monitoring API test from lame driver to stub driver.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Move shutdown-if-broken check to its own func.
Tom Clegg [Sat, 27 Oct 2018 05:18:36 +0000 (01:18 -0400)]
14360: Move shutdown-if-broken check to its own func.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Just notify once per sync.
Tom Clegg [Sat, 27 Oct 2018 05:17:39 +0000 (01:17 -0400)]
14360: Just notify once per sync.

Sync holds the mutex so none of the notifications are delivered until
sync is done anyway.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Cut excess time.Now() calls.
Tom Clegg [Sat, 27 Oct 2018 04:31:43 +0000 (00:31 -0400)]
14360: Cut excess time.Now() calls.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Split up long run func.
Tom Clegg [Sat, 27 Oct 2018 04:30:16 +0000 (00:30 -0400)]
14360: Split up long run func.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Use consts for tag keys.
Tom Clegg [Sat, 27 Oct 2018 04:29:26 +0000 (00:29 -0400)]
14360: Use consts for tag keys.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Close SSH connections when no longer needed.
Tom Clegg [Sat, 27 Oct 2018 04:28:17 +0000 (00:28 -0400)]
14360: Close SSH connections when no longer needed.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Clarify sync loop timing.
Tom Clegg [Sat, 27 Oct 2018 00:27:20 +0000 (20:27 -0400)]
14360: Clarify sync loop timing.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Update readme.
Tom Clegg [Sat, 27 Oct 2018 00:18:27 +0000 (20:18 -0400)]
14360: Update readme.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Add explicit Start method to dispatcher.
Tom Clegg [Sat, 27 Oct 2018 00:09:09 +0000 (20:09 -0400)]
14360: Add explicit Start method to dispatcher.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Fix tests.
Tom Clegg [Fri, 26 Oct 2018 06:05:45 +0000 (02:05 -0400)]
14360: Fix tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14360: Initial version of dispatch-cloud.
Tom Clegg [Thu, 25 Oct 2018 05:34:35 +0000 (01:34 -0400)]
14360: Initial version of dispatch-cloud.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMake geckodriver sanity check non-fatal.
Tom Clegg [Fri, 26 Oct 2018 00:54:00 +0000 (20:54 -0400)]
Make geckodriver sanity check non-fatal.

Allows non-workbench test runs to pass without geckodriver.

refs #14407

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoFix crash in test cleanup.
Tom Clegg [Fri, 26 Oct 2018 00:49:48 +0000 (20:49 -0400)]
Fix crash in test cleanup.

refs #14407

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14398-error-deadlock'
Tom Clegg [Thu, 25 Oct 2018 21:46:54 +0000 (17:46 -0400)]
Merge branch '14398-error-deadlock'

fixes #14398

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14407-selenium'
Tom Clegg [Thu, 25 Oct 2018 21:12:36 +0000 (17:12 -0400)]
Merge branch '14407-selenium'

refs #14407

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14388-overreplication'
Tom Clegg [Thu, 25 Oct 2018 20:00:09 +0000 (16:00 -0400)]
Merge branch '14388-overreplication'

fixes #14388

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14407: Add geckodriver to arvbox image.
Tom Clegg [Thu, 25 Oct 2018 19:56:43 +0000 (15:56 -0400)]
14407: Add geckodriver to arvbox image.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14407: Fix "too much recursion" error.
Tom Clegg [Thu, 25 Oct 2018 19:52:21 +0000 (15:52 -0400)]
14407: Fix "too much recursion" error.

The recursion error comes from evaluate_script() trying to serialize
the magical jQuery response. We don't need to see that response so
we can use execute_script() instead.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14407: Upgrade selenium-webdriver, add geckodriver.
Tom Clegg [Thu, 25 Oct 2018 19:24:28 +0000 (15:24 -0400)]
14407: Upgrade selenium-webdriver, add geckodriver.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14398: Fix deadlock on error in GetCurrentState.
Tom Clegg [Wed, 24 Oct 2018 19:59:31 +0000 (15:59 -0400)]
14398: Fix deadlock on error in GetCurrentState.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14388: Merge branch 'master' into 14388-overreplication
Tom Clegg [Wed, 24 Oct 2018 17:03:20 +0000 (13:03 -0400)]
14388: Merge branch 'master' into 14388-overreplication

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '14299-keep-balance-past-versions'
Lucas Di Pentima [Wed, 24 Oct 2018 16:16:34 +0000 (13:16 -0300)]
Merge branch '14299-keep-balance-past-versions'
Closes #14299

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14299: Use include_old_versions in keep-balance to avoid losing blocks.
Lucas Di Pentima [Tue, 23 Oct 2018 22:19:07 +0000 (19:19 -0300)]
14299: Use include_old_versions in keep-balance to avoid losing blocks.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14388: Don't prefer positions that are only temporarily untrashable.
Tom Clegg [Tue, 23 Oct 2018 18:30:42 +0000 (14:30 -0400)]
14388: Don't prefer positions that are only temporarily untrashable.

If old copies exist in the preferred positions, and a new copy is
written to a worse position, keep the old copies and wait for the new
copy to become eligible for trash.

Previously, an old copy would be deleted. This would bring replication
down to the desired level in the short term, but would also cause
extra pulling/copying in the future to restore the optimal copy, and
introduce extra probes for all clients in the meantime.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14388: Fix typo.
Tom Clegg [Tue, 23 Oct 2018 18:28:39 +0000 (14:28 -0400)]
14388: Fix typo.

Condition (si.want != si.want) should have been (si.want != sj.want).

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14388: Fix log message.
Tom Clegg [Tue, 23 Oct 2018 18:25:37 +0000 (14:25 -0400)]
14388: Fix log message.

When a volume with replication=2 has 15 objects, report them as "15
entries / 2x / 30 replicas", rather than "15 replicas", so the numbers
agree with the other logs/stats about replica counts.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoMerge branch '13561-collection-versions-doc'
Lucas Di Pentima [Tue, 23 Oct 2018 13:56:18 +0000 (10:56 -0300)]
Merge branch '13561-collection-versions-doc'
Closes #13561

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Rephrased some sentences to avoid confusion.
Lucas Di Pentima [Tue, 23 Oct 2018 13:55:12 +0000 (10:55 -0300)]
13561: Rephrased some sentences to avoid confusion.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '13561-trashed-collection-versions-fix'
Lucas Di Pentima [Mon, 22 Oct 2018 16:29:27 +0000 (13:29 -0300)]
Merge branch '13561-trashed-collection-versions-fix'
Refs #13561

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Formatting fixes, examples enhancements & additions.
Lucas Di Pentima [Mon, 22 Oct 2018 15:21:55 +0000 (12:21 -0300)]
13561: Formatting fixes, examples enhancements & additions.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14260-expired-token-delete' refs #14260
Peter Amstutz [Fri, 19 Oct 2018 14:11:33 +0000 (10:11 -0400)]
Merge branch '14260-expired-token-delete' refs #14260

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Use straight SQL DELETE instead of destroy_all
Peter Amstutz [Fri, 19 Oct 2018 14:06:50 +0000 (10:06 -0400)]
14260: Use straight SQL DELETE instead of destroy_all

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13561: Code cleanup.
Lucas Di Pentima [Thu, 18 Oct 2018 23:20:19 +0000 (20:20 -0300)]
13561: Code cleanup.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Exclude past versions regardless of user & include_trash setting.
Lucas Di Pentima [Thu, 18 Oct 2018 22:46:18 +0000 (19:46 -0300)]
13561: Exclude past versions regardless of user & include_trash setting.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14260-runtime-token' refs #14260
Peter Amstutz [Thu, 18 Oct 2018 17:44:35 +0000 (13:44 -0400)]
Merge branch '14260-runtime-token' refs #14260

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14366-crunch2-upgrade' refs #14366
Peter Amstutz [Thu, 18 Oct 2018 17:42:13 +0000 (13:42 -0400)]
Merge branch '14366-crunch2-upgrade' refs #14366

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Remove redundant schema_migrations in structure.sql
Peter Amstutz [Thu, 18 Oct 2018 17:18:19 +0000 (13:18 -0400)]
14260: Remove redundant schema_migrations in structure.sql

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Sort runtime_auth_scopes
Peter Amstutz [Thu, 18 Oct 2018 16:20:50 +0000 (12:20 -0400)]
14260: Sort runtime_auth_scopes

Container.for_current_token returns nil or a Container (not an active
record query).

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch 'master' into 14260-runtime-token
Peter Amstutz [Thu, 18 Oct 2018 15:58:57 +0000 (11:58 -0400)]
Merge branch 'master' into 14260-runtime-token

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13561: Re-phrase user guide & add admin guide section.
Lucas Di Pentima [Wed, 10 Oct 2018 20:12:27 +0000 (17:12 -0300)]
13561: Re-phrase user guide & add admin guide section.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Update documentation on collection versioning.
Lucas Di Pentima [Fri, 5 Oct 2018 18:55:41 +0000 (15:55 -0300)]
13561: Update documentation on collection versioning.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '13561-collection-versions-fixes'
Lucas Di Pentima [Wed, 17 Oct 2018 20:12:48 +0000 (17:12 -0300)]
Merge branch '13561-collection-versions-fixes'
Refs #13561

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14366: Add "upgrade to containers api" to "upgrading" section
Peter Amstutz [Wed, 17 Oct 2018 19:54:00 +0000 (15:54 -0400)]
14366: Add "upgrade to containers api" to "upgrading" section

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14366: Improve wording of "upgrading to containers API" section
Peter Amstutz [Wed, 17 Oct 2018 19:43:15 +0000 (15:43 -0400)]
14366: Improve wording of "upgrading to containers API" section

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13561: Raise exception instead of ignoring versioning attributes updates.
Lucas Di Pentima [Wed, 17 Oct 2018 18:51:36 +0000 (15:51 -0300)]
13561: Raise exception instead of ignoring versioning attributes updates.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Fixes api to get a collection with its past versions.
Lucas Di Pentima [Wed, 17 Oct 2018 18:05:50 +0000 (15:05 -0300)]
13561: Fixes api to get a collection with its past versions.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoFor the package test docker images, sanitize how we get the rvm GPG key,
Ward Vandewege [Wed, 17 Oct 2018 01:38:54 +0000 (21:38 -0400)]
For the package test docker images, sanitize how we get the rvm GPG key,
and remove a dependency on the GPG keyservers which are flakey.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoAdd a systemd service file to arvados-node-manager.
Ward Vandewege [Tue, 16 Oct 2018 20:49:15 +0000 (16:49 -0400)]
Add a systemd service file to arvados-node-manager.

Reset package iteration number for arvados-node-manager to version 1.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoRemove spurious output from run-build-packages.sh
Ward Vandewege [Tue, 16 Oct 2018 20:38:01 +0000 (16:38 -0400)]
Remove spurious output from run-build-packages.sh

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14344: bump package version for arvados-docker-cleaner so that we get a new
Ward Vandewege [Tue, 16 Oct 2018 20:37:00 +0000 (16:37 -0400)]
14344: bump package version for arvados-docker-cleaner so that we get a new
package built with the systemd service file.

refs #14344

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14344: Merge branch '14344-fix-rpm-vs-deb-detection'
Ward Vandewege [Tue, 16 Oct 2018 19:48:44 +0000 (15:48 -0400)]
14344: Merge branch '14344-fix-rpm-vs-deb-detection'

closes #14344

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14344: Move "set -e" back to top.
Tom Clegg [Tue, 16 Oct 2018 13:35:17 +0000 (09:35 -0400)]
14344: Move "set -e" back to top.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoFix the detection of rpm vs deb systems.
Ward Vandewege [Tue, 16 Oct 2018 01:49:30 +0000 (21:49 -0400)]
Fix the detection of rpm vs deb systems.

refs #14344

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoMerge branch '14285-keep-balance-metrics'
Tom Clegg [Tue, 16 Oct 2018 17:24:04 +0000 (13:24 -0400)]
Merge branch '14285-keep-balance-metrics'

closes #14285

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14285: Update admin/metrics docs.
Tom Clegg [Mon, 15 Oct 2018 21:36:03 +0000 (17:36 -0400)]
14285: Update admin/metrics docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14285: Add deduplication ratio to keep-balance metrics.
Tom Clegg [Mon, 15 Oct 2018 21:02:22 +0000 (17:02 -0400)]
14285: Add deduplication ratio to keep-balance metrics.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoFix missing namespace in metric names.
Tom Clegg [Tue, 16 Oct 2018 15:41:54 +0000 (11:41 -0400)]
Fix missing namespace in metric names.

refs #14285

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoRevert change to setup.py for arvados-docker-cleaner, pip doesn't agree with
Ward Vandewege [Mon, 15 Oct 2018 23:06:17 +0000 (19:06 -0400)]
Revert change to setup.py for arvados-docker-cleaner, pip doesn't agree with
it...

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14260: secret_mounts works with runtime_token (really this time)
Peter Amstutz [Mon, 15 Oct 2018 21:11:11 +0000 (17:11 -0400)]
14260: secret_mounts works with runtime_token (really this time)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14338-workbench-flag-to-disable-repositories'
Ward Vandewege [Mon, 15 Oct 2018 21:06:04 +0000 (17:06 -0400)]
Merge branch '14338-workbench-flag-to-disable-repositories'

closes #14338

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoAdd a flag to hide repositories entries in the Workbench menus. This is useful
Ward Vandewege [Fri, 12 Oct 2018 15:15:44 +0000 (11:15 -0400)]
Add a flag to hide repositories entries in the Workbench menus. This is useful
in a scenario where the jobs api is disabled and there are no local git
repositories. Local git repositories are optional when using the containers api.

refs #14338

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14260: secret_mounts works with runtime_token
Peter Amstutz [Mon, 15 Oct 2018 20:53:40 +0000 (16:53 -0400)]
14260: secret_mounts works with runtime_token

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: add runtime_user_uuid and runtime_auth_scopes to API response
Peter Amstutz [Mon, 15 Oct 2018 20:47:38 +0000 (16:47 -0400)]
14260: add runtime_user_uuid and runtime_auth_scopes to API response

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMake sure that the arvados-docker-cleaner systemd service file is installed in
Ward Vandewege [Mon, 15 Oct 2018 20:36:07 +0000 (16:36 -0400)]
Make sure that the arvados-docker-cleaner systemd service file is installed in
the correct directory.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years ago14260: Bugfix for runtime_token/secret_mounts and retries
Peter Amstutz [Mon, 15 Oct 2018 20:20:39 +0000 (16:20 -0400)]
14260: Bugfix for runtime_token/secret_mounts and retries

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '14285-keep-balance-metrics'
Tom Clegg [Mon, 15 Oct 2018 20:09:36 +0000 (16:09 -0400)]
Merge branch '14285-keep-balance-metrics'

refs #14285

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14285: Merge branch 'master' into 14285-keep-balance-metrics
Tom Clegg [Mon, 15 Oct 2018 20:08:22 +0000 (16:08 -0400)]
14285: Merge branch 'master' into 14285-keep-balance-metrics

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years agoWebshell requires the short hostname for the shell server object.
Ward Vandewege [Mon, 15 Oct 2018 19:39:14 +0000 (15:39 -0400)]
Webshell requires the short hostname for the shell server object.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoThe `arv group create` command doesn't set group_class by default, and we need
Ward Vandewege [Fri, 12 Oct 2018 20:01:44 +0000 (16:01 -0400)]
The `arv group create` command doesn't set group_class by default, and we need
that field set to 'project' for the 'Arvados Standard Docker Images' project.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoSmall documentation fixes.
Ward Vandewege [Fri, 12 Oct 2018 19:53:37 +0000 (15:53 -0400)]
Small documentation fixes.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <wvandewege@veritasgenetics.com>

6 years agoMerge branch '14086-keepweb-serve-past-versions'
Lucas Di Pentima [Mon, 15 Oct 2018 18:10:20 +0000 (15:10 -0300)]
Merge branch '14086-keepweb-serve-past-versions'
Closes #14086

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14285: Add tests for LoadToken and RequireLiteralToken.
Tom Clegg [Mon, 15 Oct 2018 17:50:10 +0000 (13:50 -0400)]
14285: Add tests for LoadToken and RequireLiteralToken.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14260: Fix workbench functionals test
Peter Amstutz [Mon, 15 Oct 2018 17:36:02 +0000 (13:36 -0400)]
14260: Fix workbench functionals test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14086: Add tests to prove that keep-web can serve past collection versions.
Lucas Di Pentima [Mon, 15 Oct 2018 17:02:29 +0000 (14:02 -0300)]
14086: Add tests to prove that keep-web can serve past collection versions.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14260: Fix tests.
Peter Amstutz [Mon, 15 Oct 2018 16:09:35 +0000 (12:09 -0400)]
14260: Fix tests.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14285: Merge branch 'master' into 14285-keep-balance-metrics
Tom Clegg [Mon, 15 Oct 2018 15:23:18 +0000 (11:23 -0400)]
14285: Merge branch 'master' into 14285-keep-balance-metrics

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14260: Add invalid remote token test
Peter Amstutz [Mon, 15 Oct 2018 15:09:58 +0000 (11:09 -0400)]
14260: Add invalid remote token test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Additional validation when container uuid is provided in token
Peter Amstutz [Mon, 15 Oct 2018 15:02:38 +0000 (11:02 -0400)]
14260: Additional validation when container uuid is provided in token

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Update API doc for runtime_* fields (token/user_uuid/auth_scopes)
Peter Amstutz [Fri, 12 Oct 2018 21:34:47 +0000 (17:34 -0400)]
14260: Update API doc for runtime_* fields (token/user_uuid/auth_scopes)

Also add missing documentation for secret_mounts.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: crunch-run constructs a v2 token with added container uuid
Peter Amstutz [Fri, 12 Oct 2018 21:07:33 +0000 (17:07 -0400)]
14260: crunch-run constructs a v2 token with added container uuid

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Container auth tokens must have the container uuid in the 4th position
Peter Amstutz [Fri, 12 Oct 2018 21:01:23 +0000 (17:01 -0400)]
14260: Container auth tokens must have the container uuid in the 4th position

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14285: Add keep-balance to health aggregator test stub.
Tom Clegg [Fri, 12 Oct 2018 18:56:51 +0000 (14:56 -0400)]
14285: Add keep-balance to health aggregator test stub.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14260: Don't set auth_uuid when runtime_token is set.
Peter Amstutz [Fri, 12 Oct 2018 18:46:02 +0000 (14:46 -0400)]
14260: Don't set auth_uuid when runtime_token is set.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14285: Add keep-balance to example cluster config.
Tom Clegg [Fri, 12 Oct 2018 17:56:22 +0000 (13:56 -0400)]
14285: Add keep-balance to example cluster config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14285: Add token middleware. Require management token for metrics.
Tom Clegg [Fri, 12 Oct 2018 17:52:08 +0000 (13:52 -0400)]
14285: Add token middleware. Require management token for metrics.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14285: Update sample config.
Tom Clegg [Fri, 12 Oct 2018 14:04:04 +0000 (10:04 -0400)]
14285: Update sample config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14285: Split Server to server.go.
Tom Clegg [Fri, 12 Oct 2018 14:01:50 +0000 (10:01 -0400)]
14285: Split Server to server.go.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14260: Added runtime_token to container record
Peter Amstutz [Thu, 11 Oct 2018 22:27:51 +0000 (18:27 -0400)]
14260: Added runtime_token to container record

* runtime_token, runtime_user_uuid and runtime_auth_scopes are now
  part of container initialization and reuse decisions

* Determine runtime_user_uuid and runtime_auth_scopes as part of
  Container.resolve

* Use runtime_user_uuid to create container token (when runtime_token
  is not set)

* act_as runtime_user_uuid when resolving container request fields

* tokens used for runtime_token will be left untouched (remove expire_destroy)

* added/updated/fixed tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years agoMerge branch '13561-collection-versions-api'
Lucas Di Pentima [Thu, 11 Oct 2018 18:36:03 +0000 (15:36 -0300)]
Merge branch '13561-collection-versions-api'
Refs #13561

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Move versioning code inside locking block.
Lucas Di Pentima [Thu, 11 Oct 2018 16:17:47 +0000 (13:17 -0300)]
13561: Move versioning code inside locking block.

Also, don't allow current_version_uuid updates on current versions.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago13561: Fix validation & update related test.
Lucas Di Pentima [Thu, 11 Oct 2018 14:09:37 +0000 (11:09 -0300)]
13561: Fix validation & update related test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years ago14260: runtime_token goes in container auth
Peter Amstutz [Thu, 11 Oct 2018 14:08:08 +0000 (10:08 -0400)]
14260: runtime_token goes in container auth

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Test container runtime_token
Peter Amstutz [Wed, 10 Oct 2018 19:58:21 +0000 (15:58 -0400)]
14260: Test container runtime_token

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Container runtime token wip
Peter Amstutz [Fri, 5 Oct 2018 20:40:33 +0000 (16:40 -0400)]
14260: Container runtime token wip

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago14260: Migration adding runtime_token, runtime_user_uuid, runtime_auth_scopes
Peter Amstutz [Fri, 5 Oct 2018 19:31:08 +0000 (15:31 -0400)]
14260: Migration adding runtime_token, runtime_user_uuid, runtime_auth_scopes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <pamstutz@veritasgenetics.com>

6 years ago13561: Refactor version creation & sync logic.
Lucas Di Pentima [Wed, 10 Oct 2018 01:16:30 +0000 (22:16 -0300)]
13561: Refactor version creation & sync logic.

* Avoid overriding save! and move code to collection's callbacks.
* Use around_update to make the necessary actions and get a lock before saving.
* Arrange version creation and syncing actions so that they happen after the
  current version's update.
* Update test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <ldipentima@veritasgenetics.com>

6 years agoMerge branch '14199-copy-from-remote'
Tom Clegg [Tue, 9 Oct 2018 20:07:44 +0000 (16:07 -0400)]
Merge branch '14199-copy-from-remote'

refs #14199

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14199: Reduce logging noise from azure test stubs.
Tom Clegg [Tue, 9 Oct 2018 20:07:17 +0000 (16:07 -0400)]
14199: Reduce logging noise from azure test stubs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>

6 years ago14199: Merge branch 'master' into 14199-copy-from-remote
Tom Clegg [Tue, 9 Oct 2018 19:56:26 +0000 (15:56 -0400)]
14199: Merge branch 'master' into 14199-copy-from-remote

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tclegg@veritasgenetics.com>