arvados.git
4 years ago16169: Monkey patch load_tool.resolve_and_validate_document to fix bug
Peter Amstutz [Fri, 28 Feb 2020 17:07:35 +0000 (12:07 -0500)]
16169: Monkey patch load_tool.resolve_and_validate_document to fix bug

There is a bug in upstream cwltool where the version updater needs to
replace the document fragments in the loader index with the updated
ones, but actually it only does it for the root document.  Normally we
just fix the bug in upstream but that's challenging because current
cwltool dropped support for Python 2.7 and we're still supporting py2
in Arvados 2.0 (although py2 support will most likely be dropped in
Arvados 2.1).  Making a bugfix fork comes with its own
complications (it would need to be added to PyPi) so monkey patching
is the least disruptive fix (and is relatively safe because our
cwltool dependency is pinned to a specific version).  This
should be removed as soon as a bugfix goes into upstream cwltool and
we upgrade to it.

4 years ago16169: Adds test exposing the requirement propagation bug.
Lucas Di Pentima [Wed, 26 Feb 2020 23:58:59 +0000 (20:58 -0300)]
16169: Adds test exposing the requirement propagation bug.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16177: Fix tests, test server config now has TrustAllContent: false
Peter Amstutz [Thu, 27 Feb 2020 17:21:34 +0000 (12:21 -0500)]
16177: Fix tests, test server config now has TrustAllContent: false

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16177: Use correct config item Collections.TrustAllContent
Peter Amstutz [Wed, 26 Feb 2020 20:31:58 +0000 (15:31 -0500)]
16177: Use correct config item Collections.TrustAllContent

Also added fallback error handler, if view or download link doesn't
work, render error text (otherwise you get a very confusing Rails
crash page).

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16202: Add Workbench.SSHHelpHostSuffix
Peter Amstutz [Wed, 26 Feb 2020 21:12:22 +0000 (16:12 -0500)]
16202: Add Workbench.SSHHelpHostSuffix

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoFix web shell.
Ward Vandewege [Wed, 26 Feb 2020 18:49:28 +0000 (13:49 -0500)]
Fix web shell.

refs #16203

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years ago15954: Propagate remote param.
Tom Clegg [Tue, 25 Feb 2020 17:14:32 +0000 (12:14 -0500)]
15954: Propagate remote param.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16101: Redirect logout to Workbench if return_to param missing.
Tom Clegg [Thu, 20 Feb 2020 20:43:50 +0000 (15:43 -0500)]
16101: Redirect logout to Workbench if return_to param missing.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16101: Handle logout without sso-provider.
Tom Clegg [Mon, 17 Feb 2020 18:55:27 +0000 (13:55 -0500)]
16101: Handle logout without sso-provider.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16100: Move test to integration suite to avoid logging errors.
Tom Clegg [Sat, 15 Feb 2020 21:47:34 +0000 (16:47 -0500)]
16100: Move test to integration suite to avoid logging errors.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16100: Add package dependency for /etc/mime.types.
Tom Clegg [Fri, 14 Feb 2020 18:40:01 +0000 (13:40 -0500)]
16100: Add package dependency for /etc/mime.types.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16100: Log a warning if /etc/mime.types is missing.
Tom Clegg [Fri, 14 Feb 2020 18:39:38 +0000 (13:39 -0500)]
16100: Log a warning if /etc/mime.types is missing.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16100: Test content-type detection.
Tom Clegg [Fri, 14 Feb 2020 18:25:30 +0000 (13:25 -0500)]
16100: Test content-type detection.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16100: Fix bogus timing stats for empty responses.
Tom Clegg [Thu, 13 Feb 2020 07:29:22 +0000 (02:29 -0500)]
16100: Fix bogus timing stats for empty responses.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16039: Touch python clients so they run tests with the latest SDK.
Tom Clegg [Thu, 13 Feb 2020 02:50:07 +0000 (21:50 -0500)]
16039: Touch python clients so they run tests with the latest SDK.

Otherwise, "pip install" (during "install services/nodemanager", for
example) downgrades the SDK from the current version to the latest
version published on pip, and all test suites run with that version,
instead of the version we think we're testing.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16039: Install missing python dep.
Tom Clegg [Thu, 13 Feb 2020 02:47:44 +0000 (21:47 -0500)]
16039: Install missing python dep.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16039: Use current python sdk in py3 tests.
Tom Clegg [Wed, 12 Feb 2020 18:49:50 +0000 (13:49 -0500)]
16039: Use current python sdk in py3 tests.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16039: Fix & add test for sanitized/unsanitized name conflict.
Tom Clegg [Wed, 12 Feb 2020 15:48:05 +0000 (10:48 -0500)]
16039: Fix & add test for sanitized/unsanitized name conflict.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16039: Accommodate API servers with no config export.
Tom Clegg [Wed, 12 Feb 2020 15:37:48 +0000 (10:37 -0500)]
16039: Accommodate API servers with no config export.

Add more checks in test cases.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16039: Obey ForwardSlashNameSubstitution config in arv-mount.
Tom Clegg [Tue, 11 Feb 2020 15:58:28 +0000 (10:58 -0500)]
16039: Obey ForwardSlashNameSubstitution config in arv-mount.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoTweak upgrade notes
Peter Amstutz [Fri, 14 Feb 2020 18:54:08 +0000 (13:54 -0500)]
Tweak upgrade notes

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '16152-keep-balance-http-crash' 2.0.0
Tom Clegg [Fri, 14 Feb 2020 00:22:45 +0000 (19:22 -0500)]
Merge branch '16152-keep-balance-http-crash'

fixes #16152

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16152: Fix nil http handler and ignored config args.
Tom Clegg [Thu, 13 Feb 2020 20:58:09 +0000 (15:58 -0500)]
16152: Fix nil http handler and ignored config args.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '16144-nil-checks' refs #16144
Peter Amstutz [Wed, 12 Feb 2020 03:37:44 +0000 (22:37 -0500)]
Merge branch '16144-nil-checks' refs #16144

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16144: Adds more checks and simplifies nested conditionals.
Lucas Di Pentima [Tue, 11 Feb 2020 23:14:42 +0000 (20:14 -0300)]
16144: Adds more checks and simplifies nested conditionals.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16144: Fixes the bug.
Lucas Di Pentima [Tue, 11 Feb 2020 22:22:24 +0000 (19:22 -0300)]
16144: Fixes the bug.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16144: Adds tests exposing the bug.
Lucas Di Pentima [Tue, 11 Feb 2020 22:21:09 +0000 (19:21 -0300)]
16144: Adds tests exposing the bug.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoMerge branch '16141-gosdk-missing-fields'
Lucas Di Pentima [Tue, 11 Feb 2020 17:57:54 +0000 (14:57 -0300)]
Merge branch '16141-gosdk-missing-fields'

Closes #16141

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16141: Fixes User type, adjusts fixture to make the test pass.
Lucas Di Pentima [Tue, 11 Feb 2020 17:10:48 +0000 (14:10 -0300)]
16141: Fixes User type, adjusts fixture to make the test pass.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16141: Updates the test to use a different, more complete collection fixture.
Lucas Di Pentima [Tue, 11 Feb 2020 16:41:41 +0000 (13:41 -0300)]
16141: Updates the test to use a different, more complete collection fixture.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16141: Fixes GoSDK's Collection type.
Lucas Di Pentima [Tue, 11 Feb 2020 16:41:17 +0000 (13:41 -0300)]
16141: Fixes GoSDK's Collection type.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16141: Fixes test to use the 1st keep_service's uuid the test server returns.
Lucas Di Pentima [Mon, 10 Feb 2020 19:22:07 +0000 (16:22 -0300)]
16141: Fixes test to use the 1st keep_service's uuid the test server returns.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16141: Adds better message on test in failing situations.
Lucas Di Pentima [Mon, 10 Feb 2020 18:40:47 +0000 (15:40 -0300)]
16141: Adds better message on test in failing situations.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoMerge branch '15835-metrics-docs'
Tom Clegg [Mon, 10 Feb 2020 18:03:15 +0000 (13:03 -0500)]
Merge branch '15835-metrics-docs'

closes #15835

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoPin virtualenv<20
Peter Amstutz [Mon, 10 Feb 2020 17:54:49 +0000 (12:54 -0500)]
Pin virtualenv<20

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16141: Fixes GoSDK's User type.
Lucas Di Pentima [Mon, 10 Feb 2020 17:41:44 +0000 (14:41 -0300)]
16141: Fixes GoSDK's User type.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16141: Expands test for other object types.
Lucas Di Pentima [Mon, 10 Feb 2020 17:41:10 +0000 (14:41 -0300)]
16141: Expands test for other object types.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoSet upper version of setuptools for Python 2 in Centos7 container
Peter Amstutz [Mon, 10 Feb 2020 16:11:26 +0000 (11:11 -0500)]
Set upper version of setuptools for Python 2 in Centos7 container

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoSet upper version of setuptools for Python 2 support
Peter Amstutz [Mon, 10 Feb 2020 16:09:36 +0000 (11:09 -0500)]
Set upper version of setuptools for Python 2 support

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16141: Fixes Collection type on Go SDK. Adjusts test.
Lucas Di Pentima [Mon, 10 Feb 2020 15:41:12 +0000 (12:41 -0300)]
16141: Fixes Collection type on Go SDK. Adjusts test.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoMerge branch '16139-cwl-secondaryfiles-fix'
Peter Amstutz [Mon, 10 Feb 2020 15:14:05 +0000 (10:14 -0500)]
Merge branch '16139-cwl-secondaryfiles-fix'

fixes #16139

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoAnnotate notify uses localStorage instead of sessionStorage
Peter Amstutz [Mon, 10 Feb 2020 15:13:07 +0000 (10:13 -0500)]
Annotate notify uses localStorage instead of sessionStorage

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16139: Add test
Peter Amstutz [Sun, 9 Feb 2020 23:07:15 +0000 (18:07 -0500)]
16139: Add test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16141: Adds missing collection fields to GoSDK.
Lucas Di Pentima [Fri, 7 Feb 2020 23:40:51 +0000 (20:40 -0300)]
16141: Adds missing collection fields to GoSDK.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16141: Exposes the bug.
Lucas Di Pentima [Fri, 7 Feb 2020 23:40:17 +0000 (20:40 -0300)]
16141: Exposes the bug.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago16139: Fix secondaryFile errors when running --submit --no-wait
Peter Amstutz [Fri, 7 Feb 2020 20:59:10 +0000 (15:59 -0500)]
16139: Fix secondaryFile errors when running --submit --no-wait

When submitting, we want to preserve the original CWL version of the
document.

However, when it creates a RunnerContainer (a cwltool.Process) it
examines the input interface and expects it to be in the 1.1 data
model.  But if we preserve/reload the original document, it is still
in the 1.0 data model.  This causes

The code was deliberately overriding the CWL version in metadata to
make this work.  This results in the problem reported on this ticket.

The fix is to maintain both the updated and preserved documents, and
use them appropriately where they are expected.

refs #16139

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago15835: Update metrics docs.
Tom Clegg [Fri, 7 Feb 2020 21:07:06 +0000 (16:07 -0500)]
15835: Update metrics docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoAdd note that some services require a minimal config.yml to start.
Peter Amstutz [Fri, 7 Feb 2020 16:36:53 +0000 (11:36 -0500)]
Add note that some services require a minimal config.yml to start.

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoImprove readability of upgrade notes
Peter Amstutz [Thu, 6 Feb 2020 22:36:12 +0000 (17:36 -0500)]
Improve readability of upgrade notes

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '16133-federation-loop'
Tom Clegg [Thu, 6 Feb 2020 19:59:07 +0000 (14:59 -0500)]
Merge branch '16133-federation-loop'

fixes #16133

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16133: Don't take multiple federation hops.
Tom Clegg [Thu, 6 Feb 2020 19:16:55 +0000 (14:16 -0500)]
16133: Don't take multiple federation hops.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '16136-original-owner' closes #16136
Peter Amstutz [Thu, 6 Feb 2020 17:25:54 +0000 (12:25 -0500)]
Merge branch '16136-original-owner' closes #16136

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16136: Prioritize 'Function' over 'Value' and ignore null
Peter Amstutz [Thu, 6 Feb 2020 16:42:59 +0000 (11:42 -0500)]
16136: Prioritize 'Function' over 'Value' and ignore null

Because arvados-server config-dump will emit "Value: null" even if the
original config file didn't provide it.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16133: Don't take multiple hops when getting collections.
Tom Clegg [Thu, 6 Feb 2020 16:09:32 +0000 (11:09 -0500)]
16133: Don't take multiple hops when getting collections.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16133: Avoid cycle between old and new controllers.
Tom Clegg [Thu, 6 Feb 2020 15:45:48 +0000 (10:45 -0500)]
16133: Avoid cycle between old and new controllers.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16133: Avoid cycle when searching federation for PDH.
Tom Clegg [Thu, 6 Feb 2020 15:19:04 +0000 (10:19 -0500)]
16133: Avoid cycle when searching federation for PDH.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoAdd a note to the install section
Peter Amstutz [Wed, 5 Feb 2020 18:33:02 +0000 (13:33 -0500)]
Add a note to the install section

Add note that you should look in the SDKs section for client tools.

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '16111-ssh-help' closes #16111
Peter Amstutz [Tue, 4 Feb 2020 14:43:36 +0000 (09:43 -0500)]
Merge branch '16111-ssh-help' closes #16111

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '16104-select-uuid'
Tom Clegg [Mon, 3 Feb 2020 22:04:16 +0000 (17:04 -0500)]
Merge branch '16104-select-uuid'

refs #16104

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16111: Add SSHHelpPageHTML so admin can provide custom instructions
Peter Amstutz [Mon, 3 Feb 2020 21:02:36 +0000 (16:02 -0500)]
16111: Add SSHHelpPageHTML so admin can provide custom instructions

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16104: Don't impose federated query limitations on local-only query.
Tom Clegg [Mon, 3 Feb 2020 20:28:04 +0000 (15:28 -0500)]
16104: Don't impose federated query limitations on local-only query.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoIn our systemd service files, set a reasonable default for the open file
Ward Vandewege [Mon, 3 Feb 2020 19:39:20 +0000 (14:39 -0500)]
In our systemd service files, set a reasonable default for the open file
limit (65536).

refs #16089

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years agoMerge branch '16108-favorites' refs #16108
Peter Amstutz [Mon, 3 Feb 2020 19:35:42 +0000 (14:35 -0500)]
Merge branch '16108-favorites' refs #16108

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16108: Use zzzzz- in examples
Peter Amstutz [Mon, 3 Feb 2020 19:34:53 +0000 (14:34 -0500)]
16108: Use zzzzz- in examples

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16108: Change wb1 'favorites' to filter on user_uuid instead of tail_uuid
Peter Amstutz [Sun, 2 Feb 2020 17:58:16 +0000 (12:58 -0500)]
16108: Change wb1 'favorites' to filter on user_uuid instead of tail_uuid

Fixes potential exploit by which a malicious user could inject
favorites into another user's favorites list.

Public favorites owned by "All Users" will now appear in wb1.

Move documentation about 'star' links from admin section to API
documentation.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoUpdate maintainer and vendor for our OS packages.
Ward Vandewege [Sun, 2 Feb 2020 15:55:17 +0000 (10:55 -0500)]
Update maintainer and vendor for our OS packages.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years agoWorkbench 2 isn't really beta if we're telling people to use it.
Peter Amstutz [Thu, 30 Jan 2020 23:28:41 +0000 (18:28 -0500)]
Workbench 2 isn't really beta if we're telling people to use it.

refs #16015

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoUpdate more documentation for new config file, add 'group favorites'
Peter Amstutz [Thu, 30 Jan 2020 23:17:43 +0000 (18:17 -0500)]
Update more documentation for new config file, add 'group favorites'

refs #16015

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoWorkbench1 package depends on graphviz
Peter Amstutz [Thu, 30 Jan 2020 21:57:08 +0000 (16:57 -0500)]
Workbench1 package depends on graphviz

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoAdds information about the new vocabulary format on the release notes.
Lucas Di Pentima [Thu, 30 Jan 2020 19:52:17 +0000 (16:52 -0300)]
Adds information about the new vocabulary format on the release notes.

No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoPin bundler to version compatible with all Rubies we support
Peter Amstutz [Thu, 30 Jan 2020 18:00:31 +0000 (13:00 -0500)]
Pin bundler to version compatible with all Rubies we support

refs #16015

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoUpdate text to refer to Arvados 2.0
Peter Amstutz [Thu, 30 Jan 2020 15:50:38 +0000 (10:50 -0500)]
Update text to refer to Arvados 2.0

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '15902-slow-query'
Lucas Di Pentima [Tue, 28 Jan 2020 22:06:50 +0000 (19:06 -0300)]
Merge branch '15902-slow-query'

Closes #15902

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago15902: Adjust order to avoid poorly optimized query.
Tom Clegg [Tue, 28 Jan 2020 20:05:02 +0000 (15:05 -0500)]
15902: Adjust order to avoid poorly optimized query.

When many requesting_container_uuid values are passed in this query,
the default order (["modified_at desc", "uuid"]) sometimes causes
PostgreSQL to begin with the timestamp index, which results in a slow
query. The requesting_container_uuid index makes the query much
faster.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '15944-arvbox-publicdev-fix'
Lucas Di Pentima [Tue, 28 Jan 2020 18:51:35 +0000 (15:51 -0300)]
Merge branch '15944-arvbox-publicdev-fix'

Closes #15944

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoarvados/jobs image uses python3 for arvados-cwl-runner
Peter Amstutz [Mon, 27 Jan 2020 23:05:23 +0000 (18:05 -0500)]
arvados/jobs image uses python3 for arvados-cwl-runner

This avoids the deprecation warning from cwltool.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoAdd python3 build of arvados-cwl-runner
Peter Amstutz [Mon, 27 Jan 2020 18:31:49 +0000 (13:31 -0500)]
Add python3 build of arvados-cwl-runner

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago15944: Takes arvbox container's default gw IP as internal client.
Lucas Di Pentima [Fri, 24 Jan 2020 22:22:06 +0000 (19:22 -0300)]
15944: Takes arvbox container's default gw IP as internal client.

This makes Keep work on 'publicdev' mode.
Also, turns off nginx's response caching for easier debugging.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoAdd a bit more discussion about DNS on compute node images closes #16085
Peter Amstutz [Fri, 24 Jan 2020 20:22:48 +0000 (15:22 -0500)]
Add a bit more discussion about DNS on compute node images closes #16085

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoUse updated run_upload_packages
Peter Amstutz [Fri, 24 Jan 2020 16:36:30 +0000 (11:36 -0500)]
Use updated run_upload_packages

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago15944: Merge branch 'master' into 15944-arvbox-publicdev-fix
Lucas Di Pentima [Fri, 24 Jan 2020 14:41:05 +0000 (11:41 -0300)]
15944: Merge branch 'master' into 15944-arvbox-publicdev-fix

4 years agoFix setting workflow label field from record name fixes #16083
Peter Amstutz [Thu, 23 Jan 2020 22:09:59 +0000 (17:09 -0500)]
Fix setting workflow label field from record name fixes #16083

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoRestore bootstrap.min.js refs #16081
Peter Amstutz [Thu, 23 Jan 2020 21:29:25 +0000 (16:29 -0500)]
Restore bootstrap.min.js refs #16081

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '16072-acr-default-image' closes #16072
Peter Amstutz [Thu, 23 Jan 2020 21:06:30 +0000 (16:06 -0500)]
Merge branch '16072-acr-default-image' closes #16072

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16072: Default image is runner image version, not latest
Peter Amstutz [Thu, 23 Jan 2020 16:54:42 +0000 (11:54 -0500)]
16072: Default image is runner image version, not latest

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoImprove the version assignment script to handle more cases
Peter Amstutz [Thu, 23 Jan 2020 18:51:02 +0000 (13:51 -0500)]
Improve the version assignment script to handle more cases

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoFix test refs #16051
Peter Amstutz [Wed, 22 Jan 2020 17:23:07 +0000 (12:23 -0500)]
Fix test refs #16051

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoAllow user 'setup' to succeed even if email notification fails
Peter Amstutz [Tue, 21 Jan 2020 20:07:50 +0000 (15:07 -0500)]
Allow user 'setup' to succeed even if email notification fails

fixes #16051

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoFUSE also needs version from latest(sdk, fuse)
Peter Amstutz [Tue, 21 Jan 2020 19:18:25 +0000 (14:18 -0500)]
FUSE also needs version from latest(sdk, fuse)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoPin signet <= 0.11 to support Ruby 2.3
Peter Amstutz [Sat, 18 Jan 2020 21:54:15 +0000 (16:54 -0500)]
Pin signet <= 0.11 to support Ruby 2.3

refs #16045

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoSupport OS packaging of Ruby/bunder (fix login-sync)
Peter Amstutz [Sat, 18 Jan 2020 02:30:00 +0000 (21:30 -0500)]
Support OS packaging of Ruby/bunder (fix login-sync)

refs #16045

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoArvbox uses OS package for Ruby instead of building from source
Peter Amstutz [Sat, 18 Jan 2020 00:34:16 +0000 (19:34 -0500)]
Arvbox uses OS package for Ruby instead of building from source

refs #16045

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoSupport OS packaging of Ruby/bunder, with note in install docs
Peter Amstutz [Sat, 18 Jan 2020 00:32:58 +0000 (19:32 -0500)]
Support OS packaging of Ruby/bunder, with note in install docs

refs #16045

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago"last supported version" should be release version not git commit
Peter Amstutz [Fri, 17 Jan 2020 20:15:02 +0000 (15:15 -0500)]
"last supported version" should be release version not git commit

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '16046-keepdocker-slash' closes #16046
Peter Amstutz [Fri, 17 Jan 2020 20:01:28 +0000 (15:01 -0500)]
Merge branch '16046-keepdocker-slash' closes #16046

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16046: Replace slash with space for "repo/image" collection name
Peter Amstutz [Fri, 17 Jan 2020 19:47:23 +0000 (14:47 -0500)]
16046: Replace slash with space for "repo/image" collection name

Add a property with the original repo/image name so that it is still
findable in search.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoAdd "copy files from a collection to a new collection" to cookbook
Peter Amstutz [Fri, 17 Jan 2020 16:41:01 +0000 (11:41 -0500)]
Add "copy files from a collection to a new collection" to cookbook

closes #16044

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoLogSecondsBetweenEvents should be a duration
Peter Amstutz [Fri, 17 Jan 2020 16:04:34 +0000 (11:04 -0500)]
LogSecondsBetweenEvents should be a duration

refs #16014

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoAdjust default for LogSecondsBetweenEvents from 1s to 5s
Peter Amstutz [Fri, 17 Jan 2020 15:39:31 +0000 (10:39 -0500)]
Adjust default for LogSecondsBetweenEvents from 1s to 5s

Because logging every 1s is known to overwhelm the API server at even
moderate loads.

closes #16014

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '15836-slash-in-collection-name'
Tom Clegg [Thu, 16 Jan 2020 21:07:00 +0000 (16:07 -0500)]
Merge branch '15836-slash-in-collection-name'

fixes #15836

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>