arvados.git
4 years ago15954: Merge branch 'master'
Tom Clegg [Tue, 11 Feb 2020 16:39:44 +0000 (11:39 -0500)]
15954: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '15835-metrics-docs'
Tom Clegg [Mon, 10 Feb 2020 18:03:15 +0000 (13:03 -0500)]
Merge branch '15835-metrics-docs'

closes #15835

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoPin virtualenv<20
Peter Amstutz [Mon, 10 Feb 2020 17:54:49 +0000 (12:54 -0500)]
Pin virtualenv<20

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoSet upper version of setuptools for Python 2 in Centos7 container
Peter Amstutz [Mon, 10 Feb 2020 16:11:26 +0000 (11:11 -0500)]
Set upper version of setuptools for Python 2 in Centos7 container

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoSet upper version of setuptools for Python 2 support
Peter Amstutz [Mon, 10 Feb 2020 16:09:36 +0000 (11:09 -0500)]
Set upper version of setuptools for Python 2 support

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '16139-cwl-secondaryfiles-fix'
Peter Amstutz [Mon, 10 Feb 2020 15:14:05 +0000 (10:14 -0500)]
Merge branch '16139-cwl-secondaryfiles-fix'

fixes #16139

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoAnnotate notify uses localStorage instead of sessionStorage
Peter Amstutz [Mon, 10 Feb 2020 15:13:07 +0000 (10:13 -0500)]
Annotate notify uses localStorage instead of sessionStorage

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16139: Add test
Peter Amstutz [Sun, 9 Feb 2020 23:07:15 +0000 (18:07 -0500)]
16139: Add test

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16139: Fix secondaryFile errors when running --submit --no-wait
Peter Amstutz [Fri, 7 Feb 2020 20:59:10 +0000 (15:59 -0500)]
16139: Fix secondaryFile errors when running --submit --no-wait

When submitting, we want to preserve the original CWL version of the
document.

However, when it creates a RunnerContainer (a cwltool.Process) it
examines the input interface and expects it to be in the 1.1 data
model.  But if we preserve/reload the original document, it is still
in the 1.0 data model.  This causes

The code was deliberately overriding the CWL version in metadata to
make this work.  This results in the problem reported on this ticket.

The fix is to maintain both the updated and preserved documents, and
use them appropriately where they are expected.

refs #16139

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago15835: Update metrics docs.
Tom Clegg [Fri, 7 Feb 2020 21:07:06 +0000 (16:07 -0500)]
15835: Update metrics docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoAdd note that some services require a minimal config.yml to start.
Peter Amstutz [Fri, 7 Feb 2020 16:36:53 +0000 (11:36 -0500)]
Add note that some services require a minimal config.yml to start.

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoImprove readability of upgrade notes
Peter Amstutz [Thu, 6 Feb 2020 22:36:12 +0000 (17:36 -0500)]
Improve readability of upgrade notes

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '16133-federation-loop'
Tom Clegg [Thu, 6 Feb 2020 19:59:07 +0000 (14:59 -0500)]
Merge branch '16133-federation-loop'

fixes #16133

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16133: Don't take multiple federation hops.
Tom Clegg [Thu, 6 Feb 2020 19:16:55 +0000 (14:16 -0500)]
16133: Don't take multiple federation hops.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '16136-original-owner' closes #16136
Peter Amstutz [Thu, 6 Feb 2020 17:25:54 +0000 (12:25 -0500)]
Merge branch '16136-original-owner' closes #16136

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16136: Prioritize 'Function' over 'Value' and ignore null
Peter Amstutz [Thu, 6 Feb 2020 16:42:59 +0000 (11:42 -0500)]
16136: Prioritize 'Function' over 'Value' and ignore null

Because arvados-server config-dump will emit "Value: null" even if the
original config file didn't provide it.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16133: Don't take multiple hops when getting collections.
Tom Clegg [Thu, 6 Feb 2020 16:09:32 +0000 (11:09 -0500)]
16133: Don't take multiple hops when getting collections.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16133: Avoid cycle between old and new controllers.
Tom Clegg [Thu, 6 Feb 2020 15:45:48 +0000 (10:45 -0500)]
16133: Avoid cycle between old and new controllers.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16133: Avoid cycle when searching federation for PDH.
Tom Clegg [Thu, 6 Feb 2020 15:19:04 +0000 (10:19 -0500)]
16133: Avoid cycle when searching federation for PDH.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoAdd a note to the install section
Peter Amstutz [Wed, 5 Feb 2020 18:33:02 +0000 (13:33 -0500)]
Add a note to the install section

Add note that you should look in the SDKs section for client tools.

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '16111-ssh-help' closes #16111
Peter Amstutz [Tue, 4 Feb 2020 14:43:36 +0000 (09:43 -0500)]
Merge branch '16111-ssh-help' closes #16111

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '16104-select-uuid'
Tom Clegg [Mon, 3 Feb 2020 22:04:16 +0000 (17:04 -0500)]
Merge branch '16104-select-uuid'

refs #16104

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago16111: Add SSHHelpPageHTML so admin can provide custom instructions
Peter Amstutz [Mon, 3 Feb 2020 21:02:36 +0000 (16:02 -0500)]
16111: Add SSHHelpPageHTML so admin can provide custom instructions

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16104: Don't impose federated query limitations on local-only query.
Tom Clegg [Mon, 3 Feb 2020 20:28:04 +0000 (15:28 -0500)]
16104: Don't impose federated query limitations on local-only query.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoIn our systemd service files, set a reasonable default for the open file
Ward Vandewege [Mon, 3 Feb 2020 19:39:20 +0000 (14:39 -0500)]
In our systemd service files, set a reasonable default for the open file
limit (65536).

refs #16089

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years agoMerge branch '16108-favorites' refs #16108
Peter Amstutz [Mon, 3 Feb 2020 19:35:42 +0000 (14:35 -0500)]
Merge branch '16108-favorites' refs #16108

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16108: Use zzzzz- in examples
Peter Amstutz [Mon, 3 Feb 2020 19:34:53 +0000 (14:34 -0500)]
16108: Use zzzzz- in examples

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16108: Change wb1 'favorites' to filter on user_uuid instead of tail_uuid
Peter Amstutz [Sun, 2 Feb 2020 17:58:16 +0000 (12:58 -0500)]
16108: Change wb1 'favorites' to filter on user_uuid instead of tail_uuid

Fixes potential exploit by which a malicious user could inject
favorites into another user's favorites list.

Public favorites owned by "All Users" will now appear in wb1.

Move documentation about 'star' links from admin section to API
documentation.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoUpdate maintainer and vendor for our OS packages.
Ward Vandewege [Sun, 2 Feb 2020 15:55:17 +0000 (10:55 -0500)]
Update maintainer and vendor for our OS packages.

No issue #

Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@jhvc.com>

4 years agoWorkbench 2 isn't really beta if we're telling people to use it.
Peter Amstutz [Thu, 30 Jan 2020 23:28:41 +0000 (18:28 -0500)]
Workbench 2 isn't really beta if we're telling people to use it.

refs #16015

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoUpdate more documentation for new config file, add 'group favorites'
Peter Amstutz [Thu, 30 Jan 2020 23:17:43 +0000 (18:17 -0500)]
Update more documentation for new config file, add 'group favorites'

refs #16015

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoWorkbench1 package depends on graphviz
Peter Amstutz [Thu, 30 Jan 2020 21:57:08 +0000 (16:57 -0500)]
Workbench1 package depends on graphviz

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoAdds information about the new vocabulary format on the release notes.
Lucas Di Pentima [Thu, 30 Jan 2020 19:52:17 +0000 (16:52 -0300)]
Adds information about the new vocabulary format on the release notes.

No issue #

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoPin bundler to version compatible with all Rubies we support
Peter Amstutz [Thu, 30 Jan 2020 18:00:31 +0000 (13:00 -0500)]
Pin bundler to version compatible with all Rubies we support

refs #16015

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoUpdate text to refer to Arvados 2.0
Peter Amstutz [Thu, 30 Jan 2020 15:50:38 +0000 (10:50 -0500)]
Update text to refer to Arvados 2.0

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago15954: Add workbench1.
Tom Clegg [Wed, 29 Jan 2020 15:18:18 +0000 (10:18 -0500)]
15954: Add workbench1.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15954: Refactor for better API.
Tom Clegg [Wed, 29 Jan 2020 15:12:09 +0000 (10:12 -0500)]
15954: Refactor for better API.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '15902-slow-query'
Lucas Di Pentima [Tue, 28 Jan 2020 22:06:50 +0000 (19:06 -0300)]
Merge branch '15902-slow-query'

Closes #15902

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago15902: Adjust order to avoid poorly optimized query.
Tom Clegg [Tue, 28 Jan 2020 20:05:02 +0000 (15:05 -0500)]
15902: Adjust order to avoid poorly optimized query.

When many requesting_container_uuid values are passed in this query,
the default order (["modified_at desc", "uuid"]) sometimes causes
PostgreSQL to begin with the timestamp index, which results in a slow
query. The requesting_container_uuid index makes the query much
faster.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15954: Fix missing return.
Tom Clegg [Tue, 28 Jan 2020 19:35:47 +0000 (14:35 -0500)]
15954: Fix missing return.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoMerge branch '15944-arvbox-publicdev-fix'
Lucas Di Pentima [Tue, 28 Jan 2020 18:51:35 +0000 (15:51 -0300)]
Merge branch '15944-arvbox-publicdev-fix'

Closes #15944

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years ago15954: Avoid modifying caller's global environment.
Tom Clegg [Tue, 28 Jan 2020 16:54:17 +0000 (11:54 -0500)]
15954: Avoid modifying caller's global environment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15954: Write controller URL to stdout when cluster is ready.
Tom Clegg [Tue, 28 Jan 2020 16:03:08 +0000 (11:03 -0500)]
15954: Write controller URL to stdout when cluster is ready.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15954: Add comments.
Tom Clegg [Tue, 28 Jan 2020 15:56:17 +0000 (10:56 -0500)]
15954: Add comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15954: Fix test-mode volume config.
Tom Clegg [Tue, 28 Jan 2020 15:51:55 +0000 (10:51 -0500)]
15954: Fix test-mode volume config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoarvados/jobs image uses python3 for arvados-cwl-runner
Peter Amstutz [Mon, 27 Jan 2020 23:05:23 +0000 (18:05 -0500)]
arvados/jobs image uses python3 for arvados-cwl-runner

This avoids the deprecation warning from cwltool.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago15954: Eliminate intermediate go process.
Tom Clegg [Mon, 27 Jan 2020 21:10:52 +0000 (16:10 -0500)]
15954: Eliminate intermediate go process.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15954: Start websocket and keepstore.
Tom Clegg [Mon, 27 Jan 2020 21:10:22 +0000 (16:10 -0500)]
15954: Start websocket and keepstore.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoAdd python3 build of arvados-cwl-runner
Peter Amstutz [Mon, 27 Jan 2020 18:31:49 +0000 (13:31 -0500)]
Add python3 build of arvados-cwl-runner

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago15954: Add ping check for health aggregator.
Tom Clegg [Mon, 27 Jan 2020 16:39:34 +0000 (11:39 -0500)]
15954: Add ping check for health aggregator.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15954: Don't assign ports for dispatchcloud in test mode.
Tom Clegg [Mon, 27 Jan 2020 15:22:02 +0000 (10:22 -0500)]
15954: Don't assign ports for dispatchcloud in test mode.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15954: Fix wrong token expected at keepproxy health check endpoint.
Tom Clegg [Mon, 27 Jan 2020 15:21:06 +0000 (10:21 -0500)]
15954: Fix wrong token expected at keepproxy health check endpoint.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15954: Add health/proxy/dav services.
Tom Clegg [Fri, 24 Jan 2020 20:28:28 +0000 (15:28 -0500)]
15954: Add health/proxy/dav services.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15954: Use test suite secrets in test config.
Tom Clegg [Mon, 27 Jan 2020 15:10:31 +0000 (10:10 -0500)]
15954: Use test suite secrets in test config.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15944: Takes arvbox container's default gw IP as internal client.
Lucas Di Pentima [Fri, 24 Jan 2020 22:22:06 +0000 (19:22 -0300)]
15944: Takes arvbox container's default gw IP as internal client.

This makes Keep work on 'publicdev' mode.
Also, turns off nginx's response caching for easier debugging.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas@di-pentima.com.ar>

4 years agoAdd a bit more discussion about DNS on compute node images closes #16085
Peter Amstutz [Fri, 24 Jan 2020 20:22:48 +0000 (15:22 -0500)]
Add a bit more discussion about DNS on compute node images closes #16085

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago15954: Remove unused cmdArgs.
Tom Clegg [Fri, 24 Jan 2020 20:07:32 +0000 (15:07 -0500)]
15954: Remove unused cmdArgs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15954: Fix process start/stop race.
Tom Clegg [Fri, 24 Jan 2020 20:06:29 +0000 (15:06 -0500)]
15954: Fix process start/stop race.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15954: Run dispatchcloud and keepproxy.
Tom Clegg [Fri, 24 Jan 2020 19:45:35 +0000 (14:45 -0500)]
15954: Run dispatchcloud and keepproxy.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15954: Try harder to shut down children before exiting.
Tom Clegg [Fri, 24 Jan 2020 19:02:00 +0000 (14:02 -0500)]
15954: Try harder to shut down children before exiting.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15954: boot RailsAPI and controller.
Tom Clegg [Fri, 24 Jan 2020 18:37:07 +0000 (13:37 -0500)]
15954: boot RailsAPI and controller.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoUse updated run_upload_packages
Peter Amstutz [Fri, 24 Jan 2020 16:36:30 +0000 (11:36 -0500)]
Use updated run_upload_packages

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago15944: Merge branch 'master' into 15944-arvbox-publicdev-fix
Lucas Di Pentima [Fri, 24 Jan 2020 14:41:05 +0000 (11:41 -0300)]
15944: Merge branch 'master' into 15944-arvbox-publicdev-fix

4 years agoFix setting workflow label field from record name fixes #16083
Peter Amstutz [Thu, 23 Jan 2020 22:09:59 +0000 (17:09 -0500)]
Fix setting workflow label field from record name fixes #16083

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoRestore bootstrap.min.js refs #16081
Peter Amstutz [Thu, 23 Jan 2020 21:29:25 +0000 (16:29 -0500)]
Restore bootstrap.min.js refs #16081

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '16072-acr-default-image' closes #16072
Peter Amstutz [Thu, 23 Jan 2020 21:06:30 +0000 (16:06 -0500)]
Merge branch '16072-acr-default-image' closes #16072

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16072: Default image is runner image version, not latest
Peter Amstutz [Thu, 23 Jan 2020 16:54:42 +0000 (11:54 -0500)]
16072: Default image is runner image version, not latest

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoImprove the version assignment script to handle more cases
Peter Amstutz [Thu, 23 Jan 2020 18:51:02 +0000 (13:51 -0500)]
Improve the version assignment script to handle more cases

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoFix test refs #16051
Peter Amstutz [Wed, 22 Jan 2020 17:23:07 +0000 (12:23 -0500)]
Fix test refs #16051

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoAllow user 'setup' to succeed even if email notification fails
Peter Amstutz [Tue, 21 Jan 2020 20:07:50 +0000 (15:07 -0500)]
Allow user 'setup' to succeed even if email notification fails

fixes #16051

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoFUSE also needs version from latest(sdk, fuse)
Peter Amstutz [Tue, 21 Jan 2020 19:18:25 +0000 (14:18 -0500)]
FUSE also needs version from latest(sdk, fuse)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoPin signet <= 0.11 to support Ruby 2.3
Peter Amstutz [Sat, 18 Jan 2020 21:54:15 +0000 (16:54 -0500)]
Pin signet <= 0.11 to support Ruby 2.3

refs #16045

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoSupport OS packaging of Ruby/bunder (fix login-sync)
Peter Amstutz [Sat, 18 Jan 2020 02:30:00 +0000 (21:30 -0500)]
Support OS packaging of Ruby/bunder (fix login-sync)

refs #16045

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoArvbox uses OS package for Ruby instead of building from source
Peter Amstutz [Sat, 18 Jan 2020 00:34:16 +0000 (19:34 -0500)]
Arvbox uses OS package for Ruby instead of building from source

refs #16045

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoSupport OS packaging of Ruby/bunder, with note in install docs
Peter Amstutz [Sat, 18 Jan 2020 00:32:58 +0000 (19:32 -0500)]
Support OS packaging of Ruby/bunder, with note in install docs

refs #16045

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago"last supported version" should be release version not git commit
Peter Amstutz [Fri, 17 Jan 2020 20:15:02 +0000 (15:15 -0500)]
"last supported version" should be release version not git commit

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '16046-keepdocker-slash' closes #16046
Peter Amstutz [Fri, 17 Jan 2020 20:01:28 +0000 (15:01 -0500)]
Merge branch '16046-keepdocker-slash' closes #16046

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago16046: Replace slash with space for "repo/image" collection name
Peter Amstutz [Fri, 17 Jan 2020 19:47:23 +0000 (14:47 -0500)]
16046: Replace slash with space for "repo/image" collection name

Add a property with the original repo/image name so that it is still
findable in search.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoAdd "copy files from a collection to a new collection" to cookbook
Peter Amstutz [Fri, 17 Jan 2020 16:41:01 +0000 (11:41 -0500)]
Add "copy files from a collection to a new collection" to cookbook

closes #16044

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoLogSecondsBetweenEvents should be a duration
Peter Amstutz [Fri, 17 Jan 2020 16:04:34 +0000 (11:04 -0500)]
LogSecondsBetweenEvents should be a duration

refs #16014

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoAdjust default for LogSecondsBetweenEvents from 1s to 5s
Peter Amstutz [Fri, 17 Jan 2020 15:39:31 +0000 (10:39 -0500)]
Adjust default for LogSecondsBetweenEvents from 1s to 5s

Because logging every 1s is known to overwhelm the API server at even
moderate loads.

closes #16014

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '15836-slash-in-collection-name'
Tom Clegg [Thu, 16 Jan 2020 21:07:00 +0000 (16:07 -0500)]
Merge branch '15836-slash-in-collection-name'

fixes #15836

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoRestore behavior to choose version from latest of python sdk or cwl
Peter Amstutz [Thu, 16 Jan 2020 19:49:49 +0000 (14:49 -0500)]
Restore behavior to choose version from latest of python sdk or cwl

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago15836: Mention forward slash substitution options in upgrade notes.
Tom Clegg [Thu, 16 Jan 2020 19:24:35 +0000 (14:24 -0500)]
15836: Mention forward slash substitution options in upgrade notes.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoDoc updates for install Ruby and Python SDKs and utilities
Peter Amstutz [Thu, 16 Jan 2020 17:34:28 +0000 (12:34 -0500)]
Doc updates for install Ruby and Python SDKs and utilities

closes #16000
closes #16001

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years ago15836: Use proper URL encoding in test case.
Tom Clegg [Thu, 16 Jan 2020 17:12:51 +0000 (12:12 -0500)]
15836: Use proper URL encoding in test case.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15836: Update wording in config comments.
Tom Clegg [Thu, 16 Jan 2020 17:01:53 +0000 (12:01 -0500)]
15836: Update wording in config comments.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years ago15836: Merge branch 'master'
Tom Clegg [Thu, 16 Jan 2020 16:59:39 +0000 (11:59 -0500)]
15836: Merge branch 'master'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoFix assertVersionOutput to handle '.dev' versions
Peter Amstutz [Thu, 16 Jan 2020 16:52:43 +0000 (11:52 -0500)]
Fix assertVersionOutput to handle '.dev' versions

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoversion-at-commit.sh uses '.dev' instead of '.pre'
Peter Amstutz [Thu, 16 Jan 2020 15:40:08 +0000 (10:40 -0500)]
version-at-commit.sh uses '.dev' instead of '.pre'

Makes Python happy -- setuptools allows '.dev' in the version, but
normalizes '.pre' into '.rc' which actually changes the package
filename.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoFix assertVersionOutput to handle 'pre' versions
Peter Amstutz [Thu, 16 Jan 2020 02:53:05 +0000 (21:53 -0500)]
Fix assertVersionOutput to handle 'pre' versions

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoUpdate python packages to use version_at_commit script
Peter Amstutz [Wed, 15 Jan 2020 20:26:54 +0000 (15:26 -0500)]
Update python packages to use version_at_commit script

Update test images to use Bundler 2.0.2

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoUpdate git commit pin for arvados gem (workbench this time)
Peter Amstutz [Wed, 15 Jan 2020 18:24:02 +0000 (13:24 -0500)]
Update git commit pin for arvados gem (workbench this time)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoUpdate git commit pin for arvados gem
Peter Amstutz [Wed, 15 Jan 2020 18:19:58 +0000 (13:19 -0500)]
Update git commit pin for arvados gem

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoMerge branch '15823-dispatchcloud-api-docs'
Tom Clegg [Wed, 15 Jan 2020 15:04:19 +0000 (10:04 -0500)]
Merge branch '15823-dispatchcloud-api-docs'

closes #15823

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoUpdate version number script to work with git 2.1.4.
Tom Clegg [Fri, 3 Jan 2020 20:24:08 +0000 (15:24 -0500)]
Update version number script to work with git 2.1.4.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@tomclegg.ca>

4 years agoUpdate docker repo, pin bundler to workaround bug
Peter Amstutz [Wed, 15 Jan 2020 03:05:13 +0000 (22:05 -0500)]
Update docker repo, pin bundler to workaround bug

refs #16010

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoFix glob typo to arvados.gemspec
Peter Amstutz [Tue, 14 Jan 2020 21:55:49 +0000 (16:55 -0500)]
Fix glob typo to arvados.gemspec

refs #16010

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoUpdate workbench and login-sync Gemfile.Lock
Peter Amstutz [Tue, 14 Jan 2020 21:35:39 +0000 (16:35 -0500)]
Update workbench and login-sync Gemfile.Lock

refs #16010

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

4 years agoClean up Gemfile & Gemfile.lock
Peter Amstutz [Tue, 14 Jan 2020 20:43:08 +0000 (15:43 -0500)]
Clean up Gemfile & Gemfile.lock

refs #16010

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>