21840: Fix glob to find wheels

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

Fix internal hyperlink

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Scrub more references to CentOS from docs

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Add same note about CentOS 7 to list of supported linux.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Switch CentOS 7 note around to say the relevant part first.

refs #21947

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Add 2.7.4 to upgrading & add notes about dropping CentOS 7

refs #21947

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch 'jszlenk/create_new_subproject' refs #21937

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21697-slow-client-blocking'

fixes #21697

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

21934: Avoid using subprocess.run capture_output for Py3.6 compatibility

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

21934: Avoid contextlib.nullcontext for Py3.6 compatibility

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

21934: Use older name of ssl.CertificateError

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

21934: Set explicit cache_max in test_disk_cache_retry_write_error

Without this, the test might fail if /tmp is small and the initially
calculated cache_max is already at the floor.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

21934: Use assertGreater

To improve diagnostics if the test fails.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

21934: Autospec mmap mocks

So attribute checks get the right result.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

21840: Add wheels to the Jenkins Python package build

We were previously doing this in run_upload_packages. Now that that tool
is doing pure uploads with twine, we need to build the wheels in Jenkins
instead.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

Fix 2.7.3 release date.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Turns out madvise isn't in Python 3.7

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Pin pydot version to fix version conflict with pyparsing

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

21394: Emit conformance badges json from test_with_arvbox

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

21394: use /opt/arvados-py if present

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

21394: Use v1.2.1 tag for CWL conformance tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

21394: Adjust how tags are pushed in build/run-build-docker-images.sh

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Adjust lxml version constraint so arvbox will build.

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Maintain centos7 support for one more release, refs #21780

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Add 2.7.3 to upgrading notes refs #21780

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21718-memoryview-readfrom-v2'  refs #21718

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21696-slow-propfind'

fixes #21696

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

Merge branch '21692-go-packages-no-build-id'

Refs #21692. Closes #21694.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

Fix 2.7.2 release date on upgrading notes, refs #21463

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Tweak test to maintain JDK 8 support for the time being, no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

21639: Reenable prefetch, but not on every read()

Only do prefetch every 128 invocations of read().

This should dramatically reduce the overhead of computing prefetch
while still getting some or moste of the benefits of prefetching.

Indeed, benchmarking suggests that this prefetching strategy, by
advising the kernel to map blocks into RAM, may actually improve
throughput on the high end.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21639-keep-cache-dict' refs #21639

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2.7 doesn't log "not running worker" so don't test for it, refs #21598

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21541-arv-mount-keyerror-rebase' refs #21541

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21504-arv-mount-reference'

Refs #21504.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

Merge branch '21598-local-keepstore-emptytrash'

fixes #21598

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

Merge branch '21613-fed-token-exp-2.7' into 2.7-staging

fixes #21613

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

21613: Fix handling of expired token re-validating with new UUID.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

Fix merge conflict in test case.

Disk cache cannot be disabled here because it does not exist yet in
2.7.

refs #21617

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

Merge branch '21636-s3-token-expiry-2.7' into 2.7-staging

refs #21636

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

21636: Increase ExpiryWindow and add doc reference.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

21636: Return 500 instead of 404 for unexpected volume errors.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

21636: Set ExpiryWindow to avoid credential expiry races.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

Merge branch '21617-fed-content'

fixes #21617
fixes #21533

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

Add upgrading note about MaxRunTimeOverhead and MaxRunTimeDefault

refs #21463

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21449-lsf-maxruntime'

closes #21449

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

21461: Updates arvados-server install to nodejs 14

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

Use bundlerversion in ruby install recipe, refs #21463

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Install version of bundler compatible with Ruby 2.7, refs #21463

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Also fix dotenv on ubuntu 18.04 refs #21501

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21603-ec2-subnet-error'

fixes #21603

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

Also pin dotenv on Debian 10 and CentOS 7

refs #21501

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21501-pin-dotenv'

Closes #21501.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

Merge branch '21321-cran-mirror'

Refs #21321.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

Merge branch '21552-ebs-autoscale-update'. Closes #21552

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

Merge branch '21552-force-imdsv2'

refs #21552
closes #21565

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

Merge branch '21416-email-options-doc' refs #21416

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21452-fuse-filters'

Closes #21452.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

Merge branch 'github-pr-223'

Closes #21432.
<https://github.com/arvados/arvados/pull/223>

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

Merge branch 'github-pr-224'

<https://github.com/arvados/arvados/pull/224>
Closes #21457.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

Merge branch '21304-user-update' refs #21304

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21216-multiplier-typo-fix' refs #21216

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21417-keepdocker-oci-layout'

Closes #21417.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

Merge branch '21429-remember-docker-state'

Closes #21429.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

Merge branch '21379-user-activity-remote-collection'

fixes #21379

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

Add arvbox check for fs.inotify.max_user_watches, refs #21349

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21036-keep-balance-metrics'

fixes #21036

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

Merge branch '21285-max-gw-tunnels'

refs #21285

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

Merge branch '21290-sync-past-versions' refs #21290

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21059-signup-email' refs #21059

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21206-ws-requesting-container-uuid'

closes #21206

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

Copyedit scoped token creation example

* Mark up user input
* Use zzzzz cluster id

No issue #.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

Use full paths for API documentation links

Most of the cross-reference links in our documentation point to a
specific page. These links are unusual in that they point to a
directory. Lately the linkchecker has been intermittently complaining
about them:

  URL        `file:///tmp/workspace/developer-run-tests-doc-and-sdk-R/doc/.site/api'
  Name       `API documentation'
  Parent URL file:///tmp/workspace/developer-run-tests-doc-and-sdk-R/doc/.site/admin/scoped-tokens.html, line 306, col 576
  Real URL   file:///tmp/workspace/developer-run-tests-doc-and-sdk-R/doc/.site/api/
  Warning    [file-missing-slash] Added trailing slash to
             directory.
  Result     Valid: directory

This causes a test failure. Spell out the rest of the link to prevent
that. No issue #.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

Merge branch '21309-x-crypto-upgrade'. Closes #21309

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

Merge branch '21214-dav-virtual-projects'

fixes #21214

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

Merge branch '21283-callable-api-module'

Closes #21283.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

Merge branch '21277-github-pr-221'

Closes #21277.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

Merge branch '21219-java-sdk-pr-220'

Closes #21219.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

20846: Avoid deadlock in unmount-and-replace race.

refs #20846

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

21301: Tag 2.7.2+ SDK and CLI gems as incompatible with Ruby 3.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

Fix misspelled configuration in doc AllowTrashWhileReadOnly -> AllowTrashWhenReadOnly

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21305-doc-maintenance' refs #21305

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Fix release date of 2.7.1, refs #21089

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21206-ws-requesting-container-uuid'

refs #21206

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

arvbox fixes, refs #21089

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Fix docker build for supported distros

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Try this way of checking out correct branch instead

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Fix branch checkout in debian11, refs #21089

Going to test and see if this works, if so it probably needs to be
applied to all the build Dockerfiles.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

21028: Build Ruby from source on rocky8

Same rationale as fe8da34676be7c6fbb1042fcfcabee19bfa424d0.

Refs #21028.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

21028: Build Ruby from source on rocky8

Without this, RVM downloads a binary Ruby with a bunch of configuration
options turned on. This can lead to problems building extensions when
Ruby thinks a certain feature is supported but our Docker image doesn't
have the headers to support it. Right now we're seeing that in the zlib
gem: it has extra code to turn on when Ruby supports Valgrind, but we
don't have the Valgrind headers necessary to build that code.

Closes #21028.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>

Update upgrading notes, refs #21089

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21227-keep-web-panic'

fixes #21227

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

Merge branch '21223-arv-mount-nofile' refs #21223

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21160-user-activation' refs #21160

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '21262-dependency-upgrades'. Closes #21262

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

Merge branch '21217-invalid-auth-header'

refs #21217

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

Merge branch '21205-ensure-unique' refs #21205

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Close span

refs #20937

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Remove duplicated ~$

refs #20937

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

Merge branch '19821-collection-docstrings'

Closes #19821.

Arvados-DCO-1.1-Signed-off-by: Brett Smith <brett.smith@curii.com>