Peter Amstutz [Mon, 20 Sep 2021 20:52:33 +0000 (16:52 -0400)]
Adjust version pins on google-auth and ruamel.yaml
refs #18002
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Mon, 20 Sep 2021 14:22:39 +0000 (10:22 -0400)]
Merge branch '18122-select-param'
closes #18122
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 20 Sep 2021 14:12:05 +0000 (10:12 -0400)]
Merge branch '18051-webdav-cache'
refs #18051
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Lucas Di Pentima [Mon, 20 Sep 2021 13:58:44 +0000 (10:58 -0300)]
Merge branch '18097-sync-groups-case-insensitive' into main. Closes #18097
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Peter Amstutz [Mon, 20 Sep 2021 13:46:35 +0000 (09:46 -0400)]
Revert "Change upper version bound for ruamel.yaml to <0.18"
This reverts commit
1c7420e1ed282e42907b108ce83dc8ce6edef904.
Needs to match cwltool ruamel version spec to avoid breaking arvados-cwl-runner.
refs #18002
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Mon, 20 Sep 2021 13:44:58 +0000 (09:44 -0400)]
18122: Clarify select param behavior in "get collection by pdh" API.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 20 Sep 2021 13:37:53 +0000 (09:37 -0400)]
18122: Add descriptions for select params in discovery doc.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 20 Sep 2021 13:34:35 +0000 (09:34 -0400)]
18122: Fix stutter in docs.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Lucas Di Pentima [Fri, 17 Sep 2021 14:44:11 +0000 (11:44 -0300)]
18097: Adds more tests.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Peter Amstutz [Fri, 17 Sep 2021 13:16:32 +0000 (09:16 -0400)]
Change upper version bound for ruamel.yaml to <0.18
refs #18002
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Lucas Di Pentima [Thu, 16 Sep 2021 22:33:26 +0000 (19:33 -0300)]
18097: Adds logic for the "-case-insensitive" flag. Makes new test pass.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Tom Clegg [Thu, 16 Sep 2021 20:34:57 +0000 (16:34 -0400)]
Merge branch '18051-collectionfs'
refs #18051
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Lucas Di Pentima [Thu, 16 Sep 2021 18:35:09 +0000 (15:35 -0300)]
18097: Accept '-case-insensitive' flag on sync-groups. Adds test.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Ward Vandewege [Thu, 16 Sep 2021 17:47:20 +0000 (13:47 -0400)]
Merge branch '17770-fix-logging-while-throttled'
closes #17770
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>
Tom Clegg [Thu, 16 Sep 2021 17:15:29 +0000 (13:15 -0400)]
18122: Fix "get collection by pdh" when manifest_text is unselected.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 16 Sep 2021 17:11:57 +0000 (13:11 -0400)]
18122: Don't fail on PDH mismatch when manifest_text is missing.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Ward Vandewege [Thu, 16 Sep 2021 16:48:12 +0000 (12:48 -0400)]
17770: while throttled, do not log that instances are being created when
they are not.
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>
Tom Clegg [Thu, 16 Sep 2021 16:09:30 +0000 (12:09 -0400)]
18122: Update test.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 16 Sep 2021 13:54:38 +0000 (09:54 -0400)]
18122: Update "distinct" docs (default is false) and tidy up code.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 16 Sep 2021 13:39:18 +0000 (09:39 -0400)]
18122: Update API docs.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 16 Sep 2021 14:05:08 +0000 (10:05 -0400)]
18051: Remove unused MaxPermissionEntries config.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Thu, 16 Sep 2021 13:35:29 +0000 (09:35 -0400)]
Merge branch '18002-update-python-deps' into main refs #18002
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Thu, 16 Sep 2021 13:34:53 +0000 (09:34 -0400)]
18002: Remove obsolete extras_require for Python 2
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Wed, 15 Sep 2021 20:24:50 +0000 (16:24 -0400)]
18051: Add debug logging for webdav cache.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 15 Sep 2021 19:45:40 +0000 (15:45 -0400)]
18051: Add logging capability to webdav cache.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 15 Sep 2021 07:21:45 +0000 (03:21 -0400)]
18051: Fix premature ejection from WebDAV collection cache.
Avoid multiple concurrent cache sweeps.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 15 Sep 2021 19:44:21 +0000 (15:44 -0400)]
18122: Accept "select" param in get/update/delete calls.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Wed, 15 Sep 2021 19:33:50 +0000 (15:33 -0400)]
18002: Fixes for cwltool update
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Wed, 15 Sep 2021 17:41:02 +0000 (13:41 -0400)]
18002: Updating Python dependencies WIP
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Tue, 14 Sep 2021 20:08:12 +0000 (16:08 -0400)]
Merge branch '14018-acr-set-container-properties' into main
refs #14018
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Lucas Di Pentima [Tue, 14 Sep 2021 14:04:43 +0000 (11:04 -0300)]
Merge branch '18126-unpin-python-rsa' into main. Closes #18126
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Tue, 14 Sep 2021 13:35:52 +0000 (10:35 -0300)]
18126: Unpins python-rsa since python2 support is no longer needed.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Peter Amstutz [Mon, 13 Sep 2021 16:23:37 +0000 (12:23 -0400)]
14018: Add missing file. Remove debug print()
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Mon, 13 Sep 2021 15:47:36 +0000 (11:47 -0400)]
Merge branch '17960-arv-copy-projects-doc' into main refs #17960
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Mon, 13 Sep 2021 15:40:48 +0000 (11:40 -0400)]
Merge branch '18027-boot-probe-command' into main
fixes #18027
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Sat, 11 Sep 2021 17:47:15 +0000 (13:47 -0400)]
18051: Optimizations for collections with millions of files.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Fri, 10 Sep 2021 15:24:52 +0000 (11:24 -0400)]
18051: Speed up manifest parsing with bytes.Split.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Fri, 10 Sep 2021 15:24:26 +0000 (11:24 -0400)]
18051: Add manifest-parsing / fs-building benchmark.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Fri, 10 Sep 2021 21:07:48 +0000 (17:07 -0400)]
17960: Fix example uuid.
Remove legacy current token screenshot.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Fri, 10 Sep 2021 14:27:27 +0000 (10:27 -0400)]
Merge branch '17857-lsf-cpus'
refs #17857
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Fri, 10 Sep 2021 14:25:58 +0000 (10:25 -0400)]
Merge branch '17995-filter-by-comparing-attrs'
closes #17995
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Fri, 10 Sep 2021 14:21:26 +0000 (10:21 -0400)]
Merge branch '18024-no-docker-snap' into main
refs #18024
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Thu, 9 Sep 2021 14:26:47 +0000 (10:26 -0400)]
Releases have default version of arvbox to pull
no issue #
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Tom Clegg [Thu, 9 Sep 2021 18:08:13 +0000 (14:08 -0400)]
Merge branch '18102-max-dispatch-attempts'
fixes #18102
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 9 Sep 2021 18:01:59 +0000 (14:01 -0400)]
18027: Change default boot probe to `systemctl is-system-running`.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 9 Sep 2021 15:35:52 +0000 (11:35 -0400)]
Merge branch '18027-unmount-fuse'
refs #18027
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Thu, 9 Sep 2021 13:24:59 +0000 (09:24 -0400)]
17857: Fix bsub args so containers can use multiple CPU cores.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Wed, 8 Sep 2021 21:32:35 +0000 (17:32 -0400)]
17960: Update arv-copy documentation about copying projects
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Wed, 8 Sep 2021 20:09:00 +0000 (16:09 -0400)]
18024: Add a note about snap packages
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Lucas Di Pentima [Wed, 8 Sep 2021 18:43:27 +0000 (15:43 -0300)]
Merge branch '17989-revert-pysdk-default-timeout' into main. Closes #17989
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Wed, 8 Sep 2021 18:20:06 +0000 (15:20 -0300)]
17989: Reverts default PySDK timeout to 5 minutes. Updates test.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Wed, 8 Sep 2021 13:55:22 +0000 (10:55 -0300)]
Merge branch '17989-pysdk-timeout' into main. Refs #17989
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Tue, 7 Sep 2021 21:19:27 +0000 (18:19 -0300)]
17989: Reduces the manifest size limit so that it doesn't fail on extreme cases
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Tue, 7 Sep 2021 21:11:30 +0000 (18:11 -0300)]
17989: Passes the given timeout value to api_from_config()
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Tue, 7 Sep 2021 21:10:34 +0000 (18:10 -0300)]
17989: Adds test exposing the problem.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Ward Vandewege [Tue, 7 Sep 2021 19:03:44 +0000 (15:03 -0400)]
Merge branch '18112-ubuntu1804-bundler-fix'
closes #18112
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>
Ward Vandewege [Tue, 7 Sep 2021 19:03:21 +0000 (15:03 -0400)]
18112: Merge branch 'main' into 18112-ubuntu1804-bundler-fix
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>
Peter Amstutz [Tue, 7 Sep 2021 18:59:11 +0000 (14:59 -0400)]
14018: Add ProcessProperties to documentation
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Ward Vandewege [Tue, 7 Sep 2021 18:48:42 +0000 (14:48 -0400)]
18112: add a note to the upgrade log.
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>
Peter Amstutz [Tue, 7 Sep 2021 18:45:40 +0000 (14:45 -0400)]
14018: Add arv:ProcessProperties to all the extension schemas.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Ward Vandewege [Tue, 7 Sep 2021 18:06:47 +0000 (14:06 -0400)]
18112: Ubuntu 18.04 comes with bundler version 1.16.1, which doesn't handle our
current Gemfiles properly. Make our Ubuntu 18.04 distribution packages
for arvados-api-server and arvados-workbench conflict with the
ruby-bundler package to work around this issue. Our post-install scripts
install the proper version of bundler.
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>
Tom Clegg [Tue, 7 Sep 2021 17:48:28 +0000 (13:48 -0400)]
Merge branch '18021-sort-mounts'
fixes #18021
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Tue, 7 Sep 2021 14:56:04 +0000 (10:56 -0400)]
18021: Sort mounts to fix flaky test.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Tue, 7 Sep 2021 15:47:30 +0000 (11:47 -0400)]
Merge branch '18078-reacquire-fuse-lock' into main refs #18078
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Lucas Di Pentima [Tue, 7 Sep 2021 14:00:52 +0000 (11:00 -0300)]
Merge branch '18094-update-uuid-endpoint-removal' into main. Closes #18094
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Tue, 7 Sep 2021 13:43:44 +0000 (10:43 -0300)]
Merge branch '18076-user-cache-with-repository' into main. Closes #18076
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Tom Clegg [Mon, 6 Sep 2021 19:48:50 +0000 (15:48 -0400)]
18102: Improve logging.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Mon, 6 Sep 2021 19:48:13 +0000 (15:48 -0400)]
18102: Avoid spamming logs in case of version mismatch.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Tue, 7 Sep 2021 01:51:40 +0000 (21:51 -0400)]
18102: Fix flapping lock/unlock.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Lucas Di Pentima [Mon, 6 Sep 2021 19:41:40 +0000 (16:41 -0300)]
18076: Fixes the bug by assigning a different (and random) username.
If the renamed user does exist on the LoginCluster, it'll eventually be named
correctly, and it is a stale record, it'll get a username that gives the admin
a clue about what happened to it.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Mon, 6 Sep 2021 19:28:42 +0000 (16:28 -0300)]
18076: Expands test case exposing a related issue with users with a repository.
The previous fix set the conflicting user's username to null but this isn't
possible when the user record is linked to a repository.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Tom Clegg [Mon, 6 Sep 2021 18:47:03 +0000 (14:47 -0400)]
18102: Fix double-unlock in scheduler.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Peter Amstutz [Fri, 3 Sep 2021 21:22:14 +0000 (17:22 -0400)]
18078: Fix tests
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Lucas Di Pentima [Fri, 3 Sep 2021 19:04:34 +0000 (16:04 -0300)]
18094: Removes update_uuid from the R SDK.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Ward Vandewege [Fri, 3 Sep 2021 18:43:11 +0000 (14:43 -0400)]
Merge branch '17755-add-singularity-to-compute-image'
closes #17755
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>
Lucas Di Pentima [Fri, 3 Sep 2021 18:39:05 +0000 (15:39 -0300)]
18094: Removes update_uuid code & tests from railsAPI.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Tom Clegg [Fri, 3 Sep 2021 14:29:05 +0000 (10:29 -0400)]
18027: Kill arv-mount directly if arv-mount --unmount cannot run.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Fri, 3 Sep 2021 14:26:36 +0000 (10:26 -0400)]
18027: Fix crash when reporting error during --unmount.
Traceback (most recent call last):
File "/usr/bin/arv-mount", line 10, in <module>
arvados_fuse.command.Mount(args).run()
File "/usr/share/python3/dist/python3-arvados-fuse/lib/python3.7/site-packages/arvados_fuse/command.py", line 172, in run
recursive=self.args.unmount_all)
File "/usr/share/python3/dist/python3-arvados-fuse/lib/python3.7/site-packages/arvados_fuse/unmount.py", line 162, in unmount
sys.stderr.write(fusermount_output)
TypeError: write() argument must be str, not bytes
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Ward Vandewege [Fri, 3 Sep 2021 14:03:20 +0000 (10:03 -0400)]
17755: Merge branch 'main' into 17755-add-singularity-to-compute-image
Arvados-DCO-1.1-Signed-off-by: Ward Vandewege <ward@curii.com>
Lucas Di Pentima [Fri, 3 Sep 2021 00:01:17 +0000 (21:01 -0300)]
18094: Removes update_uuid from GoSDK & controller.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Thu, 2 Sep 2021 20:37:21 +0000 (17:37 -0300)]
18094: Updates documentation, adding an upgrade note.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Thu, 2 Sep 2021 20:07:28 +0000 (17:07 -0300)]
Merge branch '18076-stale-cached-users-handling' into main. Closes #18076
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Thu, 2 Sep 2021 20:06:38 +0000 (17:06 -0300)]
18076: Improves test.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Thu, 2 Sep 2021 18:54:23 +0000 (15:54 -0300)]
18076: Fixes the bug, expands the test with additional checks.
If there's a stale cached user record that's creating the username collision,
set it to nil before retrying the update. There're two scenarios this is
covering:
1. The stale user record belongs to an existing user on LoginCluster. Its
username was taken by other user so the new username is coming in the
batch_update operation -- it's ok to temporarily have it set to nil.
2. The stale user record doesn't exist on LoginCluster anymore, so having
it being reset to nil isn't harmful and avoids future collisions.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Wed, 1 Sep 2021 20:41:01 +0000 (17:41 -0300)]
18076: Adds test exposing the issue.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Peter Amstutz [Thu, 2 Sep 2021 17:51:04 +0000 (13:51 -0400)]
14018: Setting process properties WIP
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Thu, 2 Sep 2021 17:15:52 +0000 (13:15 -0400)]
14018: Setting process properties WIP
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Peter Amstutz [Thu, 2 Sep 2021 15:20:12 +0000 (11:20 -0400)]
18078: Reacquire llfuse lock before populating collection directory
Updates the test for generating "conflict" files.
I don't have a test case for the reported bug, however this is the
only place I could find where _entries was being modified without the
lock held. By reacquiring the lock, it should no longer be possible
to read _entries at the same time as it is being updated.
Also clean up a few "from future" bits that are no longer needed
because we're python 3 only.
Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>
Lucas Di Pentima [Wed, 1 Sep 2021 20:00:45 +0000 (17:00 -0300)]
Merge branch '17696-gosdk-default-storage-class' into main. Closes #17696
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Tom Clegg [Wed, 1 Sep 2021 18:38:40 +0000 (14:38 -0400)]
17995: Fix merge error.
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 1 Sep 2021 18:24:47 +0000 (14:24 -0400)]
17995: Merge branch 'main'
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 1 Sep 2021 18:22:59 +0000 (14:22 -0400)]
17995: Accept boolean expressions as strings without ["...",=,true].
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Wed, 1 Sep 2021 13:18:29 +0000 (09:18 -0400)]
Update test to accept non-empty default BsubArgumentsList.
refs #17857
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Tue, 31 Aug 2021 20:43:17 +0000 (16:43 -0400)]
Update default bsub arguments to save stdout/stderr in /tmp.
refs #17857
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Tom Clegg [Tue, 31 Aug 2021 20:22:09 +0000 (16:22 -0400)]
Fix misleading log message.
refs #17857
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>
Lucas Di Pentima [Mon, 30 Aug 2021 20:19:11 +0000 (17:19 -0300)]
17696: Updates tests to check for backwards compatibility.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Thu, 26 Aug 2021 21:02:01 +0000 (18:02 -0300)]
17696: Moves default storage classes loading to keepclient.New().
Also adds integration test that proves that a collection and its keepclient
use the same default storage classes list.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Mon, 23 Aug 2021 16:08:35 +0000 (13:08 -0300)]
17696: Adds default storage classes config loading to KeepClient, with tests.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Lucas Di Pentima [Fri, 20 Aug 2021 16:09:39 +0000 (13:09 -0300)]
17696: Adds ArvadosClient.ClusterConfig() to get the exported cluster's config.
Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>
Tom Clegg [Mon, 30 Aug 2021 18:02:46 +0000 (14:02 -0400)]
17995: Merge branch 'main'
Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>