arvados.git
2 years ago19215: Adjusts the documentation to reflect recent changes. 19215-installer
Lucas Di Pentima [Mon, 5 Dec 2022 18:24:32 +0000 (19:24 +0100)]
19215: Adjusts the documentation to reflect recent changes.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19215: Properly outputs LE's secret access key.
Lucas Di Pentima [Mon, 5 Dec 2022 18:05:09 +0000 (19:05 +0100)]
19215: Properly outputs LE's secret access key.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19215: Fixes one remaining IP related variable.
Lucas Di Pentima [Fri, 2 Dec 2022 22:58:07 +0000 (19:58 -0300)]
19215: Fixes one remaining IP related variable.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19215: Adds private subnet & NAT gateway for compute nodes.
Lucas Di Pentima [Fri, 2 Dec 2022 22:54:22 +0000 (19:54 -0300)]
19215: Adds private subnet & NAT gateway for compute nodes.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19215: Add -o pipefail to installer.sh
Peter Amstutz [Fri, 2 Dec 2022 17:11:09 +0000 (12:11 -0500)]
19215: Add -o pipefail to installer.sh

This avoids having "| tee" suppress errors that should have caused the
script to stop.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Fix *_INT_IP defaults and Terraform CLI install text.
Peter Amstutz [Thu, 1 Dec 2022 22:37:28 +0000 (17:37 -0500)]
19215: Fix *_INT_IP defaults and Terraform CLI install text.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Move the note about installing Terraform CLI
Peter Amstutz [Thu, 1 Dec 2022 16:40:30 +0000 (11:40 -0500)]
19215: Move the note about installing Terraform CLI

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: A few tweaks about setting up compute image.
Peter Amstutz [Thu, 1 Dec 2022 16:15:52 +0000 (11:15 -0500)]
19215: A few tweaks about setting up compute image.

Make packer script create a log file.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: More documentation details
Peter Amstutz [Wed, 30 Nov 2022 22:13:04 +0000 (17:13 -0500)]
19215: More documentation details

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Polishing install process
Peter Amstutz [Wed, 30 Nov 2022 21:25:00 +0000 (16:25 -0500)]
19215: Polishing install process

* Coordinate terraform using installer.sh
* Doc updates (WIP)

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Adds region_name as output.
Lucas Di Pentima [Wed, 30 Nov 2022 15:00:18 +0000 (12:00 -0300)]
19215: Adds region_name as output.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19215: Adds hardcoded deploy_user output set to "admin".
Lucas Di Pentima [Mon, 28 Nov 2022 21:33:21 +0000 (18:33 -0300)]
19215: Adds hardcoded deploy_user output set to "admin".

Debian AMIs have their default non-root user set to "admin", so admins will
need to set up the local.params DEPLOY_USER var accordingly.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19215: Fixes IAM policy example for Keepstore S3 access.
Lucas Di Pentima [Mon, 28 Nov 2022 14:58:33 +0000 (11:58 -0300)]
19215: Fixes IAM policy example for Keepstore S3 access.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19215: Sets up the provision.sh script to use our own postgres formula fork.
Lucas Di Pentima [Mon, 28 Nov 2022 14:53:07 +0000 (11:53 -0300)]
19215: Sets up the provision.sh script to use our own postgres formula fork.

This is a temporary measure until it gets properly fixed. See:
https://github.com/saltstack-formulas/postgres-formula/issues/327

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19215: Adds documentation on Terraform code.
Lucas Di Pentima [Mon, 28 Nov 2022 14:39:49 +0000 (11:39 -0300)]
19215: Adds documentation on Terraform code.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19215: Adds initial version of terraform code for multi-host deploy in AWS.
Lucas Di Pentima [Wed, 23 Nov 2022 01:29:27 +0000 (22:29 -0300)]
19215: Adds initial version of terraform code for multi-host deploy in AWS.

It's separated in 3 sections: vpc, data-storage & services. This is to limit
the 'blast radius' of a potential error when applying changes, as recommended
in many places.
Each state should be applied in the order described above, and their outputs
feed the following states with important data.
The shared 'terraform.tfvars' file allows the operator to customize their
deployment.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19215: Fixes IAM policy example.
Lucas Di Pentima [Thu, 10 Nov 2022 21:48:07 +0000 (18:48 -0300)]
19215: Fixes IAM policy example.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19215: Fixes installer script by honoring the DEPLOY_USER var when ssh-ing.
Lucas Di Pentima [Tue, 8 Nov 2022 14:08:23 +0000 (11:08 -0300)]
19215: Fixes installer script by honoring the DEPLOY_USER var when ssh-ing.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19215: Fixes small typo.
Lucas Di Pentima [Mon, 24 Oct 2022 13:31:25 +0000 (10:31 -0300)]
19215: Fixes small typo.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19215: Fixes some typos.
Lucas Di Pentima [Fri, 21 Oct 2022 18:26:46 +0000 (15:26 -0300)]
19215: Fixes some typos.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19215: Fixes webshell nginx config.
Lucas Di Pentima [Thu, 20 Oct 2022 17:05:12 +0000 (14:05 -0300)]
19215: Fixes webshell nginx config.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19215: Uses controller's port when running diagnostics
Lucas Di Pentima [Tue, 18 Oct 2022 17:43:05 +0000 (14:43 -0300)]
19215: Uses controller's port when running diagnostics

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19215: Formatting fixes
Peter Amstutz [Mon, 17 Oct 2022 20:12:15 +0000 (16:12 -0400)]
19215: Formatting fixes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Fix note about location of keep blocks.
Peter Amstutz [Mon, 17 Oct 2022 19:58:18 +0000 (15:58 -0400)]
19215: Fix note about location of keep blocks.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Fix state creating /var/lib/aravdos/keep
Peter Amstutz [Mon, 17 Oct 2022 19:48:10 +0000 (15:48 -0400)]
19215: Fix state creating /var/lib/aravdos/keep

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Review fixes
Peter Amstutz [Mon, 17 Oct 2022 19:34:25 +0000 (15:34 -0400)]
19215: Review fixes

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Small fixes on the deploy phase.
Lucas Di Pentima [Wed, 5 Oct 2022 19:41:24 +0000 (16:41 -0300)]
19215: Small fixes on the deploy phase.

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19215: Add note that the single-host install isn't usable inside Docker
Peter Amstutz [Fri, 30 Sep 2022 21:27:47 +0000 (17:27 -0400)]
19215: Add note that the single-host install isn't usable inside Docker

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Explicitly use bash for bash-ism in snakeoil state
Peter Amstutz [Fri, 30 Sep 2022 21:16:43 +0000 (17:16 -0400)]
19215: Explicitly use bash for bash-ism in snakeoil state

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Making installer.sh work for single node
Peter Amstutz [Fri, 30 Sep 2022 20:49:08 +0000 (16:49 -0400)]
19215: Making installer.sh work for single node

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Check for git and ip tools
Peter Amstutz [Fri, 30 Sep 2022 20:20:57 +0000 (16:20 -0400)]
19215: Check for git and ip tools

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Tweak a few things from initial testing
Peter Amstutz [Fri, 30 Sep 2022 20:04:26 +0000 (16:04 -0400)]
19215: Tweak a few things from initial testing

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Make it clearer DNS only required for multi-hostname
Peter Amstutz [Fri, 30 Sep 2022 19:07:11 +0000 (15:07 -0400)]
19215: Make it clearer DNS only required for multi-hostname

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Make recommendations about disk space usage
Peter Amstutz [Fri, 30 Sep 2022 17:47:15 +0000 (13:47 -0400)]
19215: Make recommendations about disk space usage

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: store keep blocks in /var/lib/arvados/keep instead of /tmp
Peter Amstutz [Fri, 30 Sep 2022 17:29:09 +0000 (13:29 -0400)]
19215: store keep blocks in /var/lib/arvados/keep instead of /tmp

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Make it so the manual install docs recommend using diagnostics.
Peter Amstutz [Fri, 30 Sep 2022 15:28:12 +0000 (11:28 -0400)]
19215: Make it so the manual install docs recommend using diagnostics.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Comment out composer doc
Peter Amstutz [Fri, 30 Sep 2022 04:49:36 +0000 (00:49 -0400)]
19215: Comment out composer doc

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Comment out out-of-date doc
Peter Amstutz [Fri, 30 Sep 2022 04:48:43 +0000 (00:48 -0400)]
19215: Comment out out-of-date doc

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Add install page mentioning diagnostics tool.
Peter Amstutz [Fri, 30 Sep 2022 04:46:34 +0000 (00:46 -0400)]
19215: Add install page mentioning diagnostics tool.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Update single host install page
Peter Amstutz [Fri, 30 Sep 2022 04:18:01 +0000 (00:18 -0400)]
19215: Update single host install page

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Much installer documentation and reorganization
Peter Amstutz [Thu, 29 Sep 2022 21:05:49 +0000 (17:05 -0400)]
19215: Much installer documentation and reorganization

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Lots more edits
Peter Amstutz [Fri, 23 Sep 2022 22:10:27 +0000 (18:10 -0400)]
19215: Lots more edits

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Install doc update work in progress checkpoint
Peter Amstutz [Fri, 23 Sep 2022 19:34:32 +0000 (15:34 -0400)]
19215: Install doc update work in progress checkpoint

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19215: Incorporate many details into install doc
Peter Amstutz [Thu, 18 Aug 2022 22:04:23 +0000 (18:04 -0400)]
19215: Incorporate many details into install doc

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoAdd upgrade notes for 2.4.3
Peter Amstutz [Wed, 21 Sep 2022 21:09:02 +0000 (17:09 -0400)]
Add upgrade notes for 2.4.3

refs #19532

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '19362-s3-webdav-sync'
Tom Clegg [Thu, 22 Sep 2022 17:20:26 +0000 (13:20 -0400)]
Merge branch '19362-s3-webdav-sync'

fixes #19362

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Cleanup/comment locking. 19362-s3-webdav-sync
Tom Clegg [Thu, 22 Sep 2022 15:16:38 +0000 (11:16 -0400)]
19362: Cleanup/comment locking.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoImprove getting git branch and git describe refs #19464
Peter Amstutz [Wed, 21 Sep 2022 18:25:12 +0000 (14:25 -0400)]
Improve getting git branch and git describe refs #19464

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19362: Update size test.
Tom Clegg [Wed, 21 Sep 2022 13:28:52 +0000 (09:28 -0400)]
19362: Update size test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Fix unchecked error.
Tom Clegg [Tue, 20 Sep 2022 20:45:22 +0000 (16:45 -0400)]
19362: Fix unchecked error.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Fix error when GetCollection arg is neither UUID nor PDH.
Tom Clegg [Thu, 15 Sep 2022 20:24:18 +0000 (16:24 -0400)]
19362: Fix error when GetCollection arg is neither UUID nor PDH.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Sync s3 updates to long-lived session for same token.
Tom Clegg [Thu, 15 Sep 2022 20:24:15 +0000 (16:24 -0400)]
19362: Sync s3 updates to long-lived session for same token.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Use hardlinks to a singleton for each project/collection.
Tom Clegg [Wed, 14 Sep 2022 18:03:48 +0000 (14:03 -0400)]
19362: Use hardlinks to a singleton for each project/collection.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19362-all-webdav-via-sitefs'
Tom Clegg [Tue, 20 Sep 2022 20:09:01 +0000 (16:09 -0400)]
Merge branch '19362-all-webdav-via-sitefs'

refs #19362

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19428: Fix failing request on normal failed user lookup case.
Tom Clegg [Tue, 20 Sep 2022 17:44:12 +0000 (13:44 -0400)]
19428: Fix failing request on normal failed user lookup case.

refs #19428

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Update API docs. 19362-all-webdav-via-sitefs
Tom Clegg [Tue, 20 Sep 2022 13:56:33 +0000 (09:56 -0400)]
19362: Update API docs.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Remove obsolete config entries.
Tom Clegg [Tue, 20 Sep 2022 13:54:11 +0000 (09:54 -0400)]
19362: Remove obsolete config entries.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Add release note about changed metrics.
Tom Clegg [Mon, 19 Sep 2022 19:15:39 +0000 (15:15 -0400)]
19362: Add release note about changed metrics.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Update comment.
Tom Clegg [Mon, 19 Sep 2022 19:15:25 +0000 (15:15 -0400)]
19362: Update comment.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19428-webdav-performance'
Tom Clegg [Mon, 19 Sep 2022 18:03:00 +0000 (14:03 -0400)]
Merge branch '19428-webdav-performance'

refs #19428

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19518-pam-access-check'
Tom Clegg [Fri, 16 Sep 2022 20:01:14 +0000 (16:01 -0400)]
Merge branch '19518-pam-access-check'

fixes #19518

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19437-docker-watchdog'
Tom Clegg [Fri, 16 Sep 2022 15:07:19 +0000 (11:07 -0400)]
Merge branch '19437-docker-watchdog'

fixes #19437

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoUpdate schema-salad dependency for filecache fix
Peter Amstutz [Thu, 15 Sep 2022 21:42:20 +0000 (17:42 -0400)]
Update schema-salad dependency for filecache fix

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '19472-installer-logrotate'. Closes #19472
Lucas Di Pentima [Fri, 16 Sep 2022 13:39:57 +0000 (10:39 -0300)]
Merge branch '19472-installer-logrotate'. Closes #19472

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19518: Check account access permission during pam auth. 19518-pam-access-check
Tom Clegg [Fri, 16 Sep 2022 02:17:15 +0000 (22:17 -0400)]
19518: Check account access permission during pam auth.

Also fix test.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19472-logrotate' into 2.4-release 19472-installer-logrotate
Lucas Di Pentima [Mon, 12 Sep 2022 17:50:19 +0000 (14:50 -0300)]
Merge branch '19472-logrotate' into 2.4-release
Refs #19472

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years ago19472: Syncs salt installer's main branch with commit 1e0108e1a
Lucas Di Pentima [Thu, 15 Sep 2022 20:52:31 +0000 (17:52 -0300)]
19472: Syncs salt installer's main branch with commit 1e0108e1a

Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <lucas.dipentima@curii.com>

2 years agoMerge branch '19179-acct-activity' refs #19179
Peter Amstutz [Thu, 15 Sep 2022 15:09:38 +0000 (11:09 -0400)]
Merge branch '19179-acct-activity' refs #19179

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoSet "GITTARGET=.arvados-deploy-config-cluster" so it is hidden
Peter Amstutz [Mon, 12 Sep 2022 20:03:10 +0000 (16:03 -0400)]
Set "GITTARGET=.arvados-deploy-config-cluster" so it is hidden

This is because it's easy to confuse with the origin directory
"setup-arvados-cluster".

no issue #

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19362: Fix version in status response.
Tom Clegg [Mon, 12 Sep 2022 20:32:24 +0000 (16:32 -0400)]
19362: Fix version in status response.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Remove dead code.
Tom Clegg [Mon, 12 Sep 2022 20:32:12 +0000 (16:32 -0400)]
19362: Remove dead code.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Merge serveSiteFS into main code path.
Tom Clegg [Mon, 12 Sep 2022 20:09:20 +0000 (16:09 -0400)]
19362: Merge serveSiteFS into main code path.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19362: Move non-S3 collection-addressed reqs to sitefs code path.
Tom Clegg [Mon, 12 Sep 2022 18:49:37 +0000 (14:49 -0400)]
19362: Move non-S3 collection-addressed reqs to sitefs code path.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoMerge branch '19464-capture-git-info' refs #19464
Peter Amstutz [Fri, 9 Sep 2022 20:59:27 +0000 (16:59 -0400)]
Merge branch '19464-capture-git-info' refs #19464

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19464: Fix tests 19464-capture-git-info
Peter Amstutz [Fri, 9 Sep 2022 15:11:09 +0000 (11:11 -0400)]
19464: Fix tests

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoTest fixing wip
Peter Amstutz [Fri, 9 Sep 2022 14:30:37 +0000 (10:30 -0400)]
Test fixing wip

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19464: Misspelled items
Peter Amstutz [Thu, 8 Sep 2022 22:42:19 +0000 (18:42 -0400)]
19464: Misspelled items

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19464: Record git info as properties
Peter Amstutz [Thu, 8 Sep 2022 22:37:20 +0000 (18:37 -0400)]
19464: Record git info as properties

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19464: Don't repeat the workflow id
Peter Amstutz [Thu, 8 Sep 2022 21:38:57 +0000 (17:38 -0400)]
19464: Don't repeat the workflow id

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19464: Record the file path in the git repo as well
Peter Amstutz [Thu, 8 Sep 2022 21:34:37 +0000 (17:34 -0400)]
19464: Record the file path in the git repo as well

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19464: Include "git describe" in workflow name
Peter Amstutz [Thu, 8 Sep 2022 21:13:08 +0000 (17:13 -0400)]
19464: Include "git describe" in workflow name

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19464: Fix assignment
Peter Amstutz [Thu, 8 Sep 2022 20:49:35 +0000 (16:49 -0400)]
19464: Fix assignment

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19464: Record & report provenance information from git
Peter Amstutz [Thu, 8 Sep 2022 20:33:38 +0000 (16:33 -0400)]
19464: Record & report provenance information from git

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '19454-cwl-output-json' refs #19454
Peter Amstutz [Thu, 8 Sep 2022 19:05:54 +0000 (15:05 -0400)]
Merge branch '19454-cwl-output-json' refs #19454

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago19454: Update cwltool and schema salad 19454-cwl-output-json
Peter Amstutz [Thu, 8 Sep 2022 17:49:43 +0000 (13:49 -0400)]
19454: Update cwltool and schema salad

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoMerge branch '17344-easy-demo'
Tom Clegg [Thu, 8 Sep 2022 15:05:51 +0000 (11:05 -0400)]
Merge branch '17344-easy-demo'

closes #17344

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Merge branch 'main' 17344-easy-demo
Tom Clegg [Thu, 8 Sep 2022 15:04:51 +0000 (11:04 -0400)]
17344: Merge branch 'main'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Run `ls -l newpkg.deb` on host instead of container.
Tom Clegg [Thu, 8 Sep 2022 14:19:01 +0000 (10:19 -0400)]
17344: Run `ls -l newpkg.deb` on host instead of container.

This way the displayed path reflects the final package location on the
host, rather than the path inside the fpm container where the build
command's tempdir is bind-mounted.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Log when removing stale crunch-run-broken file.
Tom Clegg [Tue, 6 Sep 2022 18:25:36 +0000 (14:25 -0400)]
17344: Log when removing stale crunch-run-broken file.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago17344: Reset "broken node" flag on loopback instance create/reset.
Tom Clegg [Tue, 6 Sep 2022 16:11:12 +0000 (12:11 -0400)]
17344: Reset "broken node" flag on loopback instance create/reset.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19428: Tidy up pruneSessions, avoid calling MemorySize 2x. 19428-webdav-performance
Tom Clegg [Fri, 2 Sep 2022 14:28:52 +0000 (10:28 -0400)]
19428: Tidy up pruneSessions, avoid calling MemorySize 2x.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19437: Don't cancel until 3 consecutive docker-inspect failures. 19437-docker-watchdog
Tom Clegg [Fri, 2 Sep 2022 14:06:03 +0000 (10:06 -0400)]
19437: Don't cancel until 3 consecutive docker-inspect failures.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years agoUse "systemctl disable" instead of "service docker stop" refs #19439
Peter Amstutz [Thu, 1 Sep 2022 20:47:02 +0000 (16:47 -0400)]
Use "systemctl disable" instead of "service docker stop" refs #19439

"service docker stop" stops the daemon but it can be restarted from
prematurely by socket activation.  Whoops!

We need to use "systemctl disable" it so that it doesn't wake up
during the scratch space surgery on the /tmp directory.

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoDon't include the patch any more, refs #19439
Peter Amstutz [Wed, 31 Aug 2022 16:55:51 +0000 (12:55 -0400)]
Don't include the patch any more, refs #19439

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years agoPull our fork of amazon-ebs-autoscale for nvme support, refs #19439
Peter Amstutz [Wed, 31 Aug 2022 15:59:40 +0000 (11:59 -0400)]
Pull our fork of amazon-ebs-autoscale for nvme support, refs #19439

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <peter.amstutz@curii.com>

2 years ago17344: Remove client code setting X-External-Client header.
Tom Clegg [Tue, 30 Aug 2022 15:23:52 +0000 (11:23 -0400)]
17344: Remove client code setting X-External-Client header.

It doesn't do anything: Nginx replaces it with 0 or 1 based on remote
IP address.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19428: Avoid locking entire collection in MemorySize.
Tom Clegg [Tue, 30 Aug 2022 14:35:58 +0000 (10:35 -0400)]
19428: Avoid locking entire collection in MemorySize.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19428: Avoid locking entire filesystem for MemorySize.
Tom Clegg [Mon, 29 Aug 2022 21:01:08 +0000 (17:01 -0400)]
19428: Avoid locking entire filesystem for MemorySize.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19428: Fix unchecked errors.
Tom Clegg [Mon, 29 Aug 2022 21:00:42 +0000 (17:00 -0400)]
19428: Fix unchecked errors.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

2 years ago19428: Fix leading "/" in path, skip the 301 redirect.
Tom Clegg [Mon, 29 Aug 2022 20:59:58 +0000 (16:59 -0400)]
19428: Fix leading "/" in path, skip the 301 redirect.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>