lightning.git
7 days agoFix some tests. main
Tom Clegg [Thu, 11 Apr 2024 17:52:27 +0000 (13:52 -0400)]
Fix some tests.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

7 days agoAccept double file extensions (sample-id.1.fa.fa.gz).
Tom Clegg [Thu, 11 Apr 2024 17:08:40 +0000 (13:08 -0400)]
Accept double file extensions (sample-id.1.fa.fa.gz).

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months agoUse new Arvados logs API.
Tom Clegg [Thu, 16 Nov 2023 16:12:59 +0000 (11:12 -0500)]
Use new Arvados logs API.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months agoMerge branch '20765-moving-gvcf-regions'
Alex Coleman [Thu, 9 Nov 2023 17:26:11 +0000 (10:26 -0700)]
Merge branch '20765-moving-gvcf-regions'

refs #20765

Arvados-DCO-1.1-Signed-off-by: Alex Coleman <alex.coleman@curii.com>

5 months agoUpdate Go version.
Tom Clegg [Fri, 3 Nov 2023 18:27:24 +0000 (14:27 -0400)]
Update Go version.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months agoFix python installation.
Tom Clegg [Fri, 3 Nov 2023 18:22:59 +0000 (14:22 -0400)]
Fix python installation.

Previous recipe installed libraries in /usr via debian packages, plus
python3.7 as a dependency, instead of installing libraries that
/usr/local/bin/python (from the python:3.11-buster base image) can
actually use.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months ago21139: Fix offset counter.
Tom Clegg [Fri, 3 Nov 2023 15:23:29 +0000 (11:23 -0400)]
21139: Fix offset counter.

refs #21139

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months ago21139: Reduce lock contention.
Tom Clegg [Fri, 3 Nov 2023 15:04:18 +0000 (11:04 -0400)]
21139: Reduce lock contention.

refs #21139

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months ago21139: Remove excess concurrency to reduce mutex/goroutine overhead.
Tom Clegg [Fri, 3 Nov 2023 14:51:04 +0000 (10:51 -0400)]
21139: Remove excess concurrency to reduce mutex/goroutine overhead.

refs #21139

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months ago21139: Fix mixed-case tile variants.
Tom Clegg [Fri, 3 Nov 2023 14:33:19 +0000 (10:33 -0400)]
21139: Fix mixed-case tile variants.

refs #21139

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months agoMerge branch '21139-import-mem'
Tom Clegg [Fri, 27 Oct 2023 19:02:27 +0000 (15:02 -0400)]
Merge branch '21139-import-mem'

fixes #21139

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months ago21139: Reduce memory usage in tiling. 21139-import-mem
Tom Clegg [Thu, 26 Oct 2023 20:33:37 +0000 (16:33 -0400)]
21139: Reduce memory usage in tiling.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

5 months agoFix glm test.
Tom Clegg [Tue, 24 Oct 2023 17:22:54 +0000 (13:22 -0400)]
Fix glm test.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

7 months agoMerge branch '20645-updating-dockerfiles'
Alex Coleman [Tue, 29 Aug 2023 02:18:29 +0000 (20:18 -0600)]
Merge branch '20645-updating-dockerfiles'
refs #20645
Arvados-DCO-1.1-Signed-off-by: Alex Coleman <alex.coleman@curii.com>

8 months agoMerge branch '20753-fix-missing-columns'
Tom Clegg [Fri, 11 Aug 2023 18:39:20 +0000 (14:39 -0400)]
Merge branch '20753-fix-missing-columns'

fixes #20753

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

8 months ago20765: Adding gvcf regions subdir. 20765-moving-gvcf-regions
Alex Coleman [Fri, 4 Aug 2023 16:32:45 +0000 (10:32 -0600)]
20765: Adding gvcf regions subdir.

Additionally updating Dockerfiles that previously cloned repo.

Arvados-DCO-1.1-Signed-off-by: Alex Coleman <alex.coleman@curii.com>

8 months ago20461: Add -pprof-dir option to slice subcommand.
Tom Clegg [Wed, 2 Aug 2023 17:31:31 +0000 (13:31 -0400)]
20461: Add -pprof-dir option to slice subcommand.

refs #20461

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

8 months ago20645: Updating base images. 20645-updating-dockerfiles
Alex Coleman [Wed, 2 Aug 2023 16:44:37 +0000 (10:44 -0600)]
20645: Updating base images.

Arvados-DCO-1.1-Signed-off-by: Alex Coleman <alex.coleman@curii.com>

8 months ago20753: Fix column offset in full matrix when ref tile did not place. 20753-fix-missing-columns
Tom Clegg [Fri, 21 Jul 2023 18:44:57 +0000 (14:44 -0400)]
20753: Fix column offset in full matrix when ref tile did not place.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

8 months agoUpdating lightning Dockerfile to go from `pip3 install sklearn` -> `pip3 install...
Alex Coleman [Thu, 20 Jul 2023 17:33:47 +0000 (11:33 -0600)]
Updating lightning Dockerfile to go from `pip3 install sklearn` -> `pip3 install scikit-learn`.

Arvados-DCO-1.1-Signed-off-by: Alex Coleman <alex.coleman@curii.com>

9 months agoDefault to applying min-coverage filter based on training set only.
Tom Clegg [Thu, 6 Jul 2023 14:45:07 +0000 (10:45 -0400)]
Default to applying min-coverage filter based on training set only.

refs #20607

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

9 months agoRemove Jiayong as Maintainer, update base images from arvados/jobs -> python:3.8...
Alex Coleman [Fri, 30 Jun 2023 16:56:46 +0000 (10:56 -0600)]
Remove Jiayong as Maintainer, update base images from arvados/jobs -> python:3.8-buster, and update references to Jiayong's gvcf region git repo to Alex's.
Arvados-DCO-1.1-Signed-off-by: Alex Coleman <alex.coleman@curii.com>

9 months agoFix error message.
Tom Clegg [Tue, 27 Jun 2023 15:30:20 +0000 (11:30 -0400)]
Fix error message.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

9 months agoFix wrong array index in PCA mode.
Tom Clegg [Mon, 26 Jun 2023 18:49:08 +0000 (14:49 -0400)]
Fix wrong array index in PCA mode.

refs #20607

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

9 months agoFix missing struct field.
Tom Clegg [Mon, 26 Jun 2023 14:32:03 +0000 (10:32 -0400)]
Fix missing struct field.

refs #19995

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

11 months agoMerge branch '19995-glm-freq-threshold'
Tom Clegg [Fri, 5 May 2023 19:10:32 +0000 (15:10 -0400)]
Merge branch '19995-glm-freq-threshold'

refs #19995
refs #20233

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

12 months ago19995: Add -max-frequency filter. 19995-glm-freq-threshold
Tom Clegg [Thu, 6 Apr 2023 19:53:31 +0000 (15:53 -0400)]
19995: Add -max-frequency filter.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

12 months ago19995: Report MAF in onehot-columns.npy.
Tom Clegg [Wed, 29 Mar 2023 20:29:19 +0000 (16:29 -0400)]
19995: Report MAF in onehot-columns.npy.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

12 months ago19995: Use allele frequency, apply min freq cutoff to Χ² pvalue too.
Tom Clegg [Wed, 29 Mar 2023 15:56:42 +0000 (11:56 -0400)]
19995: Use allele frequency, apply min freq cutoff to Χ² pvalue too.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

13 months agoMerge branch '19995-glm-freq-threshold'
Tom Clegg [Tue, 7 Mar 2023 04:46:39 +0000 (23:46 -0500)]
Merge branch '19995-glm-freq-threshold'

refs #19995

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

13 months ago19995: Skip GLM on variants below frequency threshold.
Tom Clegg [Mon, 6 Mar 2023 16:21:25 +0000 (11:21 -0500)]
19995: Skip GLM on variants below frequency threshold.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

14 months agoMerge branch '19997-glm'
Tom Clegg [Thu, 2 Feb 2023 17:02:25 +0000 (12:02 -0500)]
Merge branch '19997-glm'

refs #19997

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

14 months agoPreserve pca components from input when writing samples.csv.
Tom Clegg [Thu, 2 Feb 2023 16:10:13 +0000 (11:10 -0500)]
Preserve pca components from input when writing samples.csv.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

14 months agoFix validation=0 in samples.csv (should be empty for non-c/c).
Tom Clegg [Thu, 2 Feb 2023 15:00:12 +0000 (10:00 -0500)]
Fix validation=0 in samples.csv (should be empty for non-c/c).

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

14 months agoTurn off auto-retry.
Tom Clegg [Thu, 2 Feb 2023 15:00:01 +0000 (10:00 -0500)]
Turn off auto-retry.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

14 months agoMerge branch '19868-pca-in-ml' into main
Jiayong Li [Fri, 27 Jan 2023 19:39:13 +0000 (19:39 +0000)]
Merge branch '19868-pca-in-ml' into main

refs #19868

Arvados-DCO-1.1-Signed-off-by: Jiayong Li <jli@curii.com>

14 months agoMerge branch 'main' into 19868-pca-in-ml 19868-pca-in-ml
Jiayong Li [Fri, 27 Jan 2023 19:38:44 +0000 (19:38 +0000)]
Merge branch 'main' into 19868-pca-in-ml

refs #19868

Arvados-DCO-1.1-Signed-off-by: Jiayong Li <jli@curii.com>

14 months agoChange resource requirement of gvcf2fasta and imputation
Jiayong Li [Fri, 27 Jan 2023 19:37:08 +0000 (19:37 +0000)]
Change resource requirement of gvcf2fasta and imputation

refs #19868

Arvados-DCO-1.1-Signed-off-by: Jiayong Li <jli@curii.com>

14 months agoDarker colors.
Tom Clegg [Fri, 20 Jan 2023 19:25:02 +0000 (14:25 -0500)]
Darker colors.

refs #19958

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

14 months agoBring back genomewideline/suggestiveline options.
Tom Clegg [Fri, 20 Jan 2023 18:37:34 +0000 (13:37 -0500)]
Bring back genomewideline/suggestiveline options.

refs #19958

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

14 months agoMerge branch '19868-pca-in-ml' into main
Jiayong Li [Fri, 20 Jan 2023 14:38:41 +0000 (14:38 +0000)]
Merge branch '19868-pca-in-ml' into main

refs #19868

Arvados-DCO-1.1-Signed-off-by: Jiayong Li <jli@curii.com>

14 months agoMerge branch 'main' into 19868-pca-in-ml
Jiayong Li [Fri, 20 Jan 2023 14:37:58 +0000 (14:37 +0000)]
Merge branch 'main' into 19868-pca-in-ml

refs #19868

Arvados-DCO-1.1-Signed-off-by: Jiayong Li <jli@curii.com>

14 months agoChange slice-numpy-onehot parameter
Jiayong Li [Fri, 20 Jan 2023 14:36:55 +0000 (14:36 +0000)]
Change slice-numpy-onehot parameter

refs #19868

Arvados-DCO-1.1-Signed-off-by: Jiayong Li <jli@curii.com>

14 months agoGenerate a manhattan plot for each chromosome.
Tom Clegg [Thu, 19 Jan 2023 21:38:41 +0000 (16:38 -0500)]
Generate a manhattan plot for each chromosome.

refs #19958

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

15 months agoFix GLM p-value calculation when -case-control-only=true.
Tom Clegg [Fri, 13 Jan 2023 20:05:27 +0000 (15:05 -0500)]
Fix GLM p-value calculation when -case-control-only=true.

refs #19566

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

15 months agoMerge branch '19868-pca-in-ml' into main
Jiayong Li [Thu, 12 Jan 2023 16:18:07 +0000 (16:18 +0000)]
Merge branch '19868-pca-in-ml' into main

refs #19868

Arvados-DCO-1.1-Signed-off-by: Jiayong Li <jli@curii.com>

15 months agoMerge branch 'main' into 19868-pca-in-ml
Jiayong Li [Thu, 12 Jan 2023 16:17:19 +0000 (16:17 +0000)]
Merge branch 'main' into 19868-pca-in-ml

refs #19868

Arvados-DCO-1.1-Signed-off-by: Jiayong Li <jli@curii.com>

15 months agoFix shebang and license
Jiayong Li [Thu, 12 Jan 2023 16:07:42 +0000 (16:07 +0000)]
Fix shebang and license

refs #19868

Arvados-DCO-1.1-Signed-off-by: Jiayong Li <jli@curii.com>

15 months agoFix -min-coverage calculation broken when -case-control-only=true.
Tom Clegg [Tue, 10 Jan 2023 15:00:16 +0000 (10:00 -0500)]
Fix -min-coverage calculation broken when -case-control-only=true.

refs #19868

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

15 months agoAdd column headings to slice-numpy -pca sample list output.
Tom Clegg [Tue, 3 Jan 2023 21:29:12 +0000 (16:29 -0500)]
Add column headings to slice-numpy -pca sample list output.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

15 months agoFix validation flag in slice-numpy -pca sample list output.
Tom Clegg [Tue, 3 Jan 2023 21:23:05 +0000 (16:23 -0500)]
Fix validation flag in slice-numpy -pca sample list output.

No issue #

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

15 months agoMerge branch '19526-manhattan-plot'
Tom Clegg [Wed, 21 Dec 2022 19:46:20 +0000 (14:46 -0500)]
Merge branch '19526-manhattan-plot'

refs #19526

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

15 months ago19526: Output tile locations and pvalues at specified threshold. 19526-manhattan-plot
Tom Clegg [Mon, 19 Dec 2022 21:51:02 +0000 (16:51 -0500)]
19526: Output tile locations and pvalues at specified threshold.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

15 months agoMerge branch '19566-glm'
Tom Clegg [Mon, 19 Dec 2022 19:25:54 +0000 (14:25 -0500)]
Merge branch '19566-glm'

refs #19566

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

15 months ago19566: Preemptible flag.
Tom Clegg [Mon, 19 Dec 2022 19:22:34 +0000 (14:22 -0500)]
19566: Preemptible flag.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

15 months ago19566: Record number of p-value calculations performed.
Tom Clegg [Mon, 19 Dec 2022 15:10:16 +0000 (10:10 -0500)]
19566: Record number of p-value calculations performed.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

16 months ago19566: Silence logging from glm library. 19566-glm
Tom Clegg [Fri, 16 Dec 2022 19:25:12 +0000 (14:25 -0500)]
19566: Silence logging from glm library.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

16 months ago19566: Fix chi2 used instead of logistic regression p-value.
Tom Clegg [Fri, 16 Dec 2022 15:45:25 +0000 (10:45 -0500)]
19566: Fix chi2 used instead of logistic regression p-value.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

16 months agoMerge branch '19785-add-cwl' into main
Jiayong Li [Thu, 15 Dec 2022 22:21:02 +0000 (22:21 +0000)]
Merge branch '19785-add-cwl' into main

refs #19785

Arvados-DCO-1.1-Signed-off-by: Jiayong Li <jli@curii.com>

16 months agoMerge branch 'main' into 19785-add-cwl 19785-add-cwl
Jiayong Li [Thu, 15 Dec 2022 22:20:16 +0000 (22:20 +0000)]
Merge branch 'main' into 19785-add-cwl

refs #19785

Arvados-DCO-1.1-Signed-off-by: Jiayong Li <jli@curii.com>

16 months agoChange lightning docker file so that it builds the current branch instead of main
Jiayong Li [Thu, 15 Dec 2022 22:15:13 +0000 (22:15 +0000)]
Change lightning docker file so that it builds the current branch instead of main

refs #19785

Arvados-DCO-1.1-Signed-off-by: Jiayong Li <jli@curii.com>

16 months ago19566: Merge branch 'main'
Tom Clegg [Thu, 15 Dec 2022 15:59:27 +0000 (10:59 -0500)]
19566: Merge branch 'main'

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

16 months agoMerge branch '19526-manhattan-plot'
Tom Clegg [Thu, 15 Dec 2022 15:59:03 +0000 (10:59 -0500)]
Merge branch '19526-manhattan-plot'

refs #19526

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

16 months ago19566: Precompute cov glm.
Tom Clegg [Wed, 14 Dec 2022 20:00:46 +0000 (15:00 -0500)]
19566: Precompute cov glm.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

16 months agoMerge branch '19566-glm'
Tom Clegg [Tue, 13 Dec 2022 15:03:06 +0000 (10:03 -0500)]
Merge branch '19566-glm'

refs #19566

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

16 months ago19566: Test p-value vs. Python.
Tom Clegg [Mon, 12 Dec 2022 16:37:21 +0000 (11:37 -0500)]
19566: Test p-value vs. Python.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

16 months ago19566: Normalize pca values before glm.
Tom Clegg [Fri, 2 Dec 2022 19:23:34 +0000 (14:23 -0500)]
19566: Normalize pca values before glm.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

16 months ago19566: Add constant, check GLM results against Python.
Tom Clegg [Fri, 2 Dec 2022 18:59:29 +0000 (13:59 -0500)]
19566: Add constant, check GLM results against Python.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

16 months agoMerge branch '19785-add-cwl' into main
Jiayong Li [Fri, 9 Dec 2022 21:09:17 +0000 (21:09 +0000)]
Merge branch '19785-add-cwl' into main

refs #19785

Arvados-DCO-1.1-Signed-off-by: Jiayong Li <jli@curii.com>

16 months agoFix readme
Jiayong Li [Fri, 9 Dec 2022 21:08:35 +0000 (21:08 +0000)]
Fix readme

refs #19785

Arvados-DCO-1.1-Signed-off-by: Jiayong Li <jli@curii.com>

16 months agoMerge branch '19785-add-cwl' into main
Jiayong Li [Fri, 9 Dec 2022 21:05:32 +0000 (21:05 +0000)]
Merge branch '19785-add-cwl' into main

refs #19785

Arvados-DCO-1.1-Signed-off-by: Jiayong Li <jli@curii.com>

16 months agoAdd cwl and docker files
Jiayong Li [Fri, 9 Dec 2022 21:03:13 +0000 (21:03 +0000)]
Add cwl and docker files

refs #19785

Arvados-DCO-1.1-Signed-off-by: Jiayong Li <jli@curii.com>

16 months ago19526: Tidy manhattan plot.
Tom Clegg [Thu, 1 Dec 2022 18:13:18 +0000 (13:13 -0500)]
19526: Tidy manhattan plot.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

16 months ago19566: Option to limit pca components used in glm. Fix onehot use.
Tom Clegg [Tue, 29 Nov 2022 16:22:12 +0000 (11:22 -0500)]
19566: Option to limit pca components used in glm. Fix onehot use.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

16 months ago19566: glm one column at a time.
Tom Clegg [Tue, 29 Nov 2022 16:10:32 +0000 (11:10 -0500)]
19566: glm one column at a time.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

16 months ago19566: Logistic regression p-value.
Tom Clegg [Tue, 29 Nov 2022 15:43:29 +0000 (10:43 -0500)]
19566: Logistic regression p-value.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

16 months agoMerge branch '19526-manhattan-plot'
Tom Clegg [Mon, 28 Nov 2022 20:18:32 +0000 (15:18 -0500)]
Merge branch '19526-manhattan-plot'

refs #19526

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

16 months ago19526: Add manhattan plot.
Tom Clegg [Mon, 28 Nov 2022 18:34:48 +0000 (13:34 -0500)]
19526: Add manhattan plot.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months agoCheck for unparsed command line args.
Tom Clegg [Fri, 18 Nov 2022 18:28:36 +0000 (13:28 -0500)]
Check for unparsed command line args.

refs #19780

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months ago19780: Fix indexing error.
Tom Clegg [Fri, 18 Nov 2022 17:50:49 +0000 (12:50 -0500)]
19780: Fix indexing error.

refs #19780

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months ago19527: slice-numpy accepts samples.csv with or without p-values.
Tom Clegg [Wed, 16 Nov 2022 20:22:55 +0000 (15:22 -0500)]
19527: slice-numpy accepts samples.csv with or without p-values.

refs #19527

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months ago19527: Update arvados sdk.
Tom Clegg [Mon, 14 Nov 2022 00:06:41 +0000 (19:06 -0500)]
19527: Update arvados sdk.

refs #19527

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months ago19527: Fix odd # columns to pca.
Tom Clegg [Fri, 11 Nov 2022 21:04:54 +0000 (16:04 -0500)]
19527: Fix odd # columns to pca.

refs #19527

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months ago19527: Fix one-hot matrix.
Tom Clegg [Fri, 11 Nov 2022 17:44:16 +0000 (12:44 -0500)]
19527: Fix one-hot matrix.

refs #19527

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months ago19527: Enable choose-samples to work without case/control info.
Tom Clegg [Fri, 11 Nov 2022 17:35:09 +0000 (12:35 -0500)]
19527: Enable choose-samples to work without case/control info.

refs #19527

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months ago19527: Fix Χ² calculation.
Tom Clegg [Fri, 11 Nov 2022 01:55:11 +0000 (20:55 -0500)]
19527: Fix Χ² calculation.

refs #19527

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months ago19527: Output samples.csv earlier.
Tom Clegg [Thu, 10 Nov 2022 20:49:35 +0000 (15:49 -0500)]
19527: Output samples.csv earlier.

refs #19527

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months ago19527: Fix crash on tag skipped for min-coverage.
Tom Clegg [Thu, 10 Nov 2022 19:40:45 +0000 (14:40 -0500)]
19527: Fix crash on tag skipped for min-coverage.

refs #19527

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months ago19527: Option to exclude non-case/control samples.
Tom Clegg [Thu, 10 Nov 2022 16:16:59 +0000 (11:16 -0500)]
19527: Option to exclude non-case/control samples.

refs #19527

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months agoMerge branch '19527-training-set'
Tom Clegg [Thu, 10 Nov 2022 15:24:53 +0000 (10:24 -0500)]
Merge branch '19527-training-set'

refs #19527

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months ago19527: Accommodate header row in samples csv. 19527-training-set
Tom Clegg [Wed, 9 Nov 2022 23:29:58 +0000 (18:29 -0500)]
19527: Accommodate header row in samples csv.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months ago19527: Ignore empty line at EOF.
Tom Clegg [Wed, 9 Nov 2022 23:08:57 +0000 (18:08 -0500)]
19527: Ignore empty line at EOF.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months agoMerge branch '19524-pca'
Tom Clegg [Wed, 9 Nov 2022 20:12:33 +0000 (15:12 -0500)]
Merge branch '19524-pca'

refs #19524

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months ago19527: Fix p-value calculation.
Tom Clegg [Wed, 9 Nov 2022 20:11:48 +0000 (15:11 -0500)]
19527: Fix p-value calculation.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months ago19527: Load training-set flag from samples.csv.
Tom Clegg [Wed, 9 Nov 2022 19:39:31 +0000 (14:39 -0500)]
19527: Load training-set flag from samples.csv.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months ago19527: choose-samples: training/validation set.
Tom Clegg [Mon, 7 Nov 2022 14:29:47 +0000 (09:29 -0500)]
19527: choose-samples: training/validation set.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months ago19527: Load training-set flag from samples.csv.
Tom Clegg [Wed, 9 Nov 2022 19:24:49 +0000 (14:24 -0500)]
19527: Load training-set flag from samples.csv.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months agochoose-samples: training/validation set.
Tom Clegg [Mon, 7 Nov 2022 14:29:47 +0000 (09:29 -0500)]
choose-samples: training/validation set.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months ago19524: Fit PCA to specified training set.
Tom Clegg [Wed, 2 Nov 2022 14:49:09 +0000 (10:49 -0400)]
19524: Fit PCA to specified training set.

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>

17 months agoMerge branch '19524-pca'
Tom Clegg [Mon, 31 Oct 2022 15:53:26 +0000 (11:53 -0400)]
Merge branch '19524-pca'

refs #19524

Arvados-DCO-1.1-Signed-off-by: Tom Clegg <tom@curii.com>