partis-bcr 1.0.13__cp312-cp312-macosx_10_13_universal2.whl → 1.0.13.post1.dev3__cp312-cp312-macosx_10_13_universal2.whl

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (53) hide show
  1. {partis_bcr-1.0.13.dist-info → partis_bcr-1.0.13.post1.dev3.dist-info}/METADATA +1 -1
  2. {partis_bcr-1.0.13.dist-info → partis_bcr-1.0.13.post1.dev3.dist-info}/RECORD +53 -53
  3. python/processargs.py +4 -1
  4. test/new-results/partition-new-simu/fasttree/iclust-0/log +5 -5
  5. test/new-results/partition-new-simu/fasttree/iclust-1/log +3 -3
  6. test/new-results/partition-new-simu/fasttree/iclust-2/log +4 -4
  7. test/new-results/run-times.csv +8 -8
  8. test/new-results/test.log +53 -54
  9. test/paired/new-results/partition-new-simu/fasttree/iclust-0/log +5 -5
  10. test/paired/new-results/partition-new-simu/fasttree/iclust-1/log +5 -5
  11. test/paired/new-results/partition-new-simu/fasttree/iclust-2/log +4 -4
  12. test/paired/new-results/partition-new-simu/igh+igk/partition-igh/fasttree/iclust-0/log +3 -3
  13. test/paired/new-results/partition-new-simu/igh+igk/partition-igh/fasttree/iclust-1/log +4 -4
  14. test/paired/new-results/partition-new-simu/igh+igk/partition-igk/fasttree/iclust-0/log +1 -1
  15. test/paired/new-results/partition-new-simu/igh+igk/partition-igk/fasttree/iclust-1/log +1 -1
  16. test/paired/new-results/partition-new-simu/igh+igl/partition-igh/fasttree/iclust-0/log +4 -4
  17. test/paired/new-results/partition-new-simu/igh+igl/partition-igl/fasttree/iclust-0/log +5 -5
  18. test/paired/new-results/partition-new-simu-annotation-performance/plots/flcount-matrix.svg +108 -108
  19. test/paired/new-results/partition-new-simu-annotation-performance/plots/func-non-func-per-drop-log.svg +84 -84
  20. test/paired/new-results/partition-new-simu-annotation-performance/plots/func-non-func-per-drop.svg +62 -62
  21. test/paired/new-results/partition-new-simu-annotation-performance/plots/paired-seqs-per-seq-after.svg +19 -19
  22. test/paired/new-results/partition-new-simu-annotation-performance/plots/paired-seqs-per-seq-before.svg +25 -25
  23. test/paired/new-results/partition-new-simu-annotation-performance/plots/pseq-matrix.svg +36 -36
  24. test/paired/new-results/partition-new-simu-annotation-performance/plots/seqs-per-droplet.svg +23 -23
  25. test/paired/new-results/partition-new-simu-annotation-performance/plots/true-pair-clean-performance-correct-family.svg +46 -46
  26. test/paired/new-results/partition-new-simu-annotation-performance/plots/true-pair-clean-performance-correct.svg +46 -46
  27. test/paired/new-results/partition-new-simu-annotation-performance/plots/true-pair-clean-performance-mispaired.svg +46 -46
  28. test/paired/new-results/partition-new-simu-annotation-performance/plots/true-pair-clean-performance-multiple.svg +16 -16
  29. test/paired/new-results/partition-new-simu-annotation-performance/plots/true-pair-clean-performance-near-family.svg +16 -16
  30. test/paired/new-results/partition-new-simu-annotation-performance/plots/true-pair-clean-performance-total.svg +48 -48
  31. test/paired/new-results/partition-new-simu-annotation-performance/plots/true-pair-clean-performance-unpaired.svg +49 -49
  32. test/paired/new-results/partition-new-simu-annotation-performance/plots/true-pair-clean-performance.svg +28 -28
  33. test/paired/new-results/run-times.csv +6 -6
  34. test/paired/new-results/subset-partition-new-simu/isub-0/partition.log +64 -68
  35. test/paired/new-results/subset-partition-new-simu/isub-1/partition.log +64 -69
  36. test/paired/new-results/subset-partition-new-simu/merged-partition.log +44 -48
  37. test/paired/new-results/subset-partition-new-simu/merged-subsets/parameters/igh/sw-cache.yaml +1 -1
  38. test/paired/new-results/subset-partition-new-simu/merged-subsets/parameters/igk/sw-cache.yaml +1 -1
  39. test/paired/new-results/subset-partition-new-simu/merged-subsets/parameters/igl/sw-cache.yaml +1 -1
  40. test/paired/new-results/test.log +163 -172
  41. {partis_bcr-1.0.13.data → partis_bcr-1.0.13.post1.dev3.data}/scripts/cf-alleles.py +0 -0
  42. {partis_bcr-1.0.13.data → partis_bcr-1.0.13.post1.dev3.data}/scripts/cf-germlines.py +0 -0
  43. {partis_bcr-1.0.13.data → partis_bcr-1.0.13.post1.dev3.data}/scripts/compare-plotdirs.py +0 -0
  44. {partis_bcr-1.0.13.data → partis_bcr-1.0.13.post1.dev3.data}/scripts/extract-pairing-info.py +0 -0
  45. {partis_bcr-1.0.13.data → partis_bcr-1.0.13.post1.dev3.data}/scripts/gctree-run.py +0 -0
  46. {partis_bcr-1.0.13.data → partis_bcr-1.0.13.post1.dev3.data}/scripts/get-naive-probabilities.py +0 -0
  47. {partis_bcr-1.0.13.data → partis_bcr-1.0.13.post1.dev3.data}/scripts/parse-output.py +0 -0
  48. {partis_bcr-1.0.13.data → partis_bcr-1.0.13.post1.dev3.data}/scripts/partis-test.py +0 -0
  49. {partis_bcr-1.0.13.data → partis_bcr-1.0.13.post1.dev3.data}/scripts/split-loci.py +0 -0
  50. {partis_bcr-1.0.13.dist-info → partis_bcr-1.0.13.post1.dev3.dist-info}/WHEEL +0 -0
  51. {partis_bcr-1.0.13.dist-info → partis_bcr-1.0.13.post1.dev3.dist-info}/entry_points.txt +0 -0
  52. {partis_bcr-1.0.13.dist-info → partis_bcr-1.0.13.post1.dev3.dist-info}/licenses/COPYING +0 -0
  53. {partis_bcr-1.0.13.dist-info → partis_bcr-1.0.13.post1.dev3.dist-info}/top_level.txt +0 -0
@@ -13,71 +13,71 @@ smith-waterman (new-allele fitting)
13
13
  running 10 procs for 56 seqs
14
14
  info for 56 / 56 = 1.000 (removed: 0 failed)
15
15
  kept 25 (0.446) unproductive
16
- water time: 0.3 (ig-sw 0.1 processing 0.2)
16
+ water time: 0.2 (ig-sw 0.1 processing 0.1)
17
17
  smith-waterman (writing parameters)
18
- vsearch: 56 / 56 v annotations (0 failed) with 6 v genes in 0.4 sec
18
+ vsearch: 56 / 56 v annotations (0 failed) with 6 v genes in 0.2 sec
19
19
  running 10 procs for 56 seqs
20
20
  info for 56 / 56 = 1.000 (removed: 0 failed)
21
21
  kept 25 (0.446) unproductive
22
22
  writing sw results to test/paired/new-results/test/parameters/simu/igh/sw-cache.yaml
23
- writing parameters to test/paired/new-results/test/parameters/simu/igh/sw (2.1 sec)
24
- water time: 2.5 (ig-sw 2.3 processing 0.2)
23
+ writing parameters to test/paired/new-results/test/parameters/simu/igh/sw (0.8 sec)
24
+ water time: 1.1 (ig-sw 0.9 processing 0.1)
25
25
  writing hmms removed 16 genes from glfo (leaving v 6 d 18 j 4)
26
26
 
27
27
  note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
28
- (1.2 sec)
28
+ (0.7 sec)
29
29
  hmm
30
30
  reading output
31
31
  read 56 hmm output lines with 56 sequences in 56 events (0 failures)
32
- writing parameters to test/paired/new-results/test/parameters/simu/igh/hmm (1.5 sec)
33
- writing parameters to test/paired/new-results/test/parameters/simu/igh/true (2.0 sec)
34
- infra time: 3.8
35
- hmm step time: 5.3
32
+ writing parameters to test/paired/new-results/test/parameters/simu/igh/hmm (0.8 sec)
33
+ writing parameters to test/paired/new-results/test/parameters/simu/igh/true (0.7 sec)
34
+ infra time: 1.7
35
+ hmm step time: 2.5
36
36
  writing hmms removed 3 genes from glfo (leaving v 6 d 15 j 4)
37
37
 
38
38
  note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
39
- (2.2 sec)
40
- total time: 12.7
39
+ (0.7 sec)
40
+ total time: 5.7
41
41
  cache-parameters igk:
42
42
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
43
43
  run partis cache-parameters --locus igk --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igk --is-simu --random-seed 1 --n-procs 10 --infname test/paired/ref-results/test/simu/igk.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igk/sw-cache.yaml --input-metafnames test/paired/ref-results/test/simu/meta.yaml
44
44
  --input-metafnames: added meta info for 36 sequences from test/paired/ref-results/test/simu/meta.yaml: loci paired-uids
45
45
  caching parameters
46
- vsearch: 36 / 36 v annotations (0 failed) with 6 v genes in 0.2 sec
46
+ vsearch: 36 / 36 v annotations (0 failed) with 6 v genes in 0.1 sec
47
47
  keeping 5 / 64 v genes
48
48
  missing 11 simulation genes (counts): kv1-1201 0 kv1-2701 0 kv1-501 0 kv1-803 0 kv1-901 0 kv1D-3901 0 kv2-2401 0 kv2D-2801 0 kv3-2001 0 kv4-102 0 kv6-2101 0
49
49
  smith-waterman (new-allele fitting)
50
- vsearch: 36 / 36 v annotations (0 failed) with 5 v genes in 0.2 sec
50
+ vsearch: 36 / 36 v annotations (0 failed) with 5 v genes in 0.1 sec
51
51
  running 10 procs for 36 seqs
52
52
  running 11 procs for 2 seqs
53
53
  info for 36 / 36 = 1.000 (removed: 0 failed)
54
54
  kept 14 (0.389) unproductive
55
- water time: 0.4 (ig-sw 0.0 processing 0.2)
55
+ water time: 0.3 (ig-sw 0.0 processing 0.1)
56
56
  smith-waterman (writing parameters)
57
- vsearch: 36 / 36 v annotations (0 failed) with 5 v genes in 0.2 sec
57
+ vsearch: 36 / 36 v annotations (0 failed) with 5 v genes in 0.1 sec
58
58
  running 10 procs for 36 seqs
59
59
  running 11 procs for 2 seqs
60
60
  info for 36 / 36 = 1.000 (removed: 0 failed)
61
61
  kept 14 (0.389) unproductive
62
62
  writing sw results to test/paired/new-results/test/parameters/simu/igk/sw-cache.yaml
63
- writing parameters to test/paired/new-results/test/parameters/simu/igk/sw (1.2 sec)
64
- water time: 1.7 (ig-sw 1.3 processing 0.2)
63
+ writing parameters to test/paired/new-results/test/parameters/simu/igk/sw (0.6 sec)
64
+ water time: 1.0 (ig-sw 0.7 processing 0.1)
65
65
  writing hmms removed 2 genes from glfo (leaving v 5 d 1 j 5)
66
66
 
67
67
  note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
68
- (0.8 sec)
68
+ (0.4 sec)
69
69
  hmm
70
70
  reading output
71
71
  read 36 hmm output lines with 36 sequences in 36 events (0 failures)
72
- writing parameters to test/paired/new-results/test/parameters/simu/igk/hmm (1.1 sec)
73
- writing parameters to test/paired/new-results/test/parameters/simu/igk/true (1.3 sec)
74
- infra time: 2.7
75
- hmm step time: 3.9
72
+ writing parameters to test/paired/new-results/test/parameters/simu/igk/hmm (0.6 sec)
73
+ writing parameters to test/paired/new-results/test/parameters/simu/igk/true (0.7 sec)
74
+ infra time: 1.4
75
+ hmm step time: 1.8
76
76
  writing hmms removed 0 genes from glfo (leaving v 5 d 1 j 5)
77
77
 
78
78
  note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
79
- (0.7 sec)
80
- total time: 8.2
79
+ (0.5 sec)
80
+ total time: 4.4
81
81
  cache-parameters igl:
82
82
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
83
83
  run partis cache-parameters --locus igl --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igl --is-simu --random-seed 1 --n-procs 10 --infname test/paired/ref-results/test/simu/igl.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igl/sw-cache.yaml --input-metafnames test/paired/ref-results/test/simu/meta.yaml
@@ -87,36 +87,36 @@ caching parameters
87
87
  keeping 3 / 80 v genes
88
88
  missing 7 simulation genes (counts): lv1-5102 0 lv3-101 0 lv3-1901 0 lv3-2701 0 lv4-6003 0 lv7-4604 0 lv8-6101 0
89
89
  smith-waterman (new-allele fitting)
90
- vsearch: 21 / 21 v annotations (0 failed) with 3 v genes in 0.2 sec
90
+ vsearch: 21 / 21 v annotations (0 failed) with 3 v genes in 0.1 sec
91
91
  running 10 procs for 21 seqs
92
92
  info for 21 / 21 = 1.000 (removed: 0 failed)
93
93
  kept 14 (0.667) unproductive
94
- water time: 0.2 (ig-sw 0.0 processing 0.2)
94
+ water time: 0.2 (ig-sw 0.0 processing 0.1)
95
95
  smith-waterman (writing parameters)
96
96
  vsearch: 21 / 21 v annotations (0 failed) with 3 v genes in 0.1 sec
97
97
  running 10 procs for 21 seqs
98
98
  info for 21 / 21 = 1.000 (removed: 0 failed)
99
99
  kept 14 (0.667) unproductive
100
100
  writing sw results to test/paired/new-results/test/parameters/simu/igl/sw-cache.yaml
101
- writing parameters to test/paired/new-results/test/parameters/simu/igl/sw (0.7 sec)
102
- water time: 1.0 (ig-sw 0.8 processing 0.2)
101
+ writing parameters to test/paired/new-results/test/parameters/simu/igl/sw (0.5 sec)
102
+ water time: 0.7 (ig-sw 0.6 processing 0.1)
103
103
  writing hmms removed 7 genes from glfo (leaving v 3 d 1 j 2)
104
104
 
105
105
  note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
106
- (0.4 sec)
106
+ (0.3 sec)
107
107
  hmm
108
108
  reading output
109
109
  read 21 hmm output lines with 21 sequences in 21 events (0 failures)
110
- writing parameters to test/paired/new-results/test/parameters/simu/igl/hmm (0.6 sec)
111
- writing parameters to test/paired/new-results/test/parameters/simu/igl/true (0.8 sec)
112
- infra time: 1.6
113
- hmm step time: 2.0
110
+ writing parameters to test/paired/new-results/test/parameters/simu/igl/hmm (0.4 sec)
111
+ writing parameters to test/paired/new-results/test/parameters/simu/igl/true (0.4 sec)
112
+ infra time: 1.0
113
+ hmm step time: 1.4
114
114
  writing hmms removed 0 genes from glfo (leaving v 3 d 1 j 2)
115
115
 
116
116
  note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
117
- (0.4 sec)
118
- total time: 4.5
119
- total time: 36.1
117
+ (0.2 sec)
118
+ total time: 3.1
119
+ total time: 18.9
120
120
  partition-new-simu partis partition --dont-write-git-info --paired-loci --paired-indir test/paired/ref-results/test/simu --parameter-dir test/paired/new-results/test/parameters/simu --plot-annotation-performance --max-ccf-fail-frac 0.10 --is-simu --plotdir test/paired/new-results/partition-new-simu-annotation-performance --only-csv-plots --no-partition-plots --random-seed 1 --n-procs 10 --paired-outdir test/paired/new-results/partition-new-simu
121
121
  warning ignoring --plot-annotation-performance for paired clustering since it's going to be a bit fiddly to implement
122
122
  partition igh:
@@ -132,52 +132,52 @@ smith-waterman
132
132
  plotting performance
133
133
  warning skipped annotation performance evaluation on 1 queries with different true and inferred net shm indel lengths: db63559ea9-igh
134
134
  (0.0 sec)
135
- water time: 0.3
135
+ water time: 0.1
136
136
  hmm
137
- caching all 56 naive sequences (1.7s)
137
+ caching all 56 naive sequences (1.2s)
138
138
  collapsed 56 queries into 50 clusters with identical naive seqs (0.0 sec)
139
- 50 clusters with 10 procs (0.9s)
140
- 44 clusters with 7 procs (0.7s)
139
+ 50 clusters with 10 procs (0.8s)
140
+ 44 clusters with 7 procs (0.8s)
141
141
  36 clusters with 5 procs (0.7s)
142
142
  31 clusters with 3 procs (0.5s)
143
- 29 clusters with 2 procs (1.1s)
144
- 23 clusters with 1 proc (1.5s)
143
+ 29 clusters with 2 procs (0.9s)
144
+ 23 clusters with 1 proc (1.1s)
145
145
  note not merging entire cpath history
146
- partition loop time: 5.4
146
+ partition loop time: 4.7
147
147
  getting annotations for final partition
148
- subcluster annotating 20 clusters with steps: (1.0s) (0.5s) plotting performance
148
+ subcluster annotating 20 clusters with steps: (0.8s) (0.3s) plotting performance
149
149
  warning skipped annotation performance evaluation on 1 queries with different true and inferred net shm indel lengths: db63559ea9-igh
150
150
  (0.0 sec)
151
151
 
152
- subcluster annotation time 1.6
153
- total time: 9.5
152
+ subcluster annotation time 1.2
153
+ total time: 7.5
154
154
  partition igk:
155
155
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
156
156
  run partis partition --locus igk --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igk --plot-annotation-performance --max-ccf-fail-frac 0.10 --is-simu --plotdir test/paired/new-results/partition-new-simu-annotation-performance/single-chain/plots/igk --only-csv-plots --no-partition-plots --random-seed 1 --n-procs 10 --refuse-to-cache-parameters --infname test/paired/ref-results/test/simu/igk.yaml --outfname test/paired/new-results/partition-new-simu/single-chain/partition-igk.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igk/sw-cache.yaml --input-metafnames test/paired/ref-results/test/simu/meta.yaml
157
157
  --input-metafnames: added meta info for 36 sequences from test/paired/ref-results/test/simu/meta.yaml: loci paired-uids
158
158
  partitioning (with test/paired/new-results/test/parameters/simu/igk/hmm)
159
159
  smith-waterman
160
- vsearch: 36 / 36 v annotations (0 failed) with 5 v genes in 0.2 sec
160
+ vsearch: 36 / 36 v annotations (0 failed) with 5 v genes in 0.1 sec
161
161
  reading sw results from test/paired/new-results/test/parameters/simu/igk/sw-cache.yaml
162
162
  info for 36 / 36 = 1.000 (removed: 0 failed, 0 duplicates [removed when cache file was written])
163
163
  kept 14 (0.389) unproductive
164
164
  plotting performance (0.0 sec)
165
- water time: 0.2
165
+ water time: 0.1
166
166
  hmm
167
- caching all 36 naive sequences (0.7s)
167
+ caching all 36 naive sequences (0.5s)
168
168
  collapsed 36 queries into 7 clusters with identical naive seqs (0.0 sec)
169
169
  reducing n procs to number of clusters: 10 --> 7
170
170
  7 clusters with 7 procs (0.3s)
171
171
  7 clusters with 5 procs (0.3s)
172
172
  7 clusters with 3 procs (0.3s)
173
173
  7 clusters with 2 procs (0.3s)
174
- 6 clusters with 1 proc (0.5s)
175
- partition loop time: 1.6
174
+ 6 clusters with 1 proc (0.4s)
175
+ partition loop time: 1.5
176
176
  getting annotations for final partition
177
- subcluster annotating 6 clusters with steps: (0.8s) (0.2s) (0.2s) plotting performance (0.0 sec)
177
+ subcluster annotating 6 clusters with steps: (0.4s) (0.2s) (0.2s) plotting performance (0.0 sec)
178
178
 
179
- subcluster annotation time 1.3
180
- total time: 4.0
179
+ subcluster annotation time 0.9
180
+ total time: 3.2
181
181
  partition igl:
182
182
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
183
183
  run partis partition --locus igl --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igl --plot-annotation-performance --max-ccf-fail-frac 0.10 --is-simu --plotdir test/paired/new-results/partition-new-simu-annotation-performance/single-chain/plots/igl --only-csv-plots --no-partition-plots --random-seed 1 --n-procs 10 --refuse-to-cache-parameters --infname test/paired/ref-results/test/simu/igl.yaml --outfname test/paired/new-results/partition-new-simu/single-chain/partition-igl.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igl/sw-cache.yaml --input-metafnames test/paired/ref-results/test/simu/meta.yaml
@@ -191,18 +191,18 @@ smith-waterman
191
191
  plotting performance (0.0 sec)
192
192
  water time: 0.1
193
193
  hmm
194
- caching all 21 naive sequences (0.5s)
194
+ caching all 21 naive sequences (0.4s)
195
195
  collapsed 21 queries into 3 clusters with identical naive seqs (0.0 sec)
196
196
  reducing n procs to number of clusters: 10 --> 3
197
- 3 clusters with 3 procs (0.3s)
198
- 3 clusters with 2 procs (0.2s)
199
- 3 clusters with 1 proc (0.3s)
200
- partition loop time: 0.7
197
+ 3 clusters with 3 procs (0.2s)
198
+ 3 clusters with 2 procs (0.1s)
199
+ 3 clusters with 1 proc (0.2s)
200
+ partition loop time: 0.6
201
201
  getting annotations for final partition
202
- subcluster annotating 3 clusters with steps: (0.3s) (0.2s) (0.3s) plotting performance (0.0 sec)
202
+ subcluster annotating 3 clusters with steps: (0.3s) (0.2s) (0.2s) plotting performance (0.0 sec)
203
203
 
204
- subcluster annotation time 0.9
205
- total time: 2.4
204
+ subcluster annotation time 0.7
205
+ total time: 2.0
206
206
  combining chains
207
207
  cleaning pair info for 113 seqs
208
208
  synchronized/fixed 0 pairs where one had no pair info after cleaning: h 0 k 0 l 0
@@ -240,7 +240,6 @@ WARNING using errors instead of sumw2 with weight != 1.0 in Hist::fill_ibin()
240
240
  joint 0.963 0.594
241
241
  merge time 0.0
242
242
  need to get annotations for 7/15 joint igh clusters
243
- tag: v1.0.13
244
243
  annotate igh+igk: igh
245
244
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
246
245
  run partis annotate --locus igh --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igh --max-ccf-fail-frac 0.10 --only-csv-plots --no-partition-plots --random-seed 1 --n-procs 10 --refuse-to-cache-parameters --infname test/paired/new-results/partition-new-simu/igh+igk/input-seqs-igh.fa --outfname test/paired/new-results/partition-new-simu/igh+igk/partition-igh.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igh/sw-cache.yaml --input-metafnames test/paired/new-results/partition-new-simu/igh+igk/meta-igh.yaml --ignore-sw-pair-info --input-partition-fname test/paired/new-results/partition-new-simu/igh+igk/partition-igh-only-partition.yaml
@@ -254,11 +253,10 @@ smith-waterman
254
253
  kept 13 (0.361) unproductive
255
254
  water time: 0.0
256
255
  hmm
257
- subcluster annotating 15 clusters with steps: (0.6s) (0.3s)
256
+ subcluster annotating 15 clusters with steps: (0.7s) (0.2s)
258
257
  subcluster annotation time 0.9
259
- total time: 1.1
258
+ total time: 1.0
260
259
  need to get annotations for 13/15 joint igk clusters
261
- tag: v1.0.13
262
260
  annotate igh+igk: igk
263
261
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
264
262
  run partis annotate --locus igk --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igk --max-ccf-fail-frac 0.10 --only-csv-plots --no-partition-plots --random-seed 1 --n-procs 10 --refuse-to-cache-parameters --infname test/paired/new-results/partition-new-simu/igh+igk/input-seqs-igk.fa --outfname test/paired/new-results/partition-new-simu/igh+igk/partition-igk.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igk/sw-cache.yaml --input-metafnames test/paired/new-results/partition-new-simu/igh+igk/meta-igk.yaml --ignore-sw-pair-info --input-partition-fname test/paired/new-results/partition-new-simu/igh+igk/partition-igk-only-partition.yaml
@@ -266,14 +264,14 @@ hmm
266
264
  --input-partition-fname: read best partition with 36 sequences in 15 clusters from test/paired/new-results/partition-new-simu/igh+igk/partition-igk-only-partition.yaml
267
265
  annotating (with test/paired/new-results/test/parameters/simu/igk/hmm)
268
266
  smith-waterman
269
- vsearch: 36 / 36 v annotations (0 failed) with 5 v genes in 0.1 sec
267
+ vsearch: 36 / 36 v annotations (0 failed) with 5 v genes in 0.2 sec
270
268
  reading sw results from test/paired/new-results/test/parameters/simu/igk/sw-cache.yaml
271
269
  info for 36 / 36 = 1.000 (removed: 0 failed, 0 duplicates [removed when cache file was written])
272
270
  kept 14 (0.389) unproductive
273
271
  water time: 0.0
274
272
  hmm
275
- subcluster annotating 15 clusters with steps: (0.6s) (0.2s)
276
- subcluster annotation time 0.8
273
+ subcluster annotating 15 clusters with steps: (0.5s) (0.2s)
274
+ subcluster annotation time 0.7
277
275
  total time: 1.0
278
276
  igh+igl: synchronizing heavy and light chain cluster paths
279
277
  removing badly + unpaired seqs: kept 7 total unpaired (i.e. setting aside in order to reintegrate after paired clustering): h 3 l 4
@@ -300,7 +298,6 @@ hmm
300
298
  joint 1.000 0.611
301
299
  merge time 0.0
302
300
  need to get annotations for 5/8 joint igh clusters
303
- tag: v1.0.13
304
301
  annotate igh+igl: igh
305
302
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
306
303
  run partis annotate --locus igh --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igh --max-ccf-fail-frac 0.10 --only-csv-plots --no-partition-plots --random-seed 1 --n-procs 10 --refuse-to-cache-parameters --infname test/paired/new-results/partition-new-simu/igh+igl/input-seqs-igh.fa --outfname test/paired/new-results/partition-new-simu/igh+igl/partition-igh.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igh/sw-cache.yaml --input-metafnames test/paired/new-results/partition-new-simu/igh+igl/meta-igh.yaml --ignore-sw-pair-info --input-partition-fname test/paired/new-results/partition-new-simu/igh+igl/partition-igh-only-partition.yaml
@@ -308,17 +305,16 @@ hmm
308
305
  --input-partition-fname: read best partition with 20 sequences in 8 clusters from test/paired/new-results/partition-new-simu/igh+igl/partition-igh-only-partition.yaml
309
306
  annotating (with test/paired/new-results/test/parameters/simu/igh/hmm)
310
307
  smith-waterman
311
- vsearch: 20 / 20 v annotations (0 failed) with 4 v genes in 0.1 sec
308
+ vsearch: 20 / 20 v annotations (0 failed) with 4 v genes in 0.2 sec
312
309
  reading sw results from test/paired/new-results/test/parameters/simu/igh/sw-cache.yaml
313
310
  info for 20 / 20 = 1.000 (removed: 0 failed, 0 duplicates [removed when cache file was written])
314
311
  kept 12 (0.600) unproductive
315
312
  water time: 0.0
316
313
  hmm
317
- subcluster annotating 8 clusters with steps: (0.6s) (0.3s)
318
- subcluster annotation time 0.9
319
- total time: 1.1
314
+ subcluster annotating 8 clusters with steps: (0.4s) (0.3s)
315
+ subcluster annotation time 0.7
316
+ total time: 0.9
320
317
  need to get annotations for 8/8 joint igl clusters
321
- tag: v1.0.13
322
318
  annotate igh+igl: igl
323
319
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
324
320
  run partis annotate --locus igl --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igl --max-ccf-fail-frac 0.10 --only-csv-plots --no-partition-plots --random-seed 1 --n-procs 10 --refuse-to-cache-parameters --infname test/paired/new-results/partition-new-simu/igh+igl/input-seqs-igl.fa --outfname test/paired/new-results/partition-new-simu/igh+igl/partition-igl.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igl/sw-cache.yaml --input-metafnames test/paired/new-results/partition-new-simu/igh+igl/meta-igl.yaml --ignore-sw-pair-info --input-partition-fname test/paired/new-results/partition-new-simu/igh+igl/partition-igl-only-partition.yaml
@@ -326,15 +322,15 @@ hmm
326
322
  --input-partition-fname: read best partition with 21 sequences in 8 clusters from test/paired/new-results/partition-new-simu/igh+igl/partition-igl-only-partition.yaml
327
323
  annotating (with test/paired/new-results/test/parameters/simu/igl/hmm)
328
324
  smith-waterman
329
- vsearch: 21 / 21 v annotations (0 failed) with 3 v genes in 0.2 sec
325
+ vsearch: 21 / 21 v annotations (0 failed) with 3 v genes in 0.1 sec
330
326
  reading sw results from test/paired/new-results/test/parameters/simu/igl/sw-cache.yaml
331
327
  info for 21 / 21 = 1.000 (removed: 0 failed, 0 duplicates [removed when cache file was written])
332
328
  kept 14 (0.667) unproductive
333
329
  water time: 0.0
334
330
  hmm
335
- subcluster annotating 8 clusters with steps: (0.4s) (0.2s)
336
- subcluster annotation time 0.7
337
- total time: 0.9
331
+ subcluster annotating 8 clusters with steps: (0.3s) (0.1s)
332
+ subcluster annotation time 0.5
333
+ total time: 0.6
338
334
  concatenating heavy chain loci:
339
335
  h starting with 15 annotations (36 seqs)
340
336
  k starting with 15 annotations (36 seqs)
@@ -347,7 +343,7 @@ hmm
347
343
  h 20 --> 23 +3
348
344
  k 6 --> 15 +9
349
345
  l 3 --> 8 +5
350
- total time: 43.8
346
+ total time: 33.5
351
347
  subset-partition-new-simu partis subset-partition --dont-write-git-info --paired-loci --paired-indir test/paired/ref-results/test/simu --max-ccf-fail-frac 0.15 --is-simu --n-subsets 2 --random-seed 1 --n-procs 10 --paired-outdir test/paired/new-results/subset-partition-new-simu
352
348
  note: --input-metafnames not specified, so setting to default location test/paired/ref-results/test/simu/meta.yaml
353
349
  --input-metafnames: added meta info for 113 sequences from test/paired/ref-results/test/simu/meta.yaml: loci paired-uids
@@ -376,12 +372,9 @@ hmm
376
372
  writing merged outputs from 2 subsets to test/paired/new-results/subset-partition-new-simu/merged-subsets
377
373
  writing combined h/l info to fasta and meta files in test/paired/new-results/subset-partition-new-simu/merged-subsets
378
374
  merging parameters from 2 subdirs (e.g. test/paired/new-results/subset-partition-new-simu/isub-0) to test/paired/new-results/subset-partition-new-simu/merged-subsets
379
- tag: v1.0.13
380
- tag: v1.0.13
381
- tag: v1.0.13
382
375
  run partis partition --dont-write-git-info --paired-loci --paired-indir test/paired/ref-results/test/simu --max-ccf-fail-frac 0.15 --is-simu --random-seed 1 --n-procs 10 --paired-outdir test/paired/new-results/subset-partition-new-simu --input-metafnames test/paired/new-results/subset-partition-new-simu/merged-subsets/meta.yaml --input-partition-fname test/paired/new-results/subset-partition-new-simu/merged-subsets --continue-from-input-partition --parameter-dir test/paired/new-results/subset-partition-new-simu/merged-subsets/parameters --ignore-sw-pair-info --refuse-to-cache-parameters --ignore-default-input-metafile
383
376
  log: test/paired/new-results/subset-partition-new-simu/merged-partition.log
384
- total time: 177.4
377
+ total time: 115.5
385
378
  seed-partition-new-simu partis partition --dont-write-git-info --paired-loci --paired-indir test/paired/ref-results/test/simu --parameter-dir test/paired/new-results/test/parameters/simu --max-ccf-fail-frac 0.10 --is-simu --seed-unique-id 3542bd38d8-igh:3542bd38d8-igk --seed-loci igh:igk --random-seed 1 --n-procs 10 --paired-outdir test/paired/new-results/seed-partition-new-simu
386
379
  removing seqs very different from seed seq
387
380
  wrong/no removed singly kept missing
@@ -400,49 +393,49 @@ hmm
400
393
  --input-metafnames: added meta info for 17 sequences from test/paired/ref-results/test/simu/meta.yaml: loci paired-uids
401
394
  partitioning (with test/paired/new-results/test/parameters/simu/igh/hmm)
402
395
  smith-waterman
403
- vsearch: 17 / 17 v annotations (0 failed) with 3 v genes in 0.1 sec
396
+ vsearch: 17 / 17 v annotations (0 failed) with 3 v genes in 0.2 sec
404
397
  reading sw results from test/paired/new-results/test/parameters/simu/igh/sw-cache.yaml
405
398
  info for 17 / 17 = 1.000 (removed: 0 failed, 0 duplicates [removed when cache file was written])
406
399
  kept 8 (0.471) unproductive
407
400
  water time: 0.0
408
401
  hmm
409
- caching all 17 naive sequences (0.7s)
402
+ caching all 17 naive sequences (0.5s)
410
403
  collapsed 17 queries into 17 clusters with identical naive seqs (0.0 sec)
411
- 17 clusters with 10 procs (0.5s)
412
- 17 clusters with 7 procs (0.5s)
413
- 17 clusters with 5 procs (0.5s)
414
- 17 clusters with 3 procs (0.6s)
415
- 14 clusters with 2 procs (0.5s)
416
- 14 clusters with 1 proc (0.7s)
417
- partition loop time: 3.2
404
+ 17 clusters with 10 procs (0.4s)
405
+ 17 clusters with 7 procs (0.4s)
406
+ 17 clusters with 5 procs (0.4s)
407
+ 17 clusters with 3 procs (0.4s)
408
+ 14 clusters with 2 procs (0.4s)
409
+ 14 clusters with 1 proc (0.5s)
410
+ partition loop time: 2.5
418
411
  getting annotations for final partition
419
412
  reading output
420
413
  read 12 hmm output lines with 17 sequences in 12 events (0 failures)
421
- hmm step time: 0.5
422
- total time: 4.6
414
+ hmm step time: 0.4
415
+ total time: 3.6
423
416
  partition igk:
424
417
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
425
418
  run partis partition --locus igk --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igk --max-ccf-fail-frac 0.10 --random-seed 1 --n-procs 10 --refuse-to-cache-parameters --infname test/paired/new-results/seed-partition-new-simu/seeds/3542bd38d8-igh+3542bd38d8-igk/single-chain/input-seqs-igk.fa --outfname test/paired/new-results/seed-partition-new-simu/seeds/3542bd38d8-igh+3542bd38d8-igk/single-chain/partition-igk.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igk/sw-cache.yaml --input-metafnames test/paired/ref-results/test/simu/meta.yaml
426
419
  --input-metafnames: added meta info for 12 sequences from test/paired/ref-results/test/simu/meta.yaml: loci paired-uids
427
420
  partitioning (with test/paired/new-results/test/parameters/simu/igk/hmm)
428
421
  smith-waterman
429
- vsearch: 12 / 12 v annotations (0 failed) with 2 v genes in 0.2 sec
422
+ vsearch: 12 / 12 v annotations (0 failed) with 2 v genes in 0.1 sec
430
423
  reading sw results from test/paired/new-results/test/parameters/simu/igk/sw-cache.yaml
431
424
  info for 12 / 12 = 1.000 (removed: 0 failed, 0 duplicates [removed when cache file was written])
432
425
  kept 7 (0.583) unproductive
433
426
  water time: 0.0
434
427
  hmm
435
- caching all 12 naive sequences (0.4s)
428
+ caching all 12 naive sequences (0.3s)
436
429
  collapsed 12 queries into 3 clusters with identical naive seqs (0.0 sec)
437
430
  reducing n procs to number of clusters: 10 --> 3
438
431
  3 clusters with 3 procs (0.2s)
439
- 3 clusters with 2 procs (0.1s)
432
+ 3 clusters with 2 procs (0.2s)
440
433
  3 clusters with 1 proc (0.2s)
441
- partition loop time: 0.6
434
+ partition loop time: 0.5
442
435
  getting annotations for final partition
443
- subcluster annotating 2 clusters with steps: (0.3s) (0.2s) (0.2s)
444
- subcluster annotation time 0.7
445
- total time: 1.9
436
+ subcluster annotating 2 clusters with steps: (0.2s) (0.2s) (0.2s)
437
+ subcluster annotation time 0.6
438
+ total time: 1.6
446
439
  partition igl:
447
440
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
448
441
  run partis partition --locus igl --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igl --max-ccf-fail-frac 0.10 --random-seed 1 --n-procs 10 --refuse-to-cache-parameters --infname test/paired/new-results/seed-partition-new-simu/seeds/3542bd38d8-igh+3542bd38d8-igk/single-chain/input-seqs-igl.fa --outfname test/paired/new-results/seed-partition-new-simu/seeds/3542bd38d8-igh+3542bd38d8-igk/single-chain/partition-igl.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igl/sw-cache.yaml --input-metafnames test/paired/ref-results/test/simu/meta.yaml
@@ -455,17 +448,17 @@ smith-waterman
455
448
  info for 4 / 4 = 1.000 (removed: 0 failed, 0 duplicates [removed when cache file was written])
456
449
  water time: 0.0
457
450
  hmm
458
- caching all 4 naive sequences (0.3s)
451
+ caching all 4 naive sequences (0.2s)
459
452
  collapsed 4 queries into 2 clusters with identical naive seqs (0.0 sec)
460
453
  reducing n procs to number of clusters: 4 --> 2
461
454
  2 clusters with 2 procs (0.2s)
462
- 2 clusters with 1 proc (0.3s)
455
+ 2 clusters with 1 proc (0.2s)
463
456
  partition loop time: 0.4
464
457
  getting annotations for final partition
465
458
  reading output
466
459
  read 2 hmm output lines with 4 sequences in 2 events (0 failures)
467
- hmm step time: 0.2
468
- total time: 1.0
460
+ hmm step time: 0.1
461
+ total time: 0.9
469
462
  combining chains
470
463
  cleaning pair info for 33 seqs
471
464
  synchronized/fixed 0 pairs where one had no pair info after cleaning: h 0 k 0 l 0
@@ -504,7 +497,6 @@ WARNING using errors instead of sumw2 with weight != 1.0 in Hist::fill_ibin()
504
497
  merge time 0.0
505
498
  removed 7 unseeded clusters (of 8 total, leaving 1) from igh joint partition
506
499
  seed cluster size in best joint partition: 1, excluding seed seq: 0
507
- tag: v1.0.13
508
500
  annotate igh+igk: igh
509
501
  removed 2 arg strs that were specific to action 'partition': --seed-unique-id 3542bd38d8-igh:3542bd38d8-igk
510
502
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
@@ -521,12 +513,11 @@ smith-waterman
521
513
  hmm
522
514
  reading output
523
515
  read 1 hmm output lines with 1 sequences in 1 events (0 failures)
524
- hmm step time: 0.3
525
- total time: 0.4
516
+ hmm step time: 0.2
517
+ total time: 0.3
526
518
  removed 7 unseeded clusters (of 8 total, leaving 1) from igk joint partition
527
519
  need to get annotations for 1/1 joint igk clusters
528
520
  seed cluster size in best joint partition: 1, excluding seed seq: 0
529
- tag: v1.0.13
530
521
  annotate igh+igk: igk
531
522
  removed 2 arg strs that were specific to action 'partition': --seed-unique-id 3542bd38d8-igh:3542bd38d8-igk
532
523
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
@@ -544,8 +535,8 @@ smith-waterman
544
535
  hmm
545
536
  reading output
546
537
  read 1 hmm output lines with 1 sequences in 1 events (0 failures)
547
- hmm step time: 0.2
548
- total time: 0.3
538
+ hmm step time: 0.1
539
+ total time: 0.2
549
540
  igh+igl: synchronizing heavy and light chain cluster paths
550
541
  removing badly + unpaired seqs: kept 1 total unpaired (i.e. setting aside in order to reintegrate after paired clustering): h 1 l 0
551
542
  note: discarding unpaired seqs in families with no (well-)paired seqs (i.e. families that are all either unpaired or paired to the other/wrong light chain), rather than keeping track of them to re-add later
@@ -573,7 +564,7 @@ hmm
573
564
  N clusters with all seqs:
574
565
  h 12 --> 1 -11
575
566
  k 2 --> 1 -1
576
- total time: 23.9
567
+ total time: 15.9
577
568
  get-selection-metrics-new-simu partis get-selection-metrics --dont-write-git-info --paired-loci --existing-output-run-cfg paired --min-selection-metric-cluster-size 3 --min-paired-cluster-size-to-read 3 --random-seed 1 --n-procs 10 --paired-outdir test/paired/new-results/partition-new-simu --chosen-ab-fname test/paired/new-results/get-selection-metrics-new-simu-chosen-abs.csv
578
569
  get-selection-metrics igh+igk: igh
579
570
  run partis get-selection-metrics --locus igh --dont-write-git-info --min-selection-metric-cluster-size 3 --min-paired-cluster-size-to-read 3 --random-seed 1 --n-procs 10 --chosen-ab-fname test/paired/new-results/get-selection-metrics-new-simu-chosen-abs.csv --refuse-to-cache-parameters --outfname test/paired/new-results/partition-new-simu/igh+igk/partition-igh.yaml
@@ -609,7 +600,7 @@ hmm
609
600
  starting 2 jobs
610
601
  run /Users/runner/work/partis/partis/bin/FastTree-macos -gtr -nt -out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igk/fasttree/iclust-0/fasttree.out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igk/fasttree/iclust-0/input-seqs.fa
611
602
  run /Users/runner/work/partis/partis/bin/FastTree-macos -gtr -nt -out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igk/fasttree/iclust-1/fasttree.out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igk/fasttree/iclust-1/input-seqs.fa
612
- made 2 fasttree trees (0.3s)
603
+ made 2 fasttree trees (0.2s)
613
604
  tree origins: 2 ran fasttree
614
605
  skipped 2/4 clusters smaller than 4
615
606
  setting default tau to 1 / 337 = 0.0030
@@ -620,7 +611,7 @@ hmm
620
611
  warning get_aa_tree() (AA inf tree, iclust 1): skipped 2/9 edges for which we didn't have sequences for both nodes (i.e. left the original branch length unmodified). Missing nodes: eov
621
612
  skipped 2/4 clusters that had no uids in common with tree
622
613
  writing selection metrics to test/paired/new-results/partition-new-simu/igh+igk/partition-igk-selection-metrics.yaml
623
- total time: 0.4
614
+ total time: 0.3
624
615
  get-selection-metrics igh+igl: igh
625
616
  run partis get-selection-metrics --locus igh --dont-write-git-info --min-selection-metric-cluster-size 3 --min-paired-cluster-size-to-read 3 --random-seed 1 --n-procs 10 --chosen-ab-fname test/paired/new-results/get-selection-metrics-new-simu-chosen-abs.csv --refuse-to-cache-parameters --outfname test/paired/new-results/partition-new-simu/igh+igl/partition-igh.yaml
626
617
  note: --parameter-dir not set, so using default: x-dummy-x
@@ -631,7 +622,7 @@ hmm
631
622
  getting trees for 1 cluster with size: 8
632
623
  starting 1 jobs
633
624
  run /Users/runner/work/partis/partis/bin/FastTree-macos -gtr -nt -out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igl/partition-igh/fasttree/iclust-0/fasttree.out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igl/partition-igh/fasttree/iclust-0/input-seqs.fa
634
- made 1 fasttree trees (0.2s)
625
+ made 1 fasttree trees (0.1s)
635
626
  tree origins: 1 ran fasttree
636
627
  skipped 1/2 clusters smaller than 4
637
628
  setting default tau to 1 / 376 = 0.0027
@@ -641,7 +632,7 @@ hmm
641
632
  calculating normalized lb index and lb ratio and lb fraction on aa tree with tau 0.0027
642
633
  skipped 1/2 clusters that had no uids in common with tree
643
634
  writing selection metrics to test/paired/new-results/partition-new-simu/igh+igl/partition-igh-selection-metrics.yaml
644
- total time: 0.3
635
+ total time: 0.2
645
636
  get-selection-metrics igh+igl: igl
646
637
  run partis get-selection-metrics --locus igl --dont-write-git-info --min-selection-metric-cluster-size 3 --min-paired-cluster-size-to-read 3 --random-seed 1 --n-procs 10 --chosen-ab-fname test/paired/new-results/get-selection-metrics-new-simu-chosen-abs.csv --refuse-to-cache-parameters --outfname test/paired/new-results/partition-new-simu/igh+igl/partition-igl.yaml
647
638
  note: --parameter-dir not set, so using default: x-dummy-x
@@ -653,7 +644,7 @@ hmm
653
644
  starting 2 jobs
654
645
  run /Users/runner/work/partis/partis/bin/FastTree-macos -gtr -nt -out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igl/partition-igl/fasttree/iclust-0/fasttree.out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igl/partition-igl/fasttree/iclust-0/input-seqs.fa
655
646
  run /Users/runner/work/partis/partis/bin/FastTree-macos -gtr -nt -out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igl/partition-igl/fasttree/iclust-1/fasttree.out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igl/partition-igl/fasttree/iclust-1/input-seqs.fa
656
- made 2 fasttree trees (0.3s)
647
+ made 2 fasttree trees (0.2s)
657
648
  tree origins: 2 ran fasttree
658
649
  setting default tau to 1 / 334 = 0.0030
659
650
  calculating normalized lb index and lb ratio and lb fraction with tau 0.0030
@@ -661,7 +652,7 @@ hmm
661
652
  setting default tau to 1 / 334 = 0.0030
662
653
  calculating normalized lb index and lb ratio and lb fraction on aa tree with tau 0.0030
663
654
  writing selection metrics to test/paired/new-results/partition-new-simu/igh+igl/partition-igl-selection-metrics.yaml
664
- total time: 0.4
655
+ total time: 0.3
665
656
  getting combined h/l selection metrics
666
657
  igh+igk: 13 unpaired light clusters after finding h/l cluster pairs
667
658
  igh+igk: skipped 13 annotations with N h or l ids < 3 (controlled by --min-paired-cluster-size-to-read) (keeping 2 annotation pairs)
@@ -681,7 +672,7 @@ hmm
681
672
  run /Users/runner/work/partis/partis/bin/FastTree-macos -gtr -nt -out test/paired/new-results/partition-new-simu/fasttree/iclust-0/fasttree.out test/paired/new-results/partition-new-simu/fasttree/iclust-0/input-seqs.fa
682
673
  run /Users/runner/work/partis/partis/bin/FastTree-macos -gtr -nt -out test/paired/new-results/partition-new-simu/fasttree/iclust-1/fasttree.out test/paired/new-results/partition-new-simu/fasttree/iclust-1/input-seqs.fa
683
674
  run /Users/runner/work/partis/partis/bin/FastTree-macos -gtr -nt -out test/paired/new-results/partition-new-simu/fasttree/iclust-2/fasttree.out test/paired/new-results/partition-new-simu/fasttree/iclust-2/input-seqs.fa
684
- made 3 fasttree trees (0.4s)
675
+ made 3 fasttree trees (0.3s)
685
676
  tree origins: 3 ran fasttree
686
677
  skipped 1/4 clusters smaller than 4
687
678
  setting default tau to 1 / 714 = 0.0014
@@ -694,10 +685,10 @@ hmm
694
685
  skipped 1/4 clusters that had no uids in common with tree
695
686
  writing selection metrics to test/paired/new-results/partition-new-simu/selection-metrics.yaml
696
687
  writing 10 chosen abs to test/paired/new-results/get-selection-metrics-new-simu-chosen-abs.csv
697
- total time: 12.6
688
+ total time: 9.1
698
689
  cache-parameters-data partis cache-parameters --dont-write-git-info --paired-loci --infname test/paired-data/all-seqs.fa --parameter-dir test/paired/new-results/test/parameters/data --n-max-queries 100 --random-seed 1 --n-procs 10
699
690
  note: --paired-outdir is not set, so there will be no persistent record of the results (except the parameter directory).
700
- run extract-pairing-info.py test/paired-data/all-seqs.fa /tmp/runner/hmms/263977/meta.yaml --n-max-queries 100
691
+ run extract-pairing-info.py test/paired-data/all-seqs.fa /tmp/runner/hmms/159476/meta.yaml --n-max-queries 100
701
692
  --n-max-queries: chose 48 / 48 droplets (first 100, after random shuffling) which had 100 / 100 seqs
702
693
  extract_pairing_info(): read 100 sequences with 48 droplet ids
703
694
  droplet id separators (set automatically): _ indices: [0]
@@ -708,14 +699,14 @@ hmm
708
699
  2 42 0.875
709
700
  3 2 0.042
710
701
  4 2 0.042
711
- run split-loci.py test/paired-data/all-seqs.fa --outdir /tmp/runner/hmms/263977 --input-metafname /tmp/runner/hmms/263977/meta.yaml --n-max-queries 100
702
+ run split-loci.py test/paired-data/all-seqs.fa --outdir /tmp/runner/hmms/159476 --input-metafname /tmp/runner/hmms/159476/meta.yaml --n-max-queries 100
712
703
  --n-max-queries: chose 48 / 48 droplets (first 100, after random shuffling) which had 100 / 100 seqs
713
- --input-metafnames: added meta info for 100 sequences from /tmp/runner/hmms/263977/meta.yaml: paired-uids
704
+ --input-metafnames: added meta info for 100 sequences from /tmp/runner/hmms/159476/meta.yaml: paired-uids
714
705
  read pairing info for 100 seqs from input meta file
715
706
  running vsearch on 100 sequences:
716
- igh: 49 / 100 v annotations (51 failed) with 28 v genes in 0.3 sec
707
+ igh: 49 / 100 v annotations (51 failed) with 28 v genes in 0.1 sec
717
708
  igk: 40 / 100 v annotations (60 failed) with 18 v genes in 0.2 sec
718
- igl: 15 / 100 v annotations (85 failed) with 12 v genes in 0.2 sec
709
+ igl: 15 / 100 v annotations (85 failed) with 12 v genes in 0.1 sec
719
710
  totals: igh 48 igk 37 igl 15
720
711
  count frac paired with
721
712
  h 31 0.65 k
@@ -733,10 +724,10 @@ totals: igh 48 igk 37 igl 15
733
724
  2 0.13 h l
734
725
  1 0.07 h k
735
726
  1 0.07 h h k
736
- writing to /tmp/runner/hmms/263977/
737
- igh: 48 to 263977/igh.fa
738
- igk: 37 to 263977/igk.fa
739
- igl: 15 to 263977/igl.fa
727
+ writing to /tmp/runner/hmms/159476/
728
+ igh: 48 to 159476/igh.fa
729
+ igk: 37 to 159476/igk.fa
730
+ igl: 15 to 159476/igl.fa
740
731
  writing to paired subdirs
741
732
  igh+igk:
742
733
  igh: 36 / 48 to igh+igk/igh.fa
@@ -745,107 +736,107 @@ writing to paired subdirs
745
736
  igh: 15 / 48 to igh+igl/igh.fa
746
737
  igl: 15 / 15 to igh+igl/igl.fa
747
738
  cache-parameters igh:
748
- run partis cache-parameters --locus igh --dont-write-git-info --infname /tmp/runner/hmms/263977/igh.fa --parameter-dir test/paired/new-results/test/parameters/data/igh --random-seed 1 --n-procs 10 --sw-cachefname test/paired/new-results/test/parameters/data/igh/sw-cache.yaml --input-metafnames /tmp/runner/hmms/263977/meta.yaml
749
- --input-metafnames: added meta info for 48 sequences from /tmp/runner/hmms/263977/meta.yaml: paired-uids
739
+ run partis cache-parameters --locus igh --dont-write-git-info --infname /tmp/runner/hmms/159476/igh.fa --parameter-dir test/paired/new-results/test/parameters/data/igh --random-seed 1 --n-procs 10 --sw-cachefname test/paired/new-results/test/parameters/data/igh/sw-cache.yaml --input-metafnames /tmp/runner/hmms/159476/meta.yaml
740
+ --input-metafnames: added meta info for 48 sequences from /tmp/runner/hmms/159476/meta.yaml: paired-uids
750
741
  caching parameters
751
742
  vsearch: 48 / 48 v annotations (0 failed) with 27 v genes in 0.1 sec
752
743
  keeping 23 / 198 v genes
753
744
  smith-waterman (new-allele fitting)
754
- vsearch: 48 / 48 v annotations (0 failed) with 23 v genes in 0.2 sec
745
+ vsearch: 48 / 48 v annotations (0 failed) with 23 v genes in 0.1 sec
755
746
  running 10 procs for 48 seqs
756
747
  info for 48 / 48 = 1.000 (removed: 0 failed)
757
748
  kept 1 (0.021) unproductive
758
- water time: 0.3 (ig-sw 0.1 processing 0.3)
749
+ water time: 0.2 (ig-sw 0.0 processing 0.2)
759
750
  smith-waterman (writing parameters)
760
751
  vsearch: 48 / 48 v annotations (0 failed) with 23 v genes in 0.2 sec
761
752
  running 10 procs for 48 seqs
762
753
  info for 48 / 48 = 1.000 (removed: 0 failed)
763
754
  kept 1 (0.021) unproductive
764
755
  writing sw results to test/paired/new-results/test/parameters/data/igh/sw-cache.yaml
765
- writing parameters to test/paired/new-results/test/parameters/data/igh/sw (6.4 sec)
766
- water time: 6.9 (ig-sw 6.6 processing 0.3)
756
+ writing parameters to test/paired/new-results/test/parameters/data/igh/sw (2.7 sec)
757
+ water time: 3.0 (ig-sw 2.8 processing 0.2)
767
758
  writing hmms removed 13 genes from glfo (leaving v 23 d 19 j 6)
768
759
 
769
760
  note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
770
- (2.9 sec)
761
+ (1.9 sec)
771
762
  hmm
772
763
  reading output
773
764
  read 48 hmm output lines with 48 sequences in 48 events (0 failures)
774
- writing parameters to test/paired/new-results/test/parameters/data/igh/hmm (4.8 sec)
775
- infra time: 5.0
776
- hmm step time: 6.3
765
+ writing parameters to test/paired/new-results/test/parameters/data/igh/hmm (2.6 sec)
766
+ infra time: 2.8
767
+ hmm step time: 3.7
777
768
  writing hmms removed 1 genes from glfo (leaving v 23 d 18 j 6)
778
769
 
779
770
  note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
780
- (2.4 sec)
781
- total time: 19.9
771
+ (1.9 sec)
772
+ total time: 11.3
782
773
  cache-parameters igk:
783
- run partis cache-parameters --locus igk --dont-write-git-info --infname /tmp/runner/hmms/263977/igk.fa --parameter-dir test/paired/new-results/test/parameters/data/igk --random-seed 1 --n-procs 10 --sw-cachefname test/paired/new-results/test/parameters/data/igk/sw-cache.yaml --input-metafnames /tmp/runner/hmms/263977/meta.yaml
784
- --input-metafnames: added meta info for 37 sequences from /tmp/runner/hmms/263977/meta.yaml: paired-uids
774
+ run partis cache-parameters --locus igk --dont-write-git-info --infname /tmp/runner/hmms/159476/igk.fa --parameter-dir test/paired/new-results/test/parameters/data/igk --random-seed 1 --n-procs 10 --sw-cachefname test/paired/new-results/test/parameters/data/igk/sw-cache.yaml --input-metafnames /tmp/runner/hmms/159476/meta.yaml
775
+ --input-metafnames: added meta info for 37 sequences from /tmp/runner/hmms/159476/meta.yaml: paired-uids
785
776
  caching parameters
786
- vsearch: 37 / 37 v annotations (0 failed) with 16 v genes in 0.1 sec
777
+ vsearch: 37 / 37 v annotations (0 failed) with 16 v genes in 0.2 sec
787
778
  keeping 16 / 64 v genes
788
779
  smith-waterman (new-allele fitting)
789
- vsearch: 37 / 37 v annotations (0 failed) with 16 v genes in 0.1 sec
780
+ vsearch: 37 / 37 v annotations (0 failed) with 16 v genes in 0.2 sec
790
781
  running 10 procs for 37 seqs
791
782
  info for 37 / 37 = 1.000 (removed: 0 failed)
792
783
  kept 1 (0.027) unproductive
793
- water time: 0.2 (ig-sw 0.0 processing 0.2)
784
+ water time: 0.2 (ig-sw 0.0 processing 0.1)
794
785
  smith-waterman (writing parameters)
795
- vsearch: 37 / 37 v annotations (0 failed) with 16 v genes in 0.2 sec
786
+ vsearch: 37 / 37 v annotations (0 failed) with 16 v genes in 0.3 sec
796
787
  running 10 procs for 37 seqs
797
788
  info for 37 / 37 = 1.000 (removed: 0 failed)
798
789
  kept 1 (0.027) unproductive
799
790
  writing sw results to test/paired/new-results/test/parameters/data/igk/sw-cache.yaml
800
- writing parameters to test/paired/new-results/test/parameters/data/igk/sw (3.9 sec)
801
- water time: 4.2 (ig-sw 4.0 processing 0.2)
791
+ writing parameters to test/paired/new-results/test/parameters/data/igk/sw (2.0 sec)
792
+ water time: 2.3 (ig-sw 2.1 processing 0.1)
802
793
  writing hmms removed 0 genes from glfo (leaving v 16 d 1 j 7)
803
794
 
804
795
  note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
805
- (1.9 sec)
796
+ (1.2 sec)
806
797
  hmm
807
798
  reading output
808
799
  read 37 hmm output lines with 37 sequences in 37 events (0 failures)
809
- writing parameters to test/paired/new-results/test/parameters/data/igk/hmm (3.5 sec)
810
- infra time: 3.6
811
- hmm step time: 4.5
800
+ writing parameters to test/paired/new-results/test/parameters/data/igk/hmm (1.8 sec)
801
+ infra time: 1.9
802
+ hmm step time: 2.4
812
803
  writing hmms removed 0 genes from glfo (leaving v 16 d 1 j 7)
813
804
 
814
805
  note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
815
- (2.1 sec)
816
- total time: 13.5
806
+ (1.2 sec)
807
+ total time: 8.1
817
808
  cache-parameters igl:
818
- run partis cache-parameters --locus igl --dont-write-git-info --infname /tmp/runner/hmms/263977/igl.fa --parameter-dir test/paired/new-results/test/parameters/data/igl --random-seed 1 --n-procs 10 --sw-cachefname test/paired/new-results/test/parameters/data/igl/sw-cache.yaml --input-metafnames /tmp/runner/hmms/263977/meta.yaml
819
- --input-metafnames: added meta info for 15 sequences from /tmp/runner/hmms/263977/meta.yaml: paired-uids
809
+ run partis cache-parameters --locus igl --dont-write-git-info --infname /tmp/runner/hmms/159476/igl.fa --parameter-dir test/paired/new-results/test/parameters/data/igl --random-seed 1 --n-procs 10 --sw-cachefname test/paired/new-results/test/parameters/data/igl/sw-cache.yaml --input-metafnames /tmp/runner/hmms/159476/meta.yaml
810
+ --input-metafnames: added meta info for 15 sequences from /tmp/runner/hmms/159476/meta.yaml: paired-uids
820
811
  caching parameters
821
- vsearch: 15 / 15 v annotations (0 failed) with 12 v genes in 0.1 sec
812
+ vsearch: 15 / 15 v annotations (0 failed) with 12 v genes in 0.2 sec
822
813
  keeping 10 / 80 v genes
823
814
  smith-waterman (new-allele fitting)
824
- vsearch: 15 / 15 v annotations (0 failed) with 10 v genes in 0.1 sec
815
+ vsearch: 15 / 15 v annotations (0 failed) with 10 v genes in 0.2 sec
825
816
  running 10 procs for 15 seqs
826
817
  info for 15 / 15 = 1.000 (removed: 0 failed)
827
- water time: 0.2 (ig-sw 0.0 processing 0.2)
818
+ water time: 0.2 (ig-sw 0.0 processing 0.1)
828
819
  smith-waterman (writing parameters)
829
- vsearch: 15 / 15 v annotations (0 failed) with 10 v genes in 0.1 sec
820
+ vsearch: 15 / 15 v annotations (0 failed) with 10 v genes in 0.2 sec
830
821
  running 10 procs for 15 seqs
831
822
  info for 15 / 15 = 1.000 (removed: 0 failed)
832
823
  writing sw results to test/paired/new-results/test/parameters/data/igl/sw-cache.yaml
833
- writing parameters to test/paired/new-results/test/parameters/data/igl/sw (2.1 sec)
834
- water time: 2.4 (ig-sw 2.2 processing 0.2)
824
+ writing parameters to test/paired/new-results/test/parameters/data/igl/sw (1.3 sec)
825
+ water time: 1.5 (ig-sw 1.4 processing 0.2)
835
826
  writing hmms removed 6 genes from glfo (leaving v 10 d 1 j 3)
836
827
 
837
828
  note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
838
- (1.0 sec)
829
+ (0.7 sec)
839
830
  hmm
840
831
  reading output
841
832
  read 15 hmm output lines with 15 sequences in 15 events (0 failures)
842
- writing parameters to test/paired/new-results/test/parameters/data/igl/hmm (1.9 sec)
843
- infra time: 2.1
844
- hmm step time: 2.5
833
+ writing parameters to test/paired/new-results/test/parameters/data/igl/hmm (1.5 sec)
834
+ infra time: 1.6
835
+ hmm step time: 1.9
845
836
  writing hmms removed 0 genes from glfo (leaving v 10 d 1 j 3)
846
837
 
847
838
  note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
848
- (1.0 sec)
849
- total time: 7.6
850
- warning expected to remove 1/11 files+dirs that weren't in /tmp/runner/hmms/263977/: failed.fa
851
- total time: 53.9
839
+ (0.7 sec)
840
+ total time: 5.6
841
+ warning expected to remove 1/11 files+dirs that weren't in /tmp/runner/hmms/159476/: failed.fa
842
+ total time: 32.2