partis-bcr 1.0.8__py3-none-any.whl → 1.0.9.post1.dev1__py3-none-any.whl

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (156) hide show
  1. packages/ham/bcrham +0 -0
  2. packages/ig-sw/src/ig_align/ig-sw +0 -0
  3. {partis_bcr-1.0.8.dist-info → partis_bcr-1.0.9.post1.dev1.dist-info}/METADATA +1 -1
  4. {partis_bcr-1.0.8.dist-info → partis_bcr-1.0.9.post1.dev1.dist-info}/RECORD +155 -73
  5. test/new-results/get-selection-metrics-new-simu.yaml +1 -0
  6. test/new-results/test.log +12 -16
  7. test/paired/new-results/get-selection-metrics-new-simu-chosen-abs.csv +8 -8
  8. test/paired/new-results/partition-new-simu/fasttree/iclust-0/fasttree.out +1 -1
  9. test/paired/new-results/partition-new-simu/fasttree/iclust-0/log +8 -8
  10. test/paired/new-results/partition-new-simu/fasttree/iclust-1/fasttree.out +1 -1
  11. test/paired/new-results/partition-new-simu/fasttree/iclust-1/log +7 -7
  12. test/paired/new-results/partition-new-simu/fasttree/iclust-2/fasttree.out +1 -1
  13. test/paired/new-results/partition-new-simu/fasttree/iclust-2/log +9 -9
  14. test/paired/new-results/partition-new-simu/igh+igk/partition-igh/fasttree/iclust-0/fasttree.out +1 -1
  15. test/paired/new-results/partition-new-simu/igh+igk/partition-igh/fasttree/iclust-0/log +8 -8
  16. test/paired/new-results/partition-new-simu/igh+igk/partition-igh/fasttree/iclust-1/fasttree.out +1 -1
  17. test/paired/new-results/partition-new-simu/igh+igk/partition-igh/fasttree/iclust-1/log +9 -9
  18. test/paired/new-results/partition-new-simu/igh+igk/partition-igh-selection-metrics.yaml +1 -1
  19. test/paired/new-results/partition-new-simu/igh+igk/partition-igk/fasttree/iclust-0/fasttree.out +1 -1
  20. test/paired/new-results/partition-new-simu/igh+igk/partition-igk/fasttree/iclust-0/log +8 -8
  21. test/paired/new-results/partition-new-simu/igh+igk/partition-igk/fasttree/iclust-1/fasttree.out +1 -1
  22. test/paired/new-results/partition-new-simu/igh+igk/partition-igk/fasttree/iclust-1/log +4 -4
  23. test/paired/new-results/partition-new-simu/igh+igk/partition-igk-selection-metrics.yaml +1 -1
  24. test/paired/new-results/partition-new-simu/igh+igl/partition-igh/fasttree/iclust-0/fasttree.out +1 -1
  25. test/paired/new-results/partition-new-simu/igh+igl/partition-igh/fasttree/iclust-0/log +9 -9
  26. test/paired/new-results/partition-new-simu/igh+igl/partition-igh-selection-metrics.yaml +1 -1
  27. test/paired/new-results/partition-new-simu/igh+igl/partition-igl/fasttree/iclust-0/fasttree.out +1 -1
  28. test/paired/new-results/partition-new-simu/igh+igl/partition-igl/fasttree/iclust-0/log +9 -9
  29. test/paired/new-results/partition-new-simu/igh+igl/partition-igl/fasttree/iclust-1/log +3 -3
  30. test/paired/new-results/partition-new-simu/igh+igl/partition-igl-selection-metrics.yaml +1 -1
  31. test/paired/new-results/partition-new-simu/selection-metrics.yaml +1 -1
  32. test/paired/new-results/partition-new-simu/single-chain/partition-igh.yaml +1 -1
  33. test/paired/new-results/partition-new-simu-annotation-performance/plots/flcount-matrix.svg +107 -107
  34. test/paired/new-results/partition-new-simu-annotation-performance/plots/func-non-func-per-drop-log.svg +83 -83
  35. test/paired/new-results/partition-new-simu-annotation-performance/plots/func-non-func-per-drop.svg +61 -61
  36. test/paired/new-results/partition-new-simu-annotation-performance/plots/paired-seqs-per-seq-after.svg +18 -18
  37. test/paired/new-results/partition-new-simu-annotation-performance/plots/paired-seqs-per-seq-before.svg +24 -24
  38. test/paired/new-results/partition-new-simu-annotation-performance/plots/pseq-matrix.svg +35 -35
  39. test/paired/new-results/partition-new-simu-annotation-performance/plots/seqs-per-droplet.svg +22 -22
  40. test/paired/new-results/partition-new-simu-annotation-performance/plots/true-pair-clean-performance-correct-family.svg +45 -45
  41. test/paired/new-results/partition-new-simu-annotation-performance/plots/true-pair-clean-performance-correct.svg +45 -45
  42. test/paired/new-results/partition-new-simu-annotation-performance/plots/true-pair-clean-performance-mispaired.svg +45 -45
  43. test/paired/new-results/partition-new-simu-annotation-performance/plots/true-pair-clean-performance-multiple.svg +15 -15
  44. test/paired/new-results/partition-new-simu-annotation-performance/plots/true-pair-clean-performance-near-family.svg +15 -15
  45. test/paired/new-results/partition-new-simu-annotation-performance/plots/true-pair-clean-performance-total.svg +47 -47
  46. test/paired/new-results/partition-new-simu-annotation-performance/plots/true-pair-clean-performance-unpaired.svg +48 -48
  47. test/paired/new-results/partition-new-simu-annotation-performance/plots/true-pair-clean-performance.svg +27 -27
  48. test/paired/new-results/run-times.csv +6 -6
  49. test/paired/new-results/subset-partition-new-simu/isub-0/partition.log +86 -102
  50. test/paired/new-results/subset-partition-new-simu/isub-1/igh+igk/partition-igh.yaml +1 -1
  51. test/paired/new-results/subset-partition-new-simu/isub-1/partition-igh.yaml +1 -1
  52. test/paired/new-results/subset-partition-new-simu/isub-1/partition.log +84 -100
  53. test/paired/new-results/subset-partition-new-simu/isub-1/single-chain/partition-igh.yaml +1 -1
  54. test/paired/new-results/subset-partition-new-simu/merged-partition.log +50 -54
  55. test/paired/new-results/subset-partition-new-simu/merged-subsets/igh+igk/partition-igh.yaml +1 -1
  56. test/paired/new-results/subset-partition-new-simu/merged-subsets/parameters/igh/sw-cache.yaml +1 -1
  57. test/paired/new-results/subset-partition-new-simu/merged-subsets/parameters/igk/sw-cache.yaml +1 -1
  58. test/paired/new-results/subset-partition-new-simu/merged-subsets/parameters/igl/sw-cache.yaml +1 -1
  59. test/paired/new-results/subset-partition-new-simu/merged-subsets/partition-igh.yaml +1 -1
  60. test/paired/new-results/test.log +203 -236
  61. test/ref-results/partition-new-simu/fasttree/iclust-0/fasttree.out +1 -0
  62. test/ref-results/partition-new-simu/fasttree/iclust-0/input-seqs.fa +24 -0
  63. test/ref-results/partition-new-simu/fasttree/iclust-0/log +23 -0
  64. test/ref-results/partition-new-simu/fasttree/iclust-1/fasttree.out +1 -0
  65. test/ref-results/partition-new-simu/fasttree/iclust-1/input-seqs.fa +16 -0
  66. test/ref-results/partition-new-simu/fasttree/iclust-1/log +23 -0
  67. test/ref-results/partition-new-simu/fasttree/iclust-2/fasttree.out +1 -0
  68. test/ref-results/partition-new-simu/fasttree/iclust-2/input-seqs.fa +16 -0
  69. test/ref-results/partition-new-simu/fasttree/iclust-2/log +22 -0
  70. test/ref-results/partition-new-simu/iqtree/iclust-0/input-seqs.fa +24 -0
  71. test/ref-results/partition-new-simu/iqtree/iclust-0/log +430 -0
  72. test/ref-results/partition-new-simu/iqtree/iclust-0/out.bionj +1 -0
  73. test/ref-results/partition-new-simu/iqtree/iclust-0/out.ckp.gz +0 -0
  74. test/ref-results/partition-new-simu/iqtree/iclust-0/out.iqtree +282 -0
  75. test/ref-results/partition-new-simu/iqtree/iclust-0/out.log +429 -0
  76. test/ref-results/partition-new-simu/iqtree/iclust-0/out.mldist +13 -0
  77. test/ref-results/partition-new-simu/iqtree/iclust-0/out.model.gz +0 -0
  78. test/ref-results/partition-new-simu/iqtree/iclust-0/out.state +3529 -0
  79. test/ref-results/partition-new-simu/iqtree/iclust-0/out.treefile +1 -0
  80. test/ref-results/partition-new-simu/iqtree/iclust-1/input-seqs.fa +16 -0
  81. test/ref-results/partition-new-simu/iqtree/iclust-1/log +373 -0
  82. test/ref-results/partition-new-simu/iqtree/iclust-1/out.bionj +1 -0
  83. test/ref-results/partition-new-simu/iqtree/iclust-1/out.ckp.gz +0 -0
  84. test/ref-results/partition-new-simu/iqtree/iclust-1/out.iqtree +279 -0
  85. test/ref-results/partition-new-simu/iqtree/iclust-1/out.log +372 -0
  86. test/ref-results/partition-new-simu/iqtree/iclust-1/out.mldist +9 -0
  87. test/ref-results/partition-new-simu/iqtree/iclust-1/out.model.gz +0 -0
  88. test/ref-results/partition-new-simu/iqtree/iclust-1/out.state +2229 -0
  89. test/ref-results/partition-new-simu/iqtree/iclust-1/out.treefile +1 -0
  90. test/ref-results/partition-new-simu/iqtree/iclust-2/input-seqs.fa +16 -0
  91. test/ref-results/partition-new-simu/iqtree/iclust-2/log +375 -0
  92. test/ref-results/partition-new-simu/iqtree/iclust-2/out.bionj +1 -0
  93. test/ref-results/partition-new-simu/iqtree/iclust-2/out.ckp.gz +0 -0
  94. test/ref-results/partition-new-simu/iqtree/iclust-2/out.iqtree +274 -0
  95. test/ref-results/partition-new-simu/iqtree/iclust-2/out.log +374 -0
  96. test/ref-results/partition-new-simu/iqtree/iclust-2/out.mldist +9 -0
  97. test/ref-results/partition-new-simu/iqtree/iclust-2/out.model.gz +0 -0
  98. test/ref-results/partition-new-simu/iqtree/iclust-2/out.state +2283 -0
  99. test/ref-results/partition-new-simu/iqtree/iclust-2/out.treefile +1 -0
  100. test/ref-results/partition-new-simu/iqtree-annotations.yaml +1 -0
  101. test/ref-results/partition-new-simu/raxml/iclust-0/input-seqs.fa +24 -0
  102. test/ref-results/partition-new-simu/raxml/iclust-0/input-seqs.fa.raxml.ancestralProbs +3461 -0
  103. test/ref-results/partition-new-simu/raxml/iclust-0/input-seqs.fa.raxml.ancestralStates +10 -0
  104. test/ref-results/partition-new-simu/raxml/iclust-0/input-seqs.fa.raxml.ancestralTree +1 -0
  105. test/ref-results/partition-new-simu/raxml/iclust-0/input-seqs.fa.raxml.bestModel +1 -0
  106. test/ref-results/partition-new-simu/raxml/iclust-0/input-seqs.fa.raxml.bestTree +1 -0
  107. test/ref-results/partition-new-simu/raxml/iclust-0/input-seqs.fa.raxml.bestTreeCollapsed +1 -0
  108. test/ref-results/partition-new-simu/raxml/iclust-0/input-seqs.fa.raxml.log +216 -0
  109. test/ref-results/partition-new-simu/raxml/iclust-0/input-seqs.fa.raxml.mlTrees +20 -0
  110. test/ref-results/partition-new-simu/raxml/iclust-0/input-seqs.fa.raxml.rba +0 -0
  111. test/ref-results/partition-new-simu/raxml/iclust-0/input-seqs.fa.raxml.reduced.phy +9 -0
  112. test/ref-results/partition-new-simu/raxml/iclust-0/input-seqs.fa.raxml.startTree +20 -0
  113. test/ref-results/partition-new-simu/raxml/iclust-0/log +454 -0
  114. test/ref-results/partition-new-simu/raxml/iclust-0/run.sh +3 -0
  115. test/ref-results/partition-new-simu/raxml/iclust-1/input-seqs.fa +16 -0
  116. test/ref-results/partition-new-simu/raxml/iclust-1/input-seqs.fa.raxml.ancestralProbs +2203 -0
  117. test/ref-results/partition-new-simu/raxml/iclust-1/input-seqs.fa.raxml.ancestralStates +6 -0
  118. test/ref-results/partition-new-simu/raxml/iclust-1/input-seqs.fa.raxml.ancestralTree +1 -0
  119. test/ref-results/partition-new-simu/raxml/iclust-1/input-seqs.fa.raxml.bestModel +1 -0
  120. test/ref-results/partition-new-simu/raxml/iclust-1/input-seqs.fa.raxml.bestTree +1 -0
  121. test/ref-results/partition-new-simu/raxml/iclust-1/input-seqs.fa.raxml.bestTreeCollapsed +1 -0
  122. test/ref-results/partition-new-simu/raxml/iclust-1/input-seqs.fa.raxml.log +217 -0
  123. test/ref-results/partition-new-simu/raxml/iclust-1/input-seqs.fa.raxml.mlTrees +20 -0
  124. test/ref-results/partition-new-simu/raxml/iclust-1/input-seqs.fa.raxml.rba +0 -0
  125. test/ref-results/partition-new-simu/raxml/iclust-1/input-seqs.fa.raxml.reduced.phy +4 -0
  126. test/ref-results/partition-new-simu/raxml/iclust-1/input-seqs.fa.raxml.startTree +20 -0
  127. test/ref-results/partition-new-simu/raxml/iclust-1/log +440 -0
  128. test/ref-results/partition-new-simu/raxml/iclust-1/run.sh +3 -0
  129. test/ref-results/partition-new-simu/raxml/iclust-2/input-seqs.fa +16 -0
  130. test/ref-results/partition-new-simu/raxml/iclust-2/input-seqs.fa.raxml.ancestralProbs +2275 -0
  131. test/ref-results/partition-new-simu/raxml/iclust-2/input-seqs.fa.raxml.ancestralStates +6 -0
  132. test/ref-results/partition-new-simu/raxml/iclust-2/input-seqs.fa.raxml.ancestralTree +1 -0
  133. test/ref-results/partition-new-simu/raxml/iclust-2/input-seqs.fa.raxml.bestModel +1 -0
  134. test/ref-results/partition-new-simu/raxml/iclust-2/input-seqs.fa.raxml.bestTree +1 -0
  135. test/ref-results/partition-new-simu/raxml/iclust-2/input-seqs.fa.raxml.bestTreeCollapsed +1 -0
  136. test/ref-results/partition-new-simu/raxml/iclust-2/input-seqs.fa.raxml.log +207 -0
  137. test/ref-results/partition-new-simu/raxml/iclust-2/input-seqs.fa.raxml.mlTrees +20 -0
  138. test/ref-results/partition-new-simu/raxml/iclust-2/input-seqs.fa.raxml.rba +0 -0
  139. test/ref-results/partition-new-simu/raxml/iclust-2/input-seqs.fa.raxml.startTree +20 -0
  140. test/ref-results/partition-new-simu/raxml/iclust-2/log +420 -0
  141. test/ref-results/partition-new-simu/raxml/iclust-2/run.sh +3 -0
  142. test/ref-results/partition-new-simu/raxml-annotations.yaml +1 -0
  143. bin/FastTree-macos +0 -0
  144. {partis_bcr-1.0.8.data → partis_bcr-1.0.9.post1.dev1.data}/scripts/cf-alleles.py +0 -0
  145. {partis_bcr-1.0.8.data → partis_bcr-1.0.9.post1.dev1.data}/scripts/cf-germlines.py +0 -0
  146. {partis_bcr-1.0.8.data → partis_bcr-1.0.9.post1.dev1.data}/scripts/compare-plotdirs.py +0 -0
  147. {partis_bcr-1.0.8.data → partis_bcr-1.0.9.post1.dev1.data}/scripts/extract-pairing-info.py +0 -0
  148. {partis_bcr-1.0.8.data → partis_bcr-1.0.9.post1.dev1.data}/scripts/gctree-run.py +0 -0
  149. {partis_bcr-1.0.8.data → partis_bcr-1.0.9.post1.dev1.data}/scripts/get-naive-probabilities.py +0 -0
  150. {partis_bcr-1.0.8.data → partis_bcr-1.0.9.post1.dev1.data}/scripts/parse-output.py +0 -0
  151. {partis_bcr-1.0.8.data → partis_bcr-1.0.9.post1.dev1.data}/scripts/partis-test.py +0 -0
  152. {partis_bcr-1.0.8.data → partis_bcr-1.0.9.post1.dev1.data}/scripts/split-loci.py +0 -0
  153. {partis_bcr-1.0.8.dist-info → partis_bcr-1.0.9.post1.dev1.dist-info}/WHEEL +0 -0
  154. {partis_bcr-1.0.8.dist-info → partis_bcr-1.0.9.post1.dev1.dist-info}/entry_points.txt +0 -0
  155. {partis_bcr-1.0.8.dist-info → partis_bcr-1.0.9.post1.dev1.dist-info}/licenses/COPYING +0 -0
  156. {partis_bcr-1.0.8.dist-info → partis_bcr-1.0.9.post1.dev1.dist-info}/top_level.txt +0 -0
@@ -5,121 +5,109 @@
5
5
  run partis cache-parameters --locus igh --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igh --is-simu --random-seed 1 --n-procs 10 --infname test/paired/ref-results/test/simu/igh.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igh/sw-cache.yaml --input-metafnames test/paired/ref-results/test/simu/meta.yaml
6
6
  --input-metafnames: added meta info for 56 sequences from test/paired/ref-results/test/simu/meta.yaml: loci paired-uids
7
7
  caching parameters
8
- vsearch: 56 / 56 v annotations (0 failed) with 9 v genes in 0.2 sec
8
+ vsearch: 56 / 56 v annotations (0 failed) with 9 v genes in 0.0 sec
9
9
  keeping 6 / 198 v genes
10
10
  missing 17 simulation genes (counts): hv1-1801 0 hv1-4603 0 hv1-801 0 hv2-502 0 hv3-1101 0 hv3-1501 0 hv3-2001 0 hv3-2101 0 hv3-2301 0 hv3-3004 0 hv3-4802 0 hv3-6601 0 hv3-7401 0 hv3-901 0 hv4-3103 0 hv4-402 0 hv4-5911 0
11
11
  smith-waterman (new-allele fitting)
12
- vsearch: 56 / 56 v annotations (0 failed) with 6 v genes in 0.2 sec
12
+ vsearch: 56 / 56 v annotations (0 failed) with 6 v genes in 0.0 sec
13
13
  removing old sw cache test/paired/new-results/test/parameters/simu/igh/sw-cache.yaml
14
14
  running 10 procs for 56 seqs
15
15
  info for 56 / 56 = 1.000 (removed: 0 failed)
16
16
  kept 25 (0.446) unproductive
17
- water time: 0.2 (ig-sw 0.1 processing 0.1)
17
+ water time: 0.1 (ig-sw 0.0 processing 0.0)
18
18
  smith-waterman (writing parameters)
19
- vsearch: 56 / 56 v annotations (0 failed) with 6 v genes in 0.1 sec
19
+ vsearch: 56 / 56 v annotations (0 failed) with 6 v genes in 0.0 sec
20
20
  running 10 procs for 56 seqs
21
21
  info for 56 / 56 = 1.000 (removed: 0 failed)
22
22
  kept 25 (0.446) unproductive
23
23
  writing sw results to test/paired/new-results/test/parameters/simu/igh/sw-cache.yaml
24
- writing parameters to test/paired/new-results/test/parameters/simu/igh/sw (1.5 sec)
25
- water time: 1.9 (ig-sw 1.7 processing 0.2)
24
+ writing parameters to test/paired/new-results/test/parameters/simu/igh/sw (0.6 sec)
25
+ water time: 0.7 (ig-sw 0.6 processing 0.0)
26
26
  writing hmms removed 16 genes from glfo (leaving v 6 d 18 j 4)
27
-
28
- note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
29
- (1.3 sec)
27
+ (0.5 sec)
30
28
  hmm
31
29
  reading output
32
30
  read 56 hmm output lines with 56 sequences in 56 events (0 failures)
33
- writing parameters to test/paired/new-results/test/parameters/simu/igh/hmm (1.3 sec)
34
- writing parameters to test/paired/new-results/test/parameters/simu/igh/true (1.1 sec)
35
- infra time: 2.7
36
- hmm step time: 4.1
31
+ writing parameters to test/paired/new-results/test/parameters/simu/igh/hmm (0.5 sec)
32
+ writing parameters to test/paired/new-results/test/parameters/simu/igh/true (0.4 sec)
33
+ infra time: 1.1
34
+ hmm step time: 2.1
37
35
  writing hmms removed 3 genes from glfo (leaving v 6 d 15 j 4)
38
-
39
- note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
40
- (0.8 sec)
41
- total time: 9.1
36
+ (0.3 sec)
37
+ total time: 3.9
42
38
  cache-parameters igk:
43
39
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
44
40
  run partis cache-parameters --locus igk --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igk --is-simu --random-seed 1 --n-procs 10 --infname test/paired/ref-results/test/simu/igk.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igk/sw-cache.yaml --input-metafnames test/paired/ref-results/test/simu/meta.yaml
45
41
  --input-metafnames: added meta info for 36 sequences from test/paired/ref-results/test/simu/meta.yaml: loci paired-uids
46
42
  caching parameters
47
- vsearch: 36 / 36 v annotations (0 failed) with 6 v genes in 0.1 sec
43
+ vsearch: 36 / 36 v annotations (0 failed) with 6 v genes in 0.0 sec
48
44
  keeping 5 / 64 v genes
49
45
  missing 11 simulation genes (counts): kv1-1201 0 kv1-2701 0 kv1-501 0 kv1-803 0 kv1-901 0 kv1D-3901 0 kv2-2401 0 kv2D-2801 0 kv3-2001 0 kv4-102 0 kv6-2101 0
50
46
  smith-waterman (new-allele fitting)
51
- vsearch: 36 / 36 v annotations (0 failed) with 5 v genes in 0.1 sec
47
+ vsearch: 36 / 36 v annotations (0 failed) with 5 v genes in 0.0 sec
52
48
  removing old sw cache test/paired/new-results/test/parameters/simu/igk/sw-cache.yaml
53
49
  running 10 procs for 36 seqs
54
50
  running 11 procs for 2 seqs
55
51
  info for 36 / 36 = 1.000 (removed: 0 failed)
56
52
  kept 14 (0.389) unproductive
57
- water time: 0.3 (ig-sw 0.0 processing 0.1)
53
+ water time: 0.1 (ig-sw 0.0 processing 0.0)
58
54
  smith-waterman (writing parameters)
59
- vsearch: 36 / 36 v annotations (0 failed) with 5 v genes in 0.2 sec
55
+ vsearch: 36 / 36 v annotations (0 failed) with 5 v genes in 0.0 sec
60
56
  running 10 procs for 36 seqs
61
57
  running 11 procs for 2 seqs
62
58
  info for 36 / 36 = 1.000 (removed: 0 failed)
63
59
  kept 14 (0.389) unproductive
64
60
  writing sw results to test/paired/new-results/test/parameters/simu/igk/sw-cache.yaml
65
- writing parameters to test/paired/new-results/test/parameters/simu/igk/sw (1.3 sec)
66
- water time: 1.8 (ig-sw 1.4 processing 0.2)
61
+ writing parameters to test/paired/new-results/test/parameters/simu/igk/sw (0.5 sec)
62
+ water time: 0.6 (ig-sw 0.5 processing 0.0)
67
63
  writing hmms removed 2 genes from glfo (leaving v 5 d 1 j 5)
68
-
69
- note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
70
- (0.5 sec)
64
+ (0.2 sec)
71
65
  hmm
72
66
  reading output
73
67
  read 36 hmm output lines with 36 sequences in 36 events (0 failures)
74
- writing parameters to test/paired/new-results/test/parameters/simu/igk/hmm (0.7 sec)
75
- writing parameters to test/paired/new-results/test/parameters/simu/igk/true (0.7 sec)
76
- infra time: 1.6
77
- hmm step time: 2.1
68
+ writing parameters to test/paired/new-results/test/parameters/simu/igk/hmm (0.4 sec)
69
+ writing parameters to test/paired/new-results/test/parameters/simu/igk/true (0.4 sec)
70
+ infra time: 0.9
71
+ hmm step time: 1.4
78
72
  writing hmms removed 0 genes from glfo (leaving v 5 d 1 j 5)
79
-
80
- note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
81
- (0.5 sec)
82
- total time: 5.6
73
+ (0.4 sec)
74
+ total time: 2.7
83
75
  cache-parameters igl:
84
76
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
85
77
  run partis cache-parameters --locus igl --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igl --is-simu --random-seed 1 --n-procs 10 --infname test/paired/ref-results/test/simu/igl.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igl/sw-cache.yaml --input-metafnames test/paired/ref-results/test/simu/meta.yaml
86
78
  --input-metafnames: added meta info for 21 sequences from test/paired/ref-results/test/simu/meta.yaml: loci paired-uids
87
79
  caching parameters
88
- vsearch: 21 / 21 v annotations (0 failed) with 3 v genes in 0.1 sec
80
+ vsearch: 21 / 21 v annotations (0 failed) with 3 v genes in 0.0 sec
89
81
  keeping 3 / 80 v genes
90
82
  missing 7 simulation genes (counts): lv1-5102 0 lv3-101 0 lv3-1901 0 lv3-2701 0 lv4-6003 0 lv7-4604 0 lv8-6101 0
91
83
  smith-waterman (new-allele fitting)
92
- vsearch: 21 / 21 v annotations (0 failed) with 3 v genes in 0.1 sec
84
+ vsearch: 21 / 21 v annotations (0 failed) with 3 v genes in 0.0 sec
93
85
  removing old sw cache test/paired/new-results/test/parameters/simu/igl/sw-cache.yaml
94
86
  running 10 procs for 21 seqs
95
87
  info for 21 / 21 = 1.000 (removed: 0 failed)
96
88
  kept 14 (0.667) unproductive
97
- water time: 0.1 (ig-sw 0.0 processing 0.1)
89
+ water time: 0.0 (ig-sw 0.0 processing 0.0)
98
90
  smith-waterman (writing parameters)
99
- vsearch: 21 / 21 v annotations (0 failed) with 3 v genes in 0.2 sec
91
+ vsearch: 21 / 21 v annotations (0 failed) with 3 v genes in 0.0 sec
100
92
  running 10 procs for 21 seqs
101
93
  info for 21 / 21 = 1.000 (removed: 0 failed)
102
94
  kept 14 (0.667) unproductive
103
95
  writing sw results to test/paired/new-results/test/parameters/simu/igl/sw-cache.yaml
104
- writing parameters to test/paired/new-results/test/parameters/simu/igl/sw (0.6 sec)
105
- water time: 0.9 (ig-sw 0.7 processing 0.1)
96
+ writing parameters to test/paired/new-results/test/parameters/simu/igl/sw (0.3 sec)
97
+ water time: 0.4 (ig-sw 0.3 processing 0.0)
106
98
  writing hmms removed 7 genes from glfo (leaving v 3 d 1 j 2)
107
-
108
- note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
109
- (0.3 sec)
99
+ (0.1 sec)
110
100
  hmm
111
101
  reading output
112
102
  read 21 hmm output lines with 21 sequences in 21 events (0 failures)
113
- writing parameters to test/paired/new-results/test/parameters/simu/igl/hmm (0.5 sec)
114
- writing parameters to test/paired/new-results/test/parameters/simu/igl/true (0.4 sec)
115
- infra time: 1.1
116
- hmm step time: 1.6
103
+ writing parameters to test/paired/new-results/test/parameters/simu/igl/hmm (0.3 sec)
104
+ writing parameters to test/paired/new-results/test/parameters/simu/igl/true (0.3 sec)
105
+ infra time: 0.6
106
+ hmm step time: 0.9
117
107
  writing hmms removed 0 genes from glfo (leaving v 3 d 1 j 2)
118
-
119
- note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
120
- (0.2 sec)
121
- total time: 3.6
122
- total time: 27.3
108
+ (0.1 sec)
109
+ total time: 1.6
110
+ total time: 12.1
123
111
  partition-new-simu partis partition --dont-write-git-info --paired-loci --paired-indir test/paired/ref-results/test/simu --parameter-dir test/paired/new-results/test/parameters/simu --plot-annotation-performance --max-ccf-fail-frac 0.10 --is-simu --plotdir test/paired/new-results/partition-new-simu-annotation-performance --only-csv-plots --no-partition-plots --random-seed 1 --n-procs 10 --paired-outdir test/paired/new-results/partition-new-simu
124
112
  warning ignoring --plot-annotation-performance for paired clustering since it's going to be a bit fiddly to implement
125
113
  partition igh:
@@ -128,84 +116,84 @@ hmm
128
116
  --input-metafnames: added meta info for 56 sequences from test/paired/ref-results/test/simu/meta.yaml: loci paired-uids
129
117
  partitioning (with test/paired/new-results/test/parameters/simu/igh/hmm)
130
118
  smith-waterman
131
- vsearch: 56 / 56 v annotations (0 failed) with 6 v genes in 0.1 sec
119
+ vsearch: 56 / 56 v annotations (0 failed) with 6 v genes in 0.0 sec
132
120
  reading sw results from test/paired/new-results/test/parameters/simu/igh/sw-cache.yaml
133
121
  info for 56 / 56 = 1.000 (removed: 0 failed, 0 duplicates [removed when cache file was written])
134
122
  kept 25 (0.446) unproductive
135
123
  plotting performance
136
124
  warning skipped annotation performance evaluation on 1 queries with different true and inferred net shm indel lengths: db63559ea9-igh
137
125
  (0.0 sec)
138
- water time: 0.2
126
+ water time: 0.1
139
127
  hmm
140
- caching all 56 naive sequences (1.4s)
128
+ caching all 56 naive sequences (1.0s)
141
129
  collapsed 56 queries into 50 clusters with identical naive seqs (0.0 sec)
142
- 50 clusters with 10 procs (0.8s)
143
- 44 clusters with 7 procs (0.8s)
144
- 36 clusters with 5 procs (0.7s)
145
- 31 clusters with 3 procs (0.6s)
146
- 29 clusters with 2 procs (1.3s)
147
- 23 clusters with 1 proc (1.5s)
130
+ 50 clusters with 10 procs (0.5s)
131
+ 44 clusters with 7 procs (0.5s)
132
+ 36 clusters with 5 procs (0.4s)
133
+ 31 clusters with 3 procs (0.3s)
134
+ 29 clusters with 2 procs (0.5s)
135
+ 23 clusters with 1 proc (0.6s)
148
136
  note not merging entire cpath history
149
- partition loop time: 5.8
137
+ partition loop time: 2.8
150
138
  getting annotations for final partition
151
- subcluster annotating 20 clusters with steps: (1.1s) (0.5s) plotting performance
139
+ subcluster annotating 20 clusters with steps: (0.7s) (0.2s) plotting performance
152
140
  warning skipped annotation performance evaluation on 1 queries with different true and inferred net shm indel lengths: db63559ea9-igh
153
- (0.1 sec)
141
+ (0.0 sec)
154
142
 
155
- subcluster annotation time 1.8
156
- total time: 9.3
143
+ subcluster annotation time 0.9
144
+ total time: 4.9
157
145
  partition igk:
158
146
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
159
147
  run partis partition --locus igk --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igk --plot-annotation-performance --max-ccf-fail-frac 0.10 --is-simu --plotdir test/paired/new-results/partition-new-simu-annotation-performance/single-chain/plots/igk --only-csv-plots --no-partition-plots --random-seed 1 --n-procs 10 --refuse-to-cache-parameters --infname test/paired/ref-results/test/simu/igk.yaml --outfname test/paired/new-results/partition-new-simu/single-chain/partition-igk.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igk/sw-cache.yaml --input-metafnames test/paired/ref-results/test/simu/meta.yaml
160
148
  --input-metafnames: added meta info for 36 sequences from test/paired/ref-results/test/simu/meta.yaml: loci paired-uids
161
149
  partitioning (with test/paired/new-results/test/parameters/simu/igk/hmm)
162
150
  smith-waterman
163
- vsearch: 36 / 36 v annotations (0 failed) with 5 v genes in 0.1 sec
151
+ vsearch: 36 / 36 v annotations (0 failed) with 5 v genes in 0.0 sec
164
152
  reading sw results from test/paired/new-results/test/parameters/simu/igk/sw-cache.yaml
165
153
  info for 36 / 36 = 1.000 (removed: 0 failed, 0 duplicates [removed when cache file was written])
166
154
  kept 14 (0.389) unproductive
167
155
  plotting performance (0.0 sec)
168
- water time: 0.2
156
+ water time: 0.1
169
157
  hmm
170
- caching all 36 naive sequences (0.8s)
158
+ caching all 36 naive sequences (0.5s)
171
159
  collapsed 36 queries into 7 clusters with identical naive seqs (0.0 sec)
172
160
  reducing n procs to number of clusters: 10 --> 7
173
- 7 clusters with 7 procs (0.3s)
174
- 7 clusters with 5 procs (0.3s)
175
- 7 clusters with 3 procs (0.3s)
176
- 7 clusters with 2 procs (0.3s)
177
- 6 clusters with 1 proc (0.5s)
178
- partition loop time: 1.7
161
+ 7 clusters with 7 procs (0.0s)
162
+ 7 clusters with 5 procs (0.1s)
163
+ 7 clusters with 3 procs (0.1s)
164
+ 7 clusters with 2 procs (0.1s)
165
+ 6 clusters with 1 proc (0.2s)
166
+ partition loop time: 0.5
179
167
  getting annotations for final partition
180
- subcluster annotating 6 clusters with steps: (0.6s) (0.2s) (0.2s) plotting performance (0.0 sec)
168
+ subcluster annotating 6 clusters with steps: (0.3s) (0.1s) (0.1s) plotting performance (0.0 sec)
181
169
 
182
- subcluster annotation time 1.1
183
- total time: 3.9
170
+ subcluster annotation time 0.5
171
+ total time: 1.5
184
172
  partition igl:
185
173
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
186
174
  run partis partition --locus igl --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igl --plot-annotation-performance --max-ccf-fail-frac 0.10 --is-simu --plotdir test/paired/new-results/partition-new-simu-annotation-performance/single-chain/plots/igl --only-csv-plots --no-partition-plots --random-seed 1 --n-procs 10 --refuse-to-cache-parameters --infname test/paired/ref-results/test/simu/igl.yaml --outfname test/paired/new-results/partition-new-simu/single-chain/partition-igl.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igl/sw-cache.yaml --input-metafnames test/paired/ref-results/test/simu/meta.yaml
187
175
  --input-metafnames: added meta info for 21 sequences from test/paired/ref-results/test/simu/meta.yaml: loci paired-uids
188
176
  partitioning (with test/paired/new-results/test/parameters/simu/igl/hmm)
189
177
  smith-waterman
190
- vsearch: 21 / 21 v annotations (0 failed) with 3 v genes in 0.2 sec
178
+ vsearch: 21 / 21 v annotations (0 failed) with 3 v genes in 0.0 sec
191
179
  reading sw results from test/paired/new-results/test/parameters/simu/igl/sw-cache.yaml
192
180
  info for 21 / 21 = 1.000 (removed: 0 failed, 0 duplicates [removed when cache file was written])
193
181
  kept 14 (0.667) unproductive
194
182
  plotting performance (0.0 sec)
195
- water time: 0.2
183
+ water time: 0.1
196
184
  hmm
197
- caching all 21 naive sequences (0.6s)
185
+ caching all 21 naive sequences (0.3s)
198
186
  collapsed 21 queries into 3 clusters with identical naive seqs (0.0 sec)
199
187
  reducing n procs to number of clusters: 10 --> 3
200
- 3 clusters with 3 procs (0.3s)
201
- 3 clusters with 2 procs (0.2s)
202
- 3 clusters with 1 proc (0.4s)
203
- partition loop time: 0.9
188
+ 3 clusters with 3 procs (0.0s)
189
+ 3 clusters with 2 procs (0.0s)
190
+ 3 clusters with 1 proc (0.1s)
191
+ partition loop time: 0.2
204
192
  getting annotations for final partition
205
- subcluster annotating 3 clusters with steps: (0.4s) (0.2s) (0.2s) plotting performance (0.0 sec)
193
+ subcluster annotating 3 clusters with steps: (0.1s) (0.1s) (0.1s) plotting performance (0.0 sec)
206
194
 
207
- subcluster annotation time 0.8
208
- total time: 2.7
195
+ subcluster annotation time 0.3
196
+ total time: 0.9
209
197
  combining chains
210
198
  cleaning pair info for 113 seqs
211
199
  synchronized/fixed 0 pairs where one had no pair info after cleaning: h 0 k 0 l 0
@@ -243,7 +231,6 @@ WARNING using errors instead of sumw2 with weight != 1.0 in Hist::fill_ibin()
243
231
  joint 0.963 0.594
244
232
  merge time 0.0
245
233
  need to get annotations for 7/15 joint igh clusters
246
- tag: v1.0.8
247
234
  annotate igh+igk: igh
248
235
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
249
236
  run partis annotate --locus igh --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igh --max-ccf-fail-frac 0.10 --only-csv-plots --no-partition-plots --random-seed 1 --n-procs 10 --refuse-to-cache-parameters --infname test/paired/new-results/partition-new-simu/igh+igk/input-seqs-igh.fa --outfname test/paired/new-results/partition-new-simu/igh+igk/partition-igh.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igh/sw-cache.yaml --input-metafnames test/paired/new-results/partition-new-simu/igh+igk/meta-igh.yaml --ignore-sw-pair-info --input-partition-fname test/paired/new-results/partition-new-simu/igh+igk/partition-igh-only-partition.yaml
@@ -251,17 +238,16 @@ WARNING using errors instead of sumw2 with weight != 1.0 in Hist::fill_ibin()
251
238
  --input-partition-fname: read best partition with 36 sequences in 15 clusters from test/paired/new-results/partition-new-simu/igh+igk/partition-igh-only-partition.yaml
252
239
  annotating (with test/paired/new-results/test/parameters/simu/igh/hmm)
253
240
  smith-waterman
254
- vsearch: 36 / 36 v annotations (0 failed) with 5 v genes in 0.1 sec
241
+ vsearch: 36 / 36 v annotations (0 failed) with 5 v genes in 0.0 sec
255
242
  reading sw results from test/paired/new-results/test/parameters/simu/igh/sw-cache.yaml
256
243
  info for 36 / 36 = 1.000 (removed: 0 failed, 0 duplicates [removed when cache file was written])
257
244
  kept 13 (0.361) unproductive
258
245
  water time: 0.0
259
246
  hmm
260
- subcluster annotating 15 clusters with steps: (0.7s) (0.3s)
261
- subcluster annotation time 1.0
262
- total time: 1.3
247
+ subcluster annotating 15 clusters with steps: (0.5s) (0.1s)
248
+ subcluster annotation time 0.6
249
+ total time: 0.6
263
250
  need to get annotations for 13/15 joint igk clusters
264
- tag: v1.0.8
265
251
  annotate igh+igk: igk
266
252
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
267
253
  run partis annotate --locus igk --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igk --max-ccf-fail-frac 0.10 --only-csv-plots --no-partition-plots --random-seed 1 --n-procs 10 --refuse-to-cache-parameters --infname test/paired/new-results/partition-new-simu/igh+igk/input-seqs-igk.fa --outfname test/paired/new-results/partition-new-simu/igh+igk/partition-igk.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igk/sw-cache.yaml --input-metafnames test/paired/new-results/partition-new-simu/igh+igk/meta-igk.yaml --ignore-sw-pair-info --input-partition-fname test/paired/new-results/partition-new-simu/igh+igk/partition-igk-only-partition.yaml
@@ -269,15 +255,15 @@ hmm
269
255
  --input-partition-fname: read best partition with 36 sequences in 15 clusters from test/paired/new-results/partition-new-simu/igh+igk/partition-igk-only-partition.yaml
270
256
  annotating (with test/paired/new-results/test/parameters/simu/igk/hmm)
271
257
  smith-waterman
272
- vsearch: 36 / 36 v annotations (0 failed) with 5 v genes in 0.1 sec
258
+ vsearch: 36 / 36 v annotations (0 failed) with 5 v genes in 0.0 sec
273
259
  reading sw results from test/paired/new-results/test/parameters/simu/igk/sw-cache.yaml
274
260
  info for 36 / 36 = 1.000 (removed: 0 failed, 0 duplicates [removed when cache file was written])
275
261
  kept 14 (0.389) unproductive
276
262
  water time: 0.0
277
263
  hmm
278
- subcluster annotating 15 clusters with steps: (0.6s) (0.2s)
279
- subcluster annotation time 0.8
280
- total time: 1.0
264
+ subcluster annotating 15 clusters with steps: (0.3s) (0.1s)
265
+ subcluster annotation time 0.4
266
+ total time: 0.5
281
267
  igh+igl: synchronizing heavy and light chain cluster paths
282
268
  removing badly + unpaired seqs: kept 7 total unpaired (i.e. setting aside in order to reintegrate after paired clustering): h 3 l 4
283
269
  note: discarding unpaired seqs in families with no (well-)paired seqs (i.e. families that are all either unpaired or paired to the other/wrong light chain), rather than keeping track of them to re-add later
@@ -303,7 +289,6 @@ hmm
303
289
  joint 1.000 0.611
304
290
  merge time 0.0
305
291
  need to get annotations for 5/8 joint igh clusters
306
- tag: v1.0.8
307
292
  annotate igh+igl: igh
308
293
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
309
294
  run partis annotate --locus igh --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igh --max-ccf-fail-frac 0.10 --only-csv-plots --no-partition-plots --random-seed 1 --n-procs 10 --refuse-to-cache-parameters --infname test/paired/new-results/partition-new-simu/igh+igl/input-seqs-igh.fa --outfname test/paired/new-results/partition-new-simu/igh+igl/partition-igh.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igh/sw-cache.yaml --input-metafnames test/paired/new-results/partition-new-simu/igh+igl/meta-igh.yaml --ignore-sw-pair-info --input-partition-fname test/paired/new-results/partition-new-simu/igh+igl/partition-igh-only-partition.yaml
@@ -311,17 +296,16 @@ hmm
311
296
  --input-partition-fname: read best partition with 20 sequences in 8 clusters from test/paired/new-results/partition-new-simu/igh+igl/partition-igh-only-partition.yaml
312
297
  annotating (with test/paired/new-results/test/parameters/simu/igh/hmm)
313
298
  smith-waterman
314
- vsearch: 20 / 20 v annotations (0 failed) with 4 v genes in 0.1 sec
299
+ vsearch: 20 / 20 v annotations (0 failed) with 4 v genes in 0.0 sec
315
300
  reading sw results from test/paired/new-results/test/parameters/simu/igh/sw-cache.yaml
316
301
  info for 20 / 20 = 1.000 (removed: 0 failed, 0 duplicates [removed when cache file was written])
317
302
  kept 12 (0.600) unproductive
318
303
  water time: 0.0
319
304
  hmm
320
- subcluster annotating 8 clusters with steps: (0.6s) (0.3s)
321
- subcluster annotation time 0.9
322
- total time: 1.0
305
+ subcluster annotating 8 clusters with steps: (0.3s) (0.1s)
306
+ subcluster annotation time 0.4
307
+ total time: 0.5
323
308
  need to get annotations for 8/8 joint igl clusters
324
- tag: v1.0.8
325
309
  annotate igh+igl: igl
326
310
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
327
311
  run partis annotate --locus igl --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igl --max-ccf-fail-frac 0.10 --only-csv-plots --no-partition-plots --random-seed 1 --n-procs 10 --refuse-to-cache-parameters --infname test/paired/new-results/partition-new-simu/igh+igl/input-seqs-igl.fa --outfname test/paired/new-results/partition-new-simu/igh+igl/partition-igl.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igl/sw-cache.yaml --input-metafnames test/paired/new-results/partition-new-simu/igh+igl/meta-igl.yaml --ignore-sw-pair-info --input-partition-fname test/paired/new-results/partition-new-simu/igh+igl/partition-igl-only-partition.yaml
@@ -329,15 +313,15 @@ hmm
329
313
  --input-partition-fname: read best partition with 21 sequences in 8 clusters from test/paired/new-results/partition-new-simu/igh+igl/partition-igl-only-partition.yaml
330
314
  annotating (with test/paired/new-results/test/parameters/simu/igl/hmm)
331
315
  smith-waterman
332
- vsearch: 21 / 21 v annotations (0 failed) with 3 v genes in 0.2 sec
316
+ vsearch: 21 / 21 v annotations (0 failed) with 3 v genes in 0.0 sec
333
317
  reading sw results from test/paired/new-results/test/parameters/simu/igl/sw-cache.yaml
334
318
  info for 21 / 21 = 1.000 (removed: 0 failed, 0 duplicates [removed when cache file was written])
335
319
  kept 14 (0.667) unproductive
336
320
  water time: 0.0
337
321
  hmm
338
- subcluster annotating 8 clusters with steps: (0.4s) (0.2s)
339
- subcluster annotation time 0.6
340
- total time: 0.8
322
+ subcluster annotating 8 clusters with steps: (0.2s) (0.1s)
323
+ subcluster annotation time 0.3
324
+ total time: 0.3
341
325
  concatenating heavy chain loci:
342
326
  h starting with 15 annotations (36 seqs)
343
327
  k starting with 15 annotations (36 seqs)
@@ -350,7 +334,7 @@ hmm
350
334
  h 20 --> 23 +3
351
335
  k 6 --> 15 +9
352
336
  l 3 --> 8 +5
353
- total time: 43.7
337
+ total time: 19.7
354
338
  subset-partition-new-simu partis subset-partition --dont-write-git-info --paired-loci --paired-indir test/paired/ref-results/test/simu --max-ccf-fail-frac 0.15 --is-simu --n-subsets 2 --random-seed 1 --n-procs 10 --paired-outdir test/paired/new-results/subset-partition-new-simu
355
339
  note: --input-metafnames not specified, so setting to default location test/paired/ref-results/test/simu/meta.yaml
356
340
  --input-metafnames: added meta info for 113 sequences from test/paired/ref-results/test/simu/meta.yaml: loci paired-uids
@@ -379,12 +363,9 @@ hmm
379
363
  writing merged outputs from 2 subsets to test/paired/new-results/subset-partition-new-simu/merged-subsets
380
364
  writing combined h/l info to fasta and meta files in test/paired/new-results/subset-partition-new-simu/merged-subsets
381
365
  merging parameters from 2 subdirs (e.g. test/paired/new-results/subset-partition-new-simu/isub-0) to test/paired/new-results/subset-partition-new-simu/merged-subsets
382
- tag: v1.0.8
383
- tag: v1.0.8
384
- tag: v1.0.8
385
366
  run partis partition --dont-write-git-info --paired-loci --paired-indir test/paired/ref-results/test/simu --max-ccf-fail-frac 0.15 --is-simu --random-seed 1 --n-procs 10 --paired-outdir test/paired/new-results/subset-partition-new-simu --input-metafnames test/paired/new-results/subset-partition-new-simu/merged-subsets/meta.yaml --input-partition-fname test/paired/new-results/subset-partition-new-simu/merged-subsets --continue-from-input-partition --parameter-dir test/paired/new-results/subset-partition-new-simu/merged-subsets/parameters --ignore-sw-pair-info --refuse-to-cache-parameters --ignore-default-input-metafile
386
367
  log: test/paired/new-results/subset-partition-new-simu/merged-partition.log
387
- total time: 133.2
368
+ total time: 67.8
388
369
  seed-partition-new-simu partis partition --dont-write-git-info --paired-loci --paired-indir test/paired/ref-results/test/simu --parameter-dir test/paired/new-results/test/parameters/simu --max-ccf-fail-frac 0.10 --is-simu --seed-unique-id 3542bd38d8-igh:3542bd38d8-igk --seed-loci igh:igk --random-seed 1 --n-procs 10 --paired-outdir test/paired/new-results/seed-partition-new-simu
389
370
  removing seqs very different from seed seq
390
371
  wrong/no removed singly kept missing
@@ -403,49 +384,49 @@ hmm
403
384
  --input-metafnames: added meta info for 17 sequences from test/paired/ref-results/test/simu/meta.yaml: loci paired-uids
404
385
  partitioning (with test/paired/new-results/test/parameters/simu/igh/hmm)
405
386
  smith-waterman
406
- vsearch: 17 / 17 v annotations (0 failed) with 3 v genes in 0.1 sec
387
+ vsearch: 17 / 17 v annotations (0 failed) with 3 v genes in 0.0 sec
407
388
  reading sw results from test/paired/new-results/test/parameters/simu/igh/sw-cache.yaml
408
389
  info for 17 / 17 = 1.000 (removed: 0 failed, 0 duplicates [removed when cache file was written])
409
390
  kept 8 (0.471) unproductive
410
391
  water time: 0.0
411
392
  hmm
412
- caching all 17 naive sequences (0.6s)
393
+ caching all 17 naive sequences (0.4s)
413
394
  collapsed 17 queries into 17 clusters with identical naive seqs (0.0 sec)
414
- 17 clusters with 10 procs (0.5s)
415
- 17 clusters with 7 procs (0.4s)
416
- 17 clusters with 5 procs (0.4s)
417
- 17 clusters with 3 procs (0.4s)
418
- 14 clusters with 2 procs (0.4s)
419
- 14 clusters with 1 proc (0.6s)
420
- partition loop time: 2.6
395
+ 17 clusters with 10 procs (0.1s)
396
+ 17 clusters with 7 procs (0.2s)
397
+ 17 clusters with 5 procs (0.2s)
398
+ 17 clusters with 3 procs (0.2s)
399
+ 14 clusters with 2 procs (0.2s)
400
+ 14 clusters with 1 proc (0.3s)
401
+ partition loop time: 1.2
421
402
  getting annotations for final partition
422
403
  reading output
423
404
  read 12 hmm output lines with 17 sequences in 12 events (0 failures)
424
- hmm step time: 0.5
425
- total time: 3.9
405
+ hmm step time: 0.3
406
+ total time: 1.9
426
407
  partition igk:
427
408
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
428
409
  run partis partition --locus igk --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igk --max-ccf-fail-frac 0.10 --random-seed 1 --n-procs 10 --refuse-to-cache-parameters --infname test/paired/new-results/seed-partition-new-simu/seeds/3542bd38d8-igh+3542bd38d8-igk/single-chain/input-seqs-igk.fa --outfname test/paired/new-results/seed-partition-new-simu/seeds/3542bd38d8-igh+3542bd38d8-igk/single-chain/partition-igk.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igk/sw-cache.yaml --input-metafnames test/paired/ref-results/test/simu/meta.yaml
429
410
  --input-metafnames: added meta info for 12 sequences from test/paired/ref-results/test/simu/meta.yaml: loci paired-uids
430
411
  partitioning (with test/paired/new-results/test/parameters/simu/igk/hmm)
431
412
  smith-waterman
432
- vsearch: 12 / 12 v annotations (0 failed) with 2 v genes in 0.1 sec
413
+ vsearch: 12 / 12 v annotations (0 failed) with 2 v genes in 0.0 sec
433
414
  reading sw results from test/paired/new-results/test/parameters/simu/igk/sw-cache.yaml
434
415
  info for 12 / 12 = 1.000 (removed: 0 failed, 0 duplicates [removed when cache file was written])
435
416
  kept 7 (0.583) unproductive
436
417
  water time: 0.0
437
418
  hmm
438
- caching all 12 naive sequences (0.3s)
419
+ caching all 12 naive sequences (0.2s)
439
420
  collapsed 12 queries into 3 clusters with identical naive seqs (0.0 sec)
440
421
  reducing n procs to number of clusters: 10 --> 3
441
- 3 clusters with 3 procs (0.3s)
442
- 3 clusters with 2 procs (0.2s)
443
- 3 clusters with 1 proc (0.2s)
444
- partition loop time: 0.6
422
+ 3 clusters with 3 procs (0.0s)
423
+ 3 clusters with 2 procs (0.0s)
424
+ 3 clusters with 1 proc (0.1s)
425
+ partition loop time: 0.2
445
426
  getting annotations for final partition
446
- subcluster annotating 2 clusters with steps: (0.3s) (0.2s) (0.2s)
447
- subcluster annotation time 0.6
448
- total time: 1.7
427
+ subcluster annotating 2 clusters with steps: (0.1s) (0.1s) (0.1s)
428
+ subcluster annotation time 0.2
429
+ total time: 0.6
449
430
  partition igl:
450
431
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
451
432
  run partis partition --locus igl --dont-write-git-info --parameter-dir test/paired/new-results/test/parameters/simu/igl --max-ccf-fail-frac 0.10 --random-seed 1 --n-procs 10 --refuse-to-cache-parameters --infname test/paired/new-results/seed-partition-new-simu/seeds/3542bd38d8-igh+3542bd38d8-igk/single-chain/input-seqs-igl.fa --outfname test/paired/new-results/seed-partition-new-simu/seeds/3542bd38d8-igh+3542bd38d8-igk/single-chain/partition-igl.yaml --sw-cachefname test/paired/new-results/test/parameters/simu/igl/sw-cache.yaml --input-metafnames test/paired/ref-results/test/simu/meta.yaml
@@ -453,22 +434,22 @@ getting annotations for final partition
453
434
  note: reducing N procs to the number of seqs 10 --> 4
454
435
  partitioning (with test/paired/new-results/test/parameters/simu/igl/hmm)
455
436
  smith-waterman
456
- vsearch: 4 / 4 v annotations (0 failed) with 2 v genes in 0.2 sec
437
+ vsearch: 4 / 4 v annotations (0 failed) with 2 v genes in 0.0 sec
457
438
  reading sw results from test/paired/new-results/test/parameters/simu/igl/sw-cache.yaml
458
439
  info for 4 / 4 = 1.000 (removed: 0 failed, 0 duplicates [removed when cache file was written])
459
440
  water time: 0.0
460
441
  hmm
461
- caching all 4 naive sequences (0.2s)
442
+ caching all 4 naive sequences (0.1s)
462
443
  collapsed 4 queries into 2 clusters with identical naive seqs (0.0 sec)
463
444
  reducing n procs to number of clusters: 4 --> 2
464
- 2 clusters with 2 procs (0.2s)
465
- 2 clusters with 1 proc (0.2s)
466
- partition loop time: 0.4
445
+ 2 clusters with 2 procs (0.0s)
446
+ 2 clusters with 1 proc (0.1s)
447
+ partition loop time: 0.1
467
448
  getting annotations for final partition
468
449
  reading output
469
450
  read 2 hmm output lines with 4 sequences in 2 events (0 failures)
470
- hmm step time: 0.2
471
- total time: 1.0
451
+ hmm step time: 0.1
452
+ total time: 0.3
472
453
  combining chains
473
454
  cleaning pair info for 33 seqs
474
455
  synchronized/fixed 0 pairs where one had no pair info after cleaning: h 0 k 0 l 0
@@ -507,7 +488,6 @@ WARNING using errors instead of sumw2 with weight != 1.0 in Hist::fill_ibin()
507
488
  merge time 0.0
508
489
  removed 7 unseeded clusters (of 8 total, leaving 1) from igh joint partition
509
490
  seed cluster size in best joint partition: 1, excluding seed seq: 0
510
- tag: v1.0.8
511
491
  annotate igh+igk: igh
512
492
  removed 2 arg strs that were specific to action 'partition': --seed-unique-id 3542bd38d8-igh:3542bd38d8-igk
513
493
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
@@ -517,19 +497,18 @@ WARNING using errors instead of sumw2 with weight != 1.0 in Hist::fill_ibin()
517
497
  --input-partition-fname: read best partition with 1 sequences in 1 clusters from test/paired/new-results/seed-partition-new-simu/seeds/3542bd38d8-igh+3542bd38d8-igk/igh+igk/partition-igh-only-partition.yaml
518
498
  annotating (with test/paired/new-results/test/parameters/simu/igh/hmm)
519
499
  smith-waterman
520
- vsearch: 1 / 1 v annotations (0 failed) with 1 v gene in 0.2 sec
500
+ vsearch: 1 / 1 v annotations (0 failed) with 1 v gene in 0.0 sec
521
501
  reading sw results from test/paired/new-results/test/parameters/simu/igh/sw-cache.yaml
522
502
  info for 1 / 1 = 1.000 (removed: 0 failed, 0 duplicates [removed when cache file was written])
523
503
  water time: 0.0
524
504
  hmm
525
505
  reading output
526
506
  read 1 hmm output lines with 1 sequences in 1 events (0 failures)
527
- hmm step time: 0.2
528
- total time: 0.4
507
+ hmm step time: 0.1
508
+ total time: 0.1
529
509
  removed 7 unseeded clusters (of 8 total, leaving 1) from igk joint partition
530
510
  need to get annotations for 1/1 joint igk clusters
531
511
  seed cluster size in best joint partition: 1, excluding seed seq: 0
532
- tag: v1.0.8
533
512
  annotate igh+igk: igk
534
513
  removed 2 arg strs that were specific to action 'partition': --seed-unique-id 3542bd38d8-igh:3542bd38d8-igk
535
514
  note: adding input metafname from default location (test/paired/ref-results/test/simu/meta.yaml)
@@ -539,7 +518,7 @@ hmm
539
518
  --input-partition-fname: read best partition with 1 sequences in 1 clusters from test/paired/new-results/seed-partition-new-simu/seeds/3542bd38d8-igh+3542bd38d8-igk/igh+igk/partition-igk-only-partition.yaml
540
519
  annotating (with test/paired/new-results/test/parameters/simu/igk/hmm)
541
520
  smith-waterman
542
- vsearch: 1 / 1 v annotations (0 failed) with 1 v gene in 0.2 sec
521
+ vsearch: 1 / 1 v annotations (0 failed) with 1 v gene in 0.0 sec
543
522
  reading sw results from test/paired/new-results/test/parameters/simu/igk/sw-cache.yaml
544
523
  info for 1 / 1 = 1.000 (removed: 0 failed, 0 duplicates [removed when cache file was written])
545
524
  kept 1 (1.000) unproductive
@@ -547,8 +526,8 @@ smith-waterman
547
526
  hmm
548
527
  reading output
549
528
  read 1 hmm output lines with 1 sequences in 1 events (0 failures)
550
- hmm step time: 0.2
551
- total time: 0.4
529
+ hmm step time: 0.1
530
+ total time: 0.1
552
531
  igh+igl: synchronizing heavy and light chain cluster paths
553
532
  removing badly + unpaired seqs: kept 1 total unpaired (i.e. setting aside in order to reintegrate after paired clustering): h 1 l 0
554
533
  note: discarding unpaired seqs in families with no (well-)paired seqs (i.e. families that are all either unpaired or paired to the other/wrong light chain), rather than keeping track of them to re-add later
@@ -576,7 +555,7 @@ hmm
576
555
  N clusters with all seqs:
577
556
  h 12 --> 1 -11
578
557
  k 2 --> 1 -1
579
- total time: 20.5
558
+ total time: 9.2
580
559
  get-selection-metrics-new-simu partis get-selection-metrics --dont-write-git-info --paired-loci --existing-output-run-cfg paired --min-selection-metric-cluster-size 3 --min-paired-cluster-size-to-read 3 --random-seed 1 --n-procs 10 --paired-outdir test/paired/new-results/partition-new-simu --chosen-ab-fname test/paired/new-results/get-selection-metrics-new-simu-chosen-abs.csv
581
560
  get-selection-metrics igh+igk: igh
582
561
  run partis get-selection-metrics --locus igh --dont-write-git-info --min-selection-metric-cluster-size 3 --min-paired-cluster-size-to-read 3 --random-seed 1 --n-procs 10 --chosen-ab-fname test/paired/new-results/get-selection-metrics-new-simu-chosen-abs.csv --refuse-to-cache-parameters --outfname test/paired/new-results/partition-new-simu/igh+igk/partition-igh.yaml
@@ -587,9 +566,9 @@ hmm
587
566
  skipped 10 smaller than 3 (controlled by --min-selection-metric-cluster-size)
588
567
  getting trees for 2 clusters with sizes: 7 6
589
568
  starting 2 jobs
590
- run /Users/runner/work/partis/partis/bin/FastTree-macos -gtr -nt -out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igh/fasttree/iclust-0/fasttree.out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igh/fasttree/iclust-0/input-seqs.fa
591
- run /Users/runner/work/partis/partis/bin/FastTree-macos -gtr -nt -out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igh/fasttree/iclust-1/fasttree.out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igh/fasttree/iclust-1/input-seqs.fa
592
- made 2 fasttree trees (0.2s)
569
+ run /home/runner/work/partis/partis/bin/FastTree-linux -gtr -nt -out /home/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igh/fasttree/iclust-0/fasttree.out /home/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igh/fasttree/iclust-0/input-seqs.fa
570
+ run /home/runner/work/partis/partis/bin/FastTree-linux -gtr -nt -out /home/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igh/fasttree/iclust-1/fasttree.out /home/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igh/fasttree/iclust-1/input-seqs.fa
571
+ made 2 fasttree trees (0.1s)
593
572
  tree origins: 2 ran fasttree
594
573
  skipped 3/5 clusters smaller than 4
595
574
  setting default tau to 1 / 385 = 0.0026
@@ -597,10 +576,10 @@ hmm
597
576
  warning get_aa_tree() (AA inf tree, iclust 0): skipped 13/14 edges for which we didn't have sequences for both nodes (i.e. left the original branch length unmodified). Missing nodes: amz bnw bop dkn ikm psx
598
577
  setting default tau to 1 / 385 = 0.0026
599
578
  calculating normalized lb index and lb ratio and lb fraction on aa tree with tau 0.0026
600
- warning get_aa_tree() (AA inf tree, iclust 1): skipped 9/11 edges for which we didn't have sequences for both nodes (i.e. left the original branch length unmodified). Missing nodes: eov flx ily npq
579
+ warning get_aa_tree() (AA inf tree, iclust 1): skipped 9/11 edges for which we didn't have sequences for both nodes (i.e. left the original branch length unmodified). Missing nodes: dst eov ily npq
601
580
  skipped 3/5 clusters that had no uids in common with tree
602
581
  writing selection metrics to test/paired/new-results/partition-new-simu/igh+igk/partition-igh-selection-metrics.yaml
603
- total time: 0.3
582
+ total time: 0.1
604
583
  get-selection-metrics igh+igk: igk
605
584
  run partis get-selection-metrics --locus igk --dont-write-git-info --min-selection-metric-cluster-size 3 --min-paired-cluster-size-to-read 3 --random-seed 1 --n-procs 10 --chosen-ab-fname test/paired/new-results/get-selection-metrics-new-simu-chosen-abs.csv --refuse-to-cache-parameters --outfname test/paired/new-results/partition-new-simu/igh+igk/partition-igk.yaml
606
585
  note: --parameter-dir not set, so using default: x-dummy-x
@@ -610,9 +589,9 @@ hmm
610
589
  skipped 11 smaller than 3 (controlled by --min-selection-metric-cluster-size)
611
590
  getting trees for 2 clusters with sizes: 7 7
612
591
  starting 2 jobs
613
- run /Users/runner/work/partis/partis/bin/FastTree-macos -gtr -nt -out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igk/fasttree/iclust-0/fasttree.out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igk/fasttree/iclust-0/input-seqs.fa
614
- run /Users/runner/work/partis/partis/bin/FastTree-macos -gtr -nt -out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igk/fasttree/iclust-1/fasttree.out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igk/fasttree/iclust-1/input-seqs.fa
615
- made 2 fasttree trees (0.2s)
592
+ run /home/runner/work/partis/partis/bin/FastTree-linux -gtr -nt -out /home/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igk/fasttree/iclust-0/fasttree.out /home/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igk/fasttree/iclust-0/input-seqs.fa
593
+ run /home/runner/work/partis/partis/bin/FastTree-linux -gtr -nt -out /home/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igk/fasttree/iclust-1/fasttree.out /home/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igk/partition-igk/fasttree/iclust-1/input-seqs.fa
594
+ made 2 fasttree trees (0.0s)
616
595
  tree origins: 2 ran fasttree
617
596
  skipped 2/4 clusters smaller than 4
618
597
  setting default tau to 1 / 337 = 0.0030
@@ -623,7 +602,7 @@ hmm
623
602
  warning get_aa_tree() (AA inf tree, iclust 1): skipped 2/9 edges for which we didn't have sequences for both nodes (i.e. left the original branch length unmodified). Missing nodes: eov
624
603
  skipped 2/4 clusters that had no uids in common with tree
625
604
  writing selection metrics to test/paired/new-results/partition-new-simu/igh+igk/partition-igk-selection-metrics.yaml
626
- total time: 0.4
605
+ total time: 0.1
627
606
  get-selection-metrics igh+igl: igh
628
607
  run partis get-selection-metrics --locus igh --dont-write-git-info --min-selection-metric-cluster-size 3 --min-paired-cluster-size-to-read 3 --random-seed 1 --n-procs 10 --chosen-ab-fname test/paired/new-results/get-selection-metrics-new-simu-chosen-abs.csv --refuse-to-cache-parameters --outfname test/paired/new-results/partition-new-simu/igh+igl/partition-igh.yaml
629
608
  note: --parameter-dir not set, so using default: x-dummy-x
@@ -633,8 +612,8 @@ hmm
633
612
  skipped 6 smaller than 3 (controlled by --min-selection-metric-cluster-size)
634
613
  getting trees for 1 cluster with size: 8
635
614
  starting 1 jobs
636
- run /Users/runner/work/partis/partis/bin/FastTree-macos -gtr -nt -out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igl/partition-igh/fasttree/iclust-0/fasttree.out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igl/partition-igh/fasttree/iclust-0/input-seqs.fa
637
- made 1 fasttree trees (0.2s)
615
+ run /home/runner/work/partis/partis/bin/FastTree-linux -gtr -nt -out /home/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igl/partition-igh/fasttree/iclust-0/fasttree.out /home/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igl/partition-igh/fasttree/iclust-0/input-seqs.fa
616
+ made 1 fasttree trees (0.1s)
638
617
  tree origins: 1 ran fasttree
639
618
  skipped 1/2 clusters smaller than 4
640
619
  setting default tau to 1 / 376 = 0.0027
@@ -644,7 +623,7 @@ hmm
644
623
  calculating normalized lb index and lb ratio and lb fraction on aa tree with tau 0.0027
645
624
  skipped 1/2 clusters that had no uids in common with tree
646
625
  writing selection metrics to test/paired/new-results/partition-new-simu/igh+igl/partition-igh-selection-metrics.yaml
647
- total time: 0.3
626
+ total time: 0.1
648
627
  get-selection-metrics igh+igl: igl
649
628
  run partis get-selection-metrics --locus igl --dont-write-git-info --min-selection-metric-cluster-size 3 --min-paired-cluster-size-to-read 3 --random-seed 1 --n-procs 10 --chosen-ab-fname test/paired/new-results/get-selection-metrics-new-simu-chosen-abs.csv --refuse-to-cache-parameters --outfname test/paired/new-results/partition-new-simu/igh+igl/partition-igl.yaml
650
629
  note: --parameter-dir not set, so using default: x-dummy-x
@@ -654,17 +633,17 @@ hmm
654
633
  skipped 6 smaller than 3 (controlled by --min-selection-metric-cluster-size)
655
634
  getting trees for 2 clusters with sizes: 8 6
656
635
  starting 2 jobs
657
- run /Users/runner/work/partis/partis/bin/FastTree-macos -gtr -nt -out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igl/partition-igl/fasttree/iclust-0/fasttree.out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igl/partition-igl/fasttree/iclust-0/input-seqs.fa
658
- run /Users/runner/work/partis/partis/bin/FastTree-macos -gtr -nt -out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igl/partition-igl/fasttree/iclust-1/fasttree.out /Users/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igl/partition-igl/fasttree/iclust-1/input-seqs.fa
659
- made 2 fasttree trees (0.3s)
636
+ run /home/runner/work/partis/partis/bin/FastTree-linux -gtr -nt -out /home/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igl/partition-igl/fasttree/iclust-0/fasttree.out /home/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igl/partition-igl/fasttree/iclust-0/input-seqs.fa
637
+ run /home/runner/work/partis/partis/bin/FastTree-linux -gtr -nt -out /home/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igl/partition-igl/fasttree/iclust-1/fasttree.out /home/runner/work/partis/partis/test/paired/new-results/partition-new-simu/igh+igl/partition-igl/fasttree/iclust-1/input-seqs.fa
638
+ made 2 fasttree trees (0.0s)
660
639
  tree origins: 2 ran fasttree
661
640
  setting default tau to 1 / 334 = 0.0030
662
641
  calculating normalized lb index and lb ratio and lb fraction with tau 0.0030
663
- warning get_aa_tree() (AA inf tree, iclust 0): skipped 10/13 edges for which we didn't have sequences for both nodes (i.e. left the original branch length unmodified). Missing nodes: amz bev bop dkn
642
+ warning get_aa_tree() (AA inf tree, iclust 0): skipped 10/13 edges for which we didn't have sequences for both nodes (i.e. left the original branch length unmodified). Missing nodes: amz bev dkn ikm
664
643
  setting default tau to 1 / 334 = 0.0030
665
644
  calculating normalized lb index and lb ratio and lb fraction on aa tree with tau 0.0030
666
645
  writing selection metrics to test/paired/new-results/partition-new-simu/igh+igl/partition-igl-selection-metrics.yaml
667
- total time: 0.4
646
+ total time: 0.1
668
647
  getting combined h/l selection metrics
669
648
  igh+igk: 13 unpaired light clusters after finding h/l cluster pairs
670
649
  igh+igk: skipped 13 annotations with N h or l ids < 3 (controlled by --min-paired-cluster-size-to-read) (keeping 2 annotation pairs)
@@ -681,10 +660,10 @@ hmm
681
660
  skipped 0 smaller than 3 (controlled by --min-selection-metric-cluster-size)
682
661
  getting trees for 3 clusters with sizes: 7 7 5
683
662
  starting 3 jobs
684
- run /Users/runner/work/partis/partis/bin/FastTree-macos -gtr -nt -out test/paired/new-results/partition-new-simu/fasttree/iclust-0/fasttree.out test/paired/new-results/partition-new-simu/fasttree/iclust-0/input-seqs.fa
685
- run /Users/runner/work/partis/partis/bin/FastTree-macos -gtr -nt -out test/paired/new-results/partition-new-simu/fasttree/iclust-1/fasttree.out test/paired/new-results/partition-new-simu/fasttree/iclust-1/input-seqs.fa
686
- run /Users/runner/work/partis/partis/bin/FastTree-macos -gtr -nt -out test/paired/new-results/partition-new-simu/fasttree/iclust-2/fasttree.out test/paired/new-results/partition-new-simu/fasttree/iclust-2/input-seqs.fa
687
- made 3 fasttree trees (0.4s)
663
+ run /home/runner/work/partis/partis/bin/FastTree-linux -gtr -nt -out test/paired/new-results/partition-new-simu/fasttree/iclust-0/fasttree.out test/paired/new-results/partition-new-simu/fasttree/iclust-0/input-seqs.fa
664
+ run /home/runner/work/partis/partis/bin/FastTree-linux -gtr -nt -out test/paired/new-results/partition-new-simu/fasttree/iclust-1/fasttree.out test/paired/new-results/partition-new-simu/fasttree/iclust-1/input-seqs.fa
665
+ run /home/runner/work/partis/partis/bin/FastTree-linux -gtr -nt -out test/paired/new-results/partition-new-simu/fasttree/iclust-2/fasttree.out test/paired/new-results/partition-new-simu/fasttree/iclust-2/input-seqs.fa
666
+ made 3 fasttree trees (0.1s)
688
667
  tree origins: 3 ran fasttree
689
668
  skipped 1/4 clusters smaller than 4
690
669
  setting default tau to 1 / 714 = 0.0014
@@ -697,10 +676,10 @@ hmm
697
676
  skipped 1/4 clusters that had no uids in common with tree
698
677
  writing selection metrics to test/paired/new-results/partition-new-simu/selection-metrics.yaml
699
678
  writing 10 chosen abs to test/paired/new-results/get-selection-metrics-new-simu-chosen-abs.csv
700
- total time: 11.3
679
+ total time: 5.5
701
680
  cache-parameters-data partis cache-parameters --dont-write-git-info --paired-loci --infname test/paired-data/all-seqs.fa --parameter-dir test/paired/new-results/test/parameters/data --n-max-queries 100 --random-seed 1 --n-procs 10
702
681
  note: --paired-outdir is not set, so there will be no persistent record of the results (except the parameter directory).
703
- run extract-pairing-info.py test/paired-data/all-seqs.fa /tmp/runner/hmms/754062/meta.yaml --n-max-queries 100
682
+ run extract-pairing-info.py test/paired-data/all-seqs.fa /tmp/runner/hmms/199071/meta.yaml --n-max-queries 100
704
683
  --n-max-queries: chose 48 / 48 droplets (first 100, after random shuffling) which had 100 / 100 seqs
705
684
  extract_pairing_info(): read 100 sequences with 48 droplet ids
706
685
  droplet id separators (set automatically): _ indices: [0]
@@ -711,14 +690,14 @@ hmm
711
690
  2 42 0.875
712
691
  3 2 0.042
713
692
  4 2 0.042
714
- run split-loci.py test/paired-data/all-seqs.fa --outdir /tmp/runner/hmms/754062 --input-metafname /tmp/runner/hmms/754062/meta.yaml --n-max-queries 100
693
+ run split-loci.py test/paired-data/all-seqs.fa --outdir /tmp/runner/hmms/199071 --input-metafname /tmp/runner/hmms/199071/meta.yaml --n-max-queries 100
715
694
  --n-max-queries: chose 48 / 48 droplets (first 100, after random shuffling) which had 100 / 100 seqs
716
- --input-metafnames: added meta info for 100 sequences from /tmp/runner/hmms/754062/meta.yaml: paired-uids
695
+ --input-metafnames: added meta info for 100 sequences from /tmp/runner/hmms/199071/meta.yaml: paired-uids
717
696
  read pairing info for 100 seqs from input meta file
718
697
  running vsearch on 100 sequences:
719
- igh: 49 / 100 v annotations (51 failed) with 28 v genes in 0.2 sec
698
+ igh: 49 / 100 v annotations (51 failed) with 28 v genes in 0.1 sec
720
699
  igk: 40 / 100 v annotations (60 failed) with 18 v genes in 0.1 sec
721
- igl: 15 / 100 v annotations (85 failed) with 12 v genes in 0.2 sec
700
+ igl: 15 / 100 v annotations (85 failed) with 12 v genes in 0.1 sec
722
701
  totals: igh 48 igk 37 igl 15
723
702
  count frac paired with
724
703
  h 31 0.65 k
@@ -736,10 +715,10 @@ totals: igh 48 igk 37 igl 15
736
715
  2 0.13 h l
737
716
  1 0.07 h k
738
717
  1 0.07 h h k
739
- writing to /tmp/runner/hmms/754062/
740
- igh: 48 to 754062/igh.fa
741
- igk: 37 to 754062/igk.fa
742
- igl: 15 to 754062/igl.fa
718
+ writing to /tmp/runner/hmms/199071/
719
+ igh: 48 to 199071/igh.fa
720
+ igk: 37 to 199071/igk.fa
721
+ igl: 15 to 199071/igl.fa
743
722
  writing to paired subdirs
744
723
  igh+igk:
745
724
  igh: 36 / 48 to igh+igk/igh.fa
@@ -748,107 +727,95 @@ writing to paired subdirs
748
727
  igh: 15 / 48 to igh+igl/igh.fa
749
728
  igl: 15 / 15 to igh+igl/igl.fa
750
729
  cache-parameters igh:
751
- run partis cache-parameters --locus igh --dont-write-git-info --infname /tmp/runner/hmms/754062/igh.fa --parameter-dir test/paired/new-results/test/parameters/data/igh --random-seed 1 --n-procs 10 --sw-cachefname test/paired/new-results/test/parameters/data/igh/sw-cache.yaml --input-metafnames /tmp/runner/hmms/754062/meta.yaml
752
- --input-metafnames: added meta info for 48 sequences from /tmp/runner/hmms/754062/meta.yaml: paired-uids
730
+ run partis cache-parameters --locus igh --dont-write-git-info --infname /tmp/runner/hmms/199071/igh.fa --parameter-dir test/paired/new-results/test/parameters/data/igh --random-seed 1 --n-procs 10 --sw-cachefname test/paired/new-results/test/parameters/data/igh/sw-cache.yaml --input-metafnames /tmp/runner/hmms/199071/meta.yaml
731
+ --input-metafnames: added meta info for 48 sequences from /tmp/runner/hmms/199071/meta.yaml: paired-uids
753
732
  caching parameters
754
- vsearch: 48 / 48 v annotations (0 failed) with 27 v genes in 0.2 sec
733
+ vsearch: 48 / 48 v annotations (0 failed) with 27 v genes in 0.0 sec
755
734
  keeping 23 / 198 v genes
756
735
  smith-waterman (new-allele fitting)
757
- vsearch: 48 / 48 v annotations (0 failed) with 23 v genes in 0.1 sec
736
+ vsearch: 48 / 48 v annotations (0 failed) with 23 v genes in 0.0 sec
758
737
  running 10 procs for 48 seqs
759
738
  info for 48 / 48 = 1.000 (removed: 0 failed)
760
739
  kept 1 (0.021) unproductive
761
- water time: 0.3 (ig-sw 0.0 processing 0.2)
740
+ water time: 0.1 (ig-sw 0.0 processing 0.1)
762
741
  smith-waterman (writing parameters)
763
- vsearch: 48 / 48 v annotations (0 failed) with 23 v genes in 0.2 sec
742
+ vsearch: 48 / 48 v annotations (0 failed) with 23 v genes in 0.0 sec
764
743
  running 10 procs for 48 seqs
765
744
  info for 48 / 48 = 1.000 (removed: 0 failed)
766
745
  kept 1 (0.021) unproductive
767
746
  writing sw results to test/paired/new-results/test/parameters/data/igh/sw-cache.yaml
768
- writing parameters to test/paired/new-results/test/parameters/data/igh/sw (4.7 sec)
769
- water time: 5.0 (ig-sw 4.8 processing 0.2)
747
+ writing parameters to test/paired/new-results/test/parameters/data/igh/sw (2.0 sec)
748
+ water time: 2.2 (ig-sw 2.1 processing 0.1)
770
749
  writing hmms removed 13 genes from glfo (leaving v 23 d 19 j 6)
771
-
772
- note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
773
- (2.2 sec)
750
+ (0.9 sec)
774
751
  hmm
775
752
  reading output
776
753
  read 48 hmm output lines with 48 sequences in 48 events (0 failures)
777
- writing parameters to test/paired/new-results/test/parameters/data/igh/hmm (3.5 sec)
778
- infra time: 3.7
779
- hmm step time: 5.0
754
+ writing parameters to test/paired/new-results/test/parameters/data/igh/hmm (1.9 sec)
755
+ infra time: 2.0
756
+ hmm step time: 3.0
780
757
  writing hmms removed 1 genes from glfo (leaving v 23 d 18 j 6)
781
-
782
- note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
783
- (2.3 sec)
784
- total time: 15.5
758
+ (0.9 sec)
759
+ total time: 7.5
785
760
  cache-parameters igk:
786
- run partis cache-parameters --locus igk --dont-write-git-info --infname /tmp/runner/hmms/754062/igk.fa --parameter-dir test/paired/new-results/test/parameters/data/igk --random-seed 1 --n-procs 10 --sw-cachefname test/paired/new-results/test/parameters/data/igk/sw-cache.yaml --input-metafnames /tmp/runner/hmms/754062/meta.yaml
787
- --input-metafnames: added meta info for 37 sequences from /tmp/runner/hmms/754062/meta.yaml: paired-uids
761
+ run partis cache-parameters --locus igk --dont-write-git-info --infname /tmp/runner/hmms/199071/igk.fa --parameter-dir test/paired/new-results/test/parameters/data/igk --random-seed 1 --n-procs 10 --sw-cachefname test/paired/new-results/test/parameters/data/igk/sw-cache.yaml --input-metafnames /tmp/runner/hmms/199071/meta.yaml
762
+ --input-metafnames: added meta info for 37 sequences from /tmp/runner/hmms/199071/meta.yaml: paired-uids
788
763
  caching parameters
789
- vsearch: 37 / 37 v annotations (0 failed) with 16 v genes in 0.2 sec
764
+ vsearch: 37 / 37 v annotations (0 failed) with 16 v genes in 0.0 sec
790
765
  keeping 16 / 64 v genes
791
766
  smith-waterman (new-allele fitting)
792
- vsearch: 37 / 37 v annotations (0 failed) with 16 v genes in 0.1 sec
767
+ vsearch: 37 / 37 v annotations (0 failed) with 16 v genes in 0.0 sec
793
768
  running 10 procs for 37 seqs
794
769
  info for 37 / 37 = 1.000 (removed: 0 failed)
795
770
  kept 1 (0.027) unproductive
796
- water time: 0.2 (ig-sw 0.0 processing 0.2)
771
+ water time: 0.1 (ig-sw 0.0 processing 0.1)
797
772
  smith-waterman (writing parameters)
798
- vsearch: 37 / 37 v annotations (0 failed) with 16 v genes in 0.2 sec
773
+ vsearch: 37 / 37 v annotations (0 failed) with 16 v genes in 0.0 sec
799
774
  running 10 procs for 37 seqs
800
775
  info for 37 / 37 = 1.000 (removed: 0 failed)
801
776
  kept 1 (0.027) unproductive
802
777
  writing sw results to test/paired/new-results/test/parameters/data/igk/sw-cache.yaml
803
- writing parameters to test/paired/new-results/test/parameters/data/igk/sw (2.5 sec)
804
- water time: 2.8 (ig-sw 2.7 processing 0.2)
778
+ writing parameters to test/paired/new-results/test/parameters/data/igk/sw (1.3 sec)
779
+ water time: 1.5 (ig-sw 1.4 processing 0.1)
805
780
  writing hmms removed 0 genes from glfo (leaving v 16 d 1 j 7)
806
-
807
- note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
808
- (1.4 sec)
781
+ (1.0 sec)
809
782
  hmm
810
783
  reading output
811
784
  read 37 hmm output lines with 37 sequences in 37 events (0 failures)
812
- writing parameters to test/paired/new-results/test/parameters/data/igk/hmm (2.1 sec)
813
- infra time: 2.2
814
- hmm step time: 2.8
785
+ writing parameters to test/paired/new-results/test/parameters/data/igk/hmm (1.3 sec)
786
+ infra time: 1.3
787
+ hmm step time: 1.9
815
788
  writing hmms removed 0 genes from glfo (leaving v 16 d 1 j 7)
816
-
817
- note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
818
- (1.4 sec)
819
- total time: 9.4
789
+ (1.0 sec)
790
+ total time: 5.6
820
791
  cache-parameters igl:
821
- run partis cache-parameters --locus igl --dont-write-git-info --infname /tmp/runner/hmms/754062/igl.fa --parameter-dir test/paired/new-results/test/parameters/data/igl --random-seed 1 --n-procs 10 --sw-cachefname test/paired/new-results/test/parameters/data/igl/sw-cache.yaml --input-metafnames /tmp/runner/hmms/754062/meta.yaml
822
- --input-metafnames: added meta info for 15 sequences from /tmp/runner/hmms/754062/meta.yaml: paired-uids
792
+ run partis cache-parameters --locus igl --dont-write-git-info --infname /tmp/runner/hmms/199071/igl.fa --parameter-dir test/paired/new-results/test/parameters/data/igl --random-seed 1 --n-procs 10 --sw-cachefname test/paired/new-results/test/parameters/data/igl/sw-cache.yaml --input-metafnames /tmp/runner/hmms/199071/meta.yaml
793
+ --input-metafnames: added meta info for 15 sequences from /tmp/runner/hmms/199071/meta.yaml: paired-uids
823
794
  caching parameters
824
- vsearch: 15 / 15 v annotations (0 failed) with 12 v genes in 0.1 sec
795
+ vsearch: 15 / 15 v annotations (0 failed) with 12 v genes in 0.0 sec
825
796
  keeping 10 / 80 v genes
826
797
  smith-waterman (new-allele fitting)
827
- vsearch: 15 / 15 v annotations (0 failed) with 10 v genes in 0.2 sec
798
+ vsearch: 15 / 15 v annotations (0 failed) with 10 v genes in 0.0 sec
828
799
  running 10 procs for 15 seqs
829
800
  info for 15 / 15 = 1.000 (removed: 0 failed)
830
- water time: 0.1 (ig-sw 0.0 processing 0.1)
801
+ water time: 0.0 (ig-sw 0.0 processing 0.0)
831
802
  smith-waterman (writing parameters)
832
- vsearch: 15 / 15 v annotations (0 failed) with 10 v genes in 0.1 sec
803
+ vsearch: 15 / 15 v annotations (0 failed) with 10 v genes in 0.0 sec
833
804
  running 10 procs for 15 seqs
834
805
  info for 15 / 15 = 1.000 (removed: 0 failed)
835
806
  writing sw results to test/paired/new-results/test/parameters/data/igl/sw-cache.yaml
836
- writing parameters to test/paired/new-results/test/parameters/data/igl/sw (1.6 sec)
837
- water time: 1.9 (ig-sw 1.7 processing 0.2)
807
+ writing parameters to test/paired/new-results/test/parameters/data/igl/sw (0.8 sec)
808
+ water time: 0.9 (ig-sw 0.9 processing 0.0)
838
809
  writing hmms removed 6 genes from glfo (leaving v 10 d 1 j 3)
839
-
840
- note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
841
- (0.9 sec)
810
+ (0.6 sec)
842
811
  hmm
843
812
  reading output
844
813
  read 15 hmm output lines with 15 sequences in 15 events (0 failures)
845
- writing parameters to test/paired/new-results/test/parameters/data/igl/hmm (1.5 sec)
846
- infra time: 1.6
847
- hmm step time: 2.0
814
+ writing parameters to test/paired/new-results/test/parameters/data/igl/hmm (0.8 sec)
815
+ infra time: 0.8
816
+ hmm step time: 1.1
848
817
  writing hmms removed 0 genes from glfo (leaving v 10 d 1 j 3)
849
-
850
- note: utils.memory_usage_fraction() needs testing on platform 'Darwin' to make sure unit conversions don't need changing
851
- (0.9 sec)
852
- total time: 6.4
853
- warning expected to remove 1/11 files+dirs that weren't in /tmp/runner/hmms/754062/: failed.fa
854
- total time: 40.4
818
+ (0.6 sec)
819
+ total time: 3.4
820
+ warning expected to remove 1/11 files+dirs that weren't in /tmp/runner/hmms/199071/: failed.fa
821
+ total time: 21.6