scout-browser 4.99.0__tar.gz → 4.100.0__tar.gz

{scout_browser-4.99.0 → scout_browser-4.100.0}/.github/PULL_REQUEST_TEMPLATE.md

@@ -12,7 +12,7 @@ This PR marks a new Scout release. We apply semantic versioning. This is a major
 1. `sudo -iu hiseq.clinical`
 1. `ssh localhost`
 1. (optional) Find out which scout branch is currently deployed on cg-vm1: `podman ps`
-1. Stop the service with current deployed branch: `systemctl --user stop scout.target`
+1. Stop the service with current deployed branch: `systemctl --user stop scout@<name_of_currently_deployed_branch>`
 1. Start the scout service with the branch to test: `systemctl --user start scout@<this_branch>`
 1. Make sure the branch is deployed: `systemctl --user status scout.target`
 1. After testing is done, repeat procedure at [https://pax.scilifelab.se/](https://pax.scilifelab.se), which will release the allocated resource (`scout-stage`) to be used for testing by other users.

{scout_browser-4.99.0 → scout_browser-4.100.0}/CHANGELOG.md

@@ -4,6 +4,46 @@ This project adheres to [Semantic Versioning](http://semver.org/).
 
 About changelog [here](https://keepachangelog.com/en/1.0.0/)
 
+
+## [4.100]
+### Added
+- Button with link to cancerhotspots.org on variant page for cancer cases (#5359)
+- Link to ClinGen ACMG CSPEC Criteria Specification Registry from ACMG classification page (#5364)
+- Documentation on how to export data from the scout database using the command line (#5373)
+- Filter cancer SNVs by ClinVar oncogenicity. OBS: since annotations are still sparse in ClinVar, relying solely on them could be too restrictive (#5367)
+- Include eventual gene-matching WTS outliers on variantS page (Overlap column) and variant page (Gene overlapping non-SNVs table) (#5371)
+- Minor Allele Frequency (HiFiCNV) IGV.js track for Nallo cases (#5401)
+- A page showing all cases submitted to the Matchmaker Exchange, accessible from the institute's sidebar (#5378)
+- Variants' loader progress bar (#5411)
+### Changed
+- Allow matching compounded subcategories from SV callers e.g. DUP:INV (#5360)
+- Adjust the link to the chanjo2 gene coverage report to reflect the type of analyses used for the samples (#5368)
+- Gene panels open in new tabs from case panels and display case name on the top of the page (#5369)
+- When uploading research variants, use rank threshold defined in case settings, if available, otherwise use the default threshold of 8 (#5370)
+- Display genome build version on case general report (#5381)
+- On pull request template, fixed instructions on how to deploy a branch to the development server (#5382)
+- On case general report, when a variant is classified (ACMG or CCV), tagged, commented and also dismissed, will only be displayed among the dismissed variants (#5377)
+- If case is re-runned/re-uploaded with the `--keep-actions` tag, remember also previously assigned diseases, HPO terms, phenotype groups and HPO panels (#5365)
+- Case load config alias and updated track label for TIDDIT coverage tracks to accommodate HiFiCNV dito (#5401)
+- On variants page, compounds popup table, truncate the display name of compound variants with display name that exceeds 20 characters (#5404)
+- Update dataTables js (#5407)
+- Load variants command prints more clearly which categories of variants are being loaded (#5409)
+- Tooltips instead of popovers (no click needed) for matching indicators on variantS page (#5419)
+- Call chanjo2 coverage completeness indicator via API after window loading completes (#5366)
+- On ClinVar multistep submission form, silence warnings coming from missing HGVS version using Entrez Eutils (#5424)
+### Fixed
+- Style of Alamut button on variant page (#5358)
+- Scope of overlapping functions (#5385)
+- Tests involving the variants controllers, which failed when not run in a specific order (#5391)
+- Option to return to the previous step in each of the steps of the ClinVar submission form (#5393)
+- chanjo2 MT report for cases in build 38 (#5397)
+- Fixed some variantS view tests accessing database out of app context (#5415)
+- Display of matching manual rank on the SV variant page (#5419)
+- Broken `scout setup database` command (#5422)
+- Collecting submission data for cases which have been removed (#5421)
+- Speed up query for gene overlapping variants (#5413)
+- Removing submission data for cases which have been removed (#5430)
+
 ## [4.99]
 ### Added
 - De novo assembly alignment file load and display (#5284)

{scout_browser-4.99.0 → scout_browser-4.100.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: scout-browser
-Version: 4.99.0
+Version: 4.100.0
 Summary: Clinical DNA variant visualizer and browser
 Project-URL: Repository, https://github.com/Clinical-Genomics/scout
 Project-URL: Changelog, https://github.com/Clinical-Genomics/scout/blob/main/CHANGELOG.md

scout_browser-4.100.0/docs/admin-guide/export.md

@@ -0,0 +1,221 @@
+# Exporting Data from Scout
+
+There are many scenarios where users may want to export information from Scout.
+This document outlines the available export options and how to use them via the command line.
+
+## Main `export` command:
+
+```
+scout export
+```
+
+## Available Export Commands
+
+Scout provides the following subcommands for data export:
+
+```
+Options:
+  --help  Show this message and exit.
+
+Commands:
+  cases        Export case data
+  database     Export the Scout MongoDB database
+  exons        Export exon regions
+  genes        Export genes
+  hpo_genes    Export HPO-associated genes
+  managed      Export managed variants
+  mt_report    Export a mitochondrial variants report
+  panel        Export gene panels
+  transcripts  Export transcripts
+  variants     Export variants
+  verified     Export verified variants
+```
+
+Each command is described in detail below.
+
+---
+
+## Exporting Cases (`cases`)
+
+Export case information based on institute, status, or various filters. When exporting cases, it is possible to restrict the list of he exported data by adding optional parameters:
+
+```
+Options:
+  --case-id TEXT                  Case ID to search for
+  -i, --institute TEXT            Institute ID
+  -r, --reruns                    Include rerun-requested cases
+  -f, --finished                  Include archived or solved cases
+  --causatives                    Include cases with causative variants
+  --research-requested            Include cases with research requested
+  --rerun-monitor                 Include cases with continuous rerun monitoring
+  --is-research                   Include cases in research mode
+  -s, --status [prioritized|inactive|active|solved|archived|ignored]
+                                  Filter by case status
+  --within-days INTEGER           Filter by event date (days ago)
+  --json                          Output result in JSON format
+```
+
+The command's output is a list of case documents in the same format as they are saved into the database (dictionaries). By specifying the `--json`, documents are printed in json format.
+
+---
+
+## Exporting the Database (`database`)
+
+Dump the entire Scout MongoDB database (or subsets).
+
+```
+Options:
+  -o, --out PATH       Output directory for the dump [default: ./dump]
+  --uri TEXT           MongoDB connection URI
+  --all-collections    Include variant collections
+  --help               Show this message and exit
+```
+
+---
+
+## Exporting Exons (`exons`)
+
+Export all exons or limit to a specific gene. Default format is a .bed file, but they can be exported as a json file by using the `--json` option.
+
+```
+Options:
+  -b, --build [37|38]             Genome build version
+  -hgnc, --hgnc-id INTEGER        Filter by HGNC ID
+  --json                          Output in JSON format
+```
+
+**Output Format:**
+A tab-delimited list with the following header:
+
+```
+#Chrom	Start	End	ExonId	Transcripts	HgncIDs	HgncSymbols
+```
+
+---
+
+## Exporting Genes (`genes`)
+
+Export all genes from the database. Default format is a .bed file, but they can be exported as a json file by using the `--json` option.
+
+```
+Options:
+  -b, --build [37|38|GRCh38]      Genome build version [default: 37]
+  --json                          Output in JSON format
+```
+
+**Output Format:**
+A tab-delimited list with the following header:
+
+```
+#Chromosome	Start	End	Hgnc_id	Hgnc_symbol
+```
+
+---
+
+## Exporting HPO-Associated Genes (`hpo_genes`)
+
+Export HGNC IDs for all genes associated with a given HPO term.
+
+**Example Usage:**
+
+```
+scout export hpo_genes HP:0000371
+```
+
+Result:
+
+```
+#Gene_id	Count
+9986	1
+9987	1
+9988	1
+6193	1
+7067	1
+```
+
+---
+
+## Exporting Managed Variants (`managed`)
+
+Export managed variants in VCF format.
+
+**Example Output (VCF):**
+
+```
+##fileformat=VCFv4.2
+##INFO=<ID=END,Number=1,Type=Integer,Description="End position of the variant">
+##INFO=<ID=TYPE,Number=1,Type=String,Description="Type of variant">
+#CHROM	POS	ID	REF	ALT	QUAL	FILTER	INFO
+1	1295250	.	C	T	.	.	END=1295250;TYPE=SNV
+..
+```
+
+---
+
+## Exporting Mitochondrial Reports (`mt_report`)
+
+Export a mitochondrial report for a given case.
+
+```
+Options:
+  --case_id TEXT    Required case ID
+  --outpath TEXT    Path to the output file
+  --test            Run in test mode
+```
+
+---
+
+## Exporting Gene Panels (`panel`)
+
+Export gene panels with clinical annotation in BED format.
+
+```
+Options:
+  -b, --build [37|38|GRCh38]      Genome build version [default: 37]
+  --version FLOAT                 Specify panel version
+  --bed                           Export in BED-like format
+```
+
+**Output Header (default format):**
+
+```
+#hgnc_id	symbol	disease_associated_transcripts	reduced_penetrance	mosaicism	database_entry_version	inheritance_models	custom_inheritance_models	comment
+```
+
+---
+
+## Exporting Transcripts (`transcripts`)
+
+Export a list of transcripts in BED format. Use the following command: `scout export transcripts`
+
+```
+Options:
+  -b, --build [37|38|GRCh38]      Genome build version [default: 37]
+```
+---
+
+## Exporting Causative Variants (`variants`)
+
+Export causative variants for a case or an institute. Output is VCF by default, or JSON if specified.
+
+```
+Options:
+  -c, --collaborator TEXT         Collaborator ID [default: cust000]
+  -d, --document-id TEXT          Search for a specific variant
+  --case-id TEXT                  Case ID to search for
+  --json                          Output in JSON format
+```
+
+---
+
+## Exporting Verified Variants (`verified`)
+
+Similar to the `variants` export, but limited to verified variants. Output is VCF by default, or JSON if specified.
+
+```
+Options:
+  -c, --collaborator TEXT         Collaborator ID [default: cust000]
+  -d, --document-id TEXT          Search for a specific variant
+  --case-id TEXT                  Case ID to search for
+  --json                          Output in JSON format
+```

{scout_browser-4.99.0 → scout_browser-4.100.0}/docs/admin-guide/load-config.md

@@ -22,6 +22,7 @@ Below are available configuration parameters for a Scout case. Names marked with
 - **coverage_qc_report** _String_ Path to HTML file with coverage and QC report.
 - **default_gene_panels** _List of strings_ List of default gene panels. Variants from the genes in the gene panels specified will be shown when opening the case in scout.
 - **delivery_report** _String_: Path to HTML delivery report.
+- **exe_ver**: Pipeline detailed software versions (YAML)
 - **family(*)**  _String_ Unique ID of the case.
 - **family_name**  _String_ Optional name of the case.
 - **gene_fusion_report** _String_ Path to a static gene fusion report produced by [Arriba][arriba] containing only clinical fusions (a subset of all detected fusions).
@@ -32,9 +33,9 @@ Below are available configuration parameters for a Scout case. Names marked with
 - **madeline** _String_ Path to a madeline pedigree file in XML format.
 - **multiqc** _String_ Path to a [multiqc][multiqc] report with arbitrary information.
 - **multiqc_rna** _String_ Path to a [nf-core/rnafusion multiqc][rna-multiqc] report with arbitrary information.
-- **omics_files** _List_
-  - **fraser**: _String_ Path to TSV file to parse WTS [DROP][drop] FRASER splice outlier omics variants as produded by e.g. [Tomte][tomte]
-  - **outrider**: _String_ Path to TSV file to parse WTS [DROP][drop] OUTRIDER expression outlier omics variants as produded by e.g. [Tomte][tomte]
+- **omics_files** _List_ List of multiomics results files for the case:
+    - **fraser** _String_ Path to TSV file to parse WTS [DROP][drop] FRASER splice outlier omics variants as produded by e.g. [Tomte][tomte]
+    - **outrider** _String_ Path to TSV file to parse WTS [DROP][drop] OUTRIDER expression outlier omics variants as produded by e.g. [Tomte][tomte]
 - **owner(*)**  _String_ Institute who owns current case. Must refer to existing institute.
 - **peddy_check** _String_ Path to a [peddy][peddy] ped check file.
 - **peddy_ped** _String_ Path to a [peddy][peddy] ped file with an analysis of the pedigree based on variant information.
@@ -42,6 +43,7 @@ Below are available configuration parameters for a Scout case. Names marked with
 - **phenotype_terms** _List of strings_ List of phenotype terms.
 - **rank model version** _String_ Which rank model that was used when scoring the variants.
 - **rank_score_threshold** _Float_ Only include variants with a rank score above this threshold.
+- **reference_info**: Pipeline detailed reference file versions (YAML)
 - **RNAfusion_inspector** _String_ Path to HTML [nf-core/rnafusion inspector][rnafusion-inspector] report containing only clinical fusions (a subset of all detected fusions).
 - **RNAfusion_inspector_research** _String_ Path to HTML [nf-core/rnafusion inspector][rnafusion-inspector] report containing all detected fusions.
 - **RNAfusion_report** _String_ Path to HTML [nf-core/rnafusion report][rnafusion-report] containing only clinical fusions (a subset of all detected fusions).
@@ -67,11 +69,12 @@ Below are available configuration parameters for a Scout case. Names marked with
     - **hrd** _Int_ Homologous recombination deficiency.
     - **is_sma** _Bool/None_ if SMA status determined - None if not done.
     - **is_sma_carrier**  _Bool/None_  # True / False if SMA carriership determined - None if not done.
+    - **minor_allele_frequency_wig** _String_ Path to minor allele frequency bigwig [Reference][hificnv].
     - **mitodel** _String_ Path to mitodel file.
     - **mother** _String/Int_ Sample ID for mother or 0.
     - **msi** _Int_ Microsatellite instability [0-60].
     - **mt_bam** _String_ Path to the reduced mitochondrial BAM/CRAM alignment file.
-    - **paraphase_alignment_path** _String_ Path to BAM/CRAM file to view Paraphase alignments.
+    - **paraphase_alignment_path** _String_ Path to BAM/CRAM file to view Paraphase alignments [Reference][paraphase].
     - **phenotype(*)** _String_ Specifies the affection status {affected, unaffected, unknown}.
     - **reviewer** _List_ [Reference][srs]
       - **alignment** _String_ Path to BAM/CRAM file to view STR alignments
@@ -86,13 +89,13 @@ Below are available configuration parameters for a Scout case. Names marked with
     - **rhocall_wig** _String_ Path to WIG file to view alignments [Reference][rhocall].
     - **samlple_id(*)** _String_ Identifyer for a sample.
     - **sample_name**: _String_ Name of sample.
-    - **sex (*)**: _String_ One of: {male, female, unknown}. Sex of the sample in human readable format.
+    - **sex (*)** _String_ One of: {male, female, unknown}. Sex of the sample in human readable format.
     - **smn1_cn** _Int_ Copynumber.
     - **smn2_cn** _Int_ Copynumber.
     - **smn2delta78_cn** _Int_ Copynumber.
     - **splice_junctions_bed** _String_ Path to indexed junctions .bed.gz file
     - **subject_id** _String_ Individual identifier - multiple samples could belong to the same individual
-    - **tiddit_coverage_wig** _String_ Path to WIG file to view alignments [Reference][tiddit].
+    - **tiddit_coverage_wig** or **coverage_wig** _String_ Path to WIG file to view alignment coverage overview from e.g. [Reference][tiddit] or [Reference][hificnv].
     - **tissue_type** _String_ Sample tissue origin i.e. blood, muscle.
     - **tmb** _Int_ Tumor mutational burden [0, 1000] (tumor case only).
     - **tumor_purity** _Float_ Purity of tumor sample [0.1, 1.0] (tumor case only).
@@ -146,7 +149,9 @@ vcf_snv: scout/demo/643594.clinical.vcf.gz
 [arriba]: https://arriba.readthedocs.io/en/latest/
 [d4_file]: https://github.com/38/d4-format
 [drop]: https://github.com/gagneurlab/drop
+[hificnv]: https://github.com/PacificBiosciences/HiFiCNV
 [multiqc]: https://github.com/ewels/multiqc
+[paraphase]: https://github.com/PacificBiosciences/paraphase
 [peddy]: https://github.com/brentp/peddy
 [rna-multiqc]: https://nf-co.re/rnafusion/output#multiqc
 [rnafusion-inspector]: https://nf-co.re/rnafusion/output#fusioninspector
@@ -158,3 +163,5 @@ vcf_snv: scout/demo/643594.clinical.vcf.gz
 [tomte]: https://github.com/genomic-medicine-sweden/tomte
 [upd]: https://github.com/bjhall/upd
 [yaml]: https://yaml.org
+
+

{scout_browser-4.99.0 → scout_browser-4.100.0}/docs/admin-guide/updating-individuals.md

@@ -32,6 +32,7 @@ And the tracks that can be updated are the following:
 - rhocall_bed
 - rhocall_wig
 - tiddit_coverage_wig
+- minor_allele_frequency_wig
 - upd_regions_bed
 - upd_sites_bed
 - rna_coverage_bigwig
@@ -56,6 +57,7 @@ The following files are used by the [igv.js](https://github.com/igvteam/igv.js/w
 | --------------------|:------------------------------------------------------------|
 | bam_file            | path to a bam/cram alignment file                           |
 | mt_bam              | path to a downsampled mitochondrial bam/cram alignment file |
+| minor_allele_frequency_wig | path to hificnv maf wig file                         |
 | rhocall_bed         | path to rhocall output bed file                             |
 | rhocall_wig         | path to rhocall output wig file                             |
 | tiddit_coverage_wig | path to tiddit wig coverage file                            |
@@ -65,7 +67,8 @@ The following files are used by the [igv.js](https://github.com/igvteam/igv.js/w
 `rhocall_bed` and `rhocall_wig` files are both obtained from [rhocall](https://github.com/dnil/rhocall),
 a software that calls and annotates autozygosity from VCF files.
 
-`tiddit_coverage_wig` files are obtained from [tiddit](https://github.com/SciLifeLab/TIDDIT), a software which in turn is used to call structural variants.
+`tiddit_coverage_wig` files are obtained from [tiddit](https://github.com/SciLifeLab/TIDDIT) or [HiFiCNV](https://github.com/PacificBiosciences/HiFiCNV), software which in turn is used to call structural variants.
+Similarly, `minor_allele_frequency_wig` files are obtained from [HiFiCNV](https://github.com/PacificBiosciences/HiFiCNV), a software which is also used to call structural variants.
 
 `upd_regions_bed` and `upd_sites_bed` files are created from VCF files using the [upd tool](https://github.com/bjhall/upd).
 

{scout_browser-4.99.0 → scout_browser-4.100.0}/pyproject.toml

@@ -1,6 +1,6 @@
 [project]
 name = "scout-browser"
-version = "4.99.0"
+version = "4.100.0"
 description = "Clinical DNA variant visualizer and browser"
 authors = [{name="Chiara Rasi", email="chiara.rasi@scilifelab.se"}, {name="Daniel Nilsson", email="daniel.nilsson@ki.se"}, {name="Robin Andeer", email="robin.andeer@gmail.com"}, {name="Mans Magnuson", email="monsunas@gmail.com"}]
 license = {text = "MIT License"}

{scout_browser-4.99.0 → scout_browser-4.100.0}/scout/adapter/mongo/case.py

@@ -1,5 +1,6 @@
 # -*- coding: utf-8 -*-
 import datetime
+import json
 import logging
 import operator
 import re
@@ -831,20 +832,11 @@ class CaseHandler(object):
         result = self.case_collection.delete_one(query)
         return result
 
-    def check_existing_data(self, case_obj, existing_case, institute_obj, update, keep_actions):
-        """Make sure data from case to be loaded/reuploaded conforms to case data already saved in database.
-           Return eventual evaluated variants to be propagated to the updated case if keep_actions is True
-
-        Args:
-            case_obj(dict): case dictionary to be loaded/reuploaded
-            existing_case(dict): a case with same _id or same display_name and institute_id as case_obj
-            institute_obj(dict): institute dictionary
-            update(bool): If existing case should be updated
-            keep_actions(bool): If old evaluated variants should be kept when case is updated
-
-        Returns:
-            previous_evaluated_variants(list): list of variants evaluated in previous case
-                or None if case is not already present in the database.
+    def check_existing_data(
+        self, case_obj: dict, existing_case: dict, institute_obj: dict, update, keep_actions: bool
+    ) -> Optional[List[dict]]:
+        """Make sure data from a case to be loaded/re-uploaded conforms to any case data already saved in the database.
+        If keep_actions is True, return any evaluated variants to be propagated to the updated case. The flag indicates that old evaluated variants should be kept when the case is updated.
         """
 
         if existing_case is None:
@@ -886,6 +878,29 @@ class CaseHandler(object):
             # collect all variants with user actions for this case
             return list(self.evaluated_variants(case_obj["_id"], institute_obj["_id"]))
 
+    def update_case_phenotypes(self, old_case: dict, new_case: dict):
+        """If case has been re-run/re-uploaded, remember phenotype-related settings from the old case, including assigned diseases, HPO terms, phenotype groups and HPO panels."""
+        for key in [
+            "dynamic_panel_phenotypes",
+            "dynamic_gene_list",
+            "dynamic_gene_list_edited",
+        ]:  # Remember key/values from old case
+            if key in old_case:
+                new_case[key] = old_case[key]
+
+        for key in [
+            "phenotype_terms",
+            "phenotype_groups",
+            "diagnosis_phenotypes",
+        ]:  # Remember key/values from old case and integrate with info provided on case config file
+            if key not in old_case:
+                continue
+            new_case[key] = list(
+                {
+                    json.dumps(d, sort_keys=True): d for d in new_case.get(key, []) + old_case[key]
+                }.values()
+            )
+
     def update_case_data_sharing(self, old_case: dict, new_case: dict):
         """Update data sharing info for a case that is re-runned/re-uploaded."""
         for key in ["beacon", "mme_submission"]:
@@ -1008,6 +1023,7 @@ class CaseHandler(object):
         finally:
             if existing_case:
                 self.update_case_data_sharing(old_case=existing_case, new_case=case_obj)
+                self.update_case_phenotypes(old_case=existing_case, new_case=case_obj)
                 case_obj["rerun_requested"] = False
                 if case_obj["status"] in ["active", "archived"]:
                     case_obj["status"] = "inactive"
@@ -1017,7 +1033,6 @@ class CaseHandler(object):
                     institute_id=institute_obj["_id"],
                     force_update_case=True,
                 )
-
                 self.update_case_cli(case_obj, institute_obj)
                 # update Sanger status for the new inserted variants
                 self.update_case_sanger_variants(institute_obj, case_obj, old_sanger_variants)

{scout_browser-4.99.0 → scout_browser-4.100.0}/scout/adapter/mongo/clinvar.py

@@ -1,7 +1,7 @@
 # -*- coding: utf-8 -*-
 import logging
 from datetime import datetime
-from typing import Optional
+from typing import List, Optional
 
 import pymongo
 from bson import ObjectId
@@ -218,63 +218,55 @@ class ClinVarHandler(object):
 
         return sorted_case_data or case_data_list
 
-    def clinvar_submissions(self, institute_id):
-        """Collect all open and closed clinvar submissions for an institute
-
-        Args:
-            institute_id(str): an institute ID
+    def _basic_submission_info(self, result: dict) -> dict:
+        """Extracts the basic submission fields."""
+        user = self.user(user_id=result.get("created_by"))
+        return {
+            "_id": result.get("_id"),
+            "status": result.get("status"),
+            "institute_id": result.get("institute_id"),
+            "created_at": result.get("created_at"),
+            "created_by": user["name"] if user else None,
+            "updated_at": result.get("updated_at"),
+        }
 
-        Returns:
-            submissions(list): a list of clinvar submission objects
-        """
-        # get first all submission objects
+    def clinvar_submissions(self, institute_id: str) -> List[dict]:
+        """Collect all open and closed clinvar submissions for an institute"""
         query = dict(institute_id=institute_id)
         results = list(
             self.clinvar_submission_collection.find(query).sort("updated_at", pymongo.DESCENDING)
         )
 
         submissions = []
-        # Loop over all ClinVar submissions for an institute
         for result in results:
-            submission = {}
+            submission = self._basic_submission_info(result)
             cases = {}
-            user: dict = self.user(user_id=result.get("created_by"))
-            submission["_id"] = result.get("_id")
-            submission["status"] = result.get("status")
-            submission["institute_id"] = result.get("institute_id")
-            submission["created_at"] = result.get("created_at")
-            submission["created_by"] = user["name"] if user else None
-            submission["updated_at"] = result.get("updated_at")
-
-            if "clinvar_subm_id" in result:
+
+            if result.get("clinvar_subm_id"):
                 submission["clinvar_subm_id"] = result["clinvar_subm_id"]
 
-            # If submission has variants registered
             if result.get("variant_data"):
                 submission["variant_data"] = list(
                     self.clinvar_collection.find({"_id": {"$in": result["variant_data"]}}).sort(
                         "last_evaluated", pymongo.ASCENDING
                     )
                 )
-
-                # Loop over variants contained in a single ClinVar submission
                 for var_info in submission["variant_data"]:
-                    # get case_id from variant id (caseID_variant_ID)
                     case_id = var_info["_id"].rsplit("_", 1)[0]
                     CASE_CLINVAR_SUBMISSION_PROJECTION = {"display_name": 1}
+                    var_info["added_by"] = self.clinvar_variant_submitter(
+                        institute_id=institute_id, case_id=case_id, variant_id=var_info["local_id"]
+                    )
                     case_obj = self.case(
                         case_id=case_id, projection=CASE_CLINVAR_SUBMISSION_PROJECTION
                     )
+                    if not case_obj:
+                        cases[case_id] = f"{case_id} (N/A)"  # Situation when case has been removed
+                        continue
                     cases[case_id] = case_obj.get("display_name")
 
-                    # retrieve user responsible for adding the variant to the submission
-                    var_info["added_by"] = self.clinvar_variant_submitter(
-                        institute_id=institute_id, case_id=case_id, variant_id=var_info["local_id"]
-                    )
-
             submission["cases"] = cases
 
-            # If submission has case data registered
             if result.get("case_data"):
                 unsorted_case_data = list(
                     self.clinvar_collection.find({"_id": {"$in": result["case_data"]}})

{scout_browser-4.99.0 → scout_browser-4.100.0}/scout/adapter/mongo/event.py

@@ -240,16 +240,26 @@ class EventHandler(CaseEventHandler, VariantEventHandler):
 
         return self.event_collection.find(query)
 
-    def case_events_by_verb(self, category: str, institute: dict, case: dict, verb: str):
+    def institute_events_by_verb(
+        self, category: str, institute_id: dict, verb: str
+    ) -> pymongo.cursor.Cursor:
+        """Return events with a specific verb for an institute from the newest."""
+        query = {
+            "category": category,
+            "institute": institute_id,
+            "verb": verb,
+        }
+        return self.event_collection.find(query).sort("updated_at", pymongo.DESCENDING)
+
+    def case_events_by_verb(
+        self, category: str, institute: dict, case: dict, verb: str
+    ) -> pymongo.cursor.Cursor:
         """Return events with a specific verb for a case of an institute
         Args:
             category (str): "case" or "variant"
             institute (dict): an institute id
             case (dict): a case id
             verb (str): an event action verb, example: "dismiss_variant"
-
-        Returns:
-            pymongo.Cursor: Query results
         """
         query = {
             "category": category,

{scout_browser-4.99.0 → scout_browser-4.100.0}/scout/adapter/mongo/omics_variant.py

@@ -1,5 +1,5 @@
 import logging
-from typing import Dict, Optional
+from typing import Dict, Iterable, List, Optional
 
 from pymongo import ASCENDING, DESCENDING
 
@@ -217,3 +217,16 @@ class OmicsVariantHandler:
             case_id, query=query, variant_ids=variant_ids, category=category, build=build
         )
         return self.omics_variant_collection.count_documents(query)
+
+    def get_omics_variants_hgnc_overlapping(
+        self, hgnc_ids: List[int], variant_type: str, variant_obj: dict
+    ) -> Iterable[Dict]:
+        """Return WTS outliers matching the genes of the DNA variant in question."""
+        query = {
+            "$and": [
+                {"case_id": variant_obj["case_id"]},
+                {"variant_type": variant_type},
+                {"hgnc_ids": {"$in": hgnc_ids}},
+            ]
+        }
+        return self.omics_variant_collection.find(query)