ctos-meval 1.1.0__tar.gz

ctos_meval-1.1.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2025 Center for Biomedical Informatics and Information Technology (CBIIT)
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

ctos_meval-1.1.0/PKG-INFO

@@ -0,0 +1,82 @@
+Metadata-Version: 2.4
+Name: ctos-meval
+Version: 1.1.0
+Summary: MDF Enforced Validator and Loader
+Author-email: Qiong Liu <qiong.liu@nih.gov>
+License-Expression: MIT
+Project-URL: Homepage, https://github.com/CBIIT/MEVAL
+Project-URL: Bug Tracker, https://github.com/CBIIT/MEVAL/issues
+Requires-Python: <4.0,>=3.13
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: bento-mdf>=0.13.1
+Requires-Dist: boto3<2.0,>=1.36.11
+Requires-Dist: pandas<3.0,>=2.3.3
+Requires-Dist: neo4j-viz<2.0,>=1.0.0
+Requires-Dist: neo4j<7.0,>=6.2.0
+Requires-Dist: tabulate<1.0,>=0.9.0
+Dynamic: license-file
+
+# MDF Enforced Validator and Loader (MEVAL)
+MDF Enforced Validator and Loader is a lightweight and modular framework designed to ensure data integrity through MDF enforced validation and seamless data ingestion into the graph database. This repository serves as the source code for MEVAL, providing tools, scripts, and workflows to validate and load data to graph database using Graph Model Description Format (MDF) as the source of accessing model features.
+
+## Core Modules
+
+MEVAL includes three core classes under the `meval` package that work together to support model-aware validation and graph loading workflows:
+
+### `ModelParser` (`meval/parser.py`)
+`ModelParser` wraps `bento_mdf.MDFReader` and provides easy access to MDF model metadata.(`bento_mdf` repository: https://github.com/CBIIT/bento-mdf)
+
+It is used to inspect node definitions, key properties, required fields, parent-child relationships, property types, and permissible values.
+This class is the model introspection layer used by both validation and loading logic.
+
+### `Loader` (`meval/loader.py`)
+`Loader` handles graph database ingestion for TSV data files.
+It reads files in chunks, prepares node properties and relationships from each chunk, and performs upsert operations (MERGE semantics) for nodes and edges.
+It also includes helper methods for index creation, duplicate cleanup, and graph maintenance tasks such as finding floating/orphan nodes (nodes without a path to a root node, such as study/program node).
+
+### `Validator` (`meval/validator.py`)
+`Validator` enforces MDF-based data quality checks before loading.
+It validates TSV file format, validates record-level values against model constraints, checks relationship consistency across files, and supports unique-entry checks.
+It also provides utilities such as deterministic UUID generation and adding UUID columns to TSV files.
+
+## Installation
+
+### Prerequisites
+- Python 3.13
+
+### Install from source
+1. Clone this repository.
+2. Create and activate a virtual environment.
+3. Install dependencies:
+   - `pip install -r requirements_python3.13.txt`
+4. Install the package:
+   - `pip install .`
+
+## Example Usage (Imports and Instances)
+
+```python
+from neo4j import GraphDatabase
+from meval.loader import Loader
+from meval.parser import ModelParser
+from meval.validator import Validator
+
+# Create ModelParser
+model_parser = ModelParser(
+   model_file="tests/test_files/ccdi-dcc-model-test.yml",
+   props_file="tests/test_files/ccdi-dcc-model-props-test.yml",
+   handle="ccdi_dcc",
+)
+
+# Create Validator (uses MDF object from ModelParser)
+validator = Validator(mdf=model_parser.mdf)
+
+# Create Loader
+driver = GraphDatabase.driver(
+   "bolt://localhost:7687",
+   auth=("neo4j", "your_password"),
+)
+loader = Loader(driver=driver)
+```
+
+

ctos_meval-1.1.0/README.md

@@ -0,0 +1,63 @@
+# MDF Enforced Validator and Loader (MEVAL)
+MDF Enforced Validator and Loader is a lightweight and modular framework designed to ensure data integrity through MDF enforced validation and seamless data ingestion into the graph database. This repository serves as the source code for MEVAL, providing tools, scripts, and workflows to validate and load data to graph database using Graph Model Description Format (MDF) as the source of accessing model features.
+
+## Core Modules
+
+MEVAL includes three core classes under the `meval` package that work together to support model-aware validation and graph loading workflows:
+
+### `ModelParser` (`meval/parser.py`)
+`ModelParser` wraps `bento_mdf.MDFReader` and provides easy access to MDF model metadata.(`bento_mdf` repository: https://github.com/CBIIT/bento-mdf)
+
+It is used to inspect node definitions, key properties, required fields, parent-child relationships, property types, and permissible values.
+This class is the model introspection layer used by both validation and loading logic.
+
+### `Loader` (`meval/loader.py`)
+`Loader` handles graph database ingestion for TSV data files.
+It reads files in chunks, prepares node properties and relationships from each chunk, and performs upsert operations (MERGE semantics) for nodes and edges.
+It also includes helper methods for index creation, duplicate cleanup, and graph maintenance tasks such as finding floating/orphan nodes (nodes without a path to a root node, such as study/program node).
+
+### `Validator` (`meval/validator.py`)
+`Validator` enforces MDF-based data quality checks before loading.
+It validates TSV file format, validates record-level values against model constraints, checks relationship consistency across files, and supports unique-entry checks.
+It also provides utilities such as deterministic UUID generation and adding UUID columns to TSV files.
+
+## Installation
+
+### Prerequisites
+- Python 3.13
+
+### Install from source
+1. Clone this repository.
+2. Create and activate a virtual environment.
+3. Install dependencies:
+   - `pip install -r requirements_python3.13.txt`
+4. Install the package:
+   - `pip install .`
+
+## Example Usage (Imports and Instances)
+
+```python
+from neo4j import GraphDatabase
+from meval.loader import Loader
+from meval.parser import ModelParser
+from meval.validator import Validator
+
+# Create ModelParser
+model_parser = ModelParser(
+   model_file="tests/test_files/ccdi-dcc-model-test.yml",
+   props_file="tests/test_files/ccdi-dcc-model-props-test.yml",
+   handle="ccdi_dcc",
+)
+
+# Create Validator (uses MDF object from ModelParser)
+validator = Validator(mdf=model_parser.mdf)
+
+# Create Loader
+driver = GraphDatabase.driver(
+   "bolt://localhost:7687",
+   auth=("neo4j", "your_password"),
+)
+loader = Loader(driver=driver)
+```
+
+

ctos_meval-1.1.0/ctos_meval.egg-info/PKG-INFO

@@ -0,0 +1,82 @@
+Metadata-Version: 2.4
+Name: ctos-meval
+Version: 1.1.0
+Summary: MDF Enforced Validator and Loader
+Author-email: Qiong Liu <qiong.liu@nih.gov>
+License-Expression: MIT
+Project-URL: Homepage, https://github.com/CBIIT/MEVAL
+Project-URL: Bug Tracker, https://github.com/CBIIT/MEVAL/issues
+Requires-Python: <4.0,>=3.13
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: bento-mdf>=0.13.1
+Requires-Dist: boto3<2.0,>=1.36.11
+Requires-Dist: pandas<3.0,>=2.3.3
+Requires-Dist: neo4j-viz<2.0,>=1.0.0
+Requires-Dist: neo4j<7.0,>=6.2.0
+Requires-Dist: tabulate<1.0,>=0.9.0
+Dynamic: license-file
+
+# MDF Enforced Validator and Loader (MEVAL)
+MDF Enforced Validator and Loader is a lightweight and modular framework designed to ensure data integrity through MDF enforced validation and seamless data ingestion into the graph database. This repository serves as the source code for MEVAL, providing tools, scripts, and workflows to validate and load data to graph database using Graph Model Description Format (MDF) as the source of accessing model features.
+
+## Core Modules
+
+MEVAL includes three core classes under the `meval` package that work together to support model-aware validation and graph loading workflows:
+
+### `ModelParser` (`meval/parser.py`)
+`ModelParser` wraps `bento_mdf.MDFReader` and provides easy access to MDF model metadata.(`bento_mdf` repository: https://github.com/CBIIT/bento-mdf)
+
+It is used to inspect node definitions, key properties, required fields, parent-child relationships, property types, and permissible values.
+This class is the model introspection layer used by both validation and loading logic.
+
+### `Loader` (`meval/loader.py`)
+`Loader` handles graph database ingestion for TSV data files.
+It reads files in chunks, prepares node properties and relationships from each chunk, and performs upsert operations (MERGE semantics) for nodes and edges.
+It also includes helper methods for index creation, duplicate cleanup, and graph maintenance tasks such as finding floating/orphan nodes (nodes without a path to a root node, such as study/program node).
+
+### `Validator` (`meval/validator.py`)
+`Validator` enforces MDF-based data quality checks before loading.
+It validates TSV file format, validates record-level values against model constraints, checks relationship consistency across files, and supports unique-entry checks.
+It also provides utilities such as deterministic UUID generation and adding UUID columns to TSV files.
+
+## Installation
+
+### Prerequisites
+- Python 3.13
+
+### Install from source
+1. Clone this repository.
+2. Create and activate a virtual environment.
+3. Install dependencies:
+   - `pip install -r requirements_python3.13.txt`
+4. Install the package:
+   - `pip install .`
+
+## Example Usage (Imports and Instances)
+
+```python
+from neo4j import GraphDatabase
+from meval.loader import Loader
+from meval.parser import ModelParser
+from meval.validator import Validator
+
+# Create ModelParser
+model_parser = ModelParser(
+   model_file="tests/test_files/ccdi-dcc-model-test.yml",
+   props_file="tests/test_files/ccdi-dcc-model-props-test.yml",
+   handle="ccdi_dcc",
+)
+
+# Create Validator (uses MDF object from ModelParser)
+validator = Validator(mdf=model_parser.mdf)
+
+# Create Loader
+driver = GraphDatabase.driver(
+   "bolt://localhost:7687",
+   auth=("neo4j", "your_password"),
+)
+loader = Loader(driver=driver)
+```
+
+

ctos_meval-1.1.0/ctos_meval.egg-info/SOURCES.txt

@@ -0,0 +1,15 @@
+LICENSE
+README.md
+pyproject.toml
+ctos_meval.egg-info/PKG-INFO
+ctos_meval.egg-info/SOURCES.txt
+ctos_meval.egg-info/dependency_links.txt
+ctos_meval.egg-info/requires.txt
+ctos_meval.egg-info/top_level.txt
+meval/__init__.py
+meval/loader.py
+meval/parser.py
+meval/utils.py
+meval/validator.py
+tests/test_loader.py
+tests/test_validator.py

ctos_meval-1.1.0/ctos_meval.egg-info/dependency_links.txt

@@ -0,0 +1 @@
+

ctos_meval-1.1.0/ctos_meval.egg-info/requires.txt

@@ -0,0 +1,6 @@
+bento-mdf>=0.13.1
+boto3<2.0,>=1.36.11
+pandas<3.0,>=2.3.3
+neo4j-viz<2.0,>=1.0.0
+neo4j<7.0,>=6.2.0
+tabulate<1.0,>=0.9.0

ctos_meval-1.1.0/ctos_meval.egg-info/top_level.txt

@@ -0,0 +1 @@
+meval

ctos_meval-1.1.0/meval/__init__.py

@@ -0,0 +1,7 @@
+"""MEVAL package compatibility layer."""
+
+from .loader import Loader
+from .parser import ModelParser
+from .validator import Validator
+
+__all__ = ["Loader", "ModelParser", "Validator"]