datadoc-cli 0.1.0__py3-none-any.whl

datadoc_cli-0.1.0.dist-info/METADATA

@@ -0,0 +1,254 @@
+Metadata-Version: 2.4
+Name: datadoc-cli
+Version: 0.1.0
+Summary: The Open Source Operating System for Dataset Engineering.
+Project-URL: Homepage, https://github.com/narain-karti/DATADOC
+Project-URL: Repository, https://github.com/narain-karti/DATADOC
+Project-URL: Issues, https://github.com/narain-karti/DATADOC/issues
+Author: narain-karti
+License-Expression: MIT
+License-File: LICENSE
+Classifier: Development Status :: 3 - Alpha
+Classifier: Intended Audience :: Developers
+Classifier: Intended Audience :: Science/Research
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Topic :: Scientific/Engineering
+Requires-Python: >=3.9
+Requires-Dist: numpy>=1.24.0
+Requires-Dist: plotext>=5.2.8
+Requires-Dist: polars>=0.20.0
+Requires-Dist: rich>=13.7.0
+Requires-Dist: typer>=0.12.0
+Provides-Extra: dev
+Requires-Dist: pytest>=8.0.0; extra == 'dev'
+Requires-Dist: ruff>=0.4.0; extra == 'dev'
+Description-Content-Type: text/markdown
+
+<p align="center">
+  <pre>
+ ____    _  _____  _    ____   ___   ____
+|  _ \  / \|_   _|/ \  |  _ \ / _ \ / ___|
+| | | |/ _ \ | | / _ \ | | | | | | | |
+| |_| / ___ \| |/ ___ \| |_| | |_| | |___
+|____/_/   \_\_/_/   \_\____/ \___/ \____|
+  </pre>
+</p>
+
+<h3 align="center">The Open Source Operating System for Dataset Engineering.</h3>
+
+<p align="center">
+  <a href="#installation">Install</a> |
+  <a href="#quick-start">Quick Start</a> |
+  <a href="#cli-commands">CLI Commands</a> |
+  <a href="#plugins">Plugins</a> |
+  <a href="#contributing">Contributing</a>
+</p>
+
+---
+
+## What is DATADOC?
+
+DATADOC is an intelligent, modular **Dataset Engineering Framework** that orchestrates existing powerful libraries (Pandas, NumPy, Scikit-learn) into a standardized, reusable workflow.
+
+**DATADOC is NOT another EDA tool.** It doesn't just show you charts. It **diagnoses**, **recommends**, and **automatically engineers** your dataset -- then hands you a portable Python script to replicate it anywhere.
+
+### Core Philosophy
+
+- **Orchestrate, don't replace** -- DATADOC wraps Pandas, NumPy, and Sklearn. It doesn't reinvent them.
+- **Modular Plugin Architecture** -- Every transformation is an isolated, testable plugin.
+- **Explainable by Default** -- Every action can be explained, rolled back, and exported as code.
+- **Deterministic First** -- v1.0 uses a rule-based engine. No black-box AI decisions.
+
+---
+
+## Installation
+
+```bash
+# Clone and install
+git clone https://github.com/narain-karti/DATADOC.git
+cd DATADOC
+pip install -e .
+
+# Or install with dev dependencies
+pip install -e ".[dev]"
+```
+
+---
+
+## Quick Start
+
+```bash
+# Analyze your dataset's health
+datadoc analyze your_data.csv
+
+# Get recommendations without changing anything
+datadoc recommend your_data.csv
+
+# Automatically engineer your dataset
+datadoc engineer your_data.csv
+
+# Compare before vs after
+datadoc compare your_data.csv
+
+# Export a standalone Python pipeline
+datadoc pipeline your_data.csv
+
+# Generate a Markdown report
+datadoc report your_data.csv
+
+# List all available plugins
+datadoc plugin
+```
+
+### Python SDK
+
+```python
+from datadoc.core.engine import DATADOC
+
+doc = DATADOC("your_data.csv")
+
+# Analyze
+report = doc.analyze()
+print(report)
+
+# Get recommendations
+for rec in doc.recommend():
+    print(rec)
+
+# Auto-engineer
+clean_df = doc.engineer()
+clean_df.to_csv("clean_data.csv", index=False)
+
+# Export pipeline
+with open("pipeline.py", "w") as f:
+    f.write(doc.pipeline())
+```
+
+---
+
+## CLI Commands
+
+| Command | Description |
+|---------|-------------|
+| `datadoc analyze <file>` | Scans dataset and shows a health report with status indicators |
+| `datadoc recommend <file>` | Lists suggested engineering steps without modifying data |
+| `datadoc engineer <file>` | Automatically applies all recommended transformations |
+| `datadoc compare <file>` | Shows a before/after diff of the raw vs engineered dataset |
+| `datadoc pipeline <file>` | Exports a standalone `.py` script with the exact Pandas code |
+| `datadoc report <file>` | Generates a full Markdown report |
+| `datadoc plugin` | Lists all registered plugins with priority and descriptions |
+| `datadoc version` | Displays the DATADOC version |
+
+---
+
+## Plugins
+
+DATADOC ships with 5 built-in plugins, executed in priority order:
+
+| Priority | Plugin | What it Does |
+|----------|--------|-------------|
+| 10 | **MissingValuePlugin** | Imputes missing numeric values with median, categorical with mode |
+| 20 | **OutlierPlugin** | Detects outliers via IQR and clips at 5th/95th percentiles |
+| 30 | **DatetimePlugin** | Detects date columns and extracts year, month, day, day_of_week |
+| 40 | **CategoricalEncoderPlugin** | One-Hot Encodes categorical columns (< 10 unique values) |
+| 45 | **ScalingPlugin** | Standard scales numeric columns when scale ratio exceeds 10x |
+
+### Plugin Interface
+
+Every plugin implements the full `BasePlugin` interface:
+
+```python
+class BasePlugin(ABC):
+    name: str              # Plugin identifier
+    version: str           # Semantic version
+    description: str       # One-line description
+    priority: int          # Execution order (lower = first)
+    supported_datatypes    # Which dtypes this plugin handles
+    dependencies           # Plugins that must run before this one
+
+    analyze(df) -> dict           # Detect issues
+    recommend(analysis) -> list   # Suggest fixes
+    generate_code(analysis) -> str # Export as Python code
+    apply(df) -> DataFrame        # Apply transformation
+    validate(df) -> bool          # Verify result
+    rollback(original) -> DataFrame # Undo transformation
+    explain() -> str              # Human-readable explanation
+    estimate_runtime(df) -> float # Performance estimate
+```
+
+### Building Your Own Plugin
+
+See [CONTRIBUTING.md](CONTRIBUTING.md) for a step-by-step guide on building and registering custom plugins.
+
+---
+
+## Architecture
+
+```
+datadoc/
+  core/
+    engine.py          # DATADOC orchestrator class
+  cli/
+    app.py             # Typer CLI with Rich terminal UI
+  plugins/
+    base.py            # Abstract BasePlugin interface
+    missing_values.py  # MissingValuePlugin
+    outliers.py        # OutlierPlugin
+    datetime_feat.py   # DatetimePlugin
+    encoders.py        # CategoricalEncoderPlugin
+    scaling.py         # ScalingPlugin
+tests/
+  test_core.py         # Comprehensive test suite
+```
+
+The CLI talks to the Core Engine, which orchestrates Plugins sorted by priority. Each plugin independently analyzes, recommends, and applies transformations.
+
+---
+
+## Development
+
+```bash
+# Install dev dependencies
+pip install -e ".[dev]"
+
+# Run tests
+pytest tests/ -v
+
+# Lint
+ruff check datadoc/
+```
+
+---
+
+## Roadmap
+
+- [x] Core Engine with plugin orchestration
+- [x] 5 built-in plugins (Missing Values, Outliers, Datetime, Encoding, Scaling)
+- [x] 7 CLI commands with Rich terminal UI
+- [x] Pipeline export (standalone `.py` scripts)
+- [x] Markdown report generation
+- [x] Full plugin interface (validate, rollback, explain, estimate_runtime)
+- [x] CI/CD with GitHub Actions
+- [ ] PyPI release (`pip install datadoc`)
+- [ ] Polars backend support
+- [ ] REST API (FastAPI)
+- [ ] Web Dashboard
+- [ ] AI Planner (LLM replaces Rule Engine)
+- [ ] Plugin Marketplace
+
+---
+
+## License
+
+MIT License. See [LICENSE](LICENSE) for details.
+
+---
+
+## Contributing
+
+We welcome contributions! See [CONTRIBUTING.md](CONTRIBUTING.md) for guidelines.

datadoc_cli-0.1.0.dist-info/RECORD

@@ -0,0 +1,17 @@
+datadoc/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+datadoc/cli/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+datadoc/cli/app.py,sha256=x6AuaJddr0zgII1momvkOEyWL4csn-_2ojkspdYGQEk,21062
+datadoc/core/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+datadoc/core/engine.py,sha256=h7Dinb6mO3hToe5tPkr99quXbgpAJM8bhlrUwIuMj3w,5563
+datadoc/plugins/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+datadoc/plugins/base.py,sha256=-UZZsZviZ_nIWUfLBJVFq29g6FXuH9kBVnzUZLC_sBQ,2144
+datadoc/plugins/datetime_feat.py,sha256=KiNa2gSTmb-z1cN_Ro97YZy6bd4i9VXOv2blAIZN6jg,3651
+datadoc/plugins/encoders.py,sha256=Tv1f8lJH0eFyd-BhJHNfil-9VBL4aVK7pBmuoRl5FjU,2532
+datadoc/plugins/missing_values.py,sha256=7_vYrRme1qlzLnN8ZoilyDEh1gqfLc9ozHt_5P-MMaw,2821
+datadoc/plugins/outliers.py,sha256=J9XVLCEHxco_-bmkqnHTC1HeGHAxl4k5oUSmpqjfPeU,3153
+datadoc/plugins/scaling.py,sha256=iom7aVHNjw9YK23ifS4o1hvWCEJIkESoinI1_t4rHK8,3401
+datadoc_cli-0.1.0.dist-info/METADATA,sha256=U0uOnCLkWRnROLiy8xhicPCWNPfwWNaAf-tdJ2TsEXM,7573
+datadoc_cli-0.1.0.dist-info/WHEEL,sha256=lCkmxWfQsSc9CfIClYeavTdQeEX2toPqufh9gI35EQA,87
+datadoc_cli-0.1.0.dist-info/entry_points.txt,sha256=lCLwvyMXnoOXaDiam7ISwcuspPgZ4-Uyo-5IeDGoABc,48
+datadoc_cli-0.1.0.dist-info/licenses/LICENSE,sha256=RjDNnL6vIA0vCdwmmtWQKaJI-Fidt5QxGNiYx_d7EOM,1069
+datadoc_cli-0.1.0.dist-info/RECORD,,

datadoc_cli-0.1.0.dist-info/WHEEL

@@ -0,0 +1,4 @@
+Wheel-Version: 1.0
+Generator: hatchling 1.31.0
+Root-Is-Purelib: true
+Tag: py3-none-any

datadoc_cli-0.1.0.dist-info/entry_points.txt

@@ -0,0 +1,2 @@
+[console_scripts]
+datadoc = datadoc.cli.app:app

datadoc_cli-0.1.0.dist-info/licenses/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2024 narain-karti
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.