lazyanalyst 1.0.0__tar.gz

lazyanalyst-1.0.0/CHANGELOG.md

@@ -0,0 +1,179 @@
+# Changelog
+
+All notable changes to this project will be documented in this file.
+
+The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
+and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
+
+## [1.0.0] - 2024-06-01
+
+### Added
+- Initial release of LazyAnalyst
+- Full automated data analysis pipeline
+- CSV and XLSX file support
+- 11 integrated analysis modules
+- Interactive HTML dashboard with Plotly
+- Professional HTML report generation
+- Automated statistical testing framework
+- Data quality auditing and reporting
+- Feature engineering capabilities
+- Exploratory data analysis (EDA)
+- Natural language insights generation
+- Data cleaning and preprocessing automation
+
+### Modules Included
+1. **loader.py** — File loading and dtype inference
+   - Supports CSV (auto-detects encoding and delimiter)
+   - Supports XLSX (Excel workbooks)
+   - Automatic data type conversion
+
+2. **schema.py** — Column type detection
+   - Detects: numerical, categorical, datetime, boolean, identifier
+   - Priority-based classification
+
+3. **quality.py** — Data quality auditing
+   - Missing value analysis
+   - Duplicate detection
+   - Outlier flagging
+   - Quality score calculation
+
+4. **cleaner.py** — Automated data cleaning
+   - Missing value imputation
+   - Duplicate removal
+   - Outlier handling
+   - Type conversion
+
+5. **eda.py** — Exploratory data analysis
+   - Descriptive statistics
+   - Distribution analysis
+   - Correlation analysis
+
+6. **visualizer.py** — Chart generation
+   - Histograms and distributions
+   - Bar charts for categories
+   - Scatter plots
+   - Correlation heatmaps
+   - PNG output with matplotlib/seaborn
+
+7. **features.py** — Feature engineering
+   - Polynomial features
+   - Interaction terms
+   - Normalization/scaling
+   - Log transforms
+
+8. **stats.py** — Statistical testing
+   - Pearson/Spearman correlation
+   - Independent T-tests
+   - ANOVA
+   - Chi-Square tests
+   - P-value calculation and interpretation
+
+9. **insights.py** — Automated insights
+   - Correlation insights
+   - Group difference insights
+   - Data quality insights
+   - Distribution insights
+   - Natural language output
+
+10. **dashboard.py** — Interactive dashboard
+    - Plotly-based visualizations
+    - Dark theme design
+    - 6 main sections (Overview, Quality, Distributions, Correlations, Tests, Insights)
+    - Self-contained HTML file
+    - No server required
+
+11. **reporter.py** — HTML report generation
+    - Executive summary
+    - Dataset overview
+    - Data quality metrics
+    - EDA statistics
+    - Visualization embeddings
+    - Statistical results
+    - Actionable insights
+    - Professional styling with print support
+
+### Features
+- One-line API: `dp.analyze("file.csv")`
+- Automatic error handling and resilience
+- Progress reporting throughout pipeline
+- Comprehensive output documentation
+- Browser-based results viewing
+- No manual configuration required
+
+### Documentation
+- Comprehensive README with quick start guide
+- Installation instructions via pip
+- Full API reference
+- Example usage patterns
+- Architecture documentation
+- Contributing guidelines
+
+### License
+- MIT License for open distribution
+- Free for personal and commercial use
+
+---
+
+## Release Notes
+
+### v1.0.0 Highlights
+- One-liner analysis: `dp.analyze("data.csv")`
+- 11 fully integrated modules
+- Professional HTML outputs (dashboard + report)
+- Automatic statistical testing
+- Natural language insights
+- Beautiful dark theme interface
+- Fast processing even on moderate datasets
+- Robust error handling
+
+### What's Coming in v1.1
+- Time series analysis module
+- Anomaly detection
+- Clustering analysis
+- Advanced feature selection
+- Custom analysis templates
+- Export to PDF
+- Interactive Jupyter notebook support
+
+### Known Limitations
+- Dashboard rendering requires modern browser
+- Large files (>1GB) may require increased memory
+- Some advanced statistical tests not included
+- ML models use only sklearn basics
+
+---
+
+## Installation & Usage
+
+### Install
+```bash
+pip install lazyanalyst
+```
+
+### Basic Usage
+```python
+import lazyanalyst as dp
+
+result = dp.analyze("sales.csv")
+result.dashboard()  # View interactive dashboard
+result.report()      # View HTML report
+```
+
+### Supported Formats
+- CSV (comma, semicolon, or tab-separated)
+- XLSX (Excel workbooks)
+
+---
+
+## Changelog Format
+
+- **Added** for new features
+- **Changed** for changes in existing functionality
+- **Deprecated** for soon-to-be removed features
+- **Removed** for now removed features
+- **Fixed** for any bug fixes
+- **Security** for security fix announcements
+
+---
+
+**For more information, visit the GitHub repository or PyPI page.**

lazyanalyst-1.0.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2024 LazyAnalyst Contributors
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

lazyanalyst-1.0.0/MANIFEST.in

@@ -0,0 +1,5 @@
+include README.md
+include LICENSE
+include CHANGELOG.md
+recursive-include lazyanalyst *.py
+

lazyanalyst-1.0.0/PKG-INFO

@@ -0,0 +1,224 @@
+Metadata-Version: 2.4
+Name: lazyanalyst
+Version: 1.0.0
+Summary: Automated data analysis library with end-to-end analysis pipeline
+Home-page: https://github.com/Tenali-Rama/lazyanalyst
+Author: Tenali-Rama
+Author-email: Tenali-Rama <tenalirama.krishna125@gmail.com>
+License: MIT
+Project-URL: Homepage, https://github.com/Tenali-Rama/lazyanalyst
+Project-URL: Documentation, https://github.com/Tenali-Rama/lazyanalyst#readme
+Project-URL: Repository, https://github.com/Tenali-Rama/lazyanalyst.git
+Keywords: data-analysis,automation,pandas,visualization,statistics
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.8
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Classifier: Development Status :: 4 - Beta
+Classifier: Intended Audience :: Developers
+Classifier: Intended Audience :: Science/Research
+Classifier: Topic :: Scientific/Engineering
+Requires-Python: >=3.8
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: pandas>=1.0.0
+Requires-Dist: numpy>=1.19.0
+Requires-Dist: scipy>=1.5.0
+Requires-Dist: matplotlib>=3.3.0
+Requires-Dist: seaborn>=0.11.0
+Requires-Dist: plotly>=5.0.0
+Requires-Dist: dash>=2.0.0
+Requires-Dist: openpyxl>=3.0.0
+Provides-Extra: dev
+Requires-Dist: pytest>=6.0; extra == "dev"
+Requires-Dist: black>=21.0; extra == "dev"
+Requires-Dist: flake8>=3.9; extra == "dev"
+Requires-Dist: mypy>=0.910; extra == "dev"
+Requires-Dist: build>=0.7; extra == "dev"
+Requires-Dist: twine>=3.4; extra == "dev"
+Dynamic: author
+Dynamic: home-page
+Dynamic: license-file
+Dynamic: requires-python
+
+# LazyAnalyst v1.0.0
+
+**Automated data analysis library for Python**
+
+LazyAnalyst is an end-to-end data analysis library that automates everything you'd do manually with Pandas and NumPy. Load a dataset, run one line of code, and get a complete analysis with insights, visualizations, statistical tests, and a professional HTML report.
+
+## Quick Start
+
+```python
+import lazyanalyst as dp
+
+# Analyze any CSV or Excel file
+result = dp.analyze("sales_data.csv")
+
+# Open the interactive dashboard
+result.dashboard()
+
+# Or view the professional report
+result.report()
+```
+
+That's it! LazyAnalyst handles:
+- Automated data loading and type detection
+- Data quality auditing and reporting
+- Intelligent data cleaning
+- Exploratory data analysis
+- Statistical testing (Pearson, Spearman, ANOVA, Chi-Square)
+- Feature engineering
+- Interactive Plotly dashboard
+- Professional HTML report generation
+- Automated insights and interpretations
+
+## Installation
+
+Install via pip:
+
+```bash
+pip install lazyanalyst
+```
+
+**Requirements:** Python 3.8+
+
+Or install from source:
+
+```bash
+git clone https://github.com/Tenali-Rama/lazyanalyst.git
+cd lazyanalyst
+pip install -e .
+```
+
+## Features
+
+### 1. **Automated Pipeline**
+No configuration needed. Just provide a CSV or Excel file and LazyAnalyst handles the rest.
+
+### 2. **Data Quality Auditing**
+Automatically detects:
+- Missing values
+- Duplicate rows
+- Outliers
+- Data type inconsistencies
+- Quality score calculation
+
+### 3. **Intelligent Cleaning**
+- Auto-detects and fixes common issues
+- Handles missing values intelligently
+- Removes duplicates
+- Converts data types automatically
+
+### 4. **Exploratory Data Analysis (EDA)**
+- Summary statistics (mean, median, std, min, max)
+- Distribution analysis
+- Correlation detection
+- Categorical value counts
+
+### 5. **Statistical Testing**
+Runs appropriate tests automatically:
+- **Pearson/Spearman Correlation** for numerical relationships
+- **Independent T-Test** for 2-group comparisons
+- **ANOVA** for 3+ group comparisons
+- **Chi-Square** for categorical relationships
+
+### 6. **Feature Engineering**
+- Polynomial features
+- Interaction terms
+- Scaled/normalized versions
+- Log transforms for skewed data
+
+### 7. **Visualizations**
+Generates:
+- Distribution histograms
+- Categorical bar charts
+- Correlation heatmaps
+- Scatter plots for relationships
+
+### 8. **Interactive Dashboard**
+Beautiful, self-contained HTML dashboard with all analyses and charts.
+
+### 9. **Professional Report**
+PDF-ready HTML report with executive summary, findings, and visualizations.
+
+## Example Usage
+
+### Basic Analysis
+```python
+import lazyanalyst as dp
+
+result = dp.analyze("data.csv")
+result.dashboard()  # Open interactive dashboard
+result.report()      # Open HTML report
+```
+
+### With Options
+```python
+result = dp.analyze("data.xlsx", dashboard=True, report=True)
+
+# Access cleaned data
+cleaned_df = result.cleaned_data()
+```
+
+### Supported File Types
+- CSV (auto-detects encoding and delimiter)
+- XLSX (Excel workbooks)
+
+## Output Files
+
+LazyAnalyst creates an `outputs/` folder with:
+
+- `cleaned_data.csv` — Your cleaned dataset
+- `report.html` — Professional report
+- `dashboard.html` — Interactive dashboard
+- `insights.txt` — Text summary of insights
+- `plots/` — All generated visualizations
+
+## Architecture
+
+LazyAnalyst consists of 11 integrated modules:
+
+1. **loader.py** — File loading with auto type inference
+2. **schema.py** — Column type detection
+3. **quality.py** — Data quality auditing
+4. **cleaner.py** — Automated data cleaning
+5. **eda.py** — Exploratory data analysis
+6. **visualizer.py** — Chart generation
+7. **features.py** — Feature engineering
+8. **stats.py** — Statistical testing
+9. **insights.py** — Natural language insights
+10. **dashboard.py** — Interactive dashboard generation
+11. **reporter.py** — HTML report generation
+
+## Documentation
+
+Full documentation available in the GitHub repository.
+
+## License
+
+MIT License - See LICENSE file for details
+
+## Troubleshooting
+
+### "FileNotFoundError"
+- Check file path is correct
+- Use absolute path if relative path doesn't work
+
+### "ValueError: unsupported file type"
+- Ensure file is .csv or .xlsx
+
+### Dashboard won't open
+- Check plotly and dash are installed
+- Try opening dashboard.html directly in browser
+
+## Support
+
+For questions or issues, check this README or the GitHub repository.
+
+---
+
+Transform your data analysis workflow with one line of code.

lazyanalyst-1.0.0/README.md

@@ -0,0 +1,178 @@
+# LazyAnalyst v1.0.0
+
+**Automated data analysis library for Python**
+
+LazyAnalyst is an end-to-end data analysis library that automates everything you'd do manually with Pandas and NumPy. Load a dataset, run one line of code, and get a complete analysis with insights, visualizations, statistical tests, and a professional HTML report.
+
+## Quick Start
+
+```python
+import lazyanalyst as dp
+
+# Analyze any CSV or Excel file
+result = dp.analyze("sales_data.csv")
+
+# Open the interactive dashboard
+result.dashboard()
+
+# Or view the professional report
+result.report()
+```
+
+That's it! LazyAnalyst handles:
+- Automated data loading and type detection
+- Data quality auditing and reporting
+- Intelligent data cleaning
+- Exploratory data analysis
+- Statistical testing (Pearson, Spearman, ANOVA, Chi-Square)
+- Feature engineering
+- Interactive Plotly dashboard
+- Professional HTML report generation
+- Automated insights and interpretations
+
+## Installation
+
+Install via pip:
+
+```bash
+pip install lazyanalyst
+```
+
+**Requirements:** Python 3.8+
+
+Or install from source:
+
+```bash
+git clone https://github.com/Tenali-Rama/lazyanalyst.git
+cd lazyanalyst
+pip install -e .
+```
+
+## Features
+
+### 1. **Automated Pipeline**
+No configuration needed. Just provide a CSV or Excel file and LazyAnalyst handles the rest.
+
+### 2. **Data Quality Auditing**
+Automatically detects:
+- Missing values
+- Duplicate rows
+- Outliers
+- Data type inconsistencies
+- Quality score calculation
+
+### 3. **Intelligent Cleaning**
+- Auto-detects and fixes common issues
+- Handles missing values intelligently
+- Removes duplicates
+- Converts data types automatically
+
+### 4. **Exploratory Data Analysis (EDA)**
+- Summary statistics (mean, median, std, min, max)
+- Distribution analysis
+- Correlation detection
+- Categorical value counts
+
+### 5. **Statistical Testing**
+Runs appropriate tests automatically:
+- **Pearson/Spearman Correlation** for numerical relationships
+- **Independent T-Test** for 2-group comparisons
+- **ANOVA** for 3+ group comparisons
+- **Chi-Square** for categorical relationships
+
+### 6. **Feature Engineering**
+- Polynomial features
+- Interaction terms
+- Scaled/normalized versions
+- Log transforms for skewed data
+
+### 7. **Visualizations**
+Generates:
+- Distribution histograms
+- Categorical bar charts
+- Correlation heatmaps
+- Scatter plots for relationships
+
+### 8. **Interactive Dashboard**
+Beautiful, self-contained HTML dashboard with all analyses and charts.
+
+### 9. **Professional Report**
+PDF-ready HTML report with executive summary, findings, and visualizations.
+
+## Example Usage
+
+### Basic Analysis
+```python
+import lazyanalyst as dp
+
+result = dp.analyze("data.csv")
+result.dashboard()  # Open interactive dashboard
+result.report()      # Open HTML report
+```
+
+### With Options
+```python
+result = dp.analyze("data.xlsx", dashboard=True, report=True)
+
+# Access cleaned data
+cleaned_df = result.cleaned_data()
+```
+
+### Supported File Types
+- CSV (auto-detects encoding and delimiter)
+- XLSX (Excel workbooks)
+
+## Output Files
+
+LazyAnalyst creates an `outputs/` folder with:
+
+- `cleaned_data.csv` — Your cleaned dataset
+- `report.html` — Professional report
+- `dashboard.html` — Interactive dashboard
+- `insights.txt` — Text summary of insights
+- `plots/` — All generated visualizations
+
+## Architecture
+
+LazyAnalyst consists of 11 integrated modules:
+
+1. **loader.py** — File loading with auto type inference
+2. **schema.py** — Column type detection
+3. **quality.py** — Data quality auditing
+4. **cleaner.py** — Automated data cleaning
+5. **eda.py** — Exploratory data analysis
+6. **visualizer.py** — Chart generation
+7. **features.py** — Feature engineering
+8. **stats.py** — Statistical testing
+9. **insights.py** — Natural language insights
+10. **dashboard.py** — Interactive dashboard generation
+11. **reporter.py** — HTML report generation
+
+## Documentation
+
+Full documentation available in the GitHub repository.
+
+## License
+
+MIT License - See LICENSE file for details
+
+## Troubleshooting
+
+### "FileNotFoundError"
+- Check file path is correct
+- Use absolute path if relative path doesn't work
+
+### "ValueError: unsupported file type"
+- Ensure file is .csv or .xlsx
+
+### Dashboard won't open
+- Check plotly and dash are installed
+- Try opening dashboard.html directly in browser
+
+## Support
+
+For questions or issues, check this README or the GitHub repository.
+
+---
+
+Transform your data analysis workflow with one line of code.

lazyanalyst-1.0.0/lazyanalyst/__init__.py

@@ -0,0 +1 @@
+from .analyze import analyze, LazyAnalystResult