TestDataX 0.1.0__tar.gz

testdatax-0.1.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2025 JamesPBrett
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

testdatax-0.1.0/PKG-INFO

@@ -0,0 +1,345 @@
+Metadata-Version: 2.3
+Name: TestDataX
+Version: 0.1.0
+Summary: A flexible test data generation toolkit
+License: MIT
+Author: JamesPBrett
+Requires-Python: >=3.11,<4.0
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Requires-Dist: faker (>=33.1.0,<34.0.0)
+Requires-Dist: mysql-connector-python (>=9.1.0,<10.0.0)
+Requires-Dist: orjson (>=3.10.12,<4.0.0)
+Requires-Dist: pandas (>=2.2.3,<3.0.0)
+Requires-Dist: pyarrow (>=18.1.0,<19.0.0)
+Requires-Dist: pydantic (>=2.10.4,<3.0.0)
+Requires-Dist: typer (>=0.15.1,<0.16.0)
+Description-Content-Type: text/markdown
+
+# TestDataX
+
+![Build Status](https://github.com/JamesPBrett/testdatax/actions/workflows/publish.yml/badge.svg)
+[![codecov](https://codecov.io/gh/JamesPBrett/testdatax/branch/main/graph/badge.svg?token=6VX62CI6U9)](https://codecov.io/gh/JamesPBrett/testdatax)
+![Python Version](https://img.shields.io/badge/python-3.11%2B-blue)
+![License](https://img.shields.io/badge/license-MIT-blue.svg)
+
+This command-line interface application enables quick and customizable test data generation across various formats. It leverages Faker for realistic data fields, offers flexible schema configurations, and simplifies output to multiple database dialects or file types. Users can define precise parameters for data volume, types, and constraints for each target data set.
+
+## Requirements
+- Python 3.11+
+- Additional dependencies are handled automatically by poetry
+
+## Installation
+
+### Prerequisites
+
+```bash
+# Install Python 3.11+ if not already installed
+brew install python@3.11
+
+# Install Poetry
+curl -sSL https://install.python-poetry.org | python3 -
+
+# Verify Poetry installation
+poetry --version
+```
+
+### Install
+
+```bash
+# Clone the repository
+git clone https://github.com/JamesPBrett/testdatax.git
+cd testdatax
+
+# Install dependencies
+poetry install
+```
+
+### Common Issues
+
+- If Poetry is not found in PATH:
+  ```bash
+  export PATH="$HOME/.local/bin:$PATH"
+  ```
+
+## Features
+
+- Generate realistic test data using Data providers
+- Support for multiple output formats (CSV, JSON, SQL, etc.)
+- Customizable schema definitions
+- Configurable data generation parameters
+- CLI tool for easy data generation
+
+## Supported Formats
+
+- JSON
+- CSV
+- ORC
+- Parquet
+- MySQL
+- MSSQL
+- Oracle
+
+## CLI Usage
+```bash
+testdatax -o <output_file> -f <format> -s <schema_file> -r <num_rows> [-d]
+```
+
+Options:
+- `-o, --output`: Output file path (table_name for sql exports)
+- `-f, --format`: Output format (csv, json, orc, parquet, mysql, mssql, oracle)
+- `-r, --rows`: Number of rows to generate (default: 10)
+- `-s, --schema`: Path to schema file
+- `-d, --debug`: Enable debug output
+
+## Usage Examples
+
+Generate 10 rows of CSV data:
+```bash
+testdatax -o users.csv -f csv -s schema.json -r 10
+```
+
+Generate 1000 rows of Parquet data with debug output:
+```bash
+testdatax -o large_dataset.parquet -f parquet -s users_schema.json -r 1000 -d
+```
+Generate JSON data with default row count (10):
+```bash
+testdatax -o data.json -f json -s schema.json
+```
+
+Generate ORC file with specific schema:
+```bash
+testdatax -o analytics.orc -f orc -s analytics_schema.json -r 100
+```
+
+Generate MySQL with default row count (1000), table_name as 'default':
+```bash
+testdatax -o default.sql -f mysql -r 1000
+```
+
+Generate MSSQL with default row count (1000), table_name as 'mstest':
+```bash
+testdatax -o mstest.sql -f mssql -r 1000
+```
+
+Generate Oracle with default row count (1000), table_name as 'oracle':
+```bash
+datagen -o oracle.sql -f oracle -r 1000
+```
+
+Each command consists of:
+- `-o, --output`: Specify the output file path and name
+- `-f, --format`: Output format (csv, json, orc, parquet, mysql, mssql, oracle)
+- `-s, --schema`: Path to your schema definition file
+- `-r, --rows`: Number of rows to generate (optional, defaults to 10)
+- `-d, --debug`: Enable debug logging (optional)
+
+## Schema Example
+
+```json
+{
+  "username": {
+    "type": "string",
+    "faker": "name"
+  },
+  "date_joined": {
+    "type": "datetime"
+  },
+  "date": {
+    "type": "date"
+  },
+  "age": {
+    "type": "integer",
+    "min": 18,
+    "max": 99
+  },
+  "is_active": {
+    "type": "boolean"
+  },
+  "float": {
+    "type": "float"
+  },
+  "uuid": {
+    "type": "uuid"
+  },
+  "status": {
+    "type": "enum",
+    "values": ["active", "inactive", "pending"]
+  }
+}
+```
+
+## Schema Configuration
+
+The schema file defines the structure and constraints of your generated data. Each field in the schema can have the following properties:
+
+### Basic Field Properties
+- `type`: (required) The data type of the field
+- `nullable`: (optional) Boolean to allow null values (default: false)
+- `unique`: (optional) Boolean to ensure unique values (default: false)
+
+### Type-Specific Properties
+
+#### String Fields
+```json
+{
+  "username": {
+    "type": "string",
+    "min_length": 5,
+    "max_length": 20,
+    "faker": "user_name"  // Use faker to generate realistic data
+  },
+  "description": {
+    "type": "text",
+    "min_length": 100,
+    "max_length": 500
+  }
+}
+```
+
+#### Numeric Fields
+```json
+{
+  "age": {
+    "type": "integer",
+    "min": 18,
+    "max": 99
+  },
+  "score": {
+    "type": "float",
+    "min": 0.0,
+    "max": 100.0,
+    "precision": 2
+  }
+}
+```
+
+#### Date and Time Fields
+```json
+{
+  "created_at": {
+    "type": "datetime",
+    "start_date": "2020-01-01",
+    "end_date": "2023-12-31"
+  },
+  "birth_date": {
+    "type": "date",
+    "format": "%Y-%m-%d"
+  }
+}
+```
+
+#### Enum Fields
+```json
+{
+  "status": {
+    "type": "enum",
+    "values": ["pending", "active", "suspended"],
+    "weights": [0.2, 0.7, 0.1]  // Optional probability weights
+  }
+}
+```
+
+#### Using Faker
+The generator supports Faker providers for generating realistic data:
+```json
+{
+  "name": {
+    "type": "string",
+    "faker": "name"
+  },
+  "email": {
+    "type": "string",
+    "faker": "email"
+  },
+  "address": {
+    "type": "string",
+    "faker": "address"
+  },
+  "company": {
+    "type": "string",
+    "faker": "company"
+  }
+}
+```
+
+### Complete Example
+```json
+{
+  "user_id": {
+    "type": "uuid",
+    "unique": true
+  },
+  "username": {
+    "type": "string",
+    "faker": "user_name",
+    "unique": true
+  },
+  "email": {
+    "type": "string",
+    "faker": "email",
+    "unique": true
+  },
+  "age": {
+    "type": "integer",
+    "min": 18,
+    "max": 99
+  },
+  "status": {
+    "type": "enum",
+    "values": ["active", "inactive"],
+    "weights": [0.8, 0.2]
+  },
+  "created_at": {
+    "type": "datetime",
+    "start_date": "2020-01-01",
+    "end_date": "2023-12-31"
+  },
+  "is_verified": {
+    "type": "boolean",
+    "nullable": true
+  }
+}
+```
+
+## Supported Data Types
+
+- string
+- text
+- integer
+- bigint
+- float
+- decimal
+- boolean
+- date
+- datetime
+- blob
+- uuid
+- enum
+
+## Database Type Mappings
+
+| Generic Type | MySQL         | MSSQL             | Oracle        |
+|--------------|---------------|-------------------|---------------|
+| string       | VARCHAR(255)  | NVARCHAR(255)     | VARCHAR2(255) |
+| text         | TEXT          | NVARCHAR(MAX)     | CLOB          |
+| integer      | INT           | INT               | NUMBER(10)    |
+| bigint       | BIGINT        | BIGINT            | NUMBER(19)    |
+| float        | FLOAT         | FLOAT             | FLOAT         |
+| decimal      | DECIMAL(18,2) | DECIMAL(18,2)     | NUMBER(18,2)  |
+| boolean      | TINYINT(1)    | BIT               | NUMBER(1)     |
+| date         | DATE          | DATE              | DATE          |
+| datetime     | DATETIME      | DATETIME2         | TIMESTAMP     |
+| blob         | LONGBLOB      | VARBINARY(MAX)    | BLOB          |
+| uuid         | VARCHAR(36)   | UNIQUEIDENTIFIER  | VARCHAR2(36)  |
+| enum         | ENUM          | NVARCHAR(255)     | VARCHAR2(255) |
+
+## License
+
+This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.
+# Test change
+

testdatax-0.1.0/README.md

@@ -0,0 +1,323 @@
+# TestDataX
+
+![Build Status](https://github.com/JamesPBrett/testdatax/actions/workflows/publish.yml/badge.svg)
+[![codecov](https://codecov.io/gh/JamesPBrett/testdatax/branch/main/graph/badge.svg?token=6VX62CI6U9)](https://codecov.io/gh/JamesPBrett/testdatax)
+![Python Version](https://img.shields.io/badge/python-3.11%2B-blue)
+![License](https://img.shields.io/badge/license-MIT-blue.svg)
+
+This command-line interface application enables quick and customizable test data generation across various formats. It leverages Faker for realistic data fields, offers flexible schema configurations, and simplifies output to multiple database dialects or file types. Users can define precise parameters for data volume, types, and constraints for each target data set.
+
+## Requirements
+- Python 3.11+
+- Additional dependencies are handled automatically by poetry
+
+## Installation
+
+### Prerequisites
+
+```bash
+# Install Python 3.11+ if not already installed
+brew install python@3.11
+
+# Install Poetry
+curl -sSL https://install.python-poetry.org | python3 -
+
+# Verify Poetry installation
+poetry --version
+```
+
+### Install
+
+```bash
+# Clone the repository
+git clone https://github.com/JamesPBrett/testdatax.git
+cd testdatax
+
+# Install dependencies
+poetry install
+```
+
+### Common Issues
+
+- If Poetry is not found in PATH:
+  ```bash
+  export PATH="$HOME/.local/bin:$PATH"
+  ```
+
+## Features
+
+- Generate realistic test data using Data providers
+- Support for multiple output formats (CSV, JSON, SQL, etc.)
+- Customizable schema definitions
+- Configurable data generation parameters
+- CLI tool for easy data generation
+
+## Supported Formats
+
+- JSON
+- CSV
+- ORC
+- Parquet
+- MySQL
+- MSSQL
+- Oracle
+
+## CLI Usage
+```bash
+testdatax -o <output_file> -f <format> -s <schema_file> -r <num_rows> [-d]
+```
+
+Options:
+- `-o, --output`: Output file path (table_name for sql exports)
+- `-f, --format`: Output format (csv, json, orc, parquet, mysql, mssql, oracle)
+- `-r, --rows`: Number of rows to generate (default: 10)
+- `-s, --schema`: Path to schema file
+- `-d, --debug`: Enable debug output
+
+## Usage Examples
+
+Generate 10 rows of CSV data:
+```bash
+testdatax -o users.csv -f csv -s schema.json -r 10
+```
+
+Generate 1000 rows of Parquet data with debug output:
+```bash
+testdatax -o large_dataset.parquet -f parquet -s users_schema.json -r 1000 -d
+```
+Generate JSON data with default row count (10):
+```bash
+testdatax -o data.json -f json -s schema.json
+```
+
+Generate ORC file with specific schema:
+```bash
+testdatax -o analytics.orc -f orc -s analytics_schema.json -r 100
+```
+
+Generate MySQL with default row count (1000), table_name as 'default':
+```bash
+testdatax -o default.sql -f mysql -r 1000
+```
+
+Generate MSSQL with default row count (1000), table_name as 'mstest':
+```bash
+testdatax -o mstest.sql -f mssql -r 1000
+```
+
+Generate Oracle with default row count (1000), table_name as 'oracle':
+```bash
+datagen -o oracle.sql -f oracle -r 1000
+```
+
+Each command consists of:
+- `-o, --output`: Specify the output file path and name
+- `-f, --format`: Output format (csv, json, orc, parquet, mysql, mssql, oracle)
+- `-s, --schema`: Path to your schema definition file
+- `-r, --rows`: Number of rows to generate (optional, defaults to 10)
+- `-d, --debug`: Enable debug logging (optional)
+
+## Schema Example
+
+```json
+{
+  "username": {
+    "type": "string",
+    "faker": "name"
+  },
+  "date_joined": {
+    "type": "datetime"
+  },
+  "date": {
+    "type": "date"
+  },
+  "age": {
+    "type": "integer",
+    "min": 18,
+    "max": 99
+  },
+  "is_active": {
+    "type": "boolean"
+  },
+  "float": {
+    "type": "float"
+  },
+  "uuid": {
+    "type": "uuid"
+  },
+  "status": {
+    "type": "enum",
+    "values": ["active", "inactive", "pending"]
+  }
+}
+```
+
+## Schema Configuration
+
+The schema file defines the structure and constraints of your generated data. Each field in the schema can have the following properties:
+
+### Basic Field Properties
+- `type`: (required) The data type of the field
+- `nullable`: (optional) Boolean to allow null values (default: false)
+- `unique`: (optional) Boolean to ensure unique values (default: false)
+
+### Type-Specific Properties
+
+#### String Fields
+```json
+{
+  "username": {
+    "type": "string",
+    "min_length": 5,
+    "max_length": 20,
+    "faker": "user_name"  // Use faker to generate realistic data
+  },
+  "description": {
+    "type": "text",
+    "min_length": 100,
+    "max_length": 500
+  }
+}
+```
+
+#### Numeric Fields
+```json
+{
+  "age": {
+    "type": "integer",
+    "min": 18,
+    "max": 99
+  },
+  "score": {
+    "type": "float",
+    "min": 0.0,
+    "max": 100.0,
+    "precision": 2
+  }
+}
+```
+
+#### Date and Time Fields
+```json
+{
+  "created_at": {
+    "type": "datetime",
+    "start_date": "2020-01-01",
+    "end_date": "2023-12-31"
+  },
+  "birth_date": {
+    "type": "date",
+    "format": "%Y-%m-%d"
+  }
+}
+```
+
+#### Enum Fields
+```json
+{
+  "status": {
+    "type": "enum",
+    "values": ["pending", "active", "suspended"],
+    "weights": [0.2, 0.7, 0.1]  // Optional probability weights
+  }
+}
+```
+
+#### Using Faker
+The generator supports Faker providers for generating realistic data:
+```json
+{
+  "name": {
+    "type": "string",
+    "faker": "name"
+  },
+  "email": {
+    "type": "string",
+    "faker": "email"
+  },
+  "address": {
+    "type": "string",
+    "faker": "address"
+  },
+  "company": {
+    "type": "string",
+    "faker": "company"
+  }
+}
+```
+
+### Complete Example
+```json
+{
+  "user_id": {
+    "type": "uuid",
+    "unique": true
+  },
+  "username": {
+    "type": "string",
+    "faker": "user_name",
+    "unique": true
+  },
+  "email": {
+    "type": "string",
+    "faker": "email",
+    "unique": true
+  },
+  "age": {
+    "type": "integer",
+    "min": 18,
+    "max": 99
+  },
+  "status": {
+    "type": "enum",
+    "values": ["active", "inactive"],
+    "weights": [0.8, 0.2]
+  },
+  "created_at": {
+    "type": "datetime",
+    "start_date": "2020-01-01",
+    "end_date": "2023-12-31"
+  },
+  "is_verified": {
+    "type": "boolean",
+    "nullable": true
+  }
+}
+```
+
+## Supported Data Types
+
+- string
+- text
+- integer
+- bigint
+- float
+- decimal
+- boolean
+- date
+- datetime
+- blob
+- uuid
+- enum
+
+## Database Type Mappings
+
+| Generic Type | MySQL         | MSSQL             | Oracle        |
+|--------------|---------------|-------------------|---------------|
+| string       | VARCHAR(255)  | NVARCHAR(255)     | VARCHAR2(255) |
+| text         | TEXT          | NVARCHAR(MAX)     | CLOB          |
+| integer      | INT           | INT               | NUMBER(10)    |
+| bigint       | BIGINT        | BIGINT            | NUMBER(19)    |
+| float        | FLOAT         | FLOAT             | FLOAT         |
+| decimal      | DECIMAL(18,2) | DECIMAL(18,2)     | NUMBER(18,2)  |
+| boolean      | TINYINT(1)    | BIT               | NUMBER(1)     |
+| date         | DATE          | DATE              | DATE          |
+| datetime     | DATETIME      | DATETIME2         | TIMESTAMP     |
+| blob         | LONGBLOB      | VARBINARY(MAX)    | BLOB          |
+| uuid         | VARCHAR(36)   | UNIQUEIDENTIFIER  | VARCHAR2(36)  |
+| enum         | ENUM          | NVARCHAR(255)     | VARCHAR2(255) |
+
+## License
+
+This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.
+# Test change