datacreator-sdk 0.1.5__tar.gz

datacreator_sdk-0.1.5/PKG-INFO

@@ -0,0 +1,114 @@
+Metadata-Version: 2.4
+Name: datacreator-sdk
+Version: 0.1.5
+Summary: Python SDK for the DataCreator AI dataset generation API
+Author-email: DataCreator AI <team@datacreatorai.com>
+License: MIT
+Project-URL: Homepage, https://datacreatorai.com
+Requires-Python: >=3.8
+Description-Content-Type: text/markdown
+Requires-Dist: requests>=2.32
+
+# DataCreator AI – Software Development Kit (SDK)
+
+A lightweight, proprietary Python client for accessing the **DataCreator AI** synthetic data generation API. This SDK is designed for desktop and server environments, enabling programmatic dataset generation with simple Python calls.
+
+---
+
+## Installation
+
+<!-- ### From TestPyPI (recommended during beta-testing)
+
+```bash
+pip install -i https://test.pypi.org/simple --extra-index-url https://pypi.org/simple datacreator-sdk
+``` -->
+
+## Usage Overview
+
+The `DataCreatorClient` provides a single primary method, `generate()`, that generates conversations suitable for fine-tuning AI models. The SDK handles communication, progress messages, response validation, and writing the final dataset to a `.jsonl` file.
+
+---
+
+## `generate()` Method
+
+The `generate()` function triggers the synthetic data generation workflow and saves the final dataset locally.
+
+### **Purpose**
+
+Initiates a dataset generation request and produces a `.jsonl` file containing structured conversational examples aligned with your specified theme.
+
+### **Authentication**
+Please contact us at team@datacreatorai.com for a API Key. Once you've received your unique key, send it during instantiation as shown in the example code.
+
+### **Parameters**
+
+The method accepts the following arguments:
+
+- **`main_theme` (str, required)**  
+  The central topic around which the synthetic dataset should be generated.  
+  Example: `"Daily tasks and personal planning for young working professionals"`
+  Any harmless and non-NSFW topic is allowed.
+
+- **`num_of_turns` (int, optional, default: 3)**  
+  Number of conversational turns per datapoint. The maximum number of turns allowed is 5.
+  A "turn" is typically one `user → assistant` exchange. The generation supports multiple message roles including **user**, **assistant**, **system**, and **tool**.
+  Example: `2` turns produces:  
+  - user  
+  - assistant  
+  - user  
+  - assistant  
+
+- **`num_of_datapoints` (int, optional, default: 100)**  
+  Number of independent dialogues/conversations to generate. 
+  The maximum number of data points allowed per generation is 1000.
+  Example: `10` produces 10 conversations.
+
+- **`language` (str, optional, default: "English")**  
+  The language in which the dataset should be generated.
+
+- **`system_prompt` (str, optional)**  
+  A custom instruction or persona that the assistant should follow throughout the conversations.
+
+- **`max_tokens` (int, optional, default: 2048)**  
+  The maximum token limit for each conversation.
+
+- **`use_rolling_temperatures` (bool, optional, default: False)**  
+  When set to `True`, the generator uses varying temperatures across data points to ensure **higher lexical diversity**.
+
+- **`use_model_rotation` (bool, optional, default: False)**  
+  When set to `True`, the system rotates between different high-quality models to provide **better structural diversity**.
+
+- **`output_file` (str, optional, default: "dataset.jsonl")**  
+  The path and filename where the final dataset will be written.  
+  Example: `"data.jsonl"`
+
+The final dataset is a **JSON Lines (`.jsonl`) file**, where each line represents a conversation formatted as a list of messages. This format is fully compatible for fine-tuning with providers like OpenAI, Mistral, and Anthropic. 
+
+The SDK supports the following message roles:
+- **`system`**: Sets the context or behavior of the assistant.
+- **`user`**: The human/user prompt.
+- **`assistant`**: The model's response.
+- **`tool`**: Represents tool outputs or function calls (experimental).
+
+### Example Code
+
+```bash
+
+import os
+from dotenv import load_dotenv
+from datacreatoraisdk import DataCreatorClient
+
+load_dotenv()
+
+# Example usage
+if __name__ == "__main__":
+    client = DataCreatorClient(api_key=os.getenv("DATACREATOR_API_KEY"))
+    client.generate(
+        main_theme="Natural dialogues between a user and assistant asking about daily tasks, errands, and emotions.", 
+        num_of_turns=2, 
+        num_of_datapoints=100,
+        use_rolling_temperatures=True,
+        use_model_rotation=False
+    )
+
+```

datacreator_sdk-0.1.5/README.md

@@ -0,0 +1,103 @@
+# DataCreator AI – Software Development Kit (SDK)
+
+A lightweight, proprietary Python client for accessing the **DataCreator AI** synthetic data generation API. This SDK is designed for desktop and server environments, enabling programmatic dataset generation with simple Python calls.
+
+---
+
+## Installation
+
+<!-- ### From TestPyPI (recommended during beta-testing)
+
+```bash
+pip install -i https://test.pypi.org/simple --extra-index-url https://pypi.org/simple datacreator-sdk
+``` -->
+
+## Usage Overview
+
+The `DataCreatorClient` provides a single primary method, `generate()`, that generates conversations suitable for fine-tuning AI models. The SDK handles communication, progress messages, response validation, and writing the final dataset to a `.jsonl` file.
+
+---
+
+## `generate()` Method
+
+The `generate()` function triggers the synthetic data generation workflow and saves the final dataset locally.
+
+### **Purpose**
+
+Initiates a dataset generation request and produces a `.jsonl` file containing structured conversational examples aligned with your specified theme.
+
+### **Authentication**
+Please contact us at team@datacreatorai.com for a API Key. Once you've received your unique key, send it during instantiation as shown in the example code.
+
+### **Parameters**
+
+The method accepts the following arguments:
+
+- **`main_theme` (str, required)**  
+  The central topic around which the synthetic dataset should be generated.  
+  Example: `"Daily tasks and personal planning for young working professionals"`
+  Any harmless and non-NSFW topic is allowed.
+
+- **`num_of_turns` (int, optional, default: 3)**  
+  Number of conversational turns per datapoint. The maximum number of turns allowed is 5.
+  A "turn" is typically one `user → assistant` exchange. The generation supports multiple message roles including **user**, **assistant**, **system**, and **tool**.
+  Example: `2` turns produces:  
+  - user  
+  - assistant  
+  - user  
+  - assistant  
+
+- **`num_of_datapoints` (int, optional, default: 100)**  
+  Number of independent dialogues/conversations to generate. 
+  The maximum number of data points allowed per generation is 1000.
+  Example: `10` produces 10 conversations.
+
+- **`language` (str, optional, default: "English")**  
+  The language in which the dataset should be generated.
+
+- **`system_prompt` (str, optional)**  
+  A custom instruction or persona that the assistant should follow throughout the conversations.
+
+- **`max_tokens` (int, optional, default: 2048)**  
+  The maximum token limit for each conversation.
+
+- **`use_rolling_temperatures` (bool, optional, default: False)**  
+  When set to `True`, the generator uses varying temperatures across data points to ensure **higher lexical diversity**.
+
+- **`use_model_rotation` (bool, optional, default: False)**  
+  When set to `True`, the system rotates between different high-quality models to provide **better structural diversity**.
+
+- **`output_file` (str, optional, default: "dataset.jsonl")**  
+  The path and filename where the final dataset will be written.  
+  Example: `"data.jsonl"`
+
+The final dataset is a **JSON Lines (`.jsonl`) file**, where each line represents a conversation formatted as a list of messages. This format is fully compatible for fine-tuning with providers like OpenAI, Mistral, and Anthropic. 
+
+The SDK supports the following message roles:
+- **`system`**: Sets the context or behavior of the assistant.
+- **`user`**: The human/user prompt.
+- **`assistant`**: The model's response.
+- **`tool`**: Represents tool outputs or function calls (experimental).
+
+### Example Code
+
+```bash
+
+import os
+from dotenv import load_dotenv
+from datacreatoraisdk import DataCreatorClient
+
+load_dotenv()
+
+# Example usage
+if __name__ == "__main__":
+    client = DataCreatorClient(api_key=os.getenv("DATACREATOR_API_KEY"))
+    client.generate(
+        main_theme="Natural dialogues between a user and assistant asking about daily tasks, errands, and emotions.", 
+        num_of_turns=2, 
+        num_of_datapoints=100,
+        use_rolling_temperatures=True,
+        use_model_rotation=False
+    )
+
+```

datacreator_sdk-0.1.5/datacreator_sdk.egg-info/PKG-INFO

@@ -0,0 +1,114 @@
+Metadata-Version: 2.4
+Name: datacreator-sdk
+Version: 0.1.5
+Summary: Python SDK for the DataCreator AI dataset generation API
+Author-email: DataCreator AI <team@datacreatorai.com>
+License: MIT
+Project-URL: Homepage, https://datacreatorai.com
+Requires-Python: >=3.8
+Description-Content-Type: text/markdown
+Requires-Dist: requests>=2.32
+
+# DataCreator AI – Software Development Kit (SDK)
+
+A lightweight, proprietary Python client for accessing the **DataCreator AI** synthetic data generation API. This SDK is designed for desktop and server environments, enabling programmatic dataset generation with simple Python calls.
+
+---
+
+## Installation
+
+<!-- ### From TestPyPI (recommended during beta-testing)
+
+```bash
+pip install -i https://test.pypi.org/simple --extra-index-url https://pypi.org/simple datacreator-sdk
+``` -->
+
+## Usage Overview
+
+The `DataCreatorClient` provides a single primary method, `generate()`, that generates conversations suitable for fine-tuning AI models. The SDK handles communication, progress messages, response validation, and writing the final dataset to a `.jsonl` file.
+
+---
+
+## `generate()` Method
+
+The `generate()` function triggers the synthetic data generation workflow and saves the final dataset locally.
+
+### **Purpose**
+
+Initiates a dataset generation request and produces a `.jsonl` file containing structured conversational examples aligned with your specified theme.
+
+### **Authentication**
+Please contact us at team@datacreatorai.com for a API Key. Once you've received your unique key, send it during instantiation as shown in the example code.
+
+### **Parameters**
+
+The method accepts the following arguments:
+
+- **`main_theme` (str, required)**  
+  The central topic around which the synthetic dataset should be generated.  
+  Example: `"Daily tasks and personal planning for young working professionals"`
+  Any harmless and non-NSFW topic is allowed.
+
+- **`num_of_turns` (int, optional, default: 3)**  
+  Number of conversational turns per datapoint. The maximum number of turns allowed is 5.
+  A "turn" is typically one `user → assistant` exchange. The generation supports multiple message roles including **user**, **assistant**, **system**, and **tool**.
+  Example: `2` turns produces:  
+  - user  
+  - assistant  
+  - user  
+  - assistant  
+
+- **`num_of_datapoints` (int, optional, default: 100)**  
+  Number of independent dialogues/conversations to generate. 
+  The maximum number of data points allowed per generation is 1000.
+  Example: `10` produces 10 conversations.
+
+- **`language` (str, optional, default: "English")**  
+  The language in which the dataset should be generated.
+
+- **`system_prompt` (str, optional)**  
+  A custom instruction or persona that the assistant should follow throughout the conversations.
+
+- **`max_tokens` (int, optional, default: 2048)**  
+  The maximum token limit for each conversation.
+
+- **`use_rolling_temperatures` (bool, optional, default: False)**  
+  When set to `True`, the generator uses varying temperatures across data points to ensure **higher lexical diversity**.
+
+- **`use_model_rotation` (bool, optional, default: False)**  
+  When set to `True`, the system rotates between different high-quality models to provide **better structural diversity**.
+
+- **`output_file` (str, optional, default: "dataset.jsonl")**  
+  The path and filename where the final dataset will be written.  
+  Example: `"data.jsonl"`
+
+The final dataset is a **JSON Lines (`.jsonl`) file**, where each line represents a conversation formatted as a list of messages. This format is fully compatible for fine-tuning with providers like OpenAI, Mistral, and Anthropic. 
+
+The SDK supports the following message roles:
+- **`system`**: Sets the context or behavior of the assistant.
+- **`user`**: The human/user prompt.
+- **`assistant`**: The model's response.
+- **`tool`**: Represents tool outputs or function calls (experimental).
+
+### Example Code
+
+```bash
+
+import os
+from dotenv import load_dotenv
+from datacreatoraisdk import DataCreatorClient
+
+load_dotenv()
+
+# Example usage
+if __name__ == "__main__":
+    client = DataCreatorClient(api_key=os.getenv("DATACREATOR_API_KEY"))
+    client.generate(
+        main_theme="Natural dialogues between a user and assistant asking about daily tasks, errands, and emotions.", 
+        num_of_turns=2, 
+        num_of_datapoints=100,
+        use_rolling_temperatures=True,
+        use_model_rotation=False
+    )
+
+```

datacreator_sdk-0.1.5/datacreator_sdk.egg-info/SOURCES.txt

@@ -0,0 +1,9 @@
+README.md
+pyproject.toml
+datacreator_sdk.egg-info/PKG-INFO
+datacreator_sdk.egg-info/SOURCES.txt
+datacreator_sdk.egg-info/dependency_links.txt
+datacreator_sdk.egg-info/requires.txt
+datacreator_sdk.egg-info/top_level.txt
+datacreatoraisdk/__init__.py
+datacreatoraisdk/client.py

datacreator_sdk-0.1.5/datacreator_sdk.egg-info/dependency_links.txt

@@ -0,0 +1 @@
+

datacreator_sdk-0.1.5/datacreator_sdk.egg-info/requires.txt

@@ -0,0 +1 @@
+requests>=2.32

datacreator_sdk-0.1.5/datacreator_sdk.egg-info/top_level.txt

@@ -0,0 +1 @@
+datacreatoraisdk

datacreator_sdk-0.1.5/datacreatoraisdk/__init__.py

@@ -0,0 +1,3 @@
+from .client import DataCreatorClient
+
+__all__ = ["DataCreatorClient"]

datacreator_sdk-0.1.5/datacreatoraisdk/client.py

@@ -0,0 +1,68 @@
+import json
+import time
+import requests
+from pathlib import Path
+import datetime
+
+class DataCreatorClient:
+    def __init__(self, api_key: str):
+        self.api_key = api_key
+        self.base_url = "https://synthetic-backend-basic-mmlcpe4eca-uc.a.run.app"
+
+    def generate(
+        self,
+        main_theme: str,
+        num_of_datapoints: int = 100,
+        num_of_turns: int = 3,
+        max_tokens: int = 2048,
+        language = "English",
+        system_prompt: str = "",
+        output_file: str = "dataset.jsonl",
+        use_rolling_temperatures = False,
+        use_model_rotation = False
+    ):
+        payload = {
+            "api_key": self.api_key,
+            "main_theme": main_theme,
+            "num_of_datapoints": num_of_datapoints,
+            "num_of_turns": num_of_turns,
+            "max_tokens": max_tokens,
+            "language": language,
+            "system_prompt": system_prompt,
+            "use_rolling_temperatures": use_rolling_temperatures,
+            "use_model_rotation": use_model_rotation
+        }
+
+        try:
+            steps = [
+                "Performing preliminary checks for your main theme...",
+                "Generating unique sub-themes for holistic data generation..",
+                "Generating your dataset.This may take a few minutes. Please wait..",
+                "Preparing your file..."
+            ]
+
+            for step in steps:
+                print(step)
+                time.sleep(0.2)
+        
+            resp = requests.post(f"{self.base_url}/api/chat-data", json=payload)
+            if resp.status_code != 200:
+                raise Exception(f"{resp.text}")
+            
+            # Save file
+            timestamp = datetime.datetime.now().strftime("%Y-%m-%d_%H-%M-%S")
+            # print(timestamp)
+            filename = f"dataset_downloaded_{timestamp}.jsonl"   # or read from headers
+            with open(filename, "wb") as f:
+                f.write(resp.content)
+
+            print("File downloaded:", filename)
+        except Exception as e:
+            print(f"{str(e)}")
+
+    def _download_file(self, url: str, output_file: str):
+        with requests.get(url, stream=True) as r:
+            r.raise_for_status()
+            with open(output_file, "wb") as f:
+                for chunk in r.iter_content(chunk_size=8192):
+                    f.write(chunk)

datacreator_sdk-0.1.5/pyproject.toml

@@ -0,0 +1,23 @@
+[project]
+name = "datacreator-sdk"
+version = "0.1.5"
+description = "Python SDK for the DataCreator AI dataset generation API"
+authors = [
+    { name="DataCreator AI", email="team@datacreatorai.com" }
+]
+readme = "README.md"
+license = { text = "MIT" }
+requires-python = ">=3.8"
+
+dynamic = []
+
+dependencies = [
+    "requests>=2.32"
+]
+
+[project.urls]
+Homepage = "https://datacreatorai.com"
+
+[build-system]
+requires = ["setuptools>=77.0.0", "wheel"]
+build-backend = "setuptools.build_meta"

datacreator_sdk-0.1.5/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+