DeepFabric 4.4.0__tar.gz → 4.5.1__tar.gz

{deepfabric-4.4.0 → deepfabric-4.5.1}/.github/workflows/tools-sdk-docker.yml

@@ -42,7 +42,7 @@ jobs:
         uses: actions/checkout@8e8c483db84b4bee98b60c0593521ed34d9990e8 # v6.0.1
 
       - name: Set up Docker Buildx
-        uses: docker/setup-buildx-action@b5ca514318bd6ebac0fb2aedd5d36ec1b5c232a2 # v3.10.0
+        uses: docker/setup-buildx-action@8d2750c68a42422c14e847fe6c8ac0403b4cbd6f # v3.12.0
 
       - name: Log in to Container Registry
         if: github.event_name != 'pull_request'
@@ -98,14 +98,14 @@ jobs:
 
     steps:
       - name: Download digests
-        uses: actions/download-artifact@d3f86a106a0bac45b974a628896c90dbdf5c8093 # v4.3.0
+        uses: actions/download-artifact@37930b1c2abaa49bbe596cd826c3c89aef350131 # v7.0.0
         with:
           path: /tmp/digests
           pattern: digests-*
           merge-multiple: true
 
       - name: Set up Docker Buildx
-        uses: docker/setup-buildx-action@b5ca514318bd6ebac0fb2aedd5d36ec1b5c232a2 # v3.10.0
+        uses: docker/setup-buildx-action@8d2750c68a42422c14e847fe6c8ac0403b4cbd6f # v3.12.0
 
       - name: Log in to Container Registry
         uses: docker/login-action@5e57cd118135c172c3672efd75eb46360885c0ef # v3.6.0

{deepfabric-4.4.0 → deepfabric-4.5.1}/.gitignore

@@ -133,3 +133,4 @@ formats/*
 # coverage files
 .coverage.*
 tools-sdk/.spin/*
+notebooks/lora-output/*

{deepfabric-4.4.0 → deepfabric-4.5.1}/CLAUDE.md

@@ -97,4 +97,5 @@ deepfabric start config.yaml --model gpt-4 --temperature 0.8 --hf-repo user/data
 - Bandit for security analysis
 - Python 3.11+ required
 - Google-style docstrings preferred
-- do not place imports anywhere but the top of the file
+- do not place imports anywhere but the top of the file
+- When updating `docs/` documentation, if new Markdown files are added or removed, consider updating `mkdocs.yml`.

{deepfabric-4.4.0 → deepfabric-4.5.1}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: DeepFabric
-Version: 4.4.0
+Version: 4.5.1
 Summary: Curate High Quality Datasets, Train, Evaluate and Ship
 Author-email: Luke Hinds <luke@alwaysfurther.ai>
 License-File: LICENSE
@@ -77,6 +77,9 @@ Description-Content-Type: text/markdown
     <a href="https://discord.gg/pPcjYzGvbS">
       <img src="https://img.shields.io/discord/1384081906773131274?color=7289da&label=Discord&logo=discord&logoColor=white" alt="Discord"/>
     </a>
+    <a href="https://www.reddit.com/r/deepfabric/">
+      <img src="https://img.shields.io/badge/Reddit-r%2Fdeepfabric-FF4500?logo=reddit&logoColor=white" alt="Reddit"/>
+    </a>
   </p>
 </div>
 
@@ -86,7 +89,7 @@ What sets DeepFabric apart from other dataset generation tools is its ability to
 
 <img src="/assets/df-demo.gif" width="100%" height="100%"/>
 
-Constrained decoding and response validation, along with real tool executions within isolated webassembly environments, ensure that generated samples strictly adhere to structured schema, variable constraints, and execution correctness, ensuring datasets have exact syntax and structure for use in model training pipelines. Tool definations can be either directly imported from MCP (Model Context Protocol) server schemas and automatically mocked, real life interfaces along with a standard set of common tools (`list_files()`, 'read_file()` etc)
+Constrained decoding and response validation, along with real tool executions within isolated webassembly environments, ensure that generated samples strictly adhere to structured schema, variable constraints, and execution correctness, ensuring datasets have exact syntax and structure for use in model training pipelines. Tool definations can be either directly imported from MCP (Model Context Protocol) server schemas and automatically mocked, real life interfaces along with a standard set of common tools (`list_files()`, `'read_file()` etc)
 
 Once your dataset is generated, it can be automatically uploaded to Hugging Face and directly imported into popular training frameworks like TRL, Unsloth, and Axolotl. 
 
@@ -215,7 +218,7 @@ deepfabric generate config.yaml --output-save-as dataset.jsonl
 Or upload to HuggingFace Hub:
 
 ```bash
-deepfabric upload dataset.jsonl --repo your-username/my-dataset
+deepfabric upload-hf dataset.jsonl --repo your-username/my-dataset
 ```
 
 ### 2. Load and Split for Training

{deepfabric-4.4.0 → deepfabric-4.5.1}/README.md

@@ -33,6 +33,9 @@
     <a href="https://discord.gg/pPcjYzGvbS">
       <img src="https://img.shields.io/discord/1384081906773131274?color=7289da&label=Discord&logo=discord&logoColor=white" alt="Discord"/>
     </a>
+    <a href="https://www.reddit.com/r/deepfabric/">
+      <img src="https://img.shields.io/badge/Reddit-r%2Fdeepfabric-FF4500?logo=reddit&logoColor=white" alt="Reddit"/>
+    </a>
   </p>
 </div>
 
@@ -42,7 +45,7 @@ What sets DeepFabric apart from other dataset generation tools is its ability to
 
 <img src="/assets/df-demo.gif" width="100%" height="100%"/>
 
-Constrained decoding and response validation, along with real tool executions within isolated webassembly environments, ensure that generated samples strictly adhere to structured schema, variable constraints, and execution correctness, ensuring datasets have exact syntax and structure for use in model training pipelines. Tool definations can be either directly imported from MCP (Model Context Protocol) server schemas and automatically mocked, real life interfaces along with a standard set of common tools (`list_files()`, 'read_file()` etc)
+Constrained decoding and response validation, along with real tool executions within isolated webassembly environments, ensure that generated samples strictly adhere to structured schema, variable constraints, and execution correctness, ensuring datasets have exact syntax and structure for use in model training pipelines. Tool definations can be either directly imported from MCP (Model Context Protocol) server schemas and automatically mocked, real life interfaces along with a standard set of common tools (`list_files()`, `'read_file()` etc)
 
 Once your dataset is generated, it can be automatically uploaded to Hugging Face and directly imported into popular training frameworks like TRL, Unsloth, and Axolotl. 
 
@@ -171,7 +174,7 @@ deepfabric generate config.yaml --output-save-as dataset.jsonl
 Or upload to HuggingFace Hub:
 
 ```bash
-deepfabric upload dataset.jsonl --repo your-username/my-dataset
+deepfabric upload-hf dataset.jsonl --repo your-username/my-dataset
 ```
 
 ### 2. Load and Split for Training

{deepfabric-4.4.0 → deepfabric-4.5.1}/deepfabric/builders_agent.py

@@ -763,8 +763,14 @@ Remember: You have access to the tools listed above and have used them in this c
         # Insert system message if configured
         self._insert_system_message_if_configured(messages)
 
-        # Convert tools to OpenAI format
-        tools_openai = [tool.to_openai() for tool in self.tool_registry.tools]
+        # Convert tools to OpenAI format, filtering based on inclusion strategy
+        if self.config.tool_inclusion_strategy == "used_only" and tool_results:
+            used_names = {te.function_name for te in tool_results}
+            tools_openai = [
+                tool.to_openai() for tool in self.tool_registry.tools if tool.name in used_names
+            ]
+        else:
+            tools_openai = [tool.to_openai() for tool in self.tool_registry.tools]
 
         return Conversation(
             messages=messages,
@@ -1291,8 +1297,14 @@ Is the user's original task/goal from the scenario fully completed?
         # Insert system message if configured
         self._insert_system_message_if_configured(messages)
 
-        # Convert tools to OpenAI format
-        tools_openai = [tool.to_openai() for tool in self.tool_registry.tools]
+        # Convert tools to OpenAI format, filtering based on inclusion strategy
+        if self.config.tool_inclusion_strategy == "used_only" and all_executions:
+            used_names = {te.function_name for te in all_executions}
+            tools_openai = [
+                tool.to_openai() for tool in self.tool_registry.tools if tool.name in used_names
+            ]
+        else:
+            tools_openai = [tool.to_openai() for tool in self.tool_registry.tools]
 
         return Conversation(
             messages=messages,

{deepfabric-4.4.0 → deepfabric-4.5.1}/deepfabric/cli.py

@@ -557,7 +557,7 @@ def generate(  # noqa: PLR0913
         sys.exit(1)
 
 
-@cli.command()
+@cli.command("upload-hf")
 @click.argument("dataset_file", type=click.Path(exists=True))
 @click.option(
     "--repo",
@@ -573,14 +573,14 @@ def generate(  # noqa: PLR0913
     multiple=True,
     help="Tags for the dataset (can be specified multiple times)",
 )
-def upload(
+def upload_hf(
     dataset_file: str,
     repo: str,
     token: str | None = None,
     tags: list[str] | None = None,
 ) -> None:
     """Upload a dataset to Hugging Face Hub."""
-    trace("cli_upload", {"has_tags": len(tags) > 0 if tags else False})
+    trace("cli_upload_hf", {"has_tags": len(tags) > 0 if tags else False})
 
     try:
         # Get token from CLI arg or env var

{deepfabric-4.4.0 → deepfabric-4.5.1}/deepfabric/evaluation/backends/__init__.py

@@ -1,5 +1,6 @@
 """Inference backend implementations."""
 
+from .llm_eval_backend import LLMEvalBackend
 from .ollama_backend import OllamaBackend
 from .tool_call_parsers import (
     GenericToolCallParser,
@@ -18,6 +19,7 @@ from .transformers_backend import TransformersBackend
 __all__ = [
     "TransformersBackend",
     "OllamaBackend",
+    "LLMEvalBackend",
     # Tool call parsers
     "ToolCallParser",
     "ToolCallParserRegistry",