verifiers 0.1.15.dev437__tar.gz → 0.1.15.dev439__tar.gz

{verifiers-0.1.15.dev437 → verifiers-0.1.15.dev439}/.gitignore

@@ -1,4 +1,5 @@
 # env 
+.venv
 .venv/
 venv/
 env/

verifiers-0.1.15.dev439/PKG-INFO

@@ -0,0 +1,126 @@
+Metadata-Version: 2.4
+Name: verifiers
+Version: 0.1.15.dev439
+Summary: Verifiers: Environments for LLM Reinforcement Learning
+Project-URL: Homepage, https://github.com/primeintellect-ai/verifiers
+Project-URL: Documentation, https://github.com/primeintellect-ai/verifiers
+Project-URL: Repository, https://github.com/primeintellect-ai/verifiers.git
+Project-URL: Issues, https://github.com/primeintellect-ai/verifiers/issues
+Author-email: William Brown <williambrown97@gmail.com>
+License-Expression: MIT
+License-File: LICENSE
+Keywords: agentic-rl,agents,environments,eval,grpo,harness,llm,multi-turn,reinforcement-learning,rl,rlvr,tool-use,train,verifiers
+Classifier: Development Status :: 4 - Beta
+Classifier: Intended Audience :: Developers
+Classifier: Intended Audience :: Science/Research
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Classifier: Topic :: Software Development :: Libraries :: Python Modules
+Requires-Python: <3.14,>=3.11
+Requires-Dist: aiohttp>=3.9.0
+Requires-Dist: aiolimiter>=1.2.1
+Requires-Dist: anthropic>=0.78.0
+Requires-Dist: datasets<4.7.0,>=3.0.0
+Requires-Dist: gepa
+Requires-Dist: httpx>=0.27.0
+Requires-Dist: loguru>=0.7.0
+Requires-Dist: math-verify>=0.8.0
+Requires-Dist: mcp>=1.14.1
+Requires-Dist: msgpack>=1.1.2
+Requires-Dist: numpy
+Requires-Dist: openai-agents>=0.0.7
+Requires-Dist: openai>=1.108.1
+Requires-Dist: prime-pydantic-config[toml]>=0.3.0.dev86
+Requires-Dist: prime-sandboxes>=0.2.27
+Requires-Dist: prime-tunnel>=0.1.8
+Requires-Dist: pydantic>=2.11.9
+Requires-Dist: pyzmq>=27.1.0
+Requires-Dist: renderers>=0.1.8.dev40
+Requires-Dist: requests
+Requires-Dist: rich
+Requires-Dist: setproctitle>=1.3.0
+Requires-Dist: tenacity>=8.5.0
+Requires-Dist: tomli-w>=1.0.0
+Requires-Dist: typing-extensions; python_version < '3.12'
+Requires-Dist: uvloop>=0.21.0; sys_platform != 'win32' and sys_platform != 'cygwin' and platform_python_implementation != 'PyPy'
+Provides-Extra: browser
+Requires-Dist: aiohttp>=3.9.0; extra == 'browser'
+Requires-Dist: python-dotenv>=1.0.0; extra == 'browser'
+Requires-Dist: stagehand>=3.0.0; extra == 'browser'
+Provides-Extra: harbor
+Requires-Dist: harbor==0.14.0; (python_version >= '3.12') and extra == 'harbor'
+Provides-Extra: modal
+Requires-Dist: modal>=1.4.0; extra == 'modal'
+Provides-Extra: notebook
+Requires-Dist: nest-asyncio>=1.6.0; extra == 'notebook'
+Provides-Extra: quest
+Requires-Dist: certifi; extra == 'quest'
+Requires-Dist: pillow; extra == 'quest'
+Requires-Dist: pymupdf; extra == 'quest'
+Provides-Extra: rg
+Requires-Dist: reasoning-gym; extra == 'rg'
+Provides-Extra: rl
+Requires-Dist: accelerate>=1.4.0; extra == 'rl'
+Requires-Dist: deepspeed>=0.17.6; extra == 'rl'
+Requires-Dist: flash-attn>=2.8.3; extra == 'rl'
+Requires-Dist: liger-kernel>=0.5.10; extra == 'rl'
+Requires-Dist: peft; extra == 'rl'
+Requires-Dist: requests; extra == 'rl'
+Requires-Dist: torch<2.9.0,>=2.8.0; extra == 'rl'
+Requires-Dist: transformers>=4.56.2; extra == 'rl'
+Requires-Dist: vllm<0.11.0,>=0.10.0; extra == 'rl'
+Requires-Dist: wandb; extra == 'rl'
+Provides-Extra: ta
+Requires-Dist: nltk>=3.9.2; extra == 'ta'
+Requires-Dist: textarena==0.7.4; extra == 'ta'
+Description-Content-Type: text/markdown
+
+<p align="center">
+  <picture>
+    <source media="(prefers-color-scheme: light)" srcset="https://github.com/user-attachments/assets/40c36e38-c5bd-4c5a-9cb3-f7b902cd155d">
+    <source media="(prefers-color-scheme: dark)" srcset="https://github.com/user-attachments/assets/6414bc9b-126b-41ca-9307-9e982430cde8">
+    <img alt="Prime Intellect" src="https://github.com/user-attachments/assets/6414bc9b-126b-41ca-9307-9e982430cde8" width="312" style="max-width: 100%;">
+  </picture>
+</p>
+
+---
+
+# Overview
+
+verifiers is our library for creating environments to train and evaluate LLMs.
+
+verifiers is tightly integrated with the [Environments Hub](https://app.primeintellect.ai/dashboard/environments?ex_sort=most_stars), as well as our training framework [prime-rl](https://github.com/PrimeIntellect-ai/prime-rl) and our [Hosted Training](https://app.primeintellect.ai/dashboard/training) platform.
+
+## Installation
+
+We recommend installing the [Prime CLI](https://github.com/PrimeIntellect-ai/prime) to interact with the environments.
+
+```bash
+# install uv
+curl -LsSf https://astral.sh/uv/install.sh | sh
+# install the prime CLI
+uv tool install prime
+```
+
+## Further reading
+
+- The [docs](docs/) contain short, human-written guides and overviews about the architecture.
+- The [AGENTS.md](AGENTS.md) and [skills](skills/) are for coding agents and go into more details.
+
+
+## Citation
+
+Originally created by Will Brown ([@willccbb](https://github.com/willccbb)).
+
+```bibtex
+@misc{brown_verifiers_2025,
+  author       = {William Brown},
+  title        = {{Verifiers}: Environments for LLM Reinforcement Learning},
+  howpublished = {\url{https://github.com/PrimeIntellect-ai/verifiers}},
+  year         = {2025}
+}
+```

verifiers-0.1.15.dev439/README.md

@@ -0,0 +1,45 @@
+<p align="center">
+  <picture>
+    <source media="(prefers-color-scheme: light)" srcset="https://github.com/user-attachments/assets/40c36e38-c5bd-4c5a-9cb3-f7b902cd155d">
+    <source media="(prefers-color-scheme: dark)" srcset="https://github.com/user-attachments/assets/6414bc9b-126b-41ca-9307-9e982430cde8">
+    <img alt="Prime Intellect" src="https://github.com/user-attachments/assets/6414bc9b-126b-41ca-9307-9e982430cde8" width="312" style="max-width: 100%;">
+  </picture>
+</p>
+
+---
+
+# Overview
+
+verifiers is our library for creating environments to train and evaluate LLMs.
+
+verifiers is tightly integrated with the [Environments Hub](https://app.primeintellect.ai/dashboard/environments?ex_sort=most_stars), as well as our training framework [prime-rl](https://github.com/PrimeIntellect-ai/prime-rl) and our [Hosted Training](https://app.primeintellect.ai/dashboard/training) platform.
+
+## Installation
+
+We recommend installing the [Prime CLI](https://github.com/PrimeIntellect-ai/prime) to interact with the environments.
+
+```bash
+# install uv
+curl -LsSf https://astral.sh/uv/install.sh | sh
+# install the prime CLI
+uv tool install prime
+```
+
+## Further reading
+
+- The [docs](docs/) contain short, human-written guides and overviews about the architecture.
+- The [AGENTS.md](AGENTS.md) and [skills](skills/) are for coding agents and go into more details.
+
+
+## Citation
+
+Originally created by Will Brown ([@willccbb](https://github.com/willccbb)).
+
+```bibtex
+@misc{brown_verifiers_2025,
+  author       = {William Brown},
+  title        = {{Verifiers}: Environments for LLM Reinforcement Learning},
+  howpublished = {\url{https://github.com/PrimeIntellect-ai/verifiers}},
+  year         = {2025}
+}
+```

{verifiers-0.1.15.dev437 → verifiers-0.1.15.dev439}/verifiers/envs/experimental/composable/tasksets/swe/README.md

@@ -6,7 +6,7 @@
   they are not known to be available there yet.
 - Validation: ✅ means the taskset has a linked `prime-data` PR and was
   validated with
-  [`SandboxDebugEnv`](../../../../../../docs/environments.md#integrations-and-experimental-environments),
+  [`SandboxDebugEnv`](../../../../../../docs/v0/environments.md#integrations-and-experimental-environments),
   — not yet complete.
 
 ## Progress

{verifiers-0.1.15.dev437 → verifiers-0.1.15.dev439}/verifiers/envs/integrations/browser_env/README.md

@@ -23,7 +23,7 @@ Or with pip/uv pip:
 uv pip install -e ".[browser]"
 ```
 
-When you publish an environment that uses `BrowserEnv`, list `verifiers[browser]` in that package’s `pyproject.toml` `dependencies` so installs from the [Environments Hub](https://app.primeintellect.ai/dashboard/environments) pull the extra. Validate required variables early in `load_environment()` with `vf.ensure_keys([...])` (see [Required API Keys](../../../../docs/environments.md#required-api-keys) in the Verifiers environments guide).
+When you publish an environment that uses `BrowserEnv`, list `verifiers[browser]` in that package’s `pyproject.toml` `dependencies` so installs from the [Environments Hub](https://app.primeintellect.ai/dashboard/environments) pull the extra. Validate required variables early in `load_environment()` with `vf.ensure_keys([...])` (see [Required API Keys](../../../../docs/v0/environments.md#required-api-keys) in the Verifiers environments guide).
 
 ## Required credentials
 

{verifiers-0.1.15.dev437 → verifiers-0.1.15.dev439}/verifiers/v1/harnesses/codex/harness.py

@@ -105,6 +105,7 @@ class CodexHarness(Harness[CodexHarnessConfig]):
             "-c",
             f"model_providers.{PROVIDER}.requires_openai_auth=false",
             *tool_config,
+            "--",
             prompt,
         ]
         return await runtime.run_program(argv, env)

{verifiers-0.1.15.dev437 → verifiers-0.1.15.dev439}/verifiers/v1/harnesses/rlm/harness.py

@@ -140,7 +140,7 @@ class RLMHarness(Harness[RLMHarnessConfig]):
             env["RLM_MCP_CONFIG"] = json.dumps(
                 {"mcpServers": {name: {"url": url} for name, url in mcp_urls.items()}}
             )
-        return await runtime.run_program([RLM_BIN, prompt], env)
+        return await runtime.run_program([RLM_BIN, "--", prompt], env)
 
     @metric
     async def rlm(self, trace: Trace, runtime: Runtime) -> dict[str, float]:

verifiers-0.1.15.dev437/PKG-INFO

@@ -1,304 +0,0 @@
-Metadata-Version: 2.4
-Name: verifiers
-Version: 0.1.15.dev437
-Summary: Verifiers: Environments for LLM Reinforcement Learning
-Project-URL: Homepage, https://github.com/primeintellect-ai/verifiers
-Project-URL: Documentation, https://github.com/primeintellect-ai/verifiers
-Project-URL: Repository, https://github.com/primeintellect-ai/verifiers.git
-Project-URL: Issues, https://github.com/primeintellect-ai/verifiers/issues
-Author-email: William Brown <williambrown97@gmail.com>
-License-Expression: MIT
-License-File: LICENSE
-Keywords: agentic-rl,agents,environments,eval,grpo,harness,llm,multi-turn,reinforcement-learning,rl,rlvr,tool-use,train,verifiers
-Classifier: Development Status :: 4 - Beta
-Classifier: Intended Audience :: Developers
-Classifier: Intended Audience :: Science/Research
-Classifier: License :: OSI Approved :: MIT License
-Classifier: Programming Language :: Python :: 3
-Classifier: Programming Language :: Python :: 3.11
-Classifier: Programming Language :: Python :: 3.12
-Classifier: Programming Language :: Python :: 3.13
-Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
-Classifier: Topic :: Software Development :: Libraries :: Python Modules
-Requires-Python: <3.14,>=3.11
-Requires-Dist: aiohttp>=3.9.0
-Requires-Dist: aiolimiter>=1.2.1
-Requires-Dist: anthropic>=0.78.0
-Requires-Dist: datasets<4.7.0,>=3.0.0
-Requires-Dist: gepa
-Requires-Dist: httpx>=0.27.0
-Requires-Dist: loguru>=0.7.0
-Requires-Dist: math-verify>=0.8.0
-Requires-Dist: mcp>=1.14.1
-Requires-Dist: msgpack>=1.1.2
-Requires-Dist: numpy
-Requires-Dist: openai-agents>=0.0.7
-Requires-Dist: openai>=1.108.1
-Requires-Dist: prime-pydantic-config[toml]>=0.3.0.dev86
-Requires-Dist: prime-sandboxes>=0.2.27
-Requires-Dist: prime-tunnel>=0.1.8
-Requires-Dist: pydantic>=2.11.9
-Requires-Dist: pyzmq>=27.1.0
-Requires-Dist: renderers>=0.1.8.dev40
-Requires-Dist: requests
-Requires-Dist: rich
-Requires-Dist: setproctitle>=1.3.0
-Requires-Dist: tenacity>=8.5.0
-Requires-Dist: tomli-w>=1.0.0
-Requires-Dist: typing-extensions; python_version < '3.12'
-Requires-Dist: uvloop>=0.21.0; sys_platform != 'win32' and sys_platform != 'cygwin' and platform_python_implementation != 'PyPy'
-Provides-Extra: browser
-Requires-Dist: aiohttp>=3.9.0; extra == 'browser'
-Requires-Dist: python-dotenv>=1.0.0; extra == 'browser'
-Requires-Dist: stagehand>=3.0.0; extra == 'browser'
-Provides-Extra: harbor
-Requires-Dist: harbor==0.14.0; (python_version >= '3.12') and extra == 'harbor'
-Provides-Extra: modal
-Requires-Dist: modal>=1.4.0; extra == 'modal'
-Provides-Extra: notebook
-Requires-Dist: nest-asyncio>=1.6.0; extra == 'notebook'
-Provides-Extra: quest
-Requires-Dist: certifi; extra == 'quest'
-Requires-Dist: pillow; extra == 'quest'
-Requires-Dist: pymupdf; extra == 'quest'
-Provides-Extra: rg
-Requires-Dist: reasoning-gym; extra == 'rg'
-Provides-Extra: rl
-Requires-Dist: accelerate>=1.4.0; extra == 'rl'
-Requires-Dist: deepspeed>=0.17.6; extra == 'rl'
-Requires-Dist: flash-attn>=2.8.3; extra == 'rl'
-Requires-Dist: liger-kernel>=0.5.10; extra == 'rl'
-Requires-Dist: peft; extra == 'rl'
-Requires-Dist: requests; extra == 'rl'
-Requires-Dist: torch<2.9.0,>=2.8.0; extra == 'rl'
-Requires-Dist: transformers>=4.56.2; extra == 'rl'
-Requires-Dist: vllm<0.11.0,>=0.10.0; extra == 'rl'
-Requires-Dist: wandb; extra == 'rl'
-Provides-Extra: ta
-Requires-Dist: nltk>=3.9.2; extra == 'ta'
-Requires-Dist: textarena==0.7.4; extra == 'ta'
-Description-Content-Type: text/markdown
-
-<p align="center">
-  <picture>
-    <source media="(prefers-color-scheme: light)" srcset="https://github.com/user-attachments/assets/40c36e38-c5bd-4c5a-9cb3-f7b902cd155d">
-    <source media="(prefers-color-scheme: dark)" srcset="https://github.com/user-attachments/assets/6414bc9b-126b-41ca-9307-9e982430cde8">
-    <img alt="Prime Intellect" src="https://github.com/user-attachments/assets/6414bc9b-126b-41ca-9307-9e982430cde8" width="312" style="max-width: 100%;">
-  </picture>
-</p>
-
----
-
-<h3 align="center">
-Verifiers: Environments for LLM Reinforcement Learning
-</h3>
-
-<p align="center">
-  <a href="https://docs.primeintellect.ai/verifiers">Documentation</a> •
-  <a href="https://app.primeintellect.ai/dashboard/environments?ex_sort=most_stars">Environments Hub</a> •
-  <a href="https://github.com/PrimeIntellect-ai/prime-rl">PRIME-RL</a>
-</p>
-
----
-
-<p align="center">
-  <a href="https://github.com/PrimeIntellect-ai/verifiers/actions/workflows/style.yml">
-    <img src="https://github.com/PrimeIntellect-ai/verifiers/actions/workflows/style.yml/badge.svg" alt="Style" />
-  </a>
-  <a href="https://github.com/PrimeIntellect-ai/verifiers/actions/workflows/test.yml">
-    <img src="https://github.com/PrimeIntellect-ai/verifiers/actions/workflows/test.yml/badge.svg" alt="Test" />
-  </a>
-  <a href="https://github.com/PrimeIntellect-ai/verifiers/actions/workflows/publish-envs.yml">
-    <img src="https://github.com/PrimeIntellect-ai/verifiers/actions/workflows/publish-envs.yml/badge.svg" alt="Envs" />
-  </a>
-</p>
-
-## News & Updates
-
-- [05/07/26] v0.1.14 is released, featuring the v1 Taskset/Harness API, shared eval and training config shape, model-family starter configs, OpenAI Responses and renderer-backed clients, per-turn timing, GEPA prompt artifacts, Lean guard markers, and release/infrastructure hardening.
-- [04/28/26] v0.1.13.dev8 is released, featuring per-rollout wall-clock timeouts for `MultiTurnEnv`, CLI timeout config, sandbox timeout propagation, and smaller `CliAgentEnv` and RLM fixes.
-- [04/17/26] v0.1.12 is released, featuring upstreamed opencode and RLM harnesses/tasksets, major `RLMEnv` improvements (context dropping, prompt builder, hardened transport), multi-worker env server support, expanded `vf-tui` capabilities, and richer eval configuration.
-- [03/12/26] v0.1.11 is released, featuring a unified client stack, major `RLMEnv` and env server reliability improvements, a substantially refined eval TUI, new pass@k and ablation sweep support, and bundled opencode environments.
-- [02/10/26] v0.1.10 is released, featuring OpenEnv and BrowserEnv integrations, resumed evals, improved rollout and token tracking, safer sandbox lifecycle behavior, refreshed workspace setup, and opencode harbor improvements.
-- [01/08/26] v0.1.9 is released, featuring a number of new experimental environment class types, monitor rubrics for automatic metric collection, improved workspace setup flow, improved error handling, bug fixes, and a documentation overhaul.
-- [11/19/25] v0.1.8 is released, featuring a major refactor of the rollout system to use trajectory-based tracking for token-in token-out training across turns, as well as support for truncated or branching rollouts.
-- [11/07/25] Verifiers v0.1.7 is released! This includes an improved quickstart configuration for training with [prime-rl](https://github.com/PrimeIntellect-ai/prime-rl), a new included "nano" trainer (`vf.RLTrainer`, replacing `vf.GRPOTrainer`), and a number of bug fixes and improvements to the documentation.
-- [10/27/25] A new iteration of the Prime Intellect [Environments Program](https://docs.google.com/spreadsheets/d/13UDfRDjgIZXsMI2s9-Lmn8KSMMsgk2_zsfju6cx_pNU/edit?gid=0#gid=0) is live!  
-
-
-# Overview
-
-Verifiers is our library for creating environments to train and evaluate LLMs.
-
-Environments contain everything required to run and evaluate a model on a particular task:
-- A *dataset* of task inputs
-- A *harness* for the model (tools, sandboxes, context management, etc.)
-- A reward function or *rubric* to score the model's performance
-
-Environments can be used for training models with reinforcement learning (RL), evaluating capabilities, generating synthetic data, experimenting with agent harnesses, and more. 
-
-Verifiers is tightly integrated with the [Environments Hub](https://app.primeintellect.ai/dashboard/environments?ex_sort=most_stars), as well as our training framework [prime-rl](https://github.com/PrimeIntellect-ai/prime-rl) and our [Hosted Training](https://app.primeintellect.ai/dashboard/training) platform.
-
-## Getting Started
-
-Ensure you have `uv` installed, as well as the `prime` [CLI](https://docs.primeintellect.ai/cli-reference/introduction) tool:
-```bash
-# install uv
-curl -LsSf https://astral.sh/uv/install.sh | sh
-# install the prime CLI
-uv tool install prime
-# log in to the Prime Intellect platform
-prime login
-```
-To set up a new workspace for developing environments, do:
-```bash
-# ~/dev/my-lab
-prime lab setup 
-```
-
-This sets up a Python project if needed (with `uv init`), installs `verifiers` (with `uv add verifiers`), creates the recommended workspace structure, and downloads useful starter files:
-```
-configs/
-├── endpoints.toml      # OpenAI-compatible API endpoint configuration
-├── rl/                 # Example configs for Hosted Training
-├── eval/               # Example multi-environment eval configs
-└── gepa/               # Example configs for prompt optimization
-.prime/
-└── skills/             # Bundled workflow skills for create/browse/review/eval/GEPA/train/brainstorm
-environments/
-└── AGENTS.md           # Documentation for AI coding agents
-AGENTS.md               # Top-level documentation for AI coding agents
-CLAUDE.md               # Claude-specific pointer to AGENTS.md
-```
-
-Alternatively, add `verifiers` to an existing project:
-```bash
-uv add verifiers && prime lab setup --skip-install
-```
-
-Environments built with Verifiers are self-contained Python modules. To initialize a fresh environment template, do:
-```bash
-prime env init my-env # creates a new template in ./environments/my_env
-```
-Add an explicit harness loader when the environment owns harness behavior:
-```bash
-prime env init my-env --with-harness
-```
-For OpenEnv integration, use:
-```bash
-prime env init my-openenv --openenv
-```
-Then copy your OpenEnv project into `environments/my_openenv/proj/` and build the image with:
-```bash
-uv run vf-build my-openenv
-```
-
-This will create a new module called `my_env` with a basic environment template.
-```
-environments/my_env/
-├── my_env.py           # Main implementation
-├── pyproject.toml      # Dependencies and metadata
-└── README.md           # Documentation
-```
-
-Environment modules should expose a `load_environment` function which returns an
-environment object. For simple legacy environments, this can still be a direct
-constructor:
-```python
-# my_env.py
-import verifiers as vf
-
-def load_environment(dataset_name: str = 'gsm8k') -> vf.Environment:
-    dataset = vf.load_example_dataset(dataset_name) # 'question'
-    async def correct_answer(completion, answer) -> float:
-        completion_ans = completion[-1]['content']
-        return 1.0 if completion_ans == answer else 0.0
-    rubric = vf.Rubric(funcs=[correct_answer])
-    env = vf.SingleTurnEnv(dataset=dataset, rubric=rubric)
-    return env
-```
-
-The same environment package is the unit used by evals and `prime-rl`. The
-trainer owns model, endpoint, sampling, and rollout count; v1-specific options
-stay on the taskset or harness config that owns them:
-
-```toml
-# configs/rl/my-v1-env.toml
-model = "Qwen/Qwen3-30B-A3B-Instruct-2507"
-max_steps = 100
-batch_size = 256
-rollouts_per_example = 8
-
-[sampling]
-max_tokens = 4096
-
-[[env]]
-id = "my-env"
-
-[env.harness]
-max_turns = 1
-
-[env.taskset]
-system_prompt = "Reverse text exactly."
-
-[env.taskset.scoring.contains_answer]
-weight = 1.0
-```
-
-```bash
-prime env install my-env
-```
-
-For self-managed training launch commands, use the `prime-rl` documentation.
-
-To run a local evaluation with any OpenAI-compatible model, do:
-```bash
-prime eval run my-env -m openai/gpt-5-nano # run and save eval results locally
-```
-Evaluations use [Prime Inference](https://docs.primeintellect.ai/inference/overview) by default; configure your own API endpoints in `./configs/endpoints.toml`.
-
-View local evaluation results in the terminal UI:
-```bash
-prime eval view
-```
-
-To publish the environment to the [Environments Hub](https://app.primeintellect.ai/dashboard/environments?ex_sort=most_stars), do:
-```bash
-prime env push --path ./environments/my_env
-```
-
-To run an evaluation directly from the Environments Hub, do:
-```bash
-prime eval run primeintellect/math-python
-```
-
-## Documentation
-
-**[Environments](docs/environments.md)** — Create datasets, rubrics, and custom multi-turn interaction protocols.
-
-**[Evaluation](docs/evaluation.md)** - Evaluate models using your environments.
-
-**[Training](docs/training.md)** — Train models in your environments with reinforcement learning.
-
-**[Development](docs/development.md)** — Contributing to verifiers
-
-**[API Reference](docs/reference.md)** — Understanding the API and data structures
-
-**[FAQs](docs/faqs.md)** - Other frequently asked questions.
-
-
-## Citation
-
-Originally created by Will Brown ([@willccbb](https://github.com/willccbb)).
-
-If you use this code in your research, please cite:
-
-```bibtex
-@misc{brown_verifiers_2025,
-  author       = {William Brown},
-  title        = {{Verifiers}: Environments for LLM Reinforcement Learning},
-  howpublished = {\url{https://github.com/PrimeIntellect-ai/verifiers}},
-  note         = {Commit abcdefg • accessed DD Mon YYYY},
-  year         = {2025}
-}
-```