agent-ultramode 0.1.3 → 0.1.4
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +2 -1
- package/package.json +1 -1
package/README.md
CHANGED
|
@@ -171,10 +171,11 @@ The 15 tasks were deliberately failure-skewed, so the +9 points is not what you
|
|
|
171
171
|
|
|
172
172
|
## Credits
|
|
173
173
|
|
|
174
|
-
The verification method is the **Probabilistic Pivot Tournament** from **LLM-as-a-Verifier** (Kwok et al., 2026), reimplemented from the paper. The
|
|
174
|
+
The verification method is the **Probabilistic Pivot Tournament** from **LLM-as-a-Verifier** (Kwok et al., 2026), reimplemented from the paper. The authors maintain the **official implementation, [TurboAgent](https://github.com/llm-as-a-verifier/TurboAgent)** (a proxy for Claude Code and opencode); for clean, paper-faithful benchmark numbers, that is the tighter match. I built this before I knew other implementations existed, wanting a same-model, agent-agnostic drop-in: a **reasoned** pairwise verifier (so it self-verifies with the same model, or any model, with no logprobs and no separate verifier model), plus a confidence-gated apply policy and isolated git worktrees, my adaptations on top of the PPT. The self-verification ceiling I ran into is documented in the cross-model and weak-verifier literature, worth reading before you assume same-model verification is a free lunch:
|
|
175
175
|
|
|
176
176
|
- Paper: [arXiv:2607.05391](https://arxiv.org/abs/2607.05391)
|
|
177
177
|
- Repo: [llm-as-a-verifier/llm-as-a-verifier](https://github.com/llm-as-a-verifier/llm-as-a-verifier)
|
|
178
|
+
- Official implementation: [llm-as-a-verifier/TurboAgent](https://github.com/llm-as-a-verifier/TurboAgent)
|
|
178
179
|
- On the ceiling: [LLM-as-a-Jury (cross-model)](https://arxiv.org/html/2607.10139), [Weaver: weak verifiers](https://arxiv.org/html/2506.18203), [Generative Verifiers](https://arxiv.org/pdf/2408.15240)
|
|
179
180
|
|
|
180
181
|
```bibtex
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "agent-ultramode",
|
|
3
|
-
"version": "0.1.
|
|
3
|
+
"version": "0.1.4",
|
|
4
4
|
"description": "Best-of-N for coding agents with a same-model verifier: run your task N times in isolated git worktrees and apply the verified winner. A /ultra command for opencode.",
|
|
5
5
|
"module": "ultra.ts",
|
|
6
6
|
"main": "ultra.ts",
|