agent-ultramode 0.1.2 → 0.1.3
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +3 -3
- package/package.json +1 -1
package/README.md
CHANGED
|
@@ -80,7 +80,7 @@ That is the whole setup. With no options it drafts and verifies with your **curr
|
|
|
80
80
|
{ "plugin": [ ["agent-ultramode", { "model": "myprovider/my-model" }] ] }
|
|
81
81
|
```
|
|
82
82
|
|
|
83
|
-
**Run a different agent (Claude Code, Grok, Pi, Codex, ...).** The `agent` option is the command run once per attempt, with `{task}` substituted and the cwd set to an isolated worktree. Point it at any CLI that edits files and exits:
|
|
83
|
+
**Run a different agent (Claude Code, cline, Grok, Pi, Codex, ...).** The `agent` option is the command run once per attempt, with `{task}` substituted and the cwd set to an isolated worktree. Point it at any CLI that edits files and exits:
|
|
84
84
|
|
|
85
85
|
```jsonc
|
|
86
86
|
["agent-ultramode", { "agent": "claude -p --dangerously-skip-permissions \"{task}\"" }] // Claude Code (verified)
|
|
@@ -166,12 +166,12 @@ The 15 tasks were deliberately failure-skewed, so the +9 points is not what you
|
|
|
166
166
|
- [x] **Standalone CLI** (`npx agent-ultramode`) so the loop runs anywhere, with any agent, no opencode required.
|
|
167
167
|
- [x] **Multiple models in one pass** (repeatable `--agent`): spread attempts across different models, one neutral verifier picks the best.
|
|
168
168
|
- [x] **OpenCode, Claude Code, and cline** verified end to end.
|
|
169
|
-
- [ ] **First-class agent integrations**
|
|
169
|
+
- [ ] **First-class agent integrations** (tuned defaults and a benchmark number) for Grok, Pi, and Codex.
|
|
170
170
|
- [ ] Native slash-command or MCP packaging per agent. Contributions welcome.
|
|
171
171
|
|
|
172
172
|
## Credits
|
|
173
173
|
|
|
174
|
-
The verification method is the **Probabilistic Pivot Tournament** from **LLM-as-a-Verifier** (Kwok et al., 2026), reimplemented from the paper. The `K`-sample reward estimate and the apply policy are
|
|
174
|
+
The verification method is the **Probabilistic Pivot Tournament** from **LLM-as-a-Verifier** (Kwok et al., 2026), reimplemented from the paper. The `K`-sample reward estimate and the apply policy are my adaptations. The self-verification ceiling I ran into is documented in the cross-model and weak-verifier literature, worth reading before you assume same-model verification is a free lunch:
|
|
175
175
|
|
|
176
176
|
- Paper: [arXiv:2607.05391](https://arxiv.org/abs/2607.05391)
|
|
177
177
|
- Repo: [llm-as-a-verifier/llm-as-a-verifier](https://github.com/llm-as-a-verifier/llm-as-a-verifier)
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "agent-ultramode",
|
|
3
|
-
"version": "0.1.
|
|
3
|
+
"version": "0.1.3",
|
|
4
4
|
"description": "Best-of-N for coding agents with a same-model verifier: run your task N times in isolated git worktrees and apply the verified winner. A /ultra command for opencode.",
|
|
5
5
|
"module": "ultra.ts",
|
|
6
6
|
"main": "ultra.ts",
|