loki-mode 9.50.2 → 9.50.3

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
@@ -0,0 +1,444 @@
1
+ # Competitive intel, 30 days to 2026-09-14
2
+
3
+ Window: **2026-08-15 to 2026-09-14**. Every claim below carries a URL or a
4
+ file:line. Anything without one is in the UNVERIFIED section at the bottom and
5
+ is deliberately excluded from the ranked list.
6
+
7
+ **Prior document.** `docs/COMPETITIVE-NEXT-10.md` was written 2026-09-09 and is
8
+ the same shape of deliverable (ranked build list vs factory.ai and 8090, with
9
+ already-exists verdicts). This document does NOT supersede it. It covers what is
10
+ new since it, and every ranked item below states whether it is a NEXT-10 item or
11
+ not. Re-proposing a NEXT-10 open item as a fresh discovery would be this repo's
12
+ signature failure committed at the document level rather than the item level.
13
+
14
+ **Evidence labelling used throughout:**
15
+
16
+ - `[measured]` - a command run against this repo on 2026-09-14, output quoted.
17
+ - `[sourced: URL]` - a page actually fetched on 2026-09-14.
18
+ - `vendor-claimed` - the vendor's own page or blog. Evidence that a CLAIM exists,
19
+ not that the capability works.
20
+ - `UNVERIFIED` - could not be cited. Never ranked.
21
+
22
+ ---
23
+
24
+ ## 1. What genuinely shipped in the window (2026-08-15 to 2026-09-14)
25
+
26
+ ### Factory.ai
27
+
28
+ **Aug 27, 2026 - "What it Takes for Coding Agents to Complete Large Software
29
+ Tasks"** [sourced: https://factory.ai/news/what-it-takes-for-coding-agents-to-complete-large-software-tasks]
30
+
31
+ The most strategically relevant thing any competitor published in this window.
32
+ Factory argues a single agent validating its own work stops early with "much of
33
+ the outcome absent", and reports that splitting the run into orchestrator /
34
+ implementer / validator separated by an information barrier they call **"the
35
+ wall"** produces large gains. The validator authors an independent measurement
36
+ instrument BEFORE implementation begins, so the implementer cannot tailor work to
37
+ visible test cases.
38
+
39
+ Numbers, all **vendor-claimed**, on ProgramBench (partial-credit behavioral
40
+ parity, not pass/fail):
41
+
42
+ | Subject | Single agent | With the wall |
43
+ |---|---|---|
44
+ | GDAL | 36% | 90% |
45
+ | 7-Zip | 54% | 95% |
46
+ | DuckDB | 34% | 80% |
47
+ | Fable 5 median, 24 tasks | 56.7% | 89.3% |
48
+ | Kimi K3 median | 45.1% | 75.4% |
49
+ | GPT-5.6-Sol median | 48.6% | 66.2% |
50
+
51
+ Note on reading these: ProgramBench's own paper reports that "none fully resolve
52
+ any task" [sourced: https://arxiv.org/pdf/2605.03546]. That is NOT a
53
+ contradiction of Factory's figures - ProgramBench scores partial behavioral
54
+ parity, so a high median partial score and zero fully-resolved tasks are
55
+ compatible. Treat the table as vendor-claimed on a partial-credit metric.
56
+
57
+ **Sep 1, 2026 - CLI v0.209.0** [sourced: https://docs.factory.ai/changelog/release-notes]
58
+ Default model for new sessions became GPT-5.6 Sol. Session archiving.
59
+
60
+ **Aug 17 - Sep 1, 2026 - changelog band** [sourced: same]
61
+ Roughly twenty releases. Read in bulk, it is overwhelmingly **UI and session
62
+ polish**, not capability: diff line wrapping, sidebar width persistence, session
63
+ search speed, model-list search box, voice dictation accuracy, markdown tables,
64
+ mermaid rendering. Three items have substance: `droid doctor` for connectivity
65
+ diagnostics (Aug 25), the explorer droid gaining every read-only tool (Aug 18),
66
+ and org admins being able to disable image generation (Aug 21).
67
+
68
+ **Sep 9, 2026 - Factory listed on Claude Marketplace**
69
+ [sourced: https://factory.ai/news/claude-marketplace]
70
+ Enterprises can spend existing Anthropic commitments on Factory, removing a
71
+ separate procurement cycle. This is a **distribution and procurement** move, not
72
+ an engineering one. It is ranked separately below for that reason.
73
+
74
+ ### Frontier models
75
+
76
+ **Sep 3, 2026 - GPT-6 Astra** [sourced: https://openai.com/index/gpt-6-astra/,
77
+ https://simonwillison.net/2026/Sep/3/gpt6-astra/]. Closed multimodal reasoning
78
+ model; headline upgrade is native computer use.
79
+
80
+ **Claude Fable 5.1** - released in the window per
81
+ [sourced: https://patmcguinness.substack.com/p/claude-fable-51-gpt-6-astra-and-the].
82
+ Exact date not established from a primary Anthropic source; see UNVERIFIED.
83
+
84
+ **Meta Muse Spark 1.3** - named in the same roundup as one of five models pushing
85
+ efficiency at lower cost. Secondary source only; see UNVERIFIED.
86
+
87
+ ### Independent / community signal
88
+
89
+ **Verification is now the named bottleneck.** Multiple September HN digests
90
+ converge on the same sentence: the constraint is no longer generation speed but
91
+ verification capacity
92
+ [sourced: https://www.developersdigest.tech/blog/what-hacker-news-gets-right-about-ai-coding-agents-2026].
93
+ This is the market moving toward this repo's stated wedge, not away from it.
94
+
95
+ **Docket** (github.com/yielab/docket) [sourced: https://github.com/yielab/docket]
96
+ is the closest direct competitor to the receipt. It gives every AI-written commit
97
+ a hash-chained JSONL audit log with a `docket audit verify` command. It is
98
+ self-labelled `v0.2.0-beta.2` and warns "Expect breaking changes between beta
99
+ releases"; no public star count was visible on the page I fetched, and the fetch
100
+ could not establish repo age or last-commit date, so **treat its adoption as
101
+ unmeasured rather than zero**. The durable point is architectural, and does not
102
+ depend on adoption: verification is hash-chain only, with **no cryptographic
103
+ signatures and no offline third-party verification**. Its own docs concede "an
104
+ operator able to delete all docket state can erase both the log and its backup."
105
+
106
+ ---
107
+
108
+ ## 2. Context: important, but OUTSIDE the 30-day window
109
+
110
+ Kept separate so nothing here is mistaken for a recent development.
111
+
112
+ - **Apr 1, 2026 - Legacy-Bench** [sourced: https://factory.ai/news/legacy-bench,
113
+ https://github.com/factory-ai/legacy-bench]. Apache-2.0, 19 stars. COBOL 46%,
114
+ Java 7 32%, BASIC/C89/Fortran/Assembly 5-6% each. Pass rates **16.9% to 42.5%**
115
+ across 12 model-agent combos, against >70% for the same models on
116
+ Terminal-Bench 2 and SWE-bench Verified. Droid + GPT-5.3-Codex tops it at
117
+ 42.5%. Ten sample tasks are public; the full set requires contacting Factory.
118
+ Factory states "We welcome evaluation submissions."
119
+ - **Jun 30, 2026 - "Building to the Test: Coding Agents Deliver What You Check,
120
+ Not What You Requested"** [sourced: https://arxiv.org/pdf/2606.28430]. Ma,
121
+ Kereopa-Yorke, Schultz. Independent, non-vendor evidence for exactly the
122
+ failure mode Factory's "wall" post claims to fix.
123
+ - **Jun 1, 2026 - Factory Router** [sourced: https://factory.ai/news/factory-router].
124
+ "cuts token spend by 20-25%", private research preview, measured on
125
+ Terminal-Bench 2 and Legacy-Bench against an Opus 4.7 baseline.
126
+ - **Aug 13, 2026 - Agent Effectiveness** [sourced: https://factory.ai/news/agent-effectiveness].
127
+ Thirty-two days out, so just outside. **"Currently in Private Preview"** - a
128
+ claim of a product, not a shipped one. Measures cycle time, work intent, and
129
+ attribution of sessions to shipped artifacts.
130
+ - **Jan 23, 2026 - Signals** [sourced: https://factory.ai/news/factory-signals].
131
+ Shipped and running daily; friction detection that auto-files Linear tickets
132
+ and assigns them to Droid.
133
+ - **Sep 25, 2025 - Terminal-Bench 58.75%** [sourced: https://factory.ai/news/terminal-bench].
134
+ Self-reported by Factory, run on their own Ubuntu machines.
135
+ - **Aug 13, 2026 - DeepSeek V4-Pro GA and `deepseek-harness`** (MIT, everything a
136
+ plugin) [sourced: https://www.digitalapplied.com/blog/deepseek-harness-open-source-agent-framework-2026].
137
+ Secondary source; the post itself notes the package is `v0.1.0-rc.5` with no
138
+ GitHub release behind it.
139
+
140
+ ### 8090.ai
141
+
142
+ **Nothing shipped in the window that I could cite.** The site sells
143
+ Software Factory (an "AI-native SDLC control plane") and 8090 Enterprise
144
+ [sourced: https://www.8090.ai/]. Most recent datable events are the EY.ai PDLC
145
+ launch (Mar 2026) and a $135M Series A led by Salesforce Ventures (Jun 2026)
146
+ [sourced: https://siliconangle.com/2026/06/29/ai-software-development-startup-8090-nabs-135m-funding-round/].
147
+ Absence of evidence reported as a finding, not filled with a guess.
148
+
149
+ **CORRECTION to a prior repo audit, and it goes the inconvenient way.** This
150
+ repo previously established that 8090's public site yields no verifiable product
151
+ evidence, and I was asked to confirm that in one fetch and move on. It does not
152
+ confirm [sourced: https://www.8090.ai/software-factory]. Present today: a free
153
+ trial at `factory.8090.ai` ("Get Started for Free"), public documentation at
154
+ `docs.8090.ai`, a demo video playlist, a pricing page, and a published CMS
155
+ claims-modernization case study. Still absent: benchmark numbers, a changelog,
156
+ and any version history.
157
+
158
+ So the accurate 2026-09-14 statement is **not** "no public product surface". It
159
+ is: 8090 has a self-serve on-ramp and docs, but publishes **no versioned release
160
+ history and no benchmarks**, which is what actually blocks capability comparison.
161
+ Recording this as a correction rather than a confirmation because the prior
162
+ finding's premise has changed, and re-asserting a stale finding as verified is
163
+ the same failure shape as an uncited claim.
164
+
165
+ ### Correction to a prior repo finding
166
+
167
+ The repo previously established that factory.ai, 8090 and Devin have **no**
168
+ G2/Capterra/ProductHunt listings. **That is now outdated for factory.ai.** A G2
169
+ product page exists at https://www.g2.com/products/factory-ai/reviews. I could
170
+ not fetch it (403), and the secondary report of "1 G2 review, 3 Product Hunt
171
+ reviews, Capterra 4.2"
172
+ [sourced: https://theaiagentindex.com/agents/factory-ai] is second-hand, so treat
173
+ the counts as unconfirmed. The correct statement is: **a listing now exists, with
174
+ too few reviews for aggregate sentiment comparison.** For 8090 I found listings
175
+ only on SourceForge/Slashdot aggregators, no G2/Capterra/ProductHunt.
176
+
177
+ ---
178
+
179
+ ## 3. Ranked build list
180
+
181
+ Ranked by (user value delivered) / (effort). Each item states whether it closes a
182
+ gap or extends a lead, and its NEXT-10 status.
183
+
184
+ ### 1. Put an information barrier between checklist authoring and implementation
185
+
186
+ **Closes a gap. Extends an existing lead once closed. Not in NEXT-10.**
187
+
188
+ **ALREADY EXISTS: PARTIALLY - and the existing half is the valuable half.**
189
+ I nearly filed this as "build a validator role", which would have repeated the
190
+ 8-of-11 mistake. The check refuted it:
191
+
192
+ - The checklist is derived from the PRD **before** implementation
193
+ `[measured]` `autonomy/run.sh:20483` instructs the agent to create
194
+ `.loki/checklist/checklist.json` from the PRD on the first iteration, with
195
+ per-item verification checks (`file_exists`, `file_contains`, `tests_pass`,
196
+ `grep_codebase`, `command`). `checklist_init` is called at
197
+ `autonomy/run.sh:22349`; the module is `autonomy/prd-checklist.sh`.
198
+ - It is **independently re-verified after** a completion claim `[measured]`
199
+ `checklist_verify` at `autonomy/run.sh:23973`, and
200
+ `council_reverify_checklist` at `:24858` and `:25604`, executed by the
201
+ deterministic `autonomy/checklist-verify.py`.
202
+
203
+ So Loki already has a pre-authored, deterministically-rechecked standard. What it
204
+ does **not** have is Factory's wall: the **same agent** writes the checklist and
205
+ then implements against it. That is precisely the failure mode
206
+ `arXiv:2606.28430` names, and it is independent of Factory's marketing.
207
+
208
+ **Do:** have the checklist authored by a dispatch that does not see, and is not
209
+ continued by, the implementing context. The verification machinery is already
210
+ built, so this is a dispatch-boundary change, not a new subsystem. Highest
211
+ value-over-effort item on this list because the expensive half already exists.
212
+
213
+ ### 2. Tamper-evidence: nothing to build, and a stale internal note to retract
214
+
215
+ **Extends the lead. Not in NEXT-10. NO BUILD REQUIRED.**
216
+
217
+ **ALREADY EXISTS: YES, FULLY.** I nearly ranked "wire `writeWitness`" as the
218
+ single highest-value item on this list, on the strength of an internal memory
219
+ (`project-audit-chain-not-tamper-proof`) stating it existed with **zero
220
+ production callers**. Checking the source refuted that memory outright. It is
221
+ outdated and should be retracted:
222
+
223
+ - `writeWitness` is defined at `src/audit/crosslink.js:234` and **has production
224
+ callers** `[measured]`: `src/audit/subscriber.js:142` (periodic) and `:155`
225
+ (session end), both via `writeWitnessSafely`, plus the wrapper export at
226
+ `src/audit/index.js:226,278`.
227
+ - The reconciliation half that the memory said was missing now exists:
228
+ `reconcileWitnessedPrefix` at `src/audit/crosslink.js:560` `[measured]`.
229
+ - Most importantly it is **wired into the verdict**, not merely present:
230
+ `crosslink.js:392` calls it and `:398-399` ANDs `witnessedPrefix.valid` into
231
+ the overall `valid`. The comparison is prefix-based, not tip-equality, so
232
+ legitimate chain growth does not false-positive, and the three states
233
+ (`checked` / `no_records` / `unreadable`) are explicitly never collapsed, with
234
+ `no_records` documented as "NOT a pass."
235
+
236
+ So the honest competitive position is stronger than the memory implied, and it
237
+ needs no work. Against Docket: `autonomy/receipt_jwt.py` exists `[measured]` and
238
+ `loki proof verify --jwks <url|file>` checks an Ed25519 attestation against a
239
+ published key set including **from a local `jwks.json` with no network**
240
+ `[measured: autonomy/loki:900-910]`, so a third party can check WHO produced a
241
+ receipt with no API token and no key import. Docket has neither signatures nor
242
+ offline verification, and concedes an operator can erase its log and backup.
243
+
244
+ **Do: nothing in code.** Update the memory file so a future session does not
245
+ re-propose this. The lesson generalises and is why this section survives at rank
246
+ 2 despite requiring no build: a memory is evidence of what was true when written,
247
+ never of what is true now.
248
+
249
+ ### 3. Persist a per-run human-intervention counter
250
+
251
+ **Closes a gap against Agent Effectiveness. Cheap. Not in NEXT-10.**
252
+
253
+ **REFUTED 2026-09-14 by the integrator. ALREADY EXISTS: FULLY.** This item was
254
+ filed on the belief that the reader exists and the writer does not. Both halves
255
+ of the chain ship:
256
+
257
+ - **Writer:** `handle_pause` in `autonomy/run.sh` increments
258
+ `.loki/state/interventions.json` (the counter block at `autonomy/run.sh:25712`).
259
+ Counted there deliberately: every pause path funnels through `handle_pause`,
260
+ and the `_PAUSE_IN_PROGRESS` guard makes one blocking pause count once.
261
+ - **Proof:** `autonomy/lib/proof-generator.py:1147-1151` reads that file into the
262
+ journey; `:1544-1545` mirrors it to top-level `proof["interventions"]`.
263
+ - **Reader:** `_interventions_value` in `autonomy/lib/trust_trajectory.py`.
264
+
265
+ Verified empirically: replaying the writer's logic yields count 1 then 2 across
266
+ two pauses. **No build required.**
267
+
268
+ The trap that made it look missing: `_AXIS_HIGHER_IS_BETTER = {"interventions":
269
+ False, ...}` reads like a disable flag. It is POLARITY (lower-is-better), and
270
+ `iterations` is `False` for the same reason. There are only three `_AXIS_*`
271
+ dicts and none gates availability. The axis honestly reports `available: false`
272
+ until a proof carries the count, which is by design, not a gap.
273
+
274
+ The stale docstring that seeded this belief was corrected in `a9a02681`.
275
+
276
+ Original (incorrect) reasoning retained below for the record:
277
+
278
+ **~~ALREADY EXISTS: THE READER DOES, THE WRITER DOES NOT.~~** This is the
279
+ reader/writer key contract trap this repo has hit before.
280
+ `autonomy/lib/trust_trajectory.py` already declares `interventions` as a tracked
281
+ metric with a lower-is-better direction `[measured: lines 13, 46, 54, 61]`, and
282
+ `_interventions_value` reads it at line 145. But its own docstring says
283
+ `[measured]`: *"There is no per-run intervention counter persisted today."* It is
284
+ gated off (`"interventions": False` at line 46).
285
+
286
+ Loki already computes things Factory's Private-Preview product does not, notably
287
+ **cost-per-VERIFIED-task** `[measured: autonomy/lib/trust_metrics.py:397]`, whose
288
+ denominator is a verified outcome rather than a shipped artifact. Factory's
289
+ headline metric is "how much independent work Droids do between human
290
+ interactions" - which is exactly the field Loki declares and never fills.
291
+
292
+ **Do:** persist the counter at the existing `check_human_intervention` site and
293
+ flip the flag. Small diff, and it completes a metric surface that is otherwise
294
+ stronger than the competitor's.
295
+
296
+ ### 4. Run healing mode against Legacy-Bench
297
+
298
+ **Extends the lead, on the one axis with the most headroom. Not in NEXT-10.**
299
+
300
+ **ALREADY EXISTS: NO.** `[measured]` `benchmarks/` contains SWE-bench,
301
+ swebench-pro-pilot, HumanEval and internal A/B harnesses. Zero Legacy-Bench
302
+ coverage; the only `legacy|COBOL` hits are unrelated (`speed-benchmark.sh`,
303
+ equivalence reports, SWE-bench patch files).
304
+
305
+ This is the best-matched external scoreboard in existence for this repo's
306
+ brownfield wedge (`project-brownfield-wedge-evidence`: proof-of-function on
307
+ legacy migration is unclaimed by every vendor). It is Apache-2.0, runnable via
308
+ the Harbor harness, and Factory explicitly welcomes submissions. Frontier agents
309
+ score 16.9-42.5% where they score >70% elsewhere, so the headroom is real and the
310
+ ceiling is not yet claimed by anyone credible.
311
+
312
+ **Caveat that must not be skipped:** only 10 of the tasks are public and the full
313
+ set requires contacting Factory, who also own the benchmark and currently top it.
314
+ A self-run number on 10 public tasks is a pilot, not a leaderboard claim, and must
315
+ be published as such.
316
+
317
+ ### 4b. Surface the receipt at the end of the run (added after founder steer)
318
+
319
+ **Closes a delivery gap, not a capability gap. Very cheap. Not in NEXT-10.**
320
+
321
+ The founder's framing reorders this list: rank by whether an item reduces human
322
+ round-trips or proves completion, not by feature parity. Under that lens the
323
+ sharpest question is not "do we have proof" but "does the user GET it at the end
324
+ of one run, without asking".
325
+
326
+ **ALREADY EXISTS: GENERATION YES, SURFACING BARELY.** `[measured]` The receipt is
327
+ produced automatically and is opt-OUT, not opt-in: `LOKI_PROOF` defaults to `1`
328
+ at `autonomy/run.sh:26810`, `:26894` and `:26979` (all `${LOKI_PROOF:-1}`), and
329
+ `generate_proof_of_run` is called on the terminal path "fire-and-forget on both
330
+ success and failure runs" (`:26893`). It is regenerated idempotently after
331
+ HANDOFF.md and commit writers finish so `proof.tree_sha256` describes the exact
332
+ returned tree (`:26975-26981`).
333
+
334
+ So we already beat the bar the steer set. What is thin is the last inch: the
335
+ only place the artifact's location reaches the user is a single echo,
336
+ `autonomy/run.sh:8115` - `(or open $proofs_dir/$latest/index.html)`. A user who
337
+ does not already know `loki proof` exists can finish a successful run without
338
+ ever learning a checkable receipt was written for them.
339
+
340
+ **Do:** print the receipt path plus the one-line verdict and the
341
+ `loki proof verify <id>` command in the end-of-run summary. This is the
342
+ highest value-per-line-of-code item on the list: the expensive machinery is
343
+ built, defaulted on, and currently under-announced.
344
+
345
+ ### 5. Publish the verification-bottleneck position while the market names it
346
+
347
+ **Extends the lead. Zero engineering effort. Not in NEXT-10.**
348
+
349
+ **ALREADY EXISTS: THE CAPABILITY YES, THE POSITIONING ARTIFACT NO.**
350
+ `loki verify --fast` runs exogenous checks only, no model call and no network, so
351
+ every verdict is reproducible by anyone at the same commit
352
+ `[measured: autonomy/loki:18131-18145]`, at a documented 19ms diff-scoped against
353
+ an 11,040ms baseline. `loki proof verify` re-checks a receipt for tamper and
354
+ drift with `--human` prose output `[measured: autonomy/loki:36195-36210]`.
355
+
356
+ Independent HN consensus has now converged on "verification is the bottleneck",
357
+ and the nearest competing artifact (Docket) is a 0-star beta with no signatures.
358
+ This is the cheapest item here: the product is built, the market just started
359
+ using our vocabulary.
360
+
361
+ ### Models are not products: the cost-per-task question
362
+
363
+ The founder's comparison set mixes two categories and they must not be blurred.
364
+ **factory.ai and 8090 are PRODUCTS** and are ranked above. **DeepSeek, Muse,
365
+ Claude Fable and GPT-6 Astra are MODELS.** For a provider-agnostic harness the
366
+ useful question about a model is not feature parity but: can we route to it, and
367
+ at what cost per completed task.
368
+
369
+ **ALREADY EXISTS: TIERED ROUTING YES, CHEAP-FRONTIER ROUTE NO.** `[measured]`
370
+ `providers/models.sh:19-24` exposes generic `small|medium|high` tiers and
371
+ explicitly forbids callers naming a vendor model, with `medium` the default.
372
+ That is the right abstraction and it is already built. But the only MiniMax
373
+ reference in the entire repo is a **comment**, not a route:
374
+ `providers/opencode.sh:25` records "MiniMax M2.5 resolved 75.8 at $36.64 total
375
+ vs Claude Opus 4.6 at 75.6". That is a measured near-parity result at roughly
376
+ 7.5x lower cost, sitting in a comment.
377
+
378
+ Two competitive signals make this timely. Factory **removed MiniMax M2.5 from
379
+ model selection** on Aug 11 [sourced: https://docs.factory.ai/changelog/release-notes],
380
+ and DeepSeek V4 ships open weights under MIT (Aug 13 V4-Pro GA, secondary
381
+ source). A competitor retiring the cheap near-parity model is the moment a
382
+ provider-agnostic harness can differentiate on cost per completed task.
383
+
384
+ **Do:** promote the opencode cheap-frontier result from a comment to a selectable
385
+ tier with a published cost-per-completed-task number. Low effort, directly serves
386
+ the "2-3x value" ask, and it is the one item here where being provider-agnostic
387
+ is a structural advantage rather than a parity feature.
388
+
389
+ **Honest limit:** the $36.64 figure is a single internal benchmark run recorded
390
+ in a comment. It must be re-measured before it is published anywhere external.
391
+
392
+ ### Ranked separately: apply to the Claude Marketplace partner waitlist
393
+
394
+ **Business decision, not an engineering item** - listed apart so it does not
395
+ distort the value-over-effort ordering above.
396
+
397
+ Factory listed on Sep 9 [sourced: https://factory.ai/news/claude-marketplace] and
398
+ the marketplace lets enterprises spend existing Anthropic commitments, which
399
+ removes a procurement cycle. Loki already ships the required artifacts
400
+ `[measured]`: `.claude-plugin/marketplace.json` and
401
+ `plugins/loki-mode/.claude-plugin/plugin.json` at 9.50.1. Entry is via a partner
402
+ waitlist [sourced: https://claude.com/platform/marketplace], so this is a founder
403
+ call, not a build.
404
+
405
+ ### Deliberately NOT ranked (open NEXT-10 items, status unchanged)
406
+
407
+ Re-listed only so this document cannot be read as re-proposing them. See
408
+ `docs/COMPETITIVE-NEXT-10.md` for the evidence:
409
+
410
+ - **NEXT-10 item 5** - `loki init` writes dead config keys. Open.
411
+ - **NEXT-10 item 6** - `llm_review` verdict influence deferred. Open by design.
412
+ - **NEXT-10 item 8** - flaky `test-review-assurance-tail.sh`. Open; deliberately
413
+ not patched.
414
+ - **NEXT-10 item 10** - hard command blocklist. Designed, not built.
415
+
416
+ ---
417
+
418
+ ## 4. UNVERIFIED
419
+
420
+ Excluded from the ranked list. Listed so the absence is a finding.
421
+
422
+ - **Factory, "Why model routing must be in the harness" (24 Aug 2026).** The news
423
+ index lists this title and date, but three URL attempts 404'd and two searches
424
+ failed to surface the post. Worse, three **conflicting** cost figures circulate
425
+ for Factory routing: "20-25%" (Factory Router, Jun 1, primary source), "58%",
426
+ and "cost per successful run is 80.5% of Opus on Terminal-Bench 2 and 78.0% on
427
+ Legacy-Bench" (both secondary). I did not pick one. The post may exist; I could
428
+ not read it, and no routing figure other than the Jun 1 "20-25%" should be
429
+ quoted.
430
+ - **Claude Fable 5.1 exact release date.** Named in a secondary roundup only; no
431
+ primary Anthropic announcement fetched.
432
+ - **Meta Muse Spark 1.3.** Secondary roundup only. The founder named "Muse"; I
433
+ could not confirm whether this is the same product.
434
+ - **DeepSeek V4 SWE-bench figures.** Several secondary blogs give numbers. No
435
+ primary DeepSeek source fetched, so none are reproduced here.
436
+ - **G2/Capterra/ProductHunt review counts for factory.ai.** g2.com returned 403.
437
+ The listing exists; the counts are second-hand.
438
+ - **Factory's ProgramBench table.** Vendor-claimed, self-run. ProgramBench is an
439
+ academic benchmark (arXiv:2605.03546) but I found no independent leaderboard
440
+ entry confirming Factory's figures (benchmarklist.com returned 403).
441
+ - **"Claude Mythos Preview tops SWE-bench Verified at 93.9%"** surfaced in
442
+ search. Not fetched from a primary source, outside the window, and this repo
443
+ has been burned by exactly this class of number
444
+ (`project-swebench-9967-was-string-counting`). Recorded, not used.
@@ -2,7 +2,7 @@
2
2
 
3
3
  The flagship product of [Autonomi](https://www.autonomi.dev/). Loki Mode is a spec-driven autonomous builder with a built-in trust layer that takes any spec to a deployed product and verifies completion with evidence (quality gates plus a completion council), not just a "done" claim. Complete installation instructions for all platforms and use cases.
4
4
 
5
- **Version:** v9.50.2
5
+ **Version:** v9.50.3
6
6
 
7
7
  ---
8
8