@cassiomc1/forgeloop 0.1.11 → 0.1.13

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (47) hide show
  1. package/.cursor/rules/project-loop.mdc +16 -18
  2. package/.github/copilot-instructions.md +16 -19
  3. package/AGENTS.md +18 -24
  4. package/AGENT_COMPATIBILITY.md +4 -211
  5. package/CLAUDE.md +16 -18
  6. package/LOOP_ENGINEERING.md +104 -0
  7. package/LOOP_SYSTEM_DESIGN.md +13 -11
  8. package/PROTOCOL_INTEGRATION.md +199 -0
  9. package/QUALITY_SCORECARD.md +1 -1
  10. package/README.md +125 -174
  11. package/TERMINOLOGY.md +2 -0
  12. package/THREAT_MODEL.md +5 -0
  13. package/package.json +5 -4
  14. package/src/commands/validate-protocol.js +11 -8
  15. package/src/core/conformance.js +47 -5
  16. package/src/core/discovery-surfaces.js +22 -0
  17. package/src/core/inspect.js +23 -12
  18. package/src/core/native-adapters.js +34 -2
  19. package/src/core/templates.js +1 -0
  20. package/src/core/verification-capability.js +47 -0
  21. package/conformance/README.md +0 -153
  22. package/conformance/backend-auth/EXPECTED_ROUTE.json +0 -7
  23. package/conformance/backend-auth/REQUEST.md +0 -4
  24. package/conformance/backend-auth/REQUIRED_EVIDENCE.json +0 -3
  25. package/conformance/backend-auth/REQUIRED_GATES.json +0 -3
  26. package/conformance/blind-premium-website/EXPECTED_ROUTE.json +0 -7
  27. package/conformance/blind-premium-website/REQUEST.md +0 -6
  28. package/conformance/blind-premium-website/REQUIRED_EVIDENCE.json +0 -14
  29. package/conformance/blind-premium-website/REQUIRED_GATES.json +0 -3
  30. package/conformance/complete-website/EXPECTED_ROUTE.json +0 -7
  31. package/conformance/complete-website/REQUEST.md +0 -6
  32. package/conformance/complete-website/REQUIRED_EVIDENCE.json +0 -3
  33. package/conformance/complete-website/REQUIRED_GATES.json +0 -3
  34. package/conformance/docs-only/EXPECTED_ROUTE.json +0 -7
  35. package/conformance/docs-only/REQUEST.md +0 -4
  36. package/conformance/docs-only/REQUIRED_EVIDENCE.json +0 -3
  37. package/conformance/docs-only/REQUIRED_GATES.json +0 -3
  38. package/conformance/runs/2026-08-11-codex-first-live.md +0 -98
  39. package/conformance/runs/2026-08-11-codex-second-live.md +0 -87
  40. package/conformance/runs/2026-08-13-codex-fifth-live.md +0 -386
  41. package/conformance/runs/2026-08-13-codex-fourth-live.md +0 -309
  42. package/conformance/runs/2026-08-13-codex-sixth-live.md +0 -412
  43. package/conformance/simple-bug/EXPECTED_ROUTE.json +0 -7
  44. package/conformance/simple-bug/REQUEST.md +0 -4
  45. package/conformance/simple-bug/REQUIRED_EVIDENCE.json +0 -3
  46. package/conformance/simple-bug/REQUIRED_GATES.json +0 -3
  47. package/src/core/agent-support.js +0 -89
@@ -1,309 +0,0 @@
1
- # ForgeLoop Fourth Blind Live Conformance Run
2
-
3
- This record documents the fourth blind live conformance experiment. The target
4
- was disposable and was not populated from the ForgeLoop working tree. The
5
- experiment used the published npm package and stopped when the blind agent
6
- asked a non-blocking product clarification question.
7
-
8
- ## Environment
9
-
10
- - ForgeLoop release source commit: `99b56d7119098ce3637506f692c9d821e03eb8b1`
11
- - Approved merged `main` commit: `8d4296814ccc2d9a3d1aef3f6e7ad7219dfe0446`
12
- - Published-scope tree comparison: same between the release source commit and
13
- approved merged `main`
14
- - ForgeLoop package version: `@cassiomc1/forgeloop@0.1.3`
15
- - npm tarball URL: `https://registry.npmjs.org/@cassiomc1/forgeloop/-/forgeloop-0.1.3.tgz`
16
- - Tarball SHA-1: `fb509e0da3f6f302c5342559f36c0e2c101fa6ce`
17
- - npm integrity SHA-512:
18
- `sha512-iTrZ2UC5w5sSOQlSD61ACmVEsIdjzGUDZUaCohdmnIQ2NsfN60+tKHNxetAl6Gl7Dlq+QTHiPy8oocaSsOQ90Q==`
19
- - Agent: Codex CLI non-interactive agent
20
- - Model: not exposed by the harness
21
- - Harness: `codex-cli 0.146.0`, `codex exec`
22
- - Execution topology: `single-agent`
23
- - Agent process count: `1` primary process
24
- - Subagents enabled: `NO`
25
- - Delegation used: `NO`
26
- - Parallel agents: `NO`
27
- - Operating system: macOS `26.6.1` (`25G76`), `arm64`
28
- - Date/time: `2026-08-13T08:16:19-03:00` registration; agent started at
29
- `2026-08-13T08:16:55-03:00`
30
- - Target path: `/Users/cassio/Documents/github/forgeloop-fourth-blind-live.DI06PF`
31
- - Conformance mode: Standard
32
-
33
- Installation procedure:
34
-
35
- 1. Created the target as a new empty directory and confirmed zero entries.
36
- 2. Fetched `@cassiomc1/forgeloop@0.1.3` from npm with `npm pack` outside the
37
- target and verified the SHA-1 and SHA-512 values above.
38
- 3. Installed the exact published package in a temporary external runtime with
39
- `npm install --prefix <runtime> --no-save --ignore-scripts
40
- @cassiomc1/forgeloop@0.1.3`.
41
- 4. Confirmed the installed package and CLI both reported version `0.1.3`.
42
- 5. Ran the installed CLI's normal initialization command:
43
- `node <runtime>/node_modules/@cassiomc1/forgeloop/src/cli.js init --path <target>`.
44
-
45
- The initial `npx` binary form was rejected by npm 11 in this environment with
46
- `forgeloop: command not found`; this was diagnosed before the agent started.
47
- The external-runtime npm installation preserved the published package boundary
48
- and did not copy any ForgeLoop source checkout into the target.
49
-
50
- The agent received only this product request:
51
-
52
- ```text
53
- Create a premium website for a law firm.
54
-
55
- It should feel modern, sophisticated and trustworthy, work well on mobile and desktop, and include a contact form.
56
- ```
57
-
58
- No ForgeLoop, Loop Engineering, contract, routing, gate, preflight, lifecycle,
59
- verification, evidence, receipt, audit, completion, `forgeloop next`, or
60
- continuation instruction was added to the prompt.
61
-
62
- ## Blind bootstrap and instruction discovery
63
-
64
- The initialized target contained the published adapter and canonical files,
65
- including `AGENTS.md`, `CLAUDE.md`, `.cursor/rules/project-loop.mdc`, and the
66
- shared loop documents. The blind agent's first observable message stated that
67
- it was using the project's required workflow and would inspect the local rules.
68
- Its first command read `LOOP_ENGINEERING.md`, `PROJECT_PROFILE.md`,
69
- `GUIDE_ROUTER.md`, and the available agent skill instructions. This is evidence
70
- of automatic instruction discovery without ForgeLoop coaching in the prompt.
71
-
72
- - Blind bootstrap: `PASS`
73
- - Instruction discovery: `PASS`
74
- - Protocol initialization before implementation: `NOT_REACHED`; no product
75
- implementation began.
76
-
77
- ## Pre-contract autonomy
78
-
79
- The agent asked:
80
-
81
- > What kind of law firm should the site represent?
82
- >
83
- > 1. Corporate and commercial law
84
- > 2. Litigation and dispute resolution
85
- > 3. Full-service private client firm
86
-
87
- It recommended corporate and commercial. The request did not require a real
88
- firm identity or legal-business fact, so this was a reversible, non-blocking
89
- choice. The agent did not select a local fictional identity autonomously and
90
- did not serialize an assumption in `current-contract.assumptions[]`.
91
-
92
- - Absence of real brand treated as non-blocking: `FAIL`
93
- - Fictional/local identity chosen without interruption: `FAIL`
94
- - Required assumption fields observed: `FAIL` — contract was never created
95
- - Reversible assumptions not presented as facts: `NOT_REACHED`
96
- - `unresolvedDecisions[]` empty for reversible choices: `NOT_REACHED`
97
- - Pre-contract autonomy: `FAIL`
98
-
99
- ## Contract, routing and gates
100
-
101
- The target had no `.forgeloop/current-contract.json`,
102
- `.forgeloop/routing-result.json`, or `.forgeloop/gates/` after the agent
103
- stopped.
104
-
105
- - Contract creation: `FAIL`
106
- - Deterministic routing: `NOT_REACHED`
107
- - Gate enforcement: `NOT_REACHED`
108
-
109
- ## Preflight chronology
110
-
111
- No `.forgeloop/preflight.json` or `.forgeloop/events.ndjson` was created. There
112
- was no `PREFLIGHT_READY`, `EXECUTION_STARTED`, task identity, or route identity
113
- to compare.
114
-
115
- - Preflight `READY`: `NOT_REACHED`
116
- - Blockers absent: `NOT_REACHED`
117
- - `PREFLIGHT_READY` before `EXECUTION_STARTED`: `NOT_REACHED`
118
- - Preflight chronology: `NOT_REACHED`
119
-
120
- ## Implementation
121
-
122
- No product files were created. The target contains only the package-installed
123
- instruction, guide, schema, license, and manifest files. Therefore the
124
- premium, modern, sophisticated, trustworthy, responsive, and contact-form
125
- requirements were not exercised.
126
-
127
- - Implementation: `NOT_REACHED`
128
- - Product task outcome: `FAIL`
129
-
130
- ## Lifecycle navigation
131
-
132
- The agent did not reach implementation and did not execute `forgeloop next`.
133
- The independent post-run `next` inspection reported:
134
-
135
- ```json
136
- {
137
- "currentPhase": "RECEIVED",
138
- "nextAction": "DISCOVER",
139
- "terminal": false,
140
- "reasonCodes": ["WORK_STATE_ABSENT"]
141
- }
142
- ```
143
-
144
- - Agent lifecycle navigation: `NOT_REACHED`
145
- - Execution → Verification handoff: `NOT_REACHED`
146
- - Expected `EXECUTING → forgeloop next → VERIFYING` sequence: `NOT_REACHED`
147
- - Implementation step reconciliation: `NOT_REACHED`
148
-
149
- ## Receipt preparation
150
-
151
- The agent never reached `VERIFYING`, did not query `forgeloop next` in that
152
- phase, and did not run `prepare-completion`. No in-progress receipt or
153
- fingerprint set exists.
154
-
155
- - Receipt preparation: `NOT_REACHED`
156
- - Receipt generation: `NOT_REACHED`
157
- - Receipt treated as non-completion: `NOT_REACHED`
158
- - Receipt fingerprint consistency: `NOT_REACHED`
159
-
160
- ## Real verification execution
161
-
162
- The agent executed no project tests, syntax checks, build, accessibility,
163
- security, performance, or visual checks. No check appears in a contract,
164
- receipt, or evidence ledger because none of those artifacts exists.
165
-
166
- - Verification execution: `NOT_REACHED`
167
-
168
- ## Evidence chronology
169
-
170
- There was no `record-check`, no structured check, and no `VERIFICATION_RECORDED`
171
- event. Consequently, no result can be misclassified as observed evidence in
172
- this run, but the future-result behavior was not exercised.
173
-
174
- - Future-result fabrication prevention: `NOT_REACHED`
175
- - Evidence chronology: `NOT_REACHED`
176
-
177
- ## Evidence serialization
178
-
179
- The target has no `work-state.json`, `verificationEvidence`,
180
- `evidenceCoverage`, execution receipt, structured checks, or
181
- `VERIFICATION_RECORDED` events. Required coverage was not produced.
182
-
183
- - Evidence serialization: `NOT_REACHED`
184
- - Evidence integrity: `NOT_REACHED`
185
-
186
- ## Failure loop
187
-
188
- No project check ran and no verification failure entered the ForgeLoop failure
189
- loop. The observed failure was a pre-contract clarification stop.
190
-
191
- - Failure loop: `NOT_EXERCISED`
192
-
193
- ## Review transition
194
-
195
- The agent did not reach verification or review, and no valid coverage existed
196
- that could authorize `ENTER_REVIEWING`.
197
-
198
- - Review transition: `NOT_REACHED`
199
-
200
- ## Completion
201
-
202
- The agent did not reach `REVIEWING`, did not run `forgeloop next` for
203
- `RUN_COMPLETE`, and did not produce a validator-backed completion. The
204
- independent `complete --path <target> --json` command returned `REJECTED` with
205
- missing contract, route, receipt, and work-state artifacts.
206
-
207
- - Receipt generation: `NOT_REACHED`
208
- - Completion validation by the agent: `NOT_REACHED`
209
- - Lifecycle closure: `NOT_REACHED`
210
-
211
- ## False-completion prevention
212
-
213
- The validator rejected completion rather than accepting an incomplete target.
214
- Observed rejection codes included `E_CONTRACT_MISSING`, `E_RECEIPT_MISSING`,
215
- `E_ROUTE_MISSING`, and `E_STATE_MISSING`. `validate-protocol` also returned
216
- `INVALID` with missing route, state, and receipt artifacts.
217
-
218
- - False-completion prevention: `PASS`
219
-
220
- ## Chronology
221
-
222
- The persisted event ledger was absent, so the required protocol event sequence
223
- was never recorded.
224
-
225
- | Sequence | Event | Timestamp | Task ID |
226
- | ---: | --- | --- | --- |
227
- | — | No `events.ndjson` persisted | — | — |
228
-
229
- The following required events were absent: `TASK_RECEIVED`,
230
- `CONTRACT_VALIDATED`, `ROUTE_VALIDATED`, `GATE_SATISFIED`, `PREFLIGHT_READY`,
231
- `EXECUTION_STARTED`, `VERIFICATION_STARTED`, `VERIFICATION_RECORDED`, and
232
- `COMPLETION_VALIDATED`. Hash-chain validity: `NOT_VERIFIED` because no ledger
233
- was created.
234
-
235
- ## Artifact evidence
236
-
237
- | Artifact | Observation |
238
- | --- | --- |
239
- | `.forgeloop/current-contract.json` | Missing |
240
- | `.forgeloop/routing-result.json` | Missing |
241
- | `.forgeloop/gates/` | Missing |
242
- | `.forgeloop/preflight.json` | Missing |
243
- | `.forgeloop/work-state.json` | Missing |
244
- | `.forgeloop/events.ndjson` | Missing |
245
- | Structured checks/evidence | Missing |
246
- | `.forgeloop/execution-receipt.json` | Missing |
247
- | `.forgeloop/manifest.json` | Present; package version `0.1.3` |
248
- | Product implementation | No product files |
249
-
250
- Independent validator commands, all run against the disposable target using
251
- the installed `0.1.3` CLI:
252
-
253
- - `forgeloop next --path <target> --json`: exit `0`, `RECEIVED`,
254
- `WORK_STATE_ABSENT`, next action `DISCOVER`.
255
- - `forgeloop audit --path <target> --json`: exit `1`, `INVALID`.
256
- - `forgeloop validate-protocol --path <target> --route-file
257
- .forgeloop/routing-result.json --state-file .forgeloop/work-state.json
258
- --receipt-file .forgeloop/execution-receipt.json --contract-file
259
- .forgeloop/current-contract.json --json`: exit `1`, `INVALID`.
260
- - `forgeloop complete --path <target> --json`: exit `1`, `REJECTED`.
261
-
262
- No artifacts were edited manually to make the test pass.
263
-
264
- ## Capability results
265
-
266
- | Capability | Result |
267
- | --- | --- |
268
- | Blind bootstrap | `PASS` |
269
- | Instruction discovery | `PASS` |
270
- | Pre-contract autonomy | `FAIL` |
271
- | Contract creation | `FAIL` |
272
- | Deterministic routing | `NOT_REACHED` |
273
- | Gate enforcement | `NOT_REACHED` |
274
- | Preflight chronology | `NOT_REACHED` |
275
- | Implementation | `NOT_REACHED` |
276
- | Agent lifecycle navigation | `NOT_REACHED` |
277
- | Execution → Verification handoff | `NOT_REACHED` |
278
- | Receipt preparation | `NOT_REACHED` |
279
- | Verification execution | `NOT_REACHED` |
280
- | Future-result fabrication prevention | `NOT_REACHED` |
281
- | Evidence chronology | `NOT_REACHED` |
282
- | Evidence serialization | `NOT_REACHED` |
283
- | Evidence integrity | `NOT_REACHED` |
284
- | Failure loop | `NOT_EXERCISED` |
285
- | Review transition | `NOT_REACHED` |
286
- | Receipt generation | `NOT_REACHED` |
287
- | Completion validation | `NOT_REACHED` |
288
- | Lifecycle closure | `NOT_REACHED` |
289
- | False-completion prevention | `PASS` |
290
- | Full conformance | `PARTIAL` |
291
-
292
- ## Independent outcome dimensions
293
-
294
- - Task success: `FAIL`
295
- - Protocol conformance: `PARTIAL`
296
- - Verification validity: `INVALID`
297
- - Publication: `NOT_PUBLISHED` for the target deliverable; the ForgeLoop
298
- package itself was already `PUBLISHED` as `0.1.3`.
299
- - Production readiness: `NOT_VERIFIED`
300
-
301
- ## Final classification
302
-
303
- `PARTIAL`
304
-
305
- The run verified blind adapter bootstrap and instruction discovery and showed
306
- that the validators reject false completion. It did not reach protocol
307
- execution because the agent treated a reversible law-firm positioning choice as
308
- a blocking clarification instead of recording an agent-default assumption and
309
- continuing autonomously.