ai-engineering-loop 1.0.18 → 1.0.19
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.agents/workflows/ai-engineering-loop.md +2 -2
- package/.claude/skills/ai-engineering-loop/SKILL.md +2 -2
- package/.gemini/skills/ai-engineering-loop/SKILL.md +2 -2
- package/.grok/skills/ai-engineering-loop/SKILL.md +2 -2
- package/README.md +2 -2
- package/adapters/generate-workflow/SKILL.md +9 -2
- package/bin/ai-engineering-loop.js +2 -2
- package/core/repo-config-schema.md +1 -1
- package/lib/generate-workflow.js +2 -1
- package/lib/intern-catalog.js +53 -0
- package/package.json +1 -1
- package/templates/repo-config/workflow.md +1 -1
- package/tests/generate-workflow.test.js +3 -2
- package/tests/intern-catalog.test.js +72 -0
- package/tests/skill-host-compat.test.js +5 -1
|
@@ -7,7 +7,7 @@ Follow `policies/review-budget.md`. Parent is Maker plus orchestrator. Do not us
|
|
|
7
7
|
|
|
8
8
|
Compact map (not a second OS): Specify (stages 0-1), Make (stages 2-4), Review (stages 5-7), Deliver (stage 8). Keep the 8-stage numbers. Do not skip Goal Contract, verification, Devil's Advocate, or Judge.
|
|
9
9
|
|
|
10
|
-
Stage 1: if the user asks for ideas, list a short menu and wait; do not implement. Grill if the task is ambiguous (`core/grill-policy.md`), then freeze the Goal Contract file. Chat agreement is not freeze. If the user prompt has no numbered AC, draft `.ai-engineering-loop/tasks/goal-contract.md` with a failure table, show it, wait for freeze. Do not start Maker. On business-logic change, and always on `adapter_type: dot`, grill includes blast radius: lifecycle sketch, four pillars (state, sibling, approval, queues), ASCII picture. Load `task-impact-inquiry` if present. Do not run a second interview. Passing unit tests are not isolation proof. Use `.ai-engineering-loop/glossary.md`. Name test seams. AC is a failure table (happy, empty/omit, boundary, sibling, error). One red test per AC row. Do not freeze sunny-path-only. Stages 2-4: Read `maker_intern` from workflow.md (missing or none = parent is Maker).
|
|
10
|
+
Stage 1: if the user asks for ideas, list a short menu and wait; do not implement. Grill if the task is ambiguous (`core/grill-policy.md`), then freeze the Goal Contract file. Chat agreement is not freeze. If the user prompt has no numbered AC, draft `.ai-engineering-loop/tasks/goal-contract.md` with a failure table, show it, wait for freeze. Do not start Maker. On business-logic change, and always on `adapter_type: dot`, grill includes blast radius: lifecycle sketch, four pillars (state, sibling, approval, queues), ASCII picture. Load `task-impact-inquiry` if present. Do not run a second interview. Passing unit tests are not isolation proof. Use `.ai-engineering-loop/glossary.md`. Name test seams. AC is a failure table (happy, empty/omit, boundary, sibling, error). One red test per AC row. Do not freeze sunny-path-only. Stages 2-4: Read `maker_intern` from workflow.md (missing or none = parent is Maker). Do not type a model name. If intern is set, confirm it came from this host's list (`/models` if that command exists). If the list command is missing or the id is not on it, parent is Maker; say intern INVOCATION_UNAVAILABLE. Intern cannot skip verification, Devil's Advocate, or Judge. Maker: TDD at those seams (`policies/tdd-policy.md`): one red test per AC row. Bugs: red repro first (`core/root-cause-analysis.md`). Mid-loop stop: `core/handoff-policy.md`.
|
|
11
11
|
|
|
12
12
|
If `invoke_subagent` (or Task) exists, spawn `devil-advocate` then `judge` as siblings. Wait for each child. Do not run them in the background. Use `general-purpose` only if the named type is rejected.
|
|
13
13
|
|
|
@@ -17,4 +17,4 @@ If `invoke_subagent` (or Task) exists, spawn `devil-advocate` then `judge` as si
|
|
|
17
17
|
|
|
18
18
|
If no subagent tool exists, run the same budgets in this session as CONTEXT_ISOLATION_ONLY. Do not claim independent agent execution.
|
|
19
19
|
|
|
20
|
-
Init/status/refresh/sync-hosts/generate-adapter/generate-workflow: `npx ai-engineering-loop <command>`. generate-workflow grills Q1-Q6. Stage 0: `npx ai-engineering-loop sync-hosts` then `npx ai-engineering-loop status`. Read `.ai-engineering-loop/glossary.md`. Read `.ai-engineering-loop/lessons.md` and `.ai-engineering-loop/workflow.md` if they exist. Follow workflow.md hooks (`before_grill`, `after_freeze`, `after_pass`). Do not skip Goal Contract, verification, Devil's Advocate, or Judge even if workflow.md asks. If workflow.md is missing, run the default 8-stage loop (no extra hooks). If sync-hosts copied files, tell the user a new session is needed for updated skill text; keep going with this session. After Judge PASS: run the `after_pass` hook if it is not `none`. Stage 8: load `adapters/<adapter_type>/`. If adapter.md is missing, run `generate-adapter` (grill). Do not invent a company pipeline. Confirmed process lessons go to `lessons.md`, not a chat dump.
|
|
20
|
+
Init/status/refresh/sync-hosts/generate-adapter/generate-workflow: `npx ai-engineering-loop <command>`. generate-workflow grills Q1-Q6. Q6 Maker intern: pick from the host catalog (`grok models` or `/models` if that command exists); do not type a model name. Stage 0: `npx ai-engineering-loop sync-hosts` then `npx ai-engineering-loop status`. Read `.ai-engineering-loop/glossary.md`. Read `.ai-engineering-loop/lessons.md` and `.ai-engineering-loop/workflow.md` if they exist. Follow workflow.md hooks (`before_grill`, `after_freeze`, `after_pass`). Do not skip Goal Contract, verification, Devil's Advocate, or Judge even if workflow.md asks. If workflow.md is missing, run the default 8-stage loop (no extra hooks). If sync-hosts copied files, tell the user a new session is needed for updated skill text; keep going with this session. After Judge PASS: run the `after_pass` hook if it is not `none`. Stage 8: load `adapters/<adapter_type>/`. If adapter.md is missing, run `generate-adapter` (grill). Do not invent a company pipeline. Confirmed process lessons go to `lessons.md`, not a chat dump.
|
|
@@ -26,7 +26,7 @@ Claude Code talks to strict proxies (including Kiro). Follow this exactly:
|
|
|
26
26
|
|
|
27
27
|
- `init` / `status` / `refresh` / `sync-hosts` / `generate-adapter` / `generate-workflow`: run `npx ai-engineering-loop <command>` in the repo. Do not commit unless asked.
|
|
28
28
|
- `generate-adapter`: load skill `generate-adapter` if present. Grill Q1-Q5. Then write `.ai-engineering-loop/adapter.md`. Do not start Maker.
|
|
29
|
-
- `generate-workflow`: load skill `generate-workflow` if present. Grill Q1-Q6. Then write `.ai-engineering-loop/workflow.md` and empty `lessons.md` if missing. Do not start Maker.
|
|
29
|
+
- `generate-workflow`: load skill `generate-workflow` if present. Grill Q1-Q6. Q6 Maker intern: if `/models` exists in this session, use it and show numbered options; else only `none`. Do not type a model name. Then write `.ai-engineering-loop/workflow.md` and empty `lessons.md` if missing. Do not start Maker.
|
|
30
30
|
- Any other argument: full loop for that task.
|
|
31
31
|
|
|
32
32
|
## Loop
|
|
@@ -37,7 +37,7 @@ Parent session is Maker plus orchestrator. Spawn Devil's Advocate and Judge as *
|
|
|
37
37
|
|
|
38
38
|
1. Stage 0: `npx ai-engineering-loop sync-hosts` then `npx ai-engineering-loop status` (init or refresh if missing or stale). Read `.ai-engineering-loop/glossary.md`. Read `.ai-engineering-loop/lessons.md` and `.ai-engineering-loop/workflow.md` if they exist. Follow workflow.md hooks (`before_grill`, `after_freeze`, `after_pass`). Do not skip Goal Contract, verification, Devil's Advocate, or Judge even if workflow.md asks. If workflow.md is missing, run the default 8-stage loop (no extra hooks). If sync-hosts copied files, tell the user a new session is needed for updated skill text; keep going with this session.
|
|
39
39
|
2. Stage 1: Goal Contract (`core/goal-contract.md`). If the user asks for ideas, list a short menu and wait; do not implement. If the task is ambiguous and the user can answer, grill first (`core/grill-policy.md`): design tree, recommended answers, do not ask look-up facts. Skip grill if the contract is already frozen or the user waived it. On business-logic change, and always on `adapter_type: dot`, grill includes blast radius: lifecycle sketch, four pillars (state, sibling, approval, queues), ASCII picture. Load `task-impact-inquiry` if present. Do not run a second interview. Passing unit tests are not isolation proof. Chat agreement is not freeze: every user-visible decision must be a numbered AC in the Goal Contract file. Freeze before any production edit. Name test seams. Use glossary terms. AC is a failure table (happy, empty/omit, boundary, sibling, error). One red test per AC row. Do not freeze sunny-path-only. If the user prompt has no numbered AC, draft `.ai-engineering-loop/tasks/goal-contract.md` with a failure table, show it, wait for freeze. Do not start Maker.
|
|
40
|
-
3. Stages 2-4: Read `maker_intern` from workflow.md (missing or none = parent is Maker).
|
|
40
|
+
3. Stages 2-4: Read `maker_intern` from workflow.md (missing or none = parent is Maker). Do not type a model name. If intern is set, confirm it came from this host's list (`/models` if that command exists). If the list command is missing or the id is not on it, parent is Maker; say intern INVOCATION_UNAVAILABLE. Do not add a model key or HTTP client. Intern cannot skip verification, Devil's Advocate, or Judge. Bugs: red repro first (`core/root-cause-analysis.md`). Features: TDD at named seams (`policies/tdd-policy.md`): one red test per AC row. Surgical diff.
|
|
41
41
|
4. Stage 5: run commands from `.ai-engineering-loop/verification.md`. Keep command, exit code, stdout, test counts. Vague "seems green" is invalid. Write `.ai-engineering-loop/tasks/claimed-vs-reality.md` (AC, Claimed, Reality from command log). Do not spawn Devil's Advocate if the file is missing or any Claimed row lacks Reality.
|
|
42
42
|
5. Write artifacts, then spawn. Before Devil's Advocate:
|
|
43
43
|
- Write `git diff` to a file (for example `.ai-engineering-loop/tasks/current.diff`).
|
|
@@ -21,7 +21,7 @@ Canonical mode ids: `TRUE_INDEPENDENT_AGENT`, `ISOLATED_AGENT_INSTANCE`, `FRESH_
|
|
|
21
21
|
|
|
22
22
|
- `init` / `status` / `refresh` / `sync-hosts` / `generate-adapter` / `generate-workflow`: run `npx ai-engineering-loop <command>` in the repo. Do not commit unless asked.
|
|
23
23
|
- `generate-adapter`: load skill `generate-adapter` if present. Grill Q1-Q5. Then write `.ai-engineering-loop/adapter.md`. Do not start Maker.
|
|
24
|
-
- `generate-workflow`: load skill `generate-workflow` if present. Grill Q1-Q6. Then write `.ai-engineering-loop/workflow.md` and empty `lessons.md` if missing. Do not start Maker.
|
|
24
|
+
- `generate-workflow`: load skill `generate-workflow` if present. Grill Q1-Q6. Q6 Maker intern: if `/models` exists in this session, use it and show numbered options; else only `none`. Do not type a model name. Then write `.ai-engineering-loop/workflow.md` and empty `lessons.md` if missing. Do not start Maker.
|
|
25
25
|
- Any other argument: full loop for that task.
|
|
26
26
|
|
|
27
27
|
## Loop
|
|
@@ -30,7 +30,7 @@ Compact map (not a second OS): Specify (stages 0-1), Make (stages 2-4), Review (
|
|
|
30
30
|
|
|
31
31
|
1. Stage 0: `npx ai-engineering-loop sync-hosts` then `npx ai-engineering-loop status` (init or refresh if missing or stale). Read `.ai-engineering-loop/glossary.md`. Read `.ai-engineering-loop/lessons.md` and `.ai-engineering-loop/workflow.md` if they exist. Follow workflow.md hooks (`before_grill`, `after_freeze`, `after_pass`). Do not skip Goal Contract, verification, Devil's Advocate, or Judge even if workflow.md asks. If workflow.md is missing, run the default 8-stage loop (no extra hooks). If sync-hosts copied files, tell the user a new session is needed for updated skill text; keep going with this session.
|
|
32
32
|
2. Stage 1: Goal Contract (`core/goal-contract.md`). If the user asks for ideas, list a short menu and wait; do not implement. If the task is ambiguous and the user can answer, grill first (`core/grill-policy.md`): design tree, recommended answers, do not ask look-up facts. Skip grill if the contract is already frozen or the user waived it. On business-logic change, and always on `adapter_type: dot`, grill includes blast radius: lifecycle sketch, four pillars (state, sibling, approval, queues), ASCII picture. Load `task-impact-inquiry` if present. Do not run a second interview. Passing unit tests are not isolation proof. Chat agreement is not freeze: every user-visible decision must be a numbered AC in the Goal Contract file. Freeze before any production edit. Name test seams. Use glossary terms. AC is a failure table (happy, empty/omit, boundary, sibling, error). One red test per AC row. Do not freeze sunny-path-only. If the user prompt has no numbered AC, draft `.ai-engineering-loop/tasks/goal-contract.md` with a failure table, show it, wait for freeze. Do not start Maker.
|
|
33
|
-
3. Stages 2-4: Read `maker_intern` from workflow.md (missing or none = parent is Maker).
|
|
33
|
+
3. Stages 2-4: Read `maker_intern` from workflow.md (missing or none = parent is Maker). Do not type a model name. If intern is set, confirm it came from this host's list (`/models` if that command exists). If the list command is missing or the id is not on it, parent is Maker; say intern INVOCATION_UNAVAILABLE. Do not add HTTP clients or API keys. Intern cannot skip verification, Devil's Advocate, or Judge. After intern returns, parent runs Stage 5. Bugs: red repro first (`core/root-cause-analysis.md`). Features: TDD at named seams (`policies/tdd-policy.md`): one red test per AC row. Surgical diff.
|
|
34
34
|
4. Stage 5: run commands from `.ai-engineering-loop/verification.md`. Keep command, exit code, stdout, test counts. Vague "seems green" is invalid. Write `.ai-engineering-loop/tasks/claimed-vs-reality.md` (AC, Claimed, Reality from command log). Do not spawn Devil's Advocate if the file is missing or any Claimed row lacks Reality.
|
|
35
35
|
5. Write artifacts, then spawn. Before Devil's Advocate:
|
|
36
36
|
- Write `git diff` to a file (for example `.ai-engineering-loop/tasks/current.diff`).
|
|
@@ -40,7 +40,7 @@ Optional fallback if `devil-advocate` / `judge` types are not registered: `subag
|
|
|
40
40
|
|
|
41
41
|
### `/ai-engineering-loop init|status|refresh|sync-hosts|generate-adapter|generate-workflow`
|
|
42
42
|
|
|
43
|
-
Run `npx ai-engineering-loop <command>` in the target repo. Do not commit unless the user asks. `sync-hosts` copies this package's skills/agents/commands into `~/.claude`, `~/.grok`, `~/.gemini`, and `~/.agents` for hosts that already exist. `generate-adapter`: load skill `generate-adapter` if present. Grill Q1-Q5. Then write `.ai-engineering-loop/adapter.md`. Do not start Maker. `generate-workflow`: load skill `generate-workflow` if present. Grill Q1-Q6. Then write `.ai-engineering-loop/workflow.md` and empty `lessons.md` if missing. Do not start Maker.
|
|
43
|
+
Run `npx ai-engineering-loop <command>` in the target repo. Do not commit unless the user asks. `sync-hosts` copies this package's skills/agents/commands into `~/.claude`, `~/.grok`, `~/.gemini`, and `~/.agents` for hosts that already exist. `generate-adapter`: load skill `generate-adapter` if present. Grill Q1-Q5. Then write `.ai-engineering-loop/adapter.md`. Do not start Maker. `generate-workflow`: load skill `generate-workflow` if present. Grill Q1-Q6. Q6 Maker intern: run `grok models` (or `/models` if that slash command exists here), drop grok-imagine-* and video, show numbered options plus none. Do not type a model name. Then write `.ai-engineering-loop/workflow.md` and empty `lessons.md` if missing. Do not start Maker.
|
|
44
44
|
|
|
45
45
|
### `/ai-engineering-loop [task]`
|
|
46
46
|
|
|
@@ -48,7 +48,7 @@ Compact map (not a second OS): Specify (stages 0-1), Make (stages 2-4), Review (
|
|
|
48
48
|
|
|
49
49
|
1. Stage 0: `npx ai-engineering-loop sync-hosts` then `npx ai-engineering-loop status` (init/refresh if missing or stale). Read `.ai-engineering-loop/glossary.md`. Read `.ai-engineering-loop/lessons.md` and `.ai-engineering-loop/workflow.md` if they exist. Follow workflow.md hooks (`before_grill`, `after_freeze`, `after_pass`). Do not skip Goal Contract, verification, Devil's Advocate, or Judge even if workflow.md asks. If workflow.md is missing, run the default 8-stage loop (no extra hooks). If sync-hosts copied files, tell the user a new session is needed for updated skill text; keep going with this session.
|
|
50
50
|
2. Stage 1: Goal Contract (`core/goal-contract.md`). If the user asks for ideas, list a short menu and wait; do not implement. If the task is ambiguous and the user can answer, grill first (`core/grill-policy.md`): design tree, recommended answers, do not ask look-up facts. Skip grill if the contract is already frozen or the user waived it. On business-logic change, and always on `adapter_type: dot`, grill includes blast radius: lifecycle sketch, four pillars (state, sibling, approval, queues), ASCII picture. Load `task-impact-inquiry` if present. Do not run a second interview. Passing unit tests are not isolation proof. Chat agreement is not freeze: every user-visible decision must be a numbered AC in the Goal Contract file. Freeze before any production edit. Name test seams. Use glossary terms. AC is a failure table (happy, empty/omit, boundary, sibling, error). One red test per AC row. Do not freeze sunny-path-only. If the user prompt has no numbered AC, draft `.ai-engineering-loop/tasks/goal-contract.md` with a failure table, show it, wait for freeze. Do not start Maker.
|
|
51
|
-
3. Stages 2–4: Read `maker_intern` from workflow.md (missing or none = parent is Maker). If a label is set, write `.ai-engineering-loop/tasks/maker-brief.md` and spawn that intern as a sibling (`background: false`, wait). Pass a model key only if that key exists on the spawn schema. Do not invent keys, HTTP clients, or
|
|
51
|
+
3. Stages 2–4: Read `maker_intern` from workflow.md (missing or none = parent is Maker). Do not type a model name. If a label is set, run `grok models` and confirm the id is in the coding list (not grok-imagine-*). If missing, parent is Maker; say intern INVOCATION_UNAVAILABLE. Otherwise write `.ai-engineering-loop/tasks/maker-brief.md` and spawn that intern as a sibling (`background: false`, wait). Pass a model key only if that key exists on the spawn schema. Do not invent keys, HTTP clients, or custom endpoints. Intern must not spawn DA or Judge (depth 1). After intern returns, parent runs Stage 5 then DA/Judge. Intern cannot skip verification, Devil's Advocate, or Judge. Bugs: red repro first (`core/root-cause-analysis.md`). Features: TDD at named seams (`policies/tdd-policy.md`): one red test per AC row. Surgical diff.
|
|
52
52
|
4. Stage 5: run verification from `.ai-engineering-loop/verification.md`. Keep command, exit code, stdout, test counts. Vague "seems green" is invalid. Write `.ai-engineering-loop/tasks/claimed-vs-reality.md` (AC, Claimed, Reality from command log). Do not spawn Devil's Advocate if the file is missing or any Claimed row lacks Reality.
|
|
53
53
|
5. Write artifacts to disk so children do not need parent chat:
|
|
54
54
|
- Goal Contract path
|
package/README.md
CHANGED
|
@@ -6,7 +6,7 @@
|
|
|
6
6
|
[](https://opensource.org/licenses/MIT)
|
|
7
7
|
[](https://github.com/egagofur/ai-engineering-loop/pulls)
|
|
8
8
|
[](https://github.com/egagofur/ai-engineering-loop)
|
|
9
|
-
[](https://github.com/egagofur/ai-engineering-loop/releases)
|
|
10
10
|
|
|
11
11
|
**A Reusable, Framework-Agnostic AI Engineering Operating System for Autonomous Coding Agents**
|
|
12
12
|
|
|
@@ -67,7 +67,7 @@ The 8-stage loop stays one OS. These techniques sit **inside** existing stages (
|
|
|
67
67
|
| 1 | Grill until the design-tree frontier is empty, then freeze the Goal Contract. Idea requests: menu, wait, then grill the pick. Chat `setuju` is not freeze; user-visible decisions must be numbered AC in the contract file. AC is a **failure table** (happy, empty/omit, boundary, sibling, error), not sunny path only. **Sloppy prompt** (no numbered AC): draft the Goal Contract file, show it, wait for freeze — do not Maker. Business-logic change: **blast radius** (lifecycle sketch, four pillars, ASCII picture) via `task-impact-inquiry` inside grill — not a second loop. Passing unit tests are not isolation proof. | `core/grill-policy.md` |
|
|
68
68
|
| 1 | Ubiquitous language in `.ai-engineering-loop/glossary.md`; load-bearing choices in `.ai-engineering-loop/adrs/` | `core/repo-config-schema.md` |
|
|
69
69
|
| 2 | Bugs: red repro → minimise → hypothesise → instrument → fix | `core/root-cause-analysis.md` |
|
|
70
|
-
| 4 | Optional **Maker intern**:
|
|
70
|
+
| 4 | Optional **Maker intern**: overlay `maker_intern`. Default `none`. Pick from the host catalog (`grok models` or `/models` if that command exists; numbered options). Do not type a model name. No custom endpoint. Imagine/video models are not intern picks. Unknown id → parent Maker (`INVOCATION_UNAVAILABLE`). Devil's Advocate and Judge stay on the parent. | `.ai-engineering-loop/workflow.md` |
|
|
71
71
|
| 4–5 | Red-green at named **seams**; failure table (not happy path only); coverage is a map; no grep/tautology | `policies/tdd-policy.md` |
|
|
72
72
|
| 5 | **Claimed vs Reality** table before DA. Missing file or empty Reality blocks Devil's Advocate. "Seems green" is not Reality. | `core/verification-loop.md` |
|
|
73
73
|
| 6–7 | Spec vs Standards reported separately. Standards BLOCKER/HIGH iterate only when `hardConvention` is true | `policies/finding-policy.md` |
|
|
@@ -71,13 +71,18 @@ Recommended: keep AEL default
|
|
|
71
71
|
Q5 - Skip generate-adapter when adapter.md already exists: yes | no
|
|
72
72
|
Recommended: yes
|
|
73
73
|
|
|
74
|
-
Q6 - Maker intern:
|
|
74
|
+
Q6 - Maker intern: pick from the host catalog. Do not type a model name.
|
|
75
|
+
Look up models with this host's list command:
|
|
76
|
+
- Grok CLI: `grok models`
|
|
77
|
+
- Many agent CLIs (Codex and others): `/models` if that slash command exists in this session
|
|
78
|
+
Drop image/video/imagine ids. Show numbered options plus 0) none.
|
|
79
|
+
If no list command exists here: only 0) none.
|
|
75
80
|
Recommended: none
|
|
76
81
|
```
|
|
77
82
|
|
|
78
83
|
If they name a tool or step, write that name into the matching hook. Do not invent Figma/Jira/Slack unless they said so.
|
|
79
84
|
|
|
80
|
-
Q6
|
|
85
|
+
Q6 writes `maker_intern` from the numbered pick only. Do not type a model name. Do not use a custom endpoint. Do not paste API keys or URLs. Default none = parent is Maker.
|
|
81
86
|
|
|
82
87
|
### 3. Write
|
|
83
88
|
|
|
@@ -132,3 +137,5 @@ Next: /ai-engineering-loop for product work. Stage 0 reads these files.
|
|
|
132
137
|
- Dumping chat into lessons
|
|
133
138
|
- Mermaid or LaTeX
|
|
134
139
|
- Running the 8-stage product loop inside this skill
|
|
140
|
+
- Typing a model name for Q6
|
|
141
|
+
- Custom intern endpoints
|
|
@@ -34,7 +34,7 @@ const {
|
|
|
34
34
|
lessonsMarkdown
|
|
35
35
|
} = require('../lib/generate-workflow.js');
|
|
36
36
|
|
|
37
|
-
const VERSION = '1.0.
|
|
37
|
+
const VERSION = '1.0.19';
|
|
38
38
|
const CWD = process.cwd();
|
|
39
39
|
const CONTEXT_DIR = path.join(CWD, '.ai-engineering-loop');
|
|
40
40
|
|
|
@@ -288,7 +288,7 @@ function generateContextFiles(rootDir, discovery, trigger = 'init', impact = 'IN
|
|
|
288
288
|
|
|
289
289
|
// 0. metadata.json (Baseline)
|
|
290
290
|
const metadataJson = {
|
|
291
|
-
contextVersion: '1.0.
|
|
291
|
+
contextVersion: '1.0.19',
|
|
292
292
|
generatedAt: new Date().toISOString(),
|
|
293
293
|
repositoryRevision: currentRevision,
|
|
294
294
|
projectProfile: discovery.profile,
|
|
@@ -83,7 +83,7 @@ Maintains lightweight state for instant drift detection:
|
|
|
83
83
|
|
|
84
84
|
### 10. `workflow.md` — Loop overlay (optional)
|
|
85
85
|
- Hooks around the 8-stage OS: `before_grill`, `after_freeze`, `after_pass`.
|
|
86
|
-
- Optional `maker_intern` (default `none`).
|
|
86
|
+
- Optional `maker_intern` (default `none`). Pick from this host's catalog (`grok models` or `/models`). Do not type a guessed slug. Not a key or URL.
|
|
87
87
|
- Cannot skip Goal Contract, verification, Devil's Advocate, or Judge.
|
|
88
88
|
- Missing file means default 8-stage loop (no extra hooks, parent is Maker).
|
|
89
89
|
- Generate with `npx ai-engineering-loop generate-workflow` (grill Q1–Q6) or `--write`.
|
package/lib/generate-workflow.js
CHANGED
|
@@ -90,7 +90,7 @@ This file adds hooks around the AI Engineering Loop. It does not replace the 8-s
|
|
|
90
90
|
## Maker intern
|
|
91
91
|
- **maker_intern**: ${intern}
|
|
92
92
|
|
|
93
|
-
Default \`none\` = parent is Maker.
|
|
93
|
+
Default \`none\` = parent is Maker. Pick \`maker_intern\` from this host's catalog (\`grok models\` or \`/models\`). Do not type a guessed slug. AEL does not store intern API keys. Devil's Advocate and Judge stay on the parent. Intern cannot skip them.
|
|
94
94
|
|
|
95
95
|
## Optional skips
|
|
96
96
|
${skipLine}
|
|
@@ -202,6 +202,7 @@ function formatGenerateWorkflowReport({ version, wrote } = {}) {
|
|
|
202
202
|
'This is not a second OS. Required: Goal Contract, verification, Devil\'s Advocate, Judge.',
|
|
203
203
|
'Files: .ai-engineering-loop/workflow.md and lessons.md',
|
|
204
204
|
'Next: load skill generate-workflow. Ask Q1-Q6. Wait.',
|
|
205
|
+
'Q6: pick from host catalog (grok models or /models). Do not type a model name. Recommended: none',
|
|
205
206
|
'Headless: npx ai-engineering-loop generate-workflow --write'
|
|
206
207
|
];
|
|
207
208
|
if (wrote) {
|
|
@@ -0,0 +1,53 @@
|
|
|
1
|
+
'use strict';
|
|
2
|
+
|
|
3
|
+
const HOST_MODEL_LIST_COMMANDS = ['grok models', '/models'];
|
|
4
|
+
|
|
5
|
+
function parseGrokModelsOutput(text) {
|
|
6
|
+
const models = [];
|
|
7
|
+
let defaultModel = '';
|
|
8
|
+
const raw = String(text || '');
|
|
9
|
+
const def = raw.match(/Default model:\s*(\S+)/i);
|
|
10
|
+
if (def) defaultModel = def[1];
|
|
11
|
+
for (const line of raw.split('\n')) {
|
|
12
|
+
const match = line.match(/^\s*[-*]\s+(\S+)/);
|
|
13
|
+
if (!match) continue;
|
|
14
|
+
const id = match[1].replace(/\(default\)/i, '').trim();
|
|
15
|
+
if (id && !models.includes(id)) models.push(id);
|
|
16
|
+
}
|
|
17
|
+
return { defaultModel, models };
|
|
18
|
+
}
|
|
19
|
+
|
|
20
|
+
function isCodingInternModel(id) {
|
|
21
|
+
const s = String(id || '').toLowerCase();
|
|
22
|
+
if (!s) return false;
|
|
23
|
+
if (/imagine/.test(s)) return false;
|
|
24
|
+
if (/(^|-)video($|-)/.test(s)) return false;
|
|
25
|
+
return true;
|
|
26
|
+
}
|
|
27
|
+
|
|
28
|
+
function codingInternModels(models) {
|
|
29
|
+
return (models || []).filter(isCodingInternModel);
|
|
30
|
+
}
|
|
31
|
+
|
|
32
|
+
function formatInternPickList(models) {
|
|
33
|
+
const lines = ['0) none (Recommended)'];
|
|
34
|
+
codingInternModels(models).forEach((id, i) => {
|
|
35
|
+
lines.push(`${i + 1}) ${id}`);
|
|
36
|
+
});
|
|
37
|
+
return lines.join('\n');
|
|
38
|
+
}
|
|
39
|
+
|
|
40
|
+
function internInCatalog(id, models) {
|
|
41
|
+
const s = String(id || '').trim();
|
|
42
|
+
if (!s || /^none$/i.test(s)) return true;
|
|
43
|
+
return codingInternModels(models).includes(s);
|
|
44
|
+
}
|
|
45
|
+
|
|
46
|
+
module.exports = {
|
|
47
|
+
HOST_MODEL_LIST_COMMANDS,
|
|
48
|
+
parseGrokModelsOutput,
|
|
49
|
+
isCodingInternModel,
|
|
50
|
+
codingInternModels,
|
|
51
|
+
formatInternPickList,
|
|
52
|
+
internInCatalog
|
|
53
|
+
};
|
package/package.json
CHANGED
|
@@ -16,7 +16,7 @@ This file adds hooks around the AI Engineering Loop. It does not replace the 8-s
|
|
|
16
16
|
## Maker intern
|
|
17
17
|
- **maker_intern**: none
|
|
18
18
|
|
|
19
|
-
Default `none` = parent is Maker.
|
|
19
|
+
Default `none` = parent is Maker. Pick `maker_intern` from this host's catalog (`grok models` or `/models`). Do not type a guessed slug. AEL does not store intern API keys. Devil's Advocate and Judge stay on the parent. Intern cannot skip them.
|
|
20
20
|
|
|
21
21
|
## Optional skips
|
|
22
22
|
none
|
|
@@ -97,6 +97,7 @@ test('CLI generate-workflow without --write prints grill protocol', () => {
|
|
|
97
97
|
const out = execFileSync('node', [CLI, 'generate-workflow'], { cwd: dir, encoding: 'utf8' });
|
|
98
98
|
assert.match(out, /generate-workflow/);
|
|
99
99
|
assert.match(out, /Q1-Q6/);
|
|
100
|
+
assert.match(out, /Do not type a model name/);
|
|
100
101
|
assert.ok(!fs.existsSync(path.join(dir, '.ai-engineering-loop', 'workflow.md')));
|
|
101
102
|
});
|
|
102
103
|
|
|
@@ -130,8 +131,8 @@ test('AC-1 default overlay maker_intern is none', () => {
|
|
|
130
131
|
const parsed = parseWorkflowFile(dir);
|
|
131
132
|
assert.match(workflow, /\*\*maker_intern\*\*: none/);
|
|
132
133
|
assert.strictEqual(parsed.makerIntern, 'none');
|
|
133
|
-
assert.match(workflowMarkdown(), /
|
|
134
|
-
assert.match(workflowMarkdown(), /
|
|
134
|
+
assert.match(workflowMarkdown(), /host's catalog/);
|
|
135
|
+
assert.match(workflowMarkdown(), /Do not type a guessed slug/);
|
|
135
136
|
});
|
|
136
137
|
|
|
137
138
|
test('AC-2 missing workflow.md makerIntern is none', () => {
|
|
@@ -0,0 +1,72 @@
|
|
|
1
|
+
'use strict';
|
|
2
|
+
|
|
3
|
+
const test = require('node:test');
|
|
4
|
+
const assert = require('node:assert');
|
|
5
|
+
const {
|
|
6
|
+
HOST_MODEL_LIST_COMMANDS,
|
|
7
|
+
parseGrokModelsOutput,
|
|
8
|
+
codingInternModels,
|
|
9
|
+
formatInternPickList,
|
|
10
|
+
internInCatalog
|
|
11
|
+
} = require('../lib/intern-catalog.js');
|
|
12
|
+
|
|
13
|
+
const GROK_MODELS_FIXTURE = `You are logged in with grok.com.
|
|
14
|
+
|
|
15
|
+
Default model: grok-4.6
|
|
16
|
+
|
|
17
|
+
Available models:
|
|
18
|
+
- grok-4.20-0309-non-reasoning
|
|
19
|
+
- grok-4.20-0309-reasoning
|
|
20
|
+
- grok-4.20-multi-agent-0309
|
|
21
|
+
- grok-4.3
|
|
22
|
+
- grok-4.5
|
|
23
|
+
* grok-4.6 (default)
|
|
24
|
+
- grok-build-0.1
|
|
25
|
+
- grok-imagine-image
|
|
26
|
+
- grok-imagine-image-2.0
|
|
27
|
+
- grok-imagine-image-quality
|
|
28
|
+
- grok-imagine-video
|
|
29
|
+
- grok-imagine-video-1.5
|
|
30
|
+
`;
|
|
31
|
+
|
|
32
|
+
test('host list commands include grok models and /models', () => {
|
|
33
|
+
assert.ok(HOST_MODEL_LIST_COMMANDS.includes('grok models'));
|
|
34
|
+
assert.ok(HOST_MODEL_LIST_COMMANDS.includes('/models'));
|
|
35
|
+
});
|
|
36
|
+
|
|
37
|
+
test('AC-1 parse grok models into ids plus default', () => {
|
|
38
|
+
const parsed = parseGrokModelsOutput(GROK_MODELS_FIXTURE);
|
|
39
|
+
assert.strictEqual(parsed.defaultModel, 'grok-4.6');
|
|
40
|
+
assert.ok(parsed.models.includes('grok-build-0.1'));
|
|
41
|
+
assert.ok(parsed.models.includes('grok-4.6'));
|
|
42
|
+
});
|
|
43
|
+
|
|
44
|
+
test('AC-2 empty catalog pick list is only none', () => {
|
|
45
|
+
assert.strictEqual(formatInternPickList([]), '0) none (Recommended)');
|
|
46
|
+
assert.strictEqual(internInCatalog('none', []), true);
|
|
47
|
+
assert.strictEqual(internInCatalog('', []), true);
|
|
48
|
+
});
|
|
49
|
+
|
|
50
|
+
test('AC-3 Claude has no grok catalog so only none is in-catalog', () => {
|
|
51
|
+
assert.strictEqual(internInCatalog('gemini-flash', []), false);
|
|
52
|
+
assert.strictEqual(internInCatalog('grok-build-0.1', []), false);
|
|
53
|
+
});
|
|
54
|
+
|
|
55
|
+
test('AC-4 imagine and video models are not coding intern picks', () => {
|
|
56
|
+
const { models } = parseGrokModelsOutput(GROK_MODELS_FIXTURE);
|
|
57
|
+
const coding = codingInternModels(models);
|
|
58
|
+
assert.ok(coding.includes('grok-build-0.1'));
|
|
59
|
+
assert.ok(!coding.includes('grok-imagine-image'));
|
|
60
|
+
assert.ok(!coding.includes('grok-imagine-video'));
|
|
61
|
+
const list = formatInternPickList(models);
|
|
62
|
+
assert.match(list, /0\) none \(Recommended\)/);
|
|
63
|
+
assert.match(list, /grok-build-0.1/);
|
|
64
|
+
assert.doesNotMatch(list, /imagine/);
|
|
65
|
+
});
|
|
66
|
+
|
|
67
|
+
test('AC-5 unknown slug is not in catalog', () => {
|
|
68
|
+
const { models } = parseGrokModelsOutput(GROK_MODELS_FIXTURE);
|
|
69
|
+
assert.strictEqual(internInCatalog('grok-build-0.1', models), true);
|
|
70
|
+
assert.strictEqual(internInCatalog('not-a-real-model', models), false);
|
|
71
|
+
assert.strictEqual(internInCatalog('sk-abc', models), false);
|
|
72
|
+
});
|
|
@@ -222,7 +222,10 @@ test('generate-workflow skill is Claude-safe and host skills read the overlay',
|
|
|
222
222
|
assert.match(skill, /maker_intern/);
|
|
223
223
|
assert.match(skill, /Do not start Maker/);
|
|
224
224
|
assert.match(skill, /lessons\.md/);
|
|
225
|
-
assert.match(skill, /
|
|
225
|
+
assert.match(skill, /grok models/);
|
|
226
|
+
assert.match(skill, /\/models/);
|
|
227
|
+
assert.match(skill, /Do not type a model name/);
|
|
228
|
+
assert.doesNotMatch(skill, /any host-native label \(gemini-flash/);
|
|
226
229
|
for (const rel of [
|
|
227
230
|
'.claude/skills/ai-engineering-loop/SKILL.md',
|
|
228
231
|
'.grok/skills/ai-engineering-loop/SKILL.md',
|
|
@@ -236,6 +239,7 @@ test('generate-workflow skill is Claude-safe and host skills read the overlay',
|
|
|
236
239
|
assert.match(text, /generate-workflow/, rel);
|
|
237
240
|
assert.match(text, /maker_intern/, rel);
|
|
238
241
|
assert.match(text, /INVOCATION_UNAVAILABLE/, rel);
|
|
242
|
+
assert.match(text, /Do not type a model name/, rel);
|
|
239
243
|
}
|
|
240
244
|
});
|
|
241
245
|
|