@sreetej510/pi-shipd-checks 0.6.1 → 0.7.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +17 -3
- package/dist/index.js +65 -61
- package/package.json +5 -2
package/README.md
CHANGED
|
@@ -30,9 +30,21 @@ The agent-callable `analyze_task_tests` tool provides the separate test-analysis
|
|
|
30
30
|
- `mode: "solution-audit"` runs one exhaustive Auditor over the implementation, using the
|
|
31
31
|
`# Gaps in solution` rules and the same in-memory changed-code diff.
|
|
32
32
|
|
|
33
|
-
|
|
34
|
-
|
|
35
|
-
|
|
33
|
+
The agent-callable `submit_shipd` tool runs `create_patches.sh` in the current working directory, reads
|
|
34
|
+
`agent_prompt.md`, `test.patch`, and `solution.patch`, fills the authenticated Shipd draft fields, starts the Test
|
|
35
|
+
Quality and then Solution Quality reruns in one browser tab, waits for both jobs, and returns only the useful report data:
|
|
36
|
+
`details.testQuality.coverageSuggestions`, `details.testQuality.tests` filtered to items whose `fairness` is exactly
|
|
37
|
+
`"Not fair"`, and the complete `details.solutionQuality.evaluation` block. Its compact UI is labeled `Quality Checks`,
|
|
38
|
+
shows live elapsed time, and only displays unfair-test count, suggestion count, code-quality score, and
|
|
39
|
+
comprehensiveness score. It takes no parameters. Set the session's
|
|
40
|
+
job link with `/shipd:link <job-link>`; the link is stored in that chat session only. It uses one fresh headless
|
|
41
|
+
browser tab per invocation and does not click the final orange challenge-submit button. Authentication comes from
|
|
42
|
+
`SHIPD_STORAGE_STATE` or the saved state created by `scripts/playwright-auth-smoke.mjs`.
|
|
43
|
+
|
|
44
|
+
All analysis modes are read-only. Gap analysis uses two agents: a gap finder followed by a fairness reviewer.
|
|
45
|
+
Each audit uses one agent to keep the tool affordable. Invoke analysis only when the user asks, never in
|
|
46
|
+
parallel, and run repeated requests sequentially after applying each result. `submit_shipd` consumes Shipd tokens;
|
|
47
|
+
do not run overlapping invocations for the same challenge.
|
|
36
48
|
|
|
37
49
|
## Commands
|
|
38
50
|
|
|
@@ -43,6 +55,7 @@ parallel, and run repeated requests sequentially after applying each result.
|
|
|
43
55
|
| `/checks` | Open a menu with config and solver-gap-finder options |
|
|
44
56
|
| `/checks --config` | Configure reviewer, solver, gap-analysis, and Auditor models |
|
|
45
57
|
| `/checks --solver-gap-finder` | Run several solver agents TDD-style against `agent_prompt.md` + `test.patch`, then compare their solutions to the real solution to find gaps |
|
|
58
|
+
| `/shipd:link <url>` | Save the Shipd job link for the current chat session |
|
|
46
59
|
| `/analyze:on` | Enable the agent-callable test-analysis tool for the current project |
|
|
47
60
|
| `/analyze:off` | Disable the agent-callable test-analysis tool for the current project |
|
|
48
61
|
|
|
@@ -185,6 +198,7 @@ Or, for local development, point at the entry point directly:
|
|
|
185
198
|
| File | Responsibility |
|
|
186
199
|
|---|---|
|
|
187
200
|
| `src/index.ts` | Extension entry point: message renderer, cancel shortcut, command registration |
|
|
201
|
+
| `src/submit.ts` | `submit_shipd`: Playwright draft filling, sequential quality checks, polling, and report extraction |
|
|
188
202
|
| `src/command.ts` | The `/checks` command: argument parsing, `--config` flow, run orchestration |
|
|
189
203
|
| `src/agents.ts` | Spawns and races the gap-finder/reviewer/solver agent sessions |
|
|
190
204
|
| `src/solvergap.ts` | Local solver result persistence and comparison artifacts |
|