@sreetej510/pi-shipd-checks 0.6.1 → 0.7.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (3) hide show
  1. package/README.md +17 -3
  2. package/dist/index.js +65 -61
  3. package/package.json +5 -2
package/README.md CHANGED
@@ -30,9 +30,21 @@ The agent-callable `analyze_task_tests` tool provides the separate test-analysis
30
30
  - `mode: "solution-audit"` runs one exhaustive Auditor over the implementation, using the
31
31
  `# Gaps in solution` rules and the same in-memory changed-code diff.
32
32
 
33
- All modes are read-only. Gap analysis uses two agents: a gap finder followed by a fairness reviewer.
34
- Each audit uses one agent to keep the tool affordable. Invoke the tool only when the user asks, never in
35
- parallel, and run repeated requests sequentially after applying each result.
33
+ The agent-callable `submit_shipd` tool runs `create_patches.sh` in the current working directory, reads
34
+ `agent_prompt.md`, `test.patch`, and `solution.patch`, fills the authenticated Shipd draft fields, starts the Test
35
+ Quality and then Solution Quality reruns in one browser tab, waits for both jobs, and returns only the useful report data:
36
+ `details.testQuality.coverageSuggestions`, `details.testQuality.tests` filtered to items whose `fairness` is exactly
37
+ `"Not fair"`, and the complete `details.solutionQuality.evaluation` block. Its compact UI is labeled `Quality Checks`,
38
+ shows live elapsed time, and only displays unfair-test count, suggestion count, code-quality score, and
39
+ comprehensiveness score. It takes no parameters. Set the session's
40
+ job link with `/shipd:link <job-link>`; the link is stored in that chat session only. It uses one fresh headless
41
+ browser tab per invocation and does not click the final orange challenge-submit button. Authentication comes from
42
+ `SHIPD_STORAGE_STATE` or the saved state created by `scripts/playwright-auth-smoke.mjs`.
43
+
44
+ All analysis modes are read-only. Gap analysis uses two agents: a gap finder followed by a fairness reviewer.
45
+ Each audit uses one agent to keep the tool affordable. Invoke analysis only when the user asks, never in
46
+ parallel, and run repeated requests sequentially after applying each result. `submit_shipd` consumes Shipd tokens;
47
+ do not run overlapping invocations for the same challenge.
36
48
 
37
49
  ## Commands
38
50
 
@@ -43,6 +55,7 @@ parallel, and run repeated requests sequentially after applying each result.
43
55
  | `/checks` | Open a menu with config and solver-gap-finder options |
44
56
  | `/checks --config` | Configure reviewer, solver, gap-analysis, and Auditor models |
45
57
  | `/checks --solver-gap-finder` | Run several solver agents TDD-style against `agent_prompt.md` + `test.patch`, then compare their solutions to the real solution to find gaps |
58
+ | `/shipd:link <url>` | Save the Shipd job link for the current chat session |
46
59
  | `/analyze:on` | Enable the agent-callable test-analysis tool for the current project |
47
60
  | `/analyze:off` | Disable the agent-callable test-analysis tool for the current project |
48
61
 
@@ -185,6 +198,7 @@ Or, for local development, point at the entry point directly:
185
198
  | File | Responsibility |
186
199
  |---|---|
187
200
  | `src/index.ts` | Extension entry point: message renderer, cancel shortcut, command registration |
201
+ | `src/submit.ts` | `submit_shipd`: Playwright draft filling, sequential quality checks, polling, and report extraction |
188
202
  | `src/command.ts` | The `/checks` command: argument parsing, `--config` flow, run orchestration |
189
203
  | `src/agents.ts` | Spawns and races the gap-finder/reviewer/solver agent sessions |
190
204
  | `src/solvergap.ts` | Local solver result persistence and comparison artifacts |