form-tester 0.4.3 → 0.5.1

package/.claude/skills/form-tester/INSTRUCTIONS.md

@@ -45,6 +45,7 @@ Notes:
 - Use `--help` or `-h` to print the command list without starting the prompt.
 - Playwright CLI commands are available from this skill when needed.
 - IMPORTANT: All screenshots taken during a test run MUST use `--full-page` to capture the entire page, not just the viewport. This applies to every screenshot command: `playwright-cli screenshot --filename "..." --full-page`
+- IMPORTANT: Take a full-page screenshot EVERY TIME the page changes. This includes: after clicking any action button (Neste, Forrige, Send inn, etc.), after a step/page transition, after form validation errors appear, after modals open, and after submission. Name screenshots descriptively (e.g., step1_filled.png, step2_before_submit.png, submit_result.png).
 
 Test flow (when /test is triggered):
 IMPORTANT: Each prompt below MUST be asked as a separate message to the user. Wait for the user's response before proceeding to the next step. Do NOT combine multiple prompts into one message.
@@ -63,7 +64,8 @@ Dokumenter verification (only when modal confirms storage):
 1. Navigate to `/dokumenter?pnr={PNR}` and select the same person used during form fill.
 2. The document list loads sorted newest first. The first entry should match the form title.
 3. Click "Se detaljer" on the first document, then click "Åpne dokumentet".
-4. If the document opens in a new tab as HTML: switch to that tab, take a full-page screenshot (`--full-page`), save snapshot and raw HTML.
-5. If the document opens as a PDF viewer: download the PDF instead of screenshotting. Use `playwright-cli pdf --filename "$OUTPUT_DIR/document.pdf"` or save it via the download.
-6. If the document does NOT open (XML format, no new tab, or other): note the document type in test_results.txt and skip the screenshot/download.
-7. Include the document verification results in test_results.txt (document title, whether it matched the form h1, document type: HTML/PDF/XML).
+4. IMPORTANT - document capture depends on format:
+   - PDF documents: DOWNLOAD the file. Use `playwright-cli pdf --filename "$OUTPUT_DIR/document.pdf"` or save via browser download. Do NOT screenshot PDFs.
+   - HTML documents: Take a FULL-PAGE screenshot of the ENTIRE document (`playwright-cli screenshot --filename "$OUTPUT_DIR/document_screenshot.png" --full-page`). HTML documents cannot be downloaded as files, so the full-page screenshot is the primary artifact. Also save the snapshot and raw HTML.
+   - XML/other formats: Note the document type in test_results.txt and skip capture.
+5. Include the document verification results in test_results.txt (document title, whether it matched the form h1, document type: HTML/PDF/XML).

package/.github/copilot-instructions.md

@@ -62,11 +62,17 @@ When `/test` is triggered:
 
 - Provide a full /skjemautfyller URL. If `pnr` is missing, the CLI will prompt.
 - All screenshots MUST use `--full-page` to capture the entire page.
+- Take a full-page screenshot EVERY TIME the page changes: after clicking action buttons (Neste, Forrige, Send inn), after step/page transitions, after validation errors, after modals, and after submission.
 - Use `/save {label}` to capture additional snapshots into the output folder.
 - If an error modal appears on submit, open DevTools -> Network, retry once, and capture the Correlation ID header.
 
 ## Post-Submit Verification
 
 After submission, read the modal text:
-- If it mentions Dokumenter storage -> navigate to `/dokumenter?pnr={PNR}`, verify the document appears, and capture it (screenshot for HTML, download for PDF).
+- If it mentions Dokumenter storage -> navigate to `/dokumenter?pnr={PNR}`, verify the document appears.
 - If it does NOT mention Dokumenter -> skip verification, note in test_results.txt.
+
+Document capture depends on format:
+- **PDF documents**: download the file (`playwright-cli pdf --filename "..." `). Do NOT screenshot PDFs.
+- **HTML documents**: take a full-page screenshot of the ENTIRE document (`playwright-cli screenshot --filename "..." --full-page`). HTML documents cannot be downloaded, so the screenshot is the primary artifact.
+- **XML/other**: note the type in test_results.txt and skip capture.

package/README.md

@@ -69,6 +69,42 @@ If Copilot doesn't recognize the skill:
 1. Make sure `.claude/skills/form-tester/` exists in your project (run `form-tester install`)
 2. Run `/skills` in the Copilot CLI to reload skills, or restart the session
 
+## Skip permission prompts
+
+By default, AI agents will ask permission for every shell command. To run without interruptions, pre-allow the relevant tools.
+
+### Claude Code
+
+Add to your project's `.claude/settings.local.json` (or global `~/.claude/settings.json`):
+
+```json
+{
+  "permissions": {
+    "allow": [
+      "Skill(form-tester)",
+      "Bash(form-tester:*)",
+      "Bash(playwright-cli:*)"
+    ]
+  }
+}
+```
+
+Or use the Claude Code CLI:
+```bash
+claude config add permissions.allow "Skill(form-tester)"
+claude config add permissions.allow "Bash(form-tester:*)"
+claude config add permissions.allow "Bash(playwright-cli:*)"
+```
+
+### GitHub Copilot
+
+In Copilot CLI, use auto-approve mode:
+```bash
+copilot --auto-approve
+```
+
+Or approve the tool categories when first prompted and select "Always allow".
+
 ## Test Output
 
 Test runs are saved to `output/{form-id}/{timestamp}/` with:
@@ -76,6 +112,13 @@ Test runs are saved to `output/{form-id}/{timestamp}/` with:
 - Screenshots (PNG, full-page)
 - `test_results.txt`
 
+### Dokumenter verification
+
+After form submission, some forms store a copy in Dokumenter. The document type determines how to capture it:
+
+- **PDF documents** — download the file directly (`playwright-cli pdf` or via browser download)
+- **HTML documents** — take a full-page screenshot of the entire document (`playwright-cli screenshot --filename "..." --full-page`). HTML documents cannot be downloaded as-is, so the screenshot is the primary artifact.
+
 ## Update
 
 ```bash

package/form-tester.js

@@ -6,7 +6,7 @@ const { spawn, execSync } = require("child_process");
 
 const CONFIG_PATH = path.join(process.cwd(), "form-tester.config.json");
 const OUTPUT_BASE = path.resolve(process.cwd(), "output");
-const LOCAL_VERSION = "0.4.3";
+const LOCAL_VERSION = "0.5.1";
 const RECOMMENDED_PERSON = "Uromantisk Direktør";
 
 const PERSONAS = [
@@ -880,15 +880,20 @@ async function handleTest(url, config) {
 }
 
 async function handleTestAuto(url, config, flags) {
-  // Resolve PNR
-  const pnr = flags.pnr || config.pnr;
+  const v = flags.verbosity || "normal";
+  const log = (msg) => { if (v !== "silent") console.log(msg); };
+  const verbose = (msg) => { if (v === "verbose") console.log(msg); };
+
+  // Resolve PNR — check URL first, then flag, then config
+  const pnr = extractPnrFromUrl(url) || flags.pnr || config.pnr;
   if (!pnr) {
-    console.error("No PNR available. Pass --pnr <value> or set it in form-tester.config.json");
+    console.error("No PNR available. Pass --pnr <value>, include pnr= in the URL, or set it in form-tester.config.json");
     process.exit(1);
   }
   const fullUrl = extractPnrFromUrl(url) ? url : setPnrOnUrl(url, pnr);
   config.pnr = pnr;
   saveConfig(config);
+  verbose(`URL: ${fullUrl}`);
 
   // Resolve persona
   let personaChoice;
@@ -896,14 +901,14 @@ async function handleTestAuto(url, config, flags) {
   if (personaId) {
     const found = getPersonaById(personaId);
     if (found) {
-      console.log(`Persona: ${found.name} — ${found.description}`);
+      log(`Persona: ${found.name} — ${found.description}`);
       personaChoice = { type: "preset", persona: found };
     } else {
-      console.log(`Unknown persona "${personaId}", using Noen.`);
+      log(`Unknown persona "${personaId}", using Noen.`);
       personaChoice = { type: "noen", persona: null };
     }
   } else {
-    console.log("Persona: Noen — nøytrale svar (auto)");
+    log("Persona: Noen — nøytrale svar (auto)");
     personaChoice = { type: "noen", persona: null };
   }
 
@@ -911,7 +916,7 @@ async function handleTestAuto(url, config, flags) {
   const scenarioChoice = flags.scenario
     ? { type: "custom", description: flags.scenario }
     : { type: "default", description: "Standard test" };
-  console.log(`Scenario: ${scenarioChoice.description}`);
+  log(`Scenario: ${scenarioChoice.description}`);
 
   // Create output directory
   const formId = sanitizeSegment(extractFormId(fullUrl));
@@ -934,16 +939,17 @@ async function handleTestAuto(url, config, flags) {
   fs.writeFileSync(path.join(outputDir, "scenario.json"), JSON.stringify(scenarioChoice, null, 2));
 
   // Open and take initial full-page screenshot
-  console.log("Opening form with Playwright CLI...");
+  log("Opening form with Playwright CLI...");
   await runPlaywrightCli(["open", fullUrl]);
   await runPlaywrightCli(["snapshot", "--filename", path.join(outputDir, "page_open.yml")]);
   await runPlaywrightCli(["screenshot", "--filename", path.join(outputDir, "page_open.png"), "--full-page"]);
-  console.log("Saved: page_open.yml + page_open.png (full-page)");
+  log("Saved: page_open.yml + page_open.png (full-page)");
 
   // Auto-select person (try recommended, then first available)
   let options = extractPersonsFromSnapshotFile(path.join(outputDir, "page_open.yml"));
   if (!options.length) {
     for (let attempt = 0; attempt < 3; attempt++) {
+      verbose(`Scanning for person options (attempt ${attempt + 1})...`);
       await sleep(1500);
       options = await fetchPersonOptions();
       if (options.length) break;
@@ -952,7 +958,7 @@ async function handleTestAuto(url, config, flags) {
   if (options.length) {
     options = prioritizeRecommended(options, RECOMMENDED_PERSON);
     const chosen = options[0];
-    console.log(`Auto-selected person: ${chosen}`);
+    log(`Auto-selected person: ${chosen}`);
     config.lastPerson = chosen;
     saveConfig(config);
   }
@@ -960,18 +966,23 @@ async function handleTestAuto(url, config, flags) {
   // Take form loaded screenshot after person selection
   await runPlaywrightCli(["snapshot", "--filename", path.join(outputDir, "form_loaded.yml")]);
   await runPlaywrightCli(["screenshot", "--filename", path.join(outputDir, "form_loaded.png"), "--full-page"]);
-  console.log("Saved: form_loaded.yml + form_loaded.png (full-page)");
+  log("Saved: form_loaded.yml + form_loaded.png (full-page)");
 
   const dokumenterUrl = resolveDokumenterUrl(config);
-  console.log(`\nOutput folder: ${outputDir}`);
-  if (dokumenterUrl) {
-    console.log(`Dokumenter URL: ${dokumenterUrl}`);
+
+  // Always print output folder (even in silent mode)
+  console.log(`Output folder: ${outputDir}`);
+
+  if (v !== "silent") {
+    if (dokumenterUrl) {
+      console.log(`Dokumenter URL: ${dokumenterUrl}`);
+    }
+    console.log("");
+    console.log("IMPORTANT: All screenshots MUST use --full-page to capture the entire page.");
+    console.log("Example: playwright-cli screenshot --filename \"path/to/file.png\" --full-page");
+    console.log("");
+    printNextSteps(outputDir, dokumenterUrl || "/dokumenter?pnr={PNR}");
   }
-  console.log("");
-  console.log("IMPORTANT: All screenshots MUST use --full-page to capture the entire page.");
-  console.log("Example: playwright-cli screenshot --filename \"path/to/file.png\" --full-page");
-  console.log("");
-  printNextSteps(outputDir, dokumenterUrl || "/dokumenter?pnr={PNR}");
 }
 
 async function handleCommand(line, config) {
@@ -1131,13 +1142,17 @@ async function main() {
     const config = loadConfig();
     const url = args.find((a) => a.startsWith("http"));
     if (!url) {
-      console.error("Usage: form-tester test <url> --auto [--pnr <pnr>] [--persona <id>] [--scenario <text>]");
+      console.error("Usage: form-tester test <url> --auto [--pnr <pnr>] [--persona <id>] [--scenario <text>] [--silent|--verbose]");
       process.exit(1);
     }
-    const pnrFlag = args[args.indexOf("--pnr") + 1];
-    const personaFlag = args[args.indexOf("--persona") + 1];
-    const scenarioFlag = args[args.indexOf("--scenario") + 1];
-    await handleTestAuto(url, config, { pnr: pnrFlag, persona: personaFlag, scenario: scenarioFlag });
+    const flagVal = (flag) => args.includes(flag) ? args[args.indexOf(flag) + 1] : undefined;
+    const verbosity = args.includes("--silent") ? "silent" : args.includes("--verbose") ? "verbose" : "normal";
+    await handleTestAuto(url, config, {
+      pnr: flagVal("--pnr"),
+      persona: flagVal("--persona"),
+      scenario: flagVal("--scenario"),
+      verbosity,
+    });
     process.exit(0);
   }
 

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "form-tester",
-  "version": "0.4.3",
+  "version": "0.5.1",
   "description": "AI-powered form testing skill for /skjemautfyller forms using Playwright CLI. Works with Claude Code and GitHub Copilot.",
   "main": "form-tester.js",
   "bin": {