eyeprolog 1.4.0 → 1.4.1

package/README.md

@@ -68,7 +68,7 @@ printf 'human(socrates).\nmortal(X) :- human(X).\n' |
 - [Symbiotic Knowledge Graphs](examples/deck/symbiotic-knowledge-graphs.md) — RDF ↔ Prolog heatwave-response demo for human/AI/KG co-evolution
 - [rdf-prolog-roundtrip](https://github.com/eyereasoner/rdf-prolog-roundtrip) — standalone RDF 1.2 ↔ ISO Prolog bridge used by the RDF examples
 - [ISO conformance audit](test/conformance/ISO-COMPLIANCE.md) — supported Part 1 profile
-- [Conformance report](conformance-report.md) — generated public corpus summary
+- [Conformance report](conformance-report.md) — generated executable conformance status and corpus summary
 - [OpenRuleBench](openrulebench/README.md) — portable benchmark profile
 
 ## RDF, Prolog, and symbiotic knowledge graphs

package/conformance-report.md

@@ -1,6 +1,20 @@
 # EyeProlog conformance report
 
-This report summarizes the file-based conformance corpus under `test/conformance/`.
+This report combines an executable external conformance gate with the file-based
+conformance corpus under `test/conformance/`. The executable result is measured
+when this report is generated; it is not inferred from fixture counts.
+
+## Executable conformance status
+
+| Gate | Passed | Total | Status |
+|---|---:|---:|---|
+| WG17 syntax | 366 | 366 | pass |
+
+The WG17 syntax row executes the vendored 366-case conformity-testing matrix
+against EyeProlog's strict ISO reader/writer. A behavior fix such as operator-token
+spelling therefore changes this report even when no corpus file is added or removed.
+
+## File-based corpus inventory
 
 | Category | Positive | Errors | Warnings | Proofs | Total |
 |---|---:|---:|---:|---:|---:|

package/package.json

@@ -3,7 +3,7 @@
   "publishConfig": {
     "access": "public"
   },
-  "version": "1.4.0",
+  "version": "1.4.1",
   "description": "EyeProlog turns facts and rules into answers and proofs.",
   "type": "module",
   "main": "./index.js",

package/test/conformance/ISO-COMPLIANCE.md

@@ -6,7 +6,7 @@ together with Technical Corrigenda 1:2007, 2:2012, and 3:2017. Detailed
 row-level evidence lives only where it adds information: the built-in, processor,
 term-semantics, Prolog-text/execution, evaluable-functor, implementation-defined,
 WG17-syntax, and STC draft ledgers in this directory. The generated
-[`conformance-report.md`](../../conformance-report.md) gives current case totals.
+[`conformance-report.md`](../../conformance-report.md) gives the current executable WG17 syntax result together with file-based case totals.
 
 The ledger deliberately does **not** claim independent certification. A row
 marked `covered` means EyeProlog has implementation and executable tests for

package/test/conformance/README.md

@@ -109,7 +109,7 @@ terminating newline, so stream-sensitive cases such as #270 and #271 exercise
 the characters left after `read/1`. Normal `npm test` remains offline and uses
 only the committed upstream snapshot.
 
-Summarize conformance coverage by category:
+Regenerate the public conformance report, including the executable WG17 syntax status and the file-based category inventory:
 
 ```sh
 node test/run-conformance-report.mjs
@@ -146,8 +146,8 @@ are recorded in [THIRD_PARTY.md](THIRD_PARTY.md).
 The corpus has 386 cases in `iso/` and 802 file-based conformance cases in
 total. Of those, 11 cases in `stc/` are explicitly labelled working-draft
 review evidence rather than normative ISO claims. The separate strict-reader WG17 matrix has 366 executable dispositions.
-The generated `conformance-report.md` is the authoritative source for current
-category totals. Together with regression, documentation-sync, API, example,
+The generated `conformance-report.md` is the authoritative source for the current
+executable WG17 syntax result and file-based category totals. Together with regression, documentation-sync, API, example,
 and book-example checks, `npm test` is the release gate.
 
 ## Updating expected output

package/test/run-conformance-report.mjs

@@ -1,10 +1,12 @@
 #!/usr/bin/env node
-// Static conformance corpus report.
-// This complements the executable runner with a category summary that makes
-// coverage growth visible without running every case.
+// Executable conformance status plus static corpus inventory.
+// The WG17 row is run when this report is generated, so a syntax-conformance
+// regression changes the public report even when the fixture inventory itself
+// has not changed.
 import fs from 'node:fs';
 import path from 'node:path';
 import { fileURLToPath } from 'node:url';
+import { runWg17 } from './run-wg17.mjs';
 import { listPrologFiles } from './test-support.mjs';
 
 const root = path.resolve(path.dirname(fileURLToPath(import.meta.url)));
@@ -18,9 +20,9 @@ const KINDS = [
   { kind: 'proofs', expectedKind: 'expected-proofs', expectedExt: '.pl', column: 'proofs' },
 ];
 
-export function buildConformanceReport() {
+export function buildConformanceReport({ wg17Suite = runWg17 } = {}) {
   const categories = new Map();
-  const issues = [];
+  const corpusIssues = [];
 
   for (const { kind, expectedKind, expectedExt, column } of KINDS) {
     const base = path.join(conformanceRoot, kind);
@@ -33,10 +35,10 @@ export function buildConformanceReport() {
 
       const stem = file.slice(0, -3);
       const expected = path.join(conformanceRoot, expectedKind, `${stem}${expectedExt}`);
-      if (!fs.existsSync(expected)) issues.push(`missing ${expectedKind}/${stem}${expectedExt}`);
+      if (!fs.existsSync(expected)) corpusIssues.push(`missing ${expectedKind}/${stem}${expectedExt}`);
       if (kind === 'warnings') {
         const expectedStderr = path.join(conformanceRoot, expectedKind, `${stem}.txt`);
-        if (!fs.existsSync(expectedStderr)) issues.push(`missing ${expectedKind}/${stem}.txt`);
+        if (!fs.existsSync(expectedStderr)) corpusIssues.push(`missing ${expectedKind}/${stem}.txt`);
       }
     }
   }
@@ -52,32 +54,97 @@ export function buildConformanceReport() {
     total: acc.total + row.total,
   }), { positive: 0, errors: 0, warnings: 0, proofs: 0, total: 0 });
 
-  return { rows, total, issues: issues.sort() };
+  const executable = [executeGate('WG17 syntax', wg17Suite)];
+  const executionIssues = executable.flatMap((gate) => gate.failures.map((failure) =>
+    `${gate.name}: ${failure.name}: ${failure.message}`));
+
+  return {
+    rows,
+    total,
+    executable,
+    corpusIssues: corpusIssues.sort(),
+    executionIssues,
+    issues: [...corpusIssues.sort(), ...executionIssues],
+  };
 }
 
 export function formatConformanceReport(report = buildConformanceReport()) {
   const lines = [
     '# EyeProlog conformance report',
     '',
-    'This report summarizes the file-based conformance corpus under `test/conformance/`.',
+    'This report combines an executable external conformance gate with the file-based',
+    'conformance corpus under `test/conformance/`. The executable result is measured',
+    'when this report is generated; it is not inferred from fixture counts.',
+    '',
+    '## Executable conformance status',
+    '',
+    '| Gate | Passed | Total | Status |',
+    '|---|---:|---:|---|',
+  ];
+
+  for (const gate of report.executable) {
+    const status = gate.passed === gate.total ? 'pass' : 'fail';
+    lines.push(`| ${gate.name} | ${gate.passed} | ${gate.total} | ${status} |`);
+  }
+
+  lines.push(
+    '',
+    'The WG17 syntax row executes the vendored 366-case conformity-testing matrix',
+    'against EyeProlog\'s strict ISO reader/writer. A behavior fix such as operator-token',
+    'spelling therefore changes this report even when no corpus file is added or removed.',
+    '',
+    '## File-based corpus inventory',
     '',
     '| Category | Positive | Errors | Warnings | Proofs | Total |',
     '|---|---:|---:|---:|---:|---:|',
-  ];
+  );
 
   for (const row of report.rows) {
     lines.push(`| ${row.category} | ${row.positive} | ${row.errors} | ${row.warnings} | ${row.proofs} | ${row.total} |`);
   }
   lines.push(`| **Total** | **${report.total.positive}** | **${report.total.errors}** | **${report.total.warnings}** | **${report.total.proofs}** | **${report.total.total}** |`);
 
-  if (report.issues.length > 0) {
+  if (report.corpusIssues.length > 0) {
     lines.push('', '## Corpus issues', '');
-    for (const issue of report.issues) lines.push(`- ${issue}`);
+    for (const issue of report.corpusIssues) lines.push(`- ${issue}`);
+  }
+  if (report.executionIssues.length > 0) {
+    lines.push('', '## Executable conformance failures', '');
+    for (const issue of report.executionIssues) lines.push(`- ${issue}`);
   }
 
   return `${lines.join('\n')}\n`;
 }
 
+function executeGate(name, runSuite) {
+  const failures = [];
+  const reporter = {
+    passed: 0,
+    total: 0,
+    section() {},
+    sectionTotal() {},
+    test(testName, run) {
+      this.total++;
+      try {
+        run();
+        this.passed++;
+      } catch (error) {
+        failures.push({
+          name: testName,
+          message: String(error?.message ?? error).split('\n', 1)[0],
+        });
+      }
+    },
+  };
+
+  try {
+    runSuite(reporter);
+  } catch (error) {
+    failures.push({ name: 'suite setup', message: String(error?.message ?? error).split('\n', 1)[0] });
+  }
+  return { name, passed: reporter.passed, total: reporter.total, failures };
+}
+
 function categoryOf(file) {
   const parts = file.split('/');
   return parts.length > 1 ? parts[0] : 'legacy-numbered';

package/test/run-regression.mjs

@@ -5029,10 +5029,27 @@ function documentationSyncCases() {
         assertEqual(report.total.total >= 475, true, 'conformance case count');
         assertEqual(report.total.positive + report.total.errors + report.total.warnings + report.total.proofs, report.total.total, 'conformance total');
         assertEqual(report.rows.some((row) => row.category === 'legacy-numbered'), false, 'legacy-numbered category');
+        const wg17 = report.executable.find((gate) => gate.name === 'WG17 syntax');
+        assertEqual(wg17?.total, 366, 'WG17 executable total');
+        assertEqual(wg17?.passed, 366, 'WG17 executable passed');
+        assertArrayEqual(wg17?.failures ?? [], [], 'WG17 executable failures');
         const text = formatConformanceReport(report);
+        assertIncludes(text, '| WG17 syntax | 366 | 366 | pass |', 'report');
         assertIncludes(text, '| variables |', 'report');
         assertIncludes(text, '| Proofs |', 'report');
         assertIncludes(text, '| **Total** |', 'report');
+
+        const failing = buildConformanceReport({
+          wg17Suite: (reporter) => {
+            reporter.section('WG17 syntax');
+            reporter.test('synthetic syntax failure', () => { throw new Error('synthetic mismatch'); });
+            reporter.sectionTotal('WG17 syntax');
+          },
+        });
+        assertEqual(failing.executable[0].passed, 0, 'failing WG17 executable passed');
+        assertEqual(failing.executable[0].total, 1, 'failing WG17 executable total');
+        assertEqual(failing.executionIssues.length, 1, 'failing WG17 report issue count');
+        assertIncludes(formatConformanceReport(failing), '| WG17 syntax | 0 | 1 | fail |', 'failing report');
       },
     },
 

package/the-art-of-eyeprolog.md

@@ -7784,14 +7784,14 @@ their declared goals are executed. The eight-case
 playground contract suite imports the production worker, sends real reasoning
 requests through its message protocol, and crawls the served module graph for
 missing assets, bad MIME types, and static Node-only imports. The generated
-`conformance-report.md` is the authoritative source for current conformance
-category totals.
+`conformance-report.md` is the authoritative source for the current executable
+WG17 syntax result and file-based conformance category totals.
 
 ### Generated and checked repository material
 
 Repository artifacts have distinct roles:
 
-- `conformance-report.md` is generated from the file-based conformance corpus;
+- `conformance-report.md` executes the vendored WG17 syntax gate and also inventories the file-based conformance corpus;
 - `examples/book/` is extracted from executable code blocks in this book and
   should be rebuilt with `npm run generate` rather than edited directly;
 - `examples/output/` and `examples/proof/` contain reviewed exact-output