forgeqe-cli 2.2.1__tar.gz → 2.2.3__tar.gz

{forgeqe_cli-2.2.1 → forgeqe_cli-2.2.3}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: forgeqe-cli
-Version: 2.2.1
+Version: 2.2.3
 Summary: pip launcher for the ForgeQE browser agent (npm package: @capagents/forgeqe)
 Author: CLI-Agents
 License: MIT
@@ -65,7 +65,7 @@ ForgeQE sends no telemetry and turns it off in everything it starts:
 - The agent runtime: auto-update, session sharing, OpenTelemetry spans, and the model catalogue download are off; it uses its bundled model list.
 - The repo's test command: `DO_NOT_TRACK=1`, plus the opt-outs for Next.js, Nuxt, Astro, Gatsby, Storybook, Turborepo, Angular, .NET, and Cypress.
 
-`OTEL_EXPORTER_OTLP_*` variables are removed from those processes, and your environment cannot turn any of this back on. The only traffic is to your model endpoint and the sites the agent visits. The engine also downloads its ad-block and cookie-banner extensions from the Chrome Web Store once.
+`OTEL_EXPORTER_OTLP_*` variables are removed from those processes, and your environment cannot turn any of this back on. The traffic is to your model endpoint and the sites the agent visits. Besides that, ForgeQE downloads only public files: the model price lists from models.dev and LiteLLM, once a day (`FORGEQE_PRICES=off` stops them); the agent runtime from its GitHub releases, when it is not installed; and the engine's ad-block and cookie-banner extensions from the Chrome Web Store, once. Nothing about your runs is sent.
 
 ## Configure
 
@@ -102,7 +102,7 @@ The active profile is `llm.active` in `forgeqe.yaml`, else `default` in `llms.js
 
 **Model router.** With more than one model in `llms.json`, `llm.routing: auto` gives each area of work (ForgeQE's agent, browser runs, coding, review, analysis, planning) the cheapest configured model that is good enough for it. ForgeQE checks each model once and rates it, and keeps the result in `.forgeqe/model-profile.json`. `forgeqe models --routes` shows the model each area gets, and why. `--profile` and `code.model` still win. See [docs/MODEL_ROUTING.md](docs/MODEL_ROUTING.md).
 
-**GitHub Copilot.** With Copilot licences, a `github_copilot` profile runs ForgeQE's agent and Scribe on the Copilot seat through the agent runtime's GitHub Copilot sign-in (`forgeqe auth login copilot`, GitHub.com or GitHub Enterprise). The browser engine uses GitHub Models with your GitHub sign-in (`forgeqe auth login github`, or `GITHUB_TOKEN`), optionally billed to an organization with `github_org`. See HOW_TO_USE.md, *GitHub Copilot seats as the model*.
+**GitHub Copilot.** With Copilot licences, a `github_copilot` profile runs the browser engine and the desktop and mobile agents on the Copilot seat through GitHub's Copilot SDK, behind a gateway on `127.0.0.1`. It signs in with a GitHub token (`forgeqe auth login copilot`: a fine-grained token with the Copilot Requests permission, or the GitHub CLI's sign-in), so no third-party app is authorized on the account. ForgeQE's agent and Scribe do not run on Copilot yet. See HOW_TO_USE.md, *GitHub Copilot seats as the model*.
 
 ## CLI
 

{forgeqe_cli-2.2.1 → forgeqe_cli-2.2.3}/README.md

@@ -51,7 +51,7 @@ ForgeQE sends no telemetry and turns it off in everything it starts:
 - The agent runtime: auto-update, session sharing, OpenTelemetry spans, and the model catalogue download are off; it uses its bundled model list.
 - The repo's test command: `DO_NOT_TRACK=1`, plus the opt-outs for Next.js, Nuxt, Astro, Gatsby, Storybook, Turborepo, Angular, .NET, and Cypress.
 
-`OTEL_EXPORTER_OTLP_*` variables are removed from those processes, and your environment cannot turn any of this back on. The only traffic is to your model endpoint and the sites the agent visits. The engine also downloads its ad-block and cookie-banner extensions from the Chrome Web Store once.
+`OTEL_EXPORTER_OTLP_*` variables are removed from those processes, and your environment cannot turn any of this back on. The traffic is to your model endpoint and the sites the agent visits. Besides that, ForgeQE downloads only public files: the model price lists from models.dev and LiteLLM, once a day (`FORGEQE_PRICES=off` stops them); the agent runtime from its GitHub releases, when it is not installed; and the engine's ad-block and cookie-banner extensions from the Chrome Web Store, once. Nothing about your runs is sent.
 
 ## Configure
 
@@ -88,7 +88,7 @@ The active profile is `llm.active` in `forgeqe.yaml`, else `default` in `llms.js
 
 **Model router.** With more than one model in `llms.json`, `llm.routing: auto` gives each area of work (ForgeQE's agent, browser runs, coding, review, analysis, planning) the cheapest configured model that is good enough for it. ForgeQE checks each model once and rates it, and keeps the result in `.forgeqe/model-profile.json`. `forgeqe models --routes` shows the model each area gets, and why. `--profile` and `code.model` still win. See [docs/MODEL_ROUTING.md](docs/MODEL_ROUTING.md).
 
-**GitHub Copilot.** With Copilot licences, a `github_copilot` profile runs ForgeQE's agent and Scribe on the Copilot seat through the agent runtime's GitHub Copilot sign-in (`forgeqe auth login copilot`, GitHub.com or GitHub Enterprise). The browser engine uses GitHub Models with your GitHub sign-in (`forgeqe auth login github`, or `GITHUB_TOKEN`), optionally billed to an organization with `github_org`. See HOW_TO_USE.md, *GitHub Copilot seats as the model*.
+**GitHub Copilot.** With Copilot licences, a `github_copilot` profile runs the browser engine and the desktop and mobile agents on the Copilot seat through GitHub's Copilot SDK, behind a gateway on `127.0.0.1`. It signs in with a GitHub token (`forgeqe auth login copilot`: a fine-grained token with the Copilot Requests permission, or the GitHub CLI's sign-in), so no third-party app is authorized on the account. ForgeQE's agent and Scribe do not run on Copilot yet. See HOW_TO_USE.md, *GitHub Copilot seats as the model*.
 
 ## CLI
 

{forgeqe_cli-2.2.1 → forgeqe_cli-2.2.3}/py/forgeqe_cli/__init__.py

@@ -4,4 +4,4 @@ The agent itself is the npm package ``@capagents/forgeqe`` (OpenTUI + Bun).
 This distribution only puts a ``forgeqe`` command on PATH.
 """
 
-__version__ = "2.2.1"
+__version__ = "2.2.3"

forgeqe_cli-2.2.3/py/forgeqe_cli/pytest_plugin.py

@@ -0,0 +1,132 @@
+"""ForgeQE plugin for pytest: an HTML report after every run, from the terminal, an IDE's test runner, or CI.
+
+pytest loads it by itself from the forgeqe-cli wheel (the pytest11 entry point). It is on in a folder with
+forgeqe.yaml or .forgeqe/, or with ``pytest --forgeqe-report`` or FORGEQE_REPORT=1; FORGEQE_REPORT=0 turns it off.
+At the end of the run it writes the results, with each failure's message and traceback, to
+.pytest_cache/forgeqe/results.json and runs ``forgeqe report`` on it.
+"""
+
+from __future__ import annotations
+
+import json
+import os
+import re
+import subprocess
+import sys
+import tempfile
+import time
+from datetime import datetime, timezone
+from pathlib import Path
+
+ANSI = re.compile(r"\x1b\[[0-9;]*[A-Za-z]")
+
+
+def _clean(text: str) -> str:
+    return ANSI.sub("", text or "")
+
+
+def pytest_addoption(parser):
+    parser.getgroup("forgeqe").addoption(
+        "--forgeqe-report", action="store_true", default=False, help="write a ForgeQE HTML report after the run"
+    )
+
+
+def _active(config) -> bool:
+    flag = os.environ.get("FORGEQE_REPORT")
+    if flag == "0":
+        return False
+    if flag == "1" or config.getoption("forgeqe_report", False):
+        return True
+    root = Path(str(config.rootpath))
+    return (root / "forgeqe.yaml").exists() or (root / ".forgeqe").is_dir()
+
+
+def pytest_configure(config):
+    # An xdist worker sends its results to the controller, which writes the one report.
+    if hasattr(config, "workerinput") or not _active(config):
+        return
+    config.pluginmanager.register(_Collector(config), "forgeqe-collector")
+
+
+def _message(report) -> str:
+    crash = getattr(getattr(report, "longrepr", None), "reprcrash", None)
+    text = crash.message if crash is not None else str(getattr(report, "longrepr", "") or "")
+    first = next((line.strip() for line in _clean(text).splitlines() if line.strip()), "")
+    return first[:300]
+
+
+class _Collector:
+    def __init__(self, config):
+        self.config = config
+        self.tests: dict[str, dict] = {}
+        self.started = datetime.now(timezone.utc)
+        self.t0 = time.monotonic()
+        self.line = ""
+
+    def pytest_runtest_logreport(self, report):
+        nodeid = report.nodeid
+        test = self.tests.setdefault(
+            nodeid, {"name": " › ".join(nodeid.split("::")), "status": "passed", "seconds": 0.0, "file": report.location[0]}
+        )
+        if report.outcome == "rerun":
+            # pytest-rerunfailures: a failure that is run again; passing later makes the test flaky, not failed.
+            test["rerun"] = True
+            test.setdefault("message", _message(report))
+            test.setdefault("details", _clean(report.longreprtext))
+            return
+        test["seconds"] = round(test["seconds"] + (report.duration or 0), 3)
+        if report.failed:
+            if test["status"] != "failed":
+                test["message"] = _message(report)
+                test["details"] = _clean(report.longreprtext)
+            test["status"] = "failed"
+        elif report.skipped and test["status"] == "passed" and report.when in ("setup", "call"):
+            test["status"] = "skipped"
+
+    def pytest_sessionfinish(self, session):
+        if not self.tests:
+            return
+        tests = []
+        for test in self.tests.values():
+            rerun = test.pop("rerun", False)
+            if test["status"] == "passed" and rerun:
+                test["flaky"] = True
+            elif test["status"] != "failed" and not test.get("flaky"):
+                test.pop("message", None)
+                test.pop("details", None)
+            tests.append({k: v for k, v in test.items() if v not in ("", None)})
+        doc = {
+            "format": "forgeqe-results",
+            "version": 1,
+            "framework": "pytest",
+            "startedAt": self.started.isoformat(),
+            "ms": round((time.monotonic() - self.t0) * 1000),
+            "command": " ".join(["pytest", *self.config.invocation_params.args])[:500],
+            "tests": tests,
+        }
+        cache = getattr(self.config, "cache", None)
+        folder = Path(cache.mkdir("forgeqe")) if cache is not None else Path(tempfile.mkdtemp(prefix="forgeqe-"))
+        path = folder / "results.json"
+        path.write_text(json.dumps(doc, indent=2) + "\n", encoding="utf-8")
+        self.line = _report(path, Path(str(self.config.rootpath)))
+
+    def pytest_terminal_summary(self, terminalreporter):
+        if self.line:
+            terminalreporter.write_line(self.line)
+
+
+def _report(path: Path, root: Path) -> str:
+    """Run forgeqe report on the results; the line to show."""
+    # This wheel's own launcher, by the Python running pytest: no PATH lookup and no .cmd shim on Windows.
+    bin_ = os.environ.get("FORGEQE_BIN")
+    cmd = [bin_, "report", str(path)] if bin_ else [sys.executable, "-m", "forgeqe_cli", "report", str(path)]
+    try:
+        run = subprocess.run(cmd, cwd=str(root), capture_output=True, text=True, timeout=300)
+    except (OSError, subprocess.TimeoutExpired) as exc:
+        return f"ForgeQE: no report ({exc.__class__.__name__}). Build it with: forgeqe report {path}"
+    # forgeqe report exits 1 when a test failed: that is a report, not an error.
+    line = next((l for l in _clean(run.stdout).splitlines() if l.startswith("Report")), "") if run.returncode <= 1 else ""
+    if line:
+        return "ForgeQE report: " + line[len("Report"):].strip()
+    why = (_clean(run.stderr).strip().splitlines() or ["it did not finish"])[-1]
+    return f"ForgeQE: no report ({why}). Build it with: forgeqe report {path}"

{forgeqe_cli-2.2.1 → forgeqe_cli-2.2.3}/py/forgeqe_cli.egg-info/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: forgeqe-cli
-Version: 2.2.1
+Version: 2.2.3
 Summary: pip launcher for the ForgeQE browser agent (npm package: @capagents/forgeqe)
 Author: CLI-Agents
 License: MIT
@@ -65,7 +65,7 @@ ForgeQE sends no telemetry and turns it off in everything it starts:
 - The agent runtime: auto-update, session sharing, OpenTelemetry spans, and the model catalogue download are off; it uses its bundled model list.
 - The repo's test command: `DO_NOT_TRACK=1`, plus the opt-outs for Next.js, Nuxt, Astro, Gatsby, Storybook, Turborepo, Angular, .NET, and Cypress.
 
-`OTEL_EXPORTER_OTLP_*` variables are removed from those processes, and your environment cannot turn any of this back on. The only traffic is to your model endpoint and the sites the agent visits. The engine also downloads its ad-block and cookie-banner extensions from the Chrome Web Store once.
+`OTEL_EXPORTER_OTLP_*` variables are removed from those processes, and your environment cannot turn any of this back on. The traffic is to your model endpoint and the sites the agent visits. Besides that, ForgeQE downloads only public files: the model price lists from models.dev and LiteLLM, once a day (`FORGEQE_PRICES=off` stops them); the agent runtime from its GitHub releases, when it is not installed; and the engine's ad-block and cookie-banner extensions from the Chrome Web Store, once. Nothing about your runs is sent.
 
 ## Configure
 
@@ -102,7 +102,7 @@ The active profile is `llm.active` in `forgeqe.yaml`, else `default` in `llms.js
 
 **Model router.** With more than one model in `llms.json`, `llm.routing: auto` gives each area of work (ForgeQE's agent, browser runs, coding, review, analysis, planning) the cheapest configured model that is good enough for it. ForgeQE checks each model once and rates it, and keeps the result in `.forgeqe/model-profile.json`. `forgeqe models --routes` shows the model each area gets, and why. `--profile` and `code.model` still win. See [docs/MODEL_ROUTING.md](docs/MODEL_ROUTING.md).
 
-**GitHub Copilot.** With Copilot licences, a `github_copilot` profile runs ForgeQE's agent and Scribe on the Copilot seat through the agent runtime's GitHub Copilot sign-in (`forgeqe auth login copilot`, GitHub.com or GitHub Enterprise). The browser engine uses GitHub Models with your GitHub sign-in (`forgeqe auth login github`, or `GITHUB_TOKEN`), optionally billed to an organization with `github_org`. See HOW_TO_USE.md, *GitHub Copilot seats as the model*.
+**GitHub Copilot.** With Copilot licences, a `github_copilot` profile runs the browser engine and the desktop and mobile agents on the Copilot seat through GitHub's Copilot SDK, behind a gateway on `127.0.0.1`. It signs in with a GitHub token (`forgeqe auth login copilot`: a fine-grained token with the Copilot Requests permission, or the GitHub CLI's sign-in), so no third-party app is authorized on the account. ForgeQE's agent and Scribe do not run on Copilot yet. See HOW_TO_USE.md, *GitHub Copilot seats as the model*.
 
 ## CLI
 

{forgeqe_cli-2.2.1 → forgeqe_cli-2.2.3}/py/forgeqe_cli.egg-info/SOURCES.txt

@@ -4,6 +4,7 @@ pyproject.toml
 py/forgeqe_cli/__init__.py
 py/forgeqe_cli/__main__.py
 py/forgeqe_cli/launcher.py
+py/forgeqe_cli/pytest_plugin.py
 py/forgeqe_cli.egg-info/PKG-INFO
 py/forgeqe_cli.egg-info/SOURCES.txt
 py/forgeqe_cli.egg-info/dependency_links.txt

{forgeqe_cli-2.2.1 → forgeqe_cli-2.2.3}/py/forgeqe_cli.egg-info/entry_points.txt

@@ -1,3 +1,6 @@
 [console_scripts]
 forgeqe = forgeqe_cli.launcher:main
 webpilot = forgeqe_cli.launcher:main
+
+[pytest11]
+forgeqe = forgeqe_cli.pytest_plugin

{forgeqe_cli-2.2.1 → forgeqe_cli-2.2.3}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
 
 [project]
 name = "forgeqe-cli"
-version = "2.2.1"
+version = "2.2.3"
 description = "pip launcher for the ForgeQE browser agent (npm package: @capagents/forgeqe)"
 readme = "README.md"
 requires-python = ">=3.9"
@@ -21,6 +21,10 @@ forgeqe = "forgeqe_cli.launcher:main"
 # The command's name before the rename, kept so existing scripts still work.
 webpilot = "forgeqe_cli.launcher:main"
 
+# pytest loads the plugin by itself where the wheel is installed: a ForgeQE report after every run (forgeqe report setup).
+[project.entry-points.pytest11]
+forgeqe = "forgeqe_cli.pytest_plugin"
+
 [tool.setuptools.packages.find]
 where = ["py"]
 # The engine ships in the npm package; the wheel is only the launcher.