testfix 0.1.0__tar.gz

testfix-0.1.0/PKG-INFO

@@ -0,0 +1,214 @@
+Metadata-Version: 2.4
+Name: testfix
+Version: 0.1.0
+Summary: AI-powered CLI to automatically fix failing tests — non-interactive, pipeable, CI-ready
+Author: faw21
+License: BSL-1.1
+Keywords: ai,automation,cli,developer-tools,pytest,tdd,testing
+Classifier: Development Status :: 3 - Alpha
+Classifier: Environment :: Console
+Classifier: Intended Audience :: Developers
+Classifier: Programming Language :: Python :: 3
+Classifier: Topic :: Software Development :: Testing
+Classifier: Topic :: Utilities
+Requires-Python: >=3.9
+Requires-Dist: anthropic>=0.25
+Requires-Dist: click>=8.0
+Requires-Dist: openai>=1.0
+Requires-Dist: python-dotenv>=1.0
+Requires-Dist: rich>=13.0
+Provides-Extra: dev
+Requires-Dist: anthropic>=0.25; extra == 'dev'
+Requires-Dist: openai>=1.0; extra == 'dev'
+Requires-Dist: pytest-cov; extra == 'dev'
+Requires-Dist: pytest-mock; extra == 'dev'
+Requires-Dist: pytest>=8.0; extra == 'dev'
+Description-Content-Type: text/markdown
+
+# testfix
+
+**AI-powered failing test auto-fixer.** Run your tests, let the AI fix the failures, repeat until green — all from one command.
+
+```bash
+pip install testfix
+testfix pytest          # run, fix, retry up to 5× until tests pass
+```
+
+> Supports pytest · jest · vitest · go test · cargo test
+
+---
+
+## Why testfix?
+
+You've been there: you write a feature, run tests, and see 5 failures. Fixing each one manually means reading tracebacks, understanding what broke, writing a fix, re-running — and repeating. testfix automates that loop.
+
+Unlike GitHub Copilot (needs IDE) or aider (interactive session), testfix is a **pure CLI tool**: non-interactive, pipeable, pre-push hook-ready.
+
+---
+
+## Installation
+
+```bash
+pip install testfix
+```
+
+Requires Python 3.9+. No configuration needed — just install and run.
+
+### API Keys
+
+Set one of these (or use Ollama for free local inference):
+
+```bash
+export ANTHROPIC_API_KEY=sk-ant-...   # Claude (default)
+export OPENAI_API_KEY=sk-...          # OpenAI
+# or use --provider ollama (no key needed, runs locally)
+```
+
+---
+
+## Quick Start
+
+```bash
+# Run pytest and fix failures (up to 5 tries)
+testfix pytest
+
+# Fix a specific test file
+testfix pytest tests/test_auth.py
+
+# Run once: test → fix → test again
+testfix --once pytest
+
+# Preview fixes without applying them
+testfix --dry-run pytest
+
+# Use OpenAI instead of Claude
+testfix --provider openai pytest
+
+# Use local Ollama (free, no API key)
+testfix --provider ollama pytest
+
+# Use Jest
+testfix npm test
+
+# Use Go test
+testfix go test ./...
+
+# Focus on a specific source file
+testfix --file src/auth.py pytest
+```
+
+---
+
+## How it works
+
+```
+testfix pytest
+│
+├─ Attempt 1/5
+│   ├─ Run: pytest
+│   ├─ 3 failing tests found
+│   ├─ 🤖 Asking Claude to fix 3 failure(s)…
+│   ├─ Generated 1 file fix(es)
+│   │   └─ src/auth.py  (diff shown)
+│   └─ ✔ Applied fix (backup: .testfix.bak)
+│
+├─ Attempt 2/5
+│   ├─ Run: pytest
+│   └─ ✅ All tests pass!
+│
+└─ Exit 0
+```
+
+1. **Run** your tests with the command you provide
+2. **Parse** failures: extracts test name, location, error, traceback
+3. **Collect** relevant source files (from tracebacks + heuristics)
+4. **Ask** the AI to fix the source code — never modifies test files
+5. **Apply** the fix (with `.testfix.bak` backup)
+6. **Repeat** until tests pass or `--max-tries` is reached
+
+---
+
+## Options
+
+```
+testfix [OPTIONS] TEST_COMMAND...
+
+Options:
+  --max-tries N      Max fix-and-retry iterations (default: 5)
+  --once             Run once: test → fix → test again (--max-tries 2)
+  --dry-run          Show diffs but don't apply fixes
+  --provider NAME    LLM provider: claude, openai, ollama (default: claude)
+  --model NAME       Model override (e.g. claude-sonnet-4-5, gpt-4o)
+  --file PATH        Focus fixes on this source file
+  -v, --verbose      Show full test runner stderr
+  --version          Show version and exit
+```
+
+---
+
+## Pre-push hook
+
+Add to `.git/hooks/pre-push`:
+
+```bash
+#!/bin/bash
+testfix --once --provider ollama pytest
+```
+
+This runs tests, lets AI fix any failures, and blocks the push if tests are still failing.
+
+---
+
+## CI / GitHub Actions
+
+```yaml
+- name: Run and auto-fix tests
+  run: testfix pytest
+  env:
+    ANTHROPIC_API_KEY: ${{ secrets.ANTHROPIC_API_KEY }}
+```
+
+Or use `--dry-run` in CI to just report what would be fixed without changing files:
+
+```yaml
+- name: Check if AI can fix test failures
+  run: testfix --dry-run pytest || echo "Tests failing (see diff above)"
+```
+
+---
+
+## Supported test frameworks
+
+| Framework | Command example |
+|-----------|----------------|
+| **pytest** | `testfix pytest` |
+| **jest** | `testfix npx jest` |
+| **vitest** | `testfix npx vitest` |
+| **go test** | `testfix go test ./...` |
+| **cargo test** | `testfix cargo test` |
+| **rspec** | `testfix bundle exec rspec` |
+| **any** | `testfix <your test command>` |
+
+---
+
+## Ecosystem
+
+testfix is part of a suite of AI-powered developer CLI tools:
+
+| Tool | Purpose |
+|------|---------|
+| **[critiq](https://github.com/faw21/critiq)** | AI code reviewer — catch issues before you push |
+| **[testfix](https://github.com/faw21/testfix)** | AI test fixer — automatically fix failing tests |
+| **[difftests](https://github.com/faw21/difftests)** | AI test generator — write tests for your diffs |
+| **[gpr](https://github.com/faw21/gpr)** | AI PR description + commit message generator |
+| **[gitbrief](https://github.com/faw21/gitbrief)** | Pack your codebase into LLM context |
+| **[standup-ai](https://github.com/faw21/standup-ai)** | AI daily standup generator |
+| **[changelog-ai](https://github.com/faw21/changelog-ai)** | AI CHANGELOG generator |
+| **[prcat](https://github.com/faw21/prcat)** | AI PR reviewer for incoming PRs |
+| **[chronicle](https://github.com/faw21/chronicle)** | Turn git history into stories |
+
+---
+
+## License
+
+Business Source License 1.1 — free for non-commercial use. See [LICENSE](LICENSE).

testfix-0.1.0/README.md

@@ -0,0 +1,187 @@
+# testfix
+
+**AI-powered failing test auto-fixer.** Run your tests, let the AI fix the failures, repeat until green — all from one command.
+
+```bash
+pip install testfix
+testfix pytest          # run, fix, retry up to 5× until tests pass
+```
+
+> Supports pytest · jest · vitest · go test · cargo test
+
+---
+
+## Why testfix?
+
+You've been there: you write a feature, run tests, and see 5 failures. Fixing each one manually means reading tracebacks, understanding what broke, writing a fix, re-running — and repeating. testfix automates that loop.
+
+Unlike GitHub Copilot (needs IDE) or aider (interactive session), testfix is a **pure CLI tool**: non-interactive, pipeable, pre-push hook-ready.
+
+---
+
+## Installation
+
+```bash
+pip install testfix
+```
+
+Requires Python 3.9+. No configuration needed — just install and run.
+
+### API Keys
+
+Set one of these (or use Ollama for free local inference):
+
+```bash
+export ANTHROPIC_API_KEY=sk-ant-...   # Claude (default)
+export OPENAI_API_KEY=sk-...          # OpenAI
+# or use --provider ollama (no key needed, runs locally)
+```
+
+---
+
+## Quick Start
+
+```bash
+# Run pytest and fix failures (up to 5 tries)
+testfix pytest
+
+# Fix a specific test file
+testfix pytest tests/test_auth.py
+
+# Run once: test → fix → test again
+testfix --once pytest
+
+# Preview fixes without applying them
+testfix --dry-run pytest
+
+# Use OpenAI instead of Claude
+testfix --provider openai pytest
+
+# Use local Ollama (free, no API key)
+testfix --provider ollama pytest
+
+# Use Jest
+testfix npm test
+
+# Use Go test
+testfix go test ./...
+
+# Focus on a specific source file
+testfix --file src/auth.py pytest
+```
+
+---
+
+## How it works
+
+```
+testfix pytest
+│
+├─ Attempt 1/5
+│   ├─ Run: pytest
+│   ├─ 3 failing tests found
+│   ├─ 🤖 Asking Claude to fix 3 failure(s)…
+│   ├─ Generated 1 file fix(es)
+│   │   └─ src/auth.py  (diff shown)
+│   └─ ✔ Applied fix (backup: .testfix.bak)
+│
+├─ Attempt 2/5
+│   ├─ Run: pytest
+│   └─ ✅ All tests pass!
+│
+└─ Exit 0
+```
+
+1. **Run** your tests with the command you provide
+2. **Parse** failures: extracts test name, location, error, traceback
+3. **Collect** relevant source files (from tracebacks + heuristics)
+4. **Ask** the AI to fix the source code — never modifies test files
+5. **Apply** the fix (with `.testfix.bak` backup)
+6. **Repeat** until tests pass or `--max-tries` is reached
+
+---
+
+## Options
+
+```
+testfix [OPTIONS] TEST_COMMAND...
+
+Options:
+  --max-tries N      Max fix-and-retry iterations (default: 5)
+  --once             Run once: test → fix → test again (--max-tries 2)
+  --dry-run          Show diffs but don't apply fixes
+  --provider NAME    LLM provider: claude, openai, ollama (default: claude)
+  --model NAME       Model override (e.g. claude-sonnet-4-5, gpt-4o)
+  --file PATH        Focus fixes on this source file
+  -v, --verbose      Show full test runner stderr
+  --version          Show version and exit
+```
+
+---
+
+## Pre-push hook
+
+Add to `.git/hooks/pre-push`:
+
+```bash
+#!/bin/bash
+testfix --once --provider ollama pytest
+```
+
+This runs tests, lets AI fix any failures, and blocks the push if tests are still failing.
+
+---
+
+## CI / GitHub Actions
+
+```yaml
+- name: Run and auto-fix tests
+  run: testfix pytest
+  env:
+    ANTHROPIC_API_KEY: ${{ secrets.ANTHROPIC_API_KEY }}
+```
+
+Or use `--dry-run` in CI to just report what would be fixed without changing files:
+
+```yaml
+- name: Check if AI can fix test failures
+  run: testfix --dry-run pytest || echo "Tests failing (see diff above)"
+```
+
+---
+
+## Supported test frameworks
+
+| Framework | Command example |
+|-----------|----------------|
+| **pytest** | `testfix pytest` |
+| **jest** | `testfix npx jest` |
+| **vitest** | `testfix npx vitest` |
+| **go test** | `testfix go test ./...` |
+| **cargo test** | `testfix cargo test` |
+| **rspec** | `testfix bundle exec rspec` |
+| **any** | `testfix <your test command>` |
+
+---
+
+## Ecosystem
+
+testfix is part of a suite of AI-powered developer CLI tools:
+
+| Tool | Purpose |
+|------|---------|
+| **[critiq](https://github.com/faw21/critiq)** | AI code reviewer — catch issues before you push |
+| **[testfix](https://github.com/faw21/testfix)** | AI test fixer — automatically fix failing tests |
+| **[difftests](https://github.com/faw21/difftests)** | AI test generator — write tests for your diffs |
+| **[gpr](https://github.com/faw21/gpr)** | AI PR description + commit message generator |
+| **[gitbrief](https://github.com/faw21/gitbrief)** | Pack your codebase into LLM context |
+| **[standup-ai](https://github.com/faw21/standup-ai)** | AI daily standup generator |
+| **[changelog-ai](https://github.com/faw21/changelog-ai)** | AI CHANGELOG generator |
+| **[prcat](https://github.com/faw21/prcat)** | AI PR reviewer for incoming PRs |
+| **[chronicle](https://github.com/faw21/chronicle)** | Turn git history into stories |
+
+---
+
+## License
+
+Business Source License 1.1 — free for non-commercial use. See [LICENSE](LICENSE).

testfix-0.1.0/pyproject.toml

@@ -0,0 +1,50 @@
+[build-system]
+requires = ["hatchling"]
+build-backend = "hatchling.build"
+
+[project]
+name = "testfix"
+version = "0.1.0"
+description = "AI-powered CLI to automatically fix failing tests — non-interactive, pipeable, CI-ready"
+readme = "README.md"
+requires-python = ">=3.9"
+license = { text = "BSL-1.1" }
+authors = [{ name = "faw21" }]
+keywords = ["ai", "testing", "cli", "developer-tools", "automation", "pytest", "tdd"]
+classifiers = [
+    "Development Status :: 3 - Alpha",
+    "Intended Audience :: Developers",
+    "Environment :: Console",
+    "Programming Language :: Python :: 3",
+    "Topic :: Software Development :: Testing",
+    "Topic :: Utilities",
+]
+dependencies = [
+    "click>=8.0",
+    "anthropic>=0.25",
+    "openai>=1.0",
+    "rich>=13.0",
+    "python-dotenv>=1.0",
+]
+
+[project.optional-dependencies]
+dev = [
+    "pytest>=8.0",
+    "pytest-cov",
+    "pytest-mock",
+    "anthropic>=0.25",
+    "openai>=1.0",
+]
+
+[project.scripts]
+testfix = "testfix.cli:main"
+
+[tool.hatch.build.targets.wheel]
+packages = ["src/testfix"]
+
+[tool.pytest.ini_options]
+testpaths = ["tests"]
+addopts = "--cov=testfix --cov-report=term-missing --cov-fail-under=80"
+
+[tool.coverage.run]
+source = ["src/testfix"]

testfix-0.1.0/src/testfix/__init__.py

@@ -0,0 +1,3 @@
+"""testfix — AI-powered failing test auto-fixer."""
+
+__version__ = "0.1.0"

testfix-0.1.0/src/testfix/cli.py

@@ -0,0 +1,234 @@
+"""testfix CLI — run tests, fix failures, repeat."""
+
+from __future__ import annotations
+
+import sys
+from pathlib import Path
+from typing import Optional
+
+import click
+from rich.console import Console
+from rich.panel import Panel
+from rich.syntax import Syntax
+from rich.text import Text
+
+from . import __version__
+from .fixer import apply_patches, generate_fixes
+from .runner import RunResult, run_tests
+
+console = Console()
+
+
+# ── Helpers ───────────────────────────────────────────────────────────────────
+
+
+def _print_run_summary(result: RunResult, attempt: int) -> None:
+    """Print a summary of the test run."""
+    if result.all_passed:
+        console.print(f"[bold green]✅ All tests pass![/] (attempt {attempt})")
+    else:
+        icon = "🔴"
+        console.print(
+            f"{icon} [bold red]{result.failed} failing[/], "
+            f"[green]{result.passed} passing[/]  "
+            f"(attempt {attempt})"
+        )
+        for failure in result.failures[:5]:
+            loc = f"  [dim]{failure.file_path}:{failure.line_number}[/]" if failure.file_path else ""
+            console.print(f"   └─ {failure.test_name}{loc}")
+        if len(result.failures) > 5:
+            console.print(f"   └─ [dim]… and {len(result.failures) - 5} more[/]")
+
+
+def _print_diff(diff_lines: list[str], file_path: str) -> None:
+    """Print a colorised unified diff."""
+    diff_text = "".join(diff_lines)
+    if diff_text:
+        syntax = Syntax(diff_text, "diff", theme="monokai", line_numbers=False)
+        console.print(Panel(syntax, title=f"[bold]{file_path}[/]", border_style="dim"))
+
+
+def _do_fix_cycle(
+    command: list[str],
+    *,
+    cwd: str,
+    max_tries: int,
+    provider: str,
+    model: Optional[str],
+    dry_run: bool,
+    focus_file: Optional[str],
+    verbose: bool,
+) -> int:
+    """
+    Core retry loop.
+
+    Returns:
+        0 — all tests pass
+        1 — still failing after max_tries
+        2 — error (command not found etc.)
+    """
+    attempt = 0
+
+    while attempt < max_tries:
+        attempt += 1
+        console.rule(f"[dim]Attempt {attempt}/{max_tries}[/]")
+
+        # Run tests
+        result = run_tests(command, cwd=cwd)
+
+        if verbose and result.stderr:
+            console.print(f"[dim]{result.stderr[:500]}[/]")
+
+        _print_run_summary(result, attempt)
+
+        if result.exit_code == 127:
+            console.print(f"[bold red]Error:[/] {result.stderr}")
+            return 2
+
+        if result.all_passed:
+            return 0
+
+        if attempt >= max_tries:
+            console.print(
+                f"\n[yellow]⚠️  Still failing after {max_tries} attempt(s).[/] "
+                "Try increasing [bold]--max-tries[/] or switch to a stronger model."
+            )
+            return 1
+
+        # Generate fixes
+        console.print(f"\n[bold cyan]🤖 Asking {provider} to fix {result.failed} failure(s)…[/]")
+
+        try:
+            fix_result = generate_fixes(
+                result,
+                cwd=cwd,
+                provider=provider,
+                model=model,
+                focus_file=focus_file,
+            )
+        except Exception as exc:
+            console.print(f"[bold red]LLM error:[/] {exc}")
+            return 2
+
+        if not fix_result.patches:
+            console.print("[yellow]⚠️  AI could not suggest fixes.[/] Check the failures manually.")
+            return 1
+
+        console.print(f"[green]Generated {fix_result.files_changed} file fix(es)[/]")
+
+        for patch in fix_result.patches:
+            _print_diff(patch.diff_lines, patch.file_path)
+
+        if dry_run:
+            console.print("\n[bold yellow]--dry-run:[/] Not applying fixes. Exiting.")
+            return 1
+
+        # Apply
+        applied = apply_patches(fix_result.patches, cwd=cwd)
+        for f in applied:
+            console.print(f"  [green]✔[/] Applied fix to [bold]{Path(f).name}[/] (backup: .testfix.bak)")
+
+    # Should not reach here
+    return 1
+
+
+# ── CLI ───────────────────────────────────────────────────────────────────────
+
+
+@click.command(
+    name="testfix",
+    context_settings={"ignore_unknown_options": True},
+)
+@click.argument("test_command", nargs=-1, required=True, type=click.UNPROCESSED)
+@click.option(
+    "--max-tries",
+    default=5,
+    show_default=True,
+    help="Maximum fix-and-retry iterations.",
+)
+@click.option(
+    "--once",
+    is_flag=True,
+    help="Run tests once, fix once, run again — equivalent to --max-tries 2.",
+)
+@click.option(
+    "--dry-run",
+    is_flag=True,
+    help="Show proposed fixes as diffs but do not apply them.",
+)
+@click.option(
+    "--provider",
+    default="claude",
+    type=click.Choice(["claude", "openai", "ollama"], case_sensitive=False),
+    show_default=True,
+    help="LLM provider.",
+)
+@click.option(
+    "--model",
+    default=None,
+    help="Model name override (e.g. claude-sonnet-4-5, gpt-4o, qwen2.5:7b).",
+)
+@click.option(
+    "--file",
+    "focus_file",
+    default=None,
+    help="Focus fixes on this source file (relative to cwd).",
+)
+@click.option(
+    "--verbose",
+    "-v",
+    is_flag=True,
+    help="Show full stderr output from test runner.",
+)
+@click.version_option(__version__, "--version")
+def main(
+    test_command: tuple,
+    max_tries: int,
+    once: bool,
+    dry_run: bool,
+    provider: str,
+    model: Optional[str],
+    focus_file: Optional[str],
+    verbose: bool,
+) -> None:
+    """
+    Run tests. If they fail, ask AI to fix them. Repeat until they pass.
+
+    \b
+    Examples:
+        testfix pytest
+        testfix pytest tests/test_auth.py
+        testfix --max-tries 3 pytest
+        testfix --dry-run pytest
+        testfix --provider ollama pytest
+        testfix --once npm test
+    """
+    from dotenv import load_dotenv
+    load_dotenv(override=True)
+
+    cwd = str(Path.cwd())
+    effective_max = 2 if once else max_tries
+    command = list(test_command)
+
+    console.print(
+        Panel(
+            f"[bold]testfix[/] v{__version__}  "
+            f"[dim]command:[/] {' '.join(command)}  "
+            f"[dim]provider:[/] {provider}  "
+            f"[dim]max-tries:[/] {effective_max}",
+            border_style="blue",
+        )
+    )
+
+    exit_code = _do_fix_cycle(
+        command,
+        cwd=cwd,
+        max_tries=effective_max,
+        provider=provider,
+        model=model,
+        dry_run=dry_run,
+        focus_file=focus_file,
+        verbose=verbose,
+    )
+
+    sys.exit(exit_code)