myverdict 0.1.0__tar.gz

myverdict-0.1.0/PKG-INFO

@@ -0,0 +1,72 @@
+Metadata-Version: 2.4
+Name: myverdict
+Version: 0.1.0
+Summary: A lie detector for AI coding agents: audits diffs and traces what actually runs.
+Author: verdict contributors
+License: MIT
+Project-URL: Homepage, https://github.com/nshah271/verdict
+Project-URL: Repository, https://github.com/nshah271/verdict
+Project-URL: Issues, https://github.com/nshah271/verdict/issues
+Keywords: ai,code-review,static-analysis,lie-detector,agents,claude,bob,mcp
+Classifier: Development Status :: 4 - Beta
+Classifier: Intended Audience :: Developers
+Classifier: Topic :: Software Development :: Quality Assurance
+Classifier: Topic :: Software Development :: Testing
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+Requires-Dist: mcp>=1.0.0
+Requires-Dist: click>=8.1
+Requires-Dist: jedi>=0.19
+Provides-Extra: dev
+Requires-Dist: ruff; extra == "dev"
+Requires-Dist: pytest; extra == "dev"
+Requires-Dist: pytest-asyncio; extra == "dev"
+Requires-Dist: pre-commit; extra == "dev"
+
+# verdict
+
+A lie detector for AI coding agents. Audits an AI-generated diff statically and traces what actually runs when the tests execute, then returns a single scorecard: `PASS`, `SUSPICIOUS`, or `LIED`.
+
+Built for the IBM Bob hackathon (May 2026). Repo bootstrap in progress; the real README lands as part of P3.5.
+
+## Install
+
+```bash
+pip install myverdict
+```
+
+The PyPI package is named `myverdict` (the shorter `verdict-ai` slot was taken by an unrelated project before we shipped). The Python import is still `import verdict` and the CLI is still `verdict`.
+
+## Quick start with IBM Bob
+
+```bash
+# Install verdict's MCP server and Custom Mode globally so Bob sees them
+# in every project on this machine:
+verdict mcp-install --global
+verdict bob-mode-install --global
+
+# Restart Bob, then in any project switch to "Verifier" mode after a
+# coding session or type /verify for a one-shot audit.
+```
+
+Drop `--global` to install per-project under `.bob/` instead.
+
+## Status
+
+| Priority | Owner | Status |
+|----------|-------|--------|
+| P0.1 foundation (diff + AST) | Neel | not started |
+| P0.2 dead function detection | Jacob | not started |
+| P0.3 vacuous test detection | Alexie | not started |
+| P0.4 CLI + scorecard | Neel | not started |
+| P1.1 execution tracer | Neel | not started |
+| P1.2 MCP server | Ben | not started |
+
+See `verdict-spec.md` and `TEAM.md` (local to the team, not in this repo) for the full plan.

myverdict-0.1.0/README.md

@@ -0,0 +1,40 @@
+# verdict
+
+A lie detector for AI coding agents. Audits an AI-generated diff statically and traces what actually runs when the tests execute, then returns a single scorecard: `PASS`, `SUSPICIOUS`, or `LIED`.
+
+Built for the IBM Bob hackathon (May 2026). Repo bootstrap in progress; the real README lands as part of P3.5.
+
+## Install
+
+```bash
+pip install myverdict
+```
+
+The PyPI package is named `myverdict` (the shorter `verdict-ai` slot was taken by an unrelated project before we shipped). The Python import is still `import verdict` and the CLI is still `verdict`.
+
+## Quick start with IBM Bob
+
+```bash
+# Install verdict's MCP server and Custom Mode globally so Bob sees them
+# in every project on this machine:
+verdict mcp-install --global
+verdict bob-mode-install --global
+
+# Restart Bob, then in any project switch to "Verifier" mode after a
+# coding session or type /verify for a one-shot audit.
+```
+
+Drop `--global` to install per-project under `.bob/` instead.
+
+## Status
+
+| Priority | Owner | Status |
+|----------|-------|--------|
+| P0.1 foundation (diff + AST) | Neel | not started |
+| P0.2 dead function detection | Jacob | not started |
+| P0.3 vacuous test detection | Alexie | not started |
+| P0.4 CLI + scorecard | Neel | not started |
+| P1.1 execution tracer | Neel | not started |
+| P1.2 MCP server | Ben | not started |
+
+See `verdict-spec.md` and `TEAM.md` (local to the team, not in this repo) for the full plan.

myverdict-0.1.0/myverdict.egg-info/PKG-INFO

@@ -0,0 +1,72 @@
+Metadata-Version: 2.4
+Name: myverdict
+Version: 0.1.0
+Summary: A lie detector for AI coding agents: audits diffs and traces what actually runs.
+Author: verdict contributors
+License: MIT
+Project-URL: Homepage, https://github.com/nshah271/verdict
+Project-URL: Repository, https://github.com/nshah271/verdict
+Project-URL: Issues, https://github.com/nshah271/verdict/issues
+Keywords: ai,code-review,static-analysis,lie-detector,agents,claude,bob,mcp
+Classifier: Development Status :: 4 - Beta
+Classifier: Intended Audience :: Developers
+Classifier: Topic :: Software Development :: Quality Assurance
+Classifier: Topic :: Software Development :: Testing
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+Requires-Dist: mcp>=1.0.0
+Requires-Dist: click>=8.1
+Requires-Dist: jedi>=0.19
+Provides-Extra: dev
+Requires-Dist: ruff; extra == "dev"
+Requires-Dist: pytest; extra == "dev"
+Requires-Dist: pytest-asyncio; extra == "dev"
+Requires-Dist: pre-commit; extra == "dev"
+
+# verdict
+
+A lie detector for AI coding agents. Audits an AI-generated diff statically and traces what actually runs when the tests execute, then returns a single scorecard: `PASS`, `SUSPICIOUS`, or `LIED`.
+
+Built for the IBM Bob hackathon (May 2026). Repo bootstrap in progress; the real README lands as part of P3.5.
+
+## Install
+
+```bash
+pip install myverdict
+```
+
+The PyPI package is named `myverdict` (the shorter `verdict-ai` slot was taken by an unrelated project before we shipped). The Python import is still `import verdict` and the CLI is still `verdict`.
+
+## Quick start with IBM Bob
+
+```bash
+# Install verdict's MCP server and Custom Mode globally so Bob sees them
+# in every project on this machine:
+verdict mcp-install --global
+verdict bob-mode-install --global
+
+# Restart Bob, then in any project switch to "Verifier" mode after a
+# coding session or type /verify for a one-shot audit.
+```
+
+Drop `--global` to install per-project under `.bob/` instead.
+
+## Status
+
+| Priority | Owner | Status |
+|----------|-------|--------|
+| P0.1 foundation (diff + AST) | Neel | not started |
+| P0.2 dead function detection | Jacob | not started |
+| P0.3 vacuous test detection | Alexie | not started |
+| P0.4 CLI + scorecard | Neel | not started |
+| P1.1 execution tracer | Neel | not started |
+| P1.2 MCP server | Ben | not started |
+
+See `verdict-spec.md` and `TEAM.md` (local to the team, not in this repo) for the full plan.

myverdict-0.1.0/myverdict.egg-info/SOURCES.txt

@@ -0,0 +1,40 @@
+README.md
+pyproject.toml
+myverdict.egg-info/PKG-INFO
+myverdict.egg-info/SOURCES.txt
+myverdict.egg-info/dependency_links.txt
+myverdict.egg-info/entry_points.txt
+myverdict.egg-info/requires.txt
+myverdict.egg-info/top_level.txt
+tests/test_ast_utils.py
+tests/test_bob_integration.py
+tests/test_bob_mode_install.py
+tests/test_cli.py
+tests/test_dead_functions.py
+tests/test_diff.py
+tests/test_hallucinated_api.py
+tests/test_mcp_server.py
+tests/test_report.py
+tests/test_suppressed_exc.py
+tests/test_trace.py
+tests/test_vacuous_tests.py
+verdict/__init__.py
+verdict/_coverage_plugin.py
+verdict/_tracer_plugin.py
+verdict/ast_utils.py
+verdict/cli.py
+verdict/dashboard_cmd.py
+verdict/diff.py
+verdict/mcp_server.py
+verdict/report.py
+verdict/types.py
+verdict/bob_integration/__init__.py
+verdict/bob_integration/slash_commands/__init__.py
+verdict/checks/__init__.py
+verdict/checks/coverage_delta.py
+verdict/checks/dead_functions.py
+verdict/checks/hallucinated_api.py
+verdict/checks/phantom_files.py
+verdict/checks/suppressed_exc.py
+verdict/checks/trace.py
+verdict/checks/vacuous_tests.py

myverdict-0.1.0/myverdict.egg-info/dependency_links.txt

@@ -0,0 +1 @@
+

myverdict-0.1.0/myverdict.egg-info/entry_points.txt

@@ -0,0 +1,3 @@
+[console_scripts]
+verdict = verdict.cli:cli
+verdict-mcp = verdict.mcp_server:entrypoint

myverdict-0.1.0/myverdict.egg-info/requires.txt

@@ -0,0 +1,9 @@
+mcp>=1.0.0
+click>=8.1
+jedi>=0.19
+
+[dev]
+ruff
+pytest
+pytest-asyncio
+pre-commit

myverdict-0.1.0/myverdict.egg-info/top_level.txt

@@ -0,0 +1,2 @@
+verdict
+verdict-vscode

myverdict-0.1.0/pyproject.toml

@@ -0,0 +1,49 @@
+[build-system]
+requires = ["setuptools>=68"]
+build-backend = "setuptools.build_meta"
+
+[project]
+name = "myverdict"
+version = "0.1.0"
+description = "A lie detector for AI coding agents: audits diffs and traces what actually runs."
+readme = "README.md"
+requires-python = ">=3.10"
+license = { text = "MIT" }
+authors = [{ name = "verdict contributors" }]
+keywords = ["ai", "code-review", "static-analysis", "lie-detector", "agents", "claude", "bob", "mcp"]
+classifiers = [
+  "Development Status :: 4 - Beta",
+  "Intended Audience :: Developers",
+  "Topic :: Software Development :: Quality Assurance",
+  "Topic :: Software Development :: Testing",
+  "Programming Language :: Python :: 3",
+  "Programming Language :: Python :: 3.10",
+  "Programming Language :: Python :: 3.11",
+  "Programming Language :: Python :: 3.12",
+  "Programming Language :: Python :: 3.13",
+  "License :: OSI Approved :: MIT License",
+  "Operating System :: OS Independent",
+]
+dependencies = ["mcp>=1.0.0", "click>=8.1", "jedi>=0.19"]
+
+[project.urls]
+Homepage = "https://github.com/nshah271/verdict"
+Repository = "https://github.com/nshah271/verdict"
+Issues = "https://github.com/nshah271/verdict/issues"
+
+[project.optional-dependencies]
+dev = ["ruff", "pytest", "pytest-asyncio", "pre-commit"]
+
+[project.scripts]
+verdict = "verdict.cli:cli"
+verdict-mcp = "verdict.mcp_server:entrypoint"
+
+[tool.setuptools.packages.find]
+include = ["verdict*"]
+
+[tool.ruff]
+line-length = 100
+target-version = "py310"
+
+[tool.ruff.lint]
+select = ["E", "F", "I", "B", "UP"]

myverdict-0.1.0/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+

myverdict-0.1.0/tests/test_ast_utils.py

@@ -0,0 +1,260 @@
+"""Tests for AST analysis functionality."""
+
+import tempfile
+from pathlib import Path
+
+from verdict.ast_utils import get_added_functions, get_added_tests
+from verdict.types import ChangedFile
+
+
+def test_get_added_functions_basic():
+    """Test extracting added functions from a Python file."""
+    changed_file: ChangedFile = {
+        "path": "tests/fixtures/sample_module.py",
+        "added_lines": [8, 14, 21, 48, 51, 55],  # regular_function, async_function, simple_fixture, SampleClass, __init__, method_one
+        "removed_lines": [],
+    }
+
+    added_functions = get_added_functions([changed_file], repo_root=".")
+
+    # Convert to dict for easier lookup
+    funcs_by_name = {f["name"]: f for f in added_functions}
+
+    # Check regular function
+    assert "regular_function" in funcs_by_name
+    regular = funcs_by_name["regular_function"]
+    assert regular["file"] == "tests/fixtures/sample_module.py"
+    assert regular["line"] == 8
+    assert regular["end_line"] == 10
+    assert regular["is_test"] is True  # In tests/ directory
+    assert regular["decorators"] == []
+
+    # Check async function
+    assert "async_function" in funcs_by_name
+    async_func = funcs_by_name["async_function"]
+    assert async_func["line"] == 14
+    assert async_func["is_test"] is True  # In tests/ directory
+
+    # Check function with decorator
+    assert "simple_fixture" in funcs_by_name
+    fixture = funcs_by_name["simple_fixture"]
+    assert fixture["line"] == 21
+    assert fixture["decorators"] == ["pytest.fixture"]
+
+    # Check class
+    assert "SampleClass" in funcs_by_name
+    cls = funcs_by_name["SampleClass"]
+    assert cls["line"] == 48
+    assert cls["is_test"] is True  # In tests/ directory
+
+    # Check method
+    assert "method_one" in funcs_by_name
+    method = funcs_by_name["method_one"]
+    assert method["line"] == 55
+    assert method["is_test"] is True  # In tests/ directory
+
+
+def test_decorator_with_call_args():
+    """Test that decorators with call args are extracted correctly."""
+    changed_file: ChangedFile = {
+        "path": "tests/fixtures/sample_module.py",
+        "added_lines": [28],  # complex_fixture function def line
+        "removed_lines": [],
+    }
+
+    added_functions = get_added_functions([changed_file], repo_root=".")
+
+    funcs_by_name = {f["name"]: f for f in added_functions}
+    assert "complex_fixture" in funcs_by_name
+    fixture = funcs_by_name["complex_fixture"]
+    # Should extract just the decorator name, not the call args
+    assert fixture["decorators"] == ["pytest.fixture"]
+
+
+def test_multiple_decorators():
+    """Test function with multiple decorators."""
+    changed_file: ChangedFile = {
+        "path": "tests/fixtures/sample_module.py",
+        "added_lines": [36],  # test_with_multiple_decorators function def line
+        "removed_lines": [],
+    }
+
+    added_functions = get_added_functions([changed_file], repo_root=".")
+
+    funcs_by_name = {f["name"]: f for f in added_functions}
+    assert "test_with_multiple_decorators" in funcs_by_name
+    test_func = funcs_by_name["test_with_multiple_decorators"]
+    assert test_func["is_test"] is True  # name starts with test_
+    assert "pytest.mark.parametrize" in test_func["decorators"]
+    assert "pytest.mark.slow" in test_func["decorators"]
+
+
+def test_is_test_detection_by_name():
+    """Test that functions starting with test_ are marked as tests."""
+    changed_file: ChangedFile = {
+        "path": "tests/fixtures/sample_module.py",
+        "added_lines": [42],  # test_simple_case
+        "removed_lines": [],
+    }
+
+    added_functions = get_added_functions([changed_file], repo_root=".")
+
+    funcs_by_name = {f["name"]: f for f in added_functions}
+    assert "test_simple_case" in funcs_by_name
+    test_func = funcs_by_name["test_simple_case"]
+    assert test_func["is_test"] is True
+
+
+def test_is_test_detection_by_path():
+    """Test that functions in test files are marked as tests."""
+    changed_file: ChangedFile = {
+        "path": "tests/fixtures/sample_module.py",  # Contains "tests/"
+        "added_lines": [91],  # helper_function (not named test_*)
+        "removed_lines": [],
+    }
+
+    added_functions = get_added_functions([changed_file], repo_root=".")
+
+    funcs_by_name = {f["name"]: f for f in added_functions}
+    assert "helper_function" in funcs_by_name
+    helper = funcs_by_name["helper_function"]
+    # Should be marked as test because path contains "tests/"
+    assert helper["is_test"] is True
+
+
+def test_class_and_methods_both_appear():
+    """Test that both class and its methods appear as separate entries."""
+    changed_file: ChangedFile = {
+        "path": "tests/fixtures/sample_module.py",
+        "added_lines": [48, 51, 55, 59],  # SampleClass, __init__, method_one, async_method
+        "removed_lines": [],
+    }
+
+    added_functions = get_added_functions([changed_file], repo_root=".")
+
+    funcs_by_name = {f["name"]: f for f in added_functions}
+
+    # Class should appear
+    assert "SampleClass" in funcs_by_name
+
+    # Methods should also appear as separate entries
+    assert "__init__" in funcs_by_name
+    assert "method_one" in funcs_by_name
+    assert "async_method" in funcs_by_name
+
+
+def test_async_function_detected():
+    """Test that async functions are properly detected."""
+    changed_file: ChangedFile = {
+        "path": "tests/fixtures/sample_module.py",
+        "added_lines": [14, 59, 84],  # async_function, async_method, test_async_with_decorators
+        "removed_lines": [],
+    }
+
+    added_functions = get_added_functions([changed_file], repo_root=".")
+
+    funcs_by_name = {f["name"]: f for f in added_functions}
+
+    # All three async functions should be detected
+    assert "async_function" in funcs_by_name
+    assert "async_method" in funcs_by_name
+    assert "test_async_with_decorators" in funcs_by_name
+
+
+def test_syntax_error_skipped():
+    """Test that files with syntax errors are skipped without crashing."""
+    # Create a temporary file with invalid Python syntax
+    with tempfile.NamedTemporaryFile(mode="w", suffix=".py", delete=False) as f:
+        f.write("def broken_function(\n    # Missing closing paren and body\n")
+        temp_path = f.name
+
+    try:
+        changed_file: ChangedFile = {
+            "path": temp_path,
+            "added_lines": [1],
+            "removed_lines": [],
+        }
+
+        # Should not crash, just skip the file
+        added_functions = get_added_functions([changed_file], repo_root=".")
+        assert added_functions == []
+    finally:
+        Path(temp_path).unlink()
+
+
+def test_non_python_file_skipped():
+    """Test that non-Python files are skipped."""
+    changed_file: ChangedFile = {
+        "path": "README.md",
+        "added_lines": [1, 2, 3],
+        "removed_lines": [],
+    }
+
+    added_functions = get_added_functions([changed_file], repo_root=".")
+    assert added_functions == []
+
+
+def test_empty_added_lines():
+    """Test that files with no added lines return no functions."""
+    changed_file: ChangedFile = {
+        "path": "tests/fixtures/sample_module.py",
+        "added_lines": [],  # No added lines
+        "removed_lines": [1, 2, 3],
+    }
+
+    added_functions = get_added_functions([changed_file], repo_root=".")
+    assert added_functions == []
+
+
+def test_get_added_tests_filter():
+    """Test that get_added_tests correctly filters test functions."""
+    changed_file: ChangedFile = {
+        "path": "tests/fixtures/sample_module.py",
+        "added_lines": [8, 42, 91],  # regular_function, test_simple_case, helper_function
+        "removed_lines": [],
+    }
+
+    added_functions = get_added_functions([changed_file], repo_root=".")
+    test_functions = get_added_tests(added_functions)
+
+    # Should only include test functions
+    test_names = {f["name"] for f in test_functions}
+    assert "test_simple_case" in test_names
+    assert "helper_function" in test_names  # In tests/ directory
+    assert "regular_function" in test_names  # Also a test because in tests/ directory
+
+
+def test_nested_class():
+    """Test that nested classes are detected."""
+    changed_file: ChangedFile = {
+        "path": "tests/fixtures/sample_module.py",
+        "added_lines": [70, 73, 76],  # OuterClass, InnerClass, inner_method
+        "removed_lines": [],
+    }
+
+    added_functions = get_added_functions([changed_file], repo_root=".")
+
+    funcs_by_name = {f["name"]: f for f in added_functions}
+
+    # Both outer and inner classes should appear
+    assert "OuterClass" in funcs_by_name
+    assert "InnerClass" in funcs_by_name
+    assert "inner_method" in funcs_by_name
+
+
+def test_property_decorator():
+    """Test that property decorators are extracted correctly."""
+    changed_file: ChangedFile = {
+        "path": "tests/fixtures/sample_module.py",
+        "added_lines": [64],  # computed_property with @property
+        "removed_lines": [],
+    }
+
+    added_functions = get_added_functions([changed_file], repo_root=".")
+
+    funcs_by_name = {f["name"]: f for f in added_functions}
+    assert "computed_property" in funcs_by_name
+    prop = funcs_by_name["computed_property"]
+    assert "property" in prop["decorators"]
+
+# Made with Bob