altqa-cli 0.1.0__tar.gz

altqa_cli-0.1.0/.gitignore

@@ -0,0 +1,34 @@
+# Python
+__pycache__/
+*.py[cod]
+*.egg-info/
+*.egg
+dist/
+build/
+*.whl
+
+# Virtual env
+.venv/
+venv/
+env/
+
+# AltQA runtime artifacts
+logs/
+*.png
+altqa.json
+
+# IDE
+.vscode/
+.idea/
+*.swp
+*.swo
+.cursor/
+
+# OS
+.DS_Store
+Thumbs.db
+
+# Testing
+.pytest_cache/
+htmlcov/
+.coverage

altqa_cli-0.1.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Rohit Jangral
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

altqa_cli-0.1.0/PKG-INFO

@@ -0,0 +1,206 @@
+Metadata-Version: 2.4
+Name: altqa-cli
+Version: 0.1.0
+Summary: AI-powered QA automation CLI — tests your app from Jira tickets, reports bugs back automatically
+Project-URL: Homepage, https://gitlab.com/rohithyphen05/altqa
+Project-URL: Repository, https://gitlab.com/rohithyphen05/altqa
+Project-URL: Issues, https://gitlab.com/rohithyphen05/altqa/-/issues
+Author-email: Rohit Jangral <rohitnishantjangral@gmail.com>
+License-Expression: MIT
+License-File: LICENSE
+Keywords: ai,automation,cli,jira,playwright,qa,testing
+Classifier: Development Status :: 4 - Beta
+Classifier: Environment :: Console
+Classifier: Intended Audience :: Developers
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: Software Development :: Quality Assurance
+Classifier: Topic :: Software Development :: Testing
+Classifier: Typing :: Typed
+Requires-Python: >=3.11
+Requires-Dist: agno>=2.0
+Requires-Dist: anthropic>=0.20
+Requires-Dist: httpx>=0.25
+Requires-Dist: jira>=3.5
+Requires-Dist: openai>=1.10
+Requires-Dist: openpyxl>=3.1
+Requires-Dist: playwright>=1.40
+Requires-Dist: pydantic>=2.0
+Requires-Dist: pyyaml>=6.0
+Requires-Dist: rich>=13.0
+Requires-Dist: typer>=0.9
+Description-Content-Type: text/markdown
+
+# AltQA
+
+**AI-powered QA automation from your terminal.** AltQA reads Jira tickets, runs browser tests, detects bugs, and reports them back to Jira — like having an autonomous QA engineer on your team.
+
+```
+pip install altqa        # or: uv pip install altqa
+altqa init               # one-time setup (asks for keys, crawls your app)
+altqa run JIRA-123       # test a ticket end-to-end
+```
+
+---
+
+## How It Works
+
+```
+altqa run PROJ-42
+```
+
+1. Fetches the Jira ticket
+2. Checks for attached test case files (Excel/CSV) — **these always take priority**
+3. If no test cases attached, falls back to AI analysis of the ticket description
+4. AI converts test cases into executable browser flows
+5. Launches a real browser and runs every step
+6. Monitors for console errors, API failures, JS exceptions, and memory leaks
+7. Analyses failures with AI and generates detailed bug reports
+8. Creates sub-task bug tickets on Jira with screenshots as proof
+9. Cleans up screenshots from your project after upload
+
+---
+
+## Installation
+
+**Requirements:** Python 3.11+
+
+```bash
+# With pip
+pip install altqa
+
+# With uv (recommended)
+uv pip install altqa
+```
+
+Then initialize in your project directory:
+
+```bash
+cd your-project/
+altqa init
+```
+
+The wizard will:
+1. Ask for your app URL (e.g. `http://localhost:3000`)
+2. Ask for LLM provider & API key (OpenAI, Anthropic, or Ollama for local)
+3. Ask for Jira credentials (base URL, project key, email, API token)
+4. Ask for browser preference (Chromium, Firefox, or WebKit)
+5. Install the Playwright browser binary automatically
+6. Crawl your application and build a navigation graph
+7. Auto-generate starter test flows from discovered pages
+
+After init, you just run `altqa run JIRA-123` — that's it.
+
+---
+
+## Commands
+
+| Command | Description |
+|---|---|
+| `altqa init` | Interactive setup wizard |
+| `altqa run JIRA-123` | Full pipeline: fetch ticket, test, report bugs |
+| `altqa run JIRA-123 --dry-run` | Show the test plan without executing |
+| `altqa run-local file.xlsx` | Run tests from local Excel/CSV files (no Jira) |
+| `altqa crawl` | Discover app routes and build navigation graph |
+| `altqa run-flow login` | Execute a specific YAML test flow |
+| `altqa flows list` | List all available flows |
+| `altqa generate-flows` | Auto-generate YAML flows from the navigation graph |
+| `altqa generate-flows --ai` | AI-powered flow generation (happy paths + edge cases) |
+| `altqa test "login and add a product"` | Generate and run a test from plain English |
+| `altqa chat` | Interactive AI QA session (REPL) |
+| `altqa audit` | AI accessibility audit (WCAG compliance) |
+| `altqa config show` | Display current configuration |
+
+---
+
+## AI-Powered Features
+
+### Core Pipeline
+- **Jira-aware testing** — reads ticket descriptions and attached test case files (Excel/CSV)
+- **AI test interpretation** — converts human-written test steps into browser actions
+- **AI failure analysis** — generates bug reports with root cause, fix suggestions, and regression tests
+- **Automatic bug filing** — creates Jira sub-tasks with screenshots and detailed descriptions
+
+### Runtime Health Monitoring
+- Console errors and JS exceptions
+- API failures and network errors
+- Memory leaks and performance issues
+- Page crashes and security warnings
+
+### Advanced AI Features
+- **Plain-text testing** — `altqa test "login with wrong password and verify error"`
+- **Visual AI review** — screenshot analysis for UI/layout bugs using vision models
+- **AI flow generation** — generates comprehensive test flows from your app's navigation graph
+- **Smart selector healing** — auto-fixes broken CSS selectors when elements change
+- **Conversational QA** — `altqa chat` for interactive testing sessions
+- **AI test data generation** — realistic form data (valid, invalid, edge cases, security payloads)
+- **Root cause clustering** — groups test failures by probable root cause
+- **Accessibility audit** — WCAG compliance checking across your app
+- **Enhanced bug descriptions** — AI-generated fix suggestions, user impact analysis, and regression tests
+- **Natural language assertions** — write assertions in plain English in your YAML flows
+
+---
+
+## YAML Test Flows
+
+Define reusable test flows:
+
+```yaml
+name: login
+description: Log in with valid credentials
+steps:
+  - action: navigate
+    url: "{{app_url}}/login"
+  - action: fill
+    selector: "#username"
+    value: "{{username}}"
+  - action: fill
+    selector: "#password"
+    value: "{{password}}"
+  - action: click
+    selector: "button[type=submit]"
+  - action: wait_for
+    selector: ".dashboard"
+assertions:
+  - type: url_contains
+    value: "/dashboard"
+```
+
+Supports variable interpolation (`{{var}}`), flow includes, and natural language assertions.
+
+---
+
+## Architecture
+
+```
+CLI (Typer + Rich)
+  |
+  +-- Config (Pydantic schemas, altqa.json)
+  +-- AI Agents (Agno framework, multi-provider LLM)
+  +-- Flow Engine (YAML parser, variable resolver, assertions)
+  +-- Browser (Playwright — deterministic actions, not AI-controlled)
+  +-- Crawler (BFS discovery, navigation graph)
+  +-- Jira Integration (issue CRUD, attachments, comments)
+  +-- Pipeline Orchestrator (ties everything together)
+```
+
+**Design principle:** Browser actions are deterministic (click, fill, navigate). AI handles *intelligence* — planning, analysis, and reporting. This avoids flaky, non-reproducible tests.
+
+---
+
+## Supported LLM Providers
+
+| Provider | Models | Notes |
+|---|---|---|
+| OpenAI | gpt-4o, gpt-4o-mini, o1, etc. | Best overall experience |
+| Anthropic | claude-sonnet-4-20250514, claude-3.5-haiku, etc. | Great for analysis |
+| Ollama | llama3, mistral, codellama, etc. | Fully local, no API key |
+
+---
+
+## License
+
+MIT

altqa_cli-0.1.0/README.md

@@ -0,0 +1,170 @@
+# AltQA
+
+**AI-powered QA automation from your terminal.** AltQA reads Jira tickets, runs browser tests, detects bugs, and reports them back to Jira — like having an autonomous QA engineer on your team.
+
+```
+pip install altqa        # or: uv pip install altqa
+altqa init               # one-time setup (asks for keys, crawls your app)
+altqa run JIRA-123       # test a ticket end-to-end
+```
+
+---
+
+## How It Works
+
+```
+altqa run PROJ-42
+```
+
+1. Fetches the Jira ticket
+2. Checks for attached test case files (Excel/CSV) — **these always take priority**
+3. If no test cases attached, falls back to AI analysis of the ticket description
+4. AI converts test cases into executable browser flows
+5. Launches a real browser and runs every step
+6. Monitors for console errors, API failures, JS exceptions, and memory leaks
+7. Analyses failures with AI and generates detailed bug reports
+8. Creates sub-task bug tickets on Jira with screenshots as proof
+9. Cleans up screenshots from your project after upload
+
+---
+
+## Installation
+
+**Requirements:** Python 3.11+
+
+```bash
+# With pip
+pip install altqa
+
+# With uv (recommended)
+uv pip install altqa
+```
+
+Then initialize in your project directory:
+
+```bash
+cd your-project/
+altqa init
+```
+
+The wizard will:
+1. Ask for your app URL (e.g. `http://localhost:3000`)
+2. Ask for LLM provider & API key (OpenAI, Anthropic, or Ollama for local)
+3. Ask for Jira credentials (base URL, project key, email, API token)
+4. Ask for browser preference (Chromium, Firefox, or WebKit)
+5. Install the Playwright browser binary automatically
+6. Crawl your application and build a navigation graph
+7. Auto-generate starter test flows from discovered pages
+
+After init, you just run `altqa run JIRA-123` — that's it.
+
+---
+
+## Commands
+
+| Command | Description |
+|---|---|
+| `altqa init` | Interactive setup wizard |
+| `altqa run JIRA-123` | Full pipeline: fetch ticket, test, report bugs |
+| `altqa run JIRA-123 --dry-run` | Show the test plan without executing |
+| `altqa run-local file.xlsx` | Run tests from local Excel/CSV files (no Jira) |
+| `altqa crawl` | Discover app routes and build navigation graph |
+| `altqa run-flow login` | Execute a specific YAML test flow |
+| `altqa flows list` | List all available flows |
+| `altqa generate-flows` | Auto-generate YAML flows from the navigation graph |
+| `altqa generate-flows --ai` | AI-powered flow generation (happy paths + edge cases) |
+| `altqa test "login and add a product"` | Generate and run a test from plain English |
+| `altqa chat` | Interactive AI QA session (REPL) |
+| `altqa audit` | AI accessibility audit (WCAG compliance) |
+| `altqa config show` | Display current configuration |
+
+---
+
+## AI-Powered Features
+
+### Core Pipeline
+- **Jira-aware testing** — reads ticket descriptions and attached test case files (Excel/CSV)
+- **AI test interpretation** — converts human-written test steps into browser actions
+- **AI failure analysis** — generates bug reports with root cause, fix suggestions, and regression tests
+- **Automatic bug filing** — creates Jira sub-tasks with screenshots and detailed descriptions
+
+### Runtime Health Monitoring
+- Console errors and JS exceptions
+- API failures and network errors
+- Memory leaks and performance issues
+- Page crashes and security warnings
+
+### Advanced AI Features
+- **Plain-text testing** — `altqa test "login with wrong password and verify error"`
+- **Visual AI review** — screenshot analysis for UI/layout bugs using vision models
+- **AI flow generation** — generates comprehensive test flows from your app's navigation graph
+- **Smart selector healing** — auto-fixes broken CSS selectors when elements change
+- **Conversational QA** — `altqa chat` for interactive testing sessions
+- **AI test data generation** — realistic form data (valid, invalid, edge cases, security payloads)
+- **Root cause clustering** — groups test failures by probable root cause
+- **Accessibility audit** — WCAG compliance checking across your app
+- **Enhanced bug descriptions** — AI-generated fix suggestions, user impact analysis, and regression tests
+- **Natural language assertions** — write assertions in plain English in your YAML flows
+
+---
+
+## YAML Test Flows
+
+Define reusable test flows:
+
+```yaml
+name: login
+description: Log in with valid credentials
+steps:
+  - action: navigate
+    url: "{{app_url}}/login"
+  - action: fill
+    selector: "#username"
+    value: "{{username}}"
+  - action: fill
+    selector: "#password"
+    value: "{{password}}"
+  - action: click
+    selector: "button[type=submit]"
+  - action: wait_for
+    selector: ".dashboard"
+assertions:
+  - type: url_contains
+    value: "/dashboard"
+```
+
+Supports variable interpolation (`{{var}}`), flow includes, and natural language assertions.
+
+---
+
+## Architecture
+
+```
+CLI (Typer + Rich)
+  |
+  +-- Config (Pydantic schemas, altqa.json)
+  +-- AI Agents (Agno framework, multi-provider LLM)
+  +-- Flow Engine (YAML parser, variable resolver, assertions)
+  +-- Browser (Playwright — deterministic actions, not AI-controlled)
+  +-- Crawler (BFS discovery, navigation graph)
+  +-- Jira Integration (issue CRUD, attachments, comments)
+  +-- Pipeline Orchestrator (ties everything together)
+```
+
+**Design principle:** Browser actions are deterministic (click, fill, navigate). AI handles *intelligence* — planning, analysis, and reporting. This avoids flaky, non-reproducible tests.
+
+---
+
+## Supported LLM Providers
+
+| Provider | Models | Notes |
+|---|---|---|
+| OpenAI | gpt-4o, gpt-4o-mini, o1, etc. | Best overall experience |
+| Anthropic | claude-sonnet-4-20250514, claude-3.5-haiku, etc. | Great for analysis |
+| Ollama | llama3, mistral, codellama, etc. | Fully local, no API key |
+
+---
+
+## License
+
+MIT

altqa_cli-0.1.0/pyproject.toml

@@ -0,0 +1,63 @@
+[project]
+name = "altqa-cli"
+version = "0.1.0"
+description = "AI-powered QA automation CLI — tests your app from Jira tickets, reports bugs back automatically"
+readme = "README.md"
+requires-python = ">=3.11"
+license = "MIT"
+authors = [
+    { name = "Rohit Jangral", email = "rohitnishantjangral@gmail.com" },
+]
+keywords = ["qa", "testing", "automation", "jira", "ai", "playwright", "cli"]
+classifiers = [
+    "Development Status :: 4 - Beta",
+    "Environment :: Console",
+    "Intended Audience :: Developers",
+    "License :: OSI Approved :: MIT License",
+    "Programming Language :: Python :: 3",
+    "Programming Language :: Python :: 3.11",
+    "Programming Language :: Python :: 3.12",
+    "Programming Language :: Python :: 3.13",
+    "Topic :: Software Development :: Quality Assurance",
+    "Topic :: Software Development :: Testing",
+    "Typing :: Typed",
+]
+dependencies = [
+    "typer>=0.9",
+    "rich>=13.0",
+    "playwright>=1.40",
+    "pydantic>=2.0",
+    "agno>=2.0",
+    "pyyaml>=6.0",
+    "httpx>=0.25",
+    "openpyxl>=3.1",
+    "openai>=1.10",
+    "anthropic>=0.20",
+    "jira>=3.5",
+]
+
+[project.urls]
+Homepage = "https://gitlab.com/rohithyphen05/altqa"
+Repository = "https://gitlab.com/rohithyphen05/altqa"
+Issues = "https://gitlab.com/rohithyphen05/altqa/-/issues"
+
+[project.scripts]
+altqa = "altqa.cli.main:app"
+
+[build-system]
+requires = ["hatchling"]
+build-backend = "hatchling.build"
+
+[tool.hatch.build.targets.wheel]
+packages = ["src/altqa"]
+
+[tool.hatch.build.targets.sdist]
+include = ["src/altqa", "README.md", "LICENSE"]
+
+[dependency-groups]
+dev = [
+    "fastapi>=0.135.1",
+    "jinja2>=3.1.6",
+    "uvicorn>=0.42.0",
+    "pytest>=8.0",
+]

altqa_cli-0.1.0/src/altqa/__init__.py

@@ -0,0 +1,3 @@
+"""AltQA — AI-powered QA automation CLI."""
+
+__version__ = "0.1.0"

altqa_cli-0.1.0/src/altqa/agents/accessibility_auditor.py

@@ -0,0 +1,125 @@
+"""AccessibilityAuditorAgent — AI-powered WCAG accessibility auditing.
+
+Crawls pages and uses AI to identify accessibility violations, mapping
+them to WCAG 2.1 criteria with concrete fix suggestions.
+"""
+
+from __future__ import annotations
+
+import json
+import logging
+from pathlib import Path
+from typing import Any
+
+from agno.agent import Agent
+from pydantic import BaseModel, Field
+
+from altqa.config.models import resolve_model
+from altqa.config.schema import AltQAConfig
+
+log = logging.getLogger("altqa.agents")
+
+_PROMPT_PATH = Path(__file__).parent / "prompts" / "accessibility_audit.md"
+
+
+class A11yIssue(BaseModel):
+    severity: str = "warning"
+    wcag_criterion: str = ""
+    description: str = ""
+    element: str = ""
+    fix: str = ""
+
+
+class A11yAuditResult(BaseModel):
+    page_url: str = ""
+    score: str = "unknown"
+    issues: list[A11yIssue] = Field(default_factory=list)
+    summary: str = ""
+    passed_checks: list[str] = Field(default_factory=list)
+
+
+class AccessibilityAuditorAgent:
+    """Audit web pages for WCAG 2.1 accessibility compliance."""
+
+    def __init__(self, config: AltQAConfig) -> None:
+        self.config = config
+        self.model = resolve_model(config.llm)
+        self._system_prompt = _PROMPT_PATH.read_text()
+
+    def audit_html(self, html: str, page_url: str = "") -> A11yAuditResult:
+        """Audit raw HTML content for accessibility issues."""
+        html_snippet = html[:6000] if len(html) > 6000 else html
+
+        user_prompt = (
+            f"## Page to audit\n"
+            f"**URL:** {page_url}\n\n"
+            f"```html\n{html_snippet}\n```"
+        )
+
+        from agno.utils.log import logger as agno_logger
+        prev_handlers = agno_logger.handlers[:]
+        prev_propagate = agno_logger.propagate
+        agno_logger.handlers = [logging.NullHandler()]
+        agno_logger.propagate = False
+        try:
+            agent = Agent(
+                model=self.model,
+                instructions=[self._system_prompt],
+                markdown=False,
+            )
+            response = agent.run(user_prompt)
+            content = _clean(response.content or "{}")
+            data = json.loads(content)
+        except Exception as exc:
+            log.warning("Accessibility audit failed for %s: %s", page_url, exc)
+            return A11yAuditResult(page_url=page_url, summary=f"Audit failed: {exc}")
+        finally:
+            agno_logger.handlers = prev_handlers
+            agno_logger.propagate = prev_propagate
+
+        issues = [
+            A11yIssue(
+                severity=i.get("severity", "warning"),
+                wcag_criterion=i.get("wcag_criterion", ""),
+                description=i.get("description", ""),
+                element=i.get("element", ""),
+                fix=i.get("fix", ""),
+            )
+            for i in data.get("issues", [])
+        ]
+
+        return A11yAuditResult(
+            page_url=page_url,
+            score=data.get("score", "unknown"),
+            issues=issues,
+            summary=data.get("summary", ""),
+            passed_checks=data.get("passed_checks", []),
+        )
+
+    def audit_page(self, page, page_url: str = "") -> A11yAuditResult:
+        """Audit a live Playwright page."""
+        html = page.content()
+        url = page_url or page.url
+        return self.audit_html(html, url)
+
+    def audit_many(
+        self,
+        pages_html: list[tuple[str, str]],
+    ) -> list[A11yAuditResult]:
+        """Audit multiple pages. Each tuple is (html, page_url)."""
+        results: list[A11yAuditResult] = []
+        for html, url in pages_html:
+            result = self.audit_html(html, url)
+            results.append(result)
+            log.info("A11y audit %s: score=%s, %d issues", url, result.score, len(result.issues))
+        return results
+
+
+def _clean(content: str) -> str:
+    content = content.strip()
+    if content.startswith("```"):
+        first_newline = content.index("\n") if "\n" in content else 3
+        content = content[first_newline + 1:]
+    if content.endswith("```"):
+        content = content[:-3]
+    return content.strip()