@teevee98/synapse-hub 0.0.0-stage → 3.8.3
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.agents/agents/api-engineer.md +67 -0
- package/.agents/agents/failure-analyst.md +75 -0
- package/.agents/agents/live-explorer.md +70 -0
- package/.agents/agents/orchestrator.md +104 -0
- package/.agents/agents/perf-engineer.md +74 -0
- package/.agents/agents/pom-crafter.md +112 -0
- package/.agents/agents/quality-gatekeeper.md +87 -0
- package/.agents/agents/test-designer.md +73 -0
- package/.agents/agents/test-runner.md +67 -0
- package/.agents/rules/author-integrity-guard.md +33 -0
- package/.agents/rules/communication-style.md +18 -0
- package/.agents/rules/context-engineering.md +37 -0
- package/.agents/rules/git-push-protocol.md +33 -0
- package/.agents/rules/graphify.md +14 -0
- package/.agents/rules/lessons-learned.md +25 -0
- package/.agents/rules/mandatory-playwright-live.md +25 -0
- package/.agents/rules/mobile_appium_rules.md +43 -0
- package/.agents/rules/performance_testing_rules.md +35 -0
- package/.agents/rules/skill-precedence.md +29 -0
- package/.agents/rules/systematic-debugging.md +36 -0
- package/.agents/skills/actor-qa-swarm/SKILL.md +77 -0
- package/.agents/skills/actor-qa-swarm/examples/broker_sharding_sample.json +12 -0
- package/.agents/skills/agent-orchestration-multi-agent-optimize/SKILL.md +88 -0
- package/.agents/skills/agent-orchestration-multi-agent-optimize/examples/swarm_workload_config.json +15 -0
- package/.agents/skills/agentless-qa-repair/SKILL.md +69 -0
- package/.agents/skills/agentless-qa-repair/examples/healing_report_sample.json +17 -0
- package/.agents/skills/agentless-qa-repair/examples/three_phase_repair_workflow.md +40 -0
- package/.agents/skills/antigravity-test-sentinel/SKILL.md +63 -0
- package/.agents/skills/antigravity-test-sentinel/examples/dod_gate_policy.json +11 -0
- package/.agents/skills/antigravity-test-sentinel/examples/sprint_dod_enforcement.md +47 -0
- package/.agents/skills/api-network-mocking-interception/SKILL.md +142 -0
- package/.agents/skills/api-network-mocking-interception/examples/network_route_stub.json +9 -0
- package/.agents/skills/api-spec-to-e2e-matrix/SKILL.md +80 -0
- package/.agents/skills/api-spec-to-e2e-matrix/examples/sample_openapi.json +19 -0
- package/.agents/skills/architecture-decision-records/SKILL.md +64 -0
- package/.agents/skills/architecture-decision-records/examples/0001-record-architecture-decisions.md +12 -0
- package/.agents/skills/auth-session-and-cookie-manager/SKILL.md +75 -0
- package/.agents/skills/auth-session-and-cookie-manager/examples/multi_role_auth_matrix.md +70 -0
- package/.agents/skills/auth-session-and-cookie-manager/examples/storage_state_sample.json +11 -0
- package/.agents/skills/backend-load-and-stress-patterns/SKILL.md +85 -0
- package/.agents/skills/backend-load-and-stress-patterns/examples/k6_load_test_sample.js +13 -0
- package/.agents/skills/backend-load-and-stress-patterns/references/k6_load_template.js +82 -0
- package/.agents/skills/bats-testing-patterns/SKILL.md +100 -0
- package/.agents/skills/bats-testing-patterns/examples/cli_runner_test.bats +6 -0
- package/.agents/skills/bats-testing-patterns/resources/implementation-playbook.md +614 -0
- package/.agents/skills/clean-pom-crafter/SKILL.md +110 -0
- package/.agents/skills/clean-pom-crafter/examples/standard_test_case.groovy +28 -0
- package/.agents/skills/clean-pom-crafter/references/pom_patterns.groovy +138 -0
- package/.agents/skills/code-refactoring-refactor-clean/SKILL.md +64 -0
- package/.agents/skills/code-refactoring-refactor-clean/examples/refactored_page_sample.groovy +9 -0
- package/.agents/skills/code-refactoring-refactor-clean/examples/refactored_playwright_pom.ts +52 -0
- package/.agents/skills/code-refactoring-refactor-clean/resources/implementation-playbook.md +881 -0
- package/.agents/skills/consumer-driven-contract-testing/SKILL.md +147 -0
- package/.agents/skills/consumer-driven-contract-testing/examples/order_service_pact.json +45 -0
- package/.agents/skills/db-state-verifier-and-seeder/SKILL.md +123 -0
- package/.agents/skills/db-state-verifier-and-seeder/examples/db_fixture_seed.json +12 -0
- package/.agents/skills/e2e-testing-patterns/SKILL.md +103 -0
- package/.agents/skills/e2e-testing-patterns/examples/playwright_sharded_config.ts +12 -0
- package/.agents/skills/e2e-testing-patterns/resources/implementation-playbook.md +522 -0
- package/.agents/skills/event-stream-qa-orchestrator/SKILL.md +79 -0
- package/.agents/skills/event-stream-qa-orchestrator/examples/timeline_sample.jsonl +2 -0
- package/.agents/skills/failure-autopsy-and-healing/SKILL.md +66 -0
- package/.agents/skills/failure-autopsy-and-healing/examples/closed_loop_healing_walkthrough.md +48 -0
- package/.agents/skills/failure-autopsy-and-healing/examples/sample_junit_failure.xml +8 -0
- package/.agents/skills/failure-autopsy-and-healing/references/healing_matrix.md +64 -0
- package/.agents/skills/failure-autopsy-and-healing/references/qa_investigation_protocol.md +56 -0
- package/.agents/skills/failure-autopsy-and-healing/scripts/triage_failures.sh +83 -0
- package/.agents/skills/file-and-report-validator/SKILL.md +90 -0
- package/.agents/skills/file-and-report-validator/examples/sample_export_schema.json +14 -0
- package/.agents/skills/flaky-test-sentinel-and-quarantine/SKILL.md +114 -0
- package/.agents/skills/flaky-test-sentinel-and-quarantine/examples/quarantine_registry.json +11 -0
- package/.agents/skills/gherkin-to-suite/SKILL.md +103 -0
- package/.agents/skills/gherkin-to-suite/examples/checkout.feature +39 -0
- package/.agents/skills/gherkin-to-suite/examples/suite_report_sample.json +334 -0
- package/.agents/skills/github-actions-templates/SKILL.md +77 -0
- package/.agents/skills/github-actions-templates/examples/matrix_test_pipeline.yml +8 -0
- package/.agents/skills/graphify-impact-analyzer/SKILL.md +76 -0
- package/.agents/skills/graphify-impact-analyzer/examples/dependency_blast_radius.json +8 -0
- package/.agents/skills/katalon-cli-runner/SKILL.md +76 -0
- package/.agents/skills/katalon-cli-runner/examples/headless_kre_exec.sh +3 -0
- package/.agents/skills/katalon-cli-runner/references/groovy-patterns.md +209 -0
- package/.agents/skills/katalon-cli-runner/references/katalon-api.md +155 -0
- package/.agents/skills/katalon-cli-runner/references/runner_commands.md +67 -0
- package/.agents/skills/lam-script-generator/SKILL.md +123 -0
- package/.agents/skills/lam-script-generator/examples/user_story_sample.md +8 -0
- package/.agents/skills/lean-code-ladder/SKILL.md +94 -0
- package/.agents/skills/lean-code-ladder/examples/ladder_walkthrough.md +37 -0
- package/.agents/skills/lean-impact-scoreboard/SKILL.md +48 -0
- package/.agents/skills/lean-impact-scoreboard/examples/sample_benchmark_gain.md +20 -0
- package/.agents/skills/lean-impact-scoreboard/examples/sample_scoreboard.md +15 -0
- package/.agents/skills/meta-prompt-crafter/SKILL.md +107 -0
- package/.agents/skills/meta-prompt-crafter/examples/qa_prompt_template.md +35 -0
- package/.agents/skills/mipro-prompt-compiler/SKILL.md +59 -0
- package/.agents/skills/mipro-prompt-compiler/examples/compiled_module_sample.json +22 -0
- package/.agents/skills/mipro-prompt-compiler/examples/dspy_assertion_optimizer_case.md +46 -0
- package/.agents/skills/mobile-appium-som/SKILL.md +88 -0
- package/.agents/skills/mobile-appium-som/examples/BaseScreen.java +88 -0
- package/.agents/skills/mobile-appium-som/examples/LoginScreen.java +46 -0
- package/.agents/skills/mobile-appium-som/examples/TC_MobileLogin.java +43 -0
- package/.agents/skills/persistent-planning-files/SKILL.md +108 -0
- package/.agents/skills/persistent-planning-files/examples/task_plan_example.md +56 -0
- package/.agents/skills/playwright-live-interaction/SKILL.md +131 -0
- package/.agents/skills/playwright-live-interaction/examples/live_probe_script.js +5 -0
- package/.agents/skills/playwright-live-interaction/references/advanced_superpowers.md +160 -0
- package/.agents/skills/playwright-live-interaction/references/compact_accessibility_snapshots.md +75 -0
- package/.agents/skills/playwright-live-interaction/references/recipes.md +388 -0
- package/.agents/skills/playwright-live-interaction/references/swarm_orchestration.md +134 -0
- package/.agents/skills/playwright-webapp-testing/SKILL.md +93 -0
- package/.agents/skills/playwright-webapp-testing/examples/server_lifecycle_playwright.py +63 -0
- package/.agents/skills/qa-aci-interface/SKILL.md +67 -0
- package/.agents/skills/qa-aci-interface/examples/surgical_code_window_walkthrough.md +40 -0
- package/.agents/skills/qa-aci-interface/examples/surgical_edit_sample.json +12 -0
- package/.agents/skills/qa-memory-os/SKILL.md +80 -0
- package/.agents/skills/qa-memory-os/examples/archival_memory_sample.json +21 -0
- package/.agents/skills/rbt-manual-testing/SKILL.md +137 -0
- package/.agents/skills/rbt-manual-testing/examples/checkout_rbt_manual_suite.md +25 -0
- package/.agents/skills/rbt-manual-testing/references/field_validation_checklist.md +29 -0
- package/.agents/skills/repo-quality-audit/SKILL.md +68 -0
- package/.agents/skills/repo-quality-audit/examples/sample_audit_walkthrough.md +15 -0
- package/.agents/skills/repo-quality-audit/examples/sample_repo_audit.md +33 -0
- package/.agents/skills/review-spec/SKILL.md +60 -0
- package/.agents/skills/review-spec/examples/pocock_grilling_decision_rubric.md +40 -0
- package/.agents/skills/review-spec/examples/sample_spec_review.md +33 -0
- package/.agents/skills/security-dast-sentinel/SKILL.md +119 -0
- package/.agents/skills/security-dast-sentinel/examples/dast_scan_config.json +10 -0
- package/.agents/skills/security-dast-sentinel/references/AI-AND-LLM.md +113 -0
- package/.agents/skills/security-dast-sentinel/references/ATTACK-CLASSES.md +89 -0
- package/.agents/skills/security-dast-sentinel/references/dast_recipes.ts +33 -0
- package/.agents/skills/self-healing-locator/SKILL.md +86 -0
- package/.agents/skills/self-healing-locator/examples/aom_diff_sample.json +16 -0
- package/.agents/skills/senior-code-review/SKILL.md +108 -0
- package/.agents/skills/senior-code-review/examples/sample_review_walkthrough.md +29 -0
- package/.agents/skills/skillspector-security-guard/SKILL.md +57 -0
- package/.agents/skills/skillspector-security-guard/examples/audit_threat_vectors_report.json +35 -0
- package/.agents/skills/skillspector-security-guard/examples/safe_mcp_config.json +12 -0
- package/.agents/skills/surgical-coding-principles/SKILL.md +89 -0
- package/.agents/skills/surgical-coding-principles/examples/surgical_vs_scope_creep.md +46 -0
- package/.agents/skills/synthetic-test-data-generator/SKILL.md +135 -0
- package/.agents/skills/synthetic-test-data-generator/examples/idempotent_data_recipe.json +9 -0
- package/.agents/skills/systematic-debugging/SKILL.md +100 -0
- package/.agents/skills/systematic-debugging/examples/four_phase_case.md +44 -0
- package/.agents/skills/technical-debt-harvester/SKILL.md +70 -0
- package/.agents/skills/technical-debt-harvester/examples/sample_debt_ledger.md +25 -0
- package/.agents/skills/technical-debt-harvester/examples/sample_ledger_output.md +20 -0
- package/.agents/skills/test-driven-development/SKILL.md +114 -0
- package/.agents/skills/test-driven-development/examples/red_green_refactor_qa.md +78 -0
- package/.agents/skills/token-and-context-optimizer/SKILL.md +70 -0
- package/.agents/skills/token-and-context-optimizer/examples/distilled_log_sample.txt +3 -0
- package/.agents/skills/token-and-context-optimizer/references/context_engineering_guide.md +49 -0
- package/.agents/skills/tot-exploratory-testing/SKILL.md +59 -0
- package/.agents/skills/tot-exploratory-testing/examples/payment_gateway_tot_tree.json +62 -0
- package/.agents/skills/tot-exploratory-testing/examples/tot_graph_sample.json +35 -0
- package/.agents/skills/verification-before-completion/SKILL.md +100 -0
- package/.agents/skills/verification-before-completion/examples/evidence_log_example.md +46 -0
- package/.agents/skills/visual-regression-sentinel/SKILL.md +82 -0
- package/.agents/skills/visual-regression-sentinel/examples/visual_mask_rules.json +9 -0
- package/.agents/skills/wcag-audit-patterns/SKILL.md +77 -0
- package/.agents/skills/wcag-audit-patterns/examples/wcag_compliance_checklist.json +10 -0
- package/.agents/skills/wcag-audit-patterns/resources/implementation-playbook.md +541 -0
- package/.agents/skills/web-agent-gym-benchmarking/SKILL.md +62 -0
- package/.agents/skills/web-agent-gym-benchmarking/examples/benchmark_report_sample.json +22 -0
- package/.agents/skills/web-agent-gym-benchmarking/examples/enterprise_tasks_suite.json +38 -0
- package/.agents/skills/web-vitals-and-performance-profiler/SKILL.md +65 -0
- package/.agents/skills/web-vitals-and-performance-profiler/examples/cwv_budget_policy.json +6 -0
- package/.agents/skills/web-vitals-and-performance-profiler/examples/playwright_cwv_profiler_fixture.ts +118 -0
- package/.agents/templates/completion_report.md +57 -0
- package/.agents/workflows/analyze_requirement_document.md +18 -0
- package/.agents/workflows/export_testcases_excel.md +32 -0
- package/.agents/workflows/generate_combinatorial_test_data.md +28 -0
- package/.agents/workflows/generate_cross_module_test_plan.md +37 -0
- package/.agents/workflows/generate_manual_testcases_rbt.md +56 -0
- package/.agents/workflows/generate_requirements_from_website.md +25 -0
- package/.agents/workflows/generate_testcases_from_requirements.md +21 -0
- package/.agents/workflows/graphify.md +10 -0
- package/.agents/workflows/test-impact.md +15 -0
- package/.agents/workflows/verify.md +34 -0
- package/.cursor/rules/agents.mdc +16 -0
- package/.cursor/rules/language.mdc +7 -0
- package/.cursor/rules/synapse-qa.mdc +24 -0
- package/.cursorrules +27 -0
- package/.dockerignore +53 -0
- package/.pre-commit-hooks.yaml +14 -0
- package/.windsurfrules +26 -0
- package/AGENTS.md +86 -0
- package/CLAUDE.md +54 -0
- package/Dockerfile +81 -0
- package/LICENSE +52 -0
- package/NOTICE +264 -0
- package/README.en.md +171 -0
- package/README.md +170 -2
- package/action.yml +51 -0
- package/agentskills.json +16 -0
- package/bin/agent-qa.js +138 -0
- package/docker-compose.yml +74 -0
- package/docs/ARCHITECTURE.en.md +198 -0
- package/docs/ARCHITECTURE.md +199 -0
- package/docs/CI_CD_INTEGRATION.en.md +170 -0
- package/docs/CI_CD_INTEGRATION.md +170 -0
- package/docs/CLI_REFERENCE.en.md +174 -0
- package/docs/CLI_REFERENCE.md +176 -0
- package/docs/CONTRIBUTING.en.md +49 -0
- package/docs/CONTRIBUTING.md +49 -0
- package/docs/PERFORMANCE_AUDIT_REPORT.md +783 -0
- package/docs/PLUGIN_DEVELOPMENT_GUIDE.md +127 -0
- package/docs/QUALITY_GATES.en.md +118 -0
- package/docs/QUALITY_GATES.md +118 -0
- package/docs/TOKEN_QUOTA_PLAYBOOK.md +41 -0
- package/docs/TOOL_CATALOG.md +129 -0
- package/docs/adopted-ecosystem-tools.md +96 -0
- package/docs/research/EXTERNAL_AGENT_SKILLS_SURVEY.md +1062 -0
- package/docs/research/agent_skill_training_analysis.md +1358 -0
- package/docs/schemas/synapse.config.schema.json +86 -0
- package/package.json +94 -4
- package/plugin.json +31 -0
- package/scripts/generate_skill_examples.py +244 -0
- package/scripts/install.ps1 +112 -0
- package/scripts/install_global_plugin.ps1 +94 -0
- package/scripts/install_global_plugin.sh +49 -0
- package/scripts/lint_skills.ps1 +57 -0
- package/scripts/package_dist.py +337 -0
- package/scripts/setup.sh +59 -0
- package/scripts/update_hub.ps1 +19 -0
- package/scripts/update_hub.sh +15 -0
- package/skills_manifest.json +854 -0
- package/synapse.config.json +31 -0
- package/templates/PROJECT_AI_GUIDE_TEMPLATE.md +111 -0
- package/templates/PROJECT_STATE_TEMPLATE.md +20 -0
- package/templates/ai_bridges/CLAUDE.md +54 -0
- package/templates/ai_bridges/copilot-instructions.md +20 -0
- package/templates/ai_bridges/cursor_synapse_qa.mdc +24 -0
- package/templates/ai_bridges/windsurfrules +26 -0
- package/templates/ci/github-actions-synapse.yml +95 -0
- package/templates/ci/gitlab-ci-synapse.yml +16 -0
- package/templates/ui/index.html +1069 -0
- package/templates/welcome.html.tmpl +2074 -0
- package/tools/.infer_baseline.json +30 -0
- package/tools/TOOLS_RUNBOOK.md +1553 -0
- package/tools/TOOL_CATALOG.json +1769 -0
- package/tools/__init__.py +43 -0
- package/tools/_openapi_parser.py +158 -0
- package/tools/agent_canary.py +525 -0
- package/tools/agentless_patcher.py +417 -0
- package/tools/analyze_project.py +262 -0
- package/tools/api_drift_sentinel.py +208 -0
- package/tools/api_fuzzer.py +762 -0
- package/tools/author_integrity.py +190 -0
- package/tools/auto_heal.py +271 -0
- package/tools/auto_heal_reflexion.py +532 -0
- package/tools/autogen_qa_broker.py +844 -0
- package/tools/benchmark_swarm_context.py +394 -0
- package/tools/browser_helpers.js +746 -0
- package/tools/browsergym_eval.py +236 -0
- package/tools/bug_reporter.py +252 -0
- package/tools/bump_version.py +423 -0
- package/tools/cache_resolver.py +1214 -0
- package/tools/check_env.py +426 -0
- package/tools/check_version_sync.py +256 -0
- package/tools/ci_healing_hook.py +126 -0
- package/tools/cli.py +1598 -0
- package/tools/config_decoupler.py +253 -0
- package/tools/contract_validator.py +141 -0
- package/tools/core/__init__.py +70 -0
- package/tools/core/adapters.py +431 -0
- package/tools/core/circuit_breaker.py +263 -0
- package/tools/core/cli_runtime.py +66 -0
- package/tools/core/file_lock.py +159 -0
- package/tools/core/i18n.py +394 -0
- package/tools/core/memory_bus.py +905 -0
- package/tools/core/process_supervisor.py +332 -0
- package/tools/core/telemetry.py +329 -0
- package/tools/count_tokens.py +1267 -0
- package/tools/create_mock_docx.py +104 -0
- package/tools/dashboard_generator.py +2403 -0
- package/tools/db_sandbox.py +675 -0
- package/tools/debt_harvester.py +237 -0
- package/tools/distill_log.py +161 -0
- package/tools/dspy_qa_signatures.py +356 -0
- package/tools/e2e_flow_prober.py +132 -0
- package/tools/export_postman_collection.py +945 -0
- package/tools/flaky_detector.py +389 -0
- package/tools/fsm_enforcer.py +450 -0
- package/tools/fsm_middleware.py +401 -0
- package/tools/fuzz_payloads.py +197 -0
- package/tools/generate_allure_report.py +88 -0
- package/tools/generate_api_matrix.py +193 -0
- package/tools/generate_jmx_plan.py +1322 -0
- package/tools/generate_sbom.py +252 -0
- package/tools/generate_tc_from_story.py +203 -0
- package/tools/generate_test_reports.py +133 -0
- package/tools/generate_tool_catalog.py +482 -0
- package/tools/gherkin_suite.py +758 -0
- package/tools/git_pre_commit_guard.py +298 -0
- package/tools/goldfish_review.py +366 -0
- package/tools/heal/__init__.py +28 -0
- package/tools/heal_pr_automator.py +220 -0
- package/tools/heuristic_locator_matcher.py +351 -0
- package/tools/hub_publisher.py +623 -0
- package/tools/humanize_linter.py +438 -0
- package/tools/infer_linter.py +977 -0
- package/tools/init_config.py +306 -0
- package/tools/interview_story.py +116 -0
- package/tools/jira_sync.py +566 -0
- package/tools/jtl_analyzer.py +474 -0
- package/tools/lint/__init__.py +30 -0
- package/tools/lint_ai_docs.py +374 -0
- package/tools/lookup_tc.py +165 -0
- package/tools/lookup_xpath.py +167 -0
- package/tools/matrix_sharder.py +148 -0
- package/tools/mcp/__init__.py +18 -0
- package/tools/mcp_docx_server.ps1 +13 -0
- package/tools/mcp_docx_server.py +851 -0
- package/tools/mcp_excel_server.ps1 +13 -0
- package/tools/mcp_excel_server.py +441 -0
- package/tools/mcp_server.py +725 -0
- package/tools/md_to_xlsx.py +327 -0
- package/tools/micro_mutator.py +887 -0
- package/tools/mipro_assertion_tuner.py +210 -0
- package/tools/network_mock_shield.py +311 -0
- package/tools/newman_analyzer.py +384 -0
- package/tools/omni_emitter.py +579 -0
- package/tools/omni_parser.py +450 -0
- package/tools/omni_transpiler.py +168 -0
- package/tools/openxml_guard.py +438 -0
- package/tools/output_formatter.py +182 -0
- package/tools/package_release.py +325 -0
- package/tools/perf/__init__.py +24 -0
- package/tools/pinpoint_failure.py +190 -0
- package/tools/project_state.py +171 -0
- package/tools/qa_event_stream.py +358 -0
- package/tools/repo_map.py +346 -0
- package/tools/report/__init__.py +32 -0
- package/tools/reversible_sandbox.py +344 -0
- package/tools/safety_firewall.py +437 -0
- package/tools/security_coverage_ledger.py +538 -0
- package/tools/security_scanner.py +229 -0
- package/tools/senior_code_review.py +393 -0
- package/tools/setup_project.py +770 -0
- package/tools/skill_collision_guard.py +304 -0
- package/tools/skill_profiles.py +217 -0
- package/tools/skill_vault.py +481 -0
- package/tools/skillspector.py +1278 -0
- package/tools/smart_visual_masker.py +132 -0
- package/tools/spec_drift_sentinel.py +438 -0
- package/tools/swe_qa_aci.py +369 -0
- package/tools/synapse_observer.py +485 -0
- package/tools/synapse_qa_bench.py +190 -0
- package/tools/sync_agent_rules.py +274 -0
- package/tools/telemetry_correlator.py +397 -0
- package/tools/template_excel_exporter.py +514 -0
- package/tools/templates/jmeter-distributed/README.md +54 -0
- package/tools/templates/jmeter-distributed/docker-compose.yml +83 -0
- package/tools/test_impact.py +419 -0
- package/tools/test_memory_os.py +462 -0
- package/tools/textgrad_mutation_optimizer.py +237 -0
- package/tools/tms_sync_bridge.py +834 -0
- package/tools/tot_exploratory_tester.py +239 -0
- package/tools/trace_data_flow.py +240 -0
- package/tools/traffic_session_converter.py +256 -0
- package/tools/trend_analytics.py +314 -0
- package/tools/ui_server.py +401 -0
- package/tools/universal_ir.py +488 -0
- package/tools/update_sentinel.py +383 -0
- package/tools/validate_groovy_scripts.py +173 -0
- package/tools/verify_all.py +1271 -0
- package/tools/visual_diff_canvas.py +143 -0
- package/tools/visual_som_helper.py +550 -0
- package/tools/watch_mode.py +308 -0
- package/tools/wcag_audit.py +239 -0
- package/tools/welcome_page.py +290 -0
|
@@ -0,0 +1,67 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: qa-aci-interface
|
|
3
|
+
description: "Safe Agent-Computer Interface for inspecting code windows (40-50 lines), surgical editing with pre-commit AST checks, and distilled test execution. Use when inspecting, editing, or refactoring code without context blowout."
|
|
4
|
+
---
|
|
5
|
+
|
|
6
|
+
# QA Agent-Computer Interface (ACI) Skill — Context-Safe Code Editing
|
|
7
|
+
|
|
8
|
+
> **Paradigm Attribution:** Inspired by **Princeton NLP / Stanford SWE-agent ACI**.
|
|
9
|
+
> **Core Principle:** Prevent context window blowout and hallucinated edits by enforcing bounded file viewing (40–50 lines), surgical contiguous chunk replacements with AST syntax validation, and log distillation.
|
|
10
|
+
|
|
11
|
+
---
|
|
12
|
+
|
|
13
|
+
## 1. The Three ACI Primitives
|
|
14
|
+
|
|
15
|
+
```mermaid
|
|
16
|
+
flowchart LR
|
|
17
|
+
View["1. view-window<br/>Read 40-50 lines with line numbers"] --> Edit["2. surgical-edit<br/>Replace exact chunk with AST syntax check"]
|
|
18
|
+
Edit --> Distill["3. run-distilled<br/>Run test and distill head+tail output"]
|
|
19
|
+
```
|
|
20
|
+
|
|
21
|
+
1. **Bounded File Viewing (`view-window`):**
|
|
22
|
+
- Strictly limits context consumption by reading bounded windows (default 40 lines) with line numbers.
|
|
23
|
+
- Eliminates monolithic file ingestion (reading 4,000-line PageClasses directly is strictly forbidden).
|
|
24
|
+
|
|
25
|
+
2. **Pre-Commit Surgical Editing (`surgical-edit`):**
|
|
26
|
+
- Validates that target chunks exist uniquely in the file.
|
|
27
|
+
- Runs pre-commit AST syntax validation (Python `ast.parse` and bracket balance).
|
|
28
|
+
- Enforces **Clean POM**: strictly rejects raw XPath / CSS selectors if editing test scripts (`tests/`, `Scripts/`).
|
|
29
|
+
- Guarantees 100% UTF-8 No BOM across all file writes.
|
|
30
|
+
|
|
31
|
+
3. **Distilled Execution (`run-distilled`):**
|
|
32
|
+
- Intercepts test runner stdout/stderr and extracts the head 25 lines and tail 25 lines.
|
|
33
|
+
- Prevents terminal noise and test trace dumps from saturating the conversation context.
|
|
34
|
+
|
|
35
|
+
---
|
|
36
|
+
|
|
37
|
+
## 2. CLI Tool Usage
|
|
38
|
+
|
|
39
|
+
Autonomous commands via `tools/swe_qa_aci.py`:
|
|
40
|
+
|
|
41
|
+
```bash
|
|
42
|
+
# 1. View 40 lines starting at line 20
|
|
43
|
+
python tools/swe_qa_aci.py view-window \
|
|
44
|
+
--file src/pages/LoginPage.ts \
|
|
45
|
+
--start-line 20 \
|
|
46
|
+
--window-size 40
|
|
47
|
+
|
|
48
|
+
# 2. Surgically edit code with AST check & Clean POM guard
|
|
49
|
+
python tools/swe_qa_aci.py surgical-edit \
|
|
50
|
+
--file src/pages/LoginPage.ts \
|
|
51
|
+
--target-chunk "await this.page.click('#old-btn');" \
|
|
52
|
+
--replacement-chunk "await this.clickSafe(this.loginButton);" \
|
|
53
|
+
--validate-syntax
|
|
54
|
+
|
|
55
|
+
# 3. Run test command with distilled output
|
|
56
|
+
python tools/swe_qa_aci.py run-distilled \
|
|
57
|
+
--command "npx playwright test tests/login.spec.ts" \
|
|
58
|
+
--max-lines 50
|
|
59
|
+
```
|
|
60
|
+
|
|
61
|
+
---
|
|
62
|
+
|
|
63
|
+
## 3. Strict Operating Invariants
|
|
64
|
+
|
|
65
|
+
- **Diff Minimization:** Diff length should not exceed 30 lines per edit.
|
|
66
|
+
- **Syntax Integrity:** Zero syntax errors permitted; the tool rolls back on any syntax invalidity before touching disk.
|
|
67
|
+
- **No BOM Invariant:** Ensures zero `0xEF, 0xBB, 0xBF` bytes in modified files.
|
|
@@ -0,0 +1,40 @@
|
|
|
1
|
+
# Agent-Computer Interface (ACI) — 40-Line Surgical Editing Protocol
|
|
2
|
+
|
|
3
|
+
> **Purpose:** Prevent context blowout by restricting code inspections and edits to 40-50 line surgical windows with pre-commit AST verification.
|
|
4
|
+
|
|
5
|
+
---
|
|
6
|
+
|
|
7
|
+
## 1. The Context Blowout Anti-Pattern
|
|
8
|
+
|
|
9
|
+
Monolithic test files (e.g. 3,500-line Page Classes) exhaust agent context windows when read entirely. ACI enforces:
|
|
10
|
+
1. Querying `repo_map.txt` first to locate exact function boundaries.
|
|
11
|
+
2. Reading only lines `L120-L160` instead of the full file.
|
|
12
|
+
3. Performing surgical in-place replacement.
|
|
13
|
+
4. Verifying syntax immediately with `ast.parse()` or language compiler.
|
|
14
|
+
|
|
15
|
+
---
|
|
16
|
+
|
|
17
|
+
## 2. ACI Surgical Edit Execution
|
|
18
|
+
|
|
19
|
+
```bash
|
|
20
|
+
# 1. Inspect exact method window
|
|
21
|
+
python tools/swe_qa_aci.py read --file pages/OrderPage.py --start 80 --end 125
|
|
22
|
+
|
|
23
|
+
# 2. Perform surgical patch
|
|
24
|
+
python tools/swe_qa_aci.py edit \
|
|
25
|
+
--file pages/OrderPage.py \
|
|
26
|
+
--target "time.sleep(5)" \
|
|
27
|
+
--replacement "self.page.waitForSelector('.order-card', state='visible')"
|
|
28
|
+
|
|
29
|
+
# 3. Verify AST integrity before commit
|
|
30
|
+
python tools/infer_linter.py --file pages/OrderPage.py --strict
|
|
31
|
+
```
|
|
32
|
+
|
|
33
|
+
---
|
|
34
|
+
|
|
35
|
+
## 3. Pre-Commit Safety Check
|
|
36
|
+
|
|
37
|
+
The ACI engine automatically rejects patches that introduce:
|
|
38
|
+
- Syntax errors or brace mismatches.
|
|
39
|
+
- Swallowed exception handlers (`except: pass`).
|
|
40
|
+
- Hardcoded machine-specific absolute paths (`/Users/admin/...`).
|
|
@@ -0,0 +1,12 @@
|
|
|
1
|
+
{
|
|
2
|
+
"status": "PASS",
|
|
3
|
+
"file": "src/pages/LoginPage.ts",
|
|
4
|
+
"lines_replaced": {
|
|
5
|
+
"start": 25,
|
|
6
|
+
"end": 25
|
|
7
|
+
},
|
|
8
|
+
"ast_validation": "SYNTAX_VALID",
|
|
9
|
+
"utf8_nobom_verified": true,
|
|
10
|
+
"clean_pom_verified": true,
|
|
11
|
+
"diff_summary": "- await this.page.click('#old-btn');\n+ await this.clickSafe(this.loginButton);"
|
|
12
|
+
}
|
|
@@ -0,0 +1,80 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: qa-memory-os
|
|
3
|
+
description: "Hierarchical 3-tier memory operating system for test automation: Core Memory blocks, Recall step logs, and Archival semantic store with AUT version scoping. Use when managing long-term test session state, auth tokens, and preventing context rot."
|
|
4
|
+
---
|
|
5
|
+
|
|
6
|
+
# QA Test Memory OS Skill — Hierarchical Persistent Memory
|
|
7
|
+
|
|
8
|
+
> **Paradigm Attribution:** Inspired by **Letta AI / UC Berkeley SkyLab (MemGPT & MemFS)**.
|
|
9
|
+
> **Core Principle:** Replace flat SQLite caches with a disciplined 3-tier memory operating system. Eliminate memory rot across application versions by tagging locator mutations and flaky histories with explicit AUT release versions.
|
|
10
|
+
|
|
11
|
+
---
|
|
12
|
+
|
|
13
|
+
## 1. The 3-Tier Architecture
|
|
14
|
+
|
|
15
|
+
```mermaid
|
|
16
|
+
flowchart TD
|
|
17
|
+
subgraph MemoryOS["Hierarchical QA Test Memory OS (.agent_memory/qa_memory.db)"]
|
|
18
|
+
Core["Tier 1: Core Memory Block<br/>Fast Key-Value JSON: AUT URL, Token Expiry, Feature Flags"]
|
|
19
|
+
Recall["Tier 2: Recall Memory Log<br/>Sequential chronological timeline of execution steps"]
|
|
20
|
+
Archival["Tier 3: Archival Semantic Store<br/>Cross-sprint locator mutations scoped by AUT version (v2.1 vs v2.2)"]
|
|
21
|
+
end
|
|
22
|
+
|
|
23
|
+
Clean["Hygiene & GC Daemon<br/>Secret scrubbing (zero passwords/tokens) & DB size < 50MB"]
|
|
24
|
+
Core --> Clean
|
|
25
|
+
Recall --> Clean
|
|
26
|
+
Archival --> Clean
|
|
27
|
+
```
|
|
28
|
+
|
|
29
|
+
1. **Tier 1 — Core Memory (`core_memory`):**
|
|
30
|
+
- Immediate in-context state: active auth tokens, storage state path, AUT base URL.
|
|
31
|
+
- Enables **Zero-Second Auth**: reuse active tokens without repeating UI login forms.
|
|
32
|
+
|
|
33
|
+
2. **Tier 2 — Recall Memory (`recall_memory`):**
|
|
34
|
+
- Sequential audit log of subagent actions, navigation events, and errors.
|
|
35
|
+
- Rotates or prunes records older than 30 days to save disk space.
|
|
36
|
+
|
|
37
|
+
3. **Tier 3 — Archival Memory (`archival_memory`):**
|
|
38
|
+
- Permanent knowledge base of healed locators and historical flaky failure patterns.
|
|
39
|
+
- **AUT Version Scoping (`aut_version`):** Queries can filter by release (e.g. `aut_version="v2.1"`). When the web app upgrades to `v2.2`, obsolete `v2.1` mutations are ignored, completely eliminating false cache hits (Memory Rot).
|
|
40
|
+
|
|
41
|
+
---
|
|
42
|
+
|
|
43
|
+
## 2. CLI Tool Usage
|
|
44
|
+
|
|
45
|
+
Autonomous commands via `tools/test_memory_os.py`:
|
|
46
|
+
|
|
47
|
+
```bash
|
|
48
|
+
# 1. Initialize memory OS database
|
|
49
|
+
python tools/test_memory_os.py init --db-path .agent_memory/qa_memory.db
|
|
50
|
+
|
|
51
|
+
# 2. Update active session state in Core Memory
|
|
52
|
+
python tools/test_memory_os.py update-core \
|
|
53
|
+
--block auth_state \
|
|
54
|
+
--data '{"token_expiry": "2026-11-05T00:00:00Z", "storage_state": "storage_state.json"}'
|
|
55
|
+
|
|
56
|
+
# 3. Store locator mutation in Archival Memory scoped by version
|
|
57
|
+
python tools/test_memory_os.py archival-insert \
|
|
58
|
+
--key LOCATOR_MUTATION \
|
|
59
|
+
--payload '{"page": "CheckoutPage", "old": "#submit-btn", "new": "button[data-testid=submit]"}' \
|
|
60
|
+
--aut-version "v2.1" \
|
|
61
|
+
--tags "checkout,submit,button"
|
|
62
|
+
|
|
63
|
+
# 4. Search archival memory with semantic token matching
|
|
64
|
+
python tools/test_memory_os.py archival-search \
|
|
65
|
+
--query "Checkout submit button locator history" \
|
|
66
|
+
--aut-version "v2.1" \
|
|
67
|
+
--top-k 3 \
|
|
68
|
+
--json
|
|
69
|
+
|
|
70
|
+
# 5. Run garbage collection and secret scrubbing
|
|
71
|
+
python tools/test_memory_os.py gc --scrub-secrets --max-age-days 30
|
|
72
|
+
```
|
|
73
|
+
|
|
74
|
+
---
|
|
75
|
+
|
|
76
|
+
## 3. Strict Operating Invariants
|
|
77
|
+
|
|
78
|
+
- **Zero Plaintext Secrets:** Automatic regex masking for passwords, bearer tokens, and private keys (`[MASKED_SECRET]`).
|
|
79
|
+
- **Memory File Ceiling:** DB size strictly maintained under **50MB**.
|
|
80
|
+
- **Version Isolation:** Never apply archival locator patches across different incompatible AUT major versions.
|
|
@@ -0,0 +1,21 @@
|
|
|
1
|
+
{
|
|
2
|
+
"status": "PASS",
|
|
3
|
+
"query": "Checkout submit button locator history",
|
|
4
|
+
"aut_version": "v2.1",
|
|
5
|
+
"matches_found": 1,
|
|
6
|
+
"results": [
|
|
7
|
+
{
|
|
8
|
+
"id": "mem_arch_9014",
|
|
9
|
+
"similarity_score": 0.912,
|
|
10
|
+
"key": "LOCATOR_MUTATION",
|
|
11
|
+
"timestamp": "2026-11-04T05:30:00Z",
|
|
12
|
+
"payload": {
|
|
13
|
+
"page": "CheckoutPage",
|
|
14
|
+
"old_selector": "#submit-order",
|
|
15
|
+
"new_selector": "button[data-testid=submit]",
|
|
16
|
+
"aut_version": "v2.1",
|
|
17
|
+
"verified_by_test": "tests/checkout.spec.ts"
|
|
18
|
+
}
|
|
19
|
+
}
|
|
20
|
+
]
|
|
21
|
+
}
|
|
@@ -0,0 +1,137 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: rbt-manual-testing
|
|
3
|
+
description: "Comprehensive Risk-Based Testing (AI-RBT) 6-stage manual test case generation, Ambiguity Q&A analysis, Traceability Matrix, Field-Level Validation Checklist (15 input field types), Non-Functional scenarios (Double-Submit, Race Conditions), and Excel export formatting. Use when generating risk-based manual test cases and exploratory charters."
|
|
4
|
+
---
|
|
5
|
+
|
|
6
|
+
# RBT Manual Testing (AI-Driven Risk-Based Testing Engine)
|
|
7
|
+
|
|
8
|
+
## 1. Overview & Capabilities
|
|
9
|
+
|
|
10
|
+
**RBT Manual Testing** is an enterprise-grade skill for designing manual test suites using **Risk-Based Testing (RBT)** and coverage matrix analysis. It provides two operational modes:
|
|
11
|
+
|
|
12
|
+
| Mode | When to Use | Scope & Characteristics | Execution Time |
|
|
13
|
+
| :--- | :--- | :--- | :--- |
|
|
14
|
+
| **QUICK Mode** | Standalone modules, simple forms, unambiguous specs | Single-pass generation with EP/BVA coverage | Fast (~1-2 min) |
|
|
15
|
+
| **FULL RBT Mode** | Enterprise workflows, complex business rules, high risk | 6-stage sequential pipeline with checkpoints for Ambiguity & RTM | Thorough & structured |
|
|
16
|
+
|
|
17
|
+
### Core Tenets:
|
|
18
|
+
1. **Human Strategy:** Engineers define business boundaries, risk appetite, and resolve flagged ambiguities.
|
|
19
|
+
2. **AI Execution:** Agent decomposes modules, builds coverage matrices, applies the 15-field validation checklist, and computes risk scores.
|
|
20
|
+
3. **Enterprise Deliverables:** Standardized 12-column Markdown tables with automation metadata, ready for export to Excel (`.xlsx`), Jira Xray, or TestRail.
|
|
21
|
+
|
|
22
|
+
---
|
|
23
|
+
|
|
24
|
+
## 2. Mode Routing
|
|
25
|
+
|
|
26
|
+
- **Trigger QUICK Mode:**
|
|
27
|
+
- "quick test cases", "generate test cases for registration form", "generate test cases from requirement".
|
|
28
|
+
- Small scope (single screen, isolated dialog), clear requirements.
|
|
29
|
+
- **Trigger FULL RBT Mode:**
|
|
30
|
+
- "/generate_manual_testcases_rbt", "6-step RBT process", "risk-based test plan", "comprehensive manual suite".
|
|
31
|
+
- Complex multi-step flows, cross-module dependencies, or audit requirements.
|
|
32
|
+
|
|
33
|
+
---
|
|
34
|
+
|
|
35
|
+
## 3. Mode 1: QUICK Mode (Fast Single-Pass)
|
|
36
|
+
|
|
37
|
+
1. **Requirement Analysis:** Map Happy Paths, Negative Paths, Boundary Conditions, and Edge Cases.
|
|
38
|
+
2. **Test Design Techniques:**
|
|
39
|
+
- **Equivalence Partitioning (EP):** Partition valid and invalid input classes.
|
|
40
|
+
- **Boundary Value Analysis (BVA):** Support 2-value BVA (`Min-1`, `Min`, `Max`, `Max+1` for standard forms) and 3-value BVA (`Min-1`, `Min`, `Min+1`, `Max-1`, `Max`, `Max+1` for high-precision financial/security boundaries).
|
|
41
|
+
- **Decision Table:** Combinatorial matrix for multi-conditional business rules.
|
|
42
|
+
- **State Transition:** Sequence of object lifecycle states (`Draft` -> `Pending` -> `Approved`).
|
|
43
|
+
3. **Field-Level Validation:** Generate dedicated validation cases for each form input using the 15-field checklist.
|
|
44
|
+
4. **Standard Markdown Export:** Format output into the standard 12-column table with automation tags.
|
|
45
|
+
|
|
46
|
+
---
|
|
47
|
+
|
|
48
|
+
## 4. Mode 2: FULL RBT (6-Stage Sequential Pipeline)
|
|
49
|
+
|
|
50
|
+
```mermaid
|
|
51
|
+
flowchart TD
|
|
52
|
+
S1["<b>Stage 1: Context & Framing</b><br/>Role-play, scope & MVP boundaries"] --> S2["<b>Stage 2: Analysis & QnA</b><br/>Ambiguity detection (Checkpoint)"]
|
|
53
|
+
S2 --> S3["<b>Stage 3: Decomposition</b><br/>Module hierarchy & dependencies"]
|
|
54
|
+
S3 --> S4["<b>Stage 4: Traceability & Gap</b><br/>RTM & High-Level Scenarios (Checkpoint)"]
|
|
55
|
+
S4 --> S5["<b>Stage 5: Test Case Authoring</b><br/>Risk Scoring (H/M/L) + 15 Field Types"]
|
|
56
|
+
S5 --> S6["<b>Stage 6: Template Mapping</b><br/>12-column table + Automation tags"]
|
|
57
|
+
```
|
|
58
|
+
|
|
59
|
+
### Stage 1: Context & Framing
|
|
60
|
+
- Identify target system goals, user personas, testing standards, and release scope (MVP vs Full).
|
|
61
|
+
- Confirm understanding with the user before proceeding.
|
|
62
|
+
|
|
63
|
+
### Stage 2: Analysis & Ambiguity Q&A
|
|
64
|
+
- Map business paths: Happy Path, Alternate Paths, Exception Paths.
|
|
65
|
+
- Detect ambiguities: missing rules, contradictions, undefined error messages, missing timeouts.
|
|
66
|
+
- Format numbered Q&A table (`Q1, Q2, Q3...`) with context and proposed assumptions.
|
|
67
|
+
- 🛑 **Checkpoint:** Pause and wait for user/stakeholder response before Stage 3.
|
|
68
|
+
|
|
69
|
+
### Stage 3: System Decomposition
|
|
70
|
+
- Decompose system into Modules -> Sub-modules -> Components.
|
|
71
|
+
- Map functional dependencies and shared state across modules.
|
|
72
|
+
|
|
73
|
+
### Stage 4: Traceability Matrix (RTM) & Gap Analysis
|
|
74
|
+
- Build Requirements Traceability Matrix linking requirement IDs (`REQ-xxx`) to high-level test scenarios.
|
|
75
|
+
- Perform gap analysis to detect uncovered edge cases or orphan flows.
|
|
76
|
+
- 🛑 **Checkpoint:** Present scenario outline for user sign-off.
|
|
77
|
+
|
|
78
|
+
### Stage 5: Detailed Test Case Generation & Risk Scoring
|
|
79
|
+
- Assign Risk Level:
|
|
80
|
+
- **High:** Core revenue flows, payment processing, authentication, data loss risks.
|
|
81
|
+
- **Medium:** CRUD operations, table filtering, search, pagination.
|
|
82
|
+
- **Low:** Cosmetic UI, tooltips, static informational content.
|
|
83
|
+
- Non-Functional & Resilience Scenarios:
|
|
84
|
+
- **Double Submit / Race Conditions:** Rapid consecutive clicks on submit, concurrent edits.
|
|
85
|
+
- **Network Interruption:** Connection drops mid-transaction.
|
|
86
|
+
- **Browser Navigation:** Browser Back/Forward or page refresh during multi-step wizards.
|
|
87
|
+
- Field-Level Validation: Generate dedicated test cases for each input field.
|
|
88
|
+
|
|
89
|
+
### Stage 6: Template Mapping & Automation Metadata
|
|
90
|
+
- Assemble all test cases into the standard 12-column Markdown table.
|
|
91
|
+
- Populate automation metadata: `Automatable` (`Yes`/`No`/`Partial`), `Auto Type` (`UI`/`API`/`Unit`/`N/A`), `@Tags` (`@Smoke`, `@Regression`, `@CriticalPath`).
|
|
92
|
+
|
|
93
|
+
---
|
|
94
|
+
|
|
95
|
+
## 5. Field-Level Validation Checklist (15 Field Types)
|
|
96
|
+
|
|
97
|
+
Field-level validation rules cover positive, boundary/negative (BVA), and security vectors across 15 standard field types:
|
|
98
|
+
1. Text (Name, Title) • 2. Email • 3. Phone • 4. Password • 5. Number • 6. Date • 7. Date Range • 8. Dropdown • 9. Multi-Select • 10. Checkbox/Radio • 11. Textarea • 12. File Upload • 13. OTP/MFA • 14. Range Slider • 15. Rich Text Editor.
|
|
99
|
+
|
|
100
|
+
👉 **Full Checklist & Edge Cases:** Refer to [**Field-Level Validation Reference (`references/field_validation_checklist.md`)**](references/field_validation_checklist.md) for complete equivalence partitions, SQLi/XSS attack strings, and race condition test matrices.
|
|
101
|
+
|
|
102
|
+
---
|
|
103
|
+
|
|
104
|
+
## 6. Standard Table Output Specification
|
|
105
|
+
|
|
106
|
+
All generated test cases must adhere to the 12-column Markdown specification:
|
|
107
|
+
|
|
108
|
+
```markdown
|
|
109
|
+
| TC ID | Module | Risk Level | Test Title | Pre-Condition | Test Steps | Expected Result | Priority | Test Data | Automatable | Auto Type | Tags |
|
|
110
|
+
| :--- | :--- | :--- | :--- | :--- | :--- | :--- | :--- | :--- | :--- | :--- | :--- |
|
|
111
|
+
| CRM_CUST_TC_001 | Customer | High | Verify create customer with valid data | 1. User logged in as Admin<br>2. On Customer page | 1. Click "New Customer"<br>2. Fill all mandatory fields<br>3. Click "Save" | 1. Alert "Customer added successfully"<br>2. Record visible in customer table | High | Company="AutoCorp", Phone="+123456789" | Yes | UI | @Smoke, @Regression |
|
|
112
|
+
```
|
|
113
|
+
|
|
114
|
+
> **Formatting Invariants:**
|
|
115
|
+
> - Numbered test steps and expected results must use `<br>` for multi-line formatting inside table cells.
|
|
116
|
+
> - `Risk Level`: `High`, `Medium`, `Low`.
|
|
117
|
+
> - `Priority`: `Critical`, `High`, `Medium`, `Low`.
|
|
118
|
+
|
|
119
|
+
---
|
|
120
|
+
|
|
121
|
+
## 7. Export to Styled Excel (.xlsx)
|
|
122
|
+
|
|
123
|
+
Export Markdown test cases directly into styled Excel workbooks via the CLI tool:
|
|
124
|
+
|
|
125
|
+
```bash
|
|
126
|
+
# Convert Markdown table into styled Excel
|
|
127
|
+
synapse export-excel path/to/test_cases.md -o output.xlsx --sheet-name "Regression Suite"
|
|
128
|
+
|
|
129
|
+
# Or via unified CLI dispatcher:
|
|
130
|
+
agent-qa export-excel path/to/test_cases.md
|
|
131
|
+
```
|
|
132
|
+
|
|
133
|
+
Generated workbooks automatically include:
|
|
134
|
+
- Corporate Navy Blue header styling (`#1F4E78`, bold, white).
|
|
135
|
+
- Frozen header pane (`A2`) and enabled `AutoFilter`.
|
|
136
|
+
- Color-coded badges for Risk Level and Priority.
|
|
137
|
+
- Multi-line text wrapping and optimized column widths.
|
|
@@ -0,0 +1,25 @@
|
|
|
1
|
+
# Example AI-RBT Manual Test Suite: E-Commerce Checkout
|
|
2
|
+
|
|
3
|
+
## 1. Risk Assessment Matrix (P x I)
|
|
4
|
+
|
|
5
|
+
| Feature / Journey | Probability (1-5) | Impact (1-5) | Risk Score (P x I) | Tier | Testing Focus |
|
|
6
|
+
| :--- | :--- | :--- | :--- | :--- | :--- |
|
|
7
|
+
| Payment Gateway Integration (Stripe/PayPal) | 4 | 5 | 20 | Critical (P1) | Idempotency, 3D Secure, Network timeout, Webhook retry |
|
|
8
|
+
| Promo Code & Discount Application | 3 | 4 | 12 | High (P2) | Boundary dates, Concurrent usage, Negative cart values |
|
|
9
|
+
| Shipping Address Form & Validation | 2 | 3 | 6 | Medium (P3) | XSS, Max length, International postal formats |
|
|
10
|
+
|
|
11
|
+
## 2. Requirement Clarification & Ambiguity Log
|
|
12
|
+
|
|
13
|
+
| ID | Ambiguity / Gap | Question to Product Owner | Impact / Default Assumption |
|
|
14
|
+
| :--- | :--- | :--- | :--- |
|
|
15
|
+
| AMB-01 | Discount expiration timezone not specified | Does promo code expire at 23:59 UTC or local user time? | Assumed UTC midnight to prevent premature expiration errors. |
|
|
16
|
+
| AMB-02 | Handling partial payment failure during multi-card checkout | Should the entire order roll back or allow secondary payment? | Assumed atomic rollback: no charge without full authorization. |
|
|
17
|
+
|
|
18
|
+
## 3. Comprehensive Manual Test Case Matrix (12-Column Standard)
|
|
19
|
+
|
|
20
|
+
| TC ID | Module | Risk Tier | Scenario / Title | Pre-Conditions | Test Data | Test Steps | Expected Result | Actual Result | Status | Priority | Traceability / AC |
|
|
21
|
+
| :--- | :--- | :--- | :--- | :--- | :--- | :--- | :--- | :--- | :--- | :--- | :--- |
|
|
22
|
+
| `TC-CHK-001` | Checkout | Critical (P1) | Successful Credit Card payment with 3DS authorization | User logged in, Cart has 1 item (\$45.00) | Valid Visa test card with 3DS challenge | 1. Navigate to /checkout<br>2. Fill shipping details<br>3. Enter 3DS card<br>4. Click 'Place Order'<br>5. Authorize OTP popup | Order confirmed, receipt email queued, cart emptied | As expected | PASS | P1 | AC-01, AC-04 |
|
|
23
|
+
| `TC-CHK-002` | Checkout | Critical (P1) | Idempotency under double-submit click on 'Place Order' | User on final payment step | Valid payment details | 1. Rapidly double-click 'Place Order' button within 100ms | Button disables on first click; exactly 1 payment transaction charged | As expected | PASS | P1 | NFR-SEC-02 |
|
|
24
|
+
| `TC-CHK-003` | Checkout | High (P2) | Expired coupon code validation | User on payment step with \$100 cart | Coupon: `SUMMER2020` (Expired) | 1. Enter coupon `SUMMER2020`<br>2. Click 'Apply' | Inline error: 'Coupon code has expired', total remains \$100 | As expected | PASS | P2 | AC-05 |
|
|
25
|
+
| `TC-CHK-004` | Checkout | Medium (P3) | XSS payload injection in Delivery Instructions field | User on shipping step | Notes: `<script>alert('xss')</script>` | 1. Enter payload in notes<br>2. Complete order<br>3. View order history | Payload safely HTML-escaped; no script execution in UI | As expected | PASS | P3 | OWASP-A03 |
|
|
@@ -0,0 +1,29 @@
|
|
|
1
|
+
# Field-Level Validation Checklist (15 Input Field Types)
|
|
2
|
+
|
|
3
|
+
Comprehensive boundary values, negative test vectors, and security edge cases across all standard web and enterprise input fields.
|
|
4
|
+
|
|
5
|
+
## 15-Field Matrix
|
|
6
|
+
|
|
7
|
+
| Field Type | Positive Verification | Boundary & Negative Checks (BVA) | Security & Edge Cases |
|
|
8
|
+
| :--- | :--- | :--- | :--- |
|
|
9
|
+
| **1. Text (Name, Title)** | Valid length, Unicode support | Empty, leading/trailing whitespace, `Max`, `Max+1` | XSS `<script>`, SQLi `' OR 1=1--`, HTML tags, surrogate emojis |
|
|
10
|
+
| **2. Email** | Standard format (`user@domain.com`) | Missing `@`, missing TLD, multiple `@`, spaces | Max 254 characters, Internationalized Domain Names (IDN) |
|
|
11
|
+
| **3. Phone** | Standard E.164 or national format | Letters, symbols, too short/long, negative numbers | Leading `+`, spaces, dashes, country code mismatches |
|
|
12
|
+
| **4. Password** | Complexity requirements met (Upper, lower, digit, symbol) | Missing criteria, `Min-1`, excessive length | Spaces in password, clipboard paste blocking/support |
|
|
13
|
+
| **5. Number (Quantity, Price)** | Integer/float within valid range | Alpha chars, negative values, 0 (if disallowed), decimals | Integer overflow (> 2^31-1), thousands separator formats |
|
|
14
|
+
| **6. Date / Datetime** | Valid date format (`YYYY-MM-DD` / `DD/MM/YYYY`) | Invalid calendar dates (Feb 30), leap year checks | Past vs future boundary restrictions, manual input vs picker |
|
|
15
|
+
| **7. Date Range** | `StartDate <= EndDate` | `StartDate > EndDate`, single date selected | Same-day range, date span exceeding system max limit |
|
|
16
|
+
| **8. Dropdown / Select** | Select valid option, search filter | Unselected mandatory field, empty options list | Async loading delays, large option lists (> 1,000 items) |
|
|
17
|
+
| **9. Multi-Select** | Select multiple items, deselect individual | Exceeding max selection limit, Select All | Search filter within list, badge dismissal ("x" click) |
|
|
18
|
+
| **10. Checkbox / Radio** | Toggle check/uncheck, switch radio option | Unchecked mandatory consent (Terms of Service) | Rapid toggle spam, disabled read-only state |
|
|
19
|
+
| **11. Textarea (Notes, Bio)** | Multi-line text with line breaks | Exceeding character limit, whitespace-only input | Control characters (CRLF, tabs), rich-text paste injection |
|
|
20
|
+
| **12. File Upload** | Allowed file format & size limits | Disallowed extension (`.exe`), 0-byte file, oversized file | Special characters in filename, mime-type spoofing |
|
|
21
|
+
| **13. OTP / MFA Code** | Valid unexpired code entry | Invalid code, expired code, partial length | Rate limiting (max attempts), resend cooldown timer |
|
|
22
|
+
| **14. Range Slider** | Drag slider between Min and Max | Snap-to values, boundary values (`Min`, `Max`) | Keyboard navigation (Arrow keys, Home, End, PageUp/Down) |
|
|
23
|
+
| **15. Rich Text Editor** | Bold, italic, bullet lists formatting | Image paste, rich content pasted from external apps | Dangerous HTML tags sanitization, raw character count |
|
|
24
|
+
|
|
25
|
+
## Non-Functional & Resilience Invariants
|
|
26
|
+
|
|
27
|
+
- **Double Submit / Race Conditions:** Rapid consecutive clicks on submit; concurrent edits across browser tabs.
|
|
28
|
+
- **Network Interruption:** Connection drops mid-transaction; slow 3G timeout handling.
|
|
29
|
+
- **Browser Navigation:** Browser Back/Forward or page refresh during multi-step wizards without data loss.
|
|
@@ -0,0 +1,68 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: repo-quality-audit
|
|
3
|
+
description: "Comprehensive codebase quality audit covering bugs, security, bottlenecks, and bloat. Use when auditing an entire project, evaluating repository health, or prioritizing technical debt."
|
|
4
|
+
category: architecture_and_analysis
|
|
5
|
+
version: "1.0.0"
|
|
6
|
+
---
|
|
7
|
+
|
|
8
|
+
# Repo Quality Audit — Comprehensive Repository Health & Risk Audit
|
|
9
|
+
|
|
10
|
+
Audit an entire repository like the senior engineer who just inherited it and will be paged when it breaks.
|
|
11
|
+
Prioritize: **Correctness -> Safety -> Scale -> Tests -> Speed -> Lean**.
|
|
12
|
+
Always rank issues and provide a clear **"Fix this first"** verdict.
|
|
13
|
+
|
|
14
|
+
---
|
|
15
|
+
|
|
16
|
+
## 1. Mapping the Codebase First
|
|
17
|
+
|
|
18
|
+
Before diagnosing defects:
|
|
19
|
+
1. **Entry Points & Architecture:** Inspect entry points (CLI commands, route handlers, test runners, background workers) and dependency manifests (`package.json`, `pyproject.toml`, `pom.xml`, `build.gradle`).
|
|
20
|
+
2. **Expected Load:** Determine whether the system is a local utility, a parallel CI suite, or a high-throughput microservice.
|
|
21
|
+
3. **Data Flow Tracing:** Trace critical business flows end-to-end:
|
|
22
|
+
- External inputs and request payloads
|
|
23
|
+
- Authentication & authorization checks
|
|
24
|
+
- Database mutations and state persistence
|
|
25
|
+
- Teardown and cleanup lifecycles
|
|
26
|
+
|
|
27
|
+
---
|
|
28
|
+
|
|
29
|
+
## 2. Six Audit Dimensions
|
|
30
|
+
|
|
31
|
+
| Dimension | Inspection Focus | Red Flags |
|
|
32
|
+
|---|---|---|
|
|
33
|
+
| **1. Bugs & Logic** | Edge cases, return type mismatches, error handling | Swallowed exceptions, null dereferences, broken callers |
|
|
34
|
+
| **2. Security & Data** | Trust boundaries, authentication, secrets | Hardcoded tokens, SQLi/RCE risks, missing input sanitization |
|
|
35
|
+
| **3. Concurrency & Scale** | Resource contention, memory lifecycle | Race conditions, static sleeps, unbounded caches, unclosed connections |
|
|
36
|
+
| **4. Test Deficit** | Untested business-critical logic | Complex branches or parsers with zero test assertions |
|
|
37
|
+
| **5. Performance** | Hot paths, loop overhead | Unindexed queries, redundant network calls, $O(n^2)$ iterations |
|
|
38
|
+
| **6. Bloat & Dead Code** | Code that should not exist | Unused dependencies, duplicate helper functions, single-impl interfaces |
|
|
39
|
+
|
|
40
|
+
---
|
|
41
|
+
|
|
42
|
+
## 3. Reporting Structure
|
|
43
|
+
|
|
44
|
+
1. **Overview & Assumptions:**
|
|
45
|
+
- What this codebase does
|
|
46
|
+
- The operational load assumed
|
|
47
|
+
2. **Ranked Findings (Max 20, ordered by severity):**
|
|
48
|
+
- **Must fix (Blockers):** Bugs causing data loss, security CVEs, unhandled crashes.
|
|
49
|
+
- **Should fix (Reliability):** Concurrency races, missing regression tests, flaky waits.
|
|
50
|
+
- **Nice to have (Hygiene):** Dead code removal, dependency pruning, code deduplication.
|
|
51
|
+
3. **Verdict & Lean Metric:**
|
|
52
|
+
- **Verdict:** "Fix #1 first: [Summary of top priority issue]"
|
|
53
|
+
- **Lean Savings Potential:** Potential reduction in lines of code (`-N lines`) and unused dependencies (`-M dependencies`).
|
|
54
|
+
- **Not Checked:** Explicitly state any submodules or third-party assets omitted.
|
|
55
|
+
|
|
56
|
+
---
|
|
57
|
+
|
|
58
|
+
## 4. Complementary Hub Tools
|
|
59
|
+
|
|
60
|
+
- `python3 tools/analyze_project.py` — 5-in-1 automated health audit and AST repo map.
|
|
61
|
+
- `python3 tools/verify_all.py` — 10 Quality Gates DoD gatekeeper.
|
|
62
|
+
- `python3 tools/debt_harvester.py` — Scan repository for unaddressed shortcut debt.
|
|
63
|
+
|
|
64
|
+
---
|
|
65
|
+
|
|
66
|
+
## 5. Attribution
|
|
67
|
+
|
|
68
|
+
Adapted from **ponytail-audit** (https://github.com/DietrichGebert/ponytail) — MIT License, Copyright (c) 2026 DietrichGebert. Re-architected for Enterprise QA and Synapse Hub Standards.
|
|
@@ -0,0 +1,15 @@
|
|
|
1
|
+
# Sample Repo Quality Audit Walkthrough
|
|
2
|
+
|
|
3
|
+
## Overview
|
|
4
|
+
This walkthrough demonstrates a repo-wide quality audit identifying high-impact risks with "Fix this first" prioritization.
|
|
5
|
+
|
|
6
|
+
## Example Command
|
|
7
|
+
```bash
|
|
8
|
+
agent-qa audit . --output REPO_QUALITY_AUDIT.md
|
|
9
|
+
```
|
|
10
|
+
|
|
11
|
+
## Sample Output Findings
|
|
12
|
+
1. **Critical:** In-memory queue without persistent backoff under concurrent load (`WorkerPool.groovy:142`).
|
|
13
|
+
- *Fix:* Introduce Redis-backed queue or bounded worker pool.
|
|
14
|
+
2. **Medium:** Unbounded mock API responses causing potential memory bloat (`MockServer.groovy:89`).
|
|
15
|
+
- *Fix:* Enforce pagination or bounded payload limits.
|
|
@@ -0,0 +1,33 @@
|
|
|
1
|
+
# Sample Repository Quality Audit
|
|
2
|
+
|
|
3
|
+
Representative full-repo quality audit report:
|
|
4
|
+
|
|
5
|
+
```markdown
|
|
6
|
+
# Repository Quality Audit Report
|
|
7
|
+
|
|
8
|
+
- **Target Repository:** `warehouse-inventory-api`
|
|
9
|
+
- **Assumed Load:** 50 concurrent warehouse scanners + batch office imports (up to 5,000 items).
|
|
10
|
+
|
|
11
|
+
### Findings (Ranked Priority)
|
|
12
|
+
|
|
13
|
+
#### 1. [Must Fix] Office Batch Import Fails on Row 1,200 (`src/importers/csv.py:45`)
|
|
14
|
+
- **What this is:** In-memory batch processor loading entire CSV into a single transaction.
|
|
15
|
+
- **Problem:** When batch exceeds 1,000 items, database pool exhausts connection limits and drops connection silently.
|
|
16
|
+
- **Fix:** Chunk processing into 250-row windowed transactions.
|
|
17
|
+
- **If we skip it:** Nightly stock sync fails for all regional warehouses.
|
|
18
|
+
|
|
19
|
+
#### 2. [Should Fix] Risky Discount Logic Has No Tests (`src/services/pricing.py:112`)
|
|
20
|
+
- **What this is:** Tiered pricing rule engine based on customer loyalty grade.
|
|
21
|
+
- **Problem:** Complex ternary branching calculates negative discounts if grade is undefined. Zero unit tests cover this branch.
|
|
22
|
+
- **Fix:** Add boundary unit tests in `tests/test_pricing.py` asserting non-negative pricing.
|
|
23
|
+
- **If we skip it:** Special promotions risk leaking negative prices to checkouts.
|
|
24
|
+
|
|
25
|
+
#### 3. [Nice to Have] Dead Legacy XML Exporter (`src/exporters/legacy_xml.py`)
|
|
26
|
+
- **What this is:** Deprecated XML export helper replaced by REST API 6 months ago.
|
|
27
|
+
- **Fix:** Delete the 120-line unused module.
|
|
28
|
+
- **If we skip it:** Maintenance burden and confusion for new team members.
|
|
29
|
+
|
|
30
|
+
### Verdict
|
|
31
|
+
Fix #1 first: Chunk batch imports into 250-row windowed transactions.
|
|
32
|
+
Lean Potential: -120 dead lines, -1 unused XML library.
|
|
33
|
+
```
|
|
@@ -0,0 +1,60 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: review-spec
|
|
3
|
+
description: "Stress-test specifications, user stories, and BDD feature files with zero-context rigor. Use when reviewing requirements, user stories, or acceptance criteria before code generation."
|
|
4
|
+
category: architecture_and_analysis
|
|
5
|
+
version: "1.0.0"
|
|
6
|
+
---
|
|
7
|
+
|
|
8
|
+
# Review Spec — Zero-Context Specification Stress-Tester
|
|
9
|
+
|
|
10
|
+
Review test specifications, User Stories, and BDD `.feature` files with stateless, zero-context rigor (Elephant-Goldfish Model) before generating code.
|
|
11
|
+
|
|
12
|
+
Order of evaluation: **System Boundaries -> Dynamic Data & Teardown -> Assertion Rigor -> Boundary & Negative Cases -> Concrete Implementation Targets**.
|
|
13
|
+
|
|
14
|
+
---
|
|
15
|
+
|
|
16
|
+
## 1. When to Use
|
|
17
|
+
|
|
18
|
+
- Triggered automatically before `pom-crafter` synthesizes Page Classes or test scripts from natural-language specs.
|
|
19
|
+
- Triggered when the user asks to review, audit, or refine requirements, user stories, or acceptance criteria.
|
|
20
|
+
- Integrated CLI invocation:
|
|
21
|
+
```bash
|
|
22
|
+
python tools/goldfish_review.py path/to/spec.md
|
|
23
|
+
python tools/goldfish_review.py path/to/feature.feature --json
|
|
24
|
+
# or via CLI shim:
|
|
25
|
+
agent-qa review-spec path/to/spec.md
|
|
26
|
+
```
|
|
27
|
+
|
|
28
|
+
---
|
|
29
|
+
|
|
30
|
+
## 2. Five Verification Vectors (Goldfish Protocol)
|
|
31
|
+
|
|
32
|
+
1. **Comprehension & System Boundaries (20%):**
|
|
33
|
+
- Explicit Actor/Role definition.
|
|
34
|
+
- Clear Preconditions and Initial State.
|
|
35
|
+
- Well-defined Target Scope (no vague "works fine" or "system operates normally").
|
|
36
|
+
|
|
37
|
+
2. **Dynamic Data & Idempotent Teardown (20%):**
|
|
38
|
+
- Mandatory dynamic timestamps or random prefixes (`AUTO_`, `uniqueCode`) to eliminate database primary key collisions.
|
|
39
|
+
- Explicit post-test cleanup or automated Teardown step for every data-creation path.
|
|
40
|
+
|
|
41
|
+
3. **Assertion Rigor & Truth Anchor (25%):**
|
|
42
|
+
- Concrete, deterministic expected results instead of tautological assertions.
|
|
43
|
+
- Zero-Fake-Pass guarantee: explicit UI state changes, status codes, or database assertions.
|
|
44
|
+
|
|
45
|
+
4. **Boundary & Negative Scenarios (20%):**
|
|
46
|
+
- Invalid input values, boundary overflows, and unauthorized access attempts.
|
|
47
|
+
- Explicit error message and validation feedback assertions.
|
|
48
|
+
|
|
49
|
+
5. **Concrete Implementation Targets (15%):**
|
|
50
|
+
- Concrete Page Class mappings or API endpoint routes.
|
|
51
|
+
- Clean POM Flat Architecture compliance (locators belongs in Page Classes, not test scripts).
|
|
52
|
+
|
|
53
|
+
---
|
|
54
|
+
|
|
55
|
+
## 3. Autonomous Execution Workflow
|
|
56
|
+
|
|
57
|
+
1. Ingest specification file (`.md`, `.feature`, or story text).
|
|
58
|
+
2. Run `python tools/goldfish_review.py <spec_file>`.
|
|
59
|
+
3. If review score is `< 80/100` or blocking gaps are found, report specific missing vectors to the user or orchestrator.
|
|
60
|
+
4. Once verified ($\ge 80/100$), proceed with Clean POM test script codification.
|
|
@@ -0,0 +1,40 @@
|
|
|
1
|
+
# Pocock Grilling Spec Review & Decision-Frontier Rubric
|
|
2
|
+
|
|
3
|
+
> **Paradigm Attribution:** Inspired by **Pocock Grilling Primitive** — resolves ambiguous story requirements upfront through structured, multiple-choice decision frontiers with recommended defaults, preventing code rework.
|
|
4
|
+
|
|
5
|
+
---
|
|
6
|
+
|
|
7
|
+
## 1. The 5-Vector Completeness Review
|
|
8
|
+
|
|
9
|
+
Before handing any user story to `pom-crafter`, `review-spec` audits:
|
|
10
|
+
|
|
11
|
+
1. **State Invariants:** What state must NEVER exist under any circumstance?
|
|
12
|
+
2. **Boundary Values:** Are 0, max limits, empty inputs, and special characters defined?
|
|
13
|
+
3. **Async / Timing Bounds:** What is the maximum timeout before fallback UI displays?
|
|
14
|
+
4. **Error UX & Feedback:** Are exact toast messages, HTTP codes, and retry buttons specified?
|
|
15
|
+
5. **Data Cleanup (Teardown):** Is there an automated deletion or rollback strategy?
|
|
16
|
+
|
|
17
|
+
---
|
|
18
|
+
|
|
19
|
+
## 2. Decision-Frontier Interview Matrix
|
|
20
|
+
|
|
21
|
+
When requirements are underspecified, trigger `tools/interview_story.py` with batched choices:
|
|
22
|
+
|
|
23
|
+
```markdown
|
|
24
|
+
### Decision Frontier 1: Concurrent Session Handling
|
|
25
|
+
- [x] (Recommended) Invalidate older session and notify user with dismissible banner.
|
|
26
|
+
- [ ] Allow concurrent multi-tab browsing without state sharing.
|
|
27
|
+
- [ ] Block new login until active session logs out.
|
|
28
|
+
|
|
29
|
+
### Decision Frontier 2: Payment Gateway 3DS Timeout
|
|
30
|
+
- [x] (Recommended) Auto-poll transaction status for 60s, then display manual status check button.
|
|
31
|
+
- [ ] Immediately fail order after 30s and restore cart items.
|
|
32
|
+
```
|
|
33
|
+
|
|
34
|
+
---
|
|
35
|
+
|
|
36
|
+
## 3. Spec Approval Gate
|
|
37
|
+
|
|
38
|
+
A test specification is approved for code synthesis ONLY when:
|
|
39
|
+
- All 5 completeness vectors score $\ge 80\%$.
|
|
40
|
+
- Zero unresolved decision frontiers remain.
|