@teevee98/synapse-hub 0.0.0-stage → 3.8.3
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.agents/agents/api-engineer.md +67 -0
- package/.agents/agents/failure-analyst.md +75 -0
- package/.agents/agents/live-explorer.md +70 -0
- package/.agents/agents/orchestrator.md +104 -0
- package/.agents/agents/perf-engineer.md +74 -0
- package/.agents/agents/pom-crafter.md +112 -0
- package/.agents/agents/quality-gatekeeper.md +87 -0
- package/.agents/agents/test-designer.md +73 -0
- package/.agents/agents/test-runner.md +67 -0
- package/.agents/rules/author-integrity-guard.md +33 -0
- package/.agents/rules/communication-style.md +18 -0
- package/.agents/rules/context-engineering.md +37 -0
- package/.agents/rules/git-push-protocol.md +33 -0
- package/.agents/rules/graphify.md +14 -0
- package/.agents/rules/lessons-learned.md +25 -0
- package/.agents/rules/mandatory-playwright-live.md +25 -0
- package/.agents/rules/mobile_appium_rules.md +43 -0
- package/.agents/rules/performance_testing_rules.md +35 -0
- package/.agents/rules/skill-precedence.md +29 -0
- package/.agents/rules/systematic-debugging.md +36 -0
- package/.agents/skills/actor-qa-swarm/SKILL.md +77 -0
- package/.agents/skills/actor-qa-swarm/examples/broker_sharding_sample.json +12 -0
- package/.agents/skills/agent-orchestration-multi-agent-optimize/SKILL.md +88 -0
- package/.agents/skills/agent-orchestration-multi-agent-optimize/examples/swarm_workload_config.json +15 -0
- package/.agents/skills/agentless-qa-repair/SKILL.md +69 -0
- package/.agents/skills/agentless-qa-repair/examples/healing_report_sample.json +17 -0
- package/.agents/skills/agentless-qa-repair/examples/three_phase_repair_workflow.md +40 -0
- package/.agents/skills/antigravity-test-sentinel/SKILL.md +63 -0
- package/.agents/skills/antigravity-test-sentinel/examples/dod_gate_policy.json +11 -0
- package/.agents/skills/antigravity-test-sentinel/examples/sprint_dod_enforcement.md +47 -0
- package/.agents/skills/api-network-mocking-interception/SKILL.md +142 -0
- package/.agents/skills/api-network-mocking-interception/examples/network_route_stub.json +9 -0
- package/.agents/skills/api-spec-to-e2e-matrix/SKILL.md +80 -0
- package/.agents/skills/api-spec-to-e2e-matrix/examples/sample_openapi.json +19 -0
- package/.agents/skills/architecture-decision-records/SKILL.md +64 -0
- package/.agents/skills/architecture-decision-records/examples/0001-record-architecture-decisions.md +12 -0
- package/.agents/skills/auth-session-and-cookie-manager/SKILL.md +75 -0
- package/.agents/skills/auth-session-and-cookie-manager/examples/multi_role_auth_matrix.md +70 -0
- package/.agents/skills/auth-session-and-cookie-manager/examples/storage_state_sample.json +11 -0
- package/.agents/skills/backend-load-and-stress-patterns/SKILL.md +85 -0
- package/.agents/skills/backend-load-and-stress-patterns/examples/k6_load_test_sample.js +13 -0
- package/.agents/skills/backend-load-and-stress-patterns/references/k6_load_template.js +82 -0
- package/.agents/skills/bats-testing-patterns/SKILL.md +100 -0
- package/.agents/skills/bats-testing-patterns/examples/cli_runner_test.bats +6 -0
- package/.agents/skills/bats-testing-patterns/resources/implementation-playbook.md +614 -0
- package/.agents/skills/clean-pom-crafter/SKILL.md +110 -0
- package/.agents/skills/clean-pom-crafter/examples/standard_test_case.groovy +28 -0
- package/.agents/skills/clean-pom-crafter/references/pom_patterns.groovy +138 -0
- package/.agents/skills/code-refactoring-refactor-clean/SKILL.md +64 -0
- package/.agents/skills/code-refactoring-refactor-clean/examples/refactored_page_sample.groovy +9 -0
- package/.agents/skills/code-refactoring-refactor-clean/examples/refactored_playwright_pom.ts +52 -0
- package/.agents/skills/code-refactoring-refactor-clean/resources/implementation-playbook.md +881 -0
- package/.agents/skills/consumer-driven-contract-testing/SKILL.md +147 -0
- package/.agents/skills/consumer-driven-contract-testing/examples/order_service_pact.json +45 -0
- package/.agents/skills/db-state-verifier-and-seeder/SKILL.md +123 -0
- package/.agents/skills/db-state-verifier-and-seeder/examples/db_fixture_seed.json +12 -0
- package/.agents/skills/e2e-testing-patterns/SKILL.md +103 -0
- package/.agents/skills/e2e-testing-patterns/examples/playwright_sharded_config.ts +12 -0
- package/.agents/skills/e2e-testing-patterns/resources/implementation-playbook.md +522 -0
- package/.agents/skills/event-stream-qa-orchestrator/SKILL.md +79 -0
- package/.agents/skills/event-stream-qa-orchestrator/examples/timeline_sample.jsonl +2 -0
- package/.agents/skills/failure-autopsy-and-healing/SKILL.md +66 -0
- package/.agents/skills/failure-autopsy-and-healing/examples/closed_loop_healing_walkthrough.md +48 -0
- package/.agents/skills/failure-autopsy-and-healing/examples/sample_junit_failure.xml +8 -0
- package/.agents/skills/failure-autopsy-and-healing/references/healing_matrix.md +64 -0
- package/.agents/skills/failure-autopsy-and-healing/references/qa_investigation_protocol.md +56 -0
- package/.agents/skills/failure-autopsy-and-healing/scripts/triage_failures.sh +83 -0
- package/.agents/skills/file-and-report-validator/SKILL.md +90 -0
- package/.agents/skills/file-and-report-validator/examples/sample_export_schema.json +14 -0
- package/.agents/skills/flaky-test-sentinel-and-quarantine/SKILL.md +114 -0
- package/.agents/skills/flaky-test-sentinel-and-quarantine/examples/quarantine_registry.json +11 -0
- package/.agents/skills/gherkin-to-suite/SKILL.md +103 -0
- package/.agents/skills/gherkin-to-suite/examples/checkout.feature +39 -0
- package/.agents/skills/gherkin-to-suite/examples/suite_report_sample.json +334 -0
- package/.agents/skills/github-actions-templates/SKILL.md +77 -0
- package/.agents/skills/github-actions-templates/examples/matrix_test_pipeline.yml +8 -0
- package/.agents/skills/graphify-impact-analyzer/SKILL.md +76 -0
- package/.agents/skills/graphify-impact-analyzer/examples/dependency_blast_radius.json +8 -0
- package/.agents/skills/katalon-cli-runner/SKILL.md +76 -0
- package/.agents/skills/katalon-cli-runner/examples/headless_kre_exec.sh +3 -0
- package/.agents/skills/katalon-cli-runner/references/groovy-patterns.md +209 -0
- package/.agents/skills/katalon-cli-runner/references/katalon-api.md +155 -0
- package/.agents/skills/katalon-cli-runner/references/runner_commands.md +67 -0
- package/.agents/skills/lam-script-generator/SKILL.md +123 -0
- package/.agents/skills/lam-script-generator/examples/user_story_sample.md +8 -0
- package/.agents/skills/lean-code-ladder/SKILL.md +94 -0
- package/.agents/skills/lean-code-ladder/examples/ladder_walkthrough.md +37 -0
- package/.agents/skills/lean-impact-scoreboard/SKILL.md +48 -0
- package/.agents/skills/lean-impact-scoreboard/examples/sample_benchmark_gain.md +20 -0
- package/.agents/skills/lean-impact-scoreboard/examples/sample_scoreboard.md +15 -0
- package/.agents/skills/meta-prompt-crafter/SKILL.md +107 -0
- package/.agents/skills/meta-prompt-crafter/examples/qa_prompt_template.md +35 -0
- package/.agents/skills/mipro-prompt-compiler/SKILL.md +59 -0
- package/.agents/skills/mipro-prompt-compiler/examples/compiled_module_sample.json +22 -0
- package/.agents/skills/mipro-prompt-compiler/examples/dspy_assertion_optimizer_case.md +46 -0
- package/.agents/skills/mobile-appium-som/SKILL.md +88 -0
- package/.agents/skills/mobile-appium-som/examples/BaseScreen.java +88 -0
- package/.agents/skills/mobile-appium-som/examples/LoginScreen.java +46 -0
- package/.agents/skills/mobile-appium-som/examples/TC_MobileLogin.java +43 -0
- package/.agents/skills/persistent-planning-files/SKILL.md +108 -0
- package/.agents/skills/persistent-planning-files/examples/task_plan_example.md +56 -0
- package/.agents/skills/playwright-live-interaction/SKILL.md +131 -0
- package/.agents/skills/playwright-live-interaction/examples/live_probe_script.js +5 -0
- package/.agents/skills/playwright-live-interaction/references/advanced_superpowers.md +160 -0
- package/.agents/skills/playwright-live-interaction/references/compact_accessibility_snapshots.md +75 -0
- package/.agents/skills/playwright-live-interaction/references/recipes.md +388 -0
- package/.agents/skills/playwright-live-interaction/references/swarm_orchestration.md +134 -0
- package/.agents/skills/playwright-webapp-testing/SKILL.md +93 -0
- package/.agents/skills/playwright-webapp-testing/examples/server_lifecycle_playwright.py +63 -0
- package/.agents/skills/qa-aci-interface/SKILL.md +67 -0
- package/.agents/skills/qa-aci-interface/examples/surgical_code_window_walkthrough.md +40 -0
- package/.agents/skills/qa-aci-interface/examples/surgical_edit_sample.json +12 -0
- package/.agents/skills/qa-memory-os/SKILL.md +80 -0
- package/.agents/skills/qa-memory-os/examples/archival_memory_sample.json +21 -0
- package/.agents/skills/rbt-manual-testing/SKILL.md +137 -0
- package/.agents/skills/rbt-manual-testing/examples/checkout_rbt_manual_suite.md +25 -0
- package/.agents/skills/rbt-manual-testing/references/field_validation_checklist.md +29 -0
- package/.agents/skills/repo-quality-audit/SKILL.md +68 -0
- package/.agents/skills/repo-quality-audit/examples/sample_audit_walkthrough.md +15 -0
- package/.agents/skills/repo-quality-audit/examples/sample_repo_audit.md +33 -0
- package/.agents/skills/review-spec/SKILL.md +60 -0
- package/.agents/skills/review-spec/examples/pocock_grilling_decision_rubric.md +40 -0
- package/.agents/skills/review-spec/examples/sample_spec_review.md +33 -0
- package/.agents/skills/security-dast-sentinel/SKILL.md +119 -0
- package/.agents/skills/security-dast-sentinel/examples/dast_scan_config.json +10 -0
- package/.agents/skills/security-dast-sentinel/references/AI-AND-LLM.md +113 -0
- package/.agents/skills/security-dast-sentinel/references/ATTACK-CLASSES.md +89 -0
- package/.agents/skills/security-dast-sentinel/references/dast_recipes.ts +33 -0
- package/.agents/skills/self-healing-locator/SKILL.md +86 -0
- package/.agents/skills/self-healing-locator/examples/aom_diff_sample.json +16 -0
- package/.agents/skills/senior-code-review/SKILL.md +108 -0
- package/.agents/skills/senior-code-review/examples/sample_review_walkthrough.md +29 -0
- package/.agents/skills/skillspector-security-guard/SKILL.md +57 -0
- package/.agents/skills/skillspector-security-guard/examples/audit_threat_vectors_report.json +35 -0
- package/.agents/skills/skillspector-security-guard/examples/safe_mcp_config.json +12 -0
- package/.agents/skills/surgical-coding-principles/SKILL.md +89 -0
- package/.agents/skills/surgical-coding-principles/examples/surgical_vs_scope_creep.md +46 -0
- package/.agents/skills/synthetic-test-data-generator/SKILL.md +135 -0
- package/.agents/skills/synthetic-test-data-generator/examples/idempotent_data_recipe.json +9 -0
- package/.agents/skills/systematic-debugging/SKILL.md +100 -0
- package/.agents/skills/systematic-debugging/examples/four_phase_case.md +44 -0
- package/.agents/skills/technical-debt-harvester/SKILL.md +70 -0
- package/.agents/skills/technical-debt-harvester/examples/sample_debt_ledger.md +25 -0
- package/.agents/skills/technical-debt-harvester/examples/sample_ledger_output.md +20 -0
- package/.agents/skills/test-driven-development/SKILL.md +114 -0
- package/.agents/skills/test-driven-development/examples/red_green_refactor_qa.md +78 -0
- package/.agents/skills/token-and-context-optimizer/SKILL.md +70 -0
- package/.agents/skills/token-and-context-optimizer/examples/distilled_log_sample.txt +3 -0
- package/.agents/skills/token-and-context-optimizer/references/context_engineering_guide.md +49 -0
- package/.agents/skills/tot-exploratory-testing/SKILL.md +59 -0
- package/.agents/skills/tot-exploratory-testing/examples/payment_gateway_tot_tree.json +62 -0
- package/.agents/skills/tot-exploratory-testing/examples/tot_graph_sample.json +35 -0
- package/.agents/skills/verification-before-completion/SKILL.md +100 -0
- package/.agents/skills/verification-before-completion/examples/evidence_log_example.md +46 -0
- package/.agents/skills/visual-regression-sentinel/SKILL.md +82 -0
- package/.agents/skills/visual-regression-sentinel/examples/visual_mask_rules.json +9 -0
- package/.agents/skills/wcag-audit-patterns/SKILL.md +77 -0
- package/.agents/skills/wcag-audit-patterns/examples/wcag_compliance_checklist.json +10 -0
- package/.agents/skills/wcag-audit-patterns/resources/implementation-playbook.md +541 -0
- package/.agents/skills/web-agent-gym-benchmarking/SKILL.md +62 -0
- package/.agents/skills/web-agent-gym-benchmarking/examples/benchmark_report_sample.json +22 -0
- package/.agents/skills/web-agent-gym-benchmarking/examples/enterprise_tasks_suite.json +38 -0
- package/.agents/skills/web-vitals-and-performance-profiler/SKILL.md +65 -0
- package/.agents/skills/web-vitals-and-performance-profiler/examples/cwv_budget_policy.json +6 -0
- package/.agents/skills/web-vitals-and-performance-profiler/examples/playwright_cwv_profiler_fixture.ts +118 -0
- package/.agents/templates/completion_report.md +57 -0
- package/.agents/workflows/analyze_requirement_document.md +18 -0
- package/.agents/workflows/export_testcases_excel.md +32 -0
- package/.agents/workflows/generate_combinatorial_test_data.md +28 -0
- package/.agents/workflows/generate_cross_module_test_plan.md +37 -0
- package/.agents/workflows/generate_manual_testcases_rbt.md +56 -0
- package/.agents/workflows/generate_requirements_from_website.md +25 -0
- package/.agents/workflows/generate_testcases_from_requirements.md +21 -0
- package/.agents/workflows/graphify.md +10 -0
- package/.agents/workflows/test-impact.md +15 -0
- package/.agents/workflows/verify.md +34 -0
- package/.cursor/rules/agents.mdc +16 -0
- package/.cursor/rules/language.mdc +7 -0
- package/.cursor/rules/synapse-qa.mdc +24 -0
- package/.cursorrules +27 -0
- package/.dockerignore +53 -0
- package/.pre-commit-hooks.yaml +14 -0
- package/.windsurfrules +26 -0
- package/AGENTS.md +86 -0
- package/CLAUDE.md +54 -0
- package/Dockerfile +81 -0
- package/LICENSE +52 -0
- package/NOTICE +264 -0
- package/README.en.md +171 -0
- package/README.md +170 -2
- package/action.yml +51 -0
- package/agentskills.json +16 -0
- package/bin/agent-qa.js +138 -0
- package/docker-compose.yml +74 -0
- package/docs/ARCHITECTURE.en.md +198 -0
- package/docs/ARCHITECTURE.md +199 -0
- package/docs/CI_CD_INTEGRATION.en.md +170 -0
- package/docs/CI_CD_INTEGRATION.md +170 -0
- package/docs/CLI_REFERENCE.en.md +174 -0
- package/docs/CLI_REFERENCE.md +176 -0
- package/docs/CONTRIBUTING.en.md +49 -0
- package/docs/CONTRIBUTING.md +49 -0
- package/docs/PERFORMANCE_AUDIT_REPORT.md +783 -0
- package/docs/PLUGIN_DEVELOPMENT_GUIDE.md +127 -0
- package/docs/QUALITY_GATES.en.md +118 -0
- package/docs/QUALITY_GATES.md +118 -0
- package/docs/TOKEN_QUOTA_PLAYBOOK.md +41 -0
- package/docs/TOOL_CATALOG.md +129 -0
- package/docs/adopted-ecosystem-tools.md +96 -0
- package/docs/research/EXTERNAL_AGENT_SKILLS_SURVEY.md +1062 -0
- package/docs/research/agent_skill_training_analysis.md +1358 -0
- package/docs/schemas/synapse.config.schema.json +86 -0
- package/package.json +94 -4
- package/plugin.json +31 -0
- package/scripts/generate_skill_examples.py +244 -0
- package/scripts/install.ps1 +112 -0
- package/scripts/install_global_plugin.ps1 +94 -0
- package/scripts/install_global_plugin.sh +49 -0
- package/scripts/lint_skills.ps1 +57 -0
- package/scripts/package_dist.py +337 -0
- package/scripts/setup.sh +59 -0
- package/scripts/update_hub.ps1 +19 -0
- package/scripts/update_hub.sh +15 -0
- package/skills_manifest.json +854 -0
- package/synapse.config.json +31 -0
- package/templates/PROJECT_AI_GUIDE_TEMPLATE.md +111 -0
- package/templates/PROJECT_STATE_TEMPLATE.md +20 -0
- package/templates/ai_bridges/CLAUDE.md +54 -0
- package/templates/ai_bridges/copilot-instructions.md +20 -0
- package/templates/ai_bridges/cursor_synapse_qa.mdc +24 -0
- package/templates/ai_bridges/windsurfrules +26 -0
- package/templates/ci/github-actions-synapse.yml +95 -0
- package/templates/ci/gitlab-ci-synapse.yml +16 -0
- package/templates/ui/index.html +1069 -0
- package/templates/welcome.html.tmpl +2074 -0
- package/tools/.infer_baseline.json +30 -0
- package/tools/TOOLS_RUNBOOK.md +1553 -0
- package/tools/TOOL_CATALOG.json +1769 -0
- package/tools/__init__.py +43 -0
- package/tools/_openapi_parser.py +158 -0
- package/tools/agent_canary.py +525 -0
- package/tools/agentless_patcher.py +417 -0
- package/tools/analyze_project.py +262 -0
- package/tools/api_drift_sentinel.py +208 -0
- package/tools/api_fuzzer.py +762 -0
- package/tools/author_integrity.py +190 -0
- package/tools/auto_heal.py +271 -0
- package/tools/auto_heal_reflexion.py +532 -0
- package/tools/autogen_qa_broker.py +844 -0
- package/tools/benchmark_swarm_context.py +394 -0
- package/tools/browser_helpers.js +746 -0
- package/tools/browsergym_eval.py +236 -0
- package/tools/bug_reporter.py +252 -0
- package/tools/bump_version.py +423 -0
- package/tools/cache_resolver.py +1214 -0
- package/tools/check_env.py +426 -0
- package/tools/check_version_sync.py +256 -0
- package/tools/ci_healing_hook.py +126 -0
- package/tools/cli.py +1598 -0
- package/tools/config_decoupler.py +253 -0
- package/tools/contract_validator.py +141 -0
- package/tools/core/__init__.py +70 -0
- package/tools/core/adapters.py +431 -0
- package/tools/core/circuit_breaker.py +263 -0
- package/tools/core/cli_runtime.py +66 -0
- package/tools/core/file_lock.py +159 -0
- package/tools/core/i18n.py +394 -0
- package/tools/core/memory_bus.py +905 -0
- package/tools/core/process_supervisor.py +332 -0
- package/tools/core/telemetry.py +329 -0
- package/tools/count_tokens.py +1267 -0
- package/tools/create_mock_docx.py +104 -0
- package/tools/dashboard_generator.py +2403 -0
- package/tools/db_sandbox.py +675 -0
- package/tools/debt_harvester.py +237 -0
- package/tools/distill_log.py +161 -0
- package/tools/dspy_qa_signatures.py +356 -0
- package/tools/e2e_flow_prober.py +132 -0
- package/tools/export_postman_collection.py +945 -0
- package/tools/flaky_detector.py +389 -0
- package/tools/fsm_enforcer.py +450 -0
- package/tools/fsm_middleware.py +401 -0
- package/tools/fuzz_payloads.py +197 -0
- package/tools/generate_allure_report.py +88 -0
- package/tools/generate_api_matrix.py +193 -0
- package/tools/generate_jmx_plan.py +1322 -0
- package/tools/generate_sbom.py +252 -0
- package/tools/generate_tc_from_story.py +203 -0
- package/tools/generate_test_reports.py +133 -0
- package/tools/generate_tool_catalog.py +482 -0
- package/tools/gherkin_suite.py +758 -0
- package/tools/git_pre_commit_guard.py +298 -0
- package/tools/goldfish_review.py +366 -0
- package/tools/heal/__init__.py +28 -0
- package/tools/heal_pr_automator.py +220 -0
- package/tools/heuristic_locator_matcher.py +351 -0
- package/tools/hub_publisher.py +623 -0
- package/tools/humanize_linter.py +438 -0
- package/tools/infer_linter.py +977 -0
- package/tools/init_config.py +306 -0
- package/tools/interview_story.py +116 -0
- package/tools/jira_sync.py +566 -0
- package/tools/jtl_analyzer.py +474 -0
- package/tools/lint/__init__.py +30 -0
- package/tools/lint_ai_docs.py +374 -0
- package/tools/lookup_tc.py +165 -0
- package/tools/lookup_xpath.py +167 -0
- package/tools/matrix_sharder.py +148 -0
- package/tools/mcp/__init__.py +18 -0
- package/tools/mcp_docx_server.ps1 +13 -0
- package/tools/mcp_docx_server.py +851 -0
- package/tools/mcp_excel_server.ps1 +13 -0
- package/tools/mcp_excel_server.py +441 -0
- package/tools/mcp_server.py +725 -0
- package/tools/md_to_xlsx.py +327 -0
- package/tools/micro_mutator.py +887 -0
- package/tools/mipro_assertion_tuner.py +210 -0
- package/tools/network_mock_shield.py +311 -0
- package/tools/newman_analyzer.py +384 -0
- package/tools/omni_emitter.py +579 -0
- package/tools/omni_parser.py +450 -0
- package/tools/omni_transpiler.py +168 -0
- package/tools/openxml_guard.py +438 -0
- package/tools/output_formatter.py +182 -0
- package/tools/package_release.py +325 -0
- package/tools/perf/__init__.py +24 -0
- package/tools/pinpoint_failure.py +190 -0
- package/tools/project_state.py +171 -0
- package/tools/qa_event_stream.py +358 -0
- package/tools/repo_map.py +346 -0
- package/tools/report/__init__.py +32 -0
- package/tools/reversible_sandbox.py +344 -0
- package/tools/safety_firewall.py +437 -0
- package/tools/security_coverage_ledger.py +538 -0
- package/tools/security_scanner.py +229 -0
- package/tools/senior_code_review.py +393 -0
- package/tools/setup_project.py +770 -0
- package/tools/skill_collision_guard.py +304 -0
- package/tools/skill_profiles.py +217 -0
- package/tools/skill_vault.py +481 -0
- package/tools/skillspector.py +1278 -0
- package/tools/smart_visual_masker.py +132 -0
- package/tools/spec_drift_sentinel.py +438 -0
- package/tools/swe_qa_aci.py +369 -0
- package/tools/synapse_observer.py +485 -0
- package/tools/synapse_qa_bench.py +190 -0
- package/tools/sync_agent_rules.py +274 -0
- package/tools/telemetry_correlator.py +397 -0
- package/tools/template_excel_exporter.py +514 -0
- package/tools/templates/jmeter-distributed/README.md +54 -0
- package/tools/templates/jmeter-distributed/docker-compose.yml +83 -0
- package/tools/test_impact.py +419 -0
- package/tools/test_memory_os.py +462 -0
- package/tools/textgrad_mutation_optimizer.py +237 -0
- package/tools/tms_sync_bridge.py +834 -0
- package/tools/tot_exploratory_tester.py +239 -0
- package/tools/trace_data_flow.py +240 -0
- package/tools/traffic_session_converter.py +256 -0
- package/tools/trend_analytics.py +314 -0
- package/tools/ui_server.py +401 -0
- package/tools/universal_ir.py +488 -0
- package/tools/update_sentinel.py +383 -0
- package/tools/validate_groovy_scripts.py +173 -0
- package/tools/verify_all.py +1271 -0
- package/tools/visual_diff_canvas.py +143 -0
- package/tools/visual_som_helper.py +550 -0
- package/tools/watch_mode.py +308 -0
- package/tools/wcag_audit.py +239 -0
- package/tools/welcome_page.py +290 -0
|
@@ -0,0 +1,88 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: agent-orchestration-multi-agent-optimize
|
|
3
|
+
description: "Profile, benchmark, and orchestrate multi-agent test workloads and token throughput. Use when orchestrating multi-agent swarms, partitioning workloads, or optimizing agent roles."
|
|
4
|
+
---
|
|
5
|
+
|
|
6
|
+
# Multi-Agent Optimization & Orchestration Skill
|
|
7
|
+
|
|
8
|
+
> **Target:** Optimize multi-agent test workloads, reduce context overhead, streamline agent handoffs, and monitor token consumption across autonomous test swarms.
|
|
9
|
+
|
|
10
|
+
---
|
|
11
|
+
|
|
12
|
+
## 1. When to Use
|
|
13
|
+
|
|
14
|
+
- Managing multi-agent coordination, test suite sharding, and throughput.
|
|
15
|
+
- Profiling sub-agent task decomposition to eliminate redundant execution.
|
|
16
|
+
- Implementing dynamic model tiering (fast models for search, deep models for healing).
|
|
17
|
+
- Budgeting context tokens across collaborative agent swarms.
|
|
18
|
+
|
|
19
|
+
---
|
|
20
|
+
|
|
21
|
+
## 2. Core Orchestration Principles
|
|
22
|
+
|
|
23
|
+
1. **Single Front-Door Protocol:**
|
|
24
|
+
- All inbound tasks route through `orchestrator` to prevent split-brain execution.
|
|
25
|
+
2. **Context Isolation (`Workspace: 'share'`):**
|
|
26
|
+
- Subagents run in isolated workspaces to avoid git index collisions and context pollution.
|
|
27
|
+
3. **Observation Distillation:**
|
|
28
|
+
- Subagents return only 3-5 line summaries and pointers to logs on disk, never dumping thousands of stdout lines into the parent context.
|
|
29
|
+
4. **Dynamic Model Routing:**
|
|
30
|
+
- Use lighter models (`flash`, `flash_lite`) for element exploration and log filtering.
|
|
31
|
+
- Use deeper models (`inherit`, `pro`) for root-cause synthesis and AST mutation testing.
|
|
32
|
+
|
|
33
|
+
---
|
|
34
|
+
|
|
35
|
+
## 3. Workload Sharding & Matrix Execution
|
|
36
|
+
|
|
37
|
+
```python
|
|
38
|
+
# Multi-agent workload partition example
|
|
39
|
+
def shard_test_workload(suite_files: list, max_agents: int = 4) -> list:
|
|
40
|
+
"""Partitions test cases across parallel subagents to minimize total execution wall-clock time."""
|
|
41
|
+
shards = [[] for _ in range(max_agents)]
|
|
42
|
+
for idx, test_file in enumerate(suite_files):
|
|
43
|
+
shards[idx % max_agents].append(test_file)
|
|
44
|
+
return [s for s in shards if s]
|
|
45
|
+
```
|
|
46
|
+
|
|
47
|
+
---
|
|
48
|
+
|
|
49
|
+
## 4. Token & Latency Governance
|
|
50
|
+
|
|
51
|
+
| Optimization Layer | Baseline (Naive) | Optimized (Synapse Swarm) | Savings |
|
|
52
|
+
| :--- | :--- | :--- | :--- |
|
|
53
|
+
| **CLI Log Output** | Dump 3,000 lines | `tools/distill_log.py` (< 50 tokens) | **95%** |
|
|
54
|
+
| **Codebase Reading** | Read whole classes | `tools/repo_map.txt` (< 600 tokens) | **90%** |
|
|
55
|
+
| **Failure Resolution**| Multiple prompt loops | SQLite cache lookup (< 0.1s) | **> 90%** |
|
|
56
|
+
| **DOM Inspection** | Raw HTML DOM | Compact AOM (< 500 tokens) | **90%** |
|
|
57
|
+
|
|
58
|
+
---
|
|
59
|
+
|
|
60
|
+
## 5. Verification & Safety Guidelines
|
|
61
|
+
|
|
62
|
+
- Always establish baseline metrics before applying workflow changes.
|
|
63
|
+
- Ensure subagent dynamic test data uses unique runtime IDs (`AUTO_<timestamp>_<agentId>`).
|
|
64
|
+
- Enforce automated teardown for all creation actions dispatched by subagents.
|
|
65
|
+
|
|
66
|
+
---
|
|
67
|
+
|
|
68
|
+
## 6. Hierarchical Process & Manager Delegation
|
|
69
|
+
|
|
70
|
+
> *Borrowed and adapted from the crewAI hierarchical process model (MIT license, crewAIInc/crewAI).*
|
|
71
|
+
|
|
72
|
+
The hub's default is a flat swarm with the `orchestrator` as single front-door
|
|
73
|
+
(Section 2). For tasks too large for one dispatch round, escalate to a
|
|
74
|
+
**hierarchical process**:
|
|
75
|
+
|
|
76
|
+
1. **Manager delegation** — the orchestrator becomes a manager: it decomposes
|
|
77
|
+
the goal, assigns one bounded sub-task per specialist (`live-explorer`,
|
|
78
|
+
`pom-crafter`, `test-runner`, `failure-analyst`), and validates each result
|
|
79
|
+
before assigning the next. Workers never talk sideways; all coordination
|
|
80
|
+
flows through the manager.
|
|
81
|
+
2. **Bounded delegation depth** — max 2 levels (orchestrator → specialist →
|
|
82
|
+
sub-task). Deeper recursion hides cost and breaks the token budget.
|
|
83
|
+
3. **Validation gates between hops** — a manager accepts a sub-task result
|
|
84
|
+
only when it passes its stage gate (e.g. Stage 1 Data Contract JSON is
|
|
85
|
+
schema-valid); rejected results are retried once, then escalated.
|
|
86
|
+
4. **Escalate structure, not authority** — the hierarchy speeds coordination;
|
|
87
|
+
Truth Anchor, safety firewall and quality gates apply identically at every
|
|
88
|
+
level. Delegation never bypasses a gate.
|
package/.agents/skills/agent-orchestration-multi-agent-optimize/examples/swarm_workload_config.json
ADDED
|
@@ -0,0 +1,15 @@
|
|
|
1
|
+
{
|
|
2
|
+
"swarm": "LeadQAOrchestrator",
|
|
3
|
+
"subagents": [
|
|
4
|
+
"test-designer",
|
|
5
|
+
"live-explorer",
|
|
6
|
+
"pom-crafter",
|
|
7
|
+
"api-engineer",
|
|
8
|
+
"test-runner",
|
|
9
|
+
"perf-engineer",
|
|
10
|
+
"failure-analyst",
|
|
11
|
+
"quality-gatekeeper"
|
|
12
|
+
],
|
|
13
|
+
"tokenBudgetPerAgent": 1200,
|
|
14
|
+
"concurrency": 3
|
|
15
|
+
}
|
|
@@ -0,0 +1,69 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: agentless-qa-repair
|
|
3
|
+
description: "Repair broken test scripts and Page Classes using an Agentless 3-phase flow: localization, candidate synthesis, and minimal diff validation. Use when repairing test failures without multi-agent chat bloat."
|
|
4
|
+
---
|
|
5
|
+
|
|
6
|
+
# Agentless QA Repair Skill — Ultra-Low-Token 3-Phase Failure Healing
|
|
7
|
+
|
|
8
|
+
> **Paradigm Attribution:** Inspired by **UIUC OpenAutoCoder Agentless**.
|
|
9
|
+
> **Core Principle:** The best fix is the smallest working diff without round-trip chat loops. Solve 80% of daily test automation defects with a single-pass 3-stage pipeline under 2,500 tokens.
|
|
10
|
+
|
|
11
|
+
---
|
|
12
|
+
|
|
13
|
+
## 1. The 3-Phase Deterministic Pipeline
|
|
14
|
+
|
|
15
|
+
Rather than spawning multi-turn swarm conversations that cost 40,000–80,000 tokens per failure, `agentless-qa-repair` executes in three deterministic stages:
|
|
16
|
+
|
|
17
|
+
```mermaid
|
|
18
|
+
flowchart LR
|
|
19
|
+
Fail["Test Failure (Stacktrace)"] --> P1["Phase 1: Localization<br/>Pinpoint file & line span"]
|
|
20
|
+
P1 --> P2["Phase 2: Candidate Gen<br/>Synthesize 3 minimal patches"]
|
|
21
|
+
P2 --> P3["Phase 3: Validation & Gate<br/>Syntax + Clean POM + Diff"]
|
|
22
|
+
P3 --> Winner["Apply Shortest Winning Diff (<10s)"]
|
|
23
|
+
```
|
|
24
|
+
|
|
25
|
+
1. **Phase 1 (Localization):**
|
|
26
|
+
- Parses the stacktrace (Playwright, Jest, JUnit XML, or Python Traceback).
|
|
27
|
+
- Cross-references `tools/repo_map.txt` or repository structure.
|
|
28
|
+
- Restricts focus strictly to the enclosing method and 5–10 line span.
|
|
29
|
+
|
|
30
|
+
2. **Phase 2 (Parallel Candidate Synthesis):**
|
|
31
|
+
- Candidate 1: Semantic ARIA role locator (`getByRole('button', { name: '...' })`).
|
|
32
|
+
- Candidate 2: Resilient test identifier (`getByTestId('...')`).
|
|
33
|
+
- Candidate 3: Smart wait / network idle synchronization wrapper (`waitForLoadState('networkidle')`).
|
|
34
|
+
|
|
35
|
+
3. **Phase 3 (Validation & Selection):**
|
|
36
|
+
- Checks AST syntax validity (Python `ast.parse` or JS/TS/Groovy bracket balance).
|
|
37
|
+
- Enforces **Clean POM**: strictly rejects raw XPath / CSS injected into test script files.
|
|
38
|
+
- Selects the shortest valid diff that clears all checks.
|
|
39
|
+
|
|
40
|
+
---
|
|
41
|
+
|
|
42
|
+
## 2. CLI Tool Usage
|
|
43
|
+
|
|
44
|
+
Autonomous trigger via `tools/agentless_patcher.py`:
|
|
45
|
+
|
|
46
|
+
```bash
|
|
47
|
+
# End-to-end 3-stage healing
|
|
48
|
+
python tools/agentless_patcher.py heal-failure \
|
|
49
|
+
--error-log reports/failed_run.log \
|
|
50
|
+
--repo-map tools/repo_map.txt \
|
|
51
|
+
--max-candidates 3
|
|
52
|
+
|
|
53
|
+
# Localize failing line only
|
|
54
|
+
python tools/agentless_patcher.py localize-error \
|
|
55
|
+
--error-log reports/failed_run.log
|
|
56
|
+
|
|
57
|
+
# Generate patch candidates for a specific line
|
|
58
|
+
python tools/agentless_patcher.py generate-candidates \
|
|
59
|
+
--file src/pages/CustomerDirectoryPage.ts \
|
|
60
|
+
--line 48
|
|
61
|
+
```
|
|
62
|
+
|
|
63
|
+
---
|
|
64
|
+
|
|
65
|
+
## 3. Strict Operating Invariants
|
|
66
|
+
|
|
67
|
+
- **Token Budget Ceiling:** Must stay under **2,500 tokens** per repair cycle.
|
|
68
|
+
- **Zero Raw Selectors in Test Scripts:** If the failing file is located in `tests/`, `Scripts/`, or matches `*.spec.ts`, the fix must redirect selector adjustments into the corresponding Page Class extending `BasePage`.
|
|
69
|
+
- **Minimal Working Diff:** Always choose the patch with the fewest altered lines that passes verification.
|
|
@@ -0,0 +1,17 @@
|
|
|
1
|
+
{
|
|
2
|
+
"status": "PASS",
|
|
3
|
+
"localization": {
|
|
4
|
+
"file": "src/pages/CustomerDirectoryPage.ts",
|
|
5
|
+
"method": "selectCustomerRow",
|
|
6
|
+
"line_span": [48, 52]
|
|
7
|
+
},
|
|
8
|
+
"candidates_evaluated": 3,
|
|
9
|
+
"validation_results": {
|
|
10
|
+
"candidate_1": "FAIL (Syntax error: unbalanced bracket)",
|
|
11
|
+
"candidate_2": "PASS (All DoD Gates cleared, diff: 2 lines)",
|
|
12
|
+
"candidate_3": "PASS (All DoD Gates cleared, diff: 6 lines)"
|
|
13
|
+
},
|
|
14
|
+
"selected_winner": "candidate_2",
|
|
15
|
+
"tokens_consumed": 1780,
|
|
16
|
+
"elapsed_seconds": 7.8
|
|
17
|
+
}
|
|
@@ -0,0 +1,40 @@
|
|
|
1
|
+
# Agentless 3-Phase Test Automation Repair Workflow
|
|
2
|
+
|
|
3
|
+
> **Heritage:** Adapted from **Agentless (Xia et al.)** — eliminates conversational churn and token waste by executing repair through 3 deterministic phases: **Localization**, **Candidate Synthesis**, and **Minimal Diff Validation**.
|
|
4
|
+
|
|
5
|
+
---
|
|
6
|
+
|
|
7
|
+
## Phase 1: Failure Localization (0 LLM Tokens)
|
|
8
|
+
|
|
9
|
+
Parse JUnit XML and trace stack frames to isolate the exact failing line:
|
|
10
|
+
```bash
|
|
11
|
+
python tools/agentless_patcher.py localize --junit Reports/junit.xml
|
|
12
|
+
```
|
|
13
|
+
|
|
14
|
+
**Result:**
|
|
15
|
+
- File: `tests/e2e/test_billing.py`
|
|
16
|
+
- Line: `87`
|
|
17
|
+
- Failing Expression: `assert invoice['total'] == 120.0`
|
|
18
|
+
- Actual State: `invoice['total'] == 120.00000000000001` (IEEE 754 float drift)
|
|
19
|
+
|
|
20
|
+
---
|
|
21
|
+
|
|
22
|
+
## Phase 2: Candidate Patch Synthesis
|
|
23
|
+
|
|
24
|
+
Generate the minimal semantic patch targeting the localized line:
|
|
25
|
+
```diff
|
|
26
|
+
- assert invoice['total'] == 120.0
|
|
27
|
+
+ assert round(invoice['total'], 2) == 120.00
|
|
28
|
+
```
|
|
29
|
+
|
|
30
|
+
---
|
|
31
|
+
|
|
32
|
+
## Phase 3: Minimal Diff Validation & Rollback Guard
|
|
33
|
+
|
|
34
|
+
Execute targeted test runner within a reversible sandbox:
|
|
35
|
+
```bash
|
|
36
|
+
python tools/agentless_patcher.py verify --patch candidate_fix.diff --test-cmd "pytest tests/e2e/test_billing.py"
|
|
37
|
+
```
|
|
38
|
+
|
|
39
|
+
- If test PASSES $\to$ Commit surgical patch.
|
|
40
|
+
- If test FAILS $\to$ Instant rollback without residual workspace dirt.
|
|
@@ -0,0 +1,63 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: antigravity-test-sentinel
|
|
3
|
+
description: "Enforce verification-first discipline: blocks task completion until tests and quality gates pass. Use when enforcing Definition-of-Done quality gates before completing a code or test task."
|
|
4
|
+
---
|
|
5
|
+
|
|
6
|
+
# Antigravity Test Sentinel — Verification-First Gatekeeper
|
|
7
|
+
|
|
8
|
+
The **Antigravity Test Sentinel** enforces absolute engineering integrity across test creation, script refactoring, and bug fixes. It acts as an autonomous circuit breaker that physically prohibits the AI Agent from concluding a task without verifiable proof of test execution success.
|
|
9
|
+
|
|
10
|
+
---
|
|
11
|
+
|
|
12
|
+
## 1. The Sentinel Axiom (Zero-Hallucination Gate)
|
|
13
|
+
|
|
14
|
+
1. **The Core Rule:**
|
|
15
|
+
- Writing code is NOT completing the task.
|
|
16
|
+
- Editing a locator is NOT fixing a failure.
|
|
17
|
+
- **A task is ONLY complete when the test execution returns Exit Code 0.**
|
|
18
|
+
|
|
19
|
+
2. **Prohibited Agent Behaviors:**
|
|
20
|
+
- 🚫 Saying *"I have fixed the issue"* without executing verification.
|
|
21
|
+
- 🚫 Assuming a locator or script will work based on static text analysis.
|
|
22
|
+
- 🚫 Ignoring non-zero exit codes from CLI runners or Gradle builds.
|
|
23
|
+
|
|
24
|
+
---
|
|
25
|
+
|
|
26
|
+
## 2. Gate-Lock Protocol
|
|
27
|
+
|
|
28
|
+
Whenever an Agent modifies any test script, Page Class, locator, or helper method:
|
|
29
|
+
|
|
30
|
+
```mermaid
|
|
31
|
+
flowchart TD
|
|
32
|
+
Edit["1. Code Edit / Bug Fix Applied"] --> Run["2. Execute Test Runner Command"]
|
|
33
|
+
Run --> Check{"3. Check Process Exit Code"}
|
|
34
|
+
Check -- "Exit Code == 0" --> DoD["4. Run verify_all.py (10 Quality Gates)"]
|
|
35
|
+
DoD -- "All Gates PASS" --> Complete["5. Declare Task Complete ✅"]
|
|
36
|
+
Check -- "Exit Code != 0" --> Extract["4a. Extract Stack Trace & Failing Line"]
|
|
37
|
+
Extract --> Heal["4b. In-Place Healing Loop"]
|
|
38
|
+
Heal --> Run
|
|
39
|
+
```
|
|
40
|
+
|
|
41
|
+
1. **Step 1: Execute Runner Command:**
|
|
42
|
+
- Run the targeted test case or test suite via headless CLI runner or verification gate:
|
|
43
|
+
```bash
|
|
44
|
+
synapse verify
|
|
45
|
+
```
|
|
46
|
+
2. **Step 2: Inspect Exit Code:**
|
|
47
|
+
- If the process terminates with exit code != 0, the task is **LOCKED**.
|
|
48
|
+
- The Agent must not ask the user for confirmation or declare success.
|
|
49
|
+
3. **Step 3: Self-Diagnosis & Auto-Healing:**
|
|
50
|
+
- The Agent must parse the exact error exception and stack trace from the failure output.
|
|
51
|
+
- Apply targeted in-place healing and re-execute.
|
|
52
|
+
4. **Step 4: Definition of Done Verification:**
|
|
53
|
+
- Run `synapse verify` to confirm all 10 Quality Gates pass.
|
|
54
|
+
|
|
55
|
+
---
|
|
56
|
+
|
|
57
|
+
## 3. Sentinel Status Header
|
|
58
|
+
|
|
59
|
+
In accordance with Antigravity operating discipline, include the sentinel verification status in the session summary:
|
|
60
|
+
|
|
61
|
+
```text
|
|
62
|
+
> 🛡️ SENTINEL STATUS: VERIFIED (Exit Code: 0 | 10/10 Gates PASS)
|
|
63
|
+
```
|
|
@@ -0,0 +1,47 @@
|
|
|
1
|
+
# Sprint Definition of Done (DoD) Sentinel Enforcement
|
|
2
|
+
|
|
3
|
+
> **Policy:** No feature branch, bug fix, or refactoring PR may merge without passing all active DoD gates.
|
|
4
|
+
|
|
5
|
+
---
|
|
6
|
+
|
|
7
|
+
## 1. Zero-Command Local Verification
|
|
8
|
+
|
|
9
|
+
Before handing off code to reviewers or pushing to remote, AI agents automatically execute:
|
|
10
|
+
|
|
11
|
+
```bash
|
|
12
|
+
python tools/verify_all.py --mode hub
|
|
13
|
+
```
|
|
14
|
+
|
|
15
|
+
Expected output:
|
|
16
|
+
```text
|
|
17
|
+
======================================================================
|
|
18
|
+
[ALL QUALITY GATES PASSED - 100% DoD COMPLIANT]
|
|
19
|
+
Repository is 100% compliant, secure, and ready for execution/CI/CD.
|
|
20
|
+
======================================================================
|
|
21
|
+
```
|
|
22
|
+
|
|
23
|
+
---
|
|
24
|
+
|
|
25
|
+
## 2. Gate Failure Escalation Protocol
|
|
26
|
+
|
|
27
|
+
| Failed Gate | Immediate Remediation | Non-Negotiable Boundary |
|
|
28
|
+
| :--- | :--- | :--- |
|
|
29
|
+
| **Gate 1 (UTF-8 BOM)** | Re-encode file to UTF-8 without BOM; verify with `tools/verify_all.py`. | Reject PR automatically; zero BOM tolerated. |
|
|
30
|
+
| **Gate 3 (Clean POM)** | Move raw XPath/CSS selectors from test script into Page Class. | Zero raw selectors inside `tests/` or `Scripts/`. |
|
|
31
|
+
| **Gate 6 (Credentials)** | Remove hardcoded passwords or keys; move to `.env` or CI secret. | Never bypass; zero plain secrets on disk. |
|
|
32
|
+
| **Gate 7 (Static Linter)** | Remove empty catch blocks (`except: pass`); add valid asserts. | Zero fake-passes allowed. |
|
|
33
|
+
| **Gate 8 (Mutator >= 80%)** | Add downstream assertions validating mutated return state. | Mutation score $< 80\%$ blocks completion. |
|
|
34
|
+
|
|
35
|
+
---
|
|
36
|
+
|
|
37
|
+
## 3. CI/CD Pre-Push Hook Integration
|
|
38
|
+
|
|
39
|
+
Inside `.git/hooks/pre-push`:
|
|
40
|
+
```bash
|
|
41
|
+
#!/bin/sh
|
|
42
|
+
python3 tools/verify_all.py --mode hub
|
|
43
|
+
if [ $? -ne 0 ]; then
|
|
44
|
+
echo "❌ [DoD BLOCKED] Cannot push until all 10 Quality Gates pass."
|
|
45
|
+
exit 1
|
|
46
|
+
fi
|
|
47
|
+
```
|
|
@@ -0,0 +1,142 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: api-network-mocking-interception
|
|
3
|
+
description: "Intercept HTTP/GraphQL traffic, stub routes, and simulate chaos network failures. Use when stubbing, mocking, or intercepting network calls during UI or API tests."
|
|
4
|
+
---
|
|
5
|
+
|
|
6
|
+
# API Network Mocking, Interception & Resilience Skill
|
|
7
|
+
|
|
8
|
+
> **Target:** Eliminate flaky tests caused by backend dependencies, slow microservices, or inconsistent staging data by intercepting browser-level network requests, and verify frontend resilience against network faults and degradations.
|
|
9
|
+
|
|
10
|
+
---
|
|
11
|
+
|
|
12
|
+
## 1. Core Principles
|
|
13
|
+
|
|
14
|
+
1. **Deterministic State over Staging Data:**
|
|
15
|
+
- UI tests should verify front-end state rendering and user interactions, not whether the backend DB is seeded.
|
|
16
|
+
- Use route interception (`page.route()`) to return predictable JSON contracts (success, 400 Bad Request, 500 Server Error).
|
|
17
|
+
|
|
18
|
+
2. **Zero Network Latency:**
|
|
19
|
+
- Mock external telemetry, 3rd party analytics, fonts, and heavy media assets to speed up execution by 3x-5x.
|
|
20
|
+
|
|
21
|
+
3. **Fault Injection & Chaos Verification:**
|
|
22
|
+
- Test UI resiliency against network timeouts, dropped connections, upstream gateway outages (502/503/504), and malformed schemas without altering real server code.
|
|
23
|
+
- Guard against White Screen of Death (WSOD) when sudden network loss or circuit-breaking events occur.
|
|
24
|
+
|
|
25
|
+
---
|
|
26
|
+
|
|
27
|
+
## 2. Playwright Route Interception Standard Patterns
|
|
28
|
+
|
|
29
|
+
### Pattern A: Static JSON Response Stubbing
|
|
30
|
+
```typescript
|
|
31
|
+
// Stub user profile API
|
|
32
|
+
await page.route('**/api/v1/user/profile', async (route) => {
|
|
33
|
+
await route.fulfill({
|
|
34
|
+
status: 200,
|
|
35
|
+
contentType: 'application/json',
|
|
36
|
+
body: JSON.stringify({
|
|
37
|
+
id: 'USR_AUTO_99',
|
|
38
|
+
username: 'qa_sentinel',
|
|
39
|
+
roles: ['ADMIN_OPERATOR'],
|
|
40
|
+
permissions: ['READ', 'WRITE', 'EXECUTE']
|
|
41
|
+
})
|
|
42
|
+
});
|
|
43
|
+
});
|
|
44
|
+
```
|
|
45
|
+
|
|
46
|
+
### Pattern B: Modifying Live Responses (HAR / Passthrough Mutation)
|
|
47
|
+
```typescript
|
|
48
|
+
// Intercept real response and inject edge-case field
|
|
49
|
+
await page.route('**/api/v1/reports', async (route) => {
|
|
50
|
+
const response = await route.fetch();
|
|
51
|
+
const json = await response.json();
|
|
52
|
+
json.totalItems = 999999; // Test UI overflow / pagination edge case
|
|
53
|
+
await route.fulfill({ response, json });
|
|
54
|
+
});
|
|
55
|
+
```
|
|
56
|
+
|
|
57
|
+
### Pattern C: Simulating Network Failures & Delays
|
|
58
|
+
```typescript
|
|
59
|
+
// Simulate 500 Internal Server Error
|
|
60
|
+
await page.route('**/api/v1/checkout', async (route) => {
|
|
61
|
+
await route.fulfill({
|
|
62
|
+
status: 500,
|
|
63
|
+
contentType: 'application/json',
|
|
64
|
+
body: JSON.stringify({ errorCode: 'ERR_PAYMENT_DOWN', message: 'Gateway unreachable' })
|
|
65
|
+
});
|
|
66
|
+
});
|
|
67
|
+
|
|
68
|
+
// Simulate High Latency (Slow 3G)
|
|
69
|
+
await page.route('**/api/v1/heavy-list', async (route) => {
|
|
70
|
+
await new Promise(res => setTimeout(res, 3000));
|
|
71
|
+
await route.continue();
|
|
72
|
+
});
|
|
73
|
+
```
|
|
74
|
+
|
|
75
|
+
---
|
|
76
|
+
|
|
77
|
+
## 3. Chaos & Network Degradation Patterns
|
|
78
|
+
|
|
79
|
+
### Pattern D: Emulating Extreme Latency & Jitter via CDP
|
|
80
|
+
```typescript
|
|
81
|
+
const client = await page.context().newCDPSession(page);
|
|
82
|
+
await client.send('Network.emulateNetworkConditions', {
|
|
83
|
+
offline: false,
|
|
84
|
+
latency: 3500, // 3.5s roundtrip latency
|
|
85
|
+
downloadThroughput: ((500 * 1024) / 8), // 500 kbps
|
|
86
|
+
uploadThroughput: ((500 * 1024) / 8),
|
|
87
|
+
connectionType: 'cellular3g',
|
|
88
|
+
});
|
|
89
|
+
|
|
90
|
+
await page.goto('/orders');
|
|
91
|
+
// Verify UI displays loading skeleton/spinner and submit button is disabled in-flight
|
|
92
|
+
const submitBtn = page.locator('button[type="submit"]');
|
|
93
|
+
if (await submitBtn.isVisible()) {
|
|
94
|
+
await expect(submitBtn).toBeDisabled();
|
|
95
|
+
}
|
|
96
|
+
```
|
|
97
|
+
|
|
98
|
+
### Pattern E: Simulating Gateway Drops (502/503/504) & Circuit Breaker Recovery
|
|
99
|
+
```typescript
|
|
100
|
+
let attemptCount = 0;
|
|
101
|
+
await page.route('**/api/v1/orders/submit', async (route) => {
|
|
102
|
+
attemptCount++;
|
|
103
|
+
if (attemptCount <= 2) {
|
|
104
|
+
await route.fulfill({
|
|
105
|
+
status: 503,
|
|
106
|
+
contentType: 'application/json',
|
|
107
|
+
body: JSON.stringify({ message: 'Upstream gateway overloaded' }),
|
|
108
|
+
});
|
|
109
|
+
} else {
|
|
110
|
+
await route.fulfill({
|
|
111
|
+
status: 200,
|
|
112
|
+
contentType: 'application/json',
|
|
113
|
+
body: JSON.stringify({ success: true, orderId: 'ORD_HEALED_99' }),
|
|
114
|
+
});
|
|
115
|
+
}
|
|
116
|
+
});
|
|
117
|
+
```
|
|
118
|
+
|
|
119
|
+
### Pattern F: Sudden Offline Disconnection & Reconnection
|
|
120
|
+
```typescript
|
|
121
|
+
// 1. Cut network abruptly
|
|
122
|
+
await context.setOffline(true);
|
|
123
|
+
await page.click('[data-testid="nav-reports"]').catch(() => {});
|
|
124
|
+
|
|
125
|
+
// 2. Assert Zero White Screen of Death (WSOD) & Offline alert
|
|
126
|
+
const bodyContent = await page.evaluate(() => document.body.innerText.trim());
|
|
127
|
+
expect(bodyContent.length, 'Page must not be blank').toBeGreaterThan(20);
|
|
128
|
+
|
|
129
|
+
// 3. Restore connectivity
|
|
130
|
+
await context.setOffline(false);
|
|
131
|
+
await page.reload();
|
|
132
|
+
await expect(page.locator('h1')).toBeVisible();
|
|
133
|
+
```
|
|
134
|
+
|
|
135
|
+
---
|
|
136
|
+
|
|
137
|
+
## 4. Best Practices Checklist
|
|
138
|
+
- [ ] Always declare routes **before** calling `page.goto()`.
|
|
139
|
+
- [ ] Use regex or glob patterns with caution; avoid intercepting Vite/Webpack bundling scripts.
|
|
140
|
+
- [ ] Critical forms must disable submit buttons during in-flight network transit to prevent duplicate requests.
|
|
141
|
+
- [ ] HTTP 502/503/504 errors must trigger user-friendly notifications, never raw JSON dumps or blank screens.
|
|
142
|
+
- [ ] For teardown, unroute specific patterns or reset context per test.
|
|
@@ -0,0 +1,80 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: api-spec-to-e2e-matrix
|
|
3
|
+
description: "Generate automated positive, boundary, and negative test matrices from OpenAPI specifications. Use when converting an OpenAPI/Swagger spec into an end-to-end test matrix."
|
|
4
|
+
---
|
|
5
|
+
|
|
6
|
+
# API Spec to E2E Matrix — Contract-Based Test Generator
|
|
7
|
+
|
|
8
|
+
This skill converts OpenAPI / Swagger specifications, JSON Schemas, or REST endpoint contracts into a structured, executable End-to-End (E2E) testing matrix covering happy path, boundary values, and negative error scenarios.
|
|
9
|
+
|
|
10
|
+
---
|
|
11
|
+
|
|
12
|
+
## 1. Test Generation Matrix Taxonomy
|
|
13
|
+
|
|
14
|
+
```mermaid
|
|
15
|
+
flowchart TD
|
|
16
|
+
Spec["OpenAPI / Swagger / JSON Schema"] --> Parse["Extract Endpoint Contracts"]
|
|
17
|
+
Parse --> Pos["1. Positive Happy Path<br/>• Valid payload<br/>• HTTP 200/201<br/>• Response schema match"]
|
|
18
|
+
Parse --> Bound["2. Boundary Value Analysis<br/>• Min/Max string length<br/>• Zero, negative numbers<br/>• Unicode & special chars"]
|
|
19
|
+
Parse --> Neg["3. Negative & Fault Scenarios<br/>• Missing required fields (400)<br/>• Invalid auth token (401/403)<br/>• Malformed payload (422)"]
|
|
20
|
+
|
|
21
|
+
Pos & Bound & Neg --> Suite["Executable Test Suite"]
|
|
22
|
+
```
|
|
23
|
+
|
|
24
|
+
---
|
|
25
|
+
|
|
26
|
+
## 2. Boundary Value Generation Rules
|
|
27
|
+
|
|
28
|
+
For every field defined in the endpoint schema, generate targeted edge cases:
|
|
29
|
+
|
|
30
|
+
| Field Data Type | Schema Constraint | Generated Boundary Test Inputs |
|
|
31
|
+
| :--- | :--- | :--- |
|
|
32
|
+
| **String (Code / ID)** | `minLength: 3, maxLength: 20` | Empty string `""`, 2 chars, exactly 3 chars, 20 chars, 21 chars, special chars `<script>`, SQL `' OR 1=1--` |
|
|
33
|
+
| **Number / Integer** | `minimum: 0, maximum: 1000` | `-1`, `0`, `1`, `999`, `1000`, `1001`, floating point `10.5` |
|
|
34
|
+
| **Date / Timestamp** | `format: date-time` | Past date, today, future date, leap year `2024-02-29`, invalid format `31/12/2026` |
|
|
35
|
+
| **Enum** | `["ACTIVE", "INACTIVE"]` | Exactly `"ACTIVE"`, lowercase `"active"`, null, undefined, unknown enum `"DELETED"` |
|
|
36
|
+
| **Required Properties** | `required: ["code", "name"]` | Omit `code`, omit `name`, send `null` values |
|
|
37
|
+
|
|
38
|
+
---
|
|
39
|
+
|
|
40
|
+
## 3. Negative Scenario Validation Checklist
|
|
41
|
+
|
|
42
|
+
Every negative test case must assert two distinct layers:
|
|
43
|
+
1. **API Layer Assertion:**
|
|
44
|
+
- Verify HTTP Status Code is appropriately 400, 401, 403, 404, or 422.
|
|
45
|
+
- Verify error payload contains expected error codes and localization messages.
|
|
46
|
+
2. **UI / Toast Notification Layer Assertion:**
|
|
47
|
+
- Verify that the web UI displays the appropriate red toast notification (e.g. *"Dữ liệu không hợp lệ"* or *"Mã đã tồn tại"*).
|
|
48
|
+
- Verify that the form remains open and input fields preserve user state without losing entered data.
|
|
49
|
+
|
|
50
|
+
---
|
|
51
|
+
|
|
52
|
+
## 4. Automation Output Standards
|
|
53
|
+
|
|
54
|
+
- Generated test cases must adhere to the project's **Clean POM** structure.
|
|
55
|
+
- All requests should utilize dynamic test data with unique timestamp prefixes to ensure idempotency.
|
|
56
|
+
|
|
57
|
+
---
|
|
58
|
+
|
|
59
|
+
## 5. Automated Execution via Tooling
|
|
60
|
+
|
|
61
|
+
Agent can automatically invoke `tools/generate_api_matrix.py` and `tools/export_postman_collection.py`:
|
|
62
|
+
|
|
63
|
+
```bash
|
|
64
|
+
# 1. Generate Markdown matrix
|
|
65
|
+
python3 tools/generate_api_matrix.py --spec path/to/openapi.json --format md -o docs/api_matrix.md
|
|
66
|
+
|
|
67
|
+
# 2. Generate JSON matrix for programmatic ingestion
|
|
68
|
+
python3 tools/generate_api_matrix.py --spec path/to/openapi.json --format json -o reports/api_matrix.json
|
|
69
|
+
|
|
70
|
+
# 3. Export directly to Postman Collection v2.1.0 with AJV JSON Schema & DDT
|
|
71
|
+
synapse export-postman --spec path/to/openapi.json -o postman_collection.json --env-output postman_env.json --ddt-output test_data.csv
|
|
72
|
+
|
|
73
|
+
# 4. Zero-Input Autonomous Synthesis (No input file provided!)
|
|
74
|
+
agent-qa export-postman --domain banking -o banking_col.json --env-output env.json --ddt-output ddt.csv
|
|
75
|
+
agent-qa export-postman --domain ecommerce -o ecom_col.json
|
|
76
|
+
|
|
77
|
+
# 5. Execute Newman & Enforce CI/CD Quality Gate
|
|
78
|
+
newman run postman_collection.json -e postman_env.json -d test_data.csv -r cli,json --reporter-json-export report.json
|
|
79
|
+
agent-qa analyze-newman report.json --max-failures 0 --sla-avg 500 --markdown pr_report.md
|
|
80
|
+
```
|
|
@@ -0,0 +1,19 @@
|
|
|
1
|
+
{
|
|
2
|
+
"openapi": "3.0.0",
|
|
3
|
+
"info": {
|
|
4
|
+
"title": "Payment API",
|
|
5
|
+
"version": "1.0.0"
|
|
6
|
+
},
|
|
7
|
+
"paths": {
|
|
8
|
+
"/payments": {
|
|
9
|
+
"post": {
|
|
10
|
+
"summary": "Create payment",
|
|
11
|
+
"responses": {
|
|
12
|
+
"201": {
|
|
13
|
+
"description": "Created"
|
|
14
|
+
}
|
|
15
|
+
}
|
|
16
|
+
}
|
|
17
|
+
}
|
|
18
|
+
}
|
|
19
|
+
}
|
|
@@ -0,0 +1,64 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: architecture-decision-records
|
|
3
|
+
description: "Record, structure, and maintain technical Architecture Decision Records (ADRs). Use when documenting significant architecture decisions as ADRs."
|
|
4
|
+
---
|
|
5
|
+
|
|
6
|
+
# Architecture Decision Records (ADR) Skill
|
|
7
|
+
|
|
8
|
+
> **Target:** Standardize technical decision logs, architectural trade-offs, and design rationale across enterprise testing platforms.
|
|
9
|
+
|
|
10
|
+
---
|
|
11
|
+
|
|
12
|
+
## 1. When to Use
|
|
13
|
+
|
|
14
|
+
- Documenting significant framework, toolchain, or database decisions.
|
|
15
|
+
- Recording architecture changes (e.g. Clean POM flat architecture vs BDD layer).
|
|
16
|
+
- Capturing security, authentication, or CI/CD migration trade-offs.
|
|
17
|
+
- Onboarding engineers and providing institutional architectural memory.
|
|
18
|
+
|
|
19
|
+
---
|
|
20
|
+
|
|
21
|
+
## 2. ADR Lifecycle State Machine
|
|
22
|
+
|
|
23
|
+
```mermaid
|
|
24
|
+
stateDiagram-v2
|
|
25
|
+
Proposed --> Accepted: Team Approval
|
|
26
|
+
Proposed --> Rejected: Review Decision
|
|
27
|
+
Accepted --> Deprecated: Superseded / EOL
|
|
28
|
+
Accepted --> Superseded: Replaced by New ADR
|
|
29
|
+
```
|
|
30
|
+
|
|
31
|
+
---
|
|
32
|
+
|
|
33
|
+
## 3. Standard Lightweight ADR Format
|
|
34
|
+
|
|
35
|
+
Create decision records inside `docs/adr/ADR-XXXX-<title>.md`:
|
|
36
|
+
|
|
37
|
+
```markdown
|
|
38
|
+
# ADR-0001: Adopt Clean POM Flat Architecture
|
|
39
|
+
|
|
40
|
+
## Status
|
|
41
|
+
Accepted
|
|
42
|
+
|
|
43
|
+
## Context
|
|
44
|
+
E2E automated test suites suffered from high maintenance overhead, locator duplication, and flaky runs caused by deeply nested inheritance hierarchies and raw selectors scattered across test scripts.
|
|
45
|
+
|
|
46
|
+
## Decision
|
|
47
|
+
Enforce a 2-tier Clean Page Object Model:
|
|
48
|
+
1. All test scripts live in `tests/` and contain only business action calls.
|
|
49
|
+
2. All locators and DOM operations live in Page Classes inheriting directly from `BasePage`.
|
|
50
|
+
3. Raw XPaths and CSS selectors are strictly prohibited in test scripts.
|
|
51
|
+
|
|
52
|
+
## Consequences
|
|
53
|
+
- **Positive:** Zero locator duplication, modular self-healing, faster onboarding.
|
|
54
|
+
- **Negative:** Requires refactoring legacy tests to encapsulate DOM calls into Page Classes.
|
|
55
|
+
- **Compliance:** Enforced in CI via `tools/verify_all.py` (Gate 3).
|
|
56
|
+
```
|
|
57
|
+
|
|
58
|
+
---
|
|
59
|
+
|
|
60
|
+
## 4. Best Practices
|
|
61
|
+
|
|
62
|
+
- Keep ADRs concise (< 500 words per decision).
|
|
63
|
+
- Store ADRs as markdown versioned alongside code in `docs/adr/`.
|
|
64
|
+
- Never modify an accepted ADR to change history; author a new ADR that supersedes the previous one.
|