synapse-hub 2.1.0 โ 2.2.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.agents/agents/orchestrator.md +7 -0
- package/.agents/rules/lessons-learned.md +1 -0
- package/.agents/skills/agent-orchestration-multi-agent-optimize/SKILL.md +1 -1
- package/.agents/skills/antigravity-test-sentinel/SKILL.md +1 -2
- package/.agents/skills/api-network-mocking-interception/SKILL.md +1 -1
- package/.agents/skills/api-spec-to-e2e-matrix/SKILL.md +11 -4
- package/.agents/skills/architecture-decision-records/SKILL.md +1 -1
- package/.agents/skills/auth-session-and-cookie-manager/SKILL.md +1 -1
- package/.agents/skills/backend-load-and-stress-patterns/SKILL.md +32 -11
- package/.agents/skills/bats-testing-patterns/SKILL.md +1 -1
- package/.agents/skills/clean-pom-crafter/SKILL.md +1 -4
- package/.agents/skills/code-refactoring-refactor-clean/SKILL.md +1 -1
- package/.agents/skills/db-state-verifier-and-seeder/SKILL.md +1 -1
- package/.agents/skills/e2e-testing-patterns/SKILL.md +1 -1
- package/.agents/skills/failure-autopsy-and-healing/SKILL.md +1 -3
- package/.agents/skills/file-and-report-validator/SKILL.md +1 -1
- package/.agents/skills/flaky-test-sentinel-and-quarantine/SKILL.md +1 -1
- package/.agents/skills/github-actions-templates/SKILL.md +1 -1
- package/.agents/skills/graphify-impact-analyzer/SKILL.md +1 -3
- package/.agents/skills/katalon-cli-runner/SKILL.md +1 -1
- package/.agents/skills/lam-script-generator/SKILL.md +1 -2
- package/.agents/skills/playwright-live-interaction/SKILL.md +1 -4
- package/.agents/skills/security-dast-sentinel/SKILL.md +1 -1
- package/.agents/skills/self-healing-locator/SKILL.md +1 -2
- package/.agents/skills/skillspector-security-guard/SKILL.md +115 -0
- package/.agents/skills/synthetic-test-data-generator/SKILL.md +1 -1
- package/.agents/skills/token-and-context-optimizer/SKILL.md +1 -1
- package/.agents/skills/visual-regression-sentinel/SKILL.md +1 -1
- package/.agents/skills/wcag-audit-patterns/SKILL.md +1 -1
- package/.agents/skills/web-vitals-and-performance-profiler/SKILL.md +1 -1
- package/AGENTS.md +36 -0
- package/README.md +140 -103
- package/package.json +1 -1
- package/skills_manifest.json +42 -29
- package/templates/PROJECT_AI_GUIDE_TEMPLATE.md +15 -1
- package/templates/ai_bridges/CLAUDE.md +31 -0
- package/templates/ai_bridges/copilot-instructions.md +25 -0
- package/templates/ai_bridges/cursor_synapse_qa.mdc +26 -0
- package/templates/ai_bridges/windsurfrules +25 -0
- package/templates/ci/github-actions-synapse.yml +28 -0
- package/templates/ci/gitlab-ci-synapse.yml +16 -0
- package/tools/TOOLS_RUNBOOK.md +203 -12
- package/tools/browser_helpers.js +2 -2
- package/tools/bump_version.py +8 -0
- package/tools/cli.py +74 -2
- package/tools/export_postman_collection.py +535 -218
- package/tools/generate_jmx_plan.py +672 -102
- package/tools/git_pre_commit_guard.py +21 -0
- package/tools/jtl_analyzer.py +474 -0
- package/tools/mcp_excel_server.ps1 +1 -1
- package/tools/mcp_server.py +1 -1
- package/tools/newman_analyzer.py +385 -0
- package/tools/setup_project.py +203 -18
- package/tools/skillspector.py +1141 -0
- package/tools/telemetry_correlator.py +351 -0
- package/tools/templates/jmeter-distributed/README.md +54 -0
- package/tools/templates/jmeter-distributed/docker-compose.yml +83 -0
- package/tools/update_sentinel.py +313 -0
- package/tools/repo_map.json +0 -12
- package/tools/repo_map.txt +0 -7
|
@@ -41,3 +41,10 @@ tools:
|
|
|
41
41
|
- `tools/test_impact.py`: Determines impacted test cases prior to task assignment.
|
|
42
42
|
- `tools/lookup_tc.py`: Fast lookup of existing test cases, acceptance criteria, and IDs.
|
|
43
43
|
- `tools/mcp_server.py`: Exposes standardized JSON-RPC 2.0 endpoints for all AI clients.
|
|
44
|
+
|
|
45
|
+
## Single Front-Door FSM Workflow (Deterministic 5 Stages):
|
|
46
|
+
1. **Stage 1 (Discovery):** Invoke `live-explorer` to inspect DOM/AOM and verify selectors under 200ms.
|
|
47
|
+
2. **Stage 2 (Synthesis):** Pass Data Contract to `pom-crafter` to generate Clean POM classes and flat test scripts.
|
|
48
|
+
3. **Stage 3 (Execution):** Dispatch headless execution via `test-runner`.
|
|
49
|
+
4. **Stage 4 (Autopsy):** If test fails, invoke `failure-analyst` to perform RCA and auto-heal.
|
|
50
|
+
5. **Stage 5 (Acceptance):** Trigger `quality-gatekeeper` to verify all 8 Quality Gates and mutation score >= 80%.
|
|
@@ -17,6 +17,7 @@ description: Critical anti-patterns, past mistakes, and strict avoidance rules (
|
|
|
17
17
|
| **5** | **Flaky timing on CI/CD** | `Thread.sleep` failed under variable network lag. | Replace 100% with Smart Wait: Angular `isStable()` and CDP `Network Idle 0`. |
|
|
18
18
|
| **6** | **DB polluted with test junk** | Created entities without executing deletion. | Every data creation test case **must** execute idempotent teardown cleanup. |
|
|
19
19
|
| **7** | **Graphify/CLI ran on Skill Hub instead of target project** | Defaulted to `CWD = Agent Skill` without checking Active Workspaces. | **Agent Skill folder = read-only hub, NEVER a CLI target.** Always identify the real target project from `Active Workspaces` (the non-hub workspace). If multiple project workspaces exist, ask the user. All outputs (graphify-out/, reports) must land inside the target project folder. |
|
|
20
|
+
| **8** | **Target test code pollution on Hub** | Created/committed target tests inside Hub repo. | **Synapse-Hub is strictly read-only for business automation tests.** All page classes, specs, and test cases must reside in the target project workspace. Pre-commit guard rejects business code in Hub. |
|
|
20
21
|
|
|
21
22
|
### Memory Management & Consolidation Protocol:
|
|
22
23
|
- **Max capacity:** 8 active rules in prompt hot memory.
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: agent-orchestration-multi-agent-optimize
|
|
3
|
-
description: "
|
|
3
|
+
description: "Profile, benchmark, and orchestrate multi-agent test workloads and token throughput."
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# Multi-Agent Optimization Toolkit
|
|
@@ -1,7 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: antigravity-test-sentinel
|
|
3
|
-
description:
|
|
4
|
-
Verification-first sentinel for test automation in Antigravity. Strictly locks task completion until test runner commands (verify_all.py, KRE CLI, Playwright) return exit code 0. Forbids declaring completion on unverified code.
|
|
3
|
+
description: "Enforce verification-first discipline: blocks task completion until tests and quality gates pass."
|
|
5
4
|
---
|
|
6
5
|
|
|
7
6
|
# Antigravity Test Sentinel โ Verification-First Gatekeeper
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: api-network-mocking-interception
|
|
3
|
-
description:
|
|
3
|
+
description: "Intercept HTTP/GraphQL traffic, stub routes, and simulate chaos network failures."
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# API Network Mocking, Interception & Resilience Skill
|
|
@@ -1,7 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: api-spec-to-e2e-matrix
|
|
3
|
-
description:
|
|
4
|
-
Transforms OpenAPI/Swagger specifications and JSON schemas into automated E2E positive, boundary value, and negative test matrices.
|
|
3
|
+
description: "Generate automated positive, boundary, and negative test matrices from OpenAPI specifications."
|
|
5
4
|
---
|
|
6
5
|
|
|
7
6
|
# API Spec to E2E Matrix รขโฌโ Contract-Based Test Generator
|
|
@@ -68,6 +67,14 @@ python tools/generate_api_matrix.py --spec path/to/openapi.json --format md -o d
|
|
|
68
67
|
# 2. Generate JSON matrix for programmatic ingestion
|
|
69
68
|
python tools/generate_api_matrix.py --spec path/to/openapi.json --format json -o tools/api_matrix.json
|
|
70
69
|
|
|
71
|
-
# 3. Export directly to Postman Collection v2.1.0 with
|
|
72
|
-
python tools/export_postman_collection.py --spec path/to/openapi.json -o postman_collection.json --env-output postman_env.json
|
|
70
|
+
# 3. Export directly to Postman Collection v2.1.0 with AJV JSON Schema & DDT
|
|
71
|
+
python tools/export_postman_collection.py --spec path/to/openapi.json -o postman_collection.json --env-output postman_env.json --ddt-output test_data.csv
|
|
72
|
+
|
|
73
|
+
# 4. Zero-Input Autonomous Synthesis (No input file provided!)
|
|
74
|
+
agent-qa export-postman --domain banking -o banking_col.json --env-output env.json --ddt-output ddt.csv
|
|
75
|
+
agent-qa export-postman --domain ecommerce -o ecom_col.json
|
|
76
|
+
|
|
77
|
+
# 5. Execute Newman & Enforce CI/CD Quality Gate
|
|
78
|
+
newman run postman_collection.json -e postman_env.json -d test_data.csv -r cli,json --reporter-json-export report.json
|
|
79
|
+
agent-qa analyze-newman report.json --max-failures 0 --sla-avg 500 --markdown pr_report.md
|
|
73
80
|
```
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: architecture-decision-records
|
|
3
|
-
description:
|
|
3
|
+
description: "Record, structure, and maintain technical Architecture Decision Records (ADRs)."
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# Architecture Decision Records
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: auth-session-and-cookie-manager
|
|
3
|
-
description: Manage browser authentication sessions, JWT tokens,
|
|
3
|
+
description: "Manage browser authentication sessions, storageState, JWT tokens, and multi-role state."
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# Auth Session & Cookie Manager Skill
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: backend-load-and-stress-patterns
|
|
3
|
-
description:
|
|
3
|
+
description: "Orchestrate k6 and Locust backend load, stress, and SLA endurance test suites."
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# Backend Load & Stress Testing Patterns (k6 & Locust Orchestrator)
|
|
@@ -204,17 +204,38 @@ locust -f tests/load/locustfile.py --headless -u 100 -r 10 --run-time 5m \
|
|
|
204
204
|
--exit-code-on-error 1
|
|
205
205
|
```
|
|
206
206
|
|
|
207
|
-
### Autonomous Apache JMeter
|
|
208
|
-
Hub provides
|
|
209
|
-
```bash
|
|
210
|
-
# 1. Generate JMeter Test Plan (100 VUs, 10 min, SLA < 500ms)
|
|
211
|
-
python tools/generate_jmx_plan.py --spec swagger.json -o perf_plan.jmx --vus 100 --duration 600
|
|
212
|
-
|
|
213
|
-
# 2. Convert existing Postman collection to JMeter Plan
|
|
214
|
-
python tools/generate_jmx_plan.py --postman postman_collection.json -o perf_plan.jmx --vus 50
|
|
207
|
+
### Autonomous Apache JMeter 360ยฐ Pinnacle Suite (Full-Stack & Multi-Protocol)
|
|
208
|
+
Hub provides complete enterprise lifecycle automation for Apache JMeter 5.x via `generate_jmx_plan.py`, `jtl_analyzer.py`, and `telemetry_correlator.py`:
|
|
215
209
|
|
|
216
|
-
|
|
217
|
-
|
|
210
|
+
```bash
|
|
211
|
+
# 1. Generate Full Enterprise Plan with Pareto Traffic Shaping (70/20/10) & Deep Correlation
|
|
212
|
+
agent-qa generate-jmx --spec swagger.json -o perf_plan.jmx \
|
|
213
|
+
--workload spike --vus 200 --duration 600 \
|
|
214
|
+
--weighted-mix "70:Browse,20:Cart,10:Checkout" \
|
|
215
|
+
--csv-data users.csv --deep-correlation --jsr223-hmac
|
|
216
|
+
|
|
217
|
+
# 2. Multi-Protocol Load Plans (WebSocket, gRPC, Kafka, JDBC)
|
|
218
|
+
agent-qa generate-jmx --ws-sample -o websocket_plan.jmx # Real-time WebSocket feed
|
|
219
|
+
agent-qa generate-jmx --grpc-sample -o grpc_plan.jmx # Microservices Unary RPC
|
|
220
|
+
agent-qa generate-jmx --kafka-sample -o kafka_plan.jmx # Event-driven message broker
|
|
221
|
+
agent-qa generate-jmx --jdbc-sample -o jdbc_plan.jmx # Direct Database SQL pool
|
|
222
|
+
|
|
223
|
+
# 3. Live APM Telemetry & PerfMon Hardware Agent
|
|
224
|
+
agent-qa generate-jmx --spec swagger.json -o perf_plan.jmx \
|
|
225
|
+
--influxdb-url http://influxdb:8086/write?db=jmeter \
|
|
226
|
+
--perfmon-server 192.168.1.50:4444
|
|
227
|
+
|
|
228
|
+
# 4. Distributed Cluster Execution (Master + 3 Slaves)
|
|
229
|
+
docker-compose -f tools/templates/jmeter-distributed/docker-compose.yml up -d
|
|
230
|
+
jmeter -n -t perf_plan.jmx -R slave1,slave2,slave3 -l results.jtl
|
|
231
|
+
|
|
232
|
+
# 5. CI/CD SLA Quality Gate Enforcement (Exit code 0 on Pass, 1 on Breach)
|
|
233
|
+
agent-qa analyze-jtl results.jtl --sla-p95 500 --max-error-rate 1.0 \
|
|
234
|
+
--markdown pr_perf_report.md --json metrics.json
|
|
235
|
+
|
|
236
|
+
# 6. Full-Stack APM & Server Infrastructure RCA Correlator
|
|
237
|
+
agent-qa correlate-telemetry --jtl results.jtl --server-metrics server_metrics.csv \
|
|
238
|
+
--markdown rca_report.md
|
|
218
239
|
```
|
|
219
240
|
|
|
220
241
|
---
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: bats-testing-patterns
|
|
3
|
-
description:
|
|
3
|
+
description: "Test bash/sh scripts, CLI tools, and CI/CD pipelines with Bats."
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# Bats Testing Patterns (Bash Automated Testing System)
|
|
@@ -1,9 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: clean-pom-crafter
|
|
3
|
-
description:
|
|
4
|
-
Standardized Clean Page Object Model (POM) development and Flat Architecture enforcement across enterprise automation test suites.
|
|
5
|
-
Ensures 100% UTF-8 No BOM, zero hardcoded XPaths in scripts, dynamic test data generation via uniqueCode,
|
|
6
|
-
and standardized two-phase search, edit, calendar, multiselect, and deletion behaviors.
|
|
3
|
+
description: "Build and refactor Clean POM Page Classes adhering to Flat Architecture standards."
|
|
7
4
|
---
|
|
8
5
|
|
|
9
6
|
# Clean POM Crafter โ Enterprise Clean POM Architecture Standards
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: code-refactoring-refactor-clean
|
|
3
|
-
description: "
|
|
3
|
+
description: "Eliminate technical debt and refactor code using SOLID and Clean Code patterns."
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# Refactor, Clean Code & Technical Debt Remediation
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: db-state-verifier-and-seeder
|
|
3
|
-
description:
|
|
3
|
+
description: "Seed isolated test fixtures and assert database mutations across SQL and NoSQL."
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# Database State Verifier & Seeder Skill
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: e2e-testing-patterns
|
|
3
|
-
description:
|
|
3
|
+
description: "Design robust multi-browser E2E test architectures, parallel sharding, and retry governance."
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# E2E Testing Architectural Patterns
|
|
@@ -1,8 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: failure-autopsy-and-healing
|
|
3
|
-
description:
|
|
4
|
-
Automated failure triage, visual error autopsy from Screenshots/FAILED_*.png and Allure reports,
|
|
5
|
-
cross-platform JUnit XML parsing, and in-place Page Class code healing across automated test suites.
|
|
3
|
+
description: "Triage test failures from JUnit XML/screenshots and heal broken Page Class locators."
|
|
6
4
|
---
|
|
7
5
|
|
|
8
6
|
# Failure Autopsy & Auto-Healing (Diagnostic & Self-Healing Engine)
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: file-and-report-validator
|
|
3
|
-
description: Validate
|
|
3
|
+
description: "Validate downloaded and uploaded files (Excel, CSV, PDF) schemas and tabular integrity."
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# File & Report Validator Skill
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: flaky-test-sentinel-and-quarantine
|
|
3
|
-
description:
|
|
3
|
+
description: "Detect non-deterministic flaky tests, calculate flakiness scores, and manage quarantine."
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# Flaky Test Sentinel & Quarantine Protocol
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: github-actions-templates
|
|
3
|
-
description: Create production-ready GitHub Actions workflows for automated
|
|
3
|
+
description: "Create production-ready GitHub Actions workflows for automated test suites and CI/CD."
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# GitHub Actions Templates
|
|
@@ -1,8 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: graphify-impact-analyzer
|
|
3
|
-
description:
|
|
4
|
-
AST Knowledge Graph exploration, Architecture Navigation, and Zero-Waste Test Impact Analysis
|
|
5
|
-
across multi-module test cases using Graphify and tools/test_impact.py.
|
|
3
|
+
description: "Analyze code change blast radius and scope impacted test cases via AST."
|
|
6
4
|
---
|
|
7
5
|
|
|
8
6
|
# Graphify Impact Analyzer โ AST Knowledge Graph Navigation & Zero-Waste Impact Analysis
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: katalon-cli-runner
|
|
3
|
-
description:
|
|
3
|
+
description: "Execute headless Katalon and Gradle test runners with automatic driver cleanup."
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# Katalon CLI & Enterprise Runner โ Dual-Mode Execution Management
|
|
@@ -1,7 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: lam-script-generator
|
|
3
|
-
description:
|
|
4
|
-
Large Action Model (LAM) script generator inspired by LaVague. Transforms natural language user stories and acceptance criteria into 100% Clean POM automation scripts with zero token replayability.
|
|
3
|
+
description: "Transform user stories and acceptance criteria into Clean POM automation scripts."
|
|
5
4
|
---
|
|
6
5
|
|
|
7
6
|
# LAM Script Generator โ Large Action Model for Test Automation
|
|
@@ -1,9 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: playwright-live-interaction
|
|
3
|
-
description:
|
|
4
|
-
Fast live web interaction and interactive debugging via Playwright MCP.
|
|
5
|
-
Use for rapid feedback, testing selectors, verifying Angular/PrimeNG components,
|
|
6
|
-
and executing test actions across enterprise web test suites without restarting Katalon/Selenium.
|
|
3
|
+
description: "Probe live web DOM/AOM and verify selectors under 200ms using headless Playwright."
|
|
7
4
|
---
|
|
8
5
|
|
|
9
6
|
# Playwright Live Interaction & Fast Debugging Handbook (Enterprise Web & Clean POM)
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: security-dast-sentinel
|
|
3
|
-
description:
|
|
3
|
+
description: "Run dynamic security audits: OWASP Top 10, security headers, IDOR, and token leakage."
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# Security DAST Sentinel (Dynamic Application Security & OWASP Top 10)
|
|
@@ -1,7 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: self-healing-locator
|
|
3
|
-
description:
|
|
4
|
-
Token-efficient self-healing locator skill using Accessibility Tree (AOM) and semantic DOM diffing with Role > Label > TestId hierarchy, avoiding raw HTML bloat.
|
|
3
|
+
description: "Heal broken locators using semantic AOM diffing with Role, Label, and TestId hierarchy."
|
|
5
4
|
---
|
|
6
5
|
|
|
7
6
|
# Self-Healing Locator Skill รขโฌโ Token-Efficient AOM Diffing
|
|
@@ -0,0 +1,115 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: skillspector-security-guard
|
|
3
|
+
description: "Audit and verify AI agent skills, prompts, and MCP configurations against 71 vulnerability vectors inspired by NVIDIA SkillSpector."
|
|
4
|
+
---
|
|
5
|
+
|
|
6
|
+
# SkillSpector Security Guard โ AI Agent & MCP Security Sentinel
|
|
7
|
+
|
|
8
|
+
> **Purpose:** Autonomous security auditing, vulnerability vetting, and supply-chain inspection for AI Agent skills, prompt instruction files, Model Context Protocol (MCP) server configurations, and automation scripts.
|
|
9
|
+
> **Upstream Heritage:** Synthesized and adapted from **[NVIDIA/SkillSpector](https://github.com/NVIDIA/SkillSpector)** (Apache 2.0).
|
|
10
|
+
|
|
11
|
+
---
|
|
12
|
+
|
|
13
|
+
## 1. The Threat Model for AI Agent Skills
|
|
14
|
+
|
|
15
|
+
AI agent skills execute with user-level permissions, terminal shell execution rights, and implicit trust. Unvetted third-party skills, instructions, or MCP configs can introduce severe vulnerabilities:
|
|
16
|
+
- **Prompt Injection:** Overriding core system safety rules, steering model logic covertly, or forcing jailbreaks.
|
|
17
|
+
- **Data Exfiltration:** Covertly shipping conversation memory, user secrets, or environment keys to external URLs.
|
|
18
|
+
- **Privilege Escalation:** Running root/sudo commands, mounting `/var/run/docker.sock`, or stealing SSH/AWS keys.
|
|
19
|
+
- **Agent Snooping:** Reading configuration stores (`~/.claude`, `~/.gemini`, `~/.codex`) or parsing `mcp.json` to steal tokens.
|
|
20
|
+
- **MCP Tool Poisoning:** Injecting hidden instructions in tool metadata (HTML comments, Unicode homoglyphs, Base64).
|
|
21
|
+
|
|
22
|
+
```mermaid
|
|
23
|
+
flowchart TD
|
|
24
|
+
CandidateSkill["Candidate Skill / MCP Config / Prompt"] --> Scanner["<b>SkillSpector Sentinel</b><br/>(tools/skillspector.py)"]
|
|
25
|
+
|
|
26
|
+
subgraph Vectors["71 Detection Vectors across 17 Categories"]
|
|
27
|
+
V1["Prompt Injection & Jailbreaks (P1-P4, P9)"]
|
|
28
|
+
V2["Data Exfiltration & Sinks (E1-E5)"]
|
|
29
|
+
V3["Privilege Escalation (PE1-PE5)"]
|
|
30
|
+
V4["Agent Snooping (~/.claude, mcp.json) (AS1-AS3)"]
|
|
31
|
+
V5["Tool Poisoning & Homoglyphs (TP1-TP4)"]
|
|
32
|
+
V6["Behavioral AST & Deserialization (AST1-AST10)"]
|
|
33
|
+
end
|
|
34
|
+
|
|
35
|
+
Scanner --> Vectors
|
|
36
|
+
Vectors --> ProhibitionGuard["<b>Prohibition Context Guard</b><br/>(Filters defensive documentation & negations)"]
|
|
37
|
+
ProhibitionGuard --> Score["Risk Scoring Engine (0 - 100)"]
|
|
38
|
+
Score --> Verdict{"Verdict Assessment"}
|
|
39
|
+
|
|
40
|
+
Verdict -- "Score < 25" --> Pass["โ
SAFE: Permitted to Install"]
|
|
41
|
+
Verdict -- "25 <= Score < 60" --> Warn["โ ๏ธ CAUTION: Manual Review Required"]
|
|
42
|
+
Verdict -- "Score >= 60 or CRITICAL" --> Block["๐ DO_NOT_INSTALL: Blocked & Quarantined"]
|
|
43
|
+
```
|
|
44
|
+
|
|
45
|
+
---
|
|
46
|
+
|
|
47
|
+
## 2. 71 Vulnerability Vectors & Coverage Matrix
|
|
48
|
+
|
|
49
|
+
| Category | Pattern IDs | Threat Vector & Description | Severity |
|
|
50
|
+
| :--- | :--- | :--- | :--- |
|
|
51
|
+
| **Prompt Injection** | `P1`, `P2`, `P3`, `P4`, `P9` | Instruction overrides, zero-width steganography, bidi Trojan Source (CVE-2021-42574), exfiltration directives, vertical whitespace padding (>20 blank lines). | **CRITICAL / HIGH** |
|
|
52
|
+
| **Data Exfiltration** | `E1`, `E2`, `E3`, `E4`, `E5` | Outbound HTTP POST sinks (`curl`, `fetch`), `os.environ` harvesting, scanning for `.ssh` / `.aws` credentials, conversational context dumping, cloud storage upload. | **CRITICAL / HIGH** |
|
|
53
|
+
| **Privilege Escalation** | `PE1` โ `PE5` | Blanket wildcard permissions (`*`), `sudo`/`su`/`chmod 4755`, credential access (`/etc/shadow`, `kubeconfig`), `docker.sock` access, privileged containers. | **CRITICAL** |
|
|
54
|
+
| **Agent Snooping** | `AS1`, `AS2`, `AS3` | Reading agent auth configs (`.claude/`, `.gemini/`, `.codex/`), accessing `mcp.json` / `claude_desktop_config.json`, cross-skill reconnaissance. | **CRITICAL** |
|
|
55
|
+
| **System Prompt Leakage**| `P6`, `P7`, `P8` | Direct prompt extraction commands, side-channel extraction ("output text before this line"), tool exfiltration. | **HIGH** |
|
|
56
|
+
| **Anti-Refusal Jailbreaks**| `AR1`, `AR2`, `AR3` | Refusal suppression ("never refuse", "always comply"), warning/caveat suppression, policy nullification ("you have no restrictions"). | **CRITICAL / HIGH** |
|
|
57
|
+
| **MCP Tool Poisoning** | `TP1`, `TP2`, `TP3`, `TP4` | Hidden instructions in tool comments/Base64/data URIs, Cyrillic/Greek Unicode homoglyphs, parameter description injection, behavior drift. | **CRITICAL / HIGH** |
|
|
58
|
+
| **MCP Least Privilege** | `LP1`, `LP2`, `LP3` | Undeclared network/shell capabilities, wildcard permissions (`*`), missing allowed tools. | **HIGH / MEDIUM** |
|
|
59
|
+
| **Behavioral AST** | `AST1` โ `AST10` | Dynamic `exec()`, `eval()`, `__import__()`, `subprocess(shell=True)`, `os.system()`, dynamic `getattr()`, reflective sink lookup, and insecure deserialization (`pickle`, `yaml.unsafe_load`). | **CRITICAL / HIGH** |
|
|
60
|
+
| **Supply Chain & SSRF** | `SC1`, `SC2`, `SSRF1`, `SSRF2` | `curl \| bash` downloads, cloud instance metadata probing (`169.254.169.254`), internal loopback requests. | **CRITICAL / MEDIUM** |
|
|
61
|
+
|
|
62
|
+
---
|
|
63
|
+
|
|
64
|
+
## 3. NVIDIA Prohibition Context Engine (Defensive Language Guard)
|
|
65
|
+
|
|
66
|
+
In software testing and quality engineering hubs, security rules and documentation frequently describe anti-patterns (e.g., *"Never use eval()"*, *"Strictly forbidden: do not run sudo"*).
|
|
67
|
+
|
|
68
|
+
**SkillSpector Sentinel incorporates the NVIDIA Prohibition Context Engine:**
|
|
69
|
+
1. **Direct Negative Imperatives:** Matches governed by preceding negations (`never`, `do not`, `don't`, `must not`, `strictly forbidden`, `avoid`) are exempted.
|
|
70
|
+
2. **Defensive Callouts:** Patterns appearing inside `> [!CAUTION]`, `> [!WARNING]`, or `> [!IMPORTANT]` documentation blocks do not trigger false alerts.
|
|
71
|
+
3. **Emoji ZWJ Preservation:** Legitimate Zero-Width Joiner emoji sequences (e.g. `๐จโ๐ฉโ๐งโ๐ฆ`, `๐ณ๏ธโ๐`) are preserved, while standalone steganographic zero-width bytes are flagged.
|
|
72
|
+
4. **Request-Anchored SSRF:** Localhost references in documentation or comments are ignored; only active request-issuing functions (`fetch('http://localhost...')`, `curl`) trigger SSRF checks.
|
|
73
|
+
|
|
74
|
+
---
|
|
75
|
+
|
|
76
|
+
## 4. Operational Runbook & CLI Usage
|
|
77
|
+
|
|
78
|
+
### 1. Autonomous Pre-Install Audit
|
|
79
|
+
Before loading or installing any new skill, rule, or MCP tool into the environment, run:
|
|
80
|
+
```bash
|
|
81
|
+
# Scan a single skill file or directory
|
|
82
|
+
python3 tools/skillspector.py path/to/skill/
|
|
83
|
+
|
|
84
|
+
# Or using the agent-qa unified CLI:
|
|
85
|
+
agent-qa skillspector path/to/skill/
|
|
86
|
+
|
|
87
|
+
# Or via npx (zero-install):
|
|
88
|
+
npx synapse-hub skillspector path/to/skill/
|
|
89
|
+
```
|
|
90
|
+
|
|
91
|
+
### 2. Multi-Format Reporting for CI/CD
|
|
92
|
+
```bash
|
|
93
|
+
# Generate GitHub Actions SARIF format (Security Tab integration)
|
|
94
|
+
python3 tools/skillspector.py .agents/skills/ --format sarif --output reports/skillspector.sarif
|
|
95
|
+
|
|
96
|
+
# Generate JSON for automated policy gating
|
|
97
|
+
python3 tools/skillspector.py .agents/skills/ --format json --output reports/skillspector.json
|
|
98
|
+
|
|
99
|
+
# Strict gating: Exit with error code 1 if any CRITICAL or DO_NOT_INSTALL findings exist
|
|
100
|
+
python3 tools/skillspector.py .agents/skills/ --strict
|
|
101
|
+
```
|
|
102
|
+
|
|
103
|
+
### 3. Verdict Interpretation & Action Table
|
|
104
|
+
|
|
105
|
+
| Risk Score | Verdict | Permitted Action | Mandatory Remediation |
|
|
106
|
+
| :---: | :---: | :---: | :--- |
|
|
107
|
+
| **0 โ 24** | **`SAFE`** | โ
Install & execute freely. | No remediation required; skill is verified clean. |
|
|
108
|
+
| **25 โ 59** | **`CAUTION`** | โ ๏ธ Hold for manual inspection. | Inspect flagged lines; replace unpinned dependencies or wildcards. |
|
|
109
|
+
| **60 โ 100** | **`DO_NOT_INSTALL`** | ๐ Blocked immediately. | Quarantined. Contains active prompt injection, RCE sink, or credential theft. |
|
|
110
|
+
|
|
111
|
+
---
|
|
112
|
+
|
|
113
|
+
## 5. Acknowledgments & Upstream Attribution
|
|
114
|
+
|
|
115
|
+
This skill and its underlying inspection engine (`tools/skillspector.py`) are directly based on the research, pattern definitions, and defensive grammar created by the **NVIDIA AI Security Team** in **[NVIDIA/SkillSpector](https://github.com/NVIDIA/SkillSpector)** (Apache License 2.0).
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: synthetic-test-data-generator
|
|
3
|
-
description: Generate
|
|
3
|
+
description: "Generate idempotent, boundary-value synthetic test data with unique runtime timestamps."
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# Synthetic Test Data Generator & Edge-Case Fuzzing Skill
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: token-and-context-optimizer
|
|
3
|
-
description:
|
|
3
|
+
description: "Optimize prompt context, distill verbose logs, and prevent context rot in Antigravity."
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# Token & Context Optimizer โ Antigravity Engineering Standard
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: visual-regression-sentinel
|
|
3
|
-
description:
|
|
3
|
+
description: "Run pixel and layout shift visual regression checks with anti-flake masking."
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# Visual Regression Sentinel Skill
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: wcag-audit-patterns
|
|
3
|
-
description:
|
|
3
|
+
description: "Audit WCAG 2.2 accessibility (A/AA), keyboard navigation, and ARIA roles."
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# WCAG 2.2 Accessibility Audit Patterns
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: web-vitals-and-performance-profiler
|
|
3
|
-
description:
|
|
3
|
+
description: "Measure Core Web Vitals (LCP, CLS, INP) and network waterfalls via CDP."
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# Web Vitals & Performance Profiler Skill
|
package/AGENTS.md
CHANGED
|
@@ -91,6 +91,42 @@ This repository defines specialized multi-agent profiles (configured in `.agents
|
|
|
91
91
|
6. **Quality Gatekeeper & Sentinel (`quality-gatekeeper`):**
|
|
92
92
|
- Enforces 8 Quality Gates (`verify_all.py`), scans fake passes (`infer_linter.py`), injects AST micro-mutants (`micro_mutator.py` requiring >= 80% mutation score), audits visual regression masks (`smart_visual_masker.py`), and checks DB leaks (`trace_data_flow.py`).
|
|
93
93
|
|
|
94
|
+
### 4.1 SINGLE FRONT-DOOR PROTOCOL & DETERMINISTIC FSM WORKFLOW
|
|
95
|
+
|
|
96
|
+
> **Decision Paralysis Prevention Invariant:**
|
|
97
|
+
> All incoming tasks enter exclusively through the **Single Front-Door (`orchestrator`)**.
|
|
98
|
+
> Subagents operate in a strictly sequential 5-Stage Finite State Machine (FSM). Out-of-order execution or ambiguous dispatch is prohibited.
|
|
99
|
+
|
|
100
|
+
```mermaid
|
|
101
|
+
flowchart TD
|
|
102
|
+
User([User / System Task]) --> Orchestrator["<b>Lead QA Orchestrator</b><br/><i>Single Front-Door Entrypoint</i>"]
|
|
103
|
+
|
|
104
|
+
subgraph FSM["5-Stage Gatekeeper Execution Pipeline (FSM)"]
|
|
105
|
+
Stage1["<b>Stage 1: Discovery</b><br/>โข Subagent: live-explorer<br/>โข Probe DOM/AOM under 200ms<br/>โข Emit Data Contract JSON"]
|
|
106
|
+
Stage2["<b>Stage 2: Code Synthesis</b><br/>โข Subagent: pom-crafter<br/>โข Clean POM + Flat Architecture<br/>โข Zero XPaths in scripts"]
|
|
107
|
+
Stage3["<b>Stage 3: Headless Execution</b><br/>โข Subagent: test-runner<br/>โข Run headless CLI + distill logs<br/>โข Output Pass/Fail status"]
|
|
108
|
+
Stage4["<b>Stage 4: Failure Autopsy & Healing</b><br/>โข Subagent: failure-analyst<br/>โข Activated ONLY if Stage 3 Fails<br/>โข In-place healing via JUnit XML/Screenshot"]
|
|
109
|
+
Stage5["<b>Stage 5: Final Acceptance (DoD)</b><br/>โข Subagent: quality-gatekeeper<br/>โข 8 Quality Gates + Mutation Score >= 80%<br/>โข Task Done"]
|
|
110
|
+
|
|
111
|
+
Stage1 --> Stage2 --> Stage3
|
|
112
|
+
Stage3 -->|Pass| Stage5
|
|
113
|
+
Stage3 -->|Fail| Stage4
|
|
114
|
+
Stage4 -->|Healed| Stage3
|
|
115
|
+
end
|
|
116
|
+
|
|
117
|
+
Orchestrator --> Stage1
|
|
118
|
+
```
|
|
119
|
+
|
|
120
|
+
#### Deterministic Intent-to-Tool Matrix (Zero-Ambiguity Dispatch)
|
|
121
|
+
|
|
122
|
+
| Specific User / System Intent | Designated Subagent | Situational Tool |
|
|
123
|
+
| :--- | :--- | :--- |
|
|
124
|
+
| **Inspect live DOM / probe selectors** | `live-explorer` | `tools/browser_helpers.js`, `tools/safety_firewall.py` |
|
|
125
|
+
| **Author Page Classes or test scripts** | `pom-crafter` | `tools/repo_map.py`, `tools/universal_ir.py` |
|
|
126
|
+
| **Execute headless suites / CI runs** | `test-runner` | `tools/distill_log.py`, `tools/matrix_sharder.py` |
|
|
127
|
+
| **Triage failed test runs / RCA** | `failure-analyst` | `tools/pinpoint_failure.py`, `tools/auto_heal.py` |
|
|
128
|
+
| **Enforce Quality Gates before commit** | `quality-gatekeeper` | `tools/verify_all.py`, `tools/micro_mutator.py` |
|
|
129
|
+
|
|
94
130
|
---
|
|
95
131
|
|
|
96
132
|
## 5. CENTRALIZED TOOLS RUNBOOK
|