gabbe-kit 1.0.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/LICENSE +25 -0
- package/LICENSE-CODE +202 -0
- package/README.md +817 -0
- package/agents/AGENTS.md +542 -0
- package/agents/CONSTITUTION.md +188 -0
- package/agents/guides/00-index.md +142 -0
- package/agents/guides/ai/a2ui-protocols.md +71 -0
- package/agents/guides/ai/actor-agent-frameworks.md +82 -0
- package/agents/guides/ai/agent-communication.md +146 -0
- package/agents/guides/ai/agent-identity-trust.md +69 -0
- package/agents/guides/ai/agent-only-cognition.md +73 -0
- package/agents/guides/ai/agent-only-swarms.md +70 -0
- package/agents/guides/ai/agent-operating-ergonomics.md +52 -0
- package/agents/guides/ai/agent-ui.md +106 -0
- package/agents/guides/ai/ai-agentic.md +309 -0
- package/agents/guides/ai/beyond-llms.md +60 -0
- package/agents/guides/ai/dynamic-capability-loading.md +121 -0
- package/agents/guides/ai/gabbe-innovations.md +111 -0
- package/agents/guides/ai/model-customization-decisions.md +78 -0
- package/agents/guides/ai/multi-agent-systems.md +85 -0
- package/agents/guides/ai/self-evolving-skills.md +137 -0
- package/agents/guides/ai/self-healing-summary.md +21 -0
- package/agents/guides/ai/visual-mcp-integration.md +106 -0
- package/agents/guides/architecture/api-standards.md +61 -0
- package/agents/guides/architecture/blockchain-dlt.md +36 -0
- package/agents/guides/architecture/critical-systems-arch.md +66 -0
- package/agents/guides/architecture/event-driven-architecture.md +39 -0
- package/agents/guides/architecture/microservices.md +292 -0
- package/agents/guides/architecture/monolith.md +303 -0
- package/agents/guides/architecture/orchestration.md +75 -0
- package/agents/guides/architecture/system-qualities.md +51 -0
- package/agents/guides/architecture/system-scalability.md +47 -0
- package/agents/guides/architecture/systems-architecture.md +506 -0
- package/agents/guides/data/semantic-web.md +23 -0
- package/agents/guides/data/sql-nosql.md +305 -0
- package/agents/guides/industry/engineering-standards.md +36 -0
- package/agents/guides/industry/global-standards.md +24 -0
- package/agents/guides/industry/healthcare-fhir.md +33 -0
- package/agents/guides/industry/industrial-iot.md +33 -0
- package/agents/guides/industry/telecom-networks.md +34 -0
- package/agents/guides/languages/c-sharp.md +66 -0
- package/agents/guides/languages/go-lang.md +251 -0
- package/agents/guides/languages/java.md +73 -0
- package/agents/guides/languages/js-ts-nodejs.md +361 -0
- package/agents/guides/languages/nodejs-advanced.md +56 -0
- package/agents/guides/languages/php-laravel.md +376 -0
- package/agents/guides/languages/python-fastapi-ai.md +257 -0
- package/agents/guides/languages/rust.md +73 -0
- package/agents/guides/ops/compliance-audit.md +177 -0
- package/agents/guides/ops/cost-optimization.md +57 -0
- package/agents/guides/ops/dev-environments.md +67 -0
- package/agents/guides/ops/dev-workflow.md +44 -0
- package/agents/guides/ops/gabbe-cli-workflows.md +252 -0
- package/agents/guides/ops/production-health.md +62 -0
- package/agents/guides/ops/troubleshooting-guide.md +69 -0
- package/agents/guides/patterns/agentic-design-patterns.md +308 -0
- package/agents/guides/patterns/agentic-patterns.md +43 -0
- package/agents/guides/patterns/ai-native-scenarios.md +71 -0
- package/agents/guides/patterns/autonomous-swarm-patterns.md +42 -0
- package/agents/guides/patterns/design-patterns.md +68 -0
- package/agents/guides/patterns/enterprise-migration-scenario.md +58 -0
- package/agents/guides/patterns/enterprise-patterns.md +56 -0
- package/agents/guides/patterns/software-design-patterns.md +106 -0
- package/agents/guides/patterns/time-complexity-analysis.md +116 -0
- package/agents/guides/planning/product-requirements.md +407 -0
- package/agents/guides/planning/strategic-analysis.md +98 -0
- package/agents/guides/planning/visual-product-specs.md +162 -0
- package/agents/guides/principles/clean-code-standards.md +51 -0
- package/agents/guides/principles/computing-foundations.md +87 -0
- package/agents/guides/principles/diagramming-standards.md +568 -0
- package/agents/guides/principles/evaluation-strategy.md +103 -0
- package/agents/guides/principles/future-tech.md +35 -0
- package/agents/guides/principles/human-agent-collaboration.md +54 -0
- package/agents/guides/principles/legacy-tech.md +61 -0
- package/agents/guides/principles/mathematical-foundations.md +103 -0
- package/agents/guides/principles/modeling-methods.md +97 -0
- package/agents/guides/principles/no-code-integration.md +84 -0
- package/agents/guides/principles/testing-strategy.md +97 -0
- package/agents/guides/principles/visual-design-system.md +44 -0
- package/agents/guides/processes/RARV_CYCLE.md +262 -0
- package/agents/guides/processes/extension-protocol.md +183 -0
- package/agents/guides/processes/full-system-lifecycle.md +47 -0
- package/agents/guides/processes/knowledge-integration.md +82 -0
- package/agents/guides/processes/loki-sdlc-phases.md +446 -0
- package/agents/guides/product/green-software.md +38 -0
- package/agents/guides/product/sustainability-checks.md +29 -0
- package/agents/guides/security/ai-risk-standards-map.md +98 -0
- package/agents/guides/security/api-security.md +51 -0
- package/agents/guides/security/cryptography-standards.md +38 -0
- package/agents/guides/security/privacy-data-protection.md +41 -0
- package/agents/guides/security/secure-architecture.md +43 -0
- package/agents/guides/security/threat-modeling.md +46 -0
- package/agents/memory/AUDIT_LOG.md +48 -0
- package/agents/memory/CONTINUITY.md +49 -0
- package/agents/memory/PROJECT_STATE.md +134 -0
- package/agents/memory/RESUME_POINTER.md +15 -0
- package/agents/memory/episodic/DECISION_LOG_TEMPLATE.md +104 -0
- package/agents/memory/semantic/PROJECT_KNOWLEDGE_TEMPLATE.md +194 -0
- package/agents/memory/semantic/VECTOR_DB_CONFIG_TEMPLATE.json +46 -0
- package/agents/personas/00-index.md +148 -0
- package/agents/personas/biz-compliance.md +112 -0
- package/agents/personas/biz-legal.md +131 -0
- package/agents/personas/eng-api.md +110 -0
- package/agents/personas/eng-backend.md +113 -0
- package/agents/personas/eng-data.md +50 -0
- package/agents/personas/eng-database.md +95 -0
- package/agents/personas/eng-frontend.md +75 -0
- package/agents/personas/eng-infra.md +105 -0
- package/agents/personas/eng-messaging.md +50 -0
- package/agents/personas/eng-ml.md +50 -0
- package/agents/personas/eng-mobile.md +75 -0
- package/agents/personas/eng-perf.md +90 -0
- package/agents/personas/eng-qa.md +125 -0
- package/agents/personas/eng-tooling.md +49 -0
- package/agents/personas/ops-compliance.md +109 -0
- package/agents/personas/ops-cost.md +92 -0
- package/agents/personas/ops-devops.md +85 -0
- package/agents/personas/ops-incident.md +123 -0
- package/agents/personas/ops-monitor.md +89 -0
- package/agents/personas/ops-release.md +91 -0
- package/agents/personas/ops-security.md +104 -0
- package/agents/personas/ops-sre.md +85 -0
- package/agents/personas/orch-coordinator.md +140 -0
- package/agents/personas/orch-judge.md +135 -0
- package/agents/personas/orch-planner.md +114 -0
- package/agents/personas/orch-researcher.md +165 -0
- package/agents/personas/prod-architect.md +110 -0
- package/agents/personas/prod-design.md +112 -0
- package/agents/personas/prod-ethicist.md +50 -0
- package/agents/personas/prod-integration.md +120 -0
- package/agents/personas/prod-pm.md +115 -0
- package/agents/personas/prod-product-ops.md +128 -0
- package/agents/personas/prod-research.md +49 -0
- package/agents/personas/prod-safety-engineer.md +28 -0
- package/agents/personas/prod-tech-lead.md +119 -0
- package/agents/personas/ui-design.md +81 -0
- package/agents/scripts/check_skills_docs.py +120 -0
- package/agents/scripts/compile_skills.py +284 -0
- package/agents/scripts/comprehensive_checker.py +187 -0
- package/agents/scripts/dump-context.sh +37 -0
- package/agents/scripts/eval_skills.py +268 -0
- package/agents/scripts/preflight_summary.sh +80 -0
- package/agents/scripts/report_duplicates.py +125 -0
- package/agents/scripts/setup-context.ps1 +250 -0
- package/agents/scripts/setup-context.sh +398 -0
- package/agents/scripts/state_export.sh +84 -0
- package/agents/scripts/state_import.sh +99 -0
- package/agents/scripts/validate_integrity.py +98 -0
- package/agents/scripts/validate_links.py +96 -0
- package/agents/scripts/validate_methodology_graph.py +194 -0
- package/agents/scripts/validate_skills.py +81 -0
- package/agents/scripts/verify_e2e_init_flows.py +246 -0
- package/agents/scripts/verify_setup_simulation.py +104 -0
- package/agents/scripts/verify_triggers_and_mcps.py +159 -0
- package/agents/scripts/verify_use_cases.py +498 -0
- package/agents/skills/00-index.md +322 -0
- package/agents/skills/ai/a2ui-protocols.skill.md +31 -0
- package/agents/skills/ai/actor-agent-frameworks.skill.md +31 -0
- package/agents/skills/ai/agent-communication.skill.md +36 -0
- package/agents/skills/ai/agent-ui.skill.md +31 -0
- package/agents/skills/ai/autonomous-swarm-patterns.skill.md +31 -0
- package/agents/skills/ai/beyond-llms.skill.md +31 -0
- package/agents/skills/ai/context-engineering.skill.md +79 -0
- package/agents/skills/ai/llm-as-judge.skill.md +97 -0
- package/agents/skills/ai/multi-agent-systems.skill.md +31 -0
- package/agents/skills/ai/rag-evaluation.skill.md +93 -0
- package/agents/skills/ai/reasoning-patterns.skill.md +125 -0
- package/agents/skills/architecture/adaptive-architecture.skill.md +51 -0
- package/agents/skills/architecture/api-design.skill.md +92 -0
- package/agents/skills/architecture/api-standards.skill.md +31 -0
- package/agents/skills/architecture/arch-debt.skill.md +180 -0
- package/agents/skills/architecture/arch-design.skill.md +304 -0
- package/agents/skills/architecture/arch-patterns.skill.md +52 -0
- package/agents/skills/architecture/arch-review.skill.md +326 -0
- package/agents/skills/architecture/architecture-governance.skill.md +62 -0
- package/agents/skills/architecture/attribute-driven-design.skill.md +108 -0
- package/agents/skills/architecture/blockchain-dlt.skill.md +28 -0
- package/agents/skills/architecture/compatibility-design.skill.md +51 -0
- package/agents/skills/architecture/critical-systems-arch.skill.md +31 -0
- package/agents/skills/architecture/design-patterns.skill.md +59 -0
- package/agents/skills/architecture/diagramming.skill.md +380 -0
- package/agents/skills/architecture/domain-model.skill.md +294 -0
- package/agents/skills/architecture/enterprise-migration-scenario.skill.md +31 -0
- package/agents/skills/architecture/enterprise-patterns.skill.md +31 -0
- package/agents/skills/architecture/error-handling-strategy.skill.md +58 -0
- package/agents/skills/architecture/event-driven-architecture.skill.md +31 -0
- package/agents/skills/architecture/event-governance.skill.md +55 -0
- package/agents/skills/architecture/fitness-functions.skill.md +111 -0
- package/agents/skills/architecture/graphql-schema.skill.md +64 -0
- package/agents/skills/architecture/legacy-modernization.skill.md +51 -0
- package/agents/skills/architecture/microservices.skill.md +31 -0
- package/agents/skills/architecture/middleware-design.skill.md +59 -0
- package/agents/skills/architecture/monolith.skill.md +31 -0
- package/agents/skills/architecture/realtime-comm.skill.md +52 -0
- package/agents/skills/architecture/state-management.skill.md +72 -0
- package/agents/skills/architecture/system-qualities.skill.md +31 -0
- package/agents/skills/architecture/system-scalability.skill.md +31 -0
- package/agents/skills/architecture/systems-architecture.skill.md +31 -0
- package/agents/skills/architecture/visual-whiteboarding.skill.md +33 -0
- package/agents/skills/brain/README.md +70 -0
- package/agents/skills/brain/active-inference.skill.md +74 -0
- package/agents/skills/brain/brain-mode.skill.md +125 -0
- package/agents/skills/brain/cognitive-architectures.skill.md +53 -0
- package/agents/skills/brain/cognitive-testing.skill.md +62 -0
- package/agents/skills/brain/consciousness-loop.skill.md +68 -0
- package/agents/skills/brain/cost-benefit-router.skill.md +89 -0
- package/agents/skills/brain/episodic-consolidation.skill.md +43 -0
- package/agents/skills/brain/epistemology-knowledge.skill.md +54 -0
- package/agents/skills/brain/global-workspace.skill.md +77 -0
- package/agents/skills/brain/learning-adaptation.skill.md +68 -0
- package/agents/skills/brain/loki-mode.skill.md +267 -0
- package/agents/skills/brain/neuroscience-foundations.skill.md +52 -0
- package/agents/skills/brain/scripts/active_inference_loop.py +92 -0
- package/agents/skills/brain/scripts/cognition_test.py +80 -0
- package/agents/skills/brain/scripts/global_workspace.py +104 -0
- package/agents/skills/brain/self-improvement.skill.md +80 -0
- package/agents/skills/brain/sensory-motor.skill.md +61 -0
- package/agents/skills/brain/sequential-thinking.skill.md +48 -0
- package/agents/skills/brain/working-memory.skill.md +47 -0
- package/agents/skills/coding/agent-trajectory-eval.skill.md +92 -0
- package/agents/skills/coding/artisan-commands.skill.md +52 -0
- package/agents/skills/coding/browser-tdd.skill.md +131 -0
- package/agents/skills/coding/chaos-fault-injection.skill.md +116 -0
- package/agents/skills/coding/ci-autofix.skill.md +53 -0
- package/agents/skills/coding/clean-coder.skill.md +58 -0
- package/agents/skills/coding/code-review.skill.md +100 -0
- package/agents/skills/coding/debug.skill.md +100 -0
- package/agents/skills/coding/documentation.skill.md +149 -0
- package/agents/skills/coding/eval-driven-development.skill.md +107 -0
- package/agents/skills/coding/evals/code-review.eval.yaml +29 -0
- package/agents/skills/coding/excalidraw.skill.md +90 -0
- package/agents/skills/coding/file-processing.skill.md +55 -0
- package/agents/skills/coding/git-workflow.skill.md +153 -0
- package/agents/skills/coding/metamorphic-testing.skill.md +113 -0
- package/agents/skills/coding/mobile-dev.skill.md +41 -0
- package/agents/skills/coding/nodejs-expert.skill.md +23 -0
- package/agents/skills/coding/output-validation.skill.md +57 -0
- package/agents/skills/coding/pbt-strategy.skill.md +117 -0
- package/agents/skills/coding/performant-ai.skill.md +62 -0
- package/agents/skills/coding/performant-go.skill.md +61 -0
- package/agents/skills/coding/performant-laravel.skill.md +70 -0
- package/agents/skills/coding/performant-nodejs.skill.md +67 -0
- package/agents/skills/coding/performant-php.skill.md +53 -0
- package/agents/skills/coding/performant-python.skill.md +62 -0
- package/agents/skills/coding/refactor.skill.md +124 -0
- package/agents/skills/coding/secure-coding.skill.md +57 -0
- package/agents/skills/coding/sketch-to-diagram.skill.md +106 -0
- package/agents/skills/coding/spec-driven-development.skill.md +110 -0
- package/agents/skills/coding/tdd-cycle.skill.md +92 -0
- package/agents/skills/coding/testing-strategy.skill.md +74 -0
- package/agents/skills/coding/time-complexity.skill.md +112 -0
- package/agents/skills/coding/tldraw-canvas.skill.md +109 -0
- package/agents/skills/coding/tool-construction.skill.md +47 -0
- package/agents/skills/coding/ui-gen.skill.md +64 -0
- package/agents/skills/coding/vibe-coding.skill.md +63 -0
- package/agents/skills/coding/visual-design.skill.md +65 -0
- package/agents/skills/coordination/agent-interop.skill.md +72 -0
- package/agents/skills/coordination/agent-protocol.skill.md +62 -0
- package/agents/skills/coordination/agent-workflow-patterns.skill.md +123 -0
- package/agents/skills/coordination/agentic-linter.skill.md +134 -0
- package/agents/skills/coordination/agentic-patterns.skill.md +79 -0
- package/agents/skills/coordination/meta-optimize.skill.md +62 -0
- package/agents/skills/coordination/meta-prompting.skill.md +46 -0
- package/agents/skills/coordination/multi-agent-orch.skill.md +78 -0
- package/agents/skills/coordination/persona-selector.skill.md +78 -0
- package/agents/skills/coordination/self-optimize.skill.md +81 -0
- package/agents/skills/coordination/swarm-consensus.skill.md +52 -0
- package/agents/skills/core/agent-analytics.skill.md +74 -0
- package/agents/skills/core/audit-trail.skill.md +122 -0
- package/agents/skills/core/clarify.skill.md +89 -0
- package/agents/skills/core/emerging-tech.skill.md +52 -0
- package/agents/skills/core/empirical-methods.skill.md +101 -0
- package/agents/skills/core/evals/clarify.eval.yaml +29 -0
- package/agents/skills/core/evals/integrity-check.eval.yaml +23 -0
- package/agents/skills/core/evals/research.eval.yaml +23 -0
- package/agents/skills/core/final-review.skill.md +66 -0
- package/agents/skills/core/integrity-check.skill.md +149 -0
- package/agents/skills/core/knowledge-connect.skill.md +77 -0
- package/agents/skills/core/knowledge-gap.skill.md +123 -0
- package/agents/skills/core/preflight.skill.md +106 -0
- package/agents/skills/core/research.skill.md +107 -0
- package/agents/skills/core/retrospective.skill.md +59 -0
- package/agents/skills/core/sdlc-checkpoint.skill.md +151 -0
- package/agents/skills/core/self-heal.skill.md +163 -0
- package/agents/skills/core/session-resume.skill.md +125 -0
- package/agents/skills/core/skills-registry.skill.md +65 -0
- package/agents/skills/core/state-portability.skill.md +89 -0
- package/agents/skills/core/state-preserve.skill.md +76 -0
- package/agents/skills/core/system-lifecycle.skill.md +51 -0
- package/agents/skills/core/update-scan.skill.md +92 -0
- package/agents/skills/data/data-engineering.skill.md +56 -0
- package/agents/skills/data/data-governance.skill.md +49 -0
- package/agents/skills/data/db-migration.skill.md +136 -0
- package/agents/skills/data/semantic-web.skill.md +28 -0
- package/agents/skills/data/sql-optimization.skill.md +78 -0
- package/agents/skills/industry/engineering-standards.skill.md +31 -0
- package/agents/skills/industry/global-standards.skill.md +30 -0
- package/agents/skills/industry/healthcare-fhir.skill.md +28 -0
- package/agents/skills/industry/industrial-iot.skill.md +30 -0
- package/agents/skills/industry/telecom-networks.skill.md +30 -0
- package/agents/skills/ops/caching-strategy.skill.md +77 -0
- package/agents/skills/ops/capacity-planning.skill.md +67 -0
- package/agents/skills/ops/cloud-deploy.skill.md +55 -0
- package/agents/skills/ops/configuration-management.skill.md +107 -0
- package/agents/skills/ops/cost-optimization.skill.md +39 -0
- package/agents/skills/ops/decommission-sunset.skill.md +64 -0
- package/agents/skills/ops/dependency-lifecycle.skill.md +63 -0
- package/agents/skills/ops/deployment.skill.md +217 -0
- package/agents/skills/ops/dev-environments.skill.md +31 -0
- package/agents/skills/ops/dev-workflow.skill.md +28 -0
- package/agents/skills/ops/docker-dev.skill.md +52 -0
- package/agents/skills/ops/enterprise-integration.skill.md +53 -0
- package/agents/skills/ops/feature-flag-management.skill.md +59 -0
- package/agents/skills/ops/incident-response.skill.md +40 -0
- package/agents/skills/ops/infra-devops.skill.md +53 -0
- package/agents/skills/ops/k8s-dev.skill.md +51 -0
- package/agents/skills/ops/memory-optimization.skill.md +45 -0
- package/agents/skills/ops/observability-stack-setup.skill.md +62 -0
- package/agents/skills/ops/performance-audit.skill.md +178 -0
- package/agents/skills/ops/performance-optimization.skill.md +51 -0
- package/agents/skills/ops/production-health.skill.md +85 -0
- package/agents/skills/ops/production-verifier.skill.md +50 -0
- package/agents/skills/ops/queue-management.skill.md +52 -0
- package/agents/skills/ops/release-management.skill.md +39 -0
- package/agents/skills/ops/release-validation.skill.md +51 -0
- package/agents/skills/ops/reliability-sre.skill.md +51 -0
- package/agents/skills/ops/runbook-authoring.skill.md +64 -0
- package/agents/skills/ops/system-benchmark.skill.md +69 -0
- package/agents/skills/ops/tech-debt.skill.md +143 -0
- package/agents/skills/ops/troubleshooting-guide.skill.md +31 -0
- package/agents/skills/product/accessibility.skill.md +143 -0
- package/agents/skills/product/adr-writer.skill.md +110 -0
- package/agents/skills/product/business-case.skill.md +70 -0
- package/agents/skills/product/change-management.skill.md +90 -0
- package/agents/skills/product/decompose.skill.md +75 -0
- package/agents/skills/product/design-thinking.skill.md +62 -0
- package/agents/skills/product/estimation-sizing.skill.md +87 -0
- package/agents/skills/product/evals/spec-writer.eval.yaml +22 -0
- package/agents/skills/product/financial-governance.skill.md +88 -0
- package/agents/skills/product/green-software.skill.md +46 -0
- package/agents/skills/product/ideation-facilitation.skill.md +87 -0
- package/agents/skills/product/market-analysis.skill.md +56 -0
- package/agents/skills/product/opportunity-assessment.skill.md +89 -0
- package/agents/skills/product/product-analytics.skill.md +92 -0
- package/agents/skills/product/professional-practice.skill.md +105 -0
- package/agents/skills/product/req-elicitation.skill.md +292 -0
- package/agents/skills/product/req-review.skill.md +280 -0
- package/agents/skills/product/spec-analyze.skill.md +98 -0
- package/agents/skills/product/spec-writer.skill.md +114 -0
- package/agents/skills/product/stakeholder-management.skill.md +54 -0
- package/agents/skills/product/sustainability-checks.skill.md +29 -0
- package/agents/skills/product/systems-thinking.skill.md +56 -0
- package/agents/skills/product/user-research-synthesis.skill.md +85 -0
- package/agents/skills/product/user-story-mapping.skill.md +54 -0
- package/agents/skills/product/visual-specs.skill.md +112 -0
- package/agents/skills/security/access-control.skill.md +45 -0
- package/agents/skills/security/agent-sandboxing.skill.md +69 -0
- package/agents/skills/security/ai-ethics-compliance.skill.md +46 -0
- package/agents/skills/security/ai-red-teaming.skill.md +74 -0
- package/agents/skills/security/ai-safety-guardrails.skill.md +60 -0
- package/agents/skills/security/api-security.skill.md +31 -0
- package/agents/skills/security/backup-recovery.skill.md +49 -0
- package/agents/skills/security/compliance-review.skill.md +152 -0
- package/agents/skills/security/cryptography-standards.skill.md +31 -0
- package/agents/skills/security/dependency-security.skill.md +47 -0
- package/agents/skills/security/hazard-analysis.skill.md +53 -0
- package/agents/skills/security/legal-review.skill.md +41 -0
- package/agents/skills/security/log-analysis.skill.md +68 -0
- package/agents/skills/security/network-security.skill.md +64 -0
- package/agents/skills/security/privacy-audit.skill.md +137 -0
- package/agents/skills/security/privacy-data-protection.skill.md +31 -0
- package/agents/skills/security/prompt-injection-defense.skill.md +67 -0
- package/agents/skills/security/reliability-engineering.skill.md +47 -0
- package/agents/skills/security/safety-scan.skill.md +49 -0
- package/agents/skills/security/secrets-management.skill.md +65 -0
- package/agents/skills/security/secure-architecture.skill.md +31 -0
- package/agents/skills/security/security-audit.skill.md +164 -0
- package/agents/skills/security/threat-model.skill.md +120 -0
- package/agents/skills/security/traceability-audit.skill.md +48 -0
- package/agents/templates/00-index.md +162 -0
- package/agents/templates/architecture/ADAPTIVE_SYSTEM_TEMPLATE.md +35 -0
- package/agents/templates/architecture/ADD_WORKBOOK_TEMPLATE.md +81 -0
- package/agents/templates/architecture/ADR_TEMPLATE.md +136 -0
- package/agents/templates/architecture/ARCHITECTURE_DECISION_MATRIX.md +169 -0
- package/agents/templates/architecture/ARCHITECTURE_REVIEW_TEMPLATE.md +241 -0
- package/agents/templates/architecture/ARCHITECTURE_VIEWS_TEMPLATE.md +353 -0
- package/agents/templates/architecture/ARCH_DECISION_FRAMEWORK.md +32 -0
- package/agents/templates/architecture/C4_ARCHITECTURE_TEMPLATE.md +185 -0
- package/agents/templates/architecture/CAPABILITY_MAP_TEMPLATE.md +153 -0
- package/agents/templates/architecture/CONTEXT_MAP_TEMPLATE.md +196 -0
- package/agents/templates/architecture/DESIGN_PATTERN_USAGE.md +24 -0
- package/agents/templates/architecture/DOMAIN_MODEL_TEMPLATE.md +254 -0
- package/agents/templates/architecture/FITNESS_FUNCTION_TEMPLATE.md +59 -0
- package/agents/templates/architecture/INTEGRATION_SPEC_TEMPLATE.md +38 -0
- package/agents/templates/architecture/LEGACY_AUDIT_TEMPLATE.md +34 -0
- package/agents/templates/architecture/QUALITY_ATTRIBUTES_TEMPLATE.md +210 -0
- package/agents/templates/architecture/SCALABILITY_ANALYSIS_TEMPLATE.md +46 -0
- package/agents/templates/architecture/SMART_CONTRACT_TEMPLATE.md +44 -0
- package/agents/templates/architecture/SYSTEM_CONTEXT_TEMPLATE.md +197 -0
- package/agents/templates/brain/ACTIVE_INFERENCE_LOOP_TEMPLATE.md +42 -0
- package/agents/templates/brain/EPISODIC_MEMORY_LOG_TEMPLATE.md +28 -0
- package/agents/templates/brain/GLOBAL_WORKSPACE_CONFIG_TEMPLATE.md +44 -0
- package/agents/templates/brain/KNOWLEDGE_MAP_TEMPLATE.md +53 -0
- package/agents/templates/brain/OODA_LOOP_TRACE_TEMPLATE.md +44 -0
- package/agents/templates/brain/PREDICTION_ERROR_LOG_TEMPLATE.md +33 -0
- package/agents/templates/brain/PROJECT_CONTEXT_TEMPLATE.md +36 -0
- package/agents/templates/brain/SELF_IMPROVEMENT_LOG_TEMPLATE.md +39 -0
- package/agents/templates/brain/WORKING_MEMORY_TEMPLATE.md +34 -0
- package/agents/templates/coding/CLEAN_CODE_CHECKLIST.md +30 -0
- package/agents/templates/coding/DESIGN_TOKENS_TEMPLATE.json +54 -0
- package/agents/templates/coding/DEVCONTAINER_TEMPLATE.json +42 -0
- package/agents/templates/coding/DEV_SPACE_TEMPLATE.yaml +48 -0
- package/agents/templates/coding/E2E_TEST_SUITE_TEMPLATE.md +36 -0
- package/agents/templates/coding/EVAL_PLAN_TEMPLATE.md +85 -0
- package/agents/templates/coding/EVAL_RUBRIC_TEMPLATE.md +57 -0
- package/agents/templates/coding/GOLDEN_DATASET_TEMPLATE.md +73 -0
- package/agents/templates/coding/PROPERTY_TEST_CHECKLIST.md +77 -0
- package/agents/templates/coding/SKETCH_TO_DIAGRAM_TEMPLATE.md +56 -0
- package/agents/templates/coding/TEST_CASE_TEMPLATE.md +28 -0
- package/agents/templates/coding/TEST_PLAN_TEMPLATE.md +36 -0
- package/agents/templates/coding/TIME_COMPLEXITY_REPORT_TEMPLATE.md +61 -0
- package/agents/templates/coordination/AGENTS_TEMPLATE.md +540 -0
- package/agents/templates/coordination/AGENT_HANDSHAKE_TEMPLATE.json +37 -0
- package/agents/templates/coordination/AGENT_PROFILE_TEMPLATE.md +28 -0
- package/agents/templates/coordination/SWARM_ARCHITECTURE_TEMPLATE.md +53 -0
- package/agents/templates/coordination/SWARM_CONFIG_TEMPLATE.json +45 -0
- package/agents/templates/core/AUDIT_LOG_TEMPLATE.md +75 -0
- package/agents/templates/core/BUG_REPORT_TEMPLATE.md +136 -0
- package/agents/templates/core/DEPENDENCY_GRAPH_TEMPLATE.md +63 -0
- package/agents/templates/core/ESTIMATION_TEMPLATE.md +70 -0
- package/agents/templates/core/MCP_CONFIG_TEMPLATE.json +807 -0
- package/agents/templates/core/PLAN_TEMPLATE.md +162 -0
- package/agents/templates/core/PROJECT_RETROSPECTIVE_TEMPLATE.md +67 -0
- package/agents/templates/core/SDLC_TRACKER.md +217 -0
- package/agents/templates/core/SESSION_SNAPSHOT_TEMPLATE.md +168 -0
- package/agents/templates/core/SYSTEM_ANALYSIS_TEMPLATE.md +52 -0
- package/agents/templates/core/TASKS_TEMPLATE.md +104 -0
- package/agents/templates/core/TRACEABILITY_MATRIX_TEMPLATE.md +18 -0
- package/agents/templates/core/WHITEBOARD_DESIGN_TEMPLATE.md +46 -0
- package/agents/templates/data/DATABASE_SCHEMA_TEMPLATE.md +38 -0
- package/agents/templates/data/DATA_PIPELINE_TEMPLATE.md +44 -0
- package/agents/templates/data/ONTOLOGY_TEMPLATE.md +52 -0
- package/agents/templates/industry/ENGINEERING_STANDARDS_REVIEW_TEMPLATE.md +43 -0
- package/agents/templates/industry/FHIR_INTEGRATION_TEMPLATE.md +53 -0
- package/agents/templates/industry/GLOBAL_STANDARDS_AUDIT_TEMPLATE.md +45 -0
- package/agents/templates/industry/IOT_TELEMETRY_TEMPLATE.md +59 -0
- package/agents/templates/industry/TELECOM_API_TEMPLATE.md +50 -0
- package/agents/templates/ops/BENCHMARK_REPORT_TEMPLATE.md +48 -0
- package/agents/templates/ops/CAPACITY_PLAN_TEMPLATE.md +41 -0
- package/agents/templates/ops/COST_OPTIMIZATION_REPORT_TEMPLATE.md +40 -0
- package/agents/templates/ops/DECOMMISSION_PLAN_TEMPLATE.md +102 -0
- package/agents/templates/ops/DEPLOY_CONFIG_TEMPLATE.md +88 -0
- package/agents/templates/ops/INCIDENT_POSTMORTEM_TEMPLATE.md +39 -0
- package/agents/templates/ops/INFRA_PLAN_TEMPLATE.md +37 -0
- package/agents/templates/ops/RELEASE_READINESS_REPORT.md +35 -0
- package/agents/templates/ops/RUNBOOK_TEMPLATE.md +103 -0
- package/agents/templates/ops/TECH_DEBT_TEMPLATE.md +102 -0
- package/agents/templates/product/BUSINESS_CASE_TEMPLATE.md +42 -0
- package/agents/templates/product/CHANGE_MANAGEMENT_PLAN_TEMPLATE.md +68 -0
- package/agents/templates/product/EMPATHY_MAP_TEMPLATE.md +47 -0
- package/agents/templates/product/EXPERIMENT_PLAN_TEMPLATE.md +84 -0
- package/agents/templates/product/GREEN_SOFTWARE_REPORT_TEMPLATE.md +42 -0
- package/agents/templates/product/IDEATION_LOG_TEMPLATE.md +42 -0
- package/agents/templates/product/NFR_TEMPLATE.md +31 -0
- package/agents/templates/product/PRD_TEMPLATE.md +222 -0
- package/agents/templates/product/PROBLEM_STATEMENT_TEMPLATE.md +32 -0
- package/agents/templates/product/REQUIREMENTS_REVIEW_TEMPLATE.md +173 -0
- package/agents/templates/product/SPEC_TEMPLATE.md +259 -0
- package/agents/templates/product/STAKEHOLDER_REGISTER_TEMPLATE.md +127 -0
- package/agents/templates/product/USER_STORY_MAP_TEMPLATE.md +35 -0
- package/agents/templates/product/VISUAL_SPEC_PACKAGE_TEMPLATE.md +207 -0
- package/agents/templates/security/DATASHEET_TEMPLATE.md +95 -0
- package/agents/templates/security/ETHICAL_IMPACT_ASSESSMENT.md +32 -0
- package/agents/templates/security/HAZARD_LOG.md +17 -0
- package/agents/templates/security/MODEL_CARD_TEMPLATE.md +120 -0
- package/agents/templates/security/SAFETY_CASE.md +39 -0
- package/agents/templates/security/SAFETY_POLICY.md +25 -0
- package/agents/templates/security/SECURITY_CHECKLIST.md +157 -0
- package/agents/templates/security/SYSTEM_CARD_TEMPLATE.md +139 -0
- package/agents/templates/security/THREAT_MODEL_TEMPLATE.md +171 -0
- package/bin/install.js +572 -0
- package/docs/CLI_REFERENCE.md +527 -0
- package/docs/INSTALL.md +68 -0
- package/docs/MCP_CONFIGURATIONS.md +1765 -0
- package/docs/PLATFORM_CONTROLS.md +324 -0
- package/docs/POST_INSTALL.md +75 -0
- package/docs/QUICK_COMMANDS.md +131 -0
- package/docs/QUICK_GUIDE.md +914 -0
- package/docs/README_FULL.md +1451 -0
- package/docs/SCHEMA.md +164 -0
- package/docs/V1_RELEASE_CHECKLIST.md +144 -0
- package/docs/VERIFICATION_GUIDE.md +283 -0
- package/docs/adr/0001-record-architecture-decisions.md +26 -0
- package/docs/adr/0002-brain-active-inference-runtime.md +27 -0
- package/docs/adr/0003-additive-only-emitter-schema-evolution.md +33 -0
- package/docs/assets/GABBE.png +0 -0
- package/docs/gabbe.config.example.json +9 -0
- package/docs/reports/duplication-report.md +30 -0
- package/install.ps1 +90 -0
- package/install.sh +89 -0
- package/package.json +49 -0
- package/scripts/init.py +1036 -0
|
@@ -0,0 +1,95 @@
|
|
|
1
|
+
# Datasheet for Dataset: [DATASET_NAME]
|
|
2
|
+
|
|
3
|
+
<!-- Datasheet for Datasets in the Gebru et al. style. Fill every [PLACEHOLDER]. -->
|
|
4
|
+
<!-- Store in: docs/security/datasheets/[dataset-name]-datasheet.md -->
|
|
5
|
+
<!-- Pair this datasheet with the Model Card of any model trained on this data (see MODEL_CARD_TEMPLATE). -->
|
|
6
|
+
|
|
7
|
+
---
|
|
8
|
+
|
|
9
|
+
## 1. Motivation
|
|
10
|
+
|
|
11
|
+
- **For what purpose was the dataset created?** [PURPOSE — and what gap it fills]
|
|
12
|
+
- **Who created it and for whom?** [CREATOR_TEAM / commissioning entity]
|
|
13
|
+
- **Who funded the creation?** [FUNDING_SOURCE]
|
|
14
|
+
- **Any other context?** [NOTES]
|
|
15
|
+
|
|
16
|
+
---
|
|
17
|
+
|
|
18
|
+
## 2. Composition
|
|
19
|
+
|
|
20
|
+
- **What do the instances represent?** [e.g. documents, images, user events, conversations]
|
|
21
|
+
- **How many instances are there?** [TOTAL_COUNT, with breakdown by type/class if relevant]
|
|
22
|
+
- **Is it a sample or the full population?** [SAMPLE_OR_COMPLETE — and sampling method if a sample]
|
|
23
|
+
- **What data does each instance consist of?** [FIELDS / FEATURES]
|
|
24
|
+
- **Are there labels/targets?** [LABELS — and how derived]
|
|
25
|
+
- **Is any information missing?** [MISSINGNESS — and why]
|
|
26
|
+
- **Are relationships between instances made explicit?** [RELATIONSHIPS, e.g. threads, users]
|
|
27
|
+
- **Are there recommended splits?** [TRAIN/VAL/TEST splits and rationale]
|
|
28
|
+
- **Known errors, noise, or redundancy?** [QUALITY_ISSUES]
|
|
29
|
+
- **Does it contain confidential, sensitive, or PII data?** [SENSITIVE_DATA — categories and handling]
|
|
30
|
+
- **Could it identify individuals or sub-populations?** [IDENTIFIABILITY]
|
|
31
|
+
|
|
32
|
+
---
|
|
33
|
+
|
|
34
|
+
## 3. Collection Process
|
|
35
|
+
|
|
36
|
+
- **How was the data acquired?** [COLLECTION_METHOD — directly observed, reported, derived, scraped, purchased]
|
|
37
|
+
- **What mechanisms/tools were used?** [TOOLS / APIS / INSTRUMENTS]
|
|
38
|
+
- **Over what time frame was it collected?** [START – END]
|
|
39
|
+
- **Who collected it?** [COLLECTORS — staff, crowdworkers, automated]
|
|
40
|
+
- **Were collectors compensated fairly?** [COMPENSATION, if human]
|
|
41
|
+
- **Was consent obtained?** [CONSENT_BASIS — and from whom]
|
|
42
|
+
- **Were individuals notified / given a way to revoke?** [NOTICE_AND_REVOCATION]
|
|
43
|
+
- **Was an ethics/IRB review conducted?** [ETHICS_REVIEW]
|
|
44
|
+
|
|
45
|
+
---
|
|
46
|
+
|
|
47
|
+
## 4. Preprocessing, Cleaning, and Labeling
|
|
48
|
+
|
|
49
|
+
- **What preprocessing was done?** [TOKENIZATION / NORMALIZATION / FILTERING / DEDUP]
|
|
50
|
+
- **Was raw data saved?** [RAW_RETAINED — and where]
|
|
51
|
+
- **How was labeling performed?** [LABELING_PROCESS — annotators, guidelines, tooling]
|
|
52
|
+
- **Inter-annotator agreement / quality control?** [QC_METRICS]
|
|
53
|
+
- **What was filtered out, and could that introduce bias?** [FILTERING_BIAS]
|
|
54
|
+
- **Is the preprocessing software available?** [SOFTWARE_AVAILABILITY]
|
|
55
|
+
|
|
56
|
+
---
|
|
57
|
+
|
|
58
|
+
## 5. Uses
|
|
59
|
+
|
|
60
|
+
- **What has the dataset been used for so far?** [PRIOR_USES]
|
|
61
|
+
- **What tasks is it appropriate for?** [APPROPRIATE_USES]
|
|
62
|
+
- **What tasks should it NOT be used for?** [INAPPROPRIATE_USES]
|
|
63
|
+
- **Does its composition limit fair/safe use?** [COMPOSITION_RISKS — e.g. group under-representation]
|
|
64
|
+
- **What should a future user know to avoid misuse?** [USER_GUIDANCE]
|
|
65
|
+
|
|
66
|
+
---
|
|
67
|
+
|
|
68
|
+
## 6. Distribution
|
|
69
|
+
|
|
70
|
+
- **Will it be distributed beyond the creating entity?** [DISTRIBUTION_SCOPE]
|
|
71
|
+
- **How will it be distributed?** [CHANNEL / FORMAT]
|
|
72
|
+
- **Under what license / terms of use?** [LICENSE]
|
|
73
|
+
- **Any IP, export, or regulatory restrictions?** [RESTRICTIONS]
|
|
74
|
+
- **When will it be released?** [RELEASE_DATE]
|
|
75
|
+
|
|
76
|
+
---
|
|
77
|
+
|
|
78
|
+
## 7. Maintenance
|
|
79
|
+
|
|
80
|
+
- **Who maintains the dataset?** [MAINTAINER + CONTACT]
|
|
81
|
+
- **How will errors be reported and corrected?** [ERROR_PROCESS]
|
|
82
|
+
- **Will it be updated? On what cadence?** [UPDATE_CADENCE]
|
|
83
|
+
- **Are there retention limits / deletion obligations?** [RETENTION_POLICY]
|
|
84
|
+
- **How are older versions kept and communicated?** [VERSIONING]
|
|
85
|
+
- **Can others extend/build on it, and how is that validated?** [CONTRIBUTION_PROCESS]
|
|
86
|
+
|
|
87
|
+
---
|
|
88
|
+
|
|
89
|
+
## 8. Sign-off
|
|
90
|
+
|
|
91
|
+
| Role | Name | Status | Date |
|
|
92
|
+
|---|---|---|---|
|
|
93
|
+
| Dataset owner | [name] | [APPROVED / PENDING] | [date] |
|
|
94
|
+
| Privacy / data-protection reviewer | [name] | [APPROVED / PENDING] | [date] |
|
|
95
|
+
| Ethics reviewer | [name] | [APPROVED / PENDING] | [date] |
|
|
@@ -0,0 +1,32 @@
|
|
|
1
|
+
# Ethical Impact Assessment (EIA)
|
|
2
|
+
|
|
3
|
+
**Project**: [Name]
|
|
4
|
+
**Date**: [YYYY-MM-DD]
|
|
5
|
+
**Ethicist**: [Name]
|
|
6
|
+
|
|
7
|
+
## 1. Human Rights & Well-being
|
|
8
|
+
- [ ] **Privacy**: Does the system collect more data than necessary? (Data Minimization)
|
|
9
|
+
- [ ] **Autonomy**: Can the user fully control the system, or does it nudge/manipulate?
|
|
10
|
+
- [ ] **Equity**: Could this system disadvantage any specific group (Race, Gender, Income)?
|
|
11
|
+
- [ ] **Safety**: Is there a risk of physical or psychological harm?
|
|
12
|
+
|
|
13
|
+
## 2. Legal Alignment
|
|
14
|
+
- [ ] **GDPR/CCPA**: Data subject rights respected?
|
|
15
|
+
- [ ] **EU AI Act**: Risk category defined? Transparency obligations met?
|
|
16
|
+
- [ ] **IP**: Are we respecting copyright in our training/RAG data?
|
|
17
|
+
|
|
18
|
+
## 3. Sustainability (GreenTech)
|
|
19
|
+
- [ ] **Observation**: Estimated Carbon Footprint per user/month?
|
|
20
|
+
- [ ] **Mitigation**: Are we using green regions? Scaling to zero?
|
|
21
|
+
- [ ] **Lifecycle**: Plan for decomposing legacy resources?
|
|
22
|
+
|
|
23
|
+
## 4. AI Specific Risks
|
|
24
|
+
- **Hallucination Risk**: [High/Med/Low] -> *Mitigation*: [e.g., Grounding]
|
|
25
|
+
- **Bias Risk**: [High/Med/Low] -> *Mitigation*: [e.g., Balanced Dataset]
|
|
26
|
+
- **Misuse Risk**: [High/Med/Low] -> *Mitigation*: [e.g., Rate Limits]
|
|
27
|
+
|
|
28
|
+
## 5. Conclusion
|
|
29
|
+
- **Recommendation**: [Proceed / Proceed with Cautions / Stop]
|
|
30
|
+
- **Required Changes**:
|
|
31
|
+
1.
|
|
32
|
+
2.
|
|
@@ -0,0 +1,17 @@
|
|
|
1
|
+
# Hazard Log
|
|
2
|
+
|
|
3
|
+
**System**: [Name]
|
|
4
|
+
**Date**: [YYYY-MM-DD]
|
|
5
|
+
|
|
6
|
+
| ID | Component | Failure Mode | Effect (Severity) | Cause (Probability) | Detection | RPN | Mitigation | Status |
|
|
7
|
+
|---|---|---|---|---|---|---|---|---|
|
|
8
|
+
| H-001 | LiDAR | No Data Output | Collision Risk (10) | Cable Break (2) | Heartbeat (2) | 40 | Redundant LiDAR | OPEN |
|
|
9
|
+
| H-002 | Battery | Thermal Runaway | Fire (10) | Short Circuit (3) | Temp Sensor (3) | 90 | Liquid Cooling | CLOSED |
|
|
10
|
+
|
|
11
|
+
## Definitions
|
|
12
|
+
- **Severity**: 1 (None) to 10 (Catastrophic/Loss of Life).
|
|
13
|
+
- **Probability**: 1 (1 in 1M hours) to 10 (Frequent).
|
|
14
|
+
- **Risk Class**:
|
|
15
|
+
- High (RPN > 100): Must mitigate.
|
|
16
|
+
- Med (RPN > 50): ALARP (As Low As Reasonably Practicable).
|
|
17
|
+
- Low (RPN < 50): Acceptable.
|
|
@@ -0,0 +1,120 @@
|
|
|
1
|
+
# Model Card: [MODEL_NAME]
|
|
2
|
+
|
|
3
|
+
<!-- Model Card in the Mitchell et al. style. Fill every [PLACEHOLDER]. -->
|
|
4
|
+
<!-- Store in: docs/security/model-cards/[model-name]-model-card.md -->
|
|
5
|
+
<!-- Keep this card versioned alongside the model; update on every retrain or eval change. -->
|
|
6
|
+
|
|
7
|
+
---
|
|
8
|
+
|
|
9
|
+
## 1. Model Details
|
|
10
|
+
|
|
11
|
+
| Field | Value |
|
|
12
|
+
|---|---|
|
|
13
|
+
| Model name | [MODEL_NAME] |
|
|
14
|
+
| Version | [VERSION] |
|
|
15
|
+
| Owner / team | [OWNER_TEAM] |
|
|
16
|
+
| Point of contact | [CONTACT] |
|
|
17
|
+
| Date released | [DATE] |
|
|
18
|
+
| Model type | [e.g. transformer LLM / fine-tune of BASE_MODEL / classifier / distilled SLM] |
|
|
19
|
+
| Base / parent model | [BASE_MODEL or "trained from scratch"] |
|
|
20
|
+
| Architecture summary | [ARCHITECTURE] |
|
|
21
|
+
| License | [LICENSE] |
|
|
22
|
+
| Citation / how to cite | [CITATION] |
|
|
23
|
+
|
|
24
|
+
---
|
|
25
|
+
|
|
26
|
+
## 2. Intended Use
|
|
27
|
+
|
|
28
|
+
### In-scope uses
|
|
29
|
+
- [Primary intended use 1]
|
|
30
|
+
- [Primary intended use 2]
|
|
31
|
+
- [Intended users: who is expected to use this and in what context]
|
|
32
|
+
|
|
33
|
+
### Out-of-scope uses
|
|
34
|
+
- [Use this model is NOT validated for]
|
|
35
|
+
- [Use that is explicitly prohibited]
|
|
36
|
+
- [High-stakes context where this model must not be the sole decision-maker]
|
|
37
|
+
|
|
38
|
+
---
|
|
39
|
+
|
|
40
|
+
## 3. Training Data Summary
|
|
41
|
+
|
|
42
|
+
| Field | Value |
|
|
43
|
+
|---|---|
|
|
44
|
+
| Data sources | [SOURCES] |
|
|
45
|
+
| Size / volume | [N examples / tokens] |
|
|
46
|
+
| Time range of data | [START – END] |
|
|
47
|
+
| Languages / domains covered | [LANGUAGES_DOMAINS] |
|
|
48
|
+
| Known gaps or under-represented groups | [GAPS] |
|
|
49
|
+
| Datasheet reference | [link by name to the dataset's DATASHEET_TEMPLATE entry] |
|
|
50
|
+
|
|
51
|
+
> For the full provenance and collection process, reference the dataset's Datasheet (see `DATASHEET_TEMPLATE`).
|
|
52
|
+
|
|
53
|
+
---
|
|
54
|
+
|
|
55
|
+
## 4. Evaluation Data and Metrics
|
|
56
|
+
|
|
57
|
+
| Field | Value |
|
|
58
|
+
|---|---|
|
|
59
|
+
| Evaluation datasets | [EVAL_SETS] |
|
|
60
|
+
| Why these eval sets | [JUSTIFICATION — how they represent intended use] |
|
|
61
|
+
| Primary metrics | [METRIC_1, METRIC_2, ...] |
|
|
62
|
+
| Decision threshold(s) | [THRESHOLD] |
|
|
63
|
+
|
|
64
|
+
### Disaggregated / per-group results
|
|
65
|
+
|
|
66
|
+
<!-- Report metrics broken out by relevant group (e.g. demographic, language, segment) wherever the model could affect people differently. -->
|
|
67
|
+
|
|
68
|
+
| Group | [METRIC_1] | [METRIC_2] | N | Notes |
|
|
69
|
+
|---|---|---|---|---|
|
|
70
|
+
| Overall | [value] | [value] | [N] | |
|
|
71
|
+
| [Group A] | [value] | [value] | [N] | |
|
|
72
|
+
| [Group B] | [value] | [value] | [N] | |
|
|
73
|
+
|
|
74
|
+
---
|
|
75
|
+
|
|
76
|
+
## 5. Quantitative Analysis
|
|
77
|
+
|
|
78
|
+
- **Headline results**: [summary of overall performance against the bar]
|
|
79
|
+
- **Performance variation across groups**: [where disaggregated results diverge and by how much]
|
|
80
|
+
- **Confidence / calibration**: [calibration findings, error bars]
|
|
81
|
+
- **Comparison to baseline**: [vs prior version / vs simpler baseline]
|
|
82
|
+
|
|
83
|
+
---
|
|
84
|
+
|
|
85
|
+
## 6. Ethical Considerations
|
|
86
|
+
|
|
87
|
+
- **Sensitive data**: [does the model touch PII, protected attributes, or sensitive domains?]
|
|
88
|
+
- **Potential harms**: [who could be harmed and how if the model errs or is misused]
|
|
89
|
+
- **Fairness concerns**: [identified bias risks and what was done about them]
|
|
90
|
+
- **Human oversight**: [where a human must remain in the loop]
|
|
91
|
+
- **Misuse potential**: [foreseeable misuse and any mitigations]
|
|
92
|
+
|
|
93
|
+
---
|
|
94
|
+
|
|
95
|
+
## 7. Caveats and Recommendations
|
|
96
|
+
|
|
97
|
+
- [Caveat about generalization beyond the eval distribution]
|
|
98
|
+
- [Recommendation on monitoring in production]
|
|
99
|
+
- [Recommendation on retraining / staleness cadence]
|
|
100
|
+
- [Conditions under which results should not be trusted]
|
|
101
|
+
|
|
102
|
+
---
|
|
103
|
+
|
|
104
|
+
## 8. Known Limitations
|
|
105
|
+
|
|
106
|
+
| Limitation | Impact | Mitigation / guidance |
|
|
107
|
+
|---|---|---|
|
|
108
|
+
| [Limitation 1] | [impact] | [how users should compensate] |
|
|
109
|
+
| [Limitation 2] | [impact] | [mitigation] |
|
|
110
|
+
| [Limitation 3] | [impact] | [mitigation] |
|
|
111
|
+
|
|
112
|
+
---
|
|
113
|
+
|
|
114
|
+
## 9. Sign-off
|
|
115
|
+
|
|
116
|
+
| Role | Name | Status | Date |
|
|
117
|
+
|---|---|---|---|
|
|
118
|
+
| Model owner | [name] | [APPROVED / PENDING] | [date] |
|
|
119
|
+
| Responsible-AI / Ethics reviewer | [name] | [APPROVED / PENDING] | [date] |
|
|
120
|
+
| Security reviewer | [name] | [APPROVED / PENDING] | [date] |
|
|
@@ -0,0 +1,39 @@
|
|
|
1
|
+
# Safety Case (GSN Style)
|
|
2
|
+
|
|
3
|
+
**Goal**: The System is Safe for Operation in [Context].
|
|
4
|
+
|
|
5
|
+
## Argument Structure
|
|
6
|
+
|
|
7
|
+
### G1: Top Level Safety Goal
|
|
8
|
+
"The Autonomous Rover will not cause injury to humans."
|
|
9
|
+
|
|
10
|
+
#### S1: Context
|
|
11
|
+
"Operating in a controlled warehouse environment, max speed 2m/s."
|
|
12
|
+
|
|
13
|
+
### G2: Hazard Mitigation
|
|
14
|
+
"All identified hazards in HAZARD_LOG.md have been mitigated to acceptable levels."
|
|
15
|
+
|
|
16
|
+
#### Ev1: Evidence
|
|
17
|
+
- [Link to HAZARD_LOG.md]
|
|
18
|
+
- [Link to TMR_Test_Results.pdf]
|
|
19
|
+
|
|
20
|
+
### G3: Software Integrity
|
|
21
|
+
"Software functionality is correct and free from critical defects."
|
|
22
|
+
|
|
23
|
+
#### Ev2: Evidence
|
|
24
|
+
- [Link to E2E_TEST_SUITE.md] (100% Pass)
|
|
25
|
+
- [Link to Static_Analysis_Report.pdf] (No Critical Issues)
|
|
26
|
+
- [Link to Traceability_Matrix.md] (100% Req Coverage)
|
|
27
|
+
|
|
28
|
+
### G4: Fail-Safe Handling
|
|
29
|
+
"If a critical failure occurs, the system transitions to a Safe State."
|
|
30
|
+
|
|
31
|
+
#### Ev3: Evidence
|
|
32
|
+
- [Link to Watchdog_Test.mp4]
|
|
33
|
+
- [Link to Emergency_Stop_Test.md]
|
|
34
|
+
|
|
35
|
+
## Conclusion
|
|
36
|
+
Based on the evidence provided, the system meets the safety requirements for deployment.
|
|
37
|
+
|
|
38
|
+
**Signed**: `prod-safety-engineer`
|
|
39
|
+
**Date**: [YYYY-MM-DD]
|
|
@@ -0,0 +1,25 @@
|
|
|
1
|
+
# AI Safety Policy & Guardrails
|
|
2
|
+
|
|
3
|
+
> **Purpose**: This document defines the boundaries and safety rules for AI Agents operating within this project.
|
|
4
|
+
|
|
5
|
+
## 1. Data Privacy (PII)
|
|
6
|
+
* **Rule**: Agents MUST NOT log, store, or output Personally Identifiable Information (PII) in plain text.
|
|
7
|
+
* **Definition**: PII includes email addresses, phone numbers, credit card numbers, SSNs, and home addresses.
|
|
8
|
+
* **Action**: If PII is detected in logs or outputs, redact it immediately (e.g., `user@example.com` -> `[REDACTED_EMAIL]`).
|
|
9
|
+
|
|
10
|
+
## 2. Code Safety
|
|
11
|
+
* **Rule**: Agents MUST NOT commit secrets, API keys, or credentials to version control.
|
|
12
|
+
* **Action**: Run `gitleaks` or regex checks before every commit.
|
|
13
|
+
* **Rule**: Agents MUST NOT introduce "destructive" code patterns (e.g., `rm -rf /`, dropping production tables) without explicit human confirmation.
|
|
14
|
+
|
|
15
|
+
## 3. Hallucination Guardrails
|
|
16
|
+
* **Rule**: Agents MUST verify libraries and API endpoints exist before recommending them.
|
|
17
|
+
* **Action**: Use `search_web` or `run_command` (npm/pip) to validate existence.
|
|
18
|
+
|
|
19
|
+
## 4. Ethical Standards
|
|
20
|
+
* **Rule**: Agents MUST NOT generate content or code that promotes bias, discrimination, or harm.
|
|
21
|
+
|
|
22
|
+
## 5. Deployment Gates
|
|
23
|
+
* [ ] Security Scan passed
|
|
24
|
+
* [ ] No Secrets detected
|
|
25
|
+
* [ ] Safety Policy reviewed by Human
|
|
@@ -0,0 +1,157 @@
|
|
|
1
|
+
# Security Checklist — Pre-Release Gate
|
|
2
|
+
<!-- Complete before every production deployment — security-audit.skill auto-fills this -->
|
|
3
|
+
<!-- Date: [date] | Auditor: [agent/human] | Release: [version/tag] -->
|
|
4
|
+
|
|
5
|
+
---
|
|
6
|
+
|
|
7
|
+
## How to Use
|
|
8
|
+
|
|
9
|
+
Run through each section. Mark items:
|
|
10
|
+
- `[x]` PASS — verified and compliant
|
|
11
|
+
- `[ ]` FAIL — must be fixed before release
|
|
12
|
+
- `[~]` N/A — not applicable to this project (document why)
|
|
13
|
+
|
|
14
|
+
**All FAIL items are blocking. Do not release until all are PASS or N/A (with documented reason).**
|
|
15
|
+
|
|
16
|
+
---
|
|
17
|
+
|
|
18
|
+
## 1. Authentication & Authorization
|
|
19
|
+
|
|
20
|
+
- [ ] No hardcoded credentials in source code or config files
|
|
21
|
+
- [ ] Passwords hashed with bcrypt (cost >= 12) or Argon2 — never MD5, SHA1, SHA256
|
|
22
|
+
- [ ] Session tokens are cryptographically random (>= 128 bits entropy)
|
|
23
|
+
- [ ] JWT tokens: algorithm enforced (HS256/RS256), expiry set (<= 15 min access token)
|
|
24
|
+
- [ ] Refresh token rotation implemented (old token invalidated on use)
|
|
25
|
+
- [ ] MFA required for admin/privileged access
|
|
26
|
+
- [ ] Login endpoint: rate limited (max 5 attempts/min per IP, lockout after 10 fails)
|
|
27
|
+
- [ ] Password reset: single-use token, expires in 24 hours, invalidated on use
|
|
28
|
+
- [ ] Account lockout with notification to user
|
|
29
|
+
- [ ] All authorization checks server-side (never trust client-supplied role)
|
|
30
|
+
- [ ] RBAC/ABAC implemented and consistent across all endpoints
|
|
31
|
+
- [ ] IDOR prevention: ownership verified for all resource access (`record.userId === session.userId`)
|
|
32
|
+
|
|
33
|
+
---
|
|
34
|
+
|
|
35
|
+
## 2. Input Validation & Output Encoding
|
|
36
|
+
|
|
37
|
+
- [ ] All user inputs validated at system boundaries (HTTP body, query params, headers)
|
|
38
|
+
- [ ] SQL injection prevention: parameterized queries only (no string concatenation in SQL)
|
|
39
|
+
- [ ] Command injection prevention: no `exec()`/`shell_exec()` with user input
|
|
40
|
+
- [ ] XSS prevention: HTML encoding for all user-controlled output in HTML context
|
|
41
|
+
- [ ] Path traversal prevention: filename inputs sanitized, no `../` sequences
|
|
42
|
+
- [ ] File upload: type validation (whitelist), size limit, stored outside web root
|
|
43
|
+
- [ ] Mass assignment protection: explicit field allowlist (never spread `req.body` to ORM)
|
|
44
|
+
- [ ] Request size limits configured (prevent large payload DoS)
|
|
45
|
+
- [ ] CSRF protection: SameSite=Strict/Lax cookie or CSRF token for state-changing requests
|
|
46
|
+
|
|
47
|
+
---
|
|
48
|
+
|
|
49
|
+
## 3. Data Protection
|
|
50
|
+
|
|
51
|
+
- [ ] Sensitive data (PII, health data, financial) encrypted at rest
|
|
52
|
+
- [ ] All connections use TLS 1.2+ (TLS 1.3 preferred); no HTTP for sensitive data
|
|
53
|
+
- [ ] Secrets stored in environment variables or secrets manager (not in code or git)
|
|
54
|
+
- [ ] `.env` files in `.gitignore`
|
|
55
|
+
- [ ] API keys, tokens, connection strings not in git history (run: `gitleaks detect`)
|
|
56
|
+
- [ ] PII not logged (no email, name, phone, IP, SSN in log statements)
|
|
57
|
+
- [ ] Payment card data not stored (use tokenization — e.g., Stripe token instead of PAN)
|
|
58
|
+
- [ ] Personal data deletion implemented (GDPR Article 17 / CCPA right to delete)
|
|
59
|
+
- [ ] Database backups encrypted
|
|
60
|
+
|
|
61
|
+
---
|
|
62
|
+
|
|
63
|
+
## 4. Dependency Security
|
|
64
|
+
|
|
65
|
+
- [ ] `npm audit --audit-level=moderate` — zero critical or high CVEs
|
|
66
|
+
- [ ] `composer audit` — zero critical or high CVEs (or documented false positives)
|
|
67
|
+
- [ ] `pip-audit` / `snyk test` — clean (or documented exceptions)
|
|
68
|
+
- [ ] No end-of-life (EOL) dependencies (check: endoflife.date)
|
|
69
|
+
- [ ] License compliance verified (no GPL in commercial product without review)
|
|
70
|
+
- [ ] `gitleaks detect` — no secrets in git history
|
|
71
|
+
|
|
72
|
+
---
|
|
73
|
+
|
|
74
|
+
## 5. Container Security (if applicable)
|
|
75
|
+
|
|
76
|
+
- [ ] Docker image built from specific version (not `:latest`)
|
|
77
|
+
- [ ] Container runs as non-root user
|
|
78
|
+
- [ ] No secrets in Dockerfile or docker-compose.yml
|
|
79
|
+
- [ ] Build artifacts (node_modules, .git) excluded from image
|
|
80
|
+
- [ ] `trivy image [image]` — zero critical or high CVEs
|
|
81
|
+
- [ ] Minimal base image (Alpine preferred over full Debian)
|
|
82
|
+
- [ ] Multi-stage build (dev dependencies not in production image)
|
|
83
|
+
|
|
84
|
+
---
|
|
85
|
+
|
|
86
|
+
## 6. API Security
|
|
87
|
+
|
|
88
|
+
- [ ] Rate limiting on all public endpoints (not just auth)
|
|
89
|
+
- [ ] CORS configured: origin allowlist, not `*` for credentialed requests
|
|
90
|
+
- [ ] Security headers set:
|
|
91
|
+
- `Content-Security-Policy`
|
|
92
|
+
- `X-Frame-Options: DENY`
|
|
93
|
+
- `X-Content-Type-Options: nosniff`
|
|
94
|
+
- `Strict-Transport-Security: max-age=31536000; includeSubDomains`
|
|
95
|
+
- `Referrer-Policy: strict-origin-when-cross-origin`
|
|
96
|
+
- [ ] Sensitive data not in URL parameters (tokens, passwords — use POST body or headers)
|
|
97
|
+
- [ ] API versioning implemented (`/api/v1/`) — breaking changes go to new version
|
|
98
|
+
- [ ] GraphQL: introspection disabled in production, query depth limiting
|
|
99
|
+
- [ ] Pagination enforced (no unbounded queries returning all records)
|
|
100
|
+
|
|
101
|
+
---
|
|
102
|
+
|
|
103
|
+
## 7. Error Handling & Logging
|
|
104
|
+
|
|
105
|
+
- [ ] No stack traces in HTTP responses in production
|
|
106
|
+
- [ ] Production errors return generic messages (500 Internal Server Error) — details only in logs
|
|
107
|
+
- [ ] No PII in log statements
|
|
108
|
+
- [ ] Security events logged: failed logins, access denied, input validation failures
|
|
109
|
+
- [ ] Log levels appropriate: no verbose debug logging in production
|
|
110
|
+
- [ ] Logs shipped to SIEM or centralized logging (not only on local disk)
|
|
111
|
+
|
|
112
|
+
---
|
|
113
|
+
|
|
114
|
+
## 8. Infrastructure & Configuration
|
|
115
|
+
|
|
116
|
+
- [ ] Default credentials changed on all systems (databases, admin panels, services)
|
|
117
|
+
- [ ] Production environment variables separate from dev/staging
|
|
118
|
+
- [ ] Directory listing disabled on web server
|
|
119
|
+
- [ ] Debugging endpoints disabled in production (e.g., `/debug`, `/phpinfo`, `/__debugbar`)
|
|
120
|
+
- [ ] Admin panels restricted by IP or VPN (not public internet)
|
|
121
|
+
- [ ] Backup and restore procedure tested (not just configured)
|
|
122
|
+
|
|
123
|
+
---
|
|
124
|
+
|
|
125
|
+
## 9. OWASP Top 10 — Final Check
|
|
126
|
+
|
|
127
|
+
| OWASP Category | Status | Notes |
|
|
128
|
+
|---|---|---|
|
|
129
|
+
| A01: Broken Access Control | [ ] | IDOR checks, auth enforcement |
|
|
130
|
+
| A02: Cryptographic Failures | [ ] | Password hashing, TLS, encryption at rest |
|
|
131
|
+
| A03: Injection | [ ] | SQL injection, command injection, XSS |
|
|
132
|
+
| A04: Insecure Design | [ ] | Threat model completed for new features |
|
|
133
|
+
| A05: Security Misconfiguration | [ ] | Headers, defaults, error handling |
|
|
134
|
+
| A06: Vulnerable Components | [ ] | Dependency audit clean |
|
|
135
|
+
| A07: Auth Failures | [ ] | Rate limiting, session management, MFA |
|
|
136
|
+
| A08: Data Integrity | [ ] | File upload validation, SRI hashes |
|
|
137
|
+
| A09: Logging & Monitoring | [ ] | Security events logged, SIEM configured |
|
|
138
|
+
| A10: SSRF | [ ] | URL fetching uses allowlist |
|
|
139
|
+
|
|
140
|
+
---
|
|
141
|
+
|
|
142
|
+
## 10. Release Sign-Off
|
|
143
|
+
|
|
144
|
+
| Category | Status | Verified by | Date |
|
|
145
|
+
|---|---|---|---|
|
|
146
|
+
| Authentication & Authorization | PASS / FAIL | [name] | [date] |
|
|
147
|
+
| Input Validation | PASS / FAIL | [name] | [date] |
|
|
148
|
+
| Data Protection | PASS / FAIL | [name] | [date] |
|
|
149
|
+
| Dependencies | PASS / FAIL | [name] | [date] |
|
|
150
|
+
| Container Security | PASS / FAIL / N/A | [name] | [date] |
|
|
151
|
+
| API Security | PASS / FAIL | [name] | [date] |
|
|
152
|
+
| Error Handling & Logging | PASS / FAIL | [name] | [date] |
|
|
153
|
+
| OWASP Top 10 | PASS / FAIL | [name] | [date] |
|
|
154
|
+
|
|
155
|
+
**OVERALL: APPROVED / NOT APPROVED**
|
|
156
|
+
|
|
157
|
+
*All items must be PASS or N/A (with documented reason) before production release.*
|
|
@@ -0,0 +1,139 @@
|
|
|
1
|
+
# System Card: [SYSTEM_NAME]
|
|
2
|
+
|
|
3
|
+
<!-- System Card for a deployed AI system (models + tools + retrieval + guardrails). Fill every [PLACEHOLDER]. -->
|
|
4
|
+
<!-- Store in: docs/security/system-cards/[system-name]-system-card.md -->
|
|
5
|
+
<!-- A System Card describes the whole deployed system, not a single model. Reference each component's Model Card and Datasheet by name. -->
|
|
6
|
+
|
|
7
|
+
---
|
|
8
|
+
|
|
9
|
+
## 1. System Overview and Components
|
|
10
|
+
|
|
11
|
+
| Field | Value |
|
|
12
|
+
|---|---|
|
|
13
|
+
| System name | [SYSTEM_NAME] |
|
|
14
|
+
| Version | [VERSION] |
|
|
15
|
+
| Owner / team | [OWNER_TEAM] |
|
|
16
|
+
| Point of contact | [CONTACT] |
|
|
17
|
+
| Date / status | [DATE] / [DEV / STAGING / PRODUCTION] |
|
|
18
|
+
| One-line description | [WHAT_THE_SYSTEM_DOES] |
|
|
19
|
+
|
|
20
|
+
### Component inventory
|
|
21
|
+
|
|
22
|
+
| Component | What it is | Provenance / reference |
|
|
23
|
+
|---|---|---|
|
|
24
|
+
| Model(s) | [model name + version] | [reference its MODEL_CARD_TEMPLATE entry by name] |
|
|
25
|
+
| Training data | [dataset name] | [reference its DATASHEET_TEMPLATE entry by name] |
|
|
26
|
+
| Tools / actions | [tools/APIs the system can call] | [allowlist source] |
|
|
27
|
+
| Retrieval / knowledge | [RAG sources, vector store, indexes] | [source of truth] |
|
|
28
|
+
| Guardrails | [input/output filters, classifiers, policy engine] | [config location] |
|
|
29
|
+
| Orchestration | [single agent / multi-agent topology] | [reference relevant guide by name] |
|
|
30
|
+
|
|
31
|
+
### Data-flow summary
|
|
32
|
+
[Describe how a request flows through the components: input -> guardrails -> retrieval -> model -> tools -> output validation -> response. Note trust boundaries.]
|
|
33
|
+
|
|
34
|
+
---
|
|
35
|
+
|
|
36
|
+
## 2. Intended Use and Users
|
|
37
|
+
|
|
38
|
+
### In-scope
|
|
39
|
+
- [Intended task(s)]
|
|
40
|
+
- [Intended users and their context]
|
|
41
|
+
|
|
42
|
+
### Out-of-scope
|
|
43
|
+
- [Uses the system is NOT validated for]
|
|
44
|
+
- [Explicitly prohibited uses]
|
|
45
|
+
- [Decisions that must not be fully automated by this system]
|
|
46
|
+
|
|
47
|
+
---
|
|
48
|
+
|
|
49
|
+
## 3. Risk Assessment
|
|
50
|
+
|
|
51
|
+
<!-- Map each risk to a recognized framework so coverage is auditable. -->
|
|
52
|
+
|
|
53
|
+
| Risk | OWASP LLM Top 10 ref | NIST AI RMF function | Likelihood (L/M/H) | Impact (L/M/H) | Priority |
|
|
54
|
+
|---|---|---|---|---|---|
|
|
55
|
+
| Prompt injection (direct/indirect) | LLM01 | [Govern/Map/Measure/Manage] | [L/M/H] | [L/M/H] | [Critical/High/Med/Low] |
|
|
56
|
+
| Sensitive information disclosure | LLM02 | [function] | | | |
|
|
57
|
+
| Excessive agency / unauthorized tool use | LLM06 | [function] | | | |
|
|
58
|
+
| System prompt leakage | LLM07 | [function] | | | |
|
|
59
|
+
| [Other system-specific risk] | [ref] | [function] | | | |
|
|
60
|
+
|
|
61
|
+
> Reference `threat-model.skill` for surface enumeration and the project Threat Model (see `THREAT_MODEL_TEMPLATE`).
|
|
62
|
+
|
|
63
|
+
---
|
|
64
|
+
|
|
65
|
+
## 4. Safety Mitigations and Guardrails
|
|
66
|
+
|
|
67
|
+
| Control | Layer | What it mitigates | Reference |
|
|
68
|
+
|---|---|---|---|
|
|
69
|
+
| Instruction hierarchy / spotlighting | Input | Prompt injection | `prompt-injection-defense.skill` |
|
|
70
|
+
| Untrusted-content quarantine (dual-LLM) | Processing | Indirect injection | `prompt-injection-defense.skill` |
|
|
71
|
+
| Tool allowlist + least-privilege tokens | Action | Excessive agency | [policy source] |
|
|
72
|
+
| Egress filtering | Output | Data exfiltration | [config] |
|
|
73
|
+
| Output validation | Output | Unsafe/malformed output | `output-validation.skill` |
|
|
74
|
+
| Content/safety classifiers | Input+Output | Policy violations | `ai-safety-guardrails.skill` |
|
|
75
|
+
| Human-approval gate | Action | High-impact/irreversible actions | [gate definition] |
|
|
76
|
+
|
|
77
|
+
---
|
|
78
|
+
|
|
79
|
+
## 5. Evaluation and Red-Team Results
|
|
80
|
+
|
|
81
|
+
### Functional evaluation
|
|
82
|
+
| Metric | Result | Bar | Pass? |
|
|
83
|
+
|---|---|---|---|
|
|
84
|
+
| [METRIC_1] | [value] | [target] | [Y/N] |
|
|
85
|
+
| [METRIC_2] | [value] | [target] | [Y/N] |
|
|
86
|
+
|
|
87
|
+
### Red-team / ASR scorecard
|
|
88
|
+
<!-- Reference ai-red-teaming.skill. ASR = attack-success-rate. -->
|
|
89
|
+
|
|
90
|
+
| OWASP category | Technique | Attempts | Successes | ASR | Gate threshold | Pass? |
|
|
91
|
+
|---|---|---|---|---|---|---|
|
|
92
|
+
| LLM01 | Direct injection | [N] | [N] | [%] | [%] | [Y/N] |
|
|
93
|
+
| LLM01 | Indirect injection | [N] | [N] | [%] | [%] | [Y/N] |
|
|
94
|
+
| LLM06 | Tool abuse | [N] | [N] | [%] | [%] | [Y/N] |
|
|
95
|
+
| [category] | [technique] | | | | | |
|
|
96
|
+
|
|
97
|
+
> Honesty statement: a passing red-team run means no successful attack in this suite as of [DATE]; it does not prove the system is safe. See `ai-red-teaming.skill`.
|
|
98
|
+
|
|
99
|
+
---
|
|
100
|
+
|
|
101
|
+
## 6. Human Oversight and Escalation
|
|
102
|
+
|
|
103
|
+
- **Where a human is in the loop**: [decision points requiring human approval]
|
|
104
|
+
- **Escalation triggers**: [low confidence, guardrail trip, high-impact action, anomaly]
|
|
105
|
+
- **Who responds**: [role/on-call]
|
|
106
|
+
- **Override / kill switch**: [how to disable or roll back the system]
|
|
107
|
+
|
|
108
|
+
---
|
|
109
|
+
|
|
110
|
+
## 7. Monitoring and Incident Response
|
|
111
|
+
|
|
112
|
+
| Field | Value |
|
|
113
|
+
|---|---|
|
|
114
|
+
| What is monitored | [latency, refusal rate, guardrail trips, ASR drift, cost, output anomalies] |
|
|
115
|
+
| Telemetry standard | [e.g. OTel GenAI conventions] |
|
|
116
|
+
| Alert thresholds | [thresholds and owners] |
|
|
117
|
+
| Incident runbook | [reference] |
|
|
118
|
+
| Logging & attribution | [what is logged, against which agent identity] |
|
|
119
|
+
| Retention | [log retention period] |
|
|
120
|
+
|
|
121
|
+
---
|
|
122
|
+
|
|
123
|
+
## 8. Known Limitations
|
|
124
|
+
|
|
125
|
+
| Limitation | Impact | Guidance |
|
|
126
|
+
|---|---|---|
|
|
127
|
+
| [Limitation 1] | [impact] | [how to compensate] |
|
|
128
|
+
| [Limitation 2] | [impact] | [guidance] |
|
|
129
|
+
| Prompt injection cannot be fully eliminated | Residual risk of manipulated actions | Keep HITL gates on high-impact actions |
|
|
130
|
+
|
|
131
|
+
---
|
|
132
|
+
|
|
133
|
+
## 9. Sign-off
|
|
134
|
+
|
|
135
|
+
| Role | Name | Status | Date |
|
|
136
|
+
|---|---|---|---|
|
|
137
|
+
| System owner | [name] | [APPROVED / PENDING] | [date] |
|
|
138
|
+
| Security reviewer | [name] | [APPROVED / PENDING] | [date] |
|
|
139
|
+
| Responsible-AI / Ethics reviewer | [name] | [APPROVED / PENDING] | [date] |
|