contextos-agents 1.5.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.agents/AGENTS.md +421 -0
- package/.agents/adapters/aider/export.js +137 -0
- package/.agents/adapters/claude/export.js +55 -0
- package/.agents/adapters/copilot/export.js +107 -0
- package/.agents/adapters/cursor/export.js +210 -0
- package/.agents/adapters/gemini/export.js +115 -0
- package/.agents/adapters/shared.js +119 -0
- package/.agents/adapters/zed/export.js +111 -0
- package/.agents/core/profiles/backend.yaml +47 -0
- package/.agents/core/profiles/enterprise.yaml +46 -0
- package/.agents/core/profiles/frontend.yaml +46 -0
- package/.agents/core/profiles/hackathon.yaml +45 -0
- package/.agents/core/profiles/mvp.yaml +43 -0
- package/.agents/core/profiles/startup.yaml +48 -0
- package/.agents/core/skills/adapters/EXAMPLES.md +19 -0
- package/.agents/core/skills/adapters/SKILL.md +105 -0
- package/.agents/core/skills/adapters/TROUBLESHOOTING.md +7 -0
- package/.agents/core/skills/adapters/VALIDATION.json +12 -0
- package/.agents/core/skills/adapters/skill.yaml +10 -0
- package/.agents/core/skills/architecture-diagrams/SKILL.md +108 -0
- package/.agents/core/skills/architecture-diagrams/VALIDATION.json +12 -0
- package/.agents/core/skills/architecture-diagrams/skill.yaml +8 -0
- package/.agents/core/skills/brutalist-design/SKILL.md +150 -0
- package/.agents/core/skills/brutalist-design/VALIDATION.json +12 -0
- package/.agents/core/skills/brutalist-design/skill.yaml +8 -0
- package/.agents/core/skills/context-manager/EXAMPLES.md +19 -0
- package/.agents/core/skills/context-manager/SKILL.md +126 -0
- package/.agents/core/skills/context-manager/TROUBLESHOOTING.md +7 -0
- package/.agents/core/skills/context-manager/VALIDATION.json +12 -0
- package/.agents/core/skills/context-manager/skill.yaml +10 -0
- package/.agents/core/skills/context-os/EXAMPLES.md +21 -0
- package/.agents/core/skills/context-os/SKILL.md +169 -0
- package/.agents/core/skills/context-os/TROUBLESHOOTING.md +7 -0
- package/.agents/core/skills/context-os/VALIDATION.json +12 -0
- package/.agents/core/skills/context-os/packs.yaml +59 -0
- package/.agents/core/skills/context-os/references/context-rules.md +68 -0
- package/.agents/core/skills/context-os/references/pipeline.md +119 -0
- package/.agents/core/skills/context-os/references/project-graph.md +103 -0
- package/.agents/core/skills/context-os/rules.yaml +135 -0
- package/.agents/core/skills/context-os/skill.yaml +10 -0
- package/.agents/core/skills/database/EXAMPLES.md +74 -0
- package/.agents/core/skills/database/SKILL.md +101 -0
- package/.agents/core/skills/database/TROUBLESHOOTING.md +18 -0
- package/.agents/core/skills/database/VALIDATION.json +11 -0
- package/.agents/core/skills/database/skill.yaml +25 -0
- package/.agents/core/skills/ddd/EXAMPLES.md +42 -0
- package/.agents/core/skills/ddd/SKILL.md +247 -0
- package/.agents/core/skills/ddd/TROUBLESHOOTING.md +19 -0
- package/.agents/core/skills/ddd/VALIDATION.json +12 -0
- package/.agents/core/skills/ddd/ddd.md +178 -0
- package/.agents/core/skills/ddd/skill.yaml +10 -0
- package/.agents/core/skills/decisions/EXAMPLES.md +35 -0
- package/.agents/core/skills/decisions/SKILL.md +90 -0
- package/.agents/core/skills/decisions/TROUBLESHOOTING.md +13 -0
- package/.agents/core/skills/decisions/VALIDATION.json +12 -0
- package/.agents/core/skills/decisions/skill.yaml +10 -0
- package/.agents/core/skills/docker/EXAMPLES.md +56 -0
- package/.agents/core/skills/docker/SKILL.md +63 -0
- package/.agents/core/skills/docker/TROUBLESHOOTING.md +18 -0
- package/.agents/core/skills/docker/VALIDATION.json +11 -0
- package/.agents/core/skills/docker/skill.yaml +23 -0
- package/.agents/core/skills/engineering-workflow/EXAMPLES.md +57 -0
- package/.agents/core/skills/engineering-workflow/SKILL.md +343 -0
- package/.agents/core/skills/engineering-workflow/TROUBLESHOOTING.md +19 -0
- package/.agents/core/skills/engineering-workflow/VALIDATION.json +12 -0
- package/.agents/core/skills/engineering-workflow/skill.yaml +13 -0
- package/.agents/core/skills/fastapi/EXAMPLES.md +36 -0
- package/.agents/core/skills/fastapi/SKILL.md +148 -0
- package/.agents/core/skills/fastapi/TROUBLESHOOTING.md +19 -0
- package/.agents/core/skills/fastapi/VALIDATION.json +12 -0
- package/.agents/core/skills/fastapi/fastapi.md +112 -0
- package/.agents/core/skills/fastapi/skill.yaml +10 -0
- package/.agents/core/skills/gemini-precision/SKILL.md +169 -0
- package/.agents/core/skills/gemini-precision/VALIDATION.json +12 -0
- package/.agents/core/skills/gemini-precision/skill.yaml +9 -0
- package/.agents/core/skills/generators/EXAMPLES.md +19 -0
- package/.agents/core/skills/generators/SKILL.md +112 -0
- package/.agents/core/skills/generators/TROUBLESHOOTING.md +7 -0
- package/.agents/core/skills/generators/VALIDATION.json +12 -0
- package/.agents/core/skills/generators/skill.yaml +10 -0
- package/.agents/core/skills/generators/templates/API.md +77 -0
- package/.agents/core/skills/generators/templates/ARCHITECTURE.md +70 -0
- package/.agents/core/skills/generators/templates/DATABASE.md +42 -0
- package/.agents/core/skills/generators/templates/DECISION.md +46 -0
- package/.agents/core/skills/generators/templates/PRD.md +67 -0
- package/.agents/core/skills/generators/templates/PROJECT_GRAPH.md +56 -0
- package/.agents/core/skills/generators/templates/ROADMAP.md +51 -0
- package/.agents/core/skills/generators/templates/TASKS.md +43 -0
- package/.agents/core/skills/generators/templates/UI.md +73 -0
- package/.agents/core/skills/graphify/EXAMPLES.md +73 -0
- package/.agents/core/skills/graphify/SKILL.md +130 -0
- package/.agents/core/skills/graphify/VALIDATION.json +12 -0
- package/.agents/core/skills/graphify/skill.yaml +13 -0
- package/.agents/core/skills/gstack-roles/EXAMPLES.md +23 -0
- package/.agents/core/skills/gstack-roles/SKILL.md +152 -0
- package/.agents/core/skills/gstack-roles/TROUBLESHOOTING.md +13 -0
- package/.agents/core/skills/gstack-roles/VALIDATION.json +12 -0
- package/.agents/core/skills/gstack-roles/skill.yaml +12 -0
- package/.agents/core/skills/impeccable-design/EXAMPLES.md +26 -0
- package/.agents/core/skills/impeccable-design/SKILL.md +201 -0
- package/.agents/core/skills/impeccable-design/TROUBLESHOOTING.md +19 -0
- package/.agents/core/skills/impeccable-design/VALIDATION.json +12 -0
- package/.agents/core/skills/impeccable-design/skill.yaml +14 -0
- package/.agents/core/skills/interview-me/SKILL.md +97 -0
- package/.agents/core/skills/interview-me/VALIDATION.json +12 -0
- package/.agents/core/skills/interview-me/skill.yaml +8 -0
- package/.agents/core/skills/microservices/EXAMPLES.md +38 -0
- package/.agents/core/skills/microservices/SKILL.md +164 -0
- package/.agents/core/skills/microservices/TROUBLESHOOTING.md +19 -0
- package/.agents/core/skills/microservices/VALIDATION.json +12 -0
- package/.agents/core/skills/microservices/microservices.md +119 -0
- package/.agents/core/skills/microservices/skill.yaml +10 -0
- package/.agents/core/skills/minimalist-design/SKILL.md +113 -0
- package/.agents/core/skills/minimalist-design/VALIDATION.json +12 -0
- package/.agents/core/skills/minimalist-design/skill.yaml +8 -0
- package/.agents/core/skills/nestjs/EXAMPLES.md +40 -0
- package/.agents/core/skills/nestjs/SKILL.md +139 -0
- package/.agents/core/skills/nestjs/TROUBLESHOOTING.md +19 -0
- package/.agents/core/skills/nestjs/VALIDATION.json +12 -0
- package/.agents/core/skills/nestjs/nestjs.md +103 -0
- package/.agents/core/skills/nestjs/skill.yaml +10 -0
- package/.agents/core/skills/nextjs/EXAMPLES.md +40 -0
- package/.agents/core/skills/nextjs/SKILL.md +163 -0
- package/.agents/core/skills/nextjs/TROUBLESHOOTING.md +19 -0
- package/.agents/core/skills/nextjs/VALIDATION.json +12 -0
- package/.agents/core/skills/nextjs/nextjs.md +67 -0
- package/.agents/core/skills/nextjs/skill.yaml +10 -0
- package/.agents/core/skills/node/EXAMPLES.md +80 -0
- package/.agents/core/skills/node/SKILL.md +128 -0
- package/.agents/core/skills/node/TROUBLESHOOTING.md +19 -0
- package/.agents/core/skills/node/VALIDATION.json +12 -0
- package/.agents/core/skills/node/node.md +87 -0
- package/.agents/core/skills/node/skill.yaml +10 -0
- package/.agents/core/skills/performance/EXAMPLES.md +30 -0
- package/.agents/core/skills/performance/SKILL.md +75 -0
- package/.agents/core/skills/performance/TROUBLESHOOTING.md +19 -0
- package/.agents/core/skills/performance/VALIDATION.json +12 -0
- package/.agents/core/skills/performance/performance.md +52 -0
- package/.agents/core/skills/performance/skill.yaml +10 -0
- package/.agents/core/skills/ponytail-mindset/EXAMPLES.md +45 -0
- package/.agents/core/skills/ponytail-mindset/SKILL.md +193 -0
- package/.agents/core/skills/ponytail-mindset/TROUBLESHOOTING.md +19 -0
- package/.agents/core/skills/ponytail-mindset/VALIDATION.json +12 -0
- package/.agents/core/skills/ponytail-mindset/skill.yaml +14 -0
- package/.agents/core/skills/react/EXAMPLES.md +79 -0
- package/.agents/core/skills/react/SKILL.md +132 -0
- package/.agents/core/skills/react/TROUBLESHOOTING.md +19 -0
- package/.agents/core/skills/react/VALIDATION.json +12 -0
- package/.agents/core/skills/react/react.md +93 -0
- package/.agents/core/skills/react/skill.yaml +10 -0
- package/.agents/core/skills/react-best-practices/SKILL.md +155 -0
- package/.agents/core/skills/react-best-practices/VALIDATION.json +12 -0
- package/.agents/core/skills/react-best-practices/skill.yaml +10 -0
- package/.agents/core/skills/redesign-audit/SKILL.md +117 -0
- package/.agents/core/skills/redesign-audit/VALIDATION.json +12 -0
- package/.agents/core/skills/redesign-audit/skill.yaml +8 -0
- package/.agents/core/skills/security/EXAMPLES.md +64 -0
- package/.agents/core/skills/security/SKILL.md +158 -0
- package/.agents/core/skills/security/TROUBLESHOOTING.md +19 -0
- package/.agents/core/skills/security/VALIDATION.json +12 -0
- package/.agents/core/skills/security/security.md +106 -0
- package/.agents/core/skills/security/skill.yaml +10 -0
- package/.agents/core/skills/soft-design/SKILL.md +108 -0
- package/.agents/core/skills/soft-design/VALIDATION.json +12 -0
- package/.agents/core/skills/soft-design/skill.yaml +8 -0
- package/.agents/core/skills/state-management/EXAMPLES.md +56 -0
- package/.agents/core/skills/state-management/SKILL.md +48 -0
- package/.agents/core/skills/state-management/TROUBLESHOOTING.md +18 -0
- package/.agents/core/skills/state-management/VALIDATION.json +11 -0
- package/.agents/core/skills/state-management/skill.yaml +22 -0
- package/.agents/core/skills/subagent-orchestrator/SKILL.md +100 -0
- package/.agents/core/skills/subagent-orchestrator/VALIDATION.json +12 -0
- package/.agents/core/skills/subagent-orchestrator/skill.yaml +8 -0
- package/.agents/core/skills/system-design/EXAMPLES.md +75 -0
- package/.agents/core/skills/system-design/SKILL.md +419 -0
- package/.agents/core/skills/system-design/TROUBLESHOOTING.md +19 -0
- package/.agents/core/skills/system-design/VALIDATION.json +12 -0
- package/.agents/core/skills/system-design/skill.yaml +13 -0
- package/.agents/core/skills/system-design/system-design.md +112 -0
- package/.agents/core/skills/testing/EXAMPLES.md +71 -0
- package/.agents/core/skills/testing/SKILL.md +70 -0
- package/.agents/core/skills/testing/TROUBLESHOOTING.md +18 -0
- package/.agents/core/skills/testing/VALIDATION.json +11 -0
- package/.agents/core/skills/testing/skill.yaml +26 -0
- package/.agents/core/skills/typescript/EXAMPLES.md +64 -0
- package/.agents/core/skills/typescript/SKILL.md +112 -0
- package/.agents/core/skills/typescript/TROUBLESHOOTING.md +19 -0
- package/.agents/core/skills/typescript/VALIDATION.json +12 -0
- package/.agents/core/skills/typescript/skill.yaml +10 -0
- package/.agents/core/skills/typescript/typescript.md +71 -0
- package/.agents/core/skills/ui-design/EXAMPLES.md +21 -0
- package/.agents/core/skills/ui-design/SKILL.md +124 -0
- package/.agents/core/skills/ui-design/TROUBLESHOOTING.md +19 -0
- package/.agents/core/skills/ui-design/VALIDATION.json +12 -0
- package/.agents/core/skills/ui-design/skill.yaml +10 -0
- package/.agents/core/skills/ui-design/ui.md +88 -0
- package/.agents/core/skills/ui-ux-pro/EXAMPLES.md +62 -0
- package/.agents/core/skills/ui-ux-pro/SKILL.md +375 -0
- package/.agents/core/skills/ui-ux-pro/TROUBLESHOOTING.md +19 -0
- package/.agents/core/skills/ui-ux-pro/VALIDATION.json +12 -0
- package/.agents/core/skills/ui-ux-pro/skill.yaml +13 -0
- package/.agents/core/skills/ux-design/EXAMPLES.md +36 -0
- package/.agents/core/skills/ux-design/SKILL.md +116 -0
- package/.agents/core/skills/ux-design/TROUBLESHOOTING.md +19 -0
- package/.agents/core/skills/ux-design/VALIDATION.json +12 -0
- package/.agents/core/skills/ux-design/skill.yaml +10 -0
- package/.agents/core/skills/ux-design/ux.md +80 -0
- package/.agents/core/skills/vercel-optimize/SKILL.md +83 -0
- package/.agents/core/skills/vercel-optimize/VALIDATION.json +12 -0
- package/.agents/core/skills/vercel-optimize/skill.yaml +10 -0
- package/.agents/core/skills/web-accessibility/EXAMPLES.md +39 -0
- package/.agents/core/skills/web-accessibility/SKILL.md +170 -0
- package/.agents/core/skills/web-accessibility/TROUBLESHOOTING.md +19 -0
- package/.agents/core/skills/web-accessibility/VALIDATION.json +12 -0
- package/.agents/core/skills/web-accessibility/accessibility.md +63 -0
- package/.agents/core/skills/web-accessibility/skill.yaml +10 -0
- package/.agents/ctx.js +370 -0
- package/.agents/generated/claude/skills/adapters/SKILL.md +126 -0
- package/.agents/generated/claude/skills/architecture-diagrams/SKILL.md +101 -0
- package/.agents/generated/claude/skills/brutalist-design/SKILL.md +145 -0
- package/.agents/generated/claude/skills/context-manager/SKILL.md +147 -0
- package/.agents/generated/claude/skills/context-os/SKILL.md +191 -0
- package/.agents/generated/claude/skills/database/SKILL.md +191 -0
- package/.agents/generated/claude/skills/ddd/SKILL.md +305 -0
- package/.agents/generated/claude/skills/decisions/SKILL.md +134 -0
- package/.agents/generated/claude/skills/docker/SKILL.md +135 -0
- package/.agents/generated/claude/skills/engineering-workflow/SKILL.md +414 -0
- package/.agents/generated/claude/skills/fastapi/SKILL.md +200 -0
- package/.agents/generated/claude/skills/gemini-precision/SKILL.md +161 -0
- package/.agents/generated/claude/skills/generators/SKILL.md +133 -0
- package/.agents/generated/claude/skills/graphify/SKILL.md +198 -0
- package/.agents/generated/claude/skills/gstack-roles/SKILL.md +184 -0
- package/.agents/generated/claude/skills/impeccable-design/SKILL.md +241 -0
- package/.agents/generated/claude/skills/interview-me/SKILL.md +90 -0
- package/.agents/generated/claude/skills/microservices/SKILL.md +218 -0
- package/.agents/generated/claude/skills/minimalist-design/SKILL.md +108 -0
- package/.agents/generated/claude/skills/nestjs/SKILL.md +195 -0
- package/.agents/generated/claude/skills/nextjs/SKILL.md +219 -0
- package/.agents/generated/claude/skills/node/SKILL.md +224 -0
- package/.agents/generated/claude/skills/performance/SKILL.md +121 -0
- package/.agents/generated/claude/skills/ponytail-mindset/SKILL.md +252 -0
- package/.agents/generated/claude/skills/react/SKILL.md +227 -0
- package/.agents/generated/claude/skills/react-best-practices/SKILL.md +146 -0
- package/.agents/generated/claude/skills/redesign-audit/SKILL.md +112 -0
- package/.agents/generated/claude/skills/security/SKILL.md +237 -0
- package/.agents/generated/claude/skills/soft-design/SKILL.md +103 -0
- package/.agents/generated/claude/skills/state-management/SKILL.md +120 -0
- package/.agents/generated/claude/skills/subagent-orchestrator/SKILL.md +93 -0
- package/.agents/generated/claude/skills/system-design/SKILL.md +507 -0
- package/.agents/generated/claude/skills/testing/SKILL.md +157 -0
- package/.agents/generated/claude/skills/typescript/SKILL.md +192 -0
- package/.agents/generated/claude/skills/ui-design/SKILL.md +161 -0
- package/.agents/generated/claude/skills/ui-ux-pro/SKILL.md +451 -0
- package/.agents/generated/claude/skills/ux-design/SKILL.md +168 -0
- package/.agents/generated/claude/skills/vercel-optimize/SKILL.md +76 -0
- package/.agents/generated/claude/skills/web-accessibility/SKILL.md +225 -0
- package/.agents/generated/gemini/skills/adapters/SKILL.md +135 -0
- package/.agents/generated/gemini/skills/architecture-diagrams/SKILL.md +107 -0
- package/.agents/generated/gemini/skills/brutalist-design/SKILL.md +151 -0
- package/.agents/generated/gemini/skills/context-manager/SKILL.md +156 -0
- package/.agents/generated/gemini/skills/context-os/SKILL.md +200 -0
- package/.agents/generated/gemini/skills/database/SKILL.md +200 -0
- package/.agents/generated/gemini/skills/ddd/SKILL.md +314 -0
- package/.agents/generated/gemini/skills/decisions/SKILL.md +143 -0
- package/.agents/generated/gemini/skills/docker/SKILL.md +144 -0
- package/.agents/generated/gemini/skills/engineering-workflow/SKILL.md +423 -0
- package/.agents/generated/gemini/skills/fastapi/SKILL.md +209 -0
- package/.agents/generated/gemini/skills/gemini-precision/SKILL.md +167 -0
- package/.agents/generated/gemini/skills/generators/SKILL.md +142 -0
- package/.agents/generated/gemini/skills/graphify/SKILL.md +205 -0
- package/.agents/generated/gemini/skills/gstack-roles/SKILL.md +193 -0
- package/.agents/generated/gemini/skills/impeccable-design/SKILL.md +250 -0
- package/.agents/generated/gemini/skills/interview-me/SKILL.md +96 -0
- package/.agents/generated/gemini/skills/microservices/SKILL.md +227 -0
- package/.agents/generated/gemini/skills/minimalist-design/SKILL.md +114 -0
- package/.agents/generated/gemini/skills/nestjs/SKILL.md +204 -0
- package/.agents/generated/gemini/skills/nextjs/SKILL.md +298 -0
- package/.agents/generated/gemini/skills/node/SKILL.md +323 -0
- package/.agents/generated/gemini/skills/performance/SKILL.md +185 -0
- package/.agents/generated/gemini/skills/ponytail-mindset/SKILL.md +261 -0
- package/.agents/generated/gemini/skills/react/SKILL.md +332 -0
- package/.agents/generated/gemini/skills/react-best-practices/SKILL.md +152 -0
- package/.agents/generated/gemini/skills/redesign-audit/SKILL.md +118 -0
- package/.agents/generated/gemini/skills/security/SKILL.md +355 -0
- package/.agents/generated/gemini/skills/soft-design/SKILL.md +109 -0
- package/.agents/generated/gemini/skills/state-management/SKILL.md +129 -0
- package/.agents/generated/gemini/skills/subagent-orchestrator/SKILL.md +99 -0
- package/.agents/generated/gemini/skills/system-design/SKILL.md +631 -0
- package/.agents/generated/gemini/skills/testing/SKILL.md +166 -0
- package/.agents/generated/gemini/skills/typescript/SKILL.md +275 -0
- package/.agents/generated/gemini/skills/ui-design/SKILL.md +170 -0
- package/.agents/generated/gemini/skills/ui-ux-pro/SKILL.md +460 -0
- package/.agents/generated/gemini/skills/ux-design/SKILL.md +177 -0
- package/.agents/generated/gemini/skills/vercel-optimize/SKILL.md +82 -0
- package/.agents/generated/gemini/skills/web-accessibility/SKILL.md +300 -0
- package/.agents/mcp/runtime.py +454 -0
- package/.agents/mcp/server.mjs +189373 -0
- package/.agents/plugins.js +574 -0
- package/.agents/profiles.js +267 -0
- package/.agents/resolver.js +336 -0
- package/.agents/skills-index.json +200 -0
- package/.agents/skills.json +6 -0
- package/.agents/validate.js +500 -0
- package/LICENSE +21 -0
- package/README.md +415 -0
- package/benchmarks/gemini-issues.js +533 -0
- package/bin/index.js +458 -0
- package/package.json +70 -0
- package/registry.json +53 -0
- package/registry.schema.json +32 -0
package/README.md
ADDED
|
@@ -0,0 +1,415 @@
|
|
|
1
|
+
# <img src="./Frame%202.png" height="40" align="absmiddle" /> contextos-agents
|
|
2
|
+
|
|
3
|
+
[](https://www.npmjs.com/package/contextos-agents)
|
|
4
|
+
[](https://opensource.org/licenses/MIT)
|
|
5
|
+
[](https://nodejs.org/)
|
|
6
|
+
[](#testing)
|
|
7
|
+
|
|
8
|
+
This is an open-source set of skills and behavioral rules for AI assistants. The package automatically installs an `.agents` folder into your project, teaching your AI assistant software development best practices (UI Design, Architecture, Security, and more).
|
|
9
|
+
|
|
10
|
+
## Installation
|
|
11
|
+
|
|
12
|
+
You do not need to clone anything manually. Just open your terminal in the root of your project and run:
|
|
13
|
+
|
|
14
|
+
```bash
|
|
15
|
+
npx contextos-agents
|
|
16
|
+
```
|
|
17
|
+
|
|
18
|
+
The script will automatically detect your project tech stack, create the `.agents` folder, configure skills, and compile them for your AI agent.
|
|
19
|
+
|
|
20
|
+
### Options
|
|
21
|
+
|
|
22
|
+
```bash
|
|
23
|
+
npx contextos-agents --help # Show all options
|
|
24
|
+
npx contextos-agents --version # Show version
|
|
25
|
+
npx contextos-agents --profile mvp # Install with specific profile (mvp, startup, enterprise, frontend, backend)
|
|
26
|
+
npx contextos-agents --auto # Auto-detect tech stack and apply recommended profile
|
|
27
|
+
npx contextos-agents --with-mcp # Install with MCP execution server enabled (.agents/mcp/)
|
|
28
|
+
npx contextos-agents setup-mcp # Add MCP server to an existing .agents/ project
|
|
29
|
+
npx contextos-agents --dry-run # Preview what will be installed
|
|
30
|
+
npx contextos-agents --force # Overwrite an existing .agents/ folder
|
|
31
|
+
npx contextos-agents --skip-compile # Skip auto-compilation step
|
|
32
|
+
```
|
|
33
|
+
|
|
34
|
+
## Why ContextOS?
|
|
35
|
+
|
|
36
|
+
Most AI coding assistants suffer from two extremes: they either operate in a vacuum with zero knowledge of your architectural standards, or they are choked with massive monolithic system prompts that cause context overflow, hallucinated dependencies, and lazy code stubs (`// TODO`).
|
|
37
|
+
|
|
38
|
+
**ContextOS transforms chaotic AI code generation into a disciplined, senior-level software engineering team.**
|
|
39
|
+
|
|
40
|
+
### The Problem vs. The Solution
|
|
41
|
+
|
|
42
|
+
| Without ContextOS (Everyday AI Frustrations) | With ContextOS (Engineering Discipline) |
|
|
43
|
+
|---|---|
|
|
44
|
+
| **Prompt Bloat & Token Waste:** Pasting giant system prompts burns tokens, slows responses, and degrades reasoning. | **Dynamic Context Resolution:** Dynamically resolves only 2–3 required skills per task (`ctx.js resolve`), saving up to 70–80% in prompt tokens. |
|
|
45
|
+
| **Lazy Code & Slop:** Output full of `// TODO: implement later`, missing imports, and broken refactorings. | **Zero-Placeholder Invariant:** Strict guardrails enforce 100% complete, drop-in ready code with verified syntax and error boundaries. |
|
|
46
|
+
| **Tool Zoo Fragmentation:** Inconsistent rules across Cursor (`.cursorrules`), Zed (`.zed/`), Aider, and Claude Code. | **Single Source of Truth:** Author skills once in markdown; ContextOS exports optimized configurations for all major AI editors (`ctx.js export all`). |
|
|
47
|
+
| **Destructive File Rewrites:** Agents overwrite hundreds of lines without reading existing code first. | **Surgical Blast Radius & Sandboxing:** Changes are confined to planned lines or executed safely in isolated Git worktrees via ContextOS MCP. |
|
|
48
|
+
| **"Black Box" Hallucinations:** You only see the start and end, with no insight into the agent's decisions. | **Transparent Pair Programming:** The agent outlines technical decisions, adheres to strict phases (DEFINE → PLAN → BUILD → VERIFY), and proves work with test runs. |
|
|
49
|
+
|
|
50
|
+
### Key Developer Advantages
|
|
51
|
+
|
|
52
|
+
- 🚀 **Zero-Config Onboarding:** Run `npx contextos-agents` in your repository. It auto-detects your stack (React, Node, Python, etc.) and sets up the ideal profile in seconds.
|
|
53
|
+
- 🎯 **Tailored Project Profiles:** Use `mvp` for lean, rapid prototyping without bloated microservices boilerplate, or `enterprise` for strict TDD, DDD, and security auditing.
|
|
54
|
+
- 🛡️ **Autonomous Multi-Agent Worktrees:** Run parallel tasks safely with the bundled MCP server—subagents work in isolated Git worktrees without corrupting your active workspace.
|
|
55
|
+
- 📊 **Verifiable Benchmarks:** Backed by reproducible side-by-side benchmarks demonstrating measurable code quality improvements and reduced token usage.
|
|
56
|
+
|
|
57
|
+
## Project Profiles & Stack Auto-Detection
|
|
58
|
+
|
|
59
|
+
ContextOS allows you to tailor your AI rules to the project lifecycle and architecture:
|
|
60
|
+
|
|
61
|
+
| Profile | Focus | Excluded / Filtered Skills | Ideal For |
|
|
62
|
+
|---|---|---|---|
|
|
63
|
+
| `mvp` | Maximum speed & minimalism | `microservices`, `ddd`, `cqrs`, `kubernetes` | Hackathons, prototypes, fast validation |
|
|
64
|
+
| `startup` | Balanced agile stack | `microservices`, `kubernetes` | SaaS startups, modular monoliths |
|
|
65
|
+
| `enterprise` | Maximum rigor & compliance | _(none)_ — full TDD, DDD, Security Audit | Large scale teams, strict audit requirements |
|
|
66
|
+
| `frontend` | Dedicated UI/UX & React | `fastapi`, `nestjs`, `microservices`, `ddd` | Next.js, React, Design systems, SPAs |
|
|
67
|
+
| `backend` | Server-side & APIs | `ui-ux-pro`, `impeccable-design`, `ui-design` | API servers, microservices, databases |
|
|
68
|
+
|
|
69
|
+
### Profile Commands
|
|
70
|
+
|
|
71
|
+
```bash
|
|
72
|
+
# Auto-detect tech stack in the current project
|
|
73
|
+
node .agents/ctx.js detect
|
|
74
|
+
|
|
75
|
+
# List available profiles and current active profile
|
|
76
|
+
node .agents/ctx.js profile list
|
|
77
|
+
|
|
78
|
+
# Apply a profile
|
|
79
|
+
node .agents/ctx.js profile apply mvp
|
|
80
|
+
|
|
81
|
+
# Recompile all agent exports for the active profile
|
|
82
|
+
node .agents/ctx.js export all
|
|
83
|
+
```
|
|
84
|
+
|
|
85
|
+
## What's Inside?
|
|
86
|
+
|
|
87
|
+
### Master Orchestrator
|
|
88
|
+
|
|
89
|
+
- **AGENTS.md** — The core ruleset. Automatically routes skills by task type and technology detected in your codebase.
|
|
90
|
+
|
|
91
|
+
### Skills (39 total)
|
|
92
|
+
|
|
93
|
+
| Category | Skill | What It Does |
|
|
94
|
+
| ---------- | ------- | ------------- |
|
|
95
|
+
| Core | `engineering-workflow` | Enforces DEFINE→PLAN→BUILD→VERIFY→REVIEW→SHIP pipeline and slash commands |
|
|
96
|
+
| Core | `gstack-roles` | 23 specialist roles (PM, Architect, QA Lead, etc.) — AI declares its role before each task |
|
|
97
|
+
| Core | `ponytail-mindset` | 7-rung decision ladder before writing any code. Eliminates premature abstraction |
|
|
98
|
+
| Core | `interview-me` | Progressive single-question requirements elicitation before drafting specs |
|
|
99
|
+
| Core | `subagent-orchestrator` | Multi-agent task decomposition, context boundary isolation, and merge synthesis |
|
|
100
|
+
| Core | `gemini-precision` | High-precision engineering guardrails, zero-assumption verification, and zero-placeholder output |
|
|
101
|
+
| Frontend | `ui-ux-pro` | Planning guide for UI: color systems, typography, Tailwind v4 `@theme`, Framer Motion |
|
|
102
|
+
| Frontend | `impeccable-design` | 50 deterministic QA rules for design review (typography, color, layout, animation) |
|
|
103
|
+
| Frontend | `react` | Modern React 19, concurrency, state colocation, `useOptimistic`, and render optimization |
|
|
104
|
+
| Frontend | `react-best-practices` | Vercel engineering standards, eliminating async waterfalls, bundle trace optimization |
|
|
105
|
+
| Frontend | `nextjs` | Next.js 15+ App Router, RSC, `after()`, `React.cache()`, Server Actions, and PPR |
|
|
106
|
+
| Frontend | `typescript` | Type-safe code, generics, config, and invariant type assertions |
|
|
107
|
+
| Frontend | `state-management` | Zustand, TanStack Query, client/server state separation |
|
|
108
|
+
| Frontend | `ui-design` | Component library design, design tokens, and shadcn/ui patterns |
|
|
109
|
+
| Frontend | `ux-design` | User flow design, interaction patterns, and user journey optimization |
|
|
110
|
+
| Frontend | `web-accessibility` | ARIA dialogs, focus traps, WCAG 2.1 compliance, and `:focus-visible` standards |
|
|
111
|
+
| Frontend | `brutalist-design` | Raw mechanical interfaces, Swiss print typography, and high-contrast styling |
|
|
112
|
+
| Frontend | `minimalist-design` | Clean, content-first editorial interfaces with generous negative space |
|
|
113
|
+
| Frontend | `soft-design` | Warm, low-contrast premium surfaces with subtle atmospheric depth |
|
|
114
|
+
| Frontend | `redesign-audit` | Systematic UI codebase auditing and refactoring without breaking existing features |
|
|
115
|
+
| Backend | `system-design` | DDIA patterns (Outbox, CDC, Idempotency), serverless pooling, and CAP trade-offs |
|
|
116
|
+
| Backend | `database` | Zero-downtime migrations (expand/contract), PostgreSQL indexing, and serverless pooling |
|
|
117
|
+
| Backend | `node` | Node.js asynchronous event loop and server runtime best practices |
|
|
118
|
+
| Backend | `fastapi` | FastAPI and Pydantic v2 high-performance Python backends |
|
|
119
|
+
| Backend | `nestjs` | Enterprise modular backend architecture and dependency injection |
|
|
120
|
+
| Backend | `microservices` | Service boundaries, Saga orchestration/choreography, and Dead Letter Queues |
|
|
121
|
+
| Backend | `ddd` | Domain-Driven Design, Aggregate invariants, Domain Events, and Clean Architecture |
|
|
122
|
+
| Cross | `security` | Zero-trust auth, OWASP API Top 10, SSRF IP blocking, and Prompt Injection defense |
|
|
123
|
+
| Cross | `performance` | Core Web Vitals 2026 (INP < 200ms, LCP < 2.5s), waterfall elimination |
|
|
124
|
+
| Cross | `vercel-optimize` | Edge caching, stale-while-revalidate, and Vercel platform optimizations |
|
|
125
|
+
| Cross | `testing` | Vitest, React Testing Library behavior testing, and Playwright E2E suites |
|
|
126
|
+
| Cross | `docker` | Multi-stage Dockerfiles, non-root security, and container standards |
|
|
127
|
+
| Cross | `decisions` | Architectural Decision Records (ADR) format and evaluation |
|
|
128
|
+
| Cross | `architecture-diagrams` | Animated, interactive SVG/HTML architecture, sequence, and data-flow diagrams |
|
|
129
|
+
| Cross | `adapters` | Multi-agent system export and configuration generation |
|
|
130
|
+
| Cross | `generators` | Automated PRD, Architecture, and Task generation |
|
|
131
|
+
| Cross | `context-manager` | Smart context token selection and optimization |
|
|
132
|
+
| Cross | `context-os` | ContextOS compiler meta-skill |
|
|
133
|
+
| Cross | `graphify` | Codebase knowledge graph, Tree-sitter AST dependency mapping, and blast-radius analysis |
|
|
134
|
+
|
|
135
|
+
## Slash Command Workflows
|
|
136
|
+
|
|
137
|
+
ContextOS maps development phases directly to slash commands in your AI chat:
|
|
138
|
+
|
|
139
|
+
| Command | Role Activated | What It Does |
|
|
140
|
+
|:---|:---|:---|
|
|
141
|
+
| `/spec` | Product Manager | Turn vague ideas into structured requirements and acceptance criteria |
|
|
142
|
+
| `/plan` | Architect | Decompose the spec into atomic, testable tasks (< 2 hours each) |
|
|
143
|
+
| `/build` | Senior Developer | Implement code task-by-task with TDD and minimal blast radius |
|
|
144
|
+
| `/test` | QA Lead | Run unit, integration, and E2E behavioral tests covering edge cases |
|
|
145
|
+
| `/simplify` | Staff Engineer | Run the Ponytail 7-rung ladder to strip over-engineering and dead abstractions |
|
|
146
|
+
| `/review` | Staff Engineer + Designer | 5-axis quality gate (correctness, architecture, security, performance, design) |
|
|
147
|
+
| `/ship` | Release Engineer | Verify clean CI, lint checks, docs, and rollback plan before merging |
|
|
148
|
+
|
|
149
|
+
## Dynamic Skill Resolution & CLI (`ctx.js`)
|
|
150
|
+
|
|
151
|
+
The `.agents/ctx.js` file is the **Context Engine** — it resolves minimal skills on the fly and compiles exports for AI assistants.
|
|
152
|
+
|
|
153
|
+
### Dynamic Skill Resolution (`resolve` & `index`)
|
|
154
|
+
|
|
155
|
+
To prevent context bloat, ContextOS dynamically resolves the exact 2–4 skills needed for any prompt or file:
|
|
156
|
+
|
|
157
|
+
```bash
|
|
158
|
+
# Resolve skills for a task description (English):
|
|
159
|
+
node .agents/ctx.js resolve "Build an accessible modal component with React and Tailwind"
|
|
160
|
+
|
|
161
|
+
# Output:
|
|
162
|
+
# [DOMAIN: Frontend] [PHASE: Build] [ROLE: Senior Developer]
|
|
163
|
+
# Skills loaded: ponytail-mindset, engineering-workflow, react, ui-ux-pro, web-accessibility
|
|
164
|
+
|
|
165
|
+
# Multilingual support (Russian):
|
|
166
|
+
node .agents/ctx.js resolve "создай модальное окно авторизации и напиши юнит-тесты"
|
|
167
|
+
|
|
168
|
+
# Output:
|
|
169
|
+
# [DOMAIN: Frontend] [PHASE: Build] [ROLE: Senior Developer]
|
|
170
|
+
# Skills loaded: ponytail-mindset, engineering-workflow, react, ui-ux-pro, security, testing
|
|
171
|
+
|
|
172
|
+
# Resolve skills based on active files:
|
|
173
|
+
node .agents/ctx.js resolve --files "app/api/auth/route.ts"
|
|
174
|
+
|
|
175
|
+
# Generate/update progressive lightweight skills index:
|
|
176
|
+
node .agents/ctx.js index
|
|
177
|
+
|
|
178
|
+
# Clean up lingering .swarm-worktrees directories and orphaned swarm/* git branches:
|
|
179
|
+
node .agents/ctx.js clean-worktrees
|
|
180
|
+
```
|
|
181
|
+
|
|
182
|
+
### Supported Agents & Compilation
|
|
183
|
+
|
|
184
|
+
| Agent | Command | Output Format |
|
|
185
|
+
|-------|---------|---------------|
|
|
186
|
+
| **Gemini / Antigravity** | `export gemini` | `.agents/generated/gemini/skills/` |
|
|
187
|
+
| **Claude Code** | `export claude` | `.agents/generated/claude/skills/` |
|
|
188
|
+
| **Cursor IDE** | `export cursor` | `.cursor/rules/*.mdc` (modular globs) + `.cursorrules` |
|
|
189
|
+
| **GitHub Copilot** | `export copilot` | `.github/copilot-instructions.md` |
|
|
190
|
+
| **Aider** | `export aider` | `.aider.conf.yml` + `CONVENTIONS.md` |
|
|
191
|
+
| **Zed IDE** | `export zed` | `.zed/rules.md` + `.zed/prompts/*.md` |
|
|
192
|
+
|
|
193
|
+
```bash
|
|
194
|
+
node .agents/ctx.js export all # Compile for all agents
|
|
195
|
+
node .agents/ctx.js export gemini # Compile for Gemini / Antigravity
|
|
196
|
+
node .agents/ctx.js export claude # Compile for Claude Code
|
|
197
|
+
node .agents/ctx.js export cursor # Compile for Cursor (.cursor/rules/*.mdc)
|
|
198
|
+
node .agents/ctx.js export copilot # Compile for GitHub Copilot
|
|
199
|
+
node .agents/ctx.js export aider # Compile for Aider
|
|
200
|
+
node .agents/ctx.js export zed # Compile for Zed IDE
|
|
201
|
+
```
|
|
202
|
+
|
|
203
|
+
### Pre-Compiled Artifacts & Git Architecture
|
|
204
|
+
|
|
205
|
+
ContextOS commits generated adapter configurations (`.cursorrules`, `.cursor/rules/*.mdc`, `.github/copilot-instructions.md`, `.aider.conf.yml`, `CONVENTIONS.md`, `.zed/rules.md`) directly into Git:
|
|
206
|
+
|
|
207
|
+
- **Zero-Build Onboarding:** AI assistants (Cursor, Claude Code, GitHub Copilot, Zed, Aider) activate instantly upon repository clone without requiring `npm install` or separate build steps.
|
|
208
|
+
- **Git-Native Context:** Assistant engines index project rules using native file matchers and git tree walking without depending on background daemon processes.
|
|
209
|
+
- **Automated Sync & Drift Prevention:** CI strictly validates that generated exports match source skills (`node .agents/ctx.js validate`). Any uncommitted adapter drift fails CI checks via `git diff --exit-code`.
|
|
210
|
+
- **Contributor Workflow:** Source rules are authored exclusively in `.agents/core/skills/<name>/SKILL.md`. Running `node .agents/ctx.js export all` regenerates all assistant configurations deterministically.
|
|
211
|
+
|
|
212
|
+
### Plugin Skills & Validation
|
|
213
|
+
|
|
214
|
+
You can expand your `.agents` folder with community plugins or validate your own custom skills using the top-level commands:
|
|
215
|
+
|
|
216
|
+
```bash
|
|
217
|
+
# Launch the interactive skill installer to browse and install community skills
|
|
218
|
+
npx contextos-agents install-skill
|
|
219
|
+
|
|
220
|
+
# Or install a specific skill from a GitHub repository automatically
|
|
221
|
+
npx contextos-agents install-skill --from-repo kok-o/awesome-skill
|
|
222
|
+
|
|
223
|
+
# Validate your local skills (checks frontmatter, dependencies, and sync)
|
|
224
|
+
npx contextos-agents audit
|
|
225
|
+
```
|
|
226
|
+
|
|
227
|
+
## ContextOS MCP Server & Autonomous Multi-Agent Swarm
|
|
228
|
+
|
|
229
|
+
ContextOS includes a standalone **Model Context Protocol (MCP)** execution server located in `contextos-mcp/` and bundled as `.agents/mcp/server.mjs`. It allows orchestrator agents (like Antigravity, Claude Code, or Cursor) to safely delegate coding tasks to parallel subagents running in isolated Git worktrees.
|
|
230
|
+
|
|
231
|
+
> [!TIP]
|
|
232
|
+
> **Lightweight by default:** Standard installation (`npx contextos-agents`) installs only lightweight skills, adapters, and behavioral rules (~400 KB) without copying the bundled MCP runtime. To enable MCP worktrees and subagents, pass `--with-mcp` during installation, or run `npx contextos-agents setup-mcp` at any time.
|
|
233
|
+
|
|
234
|
+
### Installing & Enabling MCP
|
|
235
|
+
|
|
236
|
+
To add the MCP execution server to an existing `.agents/` project:
|
|
237
|
+
|
|
238
|
+
```bash
|
|
239
|
+
npx contextos-agents setup-mcp
|
|
240
|
+
```
|
|
241
|
+
|
|
242
|
+
Or install a new project with MCP enabled from the start:
|
|
243
|
+
|
|
244
|
+
```bash
|
|
245
|
+
npx contextos-agents --with-mcp
|
|
246
|
+
```
|
|
247
|
+
|
|
248
|
+
### MCP Server Configuration
|
|
249
|
+
|
|
250
|
+
Add ContextOS to your IDE's MCP settings (e.g. in `.agents/mcp_config.json`):
|
|
251
|
+
|
|
252
|
+
```json
|
|
253
|
+
{
|
|
254
|
+
"mcpServers": {
|
|
255
|
+
"contextos": {
|
|
256
|
+
"command": "node",
|
|
257
|
+
"args": [
|
|
258
|
+
"./.agents/mcp/server.mjs",
|
|
259
|
+
"--dir",
|
|
260
|
+
"."
|
|
261
|
+
]
|
|
262
|
+
}
|
|
263
|
+
}
|
|
264
|
+
}
|
|
265
|
+
```
|
|
266
|
+
|
|
267
|
+
### Exposed MCP Tools
|
|
268
|
+
|
|
269
|
+
| Tool | Purpose | Key Parameters |
|
|
270
|
+
|---|---|---|
|
|
271
|
+
| `contextos_delegate` | Spawns multiple AI agents in parallel in isolated git worktrees with automatic ContextOS skill injection | `task`, `agents` (model, provider, backend), `wait` (sync/async), `verify_command` (in-worktree test) |
|
|
272
|
+
| `contextos_status` | Inspects thread progress, statuses, and diff summaries from memory and persistent disk journal | `dir`, `task_id`, `thread_id` |
|
|
273
|
+
| `contextos_diff` | Captures unified git diff and changes for a specific thread | `thread_id`, `dir` |
|
|
274
|
+
| `contextos_compare` | Compares multi-agent solutions side-by-side with token cost and execution duration metrics | `thread_ids`, `dir` |
|
|
275
|
+
| `contextos_merge` | Merges completed thread branches back into the main working tree with conflict detection | `thread_id`, `dir`, `delete_branch` |
|
|
276
|
+
| `contextos_cleanup` | Destroys worktrees, frees sessions, and purges orphaned branches and leftover directories | `dir`, `purge_orphans` |
|
|
277
|
+
|
|
278
|
+
### Enterprise Architecture Guarantees
|
|
279
|
+
|
|
280
|
+
- **Git Worktree Sandboxing:** Each subagent operates in a private git worktree (`.swarm-worktrees/`). The developer's active workspace cannot be corrupted by experimental changes or failing tests.
|
|
281
|
+
- **Disk-Backed Session Persistence:** Active and completed threads are recorded in `.swarm-worktrees/session-state.json`. If the MCP process is restarted, tasks and diffs can be recovered without losing work.
|
|
282
|
+
- **Automated In-Worktree Verification (`verify_command`):** Runs test commands (`npm test`, `cargo test`, `pytest`) inside the isolated worktree before marking tasks as successful.
|
|
283
|
+
- **Context Token Compression:** The server extracts essential rules, constraints, and checklists (`extractEssentialSkillContent`), eliminating verbose samples and reducing prompt overhead.
|
|
284
|
+
|
|
285
|
+
## Testing
|
|
286
|
+
|
|
287
|
+
Tests use the **Node.js built-in test runner** for the core framework and **Vitest** for the MCP engine — zero external test bloat.
|
|
288
|
+
|
|
289
|
+
### 1. Root Test Suite (121 tests)
|
|
290
|
+
|
|
291
|
+
```bash
|
|
292
|
+
npm test
|
|
293
|
+
```
|
|
294
|
+
|
|
295
|
+
```text
|
|
296
|
+
# tests 121
|
|
297
|
+
# suites 27
|
|
298
|
+
# pass 121
|
|
299
|
+
# fail 0
|
|
300
|
+
```
|
|
301
|
+
|
|
302
|
+
### 2. MCP Server Test Suite (428 tests)
|
|
303
|
+
|
|
304
|
+
```bash
|
|
305
|
+
cd contextos-mcp && npm test
|
|
306
|
+
```
|
|
307
|
+
|
|
308
|
+
```text
|
|
309
|
+
Test Files 24 passed (24)
|
|
310
|
+
Tests 428 passed (428)
|
|
311
|
+
```
|
|
312
|
+
|
|
313
|
+
**Test coverage:**
|
|
314
|
+
|
|
315
|
+
- `tests/install.test.js` — installer CLI flags (--help, --dry-run, --force)
|
|
316
|
+
- `tests/export.test.js` — ctx.js export for gemini, claude, cursor (.mdc rules), copilot, aider
|
|
317
|
+
- `tests/skills.test.js` — validates all skill source files and frontmatter
|
|
318
|
+
- `tests/profile.test.js` — profile resolution, stack auto-detection, and skill filtering
|
|
319
|
+
- `tests/validate.test.js` — validator rules, dependency graph, and sync checks
|
|
320
|
+
- `tests/plugins.test.js` — plugin lockfile, registry fetching, and security checks
|
|
321
|
+
- `tests/resolver.test.js` — dynamic skill resolution, progressive index, and bilingual prompt matching
|
|
322
|
+
- `tests/benchmark.test.js` — benchmark scoring engine, static AST checks, runtime sandbox, and reporters
|
|
323
|
+
- `contextos-mcp/tests/unit/session-persistence.test.ts` — session disk persistence, thread state tracking, and orphan purge
|
|
324
|
+
- `contextos-mcp/tests/unit/contextos-tools.test.ts` — all 6 MCP tool handlers and validation
|
|
325
|
+
|
|
326
|
+
## Benchmark: With Skills vs. Without Skills
|
|
327
|
+
|
|
328
|
+
The repository includes a paired, reproducible code-quality benchmark suite supporting OpenAI (GPT-4o, GPT-5, o1, o3-mini), Google Gemini, Anthropic Claude, and custom gateways (AgentRouter, OpenRouter).
|
|
329
|
+
|
|
330
|
+
The benchmark evaluates real-world code quality, security vulnerabilities, timing attacks, ARIA accessibility contracts, DDD business invariants, and error isolation between baseline LLMs and ContextOS-assisted agents.
|
|
331
|
+
|
|
332
|
+
### Live Benchmark Execution
|
|
333
|
+
|
|
334
|
+
```bash
|
|
335
|
+
# 1. Run live benchmark with OpenAI (GPT-4o, GPT-5, o3-mini):
|
|
336
|
+
set OPENAI_API_KEY=sk-... # PowerShell: $env:OPENAI_API_KEY = "sk-..."
|
|
337
|
+
npm run benchmark:live -- --provider openai --model gpt-4o
|
|
338
|
+
|
|
339
|
+
# 2. Run live benchmark with Google Gemini:
|
|
340
|
+
set GEMINI_API_KEY=... # PowerShell: $env:GEMINI_API_KEY = "..."
|
|
341
|
+
npm run benchmark:live -- --provider gemini --model gemini-2.5-flash
|
|
342
|
+
|
|
343
|
+
# 3. Run live benchmark with Anthropic Claude:
|
|
344
|
+
set ANTHROPIC_API_KEY=... # PowerShell: $env:ANTHROPIC_API_KEY = "..."
|
|
345
|
+
npm run benchmark:live -- --provider anthropic --model claude-3-7-sonnet-20250219
|
|
346
|
+
|
|
347
|
+
# 4. Run with custom OpenAI-compatible router (OpenRouter, AgentRouter, Local vLLM):
|
|
348
|
+
node benchmarks/run-live-benchmark.js --base-url "https://agentrouter.org/v1" --api-key "sk-..." --model "gpt-5.6-sol" --open
|
|
349
|
+
```
|
|
350
|
+
|
|
351
|
+
### Execution-Backed Runtime Benchmark (Real Sandbox Test Assertions)
|
|
352
|
+
|
|
353
|
+
In addition to static checks, ContextOS features an **execution-backed runtime benchmark suite**. It compiles model-generated code in an isolated Node.js V8 sandbox (`node:vm`) and runs rigorous behavioral unit assertions (`node:assert`):
|
|
354
|
+
|
|
355
|
+
```bash
|
|
356
|
+
# 1. Run runtime benchmark with OpenRouter (Google Gemini 3.8 Flash):
|
|
357
|
+
node benchmarks/run-runtime-benchmark.js --base-url "https://openrouter.ai/api/v1" --api-key "sk-or-v1-..." --model "google/gemini-3.8-flash" --open
|
|
358
|
+
|
|
359
|
+
# 2. Run runtime benchmark with AgentRouter (GPT-5.6-sol):
|
|
360
|
+
node benchmarks/run-runtime-benchmark.js --base-url "https://agentrouter.org/v1" --api-key "sk-..." --model "gpt-5.6-sol" --open
|
|
361
|
+
|
|
362
|
+
# 3. Run specific scenario (auth-security, ddd-order-invariants, or resilient-api-client):
|
|
363
|
+
npm run benchmark:runtime -- --base-url "https://agentrouter.org/v1" --api-key "sk-..." --model "gpt-5.6-sol" --task auth-security
|
|
364
|
+
```
|
|
365
|
+
|
|
366
|
+
### Evaluation Methodology
|
|
367
|
+
|
|
368
|
+
Submissions are evaluated using a strict, multi-stage verification pipeline:
|
|
369
|
+
|
|
370
|
+
1. **Sandboxed V8 Runtime Execution (Primary Ground Truth):** Compiles TypeScript into CommonJS via native AST type stripping (`node:module.stripTypeScriptTypes`) and executes in an isolated sandbox with timeout and assertion checks (`node:assert`).
|
|
371
|
+
2. **Behavioral Invariant Testing:** Stress-tests timing attacks (`crypto.timingSafeEqual`), brute-force IP/Account rate-limiting, error stack redaction, immutable Value Objects, domain event dispatch, and circuit breaker state transitions.
|
|
372
|
+
3. **Deterministic Static Analysis:** AST verification checking for zero ORM/HTTP transport leakage in domain layers and contract compliance.
|
|
373
|
+
|
|
374
|
+
### Production Scenarios Evaluated
|
|
375
|
+
|
|
376
|
+
The runtime sandbox evaluates model outputs against real-world engineering invariants:
|
|
377
|
+
|
|
378
|
+
| Scenario | Category | Skills Activated | Key Technical Invariant Proved |
|
|
379
|
+
|---|---|---|---|
|
|
380
|
+
| **Secure Auth & Rate Limiting** | Security & Backend | `security`, `node`, `ponytail-mindset` | Constant-time password verification (`timingSafeEqual`), dual-key rate-limiting, strict email/credential sanitization, zero stack-trace leak in 500s. |
|
|
381
|
+
| **DDD Order Aggregate Root** | Architecture & DDD | `ddd`, `system-design`, `decisions` | Immutable `Money` Value Object, state-machine invariants (PENDING → PAID → SHIPPED), explicit Domain Event classes with queue draining. |
|
|
382
|
+
| **Resilient API Client** | Reliability & Async | `typescript`, `system-design`, `performance` | 3-state Circuit Breaker (CLOSED → OPEN → HALF-OPEN), `AbortController` timeouts, typed error taxonomy without credential leakage. |
|
|
383
|
+
|
|
384
|
+
### Running Benchmarks Locally
|
|
385
|
+
|
|
386
|
+
You can run the benchmark suite locally with your own API keys:
|
|
387
|
+
|
|
388
|
+
```bash
|
|
389
|
+
# Run runtime sandbox benchmark with Google Gemini:
|
|
390
|
+
$env:GEMINI_API_KEY = "your-key"
|
|
391
|
+
npm run benchmark:runtime -- --provider gemini --model gemini-2.5-flash
|
|
392
|
+
|
|
393
|
+
# Run with OpenAI:
|
|
394
|
+
$env:OPENAI_API_KEY = "sk-..."
|
|
395
|
+
npm run benchmark:runtime -- --provider openai --model gpt-4o
|
|
396
|
+
```
|
|
397
|
+
|
|
398
|
+
When executed, reports are generated in `benchmarks/results/` (`.html`, `.md`, `.json`) and tracked so results are visible and shareable.
|
|
399
|
+
|
|
400
|
+
## Contributing
|
|
401
|
+
|
|
402
|
+
We are open to pull requests! See [CONTRIBUTING.md](./CONTRIBUTING.md) for a step-by-step guide on how to add a new skill.
|
|
403
|
+
|
|
404
|
+
Quick start:
|
|
405
|
+
|
|
406
|
+
1. Fork the repository
|
|
407
|
+
2. Create your feature branch (`git checkout -b feature/AmazingSkill`)
|
|
408
|
+
3. Add your skill in `.agents/core/skills/<name>/SKILL.md`
|
|
409
|
+
4. Run `npm test` — all tests must pass
|
|
410
|
+
5. Commit your changes (`git commit -m 'feat: add AmazingSkill'`)
|
|
411
|
+
6. Push and open a Pull Request
|
|
412
|
+
|
|
413
|
+
## License
|
|
414
|
+
|
|
415
|
+
Distributed under the MIT License. You can freely use, modify, and distribute this code.
|