@ryuenn3123/agentic-senior-core 4.4.0 → 5.1.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.agents/plugins/marketplace.json +21 -0
- package/.agents/rules/agentic-senior-core.md +126 -0
- package/.claude-plugin/marketplace.json +17 -0
- package/.claude-plugin/plugin.json +17 -0
- package/.clinerules/agentic-senior-core.md +94 -0
- package/.codex-plugin/plugin.json +24 -0
- package/.cursor/rules/agentic-senior-core.mdc +99 -0
- package/.devin-plugin/plugin.json +13 -0
- package/.github/copilot-instructions.md +94 -0
- package/.github/plugin/marketplace.json +20 -0
- package/.github/plugin/plugin.json +16 -0
- package/.kiro/steering/agentic-senior-core.md +94 -0
- package/.openclaw/skills/asc/SKILL.md +23 -0
- package/.openclaw/skills/asc-audit/SKILL.md +28 -0
- package/.openclaw/skills/asc-review/SKILL.md +54 -0
- package/.opencode/plugins/agentic-senior-core.mjs +31 -0
- package/.windsurf/rules/agentic-senior-core.md +94 -0
- package/AGENTS.md +126 -127
- package/CONTRIBUTING.md +93 -63
- package/README.md +160 -111
- package/__init__.py +61 -0
- package/bin/agentic-senior-core.js +42 -41
- package/commands/asc-audit.md +1 -0
- package/commands/asc-audit.toml +2 -0
- package/commands/asc-help.md +9 -0
- package/commands/asc-help.toml +2 -0
- package/commands/asc-refactor.md +1 -0
- package/commands/asc-refactor.toml +2 -0
- package/commands/asc-review.md +1 -0
- package/commands/asc-review.toml +2 -0
- package/gemini-extension.json +10 -0
- package/hooks/copilot-hooks.json +21 -0
- package/hooks/hooks.json +31 -0
- package/hooks/session-start.js +36 -0
- package/hooks/subagent-start.js +38 -0
- package/lib/cli/commands/adapter.mjs +109 -0
- package/lib/cli/commands/clean.mjs +63 -0
- package/lib/cli/commands/status.mjs +94 -0
- package/package.json +43 -60
- package/plugin.yaml +16 -0
- package/scripts/uninstall.js +38 -0
- package/skills/asc/SKILL.md +16 -0
- package/skills/asc-audit/SKILL.md +28 -0
- package/skills/asc-refactor/SKILL.md +35 -0
- package/skills/asc-review/SKILL.md +54 -0
- package/.agent-context/policies/llm-judge-threshold.json +0 -29
- package/.agent-context/prompts/bootstrap-design.md +0 -63
- package/.agent-context/prompts/compact-natural-mode.md +0 -100
- package/.agent-context/prompts/init-project.md +0 -60
- package/.agent-context/prompts/refactor.md +0 -38
- package/.agent-context/prompts/review-code.md +0 -31
- package/.agent-context/review-checklists/architecture-review.md +0 -57
- package/.agent-context/review-checklists/pr-checklist.md +0 -134
- package/.agent-context/rules/api-docs.md +0 -24
- package/.agent-context/rules/api-versioning.md +0 -16
- package/.agent-context/rules/architecture.md +0 -38
- package/.agent-context/rules/background-jobs.md +0 -17
- package/.agent-context/rules/config-and-flags.md +0 -16
- package/.agent-context/rules/database-design.md +0 -18
- package/.agent-context/rules/docker-runtime.md +0 -17
- package/.agent-context/rules/error-handling.md +0 -16
- package/.agent-context/rules/event-driven.md +0 -16
- package/.agent-context/rules/frontend-architecture.md +0 -54
- package/.agent-context/rules/microservices.md +0 -16
- package/.agent-context/rules/migrations.md +0 -16
- package/.agent-context/rules/observability.md +0 -16
- package/.agent-context/rules/performance.md +0 -16
- package/.agent-context/rules/realtime.md +0 -16
- package/.agent-context/rules/resilience.md +0 -18
- package/.agent-context/rules/security.md +0 -18
- package/.agent-context/rules/testing.md +0 -16
- package/.agent-context/state/README.md +0 -25
- package/.agent-context/state/architecture-map.md +0 -40
- package/.agent-context/state/benchmark-comparison-schema.json +0 -181
- package/.agent-context/state/benchmark-reproducibility.json +0 -87
- package/.agent-context/state/benchmark-thresholds.json +0 -10
- package/.agent-context/state/benchmark-writer-judge-config.json +0 -58
- package/.agent-context/state/dependency-map.md +0 -41
- package/.agent-context/state/memory-adapter-contract.json +0 -52
- package/.agent-context/state/memory-schema-v1.json +0 -88
- package/GEMINI.md +0 -1
- package/benchmarks/README.md +0 -60
- package/benchmarks/compact-natural-mode/fixtures.mjs +0 -359
- package/benchmarks/compact-natural-mode/scorer.mjs +0 -331
- package/benchmarks/runtime-token-saver/fixtures.mjs +0 -836
- package/lib/cli/adaptive-context/catalog.mjs +0 -394
- package/lib/cli/adaptive-context/file-signals.mjs +0 -100
- package/lib/cli/adaptive-context/implications.mjs +0 -44
- package/lib/cli/adaptive-context.mjs +0 -151
- package/lib/cli/audits/typography-palette-anti-repeat/color-utils.mjs +0 -156
- package/lib/cli/audits/typography-palette-anti-repeat/file-scanner.mjs +0 -103
- package/lib/cli/audits/typography-palette-anti-repeat/typography-utils.mjs +0 -70
- package/lib/cli/backup.mjs +0 -210
- package/lib/cli/commands/context.mjs +0 -140
- package/lib/cli/commands/init/project-context.mjs +0 -60
- package/lib/cli/commands/init/runtime-environment.mjs +0 -59
- package/lib/cli/commands/init/setup-decisions.mjs +0 -83
- package/lib/cli/commands/init.mjs +0 -654
- package/lib/cli/commands/launch.mjs +0 -76
- package/lib/cli/commands/optimize.mjs +0 -284
- package/lib/cli/commands/rollback.mjs +0 -64
- package/lib/cli/commands/upgrade/token-optimization-state.mjs +0 -51
- package/lib/cli/commands/upgrade.mjs +0 -451
- package/lib/cli/compiler.mjs +0 -187
- package/lib/cli/constants.mjs +0 -136
- package/lib/cli/detector/constants.mjs +0 -135
- package/lib/cli/detector/design-evidence/collector.mjs +0 -256
- package/lib/cli/detector/design-evidence/constants.mjs +0 -39
- package/lib/cli/detector/design-evidence/file-traversal.mjs +0 -83
- package/lib/cli/detector/design-evidence/structured-attribute-evidence.mjs +0 -117
- package/lib/cli/detector/design-evidence/summary.mjs +0 -109
- package/lib/cli/detector/design-evidence/utility-helpers.mjs +0 -122
- package/lib/cli/detector/design-evidence.mjs +0 -25
- package/lib/cli/detector/stack-detection.mjs +0 -243
- package/lib/cli/detector/ui-signals.mjs +0 -150
- package/lib/cli/detector/workspace-scan.mjs +0 -177
- package/lib/cli/detector.mjs +0 -23
- package/lib/cli/init-detection-flow.mjs +0 -48
- package/lib/cli/init-options.mjs +0 -237
- package/lib/cli/init-selection.mjs +0 -29
- package/lib/cli/memory-continuity.mjs +0 -537
- package/lib/cli/preflight.mjs +0 -76
- package/lib/cli/project-scaffolder/constants.mjs +0 -69
- package/lib/cli/project-scaffolder/discovery.mjs +0 -272
- package/lib/cli/project-scaffolder/prompt-builders.mjs +0 -171
- package/lib/cli/project-scaffolder/storage.mjs +0 -144
- package/lib/cli/project-scaffolder/ui-scope-detection.mjs +0 -36
- package/lib/cli/project-scaffolder.mjs +0 -29
- package/lib/cli/rollback.mjs +0 -66
- package/lib/cli/token-optimization.mjs +0 -401
- package/lib/cli/utils/filesystem.mjs +0 -81
- package/lib/cli/utils/managed-surface.mjs +0 -280
- package/lib/cli/utils/prompting.mjs +0 -44
- package/lib/cli/utils.mjs +0 -479
- package/mcp.json +0 -134
- package/scripts/adaptive-context/fixtures.mjs +0 -183
- package/scripts/adaptive-context-benchmark.mjs +0 -9
- package/scripts/ascx-runtime-token-saver-benchmark.mjs +0 -9
- package/scripts/benchmark-evidence-bundle.mjs +0 -645
- package/scripts/benchmark-gate.mjs +0 -121
- package/scripts/benchmark-intelligence.mjs +0 -33
- package/scripts/benchmark-writer-judge-matrix.mjs +0 -379
- package/scripts/build-release-benchmark-bundle.mjs +0 -202
- package/scripts/bump-version.mjs +0 -103
- package/scripts/clean-local-artifacts.mjs +0 -78
- package/scripts/compact-natural-mode-benchmark.mjs +0 -9
- package/scripts/context-triggered-audit.mjs +0 -391
- package/scripts/detection-benchmark.mjs +0 -127
- package/scripts/docs-quality-drift-report.mjs +0 -358
- package/scripts/documentation-boundary-audit.mjs +0 -305
- package/scripts/explain-on-demand-audit.mjs +0 -427
- package/scripts/forbidden-content-check.mjs +0 -123
- package/scripts/frontend-usability-audit.mjs +0 -243
- package/scripts/generate-sbom.mjs +0 -61
- package/scripts/governance-weekly-report.mjs +0 -466
- package/scripts/llm-judge/checklist-loader.mjs +0 -45
- package/scripts/llm-judge/constants.mjs +0 -66
- package/scripts/llm-judge/diff-collection.mjs +0 -74
- package/scripts/llm-judge/prompting.mjs +0 -78
- package/scripts/llm-judge/providers.mjs +0 -111
- package/scripts/llm-judge/verdict.mjs +0 -134
- package/scripts/llm-judge.mjs +0 -200
- package/scripts/memory-continuity-benchmark.mjs +0 -322
- package/scripts/quality-trend-report.mjs +0 -289
- package/scripts/release-gate/audit-checks.mjs +0 -441
- package/scripts/release-gate/constants.mjs +0 -53
- package/scripts/release-gate/runtime.mjs +0 -63
- package/scripts/release-gate/static-checks.mjs +0 -182
- package/scripts/release-gate.mjs +0 -42
- package/scripts/rules-guardian-audit.mjs +0 -580
- package/scripts/single-source-lazy-loading-audit.mjs +0 -449
- package/scripts/sync-thin-adapters.mjs +0 -72
- package/scripts/token-optimization-benchmark.mjs +0 -252
- package/scripts/ui-design-judge/constants.mjs +0 -13
- package/scripts/ui-design-judge/design-execution-summary.mjs +0 -81
- package/scripts/ui-design-judge/git-input.mjs +0 -134
- package/scripts/ui-design-judge/prompting.mjs +0 -52
- package/scripts/ui-design-judge/providers.mjs +0 -102
- package/scripts/ui-design-judge/reporting.mjs +0 -183
- package/scripts/ui-design-judge/rubric-calibration.mjs +0 -214
- package/scripts/ui-design-judge/rubric-goldset.json +0 -188
- package/scripts/ui-design-judge.mjs +0 -319
- package/scripts/ui-rubric-calibration.mjs +0 -35
- package/scripts/validate/audits/cache-layer-contract.mjs +0 -230
- package/scripts/validate/audits/caching-scope-hygiene.mjs +0 -235
- package/scripts/validate/audits/file-size.mjs +0 -158
- package/scripts/validate/audits/reflection-citations.mjs +0 -130
- package/scripts/validate/audits/release-bundle.mjs +0 -135
- package/scripts/validate/audits/rule-id-uniqueness.mjs +0 -278
- package/scripts/validate/config.mjs +0 -501
- package/scripts/validate/coverage-checks.mjs +0 -446
- package/scripts/validate/file-structure.mjs +0 -158
- package/scripts/validate/markdown-content.mjs +0 -109
- package/scripts/validate/project-metadata.mjs +0 -166
- package/scripts/validate/utils.mjs +0 -52
- package/scripts/validate.mjs +0 -267
|
@@ -1,181 +0,0 @@
|
|
|
1
|
-
{
|
|
2
|
-
"$schema": "https://json-schema.org/draft/2020-12/schema",
|
|
3
|
-
"title": "Benchmark Before-vs-After Comparison",
|
|
4
|
-
"description": "Schema for comparing benchmark results across releases or configuration changes. Each entry captures quality, bug signal, runtime, and token metrics for a before and after snapshot.",
|
|
5
|
-
"type": "object",
|
|
6
|
-
"required": ["schemaVersion", "comparisonId", "generatedAt", "before", "after", "delta"],
|
|
7
|
-
"properties": {
|
|
8
|
-
"schemaVersion": {
|
|
9
|
-
"type": "string",
|
|
10
|
-
"const": "1.0.0"
|
|
11
|
-
},
|
|
12
|
-
"comparisonId": {
|
|
13
|
-
"type": "string",
|
|
14
|
-
"description": "Unique identifier for this comparison run."
|
|
15
|
-
},
|
|
16
|
-
"generatedAt": {
|
|
17
|
-
"type": "string",
|
|
18
|
-
"format": "date-time"
|
|
19
|
-
},
|
|
20
|
-
"baselineVersion": {
|
|
21
|
-
"type": "string",
|
|
22
|
-
"description": "Package version of the before snapshot."
|
|
23
|
-
},
|
|
24
|
-
"candidateVersion": {
|
|
25
|
-
"type": "string",
|
|
26
|
-
"description": "Package version of the after snapshot."
|
|
27
|
-
},
|
|
28
|
-
"comparisonType": {
|
|
29
|
-
"type": "string",
|
|
30
|
-
"enum": ["release-to-release", "config-change", "model-swap", "manual"],
|
|
31
|
-
"description": "What triggered this comparison."
|
|
32
|
-
},
|
|
33
|
-
"before": { "$ref": "#/$defs/snapshot" },
|
|
34
|
-
"after": { "$ref": "#/$defs/snapshot" },
|
|
35
|
-
"delta": { "$ref": "#/$defs/deltaReport" },
|
|
36
|
-
"verdict": {
|
|
37
|
-
"type": "string",
|
|
38
|
-
"enum": ["pass", "warn", "fail"],
|
|
39
|
-
"description": "Overall comparison verdict based on threshold policy."
|
|
40
|
-
},
|
|
41
|
-
"verdictReason": {
|
|
42
|
-
"type": "string",
|
|
43
|
-
"description": "Human-readable explanation of the verdict."
|
|
44
|
-
}
|
|
45
|
-
},
|
|
46
|
-
"$defs": {
|
|
47
|
-
"snapshot": {
|
|
48
|
-
"type": "object",
|
|
49
|
-
"required": ["capturedAt", "quality", "runtime"],
|
|
50
|
-
"properties": {
|
|
51
|
-
"capturedAt": {
|
|
52
|
-
"type": "string",
|
|
53
|
-
"format": "date-time"
|
|
54
|
-
},
|
|
55
|
-
"packageVersion": {
|
|
56
|
-
"type": "string"
|
|
57
|
-
},
|
|
58
|
-
"quality": {
|
|
59
|
-
"type": "object",
|
|
60
|
-
"properties": {
|
|
61
|
-
"top1Accuracy": {
|
|
62
|
-
"type": "number",
|
|
63
|
-
"minimum": 0,
|
|
64
|
-
"maximum": 1,
|
|
65
|
-
"description": "Fraction of scenarios where the top-ranked output was correct."
|
|
66
|
-
},
|
|
67
|
-
"manualCorrectionRate": {
|
|
68
|
-
"type": "number",
|
|
69
|
-
"minimum": 0,
|
|
70
|
-
"maximum": 1,
|
|
71
|
-
"description": "Fraction of outputs requiring human correction."
|
|
72
|
-
},
|
|
73
|
-
"averageJudgeScore": {
|
|
74
|
-
"type": "number",
|
|
75
|
-
"minimum": 0,
|
|
76
|
-
"maximum": 10,
|
|
77
|
-
"description": "Mean score across all judge dimensions."
|
|
78
|
-
},
|
|
79
|
-
"scenarioCount": {
|
|
80
|
-
"type": "integer",
|
|
81
|
-
"minimum": 1
|
|
82
|
-
}
|
|
83
|
-
}
|
|
84
|
-
},
|
|
85
|
-
"bugSignal": {
|
|
86
|
-
"type": "object",
|
|
87
|
-
"properties": {
|
|
88
|
-
"validationFailures": {
|
|
89
|
-
"type": "integer",
|
|
90
|
-
"minimum": 0,
|
|
91
|
-
"description": "Number of validation check failures."
|
|
92
|
-
},
|
|
93
|
-
"securityWarnings": {
|
|
94
|
-
"type": "integer",
|
|
95
|
-
"minimum": 0
|
|
96
|
-
},
|
|
97
|
-
"deprecationWarnings": {
|
|
98
|
-
"type": "integer",
|
|
99
|
-
"minimum": 0
|
|
100
|
-
}
|
|
101
|
-
}
|
|
102
|
-
},
|
|
103
|
-
"runtime": {
|
|
104
|
-
"type": "object",
|
|
105
|
-
"properties": {
|
|
106
|
-
"totalDurationMs": {
|
|
107
|
-
"type": "number",
|
|
108
|
-
"description": "Total benchmark suite execution time in milliseconds."
|
|
109
|
-
},
|
|
110
|
-
"averageScenarioDurationMs": {
|
|
111
|
-
"type": "number"
|
|
112
|
-
},
|
|
113
|
-
"peakMemoryMb": {
|
|
114
|
-
"type": "number"
|
|
115
|
-
}
|
|
116
|
-
}
|
|
117
|
-
},
|
|
118
|
-
"token": {
|
|
119
|
-
"type": "object",
|
|
120
|
-
"properties": {
|
|
121
|
-
"nativeSavingsPercent": {
|
|
122
|
-
"type": "number",
|
|
123
|
-
"description": "Token savings from native optimization."
|
|
124
|
-
},
|
|
125
|
-
"proxySavingsPercent": {
|
|
126
|
-
"type": "number",
|
|
127
|
-
"description": "Token savings from external proxy optimization."
|
|
128
|
-
},
|
|
129
|
-
"totalInputTokens": {
|
|
130
|
-
"type": "integer"
|
|
131
|
-
},
|
|
132
|
-
"totalOutputTokens": {
|
|
133
|
-
"type": "integer"
|
|
134
|
-
}
|
|
135
|
-
}
|
|
136
|
-
}
|
|
137
|
-
}
|
|
138
|
-
},
|
|
139
|
-
"deltaReport": {
|
|
140
|
-
"type": "object",
|
|
141
|
-
"properties": {
|
|
142
|
-
"top1AccuracyChange": {
|
|
143
|
-
"type": "number",
|
|
144
|
-
"description": "After minus before. Positive means improvement."
|
|
145
|
-
},
|
|
146
|
-
"manualCorrectionRateChange": {
|
|
147
|
-
"type": "number",
|
|
148
|
-
"description": "After minus before. Negative means improvement."
|
|
149
|
-
},
|
|
150
|
-
"averageJudgeScoreChange": {
|
|
151
|
-
"type": "number"
|
|
152
|
-
},
|
|
153
|
-
"validationFailureChange": {
|
|
154
|
-
"type": "integer"
|
|
155
|
-
},
|
|
156
|
-
"totalDurationMsChange": {
|
|
157
|
-
"type": "number"
|
|
158
|
-
},
|
|
159
|
-
"nativeSavingsChange": {
|
|
160
|
-
"type": "number"
|
|
161
|
-
},
|
|
162
|
-
"regressionDetected": {
|
|
163
|
-
"type": "boolean",
|
|
164
|
-
"description": "True if any metric crossed a threshold in the wrong direction."
|
|
165
|
-
},
|
|
166
|
-
"regressionDetails": {
|
|
167
|
-
"type": "array",
|
|
168
|
-
"items": {
|
|
169
|
-
"type": "object",
|
|
170
|
-
"properties": {
|
|
171
|
-
"metric": { "type": "string" },
|
|
172
|
-
"threshold": { "type": "number" },
|
|
173
|
-
"actual": { "type": "number" },
|
|
174
|
-
"direction": { "type": "string", "enum": ["increase", "decrease"] }
|
|
175
|
-
}
|
|
176
|
-
}
|
|
177
|
-
}
|
|
178
|
-
}
|
|
179
|
-
}
|
|
180
|
-
}
|
|
181
|
-
}
|
|
@@ -1,87 +0,0 @@
|
|
|
1
|
-
{
|
|
2
|
-
"version": "1.0.0",
|
|
3
|
-
"phase": "v2.5.1",
|
|
4
|
-
"updatedAt": "2026-04-13",
|
|
5
|
-
"deterministicRuntime": {
|
|
6
|
-
"timezone": "UTC",
|
|
7
|
-
"locale": "C",
|
|
8
|
-
"nodeMajor": "22",
|
|
9
|
-
"lineEndings": "LF-preferred",
|
|
10
|
-
"shellNotes": "PowerShell and POSIX shells are supported; prefer portable commands for benchmark reruns."
|
|
11
|
-
},
|
|
12
|
-
"scenarios": [
|
|
13
|
-
{
|
|
14
|
-
"id": "planning",
|
|
15
|
-
"category": "planning",
|
|
16
|
-
"inputReferences": [
|
|
17
|
-
".agent-context/state/architecture-map.md",
|
|
18
|
-
".agent-context/state/dependency-map.md",
|
|
19
|
-
".agent-context/rules/architecture.md"
|
|
20
|
-
],
|
|
21
|
-
"expectedSignals": [
|
|
22
|
-
"clear sequencing",
|
|
23
|
-
"risk mapping",
|
|
24
|
-
"rollback path"
|
|
25
|
-
],
|
|
26
|
-
"primaryCommand": "npm run benchmark:detection"
|
|
27
|
-
},
|
|
28
|
-
{
|
|
29
|
-
"id": "refactor",
|
|
30
|
-
"category": "refactor",
|
|
31
|
-
"inputReferences": [
|
|
32
|
-
"tests/cli-smoke.test.mjs",
|
|
33
|
-
"scripts/validate.mjs"
|
|
34
|
-
],
|
|
35
|
-
"expectedSignals": [
|
|
36
|
-
"regression awareness",
|
|
37
|
-
"small safe diffs",
|
|
38
|
-
"test-backed changes"
|
|
39
|
-
],
|
|
40
|
-
"primaryCommand": "npm run benchmark:gate"
|
|
41
|
-
},
|
|
42
|
-
{
|
|
43
|
-
"id": "security",
|
|
44
|
-
"category": "security",
|
|
45
|
-
"inputReferences": [
|
|
46
|
-
".agent-context/rules/security.md",
|
|
47
|
-
"scripts/forbidden-content-check.mjs"
|
|
48
|
-
],
|
|
49
|
-
"expectedSignals": [
|
|
50
|
-
"secret hygiene",
|
|
51
|
-
"unsafe pattern detection",
|
|
52
|
-
"release blocking on risk"
|
|
53
|
-
],
|
|
54
|
-
"primaryCommand": "npm run gate:release"
|
|
55
|
-
},
|
|
56
|
-
{
|
|
57
|
-
"id": "delivery",
|
|
58
|
-
"category": "delivery",
|
|
59
|
-
"inputReferences": [
|
|
60
|
-
"scripts/release-gate.mjs",
|
|
61
|
-
"scripts/benchmark-intelligence.mjs",
|
|
62
|
-
"scripts/benchmark-gate.mjs"
|
|
63
|
-
],
|
|
64
|
-
"expectedSignals": [
|
|
65
|
-
"release readiness",
|
|
66
|
-
"static external watchlist retirement",
|
|
67
|
-
"no stale benchmark research dependency"
|
|
68
|
-
],
|
|
69
|
-
"primaryCommand": "npm run benchmark:intelligence"
|
|
70
|
-
}
|
|
71
|
-
],
|
|
72
|
-
"rerunInstructions": [
|
|
73
|
-
"Run npm run benchmark:detection to regenerate detection benchmark output.",
|
|
74
|
-
"Run npm run benchmark:gate to validate benchmark anti-regression thresholds.",
|
|
75
|
-
"Run npm run benchmark:intelligence to confirm static external benchmark watchlists stay retired.",
|
|
76
|
-
"Run npm run benchmark:bundle to emit a reproducible benchmark evidence bundle.",
|
|
77
|
-
"Run npm run benchmark:writer-judge to emit writer-judge side-by-side matrix output."
|
|
78
|
-
],
|
|
79
|
-
"commandExamples": [
|
|
80
|
-
"npm run benchmark:detection",
|
|
81
|
-
"npm run benchmark:gate",
|
|
82
|
-
"npm run benchmark:intelligence",
|
|
83
|
-
"npm run benchmark:bundle",
|
|
84
|
-
"npm run benchmark:writer-judge",
|
|
85
|
-
"node ./scripts/benchmark-evidence-bundle.mjs --stdout-only"
|
|
86
|
-
]
|
|
87
|
-
}
|
|
@@ -1,58 +0,0 @@
|
|
|
1
|
-
{
|
|
2
|
-
"version": "1.0.0",
|
|
3
|
-
"phase": "v2.5.1",
|
|
4
|
-
"blindReviewMode": true,
|
|
5
|
-
"writerLane": {
|
|
6
|
-
"models": [
|
|
7
|
-
{
|
|
8
|
-
"id": "writer-copilot-balanced",
|
|
9
|
-
"provider": "github-copilot",
|
|
10
|
-
"profile": "balanced"
|
|
11
|
-
},
|
|
12
|
-
{
|
|
13
|
-
"id": "writer-claude-architect",
|
|
14
|
-
"provider": "anthropic",
|
|
15
|
-
"profile": "architect"
|
|
16
|
-
},
|
|
17
|
-
{
|
|
18
|
-
"id": "writer-gemini-ops",
|
|
19
|
-
"provider": "google",
|
|
20
|
-
"profile": "operations"
|
|
21
|
-
}
|
|
22
|
-
],
|
|
23
|
-
"weights": {
|
|
24
|
-
"quality": 40,
|
|
25
|
-
"efficiency": 20,
|
|
26
|
-
"reliability": 25,
|
|
27
|
-
"freshness": 15
|
|
28
|
-
},
|
|
29
|
-
"scenarioMultipliers": {
|
|
30
|
-
"planning": 1,
|
|
31
|
-
"refactor": 1.02,
|
|
32
|
-
"security": 1.03,
|
|
33
|
-
"delivery": 0.98
|
|
34
|
-
}
|
|
35
|
-
},
|
|
36
|
-
"judgeLane": {
|
|
37
|
-
"models": [
|
|
38
|
-
{
|
|
39
|
-
"id": "judge-claude-audit",
|
|
40
|
-
"provider": "anthropic",
|
|
41
|
-
"profile": "audit"
|
|
42
|
-
},
|
|
43
|
-
{
|
|
44
|
-
"id": "judge-gpt-risk",
|
|
45
|
-
"provider": "openai",
|
|
46
|
-
"profile": "risk"
|
|
47
|
-
}
|
|
48
|
-
],
|
|
49
|
-
"minimumCompositeScore": 75,
|
|
50
|
-
"leniencyWindow": 2,
|
|
51
|
-
"weights": {
|
|
52
|
-
"clarity": 35,
|
|
53
|
-
"correctness": 35,
|
|
54
|
-
"risk": 20,
|
|
55
|
-
"consistency": 10
|
|
56
|
-
}
|
|
57
|
-
}
|
|
58
|
-
}
|
|
@@ -1,41 +0,0 @@
|
|
|
1
|
-
# Dependency Map
|
|
2
|
-
|
|
3
|
-
Use this map to keep Agentic-Senior-Core's CLI, governance, and validation layers from collapsing into circular or over-coupled code.
|
|
4
|
-
|
|
5
|
-
## Allowed Dependency Direction
|
|
6
|
-
|
|
7
|
-
1. `bin/` may call command modules only.
|
|
8
|
-
2. `lib/cli/commands/**` may orchestrate detector, compiler, scaffolder, memory, token, backup, rollback, preflight, and utility modules.
|
|
9
|
-
3. `lib/cli/compiler.mjs` may read constants and utilities, but must not import command modules.
|
|
10
|
-
4. `lib/cli/project-scaffolder/**` may use utilities and local scaffolder submodules; validation logic stays below the scaffolder entrypoint.
|
|
11
|
-
5. `scripts/**` may call CLI library modules for audits and reports, but release/validation scripts must avoid mutating generated state unless that is their explicit job.
|
|
12
|
-
6. `tests/**` may exercise public CLI commands, public module exports, scripts, and generated artifacts.
|
|
13
|
-
7. `.agent-context/**` stores governance data and must not depend on generated adapter content as its authority.
|
|
14
|
-
|
|
15
|
-
## Module Constraints
|
|
16
|
-
|
|
17
|
-
| Source | Allowed Dependencies | Forbidden Dependencies |
|
|
18
|
-
| --- | --- | --- |
|
|
19
|
-
| `bin/agentic-senior-core.js` | `lib/cli/commands/*` | direct compiler, scaffolder, or validation internals |
|
|
20
|
-
| `lib/cli/commands/init.mjs` | detector, compiler, scaffolder, token/memory continuity, setup helpers | UI style presets, backend framework defaults, generated adapters as source |
|
|
21
|
-
| `lib/cli/commands/upgrade.mjs` | detector, compiler, scaffolder seeds, backup/rollback, shared setup helpers | duplicated setup-policy helpers, silent stack migration |
|
|
22
|
-
| `lib/cli/project-scaffolder.mjs` | stable public scaffolder exports | private validation helpers that do not need public API exposure |
|
|
23
|
-
| `lib/cli/project-scaffolder/design-contract.mjs` | validation submodule, constants, utilities | hardcoded final palettes, fixed layouts, external design memory |
|
|
24
|
-
| `scripts/sync-thin-adapters.mjs` | `AGENTS.md` and native import bridge targets | hand-maintained duplicate policy blocks |
|
|
25
|
-
| `scripts/validate*.mjs` | config, coverage checks, file evidence | stale V2 skill-marketplace artifacts |
|
|
26
|
-
| `.agent-context/prompts/bootstrap-design.md` | current repo evidence and frontend rule | prior-chat visuals, unrelated screenshots, template style presets |
|
|
27
|
-
|
|
28
|
-
## Circular Dependency Guardrail
|
|
29
|
-
|
|
30
|
-
- Reject `commands -> project-scaffolder -> commands`.
|
|
31
|
-
- Reject `compiler -> commands`.
|
|
32
|
-
- Reject `scripts/validate -> tests`.
|
|
33
|
-
- Reject generated adapters becoming inputs for `AGENTS.md` or `.agent-context/`.
|
|
34
|
-
- Move repeated command setup policy into shared helper modules instead of copying local functions.
|
|
35
|
-
|
|
36
|
-
## Package Hygiene
|
|
37
|
-
|
|
38
|
-
- Keep one npm lockfile: `package-lock.json`.
|
|
39
|
-
- Ignore Bun lockfiles unless the package manager strategy changes explicitly.
|
|
40
|
-
- Keep generated reports out of the shipped package.
|
|
41
|
-
- Keep `onboarding-report.json` tracked only as current repo operational state; installed projects regenerate it.
|
|
@@ -1,52 +0,0 @@
|
|
|
1
|
-
{
|
|
2
|
-
"schemaVersion": "1.0.0",
|
|
3
|
-
"contractName": "cross-agent-memory-adapter",
|
|
4
|
-
"description": "Adapter contract for ingesting and retrieving shared memory observations across IDE hosts.",
|
|
5
|
-
"requiredAdapters": [
|
|
6
|
-
"claude-code",
|
|
7
|
-
"gemini-cli",
|
|
8
|
-
"vscode-chat"
|
|
9
|
-
],
|
|
10
|
-
"requiredOperations": {
|
|
11
|
-
"ingestion": [
|
|
12
|
-
"captureObservation",
|
|
13
|
-
"captureSessionSummary"
|
|
14
|
-
],
|
|
15
|
-
"retrieval": [
|
|
16
|
-
"searchIndex",
|
|
17
|
-
"getTimeline",
|
|
18
|
-
"getObservations"
|
|
19
|
-
],
|
|
20
|
-
"privacy": [
|
|
21
|
-
"applyPrivateTagRedaction",
|
|
22
|
-
"applyInlineSecretRedaction"
|
|
23
|
-
]
|
|
24
|
-
},
|
|
25
|
-
"adapters": [
|
|
26
|
-
{
|
|
27
|
-
"adapterId": "claude-code",
|
|
28
|
-
"hostType": "plugin-hooks",
|
|
29
|
-
"status": "pilot-ready",
|
|
30
|
-
"ingestionEvents": ["SessionStart", "UserPromptSubmit", "PostToolUse", "Stop", "SessionEnd"],
|
|
31
|
-
"retrievalMode": "mcp-tools"
|
|
32
|
-
},
|
|
33
|
-
{
|
|
34
|
-
"adapterId": "gemini-cli",
|
|
35
|
-
"hostType": "plugin-hooks",
|
|
36
|
-
"status": "pilot-ready",
|
|
37
|
-
"ingestionEvents": ["session_start", "prompt_submit", "post_tool", "session_end"],
|
|
38
|
-
"retrievalMode": "mcp-tools"
|
|
39
|
-
},
|
|
40
|
-
{
|
|
41
|
-
"adapterId": "vscode-chat",
|
|
42
|
-
"hostType": "chat-customization-plugin",
|
|
43
|
-
"status": "pilot-ready",
|
|
44
|
-
"ingestionEvents": ["chatStart", "promptSubmit", "postToolUse", "chatEnd"],
|
|
45
|
-
"retrievalMode": "mcp-tools"
|
|
46
|
-
}
|
|
47
|
-
],
|
|
48
|
-
"notes": [
|
|
49
|
-
"Web chat hosts are explicitly out of scope for this pilot because local runtime hooks are unavailable.",
|
|
50
|
-
"Adapters should emit provider-agnostic payloads matching .agent-context/state/memory-schema-v1.json."
|
|
51
|
-
]
|
|
52
|
-
}
|
|
@@ -1,88 +0,0 @@
|
|
|
1
|
-
{
|
|
2
|
-
"schemaVersion": "1.0.0",
|
|
3
|
-
"schemaName": "cross-agent-memory-observation",
|
|
4
|
-
"description": "Provider-agnostic schema for persistent memory observations shared across coding agents and IDE hosts.",
|
|
5
|
-
"requiredFields": [
|
|
6
|
-
"id",
|
|
7
|
-
"projectId",
|
|
8
|
-
"sessionId",
|
|
9
|
-
"adapterId",
|
|
10
|
-
"eventType",
|
|
11
|
-
"timestamp",
|
|
12
|
-
"title",
|
|
13
|
-
"summary",
|
|
14
|
-
"detail",
|
|
15
|
-
"privacy"
|
|
16
|
-
],
|
|
17
|
-
"fieldDefinitions": {
|
|
18
|
-
"id": {
|
|
19
|
-
"type": "string",
|
|
20
|
-
"description": "Stable unique observation identifier."
|
|
21
|
-
},
|
|
22
|
-
"projectId": {
|
|
23
|
-
"type": "string",
|
|
24
|
-
"description": "Repository or workspace identifier."
|
|
25
|
-
},
|
|
26
|
-
"sessionId": {
|
|
27
|
-
"type": "string",
|
|
28
|
-
"description": "Source session identifier from host adapter."
|
|
29
|
-
},
|
|
30
|
-
"adapterId": {
|
|
31
|
-
"type": "string",
|
|
32
|
-
"allowedValues": ["claude-code", "gemini-cli", "vscode-chat", "custom"],
|
|
33
|
-
"description": "Host adapter that captured this observation."
|
|
34
|
-
},
|
|
35
|
-
"eventType": {
|
|
36
|
-
"type": "string",
|
|
37
|
-
"allowedValues": ["prompt", "tool-use", "decision", "summary", "issue", "context"],
|
|
38
|
-
"description": "Observation type for retrieval filtering."
|
|
39
|
-
},
|
|
40
|
-
"timestamp": {
|
|
41
|
-
"type": "string",
|
|
42
|
-
"format": "date-time",
|
|
43
|
-
"description": "ISO timestamp when observation was captured."
|
|
44
|
-
},
|
|
45
|
-
"title": {
|
|
46
|
-
"type": "string",
|
|
47
|
-
"description": "Compact human-readable headline."
|
|
48
|
-
},
|
|
49
|
-
"summary": {
|
|
50
|
-
"type": "string",
|
|
51
|
-
"description": "Compact session-start payload used for progressive disclosure."
|
|
52
|
-
},
|
|
53
|
-
"detail": {
|
|
54
|
-
"type": "string",
|
|
55
|
-
"description": "Expanded observation text fetched on demand."
|
|
56
|
-
},
|
|
57
|
-
"tags": {
|
|
58
|
-
"type": "array",
|
|
59
|
-
"items": "string",
|
|
60
|
-
"description": "Optional normalized tags for query refinement."
|
|
61
|
-
},
|
|
62
|
-
"privacy": {
|
|
63
|
-
"type": "object",
|
|
64
|
-
"requiredFields": ["level", "redactionApplied"],
|
|
65
|
-
"fieldDefinitions": {
|
|
66
|
-
"level": {
|
|
67
|
-
"type": "string",
|
|
68
|
-
"allowedValues": ["public", "internal", "restricted"],
|
|
69
|
-
"description": "Privacy classification level."
|
|
70
|
-
},
|
|
71
|
-
"redactionApplied": {
|
|
72
|
-
"type": "boolean",
|
|
73
|
-
"description": "Indicates whether privacy sanitization modified payload content."
|
|
74
|
-
},
|
|
75
|
-
"redactionReasons": {
|
|
76
|
-
"type": "array",
|
|
77
|
-
"items": "string",
|
|
78
|
-
"description": "Redaction reason tags such as private-tag or token-like-value."
|
|
79
|
-
}
|
|
80
|
-
}
|
|
81
|
-
}
|
|
82
|
-
},
|
|
83
|
-
"retrievalContract": {
|
|
84
|
-
"sessionStartPayload": ["id", "adapterId", "eventType", "timestamp", "title", "summary"],
|
|
85
|
-
"onDemandPayload": ["detail", "tags", "privacy"],
|
|
86
|
-
"progressiveDisclosure": true
|
|
87
|
-
}
|
|
88
|
-
}
|
package/GEMINI.md
DELETED
|
@@ -1 +0,0 @@
|
|
|
1
|
-
@AGENTS.md
|
package/benchmarks/README.md
DELETED
|
@@ -1,60 +0,0 @@
|
|
|
1
|
-
# Benchmarks
|
|
2
|
-
|
|
3
|
-
Reproducible measurement suites for this repository. Release-facing claims must point to tracked JSON evidence under `benchmarks/results/` or to deterministic benchmark commands that print machine-readable output.
|
|
4
|
-
|
|
5
|
-
## Folder Structure
|
|
6
|
-
|
|
7
|
-
```text
|
|
8
|
-
benchmarks/
|
|
9
|
-
|-- anti-halu/ Provider-free anti-hallucination fixtures and scorer
|
|
10
|
-
|-- compact-natural-mode/ Response compression fixtures and scorer
|
|
11
|
-
|-- runtime-token-saver/ ASCX command-output compression fixtures
|
|
12
|
-
|-- token-usage/ Provider token-counting and cache simulation benchmark
|
|
13
|
-
|-- results/ Tracked release evidence JSON
|
|
14
|
-
`-- README.md
|
|
15
|
-
```
|
|
16
|
-
|
|
17
|
-
## Active Benchmarks
|
|
18
|
-
|
|
19
|
-
| Suite | Folder | Status | Output |
|
|
20
|
-
| --- | --- | --- | --- |
|
|
21
|
-
| Token usage baseline | `token-usage/` | Historical release evidence | `results/baseline-{YYYY-MM-DD}.json` |
|
|
22
|
-
| Cache simulation | `token-usage/` | Historical release evidence | `results/cache-phase-2-{YYYY-MM-DD}.json` |
|
|
23
|
-
| Anti-halu benchmark | `anti-halu/` | Active deterministic gate | `results/anti-halu-phase-3-{YYYY-MM-DD}.json` |
|
|
24
|
-
| ASCX runtime token saver | `runtime-token-saver/` | Active deterministic gate | stdout via `npm run benchmark:ascx` |
|
|
25
|
-
| Compact Natural Mode | `compact-natural-mode/` | Active deterministic gate | stdout via `npm run benchmark:compact-natural` |
|
|
26
|
-
| Release benchmark bundle | `results/` | Active integrity gate | `results/release-bundle-{semver}.json` |
|
|
27
|
-
|
|
28
|
-
## Running Benchmarks
|
|
29
|
-
|
|
30
|
-
Use the package scripts for active gates:
|
|
31
|
-
|
|
32
|
-
```bash
|
|
33
|
-
npm run benchmark:adaptive-context
|
|
34
|
-
npm run benchmark:ascx
|
|
35
|
-
npm run benchmark:compact-natural
|
|
36
|
-
npm run benchmark:anti-halu
|
|
37
|
-
npm run build:release-bundle
|
|
38
|
-
npm run audit:release-bundle
|
|
39
|
-
```
|
|
40
|
-
|
|
41
|
-
See `benchmarks/token-usage/README.md` for the provider token-counting benchmark details.
|
|
42
|
-
|
|
43
|
-
## Reproducibility Requirements
|
|
44
|
-
|
|
45
|
-
1. Use Node 22 or the runtime version documented by the current package metadata.
|
|
46
|
-
2. Do not add runtime dependencies to the core package for benchmark-only work. Benchmark tooling belongs in `devDependencies`.
|
|
47
|
-
3. Keep JSON output deterministic where possible. If timestamps or host facts vary, isolate them in metadata fields.
|
|
48
|
-
4. Include schema version, timestamp, and tooling version when a result file is tracked so older evidence remains interpretable.
|
|
49
|
-
|
|
50
|
-
## Result Files Convention
|
|
51
|
-
|
|
52
|
-
- Track release evidence under `benchmarks/results/*.json`.
|
|
53
|
-
- Use `{suite-name}-{YYYY-MM-DD}.json` or `{suite-name}-{semver}.json`.
|
|
54
|
-
- Do not store raw API responses, secrets, tokens, or user data.
|
|
55
|
-
- Historical phase outcomes are consolidated in `docs/archive/HISTORY.md`.
|
|
56
|
-
- Live benchmark reporting rules are in `docs/benchmark-reference.md`.
|
|
57
|
-
|
|
58
|
-
## Why This Exists
|
|
59
|
-
|
|
60
|
-
Claims such as "40% token saving" or "rule adherence improved" need reproducible evidence. These suites are the comparator surface for README, changelog, release, and planning claims.
|