@interf/compiler 0.3.4 → 0.4.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +131 -149
- package/builtin-workflows/interf/README.md +19 -0
- package/builtin-workflows/interf/compile/stages/shape/SKILL.md +28 -0
- package/builtin-workflows/interf/compile/stages/structure/SKILL.md +18 -0
- package/builtin-workflows/interf/compile/stages/summarize/SKILL.md +18 -0
- package/builtin-workflows/interf/improve/SKILL.md +18 -0
- package/builtin-workflows/interf/use/query/SKILL.md +28 -0
- package/builtin-workflows/interf/workflow.json +120 -0
- package/builtin-workflows/interf/workspace.schema.json +75 -0
- package/dist/bin.d.ts +0 -1
- package/dist/bin.js +0 -1
- package/dist/commands/compile-controller.d.ts +14 -0
- package/dist/commands/compile-controller.js +409 -0
- package/dist/commands/compile.d.ts +8 -9
- package/dist/commands/compile.js +151 -153
- package/dist/commands/create-workflow-wizard.d.ts +4 -2
- package/dist/commands/create-workflow-wizard.js +33 -31
- package/dist/commands/create.d.ts +0 -1
- package/dist/commands/create.js +15 -11
- package/dist/commands/default.d.ts +0 -1
- package/dist/commands/default.js +0 -1
- package/dist/commands/doctor.d.ts +0 -1
- package/dist/commands/doctor.js +1 -16
- package/dist/commands/executor-flow.d.ts +0 -1
- package/dist/commands/executor-flow.js +0 -1
- package/dist/commands/init.d.ts +0 -1
- package/dist/commands/init.js +71 -14
- package/dist/commands/list.d.ts +0 -1
- package/dist/commands/list.js +0 -1
- package/dist/commands/reset.d.ts +0 -1
- package/dist/commands/reset.js +0 -1
- package/dist/commands/source-config-wizard.d.ts +28 -7
- package/dist/commands/source-config-wizard.js +159 -63
- package/dist/commands/status.d.ts +0 -1
- package/dist/commands/status.js +0 -1
- package/dist/commands/test-flow.d.ts +20 -10
- package/dist/commands/test-flow.js +89 -23
- package/dist/commands/test.d.ts +0 -1
- package/dist/commands/test.js +36 -72
- package/dist/commands/verify.d.ts +0 -1
- package/dist/commands/verify.js +0 -1
- package/dist/commands/workspace-flow.d.ts +3 -3
- package/dist/commands/workspace-flow.js +30 -12
- package/dist/index.d.ts +5 -6
- package/dist/index.js +3 -4
- package/dist/lib/agent-args.d.ts +0 -1
- package/dist/lib/agent-args.js +0 -1
- package/dist/lib/agent-constants.d.ts +0 -1
- package/dist/lib/agent-constants.js +0 -1
- package/dist/lib/agent-detection.d.ts +0 -1
- package/dist/lib/agent-detection.js +0 -1
- package/dist/lib/agent-execution.d.ts +0 -1
- package/dist/lib/agent-execution.js +47 -12
- package/dist/lib/agent-logs.d.ts +0 -1
- package/dist/lib/agent-logs.js +0 -1
- package/dist/lib/agent-preflight.d.ts +0 -1
- package/dist/lib/agent-preflight.js +1 -2
- package/dist/lib/agent-render.d.ts +0 -1
- package/dist/lib/agent-render.js +0 -1
- package/dist/lib/agent-shells.d.ts +30 -3
- package/dist/lib/agent-shells.js +517 -54
- package/dist/lib/agent-status.d.ts +0 -1
- package/dist/lib/agent-status.js +0 -1
- package/dist/lib/agent-types.d.ts +0 -1
- package/dist/lib/agent-types.js +0 -1
- package/dist/lib/agents.d.ts +0 -9
- package/dist/lib/agents.js +0 -9
- package/dist/lib/chart-guidance.d.ts +1 -0
- package/dist/lib/chart-guidance.js +8 -0
- package/dist/lib/config.d.ts +0 -3
- package/dist/lib/config.js +0 -5
- package/dist/lib/discovery.d.ts +0 -1
- package/dist/lib/discovery.js +0 -1
- package/dist/lib/execution-profile.d.ts +0 -1
- package/dist/lib/execution-profile.js +0 -1
- package/dist/lib/executors.d.ts +0 -1
- package/dist/lib/executors.js +0 -1
- package/dist/lib/filesystem.d.ts +0 -1
- package/dist/lib/filesystem.js +0 -1
- package/dist/lib/interf-bootstrap.d.ts +0 -1
- package/dist/lib/interf-bootstrap.js +6 -2
- package/dist/lib/interf-detect.d.ts +2 -2
- package/dist/lib/interf-detect.js +25 -8
- package/dist/lib/interf-scaffold.d.ts +0 -1
- package/dist/lib/interf-scaffold.js +54 -21
- package/dist/lib/interf-workflow-package.d.ts +18 -1
- package/dist/lib/interf-workflow-package.js +164 -23
- package/dist/lib/interf.d.ts +1 -2
- package/dist/lib/interf.js +1 -2
- package/dist/lib/local-workflows.d.ts +10 -5
- package/dist/lib/local-workflows.js +208 -97
- package/dist/lib/logger.d.ts +0 -1
- package/dist/lib/logger.js +0 -1
- package/dist/lib/obsidian.d.ts +0 -1
- package/dist/lib/obsidian.js +0 -1
- package/dist/lib/parse.d.ts +0 -1
- package/dist/lib/parse.js +0 -1
- package/dist/lib/registry.d.ts +0 -1
- package/dist/lib/registry.js +0 -1
- package/dist/lib/runtime-acceptance.d.ts +0 -1
- package/dist/lib/runtime-acceptance.js +1 -2
- package/dist/lib/runtime-contracts.d.ts +0 -1
- package/dist/lib/runtime-contracts.js +14 -8
- package/dist/lib/runtime-paths.d.ts +0 -1
- package/dist/lib/runtime-paths.js +5 -10
- package/dist/lib/runtime-prompt.d.ts +0 -1
- package/dist/lib/runtime-prompt.js +8 -23
- package/dist/lib/runtime-reconcile.d.ts +0 -1
- package/dist/lib/runtime-reconcile.js +7 -3
- package/dist/lib/runtime-runs.d.ts +0 -1
- package/dist/lib/runtime-runs.js +4 -5
- package/dist/lib/runtime-types.d.ts +0 -1
- package/dist/lib/runtime-types.js +0 -1
- package/dist/lib/runtime.d.ts +0 -1
- package/dist/lib/runtime.js +0 -1
- package/dist/lib/schema.d.ts +356 -51
- package/dist/lib/schema.js +189 -54
- package/dist/lib/source-config.d.ts +17 -8
- package/dist/lib/source-config.js +125 -11
- package/dist/lib/state-artifacts.d.ts +0 -1
- package/dist/lib/state-artifacts.js +0 -1
- package/dist/lib/state-health.d.ts +0 -1
- package/dist/lib/state-health.js +2 -3
- package/dist/lib/state-io.d.ts +1 -1
- package/dist/lib/state-io.js +9 -10
- package/dist/lib/state-paths.d.ts +0 -1
- package/dist/lib/state-paths.js +5 -11
- package/dist/lib/state-view.d.ts +0 -1
- package/dist/lib/state-view.js +7 -8
- package/dist/lib/state.d.ts +0 -1
- package/dist/lib/state.js +0 -1
- package/dist/lib/summarize-plan.d.ts +0 -1
- package/dist/lib/summarize-plan.js +3 -3
- package/dist/lib/test-execution.d.ts +14 -0
- package/dist/lib/{benchmark-execution.js → test-execution.js} +122 -120
- package/dist/lib/test-matrices.d.ts +90 -0
- package/dist/lib/test-matrices.js +96 -0
- package/dist/lib/test-paths.d.ts +12 -0
- package/dist/lib/test-paths.js +44 -0
- package/dist/lib/test-profile-presets.d.ts +57 -0
- package/dist/lib/test-profile-presets.js +50 -0
- package/dist/lib/test-sandbox.d.ts +11 -0
- package/dist/lib/{benchmark-sandbox.js → test-sandbox.js} +18 -13
- package/dist/lib/test-specs.d.ts +7 -0
- package/dist/lib/test-specs.js +114 -0
- package/dist/lib/test-targets.d.ts +5 -0
- package/dist/lib/test-targets.js +38 -0
- package/dist/lib/test-types.d.ts +17 -0
- package/dist/lib/test-types.js +1 -0
- package/dist/lib/test.d.ts +4 -0
- package/dist/lib/test.js +3 -0
- package/dist/lib/user-config.d.ts +0 -1
- package/dist/lib/user-config.js +0 -1
- package/dist/lib/util.d.ts +0 -2
- package/dist/lib/util.js +0 -2
- package/dist/lib/validate-helpers.d.ts +0 -1
- package/dist/lib/validate-helpers.js +0 -1
- package/dist/lib/validate-workspace.d.ts +0 -1
- package/dist/lib/validate-workspace.js +34 -25
- package/dist/lib/validate.d.ts +0 -1
- package/dist/lib/validate.js +55 -9
- package/dist/lib/workflow-abi.d.ts +138 -0
- package/dist/lib/workflow-abi.js +181 -0
- package/dist/lib/workflow-definitions.d.ts +26 -5
- package/dist/lib/workflow-definitions.js +105 -168
- package/dist/lib/workflow-helpers.d.ts +1 -2
- package/dist/lib/workflow-helpers.js +32 -21
- package/dist/lib/workflow-improvement.d.ts +22 -0
- package/dist/lib/workflow-improvement.js +396 -0
- package/dist/lib/workflow-review-paths.d.ts +10 -0
- package/dist/lib/workflow-review-paths.js +27 -0
- package/dist/lib/workflow-stage-runner.d.ts +1 -1
- package/dist/lib/workflow-stage-runner.js +4 -1
- package/dist/lib/workflows.d.ts +1 -2
- package/dist/lib/workflows.js +1 -2
- package/dist/lib/workspace-compile.d.ts +0 -1
- package/dist/lib/workspace-compile.js +146 -109
- package/dist/lib/workspace-home.d.ts +5 -0
- package/dist/lib/workspace-home.js +32 -0
- package/dist/lib/workspace-layout.d.ts +2 -0
- package/dist/lib/workspace-layout.js +60 -0
- package/dist/lib/workspace-paths.d.ts +41 -0
- package/dist/lib/workspace-paths.js +107 -0
- package/dist/lib/workspace-raw.d.ts +20 -2
- package/dist/lib/workspace-raw.js +6 -8
- package/dist/lib/workspace-reset.d.ts +0 -1
- package/dist/lib/workspace-reset.js +27 -5
- package/dist/lib/workspace-schema.d.ts +1 -10
- package/dist/lib/workspace-schema.js +16 -74
- package/package.json +16 -15
- package/dist/bin.d.ts.map +0 -1
- package/dist/bin.js.map +0 -1
- package/dist/commands/compile.d.ts.map +0 -1
- package/dist/commands/compile.js.map +0 -1
- package/dist/commands/create-workflow-wizard.d.ts.map +0 -1
- package/dist/commands/create-workflow-wizard.js.map +0 -1
- package/dist/commands/create.d.ts.map +0 -1
- package/dist/commands/create.js.map +0 -1
- package/dist/commands/default.d.ts.map +0 -1
- package/dist/commands/default.js.map +0 -1
- package/dist/commands/doctor.d.ts.map +0 -1
- package/dist/commands/doctor.js.map +0 -1
- package/dist/commands/executor-flow.d.ts.map +0 -1
- package/dist/commands/executor-flow.js.map +0 -1
- package/dist/commands/init.d.ts.map +0 -1
- package/dist/commands/init.js.map +0 -1
- package/dist/commands/list.d.ts.map +0 -1
- package/dist/commands/list.js.map +0 -1
- package/dist/commands/reset.d.ts.map +0 -1
- package/dist/commands/reset.js.map +0 -1
- package/dist/commands/source-config-wizard.d.ts.map +0 -1
- package/dist/commands/source-config-wizard.js.map +0 -1
- package/dist/commands/status.d.ts.map +0 -1
- package/dist/commands/status.js.map +0 -1
- package/dist/commands/test-flow.d.ts.map +0 -1
- package/dist/commands/test-flow.js.map +0 -1
- package/dist/commands/test.d.ts.map +0 -1
- package/dist/commands/test.js.map +0 -1
- package/dist/commands/verify.d.ts.map +0 -1
- package/dist/commands/verify.js.map +0 -1
- package/dist/commands/workspace-flow.d.ts.map +0 -1
- package/dist/commands/workspace-flow.js.map +0 -1
- package/dist/index.d.ts.map +0 -1
- package/dist/index.js.map +0 -1
- package/dist/lib/agent-args.d.ts.map +0 -1
- package/dist/lib/agent-args.js.map +0 -1
- package/dist/lib/agent-constants.d.ts.map +0 -1
- package/dist/lib/agent-constants.js.map +0 -1
- package/dist/lib/agent-detection.d.ts.map +0 -1
- package/dist/lib/agent-detection.js.map +0 -1
- package/dist/lib/agent-execution.d.ts.map +0 -1
- package/dist/lib/agent-execution.js.map +0 -1
- package/dist/lib/agent-logs.d.ts.map +0 -1
- package/dist/lib/agent-logs.js.map +0 -1
- package/dist/lib/agent-preflight.d.ts.map +0 -1
- package/dist/lib/agent-preflight.js.map +0 -1
- package/dist/lib/agent-render.d.ts.map +0 -1
- package/dist/lib/agent-render.js.map +0 -1
- package/dist/lib/agent-shells.d.ts.map +0 -1
- package/dist/lib/agent-shells.js.map +0 -1
- package/dist/lib/agent-skills.d.ts +0 -21
- package/dist/lib/agent-skills.d.ts.map +0 -1
- package/dist/lib/agent-skills.js +0 -215
- package/dist/lib/agent-skills.js.map +0 -1
- package/dist/lib/agent-status.d.ts.map +0 -1
- package/dist/lib/agent-status.js.map +0 -1
- package/dist/lib/agent-types.d.ts.map +0 -1
- package/dist/lib/agent-types.js.map +0 -1
- package/dist/lib/agents.d.ts.map +0 -1
- package/dist/lib/agents.js.map +0 -1
- package/dist/lib/benchmark-execution.d.ts +0 -13
- package/dist/lib/benchmark-execution.d.ts.map +0 -1
- package/dist/lib/benchmark-execution.js.map +0 -1
- package/dist/lib/benchmark-paths.d.ts +0 -13
- package/dist/lib/benchmark-paths.d.ts.map +0 -1
- package/dist/lib/benchmark-paths.js +0 -44
- package/dist/lib/benchmark-paths.js.map +0 -1
- package/dist/lib/benchmark-sandbox.d.ts +0 -12
- package/dist/lib/benchmark-sandbox.d.ts.map +0 -1
- package/dist/lib/benchmark-sandbox.js.map +0 -1
- package/dist/lib/benchmark-specs.d.ts +0 -8
- package/dist/lib/benchmark-specs.d.ts.map +0 -1
- package/dist/lib/benchmark-specs.js +0 -115
- package/dist/lib/benchmark-specs.js.map +0 -1
- package/dist/lib/benchmark-targets.d.ts +0 -5
- package/dist/lib/benchmark-targets.d.ts.map +0 -1
- package/dist/lib/benchmark-targets.js +0 -38
- package/dist/lib/benchmark-targets.js.map +0 -1
- package/dist/lib/benchmark-types.d.ts +0 -18
- package/dist/lib/benchmark-types.d.ts.map +0 -1
- package/dist/lib/benchmark-types.js +0 -2
- package/dist/lib/benchmark-types.js.map +0 -1
- package/dist/lib/benchmark.d.ts +0 -5
- package/dist/lib/benchmark.d.ts.map +0 -1
- package/dist/lib/benchmark.js +0 -4
- package/dist/lib/benchmark.js.map +0 -1
- package/dist/lib/config.d.ts.map +0 -1
- package/dist/lib/config.js.map +0 -1
- package/dist/lib/discovery.d.ts.map +0 -1
- package/dist/lib/discovery.js.map +0 -1
- package/dist/lib/eval-packs.d.ts +0 -158
- package/dist/lib/eval-packs.d.ts.map +0 -1
- package/dist/lib/eval-packs.js +0 -149
- package/dist/lib/eval-packs.js.map +0 -1
- package/dist/lib/execution-profile.d.ts.map +0 -1
- package/dist/lib/execution-profile.js.map +0 -1
- package/dist/lib/executors.d.ts.map +0 -1
- package/dist/lib/executors.js.map +0 -1
- package/dist/lib/filesystem.d.ts.map +0 -1
- package/dist/lib/filesystem.js.map +0 -1
- package/dist/lib/interf-bootstrap.d.ts.map +0 -1
- package/dist/lib/interf-bootstrap.js.map +0 -1
- package/dist/lib/interf-detect.d.ts.map +0 -1
- package/dist/lib/interf-detect.js.map +0 -1
- package/dist/lib/interf-scaffold.d.ts.map +0 -1
- package/dist/lib/interf-scaffold.js.map +0 -1
- package/dist/lib/interf-workflow-package.d.ts.map +0 -1
- package/dist/lib/interf-workflow-package.js.map +0 -1
- package/dist/lib/interf.d.ts.map +0 -1
- package/dist/lib/interf.js.map +0 -1
- package/dist/lib/local-workflows.d.ts.map +0 -1
- package/dist/lib/local-workflows.js.map +0 -1
- package/dist/lib/logger.d.ts.map +0 -1
- package/dist/lib/logger.js.map +0 -1
- package/dist/lib/obsidian.d.ts.map +0 -1
- package/dist/lib/obsidian.js.map +0 -1
- package/dist/lib/parse.d.ts.map +0 -1
- package/dist/lib/parse.js.map +0 -1
- package/dist/lib/registry.d.ts.map +0 -1
- package/dist/lib/registry.js.map +0 -1
- package/dist/lib/runtime-acceptance.d.ts.map +0 -1
- package/dist/lib/runtime-acceptance.js.map +0 -1
- package/dist/lib/runtime-contracts.d.ts.map +0 -1
- package/dist/lib/runtime-contracts.js.map +0 -1
- package/dist/lib/runtime-paths.d.ts.map +0 -1
- package/dist/lib/runtime-paths.js.map +0 -1
- package/dist/lib/runtime-prompt.d.ts.map +0 -1
- package/dist/lib/runtime-prompt.js.map +0 -1
- package/dist/lib/runtime-reconcile.d.ts.map +0 -1
- package/dist/lib/runtime-reconcile.js.map +0 -1
- package/dist/lib/runtime-runs.d.ts.map +0 -1
- package/dist/lib/runtime-runs.js.map +0 -1
- package/dist/lib/runtime-types.d.ts.map +0 -1
- package/dist/lib/runtime-types.js.map +0 -1
- package/dist/lib/runtime.d.ts.map +0 -1
- package/dist/lib/runtime.js.map +0 -1
- package/dist/lib/schema.d.ts.map +0 -1
- package/dist/lib/schema.js.map +0 -1
- package/dist/lib/source-config.d.ts.map +0 -1
- package/dist/lib/source-config.js.map +0 -1
- package/dist/lib/state-artifacts.d.ts.map +0 -1
- package/dist/lib/state-artifacts.js.map +0 -1
- package/dist/lib/state-health.d.ts.map +0 -1
- package/dist/lib/state-health.js.map +0 -1
- package/dist/lib/state-io.d.ts.map +0 -1
- package/dist/lib/state-io.js.map +0 -1
- package/dist/lib/state-paths.d.ts.map +0 -1
- package/dist/lib/state-paths.js.map +0 -1
- package/dist/lib/state-view.d.ts.map +0 -1
- package/dist/lib/state-view.js.map +0 -1
- package/dist/lib/state.d.ts.map +0 -1
- package/dist/lib/state.js.map +0 -1
- package/dist/lib/summarize-plan.d.ts.map +0 -1
- package/dist/lib/summarize-plan.js.map +0 -1
- package/dist/lib/user-config.d.ts.map +0 -1
- package/dist/lib/user-config.js.map +0 -1
- package/dist/lib/util.d.ts.map +0 -1
- package/dist/lib/util.js.map +0 -1
- package/dist/lib/validate-helpers.d.ts.map +0 -1
- package/dist/lib/validate-helpers.js.map +0 -1
- package/dist/lib/validate-workspace.d.ts.map +0 -1
- package/dist/lib/validate-workspace.js.map +0 -1
- package/dist/lib/validate.d.ts.map +0 -1
- package/dist/lib/validate.js.map +0 -1
- package/dist/lib/workflow-definitions.d.ts.map +0 -1
- package/dist/lib/workflow-definitions.js.map +0 -1
- package/dist/lib/workflow-helpers.d.ts.map +0 -1
- package/dist/lib/workflow-helpers.js.map +0 -1
- package/dist/lib/workflow-stage-runner.d.ts.map +0 -1
- package/dist/lib/workflow-stage-runner.js.map +0 -1
- package/dist/lib/workflow-starter-docs.d.ts +0 -7
- package/dist/lib/workflow-starter-docs.d.ts.map +0 -1
- package/dist/lib/workflow-starter-docs.js +0 -3
- package/dist/lib/workflow-starter-docs.js.map +0 -1
- package/dist/lib/workflows.d.ts.map +0 -1
- package/dist/lib/workflows.js.map +0 -1
- package/dist/lib/workspace-compile.d.ts.map +0 -1
- package/dist/lib/workspace-compile.js.map +0 -1
- package/dist/lib/workspace-docs.d.ts +0 -3
- package/dist/lib/workspace-docs.d.ts.map +0 -1
- package/dist/lib/workspace-docs.js +0 -82
- package/dist/lib/workspace-docs.js.map +0 -1
- package/dist/lib/workspace-raw.d.ts.map +0 -1
- package/dist/lib/workspace-raw.js.map +0 -1
- package/dist/lib/workspace-reset.d.ts.map +0 -1
- package/dist/lib/workspace-reset.js.map +0 -1
- package/dist/lib/workspace-schema.d.ts.map +0 -1
- package/dist/lib/workspace-schema.js.map +0 -1
- package/skills/benchmark/SKILL.md +0 -122
- package/skills/workflow/create/SKILL.md +0 -141
- package/skills/workspace/shape/SKILL.md +0 -15
- package/skills/workspace/structure/SKILL.md +0 -15
- package/skills/workspace/summarize/SKILL.md +0 -15
- package/templates/workspace/README.md +0 -24
- package/templates/workspace/interfignore +0 -2
|
@@ -1,122 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
{
|
|
3
|
-
"name": "benchmark",
|
|
4
|
-
"description": "Compare compiled workspaces with Interf Compiler's file-based benchmark specs. Use when asked to benchmark, compare workflows, compare compiled workspaces, or run checks on already-compiled Interf Compiler targets."
|
|
5
|
-
}
|
|
6
|
-
---
|
|
7
|
-
|
|
8
|
-
# Benchmark Compiled Workspaces
|
|
9
|
-
|
|
10
|
-
Use this skill when the job is to compare compiled outputs built by Interf Compiler, not to build them from scratch.
|
|
11
|
-
|
|
12
|
-
Prefer the CLI:
|
|
13
|
-
|
|
14
|
-
```bash
|
|
15
|
-
interf test
|
|
16
|
-
```
|
|
17
|
-
|
|
18
|
-
This skill is for:
|
|
19
|
-
- comparing compiled workspaces built from the same source folder
|
|
20
|
-
- creating or refining simple benchmark specs under `interf/benchmarks/`
|
|
21
|
-
- summarizing which workflow or compiled workspace performed better on deterministic checks
|
|
22
|
-
|
|
23
|
-
This skill is **not** for:
|
|
24
|
-
- compiling a workspace
|
|
25
|
-
- inventing a second benchmark system outside Interf Compiler's filesystem contract
|
|
26
|
-
|
|
27
|
-
## Source of truth
|
|
28
|
-
|
|
29
|
-
- benchmark specs in `interf/benchmarks/`
|
|
30
|
-
- saved benchmark runs in `interf/benchmarks/runs/`
|
|
31
|
-
- current target eligibility from `interf status`
|
|
32
|
-
- public command: `interf test`
|
|
33
|
-
- technical alias: `interf benchmark`
|
|
34
|
-
|
|
35
|
-
When this skill is used inside a generated workspace, do not try to open SDK repo source files outside the current workspace. The benchmark spec files and saved run artifacts are the source of truth.
|
|
36
|
-
|
|
37
|
-
## Benchmark model
|
|
38
|
-
|
|
39
|
-
Interf Compiler benchmark specs are file-first and deterministic by default.
|
|
40
|
-
|
|
41
|
-
They live under `interf/benchmarks/`.
|
|
42
|
-
|
|
43
|
-
Saved benchmark runs live under `interf/benchmarks/runs/workspace/`.
|
|
44
|
-
|
|
45
|
-
Minimal example:
|
|
46
|
-
|
|
47
|
-
```json
|
|
48
|
-
{
|
|
49
|
-
"type": "workspace",
|
|
50
|
-
"name": "Weekly Brief Quality",
|
|
51
|
-
"description": "Compare weekly briefing workspaces.",
|
|
52
|
-
"cases": [
|
|
53
|
-
{
|
|
54
|
-
"id": "current-state",
|
|
55
|
-
"question": "Does this workspace clearly say what changed and what matters next?",
|
|
56
|
-
"file": "home.md",
|
|
57
|
-
"expect": {
|
|
58
|
-
"must_include": ["launch", "people"],
|
|
59
|
-
"must_not_include": ["TODO"],
|
|
60
|
-
"min_words": 5
|
|
61
|
-
}
|
|
62
|
-
}
|
|
63
|
-
]
|
|
64
|
-
}
|
|
65
|
-
```
|
|
66
|
-
|
|
67
|
-
Interpretation:
|
|
68
|
-
- `question` = plain-English assertion the user cares about
|
|
69
|
-
- `file` = output artifact to inspect
|
|
70
|
-
- `expect` = deterministic checks
|
|
71
|
-
|
|
72
|
-
Do not replace this with opaque judge prompts by default.
|
|
73
|
-
|
|
74
|
-
## Eligibility rules
|
|
75
|
-
|
|
76
|
-
Only benchmark targets whose status is currently `compiled`.
|
|
77
|
-
|
|
78
|
-
Use:
|
|
79
|
-
|
|
80
|
-
```bash
|
|
81
|
-
interf status
|
|
82
|
-
```
|
|
83
|
-
|
|
84
|
-
or the benchmark wizard itself to confirm eligibility.
|
|
85
|
-
|
|
86
|
-
If a target is `stale`, `failed`, or `idle`, do not benchmark it yet. Recompile first.
|
|
87
|
-
|
|
88
|
-
## Recommended flow
|
|
89
|
-
|
|
90
|
-
1. Confirm the source folder and target type.
|
|
91
|
-
2. Confirm the selected workspaces are compiled.
|
|
92
|
-
3. Reuse an existing benchmark spec if one already expresses the user's assertion.
|
|
93
|
-
4. Otherwise create a small benchmark spec with:
|
|
94
|
-
- one clear question per case
|
|
95
|
-
- one output file per case
|
|
96
|
-
- a few deterministic checks
|
|
97
|
-
5. Run `interf test`.
|
|
98
|
-
6. Read the saved run artifact under `interf/benchmarks/runs/`.
|
|
99
|
-
7. Summarize pass/fail differences and what they imply about the workflow or workspace.
|
|
100
|
-
|
|
101
|
-
## Authoring guidance
|
|
102
|
-
|
|
103
|
-
Prefer:
|
|
104
|
-
- small JSON files
|
|
105
|
-
- plain English
|
|
106
|
-
- deterministic checks
|
|
107
|
-
- reusable assertions that can be run again after changes
|
|
108
|
-
|
|
109
|
-
Avoid:
|
|
110
|
-
- giant benchmark files
|
|
111
|
-
- exact-answer matching
|
|
112
|
-
- judge-style prompt evaluation as the default
|
|
113
|
-
- workflow-specific assumptions hardcoded into the benchmark unless the benchmark is intentionally for that workflow
|
|
114
|
-
|
|
115
|
-
## Reporting guidance
|
|
116
|
-
|
|
117
|
-
When summarizing a benchmark run:
|
|
118
|
-
- say which targets were compared
|
|
119
|
-
- say which cases passed or failed
|
|
120
|
-
- point to the saved run file
|
|
121
|
-
- explain what the failures imply about the current workflow or workspace
|
|
122
|
-
- keep benchmark conclusions separate from subjective product opinions
|
|
@@ -1,141 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
{
|
|
3
|
-
"name": "workflow/create",
|
|
4
|
-
"description": "Create or refine an Interf Compiler workflow package. Use when asked to define a workspace workflow, author workflow.json, shape compile stages, or add declarative stage acceptance criteria."
|
|
5
|
-
}
|
|
6
|
-
---
|
|
7
|
-
|
|
8
|
-
# Create Workflow
|
|
9
|
-
|
|
10
|
-
Use this skill when shaping a reusable Interf Compiler workflow package.
|
|
11
|
-
|
|
12
|
-
Prefer the CLI first:
|
|
13
|
-
|
|
14
|
-
```bash
|
|
15
|
-
interf create workflow
|
|
16
|
-
```
|
|
17
|
-
|
|
18
|
-
That wizard should create the initial package under:
|
|
19
|
-
|
|
20
|
-
```text
|
|
21
|
-
interf/workflows/<workflow-id>/
|
|
22
|
-
```
|
|
23
|
-
|
|
24
|
-
Then refine the package in place.
|
|
25
|
-
|
|
26
|
-
## What a workflow is
|
|
27
|
-
|
|
28
|
-
A workflow is a package, not just a JSON file.
|
|
29
|
-
|
|
30
|
-
It has two layers:
|
|
31
|
-
|
|
32
|
-
- `workflow.json` = machine-readable stage graph and contract mapping
|
|
33
|
-
- `workspace.schema.json` = deterministic compiled-workspace shape
|
|
34
|
-
- local docs = human/agent method layer
|
|
35
|
-
|
|
36
|
-
Typical shape:
|
|
37
|
-
|
|
38
|
-
```text
|
|
39
|
-
interf/workflows/<workflow-id>/
|
|
40
|
-
workflow.json
|
|
41
|
-
workspace.schema.json
|
|
42
|
-
README.md
|
|
43
|
-
create/
|
|
44
|
-
SKILL.md
|
|
45
|
-
compile/
|
|
46
|
-
stages/
|
|
47
|
-
<stage-id>/
|
|
48
|
-
SKILL.md
|
|
49
|
-
use/
|
|
50
|
-
query/
|
|
51
|
-
SKILL.md
|
|
52
|
-
```
|
|
53
|
-
|
|
54
|
-
## What `workflow.json` should define
|
|
55
|
-
|
|
56
|
-
Keep it declarative.
|
|
57
|
-
|
|
58
|
-
- `id`
|
|
59
|
-
- `type`
|
|
60
|
-
- `label`
|
|
61
|
-
- `hint`
|
|
62
|
-
- optional `extends`
|
|
63
|
-
- optional `stages`
|
|
64
|
-
- optional `stage_policy_notes`
|
|
65
|
-
|
|
66
|
-
Each stage can define:
|
|
67
|
-
|
|
68
|
-
- `id`
|
|
69
|
-
- `label`
|
|
70
|
-
- `contract_type`
|
|
71
|
-
- optional `skill_dir`
|
|
72
|
-
- optional `description`
|
|
73
|
-
- optional `acceptance`
|
|
74
|
-
|
|
75
|
-
## Contract kinds
|
|
76
|
-
|
|
77
|
-
Use the shipped workspace contract families only:
|
|
78
|
-
|
|
79
|
-
- `workspace-file-evidence`
|
|
80
|
-
- `workspace-knowledge-structure`
|
|
81
|
-
- `workspace-query-shape`
|
|
82
|
-
|
|
83
|
-
Do not invent new engine contract kinds in a local workflow package.
|
|
84
|
-
|
|
85
|
-
## Workspace schema
|
|
86
|
-
|
|
87
|
-
Every workflow package should also define `workspace.schema.json`.
|
|
88
|
-
|
|
89
|
-
It should describe the deterministic output zones Interf Compiler expects, including:
|
|
90
|
-
|
|
91
|
-
- `raw/`
|
|
92
|
-
- `summaries/`
|
|
93
|
-
- `knowledge/entities/`
|
|
94
|
-
- `knowledge/claims/`
|
|
95
|
-
- `knowledge/indexes/`
|
|
96
|
-
- `home.md`
|
|
97
|
-
- `.interf/`
|
|
98
|
-
|
|
99
|
-
Use `owned_by` to show which stage ids are responsible for each zone. This keeps the reusable workflow package aligned with the compiled workspace ABI.
|
|
100
|
-
|
|
101
|
-
## Declarative acceptance
|
|
102
|
-
|
|
103
|
-
Use stage `acceptance` for deterministic stage checks that the CLI can compare against runtime state.
|
|
104
|
-
|
|
105
|
-
Current acceptance fields:
|
|
106
|
-
|
|
107
|
-
- `artifacts_exist`
|
|
108
|
-
- `state_truthy`
|
|
109
|
-
- `state_equals_counts`
|
|
110
|
-
- `state_at_least`
|
|
111
|
-
- `state_at_least_counts`
|
|
112
|
-
|
|
113
|
-
Use dynamic counts when possible.
|
|
114
|
-
|
|
115
|
-
Good:
|
|
116
|
-
- `"summarized": "target_files"`
|
|
117
|
-
- `"structured": "summary_total"`
|
|
118
|
-
- `"shaped": "summary_total"`
|
|
119
|
-
- `"compiled": "summary_total"`
|
|
120
|
-
|
|
121
|
-
Avoid hardcoding fixed file counts unless the workflow really requires them.
|
|
122
|
-
|
|
123
|
-
## Builder rules
|
|
124
|
-
|
|
125
|
-
- keep `workflow.json` readable and declarative
|
|
126
|
-
- put execution guidance in `SKILL.md` files, not in dense JSON prose
|
|
127
|
-
- let the CLI own runtime state, verification, and pass/fail
|
|
128
|
-
- use `AGENTS.md` as the workspace router after scaffolding, not as the reusable workflow spec
|
|
129
|
-
- prefer extending shipped workflows before inventing a new stage graph
|
|
130
|
-
|
|
131
|
-
## Outcome
|
|
132
|
-
|
|
133
|
-
A good workflow package gives Interf Compiler:
|
|
134
|
-
|
|
135
|
-
- a compile pipeline
|
|
136
|
-
- a deterministic workspace schema
|
|
137
|
-
- stage-to-contract mapping
|
|
138
|
-
- readable local docs for executors
|
|
139
|
-
- optional declarative acceptance checks
|
|
140
|
-
|
|
141
|
-
The goal is not to write code inside the workflow. The goal is to define a stage pipeline that Interf Compiler can enforce.
|
|
@@ -1,15 +0,0 @@
|
|
|
1
|
-
# Workspace Shape
|
|
2
|
-
|
|
3
|
-
Shape the final workspace surface around the workspace focus and saved truth checks.
|
|
4
|
-
|
|
5
|
-
Requirements:
|
|
6
|
-
- read the shaping input named in the stage contract
|
|
7
|
-
- treat the shaping input as focus plus question text only
|
|
8
|
-
- write `home.md` and any focused indexes needed under `knowledge/indexes/`
|
|
9
|
-
- bias routing, prioritization, and navigation toward the job this workspace should answer well
|
|
10
|
-
- use the existing knowledge structure instead of redoing extraction work
|
|
11
|
-
- do not copy expected answers into the workspace
|
|
12
|
-
- prefer better retrieval routes over speculative synthesis
|
|
13
|
-
|
|
14
|
-
Output goal:
|
|
15
|
-
- a final workspace surface that is easier for agents to navigate and use correctly
|
|
@@ -1,15 +0,0 @@
|
|
|
1
|
-
# Workspace Structure
|
|
2
|
-
|
|
3
|
-
Build the cross-file knowledge structure from the summary set.
|
|
4
|
-
|
|
5
|
-
Requirements:
|
|
6
|
-
- read `summaries/` and `.interf/inventory.json`
|
|
7
|
-
- write durable notes under `knowledge/entities/`, `knowledge/claims/`, and `knowledge/indexes/`
|
|
8
|
-
- canonicalize entities, claims, categories, timelines, and other retrieval structure
|
|
9
|
-
- use taxonomy and ontology only to improve retrieval, navigation, and evidence tracking
|
|
10
|
-
- prefer small stable notes over one giant catch-all file
|
|
11
|
-
- do not write `home.md` in this stage
|
|
12
|
-
- do not copy expected answers from saved checks
|
|
13
|
-
|
|
14
|
-
Output goal:
|
|
15
|
-
- a reusable cross-file structure that later shaping can route through
|
|
@@ -1,15 +0,0 @@
|
|
|
1
|
-
# Workspace Summarize
|
|
2
|
-
|
|
3
|
-
Turn raw source files into per-file evidence notes under `summaries/`.
|
|
4
|
-
|
|
5
|
-
Requirements:
|
|
6
|
-
- process only the files listed in the stage contract
|
|
7
|
-
- write one markdown summary per source file
|
|
8
|
-
- use JSON frontmatter, not YAML
|
|
9
|
-
- include `source`, `source_kind`, `evidence_tier`, `truth_mode`, `state`, and `abstract`
|
|
10
|
-
- include a readable `## Abstract` block in the body
|
|
11
|
-
- keep summaries source-grounded and conservative
|
|
12
|
-
- do not do broad cross-file synthesis in this stage
|
|
13
|
-
|
|
14
|
-
Output goal:
|
|
15
|
-
- a clean per-file evidence layer the later stages can trust
|
|
@@ -1,24 +0,0 @@
|
|
|
1
|
-
# Workspace Template
|
|
2
|
-
|
|
3
|
-
This directory contains bundled helper files for compiled workspaces.
|
|
4
|
-
|
|
5
|
-
Interf Compiler creates compiled workspaces under:
|
|
6
|
-
|
|
7
|
-
```text
|
|
8
|
-
interf/workspaces/<name>/
|
|
9
|
-
```
|
|
10
|
-
|
|
11
|
-
The generated workspace is a file-based layer on top of your raw files.
|
|
12
|
-
|
|
13
|
-
Interf Compiler scaffolds:
|
|
14
|
-
|
|
15
|
-
- `interf.json`
|
|
16
|
-
- `AGENTS.md`
|
|
17
|
-
- `CLAUDE.md`
|
|
18
|
-
- `home.md`
|
|
19
|
-
- `workflow/`
|
|
20
|
-
- `workflow/workspace.schema.json`
|
|
21
|
-
- `.interf/`
|
|
22
|
-
- `.interfignore`
|
|
23
|
-
|
|
24
|
-
The source folder remains the human control plane for the dataset. The compiled workspace is the agent-facing surface.
|