ai-capability-framework 1.0.0-rc.3 → 1.0.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +97 -103
- package/CODE_OF_CONDUCT.md +11 -13
- package/CONTRIBUTING.md +40 -43
- package/GOVERNANCE.md +34 -35
- package/README.md +99 -63
- package/ROADMAP.md +12 -12
- package/SECURITY.md +15 -15
- package/dist/audit/ledger.d.ts.map +1 -1
- package/dist/audit/ledger.js +2 -1
- package/dist/audit/records.d.ts.map +1 -1
- package/dist/audit/records.js +2 -1
- package/dist/audit/types.d.ts +4 -1
- package/dist/audit/types.d.ts.map +1 -1
- package/dist/aws/dynamodb-stores.d.ts +2 -7
- package/dist/aws/dynamodb-stores.d.ts.map +1 -1
- package/dist/aws/dynamodb-stores.js +56 -5
- package/dist/aws/testing.d.ts.map +1 -1
- package/dist/aws/testing.js +9 -0
- package/dist/cli.d.ts +6 -6
- package/dist/cli.d.ts.map +1 -1
- package/dist/cli.js +77 -7
- package/dist/evals-live/index.d.ts +2 -2
- package/dist/evals-live/index.d.ts.map +1 -1
- package/dist/evals-live/index.js +1 -1
- package/dist/evals-live/live-eval-runner.d.ts +49 -1
- package/dist/evals-live/live-eval-runner.d.ts.map +1 -1
- package/dist/evals-live/live-eval-runner.js +246 -4
- package/dist/evals-live/types.d.ts +62 -9
- package/dist/evals-live/types.d.ts.map +1 -1
- package/dist/index.d.ts +0 -1
- package/dist/index.d.ts.map +1 -1
- package/dist/index.js +0 -1
- package/dist/runtime/actions.d.ts +2 -0
- package/dist/runtime/actions.d.ts.map +1 -1
- package/dist/runtime/actions.js +200 -55
- package/dist/runtime/index.d.ts +1 -1
- package/dist/runtime/index.d.ts.map +1 -1
- package/dist/runtime/stores.d.ts +2 -7
- package/dist/runtime/stores.d.ts.map +1 -1
- package/dist/runtime/stores.js +12 -0
- package/dist/runtime/types.d.ts +25 -6
- package/dist/runtime/types.d.ts.map +1 -1
- package/docs/action-lifecycle.md +38 -32
- package/docs/adapter-roadmap.md +51 -49
- package/docs/adapters.md +14 -15
- package/docs/ai-sdk-runtime.md +36 -39
- package/docs/anthropic-runtime.md +29 -32
- package/docs/api/public-api-policy.md +59 -0
- package/docs/api.md +354 -371
- package/docs/architecture/current-state.md +28 -31
- package/docs/audit/index.md +29 -29
- package/docs/aws/cloudwatch-telemetry.md +5 -7
- package/docs/aws/dynamodb-single-table.md +8 -9
- package/docs/aws/kms-redaction.md +5 -6
- package/docs/aws/overview.md +5 -5
- package/docs/aws/production-reference.md +13 -14
- package/docs/aws/step-functions-approval.md +7 -9
- package/docs/aws-runtime.md +24 -25
- package/docs/capability-manifests.md +17 -21
- package/docs/control-plane/overview.md +2 -2
- package/docs/control-plane.md +24 -27
- package/docs/controls/index.md +19 -22
- package/docs/core/capability-manifests.md +4 -5
- package/docs/core/entity-manifests.md +5 -5
- package/docs/eval-runner.md +29 -31
- package/docs/evalops.md +13 -14
- package/docs/evals/golden-tests.md +4 -5
- package/docs/evals/overview.md +3 -3
- package/docs/evals/replay-and-trace-to-golden.md +19 -20
- package/docs/evals.md +19 -20
- package/docs/evidence.md +22 -23
- package/docs/gemini-runtime.md +31 -33
- package/docs/getting-started/anthropic-quickstart.md +61 -0
- package/docs/getting-started/concepts.md +9 -10
- package/docs/getting-started/gemini-quickstart.md +62 -0
- package/docs/getting-started/installation.md +3 -3
- package/docs/getting-started/openai-quickstart.md +61 -0
- package/docs/getting-started/provider-neutral-quickstart.md +106 -0
- package/docs/getting-started/quickstart.md +2 -2
- package/docs/getting-started.md +23 -20
- package/docs/glossary.md +31 -48
- package/docs/governance/gate.md +28 -30
- package/docs/governance/impact-and-compatibility.md +2 -3
- package/docs/governance/index.md +53 -54
- package/docs/governance/lifecycle.md +4 -5
- package/docs/governance/overview.md +2 -3
- package/docs/governance/risk-compiler.md +4 -5
- package/docs/host-responsibilities.md +6 -8
- package/docs/implementation-notes/baseline-gaps.md +15 -18
- package/docs/index.md +21 -6
- package/docs/interoperability.md +9 -9
- package/docs/langchain-runtime.md +27 -31
- package/docs/live-evals.md +68 -32
- package/docs/mcp-server-runtime.md +36 -40
- package/docs/memory.md +35 -36
- package/docs/migration-0.1-to-1.0.md +14 -9
- package/docs/observability/overview.md +2 -3
- package/docs/observability-runtime.md +35 -39
- package/docs/openai-responses.md +36 -37
- package/docs/openai-runtime.md +41 -46
- package/docs/openai-walkthrough.md +24 -28
- package/docs/policy-broker.md +9 -10
- package/docs/provenance.md +30 -29
- package/docs/providers/anthropic.md +5 -5
- package/docs/providers/choose-a-runtime.md +37 -0
- package/docs/providers/conformance.md +14 -15
- package/docs/providers/gemini.md +5 -5
- package/docs/providers/mcp.md +2 -3
- package/docs/providers/openai.md +2 -2
- package/docs/providers/semantic-kernel.md +2 -2
- package/docs/providers.md +43 -38
- package/docs/public/license-exceptions.md +187 -0
- package/docs/public/npm-release-preflight.md +112 -0
- package/docs/public-framework/compatibility-policy.md +12 -13
- package/docs/public-framework/deprecation-policy.md +8 -8
- package/docs/public-framework/final-certification-matrix.md +104 -0
- package/docs/public-framework/license-decision.md +20 -0
- package/docs/public-framework/release-process.md +46 -16
- package/docs/public-framework/security-disclosure.md +4 -5
- package/docs/public-framework/v1-certification.md +102 -15
- package/docs/release.md +200 -122
- package/docs/runtime/action-lifecycle.md +3 -3
- package/docs/runtime/policy-broker.md +4 -4
- package/docs/runtime/runtime-overview.md +4 -5
- package/docs/runtime/tool-result-envelope.md +7 -7
- package/docs/runtime.md +90 -93
- package/docs/security/overview.md +4 -4
- package/docs/security/security-packs.md +24 -26
- package/docs/security/trust-taint-redaction.md +42 -47
- package/docs/semantic-kernel-runtime.md +35 -37
- package/docs/spec.md +95 -101
- package/docs/start-here.md +18 -20
- package/examples/01-basic-read-capability/README.md +3 -4
- package/examples/02-prepare-approve-commit/README.md +6 -6
- package/examples/03-multi-provider-tools/README.md +2 -2
- package/examples/04-mcp-server/README.md +4 -5
- package/examples/05-langchain-langgraph-bridge/README.md +4 -5
- package/examples/06-vercel-ai-sdk-bridge/README.md +5 -7
- package/examples/07-policy-broker-custom-auth/README.md +4 -4
- package/examples/08-aws-step-functions-approval/README.md +4 -5
- package/examples/09-security-packs-promptfoo/README.md +4 -4
- package/examples/10-trace-to-golden/README.md +2 -2
- package/examples/11-control-plane/README.md +4 -5
- package/examples/aws/README.md +5 -8
- package/examples/control-plane/README.md +8 -9
- package/examples/control-plane/fixtures/control-plane.seed.json +8 -32
- package/examples/control-plane/public/app.js +57 -18
- package/examples/control-plane/public/index.html +15 -6
- package/examples/control-plane/server.mjs +15 -3
- package/examples/eval-results/public.results.passing.json +6 -21
- package/examples/providers/ai-sdk-next/README.md +11 -8
- package/examples/providers/anthropic-claude/README.md +5 -6
- package/examples/providers/gemini/README.md +6 -6
- package/examples/providers/langchain-agent/README.md +3 -4
- package/examples/providers/langgraph-tool-node/README.md +7 -7
- package/examples/providers/mcp/README.md +8 -8
- package/examples/providers/provider-conformance/README.md +3 -3
- package/examples/providers/semantic-kernel-mcp/README.md +6 -6
- package/examples/providers/semantic-kernel-openapi/README.md +6 -7
- package/examples/runtime-support-billing/README.md +8 -9
- package/examples/runtime-support-billing/support-billing-runtime.mjs +8 -4
- package/examples/scheduling/capabilities/scheduling.availability.get.yaml +2 -2
- package/examples/scheduling/capabilities/scheduling.invite.prepare.yaml +2 -2
- package/examples/scheduling/capabilities/scheduling.invite.send.yaml +2 -2
- package/examples/scheduling/entities/AvailabilitySlot.yaml +2 -2
- package/examples/scheduling/entities/MeetingInvite.yaml +2 -2
- package/examples/scheduling/evals/scheduling.invite.prepare.valid.yaml +3 -1
- package/examples/semantic-kernel-mcp/README.md +11 -12
- package/examples/semantic-kernel-openapi/README.md +8 -8
- package/examples/support/capabilities/support.refund.commit_case.yaml +3 -3
- package/examples/support/capabilities/support.refund.prepare_case.yaml +2 -2
- package/examples/support/capabilities/support.ticket.get.yaml +2 -2
- package/examples/support/entities/Ticket.yaml +0 -1
- package/examples/support/eval-results/support.results.passing.json +3 -12
- package/examples/support/evals/support.refund.prepare_case.approval_required.yaml +3 -1
- package/examples/support/evals/support.refund.prepare_case.valid.yaml +3 -2
- package/examples/support/memory/support.agent.preferences.json +2 -6
- package/examples/support/openai/context.support_agent.json +1 -4
- package/examples/support/provenance/support.refund.summary.provenance.json +2 -6
- package/examples/support/replay/support.refund.approval_required.trace.json +4 -14
- package/package.json +22 -5
- package/schemas/audit/action-record.schema.json +4 -1
- package/schemas/aws/approval-task.schema.json +8 -1
- package/schemas/conformance/conformance-case.schema.json +18 -2
- package/schemas/conformance/conformance-report.schema.json +17 -2
- package/schemas/conformance/provider-target-matrix.schema.json +35 -4
- package/schemas/controls/control-decision.schema.json +7 -1
- package/schemas/eval-case.schema.json +8 -1
- package/schemas/eval-result.schema.json +8 -1
- package/schemas/evidence/evidence-pack.schema.json +34 -5
- package/schemas/governance/compatibility-diff.schema.json +8 -1
- package/schemas/governance/lifecycle-transition.schema.json +10 -1
- package/schemas/governance/risk-compilation-result.schema.json +9 -1
- package/schemas/provenance/generated-content-provenance.schema.json +3 -1
- package/schemas/replay/replay-result.schema.json +16 -2
- package/schemas/replay/replay-trace.schema.json +11 -2
- package/schemas/security/context-segment.schema.json +21 -12
- package/schemas/security/redaction-policy.schema.json +4 -1
- package/schemas/security-packs/coverage-report.schema.json +17 -2
- package/schemas/security-packs/security-case-suite.schema.json +11 -1
- package/schemas/tool-result-envelope.schema.json +9 -1
- package/security-packs/approval_bypass.yaml +12 -2
- package/security-packs/capability_spoofing.yaml +17 -3
- package/security-packs/cost_amplification.yaml +21 -4
- package/security-packs/cross_tenant_access.yaml +16 -3
- package/security-packs/insecure_output_rendering.yaml +15 -4
- package/security-packs/mcp_tool_abuse.yaml +17 -3
- package/security-packs/memory_scope_violation.yaml +19 -4
- package/security-packs/prompt_injection_direct.yaml +19 -4
- package/security-packs/prompt_injection_indirect.yaml +18 -3
- package/security-packs/provider_payload_exposure.yaml +26 -4
- package/security-packs/retrieval_poisoning.yaml +5 -2
- package/security-packs/schema_confusion.yaml +17 -3
- package/security-packs/sensitive_data_disclosure.yaml +22 -5
- package/security-packs/tool_exfiltration.yaml +20 -4
- package/security-packs/tool_result_poisoning.yaml +19 -4
- package/security-packs/unsafe_commit_attempt.yaml +6 -3
package/CHANGELOG.md
CHANGED
|
@@ -4,117 +4,111 @@ All notable public changes to AI Capability Framework are documented here.
|
|
|
4
4
|
|
|
5
5
|
## Unreleased
|
|
6
6
|
|
|
7
|
-
-
|
|
8
|
-
|
|
9
|
-
|
|
10
|
-
- Added
|
|
11
|
-
|
|
12
|
-
|
|
13
|
-
- Added
|
|
14
|
-
|
|
15
|
-
|
|
16
|
-
- Added
|
|
17
|
-
|
|
18
|
-
|
|
19
|
-
|
|
7
|
+
- Prepared the `1.0.0` stable release and made `@aicf/agent-skills` a first-class
|
|
8
|
+
same-version npm artifact in certification, CI, release dry-run, and
|
|
9
|
+
trusted-publishing workflows.
|
|
10
|
+
- Added the final v1.0 certification gate with `check:public`, `check:certification`,
|
|
11
|
+
public certification docs, workflow hardening, and release-readiness assertions for
|
|
12
|
+
v1.0-ready release notes.
|
|
13
|
+
- Added public repository release-readiness hardening with CI, docs, security, and
|
|
14
|
+
release dry-run workflows plus lint, conformance, governance-gate, package, source
|
|
15
|
+
archive, and secret-scan checks.
|
|
16
|
+
- Added a first-time developer onboarding pass with a simplified README, start-here
|
|
17
|
+
guide, OpenAI walkthrough, glossary, and clearer eval/runtime navigation.
|
|
18
|
+
- Added the `ai-capability-framework/runtime` subpath for deterministic runtime context,
|
|
19
|
+
redaction, capability routing, policy brokering, handler registry, no-model
|
|
20
|
+
read/prepare execution, host-controlled action lifecycle, in-memory reference stores,
|
|
21
|
+
audit events, and runtime result envelopes.
|
|
20
22
|
- Added the optional `ai-capability-framework/openai` subpath for a bounded
|
|
21
|
-
non-streaming OpenAI Responses loop with caller-provided clients, routed
|
|
22
|
-
|
|
23
|
-
- Added optional observability, Langfuse, live eval, Promptfoo export, and
|
|
24
|
-
|
|
25
|
-
|
|
26
|
-
- Added the optional `ai-capability-framework/aws` subpath for DynamoDB runtime
|
|
27
|
-
|
|
28
|
-
|
|
29
|
-
|
|
30
|
-
- Added the optional `ai-capability-framework/mcp-server` subpath and OpenAI
|
|
31
|
-
|
|
32
|
-
- Added a public runtime support/billing mock example plus action lifecycle,
|
|
33
|
-
|
|
34
|
-
- Added the `ai-capability-framework/providers` shared foundation for
|
|
35
|
-
|
|
36
|
-
|
|
37
|
-
|
|
38
|
-
-
|
|
39
|
-
|
|
23
|
+
non-streaming OpenAI Responses loop with caller-provided clients, routed read/prepare
|
|
24
|
+
tools, R2 executor integration, and model-safe tool envelopes.
|
|
25
|
+
- Added optional observability, Langfuse, live eval, Promptfoo export, and EvalOps
|
|
26
|
+
subpaths with metadata-only tracing defaults, tracer adapters, dependency-free
|
|
27
|
+
Braintrust/OpenAI eval export helpers, and mock-driven tests.
|
|
28
|
+
- Added the optional `ai-capability-framework/aws` subpath for DynamoDB runtime stores,
|
|
29
|
+
canonical audit ledger stores, controls, control-plane state, budget usage, Step
|
|
30
|
+
Functions approval handoff, EventBridge/CloudWatch publishing, KMS redaction refs, and
|
|
31
|
+
fake AWS test clients.
|
|
32
|
+
- Added the optional `ai-capability-framework/mcp-server` subpath and OpenAI Agents SDK
|
|
33
|
+
bridge for executor-backed read/prepare interoperability.
|
|
34
|
+
- Added a public runtime support/billing mock example plus action lifecycle, policy
|
|
35
|
+
broker, and release-hardening docs and scripts.
|
|
36
|
+
- Added the `ai-capability-framework/providers` shared foundation for provider-neutral
|
|
37
|
+
tool naming, schema normalization, call parsing, safe result formatting, optional
|
|
38
|
+
dependency loading, and executor-backed read/prepare calls.
|
|
39
|
+
- Added the optional `ai-capability-framework/providers/anthropic` subpath for a bounded
|
|
40
|
+
Claude Messages tool-use loop with caller-provided clients and AICF-backed
|
|
41
|
+
read/prepare execution.
|
|
42
|
+
- Added the optional `ai-capability-framework/providers/gemini` subpath for a bounded
|
|
43
|
+
Gemini GenerateContent function-calling loop with caller-provided clients and
|
|
40
44
|
AICF-backed read/prepare execution.
|
|
41
|
-
- Added the optional `ai-capability-framework/providers/
|
|
42
|
-
|
|
43
|
-
clients and AICF-backed read/prepare execution.
|
|
44
|
-
- Added the optional `ai-capability-framework/providers/ai-sdk` subpath for a
|
|
45
|
-
Vercel AI SDK tool bridge and host-supplied `generateText`/`streamText`
|
|
46
|
-
wrappers with AICF-backed read/prepare execution.
|
|
47
|
-
- Added the optional `ai-capability-framework/providers/langchain` subpath for
|
|
48
|
-
LangChain tools and a host-supplied LangGraph `ToolNode` bridge with
|
|
45
|
+
- Added the optional `ai-capability-framework/providers/ai-sdk` subpath for a Vercel AI
|
|
46
|
+
SDK tool bridge and host-supplied `generateText`/`streamText` wrappers with
|
|
49
47
|
AICF-backed read/prepare execution.
|
|
50
|
-
- Added the optional `ai-capability-framework/providers/
|
|
51
|
-
|
|
52
|
-
|
|
48
|
+
- Added the optional `ai-capability-framework/providers/langchain` subpath for LangChain
|
|
49
|
+
tools and a host-supplied LangGraph `ToolNode` bridge with AICF-backed read/prepare
|
|
50
|
+
execution.
|
|
51
|
+
- Added the optional `ai-capability-framework/providers/mcp` subpath for hardened MCP
|
|
52
|
+
descriptors, annotations, security summaries, and tool-call parsing from routed AICF
|
|
53
|
+
capability slices.
|
|
53
54
|
- Added the optional `ai-capability-framework/providers/conformance` subpath and
|
|
54
|
-
`aicf providers` CLI group for descriptor-only cross-provider conformance
|
|
55
|
-
|
|
56
|
-
|
|
57
|
-
|
|
58
|
-
|
|
59
|
-
-
|
|
60
|
-
|
|
61
|
-
|
|
62
|
-
|
|
63
|
-
|
|
64
|
-
|
|
65
|
-
|
|
66
|
-
|
|
67
|
-
|
|
68
|
-
validation, risk, lifecycle, compatibility, impact, eval coverage,
|
|
69
|
-
security-pack coverage, configured provider conformance, and public artifact
|
|
70
|
-
hygiene checks.
|
|
55
|
+
`aicf providers` CLI group for descriptor-only cross-provider conformance checks.
|
|
56
|
+
- Added the canonical `ai-capability-framework/conformance` subpath, `aicf conformance`
|
|
57
|
+
CLI group, conformance schemas, richer F7 reports, and provider target matrix output
|
|
58
|
+
while preserving provider conformance aliases.
|
|
59
|
+
- Added grouped public provider examples, provider release scripts, and provider
|
|
60
|
+
package-readiness assertions for multi-vendor release review.
|
|
61
|
+
- Added the optional `ai-capability-framework/providers/semantic-kernel` subpath for MCP
|
|
62
|
+
guidance plus OpenAPI/plugin metadata exports for Semantic Kernel-compatible hosts.
|
|
63
|
+
- Added the `ai-capability-framework/governance` subpath and `aicf governance` CLI group
|
|
64
|
+
for lifecycle transition checks, risk compilation, compatibility diffs, and registry
|
|
65
|
+
impact analysis.
|
|
66
|
+
- Added the governance gate APIs and `aicf gate` CLI command for CI-friendly validation,
|
|
67
|
+
risk, lifecycle, compatibility, impact, eval coverage, security-pack coverage,
|
|
68
|
+
configured provider conformance, and public artifact hygiene checks.
|
|
71
69
|
- Added the optional `ai-capability-framework/control-plane` subpath and a
|
|
72
|
-
credential-free local reference app for reviewing capabilities, governance
|
|
73
|
-
|
|
74
|
-
|
|
75
|
-
- Added the optional `ai-capability-framework/audit` subpath with schema-valid
|
|
76
|
-
|
|
77
|
-
|
|
78
|
-
- Added the optional `ai-capability-framework/security` subpath for trust
|
|
79
|
-
|
|
80
|
-
|
|
81
|
-
|
|
82
|
-
|
|
83
|
-
and conversion to security/runtime context.
|
|
70
|
+
credential-free local reference app for reviewing capabilities, governance status,
|
|
71
|
+
eval/security/conformance coverage, redacted ledgers, approvals, controls, replay
|
|
72
|
+
metadata, and evidence exports.
|
|
73
|
+
- Added the optional `ai-capability-framework/audit` subpath with schema-valid policy
|
|
74
|
+
decision, action, approval, and idempotency ledger records plus in-memory reference
|
|
75
|
+
stores and runtime ledger hooks.
|
|
76
|
+
- Added the optional `ai-capability-framework/security` subpath for trust segments,
|
|
77
|
+
taint/provenance metadata, provider/trace redaction, and retention policy evaluation.
|
|
78
|
+
- Added the optional `ai-capability-framework/memory` subpath for governed host-owned
|
|
79
|
+
memory and preference summaries, use-case/scope exposure checks, and conversion to
|
|
80
|
+
security/runtime context.
|
|
84
81
|
- Added the optional `ai-capability-framework/evidence` subpath and
|
|
85
|
-
`aicf evidence export` CLI for public-safe JSON/Markdown evidence packs with
|
|
86
|
-
|
|
87
|
-
- Added the optional `ai-capability-framework/provenance` subpath for
|
|
88
|
-
|
|
89
|
-
|
|
82
|
+
`aicf evidence export` CLI for public-safe JSON/Markdown evidence packs with required
|
|
83
|
+
disclaimers and explicit coverage gaps.
|
|
84
|
+
- Added the optional `ai-capability-framework/provenance` subpath for public-safe
|
|
85
|
+
generated-content provenance metadata, strict schemas, adapter hooks, docs, and a
|
|
86
|
+
synthetic refs-and-hashes support fixture.
|
|
90
87
|
- Added public documentation and developer-experience hardening with root
|
|
91
|
-
governance/conduct/roadmap docs, grouped docs navigation, numbered examples,
|
|
92
|
-
|
|
88
|
+
governance/conduct/roadmap docs, grouped docs navigation, numbered examples, TypeDoc
|
|
89
|
+
tooling, docs checks, and package-readiness assertions.
|
|
93
90
|
- Added the optional `ai-capability-framework/controls` subpath for runtime kill
|
|
94
|
-
switches, circuit breaker evaluation, per-run budgets, local control CLI
|
|
95
|
-
|
|
96
|
-
- Added the optional `ai-capability-framework/replay` subpath for sanitized
|
|
97
|
-
|
|
98
|
-
|
|
99
|
-
|
|
100
|
-
-
|
|
101
|
-
|
|
102
|
-
|
|
103
|
-
|
|
104
|
-
- Kept provider/model calls, production storage, and model-exposed commit out of
|
|
105
|
-
the Core/runtime boundary except for the optional OpenAI subpath.
|
|
91
|
+
switches, circuit breaker evaluation, per-run budgets, local control CLI commands,
|
|
92
|
+
controls schemas, docs, and runtime/provider enforcement hooks.
|
|
93
|
+
- Added the optional `ai-capability-framework/replay` subpath for sanitized runtime
|
|
94
|
+
replay, policy/router/tool-validation simulation, trace-to-golden eval drafting,
|
|
95
|
+
replay schemas, CLI commands, and a public-safe support replay fixture.
|
|
96
|
+
- Added the optional `ai-capability-framework/security-packs` subpath with built-in
|
|
97
|
+
capability-aware security test packs, coverage reporting, public-safe generated
|
|
98
|
+
security cases, Promptfoo red-team config export, schemas, CLI commands, and docs.
|
|
99
|
+
- Kept provider/model calls, production storage, and model-exposed commit out of the
|
|
100
|
+
Core/runtime boundary except for the optional OpenAI subpath.
|
|
106
101
|
|
|
107
102
|
## 1.0.0-rc.1 - 2026-06-03
|
|
108
103
|
|
|
109
104
|
1.0 spec-complete release candidate.
|
|
110
105
|
|
|
111
|
-
- Promoted public manifests and eval result fixtures to
|
|
112
|
-
`schema_version: "1.0"`.
|
|
106
|
+
- Promoted public manifests and eval result fixtures to `schema_version: "1.0"`.
|
|
113
107
|
- Made the spec normative and explicit about the no-execution boundary.
|
|
114
108
|
- Added migration, host responsibility, and interoperability guidance.
|
|
115
109
|
- Added a second synthetic domain and conformance fixtures for external review.
|
|
116
|
-
- Added no-model-call adapters for Anthropic Claude, Google Gemini, Vercel AI
|
|
117
|
-
|
|
110
|
+
- Added no-model-call adapters for Anthropic Claude, Google Gemini, Vercel AI SDK, Model
|
|
111
|
+
Context Protocol, LangChain/LangGraph, and Semantic Kernel.
|
|
118
112
|
- Enabled public npm release-candidate publishing while keeping the no-execution
|
|
119
113
|
framework boundary.
|
|
120
114
|
|
|
@@ -126,14 +120,14 @@ Initial public v0.1 release candidate.
|
|
|
126
120
|
manifests.
|
|
127
121
|
- Added synthetic support examples for read, prepare-only write, commit, policy,
|
|
128
122
|
approval, refusal, and eval boundaries.
|
|
129
|
-
- Added a TypeScript core library and `aicf` CLI for loading, validating,
|
|
130
|
-
|
|
131
|
-
- Added deterministic policy and lifecycle decision APIs without executing
|
|
132
|
-
|
|
133
|
-
- Added a no-model-call OpenAI Responses adapter for exporting function tool
|
|
134
|
-
|
|
123
|
+
- Added a TypeScript core library and `aicf` CLI for loading, validating, inspecting,
|
|
124
|
+
deciding, OpenAI tool export, and deterministic eval scoring.
|
|
125
|
+
- Added deterministic policy and lifecycle decision APIs without executing capabilities
|
|
126
|
+
or performing side effects.
|
|
127
|
+
- Added a no-model-call OpenAI Responses adapter for exporting function tool definitions
|
|
128
|
+
and parsing tool calls.
|
|
135
129
|
- Added an API-key-free eval runner for scoring candidate result fixtures.
|
|
136
|
-
- Added release-readiness package checks, public API docs, CI validation, and
|
|
137
|
-
|
|
130
|
+
- Added release-readiness package checks, public API docs, CI validation, and public
|
|
131
|
+
repository boundary guidance.
|
|
138
132
|
|
|
139
133
|
This release was GitHub-release-ready only and was not published to npm.
|
package/CODE_OF_CONDUCT.md
CHANGED
|
@@ -1,32 +1,30 @@
|
|
|
1
1
|
# Code of Conduct
|
|
2
2
|
|
|
3
|
-
AI Capability Framework is a public project for building safer AI-accessible
|
|
4
|
-
|
|
5
|
-
|
|
3
|
+
AI Capability Framework is a public project for building safer AI-accessible application
|
|
4
|
+
capabilities. Participation should stay practical, respectful, and focused on improving
|
|
5
|
+
the framework.
|
|
6
6
|
|
|
7
7
|
## Expected Behavior
|
|
8
8
|
|
|
9
9
|
- Be direct and constructive.
|
|
10
10
|
- Assume contributors are trying to improve the public project.
|
|
11
|
-
- Keep discussions focused on code, docs, examples, tests, and framework
|
|
12
|
-
safety.
|
|
11
|
+
- Keep discussions focused on code, docs, examples, tests, and framework safety.
|
|
13
12
|
- Use synthetic examples and public-safe language.
|
|
14
13
|
- Respect maintainers when they protect the public repository boundary.
|
|
15
14
|
|
|
16
15
|
## Unacceptable Behavior
|
|
17
16
|
|
|
18
|
-
- Publishing credentials, private data, raw prompts, provider payloads, traces,
|
|
19
|
-
|
|
17
|
+
- Publishing credentials, private data, raw prompts, provider payloads, traces, customer
|
|
18
|
+
records, or internal account details.
|
|
20
19
|
- Harassment, personal attacks, threats, or discriminatory language.
|
|
21
20
|
- Repeatedly pushing changes that bypass safety, validation, or release checks.
|
|
22
21
|
- Sharing private drafts or unreleased planning material in public files.
|
|
23
22
|
|
|
24
23
|
## Reporting
|
|
25
24
|
|
|
26
|
-
Report security issues through [SECURITY.md](SECURITY.md). For conduct issues,
|
|
27
|
-
|
|
28
|
-
|
|
29
|
-
owner profile.
|
|
25
|
+
Report security issues through [SECURITY.md](SECURITY.md). For conduct issues, open a
|
|
26
|
+
GitHub issue only if it can be discussed publicly without exposing private information.
|
|
27
|
+
Otherwise contact the maintainers through the repository owner profile.
|
|
30
28
|
|
|
31
|
-
Maintainers may remove public content, close issues, or block participation to
|
|
32
|
-
|
|
29
|
+
Maintainers may remove public content, close issues, or block participation to protect
|
|
30
|
+
contributors and the public repository boundary.
|
package/CONTRIBUTING.md
CHANGED
|
@@ -1,18 +1,17 @@
|
|
|
1
1
|
# Contributing
|
|
2
2
|
|
|
3
|
-
Thanks for improving AI Capability Framework. This repository is public, so
|
|
4
|
-
|
|
3
|
+
Thanks for improving AI Capability Framework. This repository is public, so every
|
|
4
|
+
tracked change must be safe to publish.
|
|
5
5
|
|
|
6
6
|
## Public-Safe Contributions
|
|
7
7
|
|
|
8
|
-
- Use synthetic examples with fake IDs, fake tenants, fake users, and
|
|
9
|
-
|
|
10
|
-
- Do not commit credentials, account IDs, customer records, raw prompts, raw
|
|
11
|
-
|
|
12
|
-
local experiments.
|
|
8
|
+
- Use synthetic examples with fake IDs, fake tenants, fake users, and `example.com`
|
|
9
|
+
addresses.
|
|
10
|
+
- Do not commit credentials, account IDs, customer records, raw prompts, raw traces,
|
|
11
|
+
provider payloads, private source documents, generated exports, or local experiments.
|
|
13
12
|
- Keep private notes and drafts in `_private/` or another ignored path.
|
|
14
|
-
- Never copy from `_private/` into tracked files verbatim. Distill public
|
|
15
|
-
|
|
13
|
+
- Never copy from `_private/` into tracked files verbatim. Distill public guidance in
|
|
14
|
+
new wording.
|
|
16
15
|
|
|
17
16
|
## Development Workflow
|
|
18
17
|
|
|
@@ -35,20 +34,20 @@ npm run check:package
|
|
|
35
34
|
npm run check
|
|
36
35
|
```
|
|
37
36
|
|
|
38
|
-
Run `npm run generate:types` whenever schemas change. Generated public manifest
|
|
39
|
-
|
|
37
|
+
Run `npm run generate:types` whenever schemas change. Generated public manifest types
|
|
38
|
+
under `src/generated/` must stay current.
|
|
40
39
|
|
|
41
40
|
Use `npm run lint` for repository readiness checks, `npm run conformance` for
|
|
42
|
-
descriptor/mock provider conformance, and `npm run gate:examples` for the
|
|
43
|
-
|
|
41
|
+
descriptor/mock provider conformance, and `npm run gate:examples` for the deterministic
|
|
42
|
+
governance gate over public examples.
|
|
44
43
|
|
|
45
44
|
## Optional Live Integration Tests
|
|
46
45
|
|
|
47
|
-
Normal tests use mocks, descriptor exports, and synthetic fixtures. Live tests
|
|
48
|
-
|
|
49
|
-
`
|
|
50
|
-
|
|
51
|
-
|
|
46
|
+
Normal tests use mocks, descriptor exports, and synthetic fixtures. Live tests are
|
|
47
|
+
opt-in only and require explicit environment variables such as `RUN_REAL_OPENAI=1`,
|
|
48
|
+
`RUN_LIVE_ANTHROPIC=1`, `RUN_LIVE_GEMINI=1`, or `RUN_AWS_INTEGRATION=1`. Do not add
|
|
49
|
+
credentials, account IDs, tenant IDs, raw provider payloads, or transcripts to tracked
|
|
50
|
+
files.
|
|
52
51
|
|
|
53
52
|
## Documentation Contributions
|
|
54
53
|
|
|
@@ -66,10 +65,10 @@ npm run archive:source
|
|
|
66
65
|
npm run check:source-archive
|
|
67
66
|
```
|
|
68
67
|
|
|
69
|
-
Use `npm pack` for npm package review and `npm run archive:source` for public
|
|
70
|
-
|
|
71
|
-
|
|
72
|
-
|
|
68
|
+
Use `npm pack` for npm package review and `npm run archive:source` for public source
|
|
69
|
+
review. Do not zip the working directory manually; raw workspace ZIPs can include
|
|
70
|
+
`.git/`, dependencies, generated output, private notes, logs, traces, raw prompts,
|
|
71
|
+
provider payloads, or Office/PDF exports.
|
|
73
72
|
|
|
74
73
|
## Pull Requests
|
|
75
74
|
|
|
@@ -77,41 +76,39 @@ Before opening a pull request:
|
|
|
77
76
|
|
|
78
77
|
- Run `npm run check`.
|
|
79
78
|
- Confirm examples are public-safe and synthetic.
|
|
80
|
-
- Confirm `_private/`, traces, prompts, provider payloads, generated local docs,
|
|
81
|
-
|
|
82
|
-
- Use `git status --short --ignored` to confirm private material remains
|
|
83
|
-
ignored.
|
|
79
|
+
- Confirm `_private/`, traces, prompts, provider payloads, generated local docs, packed
|
|
80
|
+
tarballs, and local-only files are not tracked.
|
|
81
|
+
- Use `git status --short --ignored` to confirm private material remains ignored.
|
|
84
82
|
- Use `git ls-files` to inspect the tracked public surface.
|
|
85
83
|
|
|
86
84
|
## Changelog And Release Notes
|
|
87
85
|
|
|
88
|
-
Public behavior, docs, examples, CLI commands, package scripts, schemas, and
|
|
89
|
-
|
|
90
|
-
|
|
86
|
+
Public behavior, docs, examples, CLI commands, package scripts, schemas, and exported
|
|
87
|
+
APIs should update `CHANGELOG.md`. Keep release notes concise and public-safe. Use
|
|
88
|
+
`docs/release.md` for the release checklist and
|
|
91
89
|
`docs/public-framework/release-process.md` for the public release process.
|
|
92
90
|
|
|
93
91
|
## Provider Adapters
|
|
94
92
|
|
|
95
|
-
Provider adapters must stay behind optional subpaths unless maintainers approve
|
|
96
|
-
|
|
97
|
-
|
|
98
|
-
|
|
93
|
+
Provider adapters must stay behind optional subpaths unless maintainers approve a
|
|
94
|
+
boundary change. Do not add provider SDKs to root imports. Descriptor exports and
|
|
95
|
+
runtime loops must preserve AICF validation, policy, lifecycle, model-safe envelopes, no
|
|
96
|
+
raw provider payload retention, and no model-exposed commit tools.
|
|
99
97
|
|
|
100
98
|
## Security Packs
|
|
101
99
|
|
|
102
|
-
Security-pack changes must use synthetic public-safe text, update generated or
|
|
103
|
-
|
|
104
|
-
|
|
100
|
+
Security-pack changes must use synthetic public-safe text, update generated or assigned
|
|
101
|
+
coverage where relevant, and avoid claims of certification, legal advice, security
|
|
102
|
+
guarantees, or compliance attestation.
|
|
105
103
|
|
|
106
104
|
## Manifest Fields
|
|
107
105
|
|
|
108
|
-
Add manifest fields only when they are optional or have a migration plan. Schema
|
|
109
|
-
|
|
110
|
-
|
|
111
|
-
breaking changes.
|
|
106
|
+
Add manifest fields only when they are optional or have a migration plan. Schema changes
|
|
107
|
+
require generated types, validation updates, examples, docs, and tests. Required-field
|
|
108
|
+
additions, removed meanings, and weakened safety semantics are breaking changes.
|
|
112
109
|
|
|
113
110
|
## Scope
|
|
114
111
|
|
|
115
|
-
AICF is not an agent framework. It is a governed capability layer for
|
|
116
|
-
|
|
117
|
-
|
|
112
|
+
AICF is not an agent framework. It is a governed capability layer for AI-accessible
|
|
113
|
+
application functionality. Models propose; applications validate, authorize, execute,
|
|
114
|
+
and audit. Contributions should reinforce that boundary.
|
package/GOVERNANCE.md
CHANGED
|
@@ -1,60 +1,59 @@
|
|
|
1
1
|
# Project Governance
|
|
2
2
|
|
|
3
|
-
AI Capability Framework is maintained as a public framework. The maintainers
|
|
4
|
-
|
|
5
|
-
|
|
3
|
+
AI Capability Framework is maintained as a public framework. The maintainers prioritize
|
|
4
|
+
safety boundaries, public documentation quality, and deterministic tests over feature
|
|
5
|
+
breadth.
|
|
6
6
|
|
|
7
7
|
## Maintainer Roles
|
|
8
8
|
|
|
9
|
-
- Release maintainers own npm/GitHub release readiness, tags, changelog checks,
|
|
10
|
-
|
|
9
|
+
- Release maintainers own npm/GitHub release readiness, tags, changelog checks, package
|
|
10
|
+
contents, and trusted publishing.
|
|
11
11
|
- Security maintainers review vulnerability reports, unsafe public artifacts,
|
|
12
12
|
security-pack changes, provider boundary changes, and release mitigations.
|
|
13
|
-
- Technical maintainers review API, schema, runtime, provider, governance, and
|
|
14
|
-
|
|
13
|
+
- Technical maintainers review API, schema, runtime, provider, governance, and example
|
|
14
|
+
changes for compatibility and test coverage.
|
|
15
15
|
|
|
16
16
|
One person may hold multiple roles. Role assignment is by maintainer consensus.
|
|
17
17
|
|
|
18
18
|
## Maintainer Responsibilities
|
|
19
19
|
|
|
20
|
-
- Keep the public package free of private drafts, credentials, raw traces, raw
|
|
21
|
-
|
|
22
|
-
- Preserve the framework boundary: AICF is not an agent framework. It is a
|
|
23
|
-
|
|
24
|
-
- Review changes for public API compatibility, package hygiene, and
|
|
25
|
-
|
|
26
|
-
- Require tests and docs for public API, schema, CLI, provider, runtime,
|
|
27
|
-
|
|
20
|
+
- Keep the public package free of private drafts, credentials, raw traces, raw prompts,
|
|
21
|
+
provider payloads, and local artifacts.
|
|
22
|
+
- Preserve the framework boundary: AICF is not an agent framework. It is a governed
|
|
23
|
+
capability layer for AI-accessible application functionality.
|
|
24
|
+
- Review changes for public API compatibility, package hygiene, and no-model-exposed
|
|
25
|
+
commit behavior.
|
|
26
|
+
- Require tests and docs for public API, schema, CLI, provider, runtime, governance, or
|
|
27
|
+
example changes.
|
|
28
28
|
|
|
29
29
|
## Decision Process
|
|
30
30
|
|
|
31
|
-
Public changes should be small enough to review, include tests where behavior
|
|
32
|
-
|
|
33
|
-
|
|
34
|
-
change the architecture.
|
|
31
|
+
Public changes should be small enough to review, include tests where behavior changes,
|
|
32
|
+
and update docs when they affect user understanding. New integrations must stay isolated
|
|
33
|
+
behind optional subpaths unless maintainers explicitly change the architecture.
|
|
35
34
|
|
|
36
|
-
Models propose; applications validate, authorize, execute, and audit. Proposed
|
|
37
|
-
|
|
35
|
+
Models propose; applications validate, authorize, execute, and audit. Proposed changes
|
|
36
|
+
should reinforce that boundary.
|
|
38
37
|
|
|
39
|
-
Security-sensitive changes require explicit maintainer review before release.
|
|
40
|
-
|
|
41
|
-
|
|
42
|
-
|
|
38
|
+
Security-sensitive changes require explicit maintainer review before release. Examples
|
|
39
|
+
include model-exposed tools, action lifecycle behavior, approval or idempotency
|
|
40
|
+
semantics, provider payload handling, MCP server behavior, policy adapters, controls,
|
|
41
|
+
audit/evidence records, and public artifact rules.
|
|
43
42
|
|
|
44
43
|
## Release Approval
|
|
45
44
|
|
|
46
45
|
Release candidates are gated by the repository checks in
|
|
47
|
-
[docs/release.md](docs/release.md), package dry-run inspection, and public
|
|
48
|
-
|
|
49
|
-
|
|
46
|
+
[docs/release.md](docs/release.md), package dry-run inspection, and public artifact
|
|
47
|
+
hygiene checks. npm publishing uses trusted publishing from GitHub Actions for tagged
|
|
48
|
+
releases only.
|
|
50
49
|
|
|
51
|
-
Release approval requires a clean public worktree, passing CI, passing package
|
|
52
|
-
|
|
53
|
-
|
|
50
|
+
Release approval requires a clean public worktree, passing CI, passing package and
|
|
51
|
+
source artifact checks, reviewed changelog/release notes, and a version tag that matches
|
|
52
|
+
`package.json`.
|
|
54
53
|
|
|
55
54
|
## Deprecation Process
|
|
56
55
|
|
|
57
|
-
Deprecated APIs, schemas, commands, docs, examples, or compatibility aliases
|
|
58
|
-
|
|
59
|
-
|
|
60
|
-
|
|
56
|
+
Deprecated APIs, schemas, commands, docs, examples, or compatibility aliases should
|
|
57
|
+
include a replacement path, migration note, and expected removal window when known.
|
|
58
|
+
Deprecated behavior remains loadable for at least one minor release unless a security
|
|
59
|
+
fix requires immediate denial.
|