@shpitdev/convex-cliproxy-observability 0.1.0

package/CHANGELOG.md

@@ -0,0 +1,11 @@
+# Changelog
+
+## 0.1.0 (unreleased)
+
+- Stock CLIProxy native capture proof and private Convex component.
+- Immutable batched raw admission, exact receipts, bounded queries and separate projection progress.
+- ModelCallV1, structural OpenRouter/legacy adapters and TypeScript Messages, Responses and Chat parsers.
+- Per-destination durable delivery, exact ACK/replay, private health and reserved control gaps.
+- Fragment-aware credential redaction, all six protocol variants and real cancellation evidence.
+- Checksummed Linux artifact packaging and exact-version npm release checks.
+- No automatic retention expiry. Live activation remains a separate deployment gate.

package/LICENSE

@@ -0,0 +1,201 @@
+                                 Apache License
+                           Version 2.0, January 2004
+                        http://www.apache.org/licenses/
+
+   TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
+
+   1. Definitions.
+
+      "License" shall mean the terms and conditions for use, reproduction,
+      and distribution as defined by Sections 1 through 9 of this document.
+
+      "Licensor" shall mean the copyright owner or entity authorized by
+      the copyright owner that is granting the License.
+
+      "Legal Entity" shall mean the union of the acting entity and all
+      other entities that control, are controlled by, or are under common
+      control with that entity. For the purposes of this definition,
+      "control" means (i) the power, direct or indirect, to cause the
+      direction or management of such entity, whether by contract or
+      otherwise, or (ii) ownership of fifty percent (50%) or more of the
+      outstanding shares, or (iii) beneficial ownership of such entity.
+
+      "You" (or "Your") shall mean an individual or Legal Entity
+      exercising permissions granted by this License.
+
+      "Source" form shall mean the preferred form for making modifications,
+      including but not limited to software source code, documentation
+      source, and configuration files.
+
+      "Object" form shall mean any form resulting from mechanical
+      transformation or translation of a Source form, including but
+      not limited to compiled object code, generated documentation,
+      and conversions to other media types.
+
+      "Work" shall mean the work of authorship, whether in Source or
+      Object form, made available under the License, as indicated by a
+      copyright notice that is included in or attached to the work
+      (an example is provided in the Appendix below).
+
+      "Derivative Works" shall mean any work, whether in Source or Object
+      form, that is based on (or derived from) the Work and for which the
+      editorial revisions, annotations, elaborations, or other modifications
+      represent, as a whole, an original work of authorship. For the purposes
+      of this License, Derivative Works shall not include works that remain
+      separable from, or merely link (or bind by name) to the interfaces of,
+      the Work and Derivative Works thereof.
+
+      "Contribution" shall mean any work of authorship, including
+      the original version of the Work and any modifications or additions
+      to that Work or Derivative Works thereof, that is intentionally
+      submitted to Licensor for inclusion in the Work by the copyright owner
+      or by an individual or Legal Entity authorized to submit on behalf of
+      the copyright owner. For the purposes of this definition, "submitted"
+      means any form of electronic, verbal, or written communication sent
+      to the Licensor or its representatives, including but not limited to
+      communication on electronic mailing lists, source code control systems,
+      and issue tracking systems that are managed by, or on behalf of, the
+      Licensor for the purpose of discussing and improving the Work, but
+      excluding communication that is conspicuously marked or otherwise
+      designated in writing by the copyright owner as "Not a Contribution."
+
+      "Contributor" shall mean Licensor and any individual or Legal Entity
+      on behalf of whom a Contribution has been received by Licensor and
+      subsequently incorporated within the Work.
+
+   2. Grant of Copyright License. Subject to the terms and conditions of
+      this License, each Contributor hereby grants to You a perpetual,
+      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+      copyright license to reproduce, prepare Derivative Works of,
+      publicly display, publicly perform, sublicense, and distribute the
+      Work and such Derivative Works in Source or Object form.
+
+   3. Grant of Patent License. Subject to the terms and conditions of
+      this License, each Contributor hereby grants to You a perpetual,
+      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+      (except as stated in this section) patent license to make, have made,
+      use, offer to sell, sell, import, and otherwise transfer the Work,
+      where such license applies only to those patent claims licensable
+      by such Contributor that are necessarily infringed by their
+      Contribution(s) alone or by combination of their Contribution(s)
+      with the Work to which such Contribution(s) was submitted. If You
+      institute patent litigation against any entity (including a
+      cross-claim or counterclaim in a lawsuit) alleging that the Work
+      or a Contribution incorporated within the Work constitutes direct
+      or contributory patent infringement, then any patent licenses
+      granted to You under this License for that Work shall terminate
+      as of the date such litigation is filed.
+
+   4. Redistribution. You may reproduce and distribute copies of the
+      Work or Derivative Works thereof in any medium, with or without
+      modifications, and in Source or Object form, provided that You
+      meet the following conditions:
+
+      (a) You must give any other recipients of the Work or
+          Derivative Works a copy of this License; and
+
+      (b) You must cause any modified files to carry prominent notices
+          stating that You changed the files; and
+
+      (c) You must retain, in the Source form of any Derivative Works
+          that You distribute, all copyright, patent, trademark, and
+          attribution notices from the Source form of the Work,
+          excluding those notices that do not pertain to any part of
+          the Derivative Works; and
+
+      (d) If the Work includes a "NOTICE" text file as part of its
+          distribution, then any Derivative Works that You distribute must
+          include a readable copy of the attribution notices contained
+          within such NOTICE file, excluding those notices that do not
+          pertain to any part of the Derivative Works, in at least one
+          of the following places: within a NOTICE text file distributed
+          as part of the Derivative Works; within the Source form or
+          documentation, if provided along with the Derivative Works; or,
+          within a display generated by the Derivative Works, if and
+          wherever such third-party notices normally appear. The contents
+          of the NOTICE file are for informational purposes only and
+          do not modify the License. You may add Your own attribution
+          notices within Derivative Works that You distribute, alongside
+          or as an addendum to the NOTICE text from the Work, provided
+          that such additional attribution notices cannot be construed
+          as modifying the License.
+
+      You may add Your own copyright statement to Your modifications and
+      may provide additional or different license terms and conditions
+      for use, reproduction, or distribution of Your modifications, or
+      for any such Derivative Works as a whole, provided Your use,
+      reproduction, and distribution of the Work otherwise complies with
+      the conditions stated in this License.
+
+   5. Submission of Contributions. Unless You explicitly state otherwise,
+      any Contribution intentionally submitted for inclusion in the Work
+      by You to the Licensor shall be under the terms and conditions of
+      this License, without any additional terms or conditions.
+      Notwithstanding the above, nothing herein shall supersede or modify
+      the terms of any separate license agreement you may have executed
+      with Licensor regarding such Contributions.
+
+   6. Trademarks. This License does not grant permission to use the trade
+      names, trademarks, service marks, or product names of the Licensor,
+      except as required for reasonable and customary use in describing the
+      origin of the Work and reproducing the content of the NOTICE file.
+
+   7. Disclaimer of Warranty. Unless required by applicable law or
+      agreed to in writing, Licensor provides the Work (and each
+      Contributor provides its Contributions) on an "AS IS" BASIS,
+      WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+      implied, including, without limitation, any warranties or conditions
+      of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
+      PARTICULAR PURPOSE. You are solely responsible for determining the
+      appropriateness of using or redistributing the Work and assume any
+      risks associated with Your exercise of permissions under this License.
+
+   8. Limitation of Liability. In no event and under no legal theory,
+      whether in tort (including negligence), contract, or otherwise,
+      unless required by applicable law (such as deliberate and grossly
+      negligent acts) or agreed to in writing, shall any Contributor be
+      liable to You for damages, including any direct, indirect, special,
+      incidental, or consequential damages of any character arising as a
+      result of this License or out of the use or inability to use the
+      Work (including but not limited to damages for loss of goodwill,
+      work stoppage, computer failure or malfunction, or any and all
+      other commercial damages or losses), even if such Contributor
+      has been advised of the possibility of such damages.
+
+   9. Accepting Warranty or Additional Liability. While redistributing
+      the Work or Derivative Works thereof, You may choose to offer,
+      and charge a fee for, acceptance of support, warranty, indemnity,
+      or other liability obligations and/or rights consistent with this
+      License. However, in accepting such obligations, You may act only
+      on Your own behalf and on Your sole responsibility, not on behalf
+      of any other Contributor, and only if You agree to indemnify,
+      defend, and hold each Contributor harmless for any liability
+      incurred by, or claims asserted against, such Contributor by reason
+      of your accepting any such warranty or additional liability.
+
+   END OF TERMS AND CONDITIONS
+
+   APPENDIX: How to apply the Apache License to your work.
+
+      To apply the Apache License to your work, attach the following
+      boilerplate notice, with the fields enclosed by brackets "[]"
+      replaced with your own identifying information. (Don't include
+      the brackets!)  The text should be enclosed in the appropriate
+      comment syntax for the file format. We also recommend that a
+      file or class name and description of purpose be included on the
+      same "printed page" as the copyright notice for easier
+      identification within third-party archives.
+
+   Copyright 2026 Anand Pant
+
+   Licensed under the Apache License, Version 2.0 (the "License");
+   you may not use this file except in compliance with the License.
+   You may obtain a copy of the License at
+
+       http://www.apache.org/licenses/LICENSE-2.0
+
+   Unless required by applicable law or agreed to in writing, software
+   distributed under the License is distributed on an "AS IS" BASIS,
+   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+   See the License for the specific language governing permissions and
+   limitations under the License.

package/README.md

@@ -0,0 +1,40 @@
+# CLIProxy observability
+
+Private model-call capture for stock CLIProxyAPI 7.3.5. A separate native plugin and durable exporter feed this Convex component; the component stores bounded summaries and immutable private-content references. TypeScript owns client-protocol normalization.
+
+This package is a release candidate. Native delivery and receiver normalization are implemented; publication, Meshix adoption and DEV activation require their separate release/deployment gates.
+
+| Layer       | Coverage                                                                                                                   | CI                                       |
+| ----------- | -------------------------------------------------------------------------------------------------------------------------- | ---------------------------------------- |
+| Unit        | Protocol framing, recorded replay, inherited Responses regressions                                                         | `check`                                  |
+| Integration | Authenticated receiver, Convex receipts/projection, private blob ownership                                                 | `check`                                  |
+| e2e api     | Isolated nginx + official stock binary + simulated provider; six real success fixtures and one real cancellation recording | `native-capture` (offline playback only) |
+| e2e web     | None; host Ops integration is pending                                                                                      | No                                       |
+
+No deployed receiver or browser proof is claimed by these tests.
+
+## Host integration
+
+Mount `@shpitdev/convex-cliproxy-observability/convex.config` with `app.use`. Construct `CliproxyObservability(components.cliproxyObservability)` in the host backend. Expose a dedicated HTTP action through `handleCliproxyCaptureRequest`; use private receiver credentials, exact destination/instance enrollment and private blob storage. Never pass receiver credentials to inference sandboxes.
+
+The host supplies `PrivateCaptureStorage.put/get` and a durable `scheduleProjection` callback. Projection actions call `projectPendingSegments`, rescheduling when `more` is true. Scheduler failure returns 503 after the raw receipt, making exporter retries safe. The host must monitor and recover failed projection actions; persisted raw content and receipts remain independently readable. No TTL or cleanup cron removes calls, receipts or content by default.
+
+The receiver accepts `CaptureSegmentV1` from the `/capture` export: immutable NDJSON batches of up to 256 contiguous observations. A segment is at most 1408 KiB; the outer JSON envelope is at most 2 MiB. Each observation payload is at most 1 MiB. The exporter must persist batch boundaries before retrying. Identical identities and digests deduplicate; changed digests or overlapping ranges conflict.
+
+## Reads and evidence
+
+- `pageRecentSummaries` and `pageCorrelationSummaries` return at most three summaries under a 32 KiB response budget, using indexed keyset cursors.
+- `getCall` reads one bounded record; `pageEventSegments` pages private references. `resolveCallBlob` requires membership in the host-authorized call manifest and checks size/hash while streaming.
+- Raw admission and projection have separate sequence watermarks. Missing segments stop projection; invalid protocol data and missing usage remain explicit. Boot health retains loss counters and labels incomplete prior-boot calls unknown.
+- `ModelCallV1` is the common read contract. `fromOpenRouterSpan` is a structural adapter with no runtime dependency on the OpenRouter component. `fromLegacyCliproxySpan` labels historical rows distinctly.
+- Gateway identity is known. Selected provider, attempt detail and OAuth cost are unknown unless supported evidence exists. Pre-hook capture is unavailable; previews are not enrolled.
+
+`projectCapturedPayloads` reconstructs selected-call content from bounded pages. Its 16 MiB replay limit is a read-operation bound, not a retention limit. Larger calls remain available through raw event pages. Summary checkpoints retain scalar state and private references for large unfinished frames; immutable segments retain text, reasoning, tools and native usage snapshots.
+
+## Parser provenance
+
+The client-protocol assemblers and Responses regressions were adapted from Meshix commit `737ea929919f82921accaa4171d6abed5c85a1cb` (the reviewed #1371 stack). Synthetic log fixtures are extracted only in tests; this package does not ingest legacy text logs. Sanitized real recordings and their provenance live in `fixtures/real`.
+
+Run `pnpm --filter @shpitdev/convex-cliproxy-observability test`, `typecheck`, and `pack:check`. The latter installs the tarball in an isolated consumer with the minimum supported Convex version and checks exported APIs plus executable component test modules.
+
+Copyright 2026 Anand Pant. Apache-2.0; the native ABI adapter includes its upstream MIT notice.

package/dist/capture/index.d.ts

@@ -0,0 +1,79 @@
+import type { ExactCorrelation } from "../model-call/index.js";
+export declare const MAX_ENVELOPE_BYTES: number;
+export declare const MAX_CONTENT_BYTES: number;
+export type CaptureObservationV1 = {
+    schemaVersion: 1;
+    pluginVersion: string;
+    redactionVersion: string;
+    destinationId: string;
+    instanceId: string;
+    pluginBootId: string;
+    requestId: string;
+    sequence: number;
+    kind: "request" | "response" | "stream_init" | "stream_chunk" | "completion" | "capture_health";
+    observedAt: string;
+    offsetNs: number;
+    route: string;
+    configRevision: string;
+    sourceFormat?: string;
+    requestedModel?: string;
+    sourceTraceId?: string;
+    correlation?: ExactCorrelation;
+    correlationConflicts?: string[];
+    stockChunkIndex?: number;
+    body?: string;
+    observedBodyBytes?: number;
+    bodyFraming?: "stock_json_chunk" | "stock_sse_candidate";
+    contentSha256: string;
+    contentBytes: number;
+    completionOutcome?: string;
+    executionStatusCode?: number;
+    executionStartedAt?: string;
+    executionCompletedAt?: string;
+    error?: string;
+    gap?: string;
+    bodyFromSequence?: number;
+    droppedObservationsTotal?: number;
+    scopeConflictsTotal?: number;
+};
+export declare function sha256(bytes: Uint8Array): Promise<string>;
+export declare function observationIdentity(o: CaptureObservationV1): Promise<string>;
+export declare function callIdentity(o: Pick<CaptureObservationV1, "destinationId" | "instanceId" | "pluginBootId" | "requestId">): Promise<string>;
+export declare function decodeBody(o: CaptureObservationV1): Uint8Array;
+export declare function validateObservation(raw: Uint8Array, expected: {
+    destinationId: string;
+    instanceIds: readonly string[];
+}): Promise<{
+    observation: CaptureObservationV1;
+    body: Uint8Array<ArrayBufferLike>;
+    identity: string;
+    callId: string;
+    digest: string;
+}>;
+/** One immutable NDJSON segment batches observations: no per-token Convex writes. */
+export type CaptureSegmentV1 = {
+    schemaVersion: 1;
+    operation: "segment";
+    destinationId: string;
+    instanceId: string;
+    pluginBootId: string;
+    requestId: string;
+    firstSequence: number;
+    throughSequence: number;
+    contentSha256: string;
+    contentBytes: number;
+    contentBase64: string;
+};
+export declare const MAX_SEGMENT_BYTES: number;
+export declare function validateSegment(raw: Uint8Array, expected: {
+    destinationId: string;
+    instanceIds: readonly string[];
+}): Promise<{
+    envelope: CaptureSegmentV1;
+    observations: CaptureObservationV1[];
+    content: Uint8Array<ArrayBuffer>;
+    callId: string;
+    identity: string;
+    digest: string;
+}>;
+//# sourceMappingURL=index.d.ts.map

package/dist/capture/index.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../../src/capture/index.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EAAE,gBAAgB,EAAE,MAAM,wBAAwB,CAAC;AAC/D,eAAO,MAAM,kBAAkB,QAAkB,CAAC;AAClD,eAAO,MAAM,iBAAiB,QAAc,CAAC;AAS7C,MAAM,MAAM,oBAAoB,GAAG;IACjC,aAAa,EAAE,CAAC,CAAC;IACjB,aAAa,EAAE,MAAM,CAAC;IACtB,gBAAgB,EAAE,MAAM,CAAC;IACzB,aAAa,EAAE,MAAM,CAAC;IACtB,UAAU,EAAE,MAAM,CAAC;IACnB,YAAY,EAAE,MAAM,CAAC;IACrB,SAAS,EAAE,MAAM,CAAC;IAClB,QAAQ,EAAE,MAAM,CAAC;IACjB,IAAI,EAAE,SAAS,GAAG,UAAU,GAAG,aAAa,GAAG,cAAc,GAAG,YAAY,GAAG,gBAAgB,CAAC;IAChG,UAAU,EAAE,MAAM,CAAC;IACnB,QAAQ,EAAE,MAAM,CAAC;IACjB,KAAK,EAAE,MAAM,CAAC;IACd,cAAc,EAAE,MAAM,CAAC;IACvB,YAAY,CAAC,EAAE,MAAM,CAAC;IACtB,cAAc,CAAC,EAAE,MAAM,CAAC;IACxB,aAAa,CAAC,EAAE,MAAM,CAAC;IACvB,WAAW,CAAC,EAAE,gBAAgB,CAAC;IAC/B,oBAAoB,CAAC,EAAE,MAAM,EAAE,CAAC;IAChC,eAAe,CAAC,EAAE,MAAM,CAAC;IACzB,IAAI,CAAC,EAAE,MAAM,CAAC;IACd,iBAAiB,CAAC,EAAE,MAAM,CAAC;IAC3B,WAAW,CAAC,EAAE,kBAAkB,GAAG,qBAAqB,CAAC;IACzD,aAAa,EAAE,MAAM,CAAC;IACtB,YAAY,EAAE,MAAM,CAAC;IACrB,iBAAiB,CAAC,EAAE,MAAM,CAAC;IAC3B,mBAAmB,CAAC,EAAE,MAAM,CAAC;IAC7B,kBAAkB,CAAC,EAAE,MAAM,CAAC;IAC5B,oBAAoB,CAAC,EAAE,MAAM,CAAC;IAC9B,KAAK,CAAC,EAAE,MAAM,CAAC;IACf,GAAG,CAAC,EAAE,MAAM,CAAC;IACb,gBAAgB,CAAC,EAAE,MAAM,CAAC;IAC1B,wBAAwB,CAAC,EAAE,MAAM,CAAC;IAClC,mBAAmB,CAAC,EAAE,MAAM,CAAC;CAC9B,CAAC;AACF,wBAAsB,MAAM,CAAC,KAAK,EAAE,UAAU,GAAG,OAAO,CAAC,MAAM,CAAC,CAG/D;AACD,wBAAsB,mBAAmB,CAAC,CAAC,EAAE,oBAAoB,mBAahE;AACD,wBAAsB,YAAY,CAChC,CAAC,EAAE,IAAI,CAAC,oBAAoB,EAAE,eAAe,GAAG,YAAY,GAAG,cAAc,GAAG,WAAW,CAAC,mBAO7F;AACD,wBAAgB,UAAU,CAAC,CAAC,EAAE,oBAAoB,GAAG,UAAU,CAW9D;AACD,wBAAsB,mBAAmB,CACvC,GAAG,EAAE,UAAU,EACf,QAAQ,EAAE;IAAE,aAAa,EAAE,MAAM,CAAC;IAAC,WAAW,EAAE,SAAS,MAAM,EAAE,CAAA;CAAE;;;;;;GAuGpE;AAED,qFAAqF;AACrF,MAAM,MAAM,gBAAgB,GAAG;IAC7B,aAAa,EAAE,CAAC,CAAC;IACjB,SAAS,EAAE,SAAS,CAAC;IACrB,aAAa,EAAE,MAAM,CAAC;IACtB,UAAU,EAAE,MAAM,CAAC;IACnB,YAAY,EAAE,MAAM,CAAC;IACrB,SAAS,EAAE,MAAM,CAAC;IAClB,aAAa,EAAE,MAAM,CAAC;IACtB,eAAe,EAAE,MAAM,CAAC;IACxB,aAAa,EAAE,MAAM,CAAC;IACtB,YAAY,EAAE,MAAM,CAAC;IACrB,aAAa,EAAE,MAAM,CAAC;CACvB,CAAC;AACF,eAAO,MAAM,iBAAiB,QAAc,CAAC;AAC7C,wBAAsB,eAAe,CACnC,GAAG,EAAE,UAAU,EACf,QAAQ,EAAE;IAAE,aAAa,EAAE,MAAM,CAAC;IAAC,WAAW,EAAE,SAAS,MAAM,EAAE,CAAA;CAAE;;;;;;;GAmEpE"}

package/dist/capture/index.js

@@ -0,0 +1,182 @@
+export const MAX_ENVELOPE_BYTES = 2 * 1024 * 1024;
+export const MAX_CONTENT_BYTES = 1024 * 1024;
+const id = /^[a-zA-Z0-9][a-zA-Z0-9._:-]{0,199}$/;
+const routes = new Set([
+    "GET /v1/models",
+    "POST /v1/messages",
+    "POST /v1/messages/count_tokens",
+    "POST /v1/responses",
+    "POST /v1/chat/completions",
+]);
+export async function sha256(bytes) {
+    const digest = await crypto.subtle.digest("SHA-256", Uint8Array.from(bytes));
+    return Array.from(new Uint8Array(digest), (v) => v.toString(16).padStart(2, "0")).join("");
+}
+export async function observationIdentity(o) {
+    return sha256(new TextEncoder().encode(JSON.stringify([
+        o.destinationId,
+        o.instanceId,
+        o.pluginBootId,
+        o.requestId,
+        o.sequence,
+        o.kind,
+    ])));
+}
+export async function callIdentity(o) {
+    return sha256(new TextEncoder().encode(JSON.stringify([o.destinationId, o.instanceId, o.pluginBootId, o.requestId])));
+}
+export function decodeBody(o) {
+    const raw = o.body ?? "";
+    if (raw.length > Math.ceil(MAX_CONTENT_BYTES / 3) * 4 ||
+        !/^(?:[A-Za-z0-9+/]{4})*(?:[A-Za-z0-9+/]{2}==|[A-Za-z0-9+/]{3}=)?$/.test(raw))
+        throw new Error("invalid body encoding");
+    const decoded = atob(raw);
+    if (decoded.length > MAX_CONTENT_BYTES || decoded.length !== o.contentBytes)
+        throw new Error("body size mismatch");
+    return Uint8Array.from(decoded, (c) => c.charCodeAt(0));
+}
+export async function validateObservation(raw, expected) {
+    if (raw.byteLength > MAX_ENVELOPE_BYTES)
+        throw new Error("envelope limit");
+    const value = JSON.parse(new TextDecoder("utf-8", { fatal: true }).decode(raw));
+    if (!value || typeof value !== "object" || Array.isArray(value))
+        throw new Error("observation required");
+    const o = value;
+    if (o.schemaVersion !== 1 ||
+        o.destinationId !== expected.destinationId ||
+        !expected.instanceIds.includes(o.instanceId))
+        throw new Error("scope mismatch");
+    for (const field of [
+        "destinationId",
+        "instanceId",
+        "pluginBootId",
+        "requestId",
+        "configRevision",
+    ]) {
+        if (typeof o[field] !== "string" || !id.test(o[field]))
+            throw new Error("invalid identity");
+    }
+    if (!Number.isSafeInteger(o.sequence) ||
+        o.sequence < 1 ||
+        !Number.isSafeInteger(o.offsetNs) ||
+        o.offsetNs < 0 ||
+        !Number.isSafeInteger(o.contentBytes) ||
+        o.contentBytes < 0 ||
+        !routes.has(o.route) ||
+        !Number.isFinite(Date.parse(o.observedAt)))
+        throw new Error("invalid observation metadata");
+    if (!["request", "response", "stream_init", "stream_chunk", "completion"].includes(o.kind) ||
+        !/^[a-f0-9]{64}$/.test(o.contentSha256))
+        throw new Error("unsupported observation");
+    for (const [key, val] of Object.entries(o.correlation ?? {})) {
+        if (![
+            "requestId",
+            "runId",
+            "jobId",
+            "traceId",
+            "rootExecutionId",
+            "opencodeSessionId",
+            "operationId",
+            "stepId",
+            "partId",
+            "attemptId",
+        ].includes(key) ||
+            typeof val !== "string" ||
+            val.length > 256)
+            throw new Error("invalid correlation");
+    }
+    if (o.correlationConflicts &&
+        (!Array.isArray(o.correlationConflicts) ||
+            o.correlationConflicts.length > 10 ||
+            o.correlationConflicts.some((x) => typeof x !== "string" || x.length > 64)))
+        throw new Error("invalid correlation conflicts");
+    for (const field of [
+        "pluginVersion",
+        "redactionVersion",
+        "sourceFormat",
+        "requestedModel",
+        "sourceTraceId",
+        "gap",
+        "completionOutcome",
+    ]) {
+        if (o[field] !== undefined && (typeof o[field] !== "string" || o[field].length > 256))
+            throw new Error("invalid optional metadata");
+    }
+    if (!o.pluginVersion || !o.redactionVersion)
+        throw new Error("capture versions required");
+    if (o.kind === "completion" &&
+        !["succeeded", "failed", "canceled", "rejected"].includes(o.completionOutcome ?? ""))
+        throw new Error("invalid completion outcome");
+    if (o.bodyFraming !== undefined &&
+        !["stock_json_chunk", "stock_sse_candidate"].includes(o.bodyFraming))
+        throw new Error("invalid body framing");
+    if (o.observedBodyBytes !== undefined &&
+        (!Number.isSafeInteger(o.observedBodyBytes) ||
+            o.observedBodyBytes < 0 ||
+            o.observedBodyBytes > MAX_ENVELOPE_BYTES))
+        throw new Error("invalid observed byte count");
+    const body = decodeBody(o);
+    if ((await sha256(body)) !== o.contentSha256)
+        throw new Error("content digest mismatch");
+    return {
+        observation: o,
+        body,
+        identity: await observationIdentity(o),
+        callId: await callIdentity(o),
+        digest: await sha256(raw),
+    };
+}
+export const MAX_SEGMENT_BYTES = 1408 * 1024;
+export async function validateSegment(raw, expected) {
+    if (raw.length > MAX_ENVELOPE_BYTES)
+        throw new Error("envelope limit");
+    const envelope = JSON.parse(new TextDecoder("utf-8", { fatal: true }).decode(raw));
+    if (envelope.schemaVersion !== 1 ||
+        envelope.operation !== "segment" ||
+        envelope.destinationId !== expected.destinationId ||
+        !expected.instanceIds.includes(envelope.instanceId) ||
+        !Number.isSafeInteger(envelope.firstSequence) ||
+        !Number.isSafeInteger(envelope.throughSequence) ||
+        envelope.firstSequence < 1 ||
+        envelope.throughSequence < envelope.firstSequence ||
+        envelope.throughSequence - envelope.firstSequence >= 256 ||
+        typeof envelope.contentBase64 !== "string" ||
+        envelope.contentBase64.length > Math.ceil(MAX_SEGMENT_BYTES / 3) * 4)
+        throw new Error("invalid segment");
+    const content = Uint8Array.from(atob(envelope.contentBase64), (c) => c.charCodeAt(0));
+    if (content.byteLength !== envelope.contentBytes ||
+        content.byteLength > MAX_SEGMENT_BYTES ||
+        (await sha256(content)) !== envelope.contentSha256)
+        throw new Error("segment integrity failure");
+    const lines = new TextDecoder("utf-8", { fatal: true }).decode(content).split("\n");
+    if (lines.at(-1) === "")
+        lines.pop();
+    if (lines.length !== envelope.throughSequence - envelope.firstSequence + 1)
+        throw new Error("segment sequence count mismatch");
+    const observations = [];
+    for (const [index, line] of lines.entries()) {
+        const { observation } = await validateObservation(new TextEncoder().encode(line), expected);
+        if (observation.instanceId !== envelope.instanceId ||
+            observation.pluginBootId !== envelope.pluginBootId ||
+            observation.requestId !== envelope.requestId ||
+            observation.sequence !== envelope.firstSequence + index)
+            throw new Error("segment identity mismatch");
+        observations.push(observation);
+    }
+    const first = observations[0];
+    if (observations.some((o, index) => o.route !== first.route ||
+        o.configRevision !== first.configRevision ||
+        (o.kind === "completion" && index !== observations.length - 1)))
+        throw new Error("inconsistent segment lifecycle");
+    const callId = await callIdentity(first);
+    const identity = await sha256(new TextEncoder().encode(JSON.stringify([
+        envelope.destinationId,
+        envelope.instanceId,
+        envelope.pluginBootId,
+        envelope.requestId,
+        envelope.firstSequence,
+        envelope.throughSequence,
+    ])));
+    return { envelope, observations, content, callId, identity, digest: envelope.contentSha256 };
+}
+//# sourceMappingURL=index.js.map

package/dist/capture/index.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"index.js","sourceRoot":"","sources":["../../src/capture/index.ts"],"names":[],"mappings":"AACA,MAAM,CAAC,MAAM,kBAAkB,GAAG,CAAC,GAAG,IAAI,GAAG,IAAI,CAAC;AAClD,MAAM,CAAC,MAAM,iBAAiB,GAAG,IAAI,GAAG,IAAI,CAAC;AAC7C,MAAM,EAAE,GAAG,qCAAqC,CAAC;AACjD,MAAM,MAAM,GAAG,IAAI,GAAG,CAAC;IACrB,gBAAgB;IAChB,mBAAmB;IACnB,gCAAgC;IAChC,oBAAoB;IACpB,2BAA2B;CAC5B,CAAC,CAAC;AAoCH,MAAM,CAAC,KAAK,UAAU,MAAM,CAAC,KAAiB;IAC5C,MAAM,MAAM,GAAG,MAAM,MAAM,CAAC,MAAM,CAAC,MAAM,CAAC,SAAS,EAAE,UAAU,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC,CAAC;IAC7E,OAAO,KAAK,CAAC,IAAI,CAAC,IAAI,UAAU,CAAC,MAAM,CAAC,EAAE,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,QAAQ,CAAC,EAAE,CAAC,CAAC,QAAQ,CAAC,CAAC,EAAE,GAAG,CAAC,CAAC,CAAC,IAAI,CAAC,EAAE,CAAC,CAAC;AAC7F,CAAC;AACD,MAAM,CAAC,KAAK,UAAU,mBAAmB,CAAC,CAAuB;IAC/D,OAAO,MAAM,CACX,IAAI,WAAW,EAAE,CAAC,MAAM,CACtB,IAAI,CAAC,SAAS,CAAC;QACb,CAAC,CAAC,aAAa;QACf,CAAC,CAAC,UAAU;QACZ,CAAC,CAAC,YAAY;QACd,CAAC,CAAC,SAAS;QACX,CAAC,CAAC,QAAQ;QACV,CAAC,CAAC,IAAI;KACP,CAAC,CACH,CACF,CAAC;AACJ,CAAC;AACD,MAAM,CAAC,KAAK,UAAU,YAAY,CAChC,CAA4F;IAE5F,OAAO,MAAM,CACX,IAAI,WAAW,EAAE,CAAC,MAAM,CACtB,IAAI,CAAC,SAAS,CAAC,CAAC,CAAC,CAAC,aAAa,EAAE,CAAC,CAAC,UAAU,EAAE,CAAC,CAAC,YAAY,EAAE,CAAC,CAAC,SAAS,CAAC,CAAC,CAC7E,CACF,CAAC;AACJ,CAAC;AACD,MAAM,UAAU,UAAU,CAAC,CAAuB;IAChD,MAAM,GAAG,GAAG,CAAC,CAAC,IAAI,IAAI,EAAE,CAAC;IACzB,IACE,GAAG,CAAC,MAAM,GAAG,IAAI,CAAC,IAAI,CAAC,iBAAiB,GAAG,CAAC,CAAC,GAAG,CAAC;QACjD,CAAC,kEAAkE,CAAC,IAAI,CAAC,GAAG,CAAC;QAE7E,MAAM,IAAI,KAAK,CAAC,uBAAuB,CAAC,CAAC;IAC3C,MAAM,OAAO,GAAG,IAAI,CAAC,GAAG,CAAC,CAAC;IAC1B,IAAI,OAAO,CAAC,MAAM,GAAG,iBAAiB,IAAI,OAAO,CAAC,MAAM,KAAK,CAAC,CAAC,YAAY;QACzE,MAAM,IAAI,KAAK,CAAC,oBAAoB,CAAC,CAAC;IACxC,OAAO,UAAU,CAAC,IAAI,CAAC,OAAO,EAAE,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,UAAU,CAAC,CAAC,CAAC,CAAC,CAAC;AAC1D,CAAC;AACD,MAAM,CAAC,KAAK,UAAU,mBAAmB,CACvC,GAAe,EACf,QAAmE;IAEnE,IAAI,GAAG,CAAC,UAAU,GAAG,kBAAkB;QAAE,MAAM,IAAI,KAAK,CAAC,gBAAgB,CAAC,CAAC;IAC3E,MAAM,KAAK,GAAY,IAAI,CAAC,KAAK,CAAC,IAAI,WAAW,CAAC,OAAO,EAAE,EAAE,KAAK,EAAE,IAAI,EAAE,CAAC,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC,CAAC;IACzF,IAAI,CAAC,KAAK,IAAI,OAAO,KAAK,KAAK,QAAQ,IAAI,KAAK,CAAC,OAAO,CAAC,KAAK,CAAC;QAC7D,MAAM,IAAI,KAAK,CAAC,sBAAsB,CAAC,CAAC;IAC1C,MAAM,CAAC,GAAG,KAA6B,CAAC;IACxC,IACE,CAAC,CAAC,aAAa,KAAK,CAAC;QACrB,CAAC,CAAC,aAAa,KAAK,QAAQ,CAAC,aAAa;QAC1C,CAAC,QAAQ,CAAC,WAAW,CAAC,QAAQ,CAAC,CAAC,CAAC,UAAU,CAAC;QAE5C,MAAM,IAAI,KAAK,CAAC,gBAAgB,CAAC,CAAC;IACpC,KAAK,MAAM,KAAK,IAAI;QAClB,eAAe;QACf,YAAY;QACZ,cAAc;QACd,WAAW;QACX,gBAAgB;KACR,EAAE,CAAC;QACX,IAAI,OAAO,CAAC,CAAC,KAAK,CAAC,KAAK,QAAQ,IAAI,CAAC,EAAE,CAAC,IAAI,CAAC,CAAC,CAAC,KAAK,CAAC,CAAC;YAAE,MAAM,IAAI,KAAK,CAAC,kBAAkB,CAAC,CAAC;IAC9F,CAAC;IACD,IACE,CAAC,MAAM,CAAC,aAAa,CAAC,CAAC,CAAC,QAAQ,CAAC;QACjC,CAAC,CAAC,QAAQ,GAAG,CAAC;QACd,CAAC,MAAM,CAAC,aAAa,CAAC,CAAC,CAAC,QAAQ,CAAC;QACjC,CAAC,CAAC,QAAQ,GAAG,CAAC;QACd,CAAC,MAAM,CAAC,aAAa,CAAC,CAAC,CAAC,YAAY,CAAC;QACrC,CAAC,CAAC,YAAY,GAAG,CAAC;QAClB,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC,CAAC,KAAK,CAAC;QACpB,CAAC,MAAM,CAAC,QAAQ,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC,CAAC,UAAU,CAAC,CAAC;QAE1C,MAAM,IAAI,KAAK,CAAC,8BAA8B,CAAC,CAAC;IAClD,IACE,CAAC,CAAC,SAAS,EAAE,UAAU,EAAE,aAAa,EAAE,cAAc,EAAE,YAAY,CAAC,CAAC,QAAQ,CAAC,CAAC,CAAC,IAAI,CAAC;QACtF,CAAC,gBAAgB,CAAC,IAAI,CAAC,CAAC,CAAC,aAAa,CAAC;QAEvC,MAAM,IAAI,KAAK,CAAC,yBAAyB,CAAC,CAAC;IAC7C,KAAK,MAAM,CAAC,GAAG,EAAE,GAAG,CAAC,IAAI,MAAM,CAAC,OAAO,CAAC,CAAC,CAAC,WAAW,IAAI,EAAE,CAAC,EAAE,CAAC;QAC7D,IACE,CAAC;YACC,WAAW;YACX,OAAO;YACP,OAAO;YACP,SAAS;YACT,iBAAiB;YACjB,mBAAmB;YACnB,aAAa;YACb,QAAQ;YACR,QAAQ;YACR,WAAW;SACZ,CAAC,QAAQ,CAAC,GAAG,CAAC;YACf,OAAO,GAAG,KAAK,QAAQ;YACvB,GAAG,CAAC,MAAM,GAAG,GAAG;YAEhB,MAAM,IAAI,KAAK,CAAC,qBAAqB,CAAC,CAAC;IAC3C,CAAC;IACD,IACE,CAAC,CAAC,oBAAoB;QACtB,CAAC,CAAC,KAAK,CAAC,OAAO,CAAC,CAAC,CAAC,oBAAoB,CAAC;YACrC,CAAC,CAAC,oBAAoB,CAAC,MAAM,GAAG,EAAE;YAClC,CAAC,CAAC,oBAAoB,CAAC,IAAI,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,OAAO,CAAC,KAAK,QAAQ,IAAI,CAAC,CAAC,MAAM,GAAG,EAAE,CAAC,CAAC;QAE7E,MAAM,IAAI,KAAK,CAAC,+BAA+B,CAAC,CAAC;IACnD,KAAK,MAAM,KAAK,IAAI;QAClB,eAAe;QACf,kBAAkB;QAClB,cAAc;QACd,gBAAgB;QAChB,eAAe;QACf,KAAK;QACL,mBAAmB;KACX,EAAE,CAAC;QACX,IAAI,CAAC,CAAC,KAAK,CAAC,KAAK,SAAS,IAAI,CAAC,OAAO,CAAC,CAAC,KAAK,CAAC,KAAK,QAAQ,IAAI,CAAC,CAAC,KAAK,CAAE,CAAC,MAAM,GAAG,GAAG,CAAC;YACpF,MAAM,IAAI,KAAK,CAAC,2BAA2B,CAAC,CAAC;IACjD,CAAC;IACD,IAAI,CAAC,CAAC,CAAC,aAAa,IAAI,CAAC,CAAC,CAAC,gBAAgB;QAAE,MAAM,IAAI,KAAK,CAAC,2BAA2B,CAAC,CAAC;IAC1F,IACE,CAAC,CAAC,IAAI,KAAK,YAAY;QACvB,CAAC,CAAC,WAAW,EAAE,QAAQ,EAAE,UAAU,EAAE,UAAU,CAAC,CAAC,QAAQ,CAAC,CAAC,CAAC,iBAAiB,IAAI,EAAE,CAAC;QAEpF,MAAM,IAAI,KAAK,CAAC,4BAA4B,CAAC,CAAC;IAChD,IACE,CAAC,CAAC,WAAW,KAAK,SAAS;QAC3B,CAAC,CAAC,kBAAkB,EAAE,qBAAqB,CAAC,CAAC,QAAQ,CAAC,CAAC,CAAC,WAAW,CAAC;QAEpE,MAAM,IAAI,KAAK,CAAC,sBAAsB,CAAC,CAAC;IAC1C,IACE,CAAC,CAAC,iBAAiB,KAAK,SAAS;QACjC,CAAC,CAAC,MAAM,CAAC,aAAa,CAAC,CAAC,CAAC,iBAAiB,CAAC;YACzC,CAAC,CAAC,iBAAiB,GAAG,CAAC;YACvB,CAAC,CAAC,iBAAiB,GAAG,kBAAkB,CAAC;QAE3C,MAAM,IAAI,KAAK,CAAC,6BAA6B,CAAC,CAAC;IACjD,MAAM,IAAI,GAAG,UAAU,CAAC,CAAC,CAAC,CAAC;IAC3B,IAAI,CAAC,MAAM,MAAM,CAAC,IAAI,CAAC,CAAC,KAAK,CAAC,CAAC,aAAa;QAAE,MAAM,IAAI,KAAK,CAAC,yBAAyB,CAAC,CAAC;IACzF,OAAO;QACL,WAAW,EAAE,CAAC;QACd,IAAI;QACJ,QAAQ,EAAE,MAAM,mBAAmB,CAAC,CAAC,CAAC;QACtC,MAAM,EAAE,MAAM,YAAY,CAAC,CAAC,CAAC;QAC7B,MAAM,EAAE,MAAM,MAAM,CAAC,GAAG,CAAC;KAC1B,CAAC;AACJ,CAAC;AAgBD,MAAM,CAAC,MAAM,iBAAiB,GAAG,IAAI,GAAG,IAAI,CAAC;AAC7C,MAAM,CAAC,KAAK,UAAU,eAAe,CACnC,GAAe,EACf,QAAmE;IAEnE,IAAI,GAAG,CAAC,MAAM,GAAG,kBAAkB;QAAE,MAAM,IAAI,KAAK,CAAC,gBAAgB,CAAC,CAAC;IACvE,MAAM,QAAQ,GAAG,IAAI,CAAC,KAAK,CACzB,IAAI,WAAW,CAAC,OAAO,EAAE,EAAE,KAAK,EAAE,IAAI,EAAE,CAAC,CAAC,MAAM,CAAC,GAAG,CAAC,CAClC,CAAC;IACtB,IACE,QAAQ,CAAC,aAAa,KAAK,CAAC;QAC5B,QAAQ,CAAC,SAAS,KAAK,SAAS;QAChC,QAAQ,CAAC,aAAa,KAAK,QAAQ,CAAC,aAAa;QACjD,CAAC,QAAQ,CAAC,WAAW,CAAC,QAAQ,CAAC,QAAQ,CAAC,UAAU,CAAC;QACnD,CAAC,MAAM,CAAC,aAAa,CAAC,QAAQ,CAAC,aAAa,CAAC;QAC7C,CAAC,MAAM,CAAC,aAAa,CAAC,QAAQ,CAAC,eAAe,CAAC;QAC/C,QAAQ,CAAC,aAAa,GAAG,CAAC;QAC1B,QAAQ,CAAC,eAAe,GAAG,QAAQ,CAAC,aAAa;QACjD,QAAQ,CAAC,eAAe,GAAG,QAAQ,CAAC,aAAa,IAAI,GAAG;QACxD,OAAO,QAAQ,CAAC,aAAa,KAAK,QAAQ;QAC1C,QAAQ,CAAC,aAAa,CAAC,MAAM,GAAG,IAAI,CAAC,IAAI,CAAC,iBAAiB,GAAG,CAAC,CAAC,GAAG,CAAC;QAEpE,MAAM,IAAI,KAAK,CAAC,iBAAiB,CAAC,CAAC;IACrC,MAAM,OAAO,GAAG,UAAU,CAAC,IAAI,CAAC,IAAI,CAAC,QAAQ,CAAC,aAAa,CAAC,EAAE,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,UAAU,CAAC,CAAC,CAAC,CAAC,CAAC;IACtF,IACE,OAAO,CAAC,UAAU,KAAK,QAAQ,CAAC,YAAY;QAC5C,OAAO,CAAC,UAAU,GAAG,iBAAiB;QACtC,CAAC,MAAM,MAAM,CAAC,OAAO,CAAC,CAAC,KAAK,QAAQ,CAAC,aAAa;QAElD,MAAM,IAAI,KAAK,CAAC,2BAA2B,CAAC,CAAC;IAC/C,MAAM,KAAK,GAAG,IAAI,WAAW,CAAC,OAAO,EAAE,EAAE,KAAK,EAAE,IAAI,EAAE,CAAC,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,KAAK,CAAC,IAAI,CAAC,CAAC;IACpF,IAAI,KAAK,CAAC,EAAE,CAAC,CAAC,CAAC,CAAC,KAAK,EAAE;QAAE,KAAK,CAAC,GAAG,EAAE,CAAC;IACrC,IAAI,KAAK,CAAC,MAAM,KAAK,QAAQ,CAAC,eAAe,GAAG,QAAQ,CAAC,aAAa,GAAG,CAAC;QACxE,MAAM,IAAI,KAAK,CAAC,iCAAiC,CAAC,CAAC;IACrD,MAAM,YAAY,GAA2B,EAAE,CAAC;IAChD,KAAK,MAAM,CAAC,KAAK,EAAE,IAAI,CAAC,IAAI,KAAK,CAAC,OAAO,EAAE,EAAE,CAAC;QAC5C,MAAM,EAAE,WAAW,EAAE,GAAG,MAAM,mBAAmB,CAAC,IAAI,WAAW,EAAE,CAAC,MAAM,CAAC,IAAI,CAAC,EAAE,QAAQ,CAAC,CAAC;QAC5F,IACE,WAAW,CAAC,UAAU,KAAK,QAAQ,CAAC,UAAU;YAC9C,WAAW,CAAC,YAAY,KAAK,QAAQ,CAAC,YAAY;YAClD,WAAW,CAAC,SAAS,KAAK,QAAQ,CAAC,SAAS;YAC5C,WAAW,CAAC,QAAQ,KAAK,QAAQ,CAAC,aAAa,GAAG,KAAK;YAEvD,MAAM,IAAI,KAAK,CAAC,2BAA2B,CAAC,CAAC;QAC/C,YAAY,CAAC,IAAI,CAAC,WAAW,CAAC,CAAC;IACjC,CAAC;IACD,MAAM,KAAK,GAAG,YAAY,CAAC,CAAC,CAAE,CAAC;IAC/B,IACE,YAAY,CAAC,IAAI,CACf,CAAC,CAAC,EAAE,KAAK,EAAE,EAAE,CACX,CAAC,CAAC,KAAK,KAAK,KAAK,CAAC,KAAK;QACvB,CAAC,CAAC,cAAc,KAAK,KAAK,CAAC,cAAc;QACzC,CAAC,CAAC,CAAC,IAAI,KAAK,YAAY,IAAI,KAAK,KAAK,YAAY,CAAC,MAAM,GAAG,CAAC,CAAC,CACjE;QAED,MAAM,IAAI,KAAK,CAAC,gCAAgC,CAAC,CAAC;IACpD,MAAM,MAAM,GAAG,MAAM,YAAY,CAAC,KAAK,CAAC,CAAC;IACzC,MAAM,QAAQ,GAAG,MAAM,MAAM,CAC3B,IAAI,WAAW,EAAE,CAAC,MAAM,CACtB,IAAI,CAAC,SAAS,CAAC;QACb,QAAQ,CAAC,aAAa;QACtB,QAAQ,CAAC,UAAU;QACnB,QAAQ,CAAC,YAAY;QACrB,QAAQ,CAAC,SAAS;QAClB,QAAQ,CAAC,aAAa;QACtB,QAAQ,CAAC,eAAe;KACzB,CAAC,CACH,CACF,CAAC;IACF,OAAO,EAAE,QAAQ,EAAE,YAAY,EAAE,OAAO,EAAE,MAAM,EAAE,QAAQ,EAAE,MAAM,EAAE,QAAQ,CAAC,aAAa,EAAE,CAAC;AAC/F,CAAC"}