@trillboards/edge-sdk 0.2.49 → 0.2.52

package/README.md

@@ -106,6 +106,63 @@ The SDK auto-detects device capabilities and adjusts inference accordingly:
 - `directml` — Windows GPU acceleration
 - `cuda` — NVIDIA GPU
 
+## Acoustic Sensing (opt-in)
+
+The connector can hear as well as see. A microphone catches what a camera has
+nothing to show for — a freezer door left open behind a shelf, glass breaking off
+frame, an alarm in the next room — so an acoustic **onset** is allowed to carry a
+frame that the motion cascade would otherwise have dropped as `no_motion`.
+
+**It is OFF by default, and that default is a consent position rather than a
+rollout setting.** Many US states are all-party-consent for audio; the cameras
+this connector attaches to belong to the customer and were very likely installed,
+signed and papered for video. Turning this on has to be somebody's explicit
+decision.
+
+```ts
+new CloudSensingManager({
+  loops,
+  motionGate: { enabled: true },      // the acoustic gate rides the visual cascade
+  audioSensing: {
+    enabled: true,                    // <- explicit; default false
+    maxAudioSessionsPerSource: 1,     // long-lived audio sessions per recorder
+  },
+});
+```
+
+Every failure on this path is non-fatal by construction — a recorder that refuses
+admission, a stream with no audio track, a missing ffmpeg — all leave the camera
+loops untouched. Audio is supplementary and can never stop a feed from producing
+frames.
+
+### Why the gate is DSP and not the on-device model
+
+Gemma 4 was measured against this exact runtime before the path was built. It
+**transcribes speech excellently and does not name acoustic events**: on real
+recordings it scored 2/8 on an open prompt and 3/8 forced-choice, where every hit
+was an animate vocalization (dog, baby, applause) and every mechanical / impact /
+tonal event — breaking glass, a door slam, a smoke alarm — missed, defaulting to
+the label `speech` on audio containing no speech.
+
+So the two halves are split by what each is actually good at:
+
+| Job | Implementation |
+|---|---|
+| "Did something happen?" | `AudioOnsetDetector` — rolling background estimate + threshold |
+| "What was said?" | `LiteRtVlmProvider.transcribeAudio` (Gemma, via litert-lm `input_audio`) |
+
+The full measured battery is in the `AudioOnsetDetector` header, and the operator
+view is in [docs/runbooks/audio-sensing-substrate.md](../../../docs/runbooks/audio-sensing-substrate.md) §0.
+
+### New exports
+
+| Export | Purpose |
+|---|---|
+| `AudioOnsetDetector`, `rmsDbfs`, `SILENCE_DBFS` | Acoustic onset detection (dBFS — **not** a 0..4 tier) |
+| `attachAudioOnset` | Joins an audio transport to a feed's `MotionGate`; returns `null` when a feed has no audio |
+| `encodeWav16`, `takeMostRecentSeconds` | Float32 PCM → 16-bit mono WAV for the model's `input_audio` |
+| `MotionGateReason: 'audio_onset'` | New cascade verdict — a heard event carried this frame |
+
 ## Sub-Packages
 
 This is the umbrella package. For fine-grained control, install sub-packages individually:
@@ -119,6 +176,7 @@ This is the umbrella package. For fine-grained control, install sub-packages ind
 | [@trillboards/edge-cloud](https://www.npmjs.com/package/@trillboards/edge-cloud) | Gemini Vision scene analysis, contextual targeting |
 | [@trillboards/edge-platform-linux](https://www.npmjs.com/package/@trillboards/edge-platform-linux) | V4L2 camera, PulseAudio, systemd, kiosk mode |
 | [@trillboards/edge-platform-windows](https://www.npmjs.com/package/@trillboards/edge-platform-windows) | DirectShow, RTSP IP cameras, WASAPI audio |
+| [@trillboards/edge-platform-rtsp](https://www.npmjs.com/package/@trillboards/edge-platform-rtsp) | RTSP camera frames, RTSP **audio** sessions, macOS microphone |
 
 ## MCP Server (AI Agent Integration)
 

package/dist/AudioOnsetDetector.d.ts

@@ -0,0 +1,211 @@
+/**
+ * AudioOnsetDetector — the connector's acoustic equivalent of
+ * `SceneChangeDetector`: the CHEAP stage that answers "did anything happen?"
+ * so the expensive stage (a VLM inference) is spent only when it might matter.
+ *
+ * ── WHY THIS IS DSP AND NOT A MODEL. The plan for this feature was to let
+ * Gemma 4 name acoustic events directly — it is already on the box, litert-lm
+ * accepts `input_audio`, and both encoders ship in our `.litertlm`, so no
+ * second model would be needed. That was MEASURED before it was built, and it
+ * does not hold. Against `gemma-4-E2B-it.litertlm,gpu`, mono 16 kHz WAV, real
+ * recordings, fresh serve, a speech control passing before and after every
+ * trial, on an Apple M4 Max — and run TWICE, on litert-lm 0.13.1 (the machine
+ * default) and again on an isolated 0.16.0 (the version both provisioners pin,
+ * so the one the fleet actually runs). The two agree clip-for-clip:
+ *
+ *   | clip          | open prompt ("describe every sound")  | forced choice |
+ *   |---------------|---------------------------------------|---------------|
+ *   | glass break   | "I cannot hear any audio"             | `speech`      |
+ *   | glass break 2 | "you haven't provided an audio file"  | `speech`      |
+ *   | door slam     | "a click or a snap"                   | `speech`      |
+ *   | smoke alarm   | "I cannot hear any audio"             | `speech`      |
+ *   | siren         | "possibly a scream or a siren"        | `dog_barking` |
+ *   | dog bark      | "resemble a bird call"                | `dog_barking` |
+ *   | baby cry      | "possibly laughter or screams"        | `baby_crying` |
+ *   | applause      | "a single, loud, sharp sound"         | `applause`    |
+ *
+ * 2/8 open, 3/8 forced — the SAME 3/8 and the same per-clip labels on both
+ * runtimes, siren -> `dog_barking` included, so this is a property of the model
+ * and not of a runtime version. The three forced-choice hits are ALL animate
+ * vocalizations (dog, baby, human hands); every miss is mechanical, impact or
+ * tonal — and those four default to the label `speech` on audio containing no
+ * speech at all, because it is a speech model. The result is stable, not noisy:
+ * the smoke alarm returned a byte-identical refusal 16/16 times on a fresh
+ * serve, and the siren reads as `dog_barking` even as the FIRST request after a
+ * restart, so it is a real misclassification and not cross-request context
+ * bleed. The audio was genuinely INGESTED in every one of those trials — proven
+ * by a mixed control, `glass_then_speech.wav`, whose speech (which is SECOND in
+ * the file) transcribes exactly; a miss is therefore a capability result and
+ * not a silently dropped payload.
+ *
+ * The three events the product actually needs — a freezer door, breaking glass,
+ * a smoke alarm — are 0/3 in BOTH prompt regimes. So the gate is DSP, and Gemma
+ * keeps the half it is genuinely excellent at: it transcribed
+ * "There is a fire in the kitchen, everyone get out now" verbatim, 30/30, in
+ * 0.63–5.83 s. Speech goes to the model; "something happened" does not.
+ *
+ * TWO THINGS THOSE TIMINGS ARE NOT. (1) The DELEGATE is unconfirmed: the `,gpu`
+ * id was POSTed, but no engine trace was read back, and a warm mldrift cache
+ * does not re-emit the `Replacing N … (LITERT_WEBGPU)` line — so a latency range
+ * quoted here may span two delegates. The CAPABILITY result does not depend on
+ * that; the latencies are indicative only. (2) They are not this feature's
+ * running cost. The gate never calls the model at all — see below.
+ *
+ * ── COST, WHICH IS THE POINT OF PUTTING IT HERE. `litert-lm serve` is a SINGLE
+ * conversation and the connector's whole inference budget flows through it. A
+ * model-based gate would have spent that budget continuously, at 25 audio
+ * tokens per second of audio, on a machine already ceilinged in analyses/hour.
+ * This detector spends NONE of it: measured over 1 h of 16 kHz audio pushed in
+ * 100 ms blocks (36,000 blocks, one M4 Max core), it costs 50.5 ms of CPU
+ * total — 1.40 µs per block, 0.0014% of one core — and zero model tokens. The
+ * acoustic channel is therefore free with respect to the serial slot, and only
+ * `transcribeAudio` (opt-in, speech only) ever competes for it.
+ *
+ * ── WHAT IT DOES. Frame the PCM into short hops, take each hop's RMS in dBFS,
+ * hold a rolling estimate of the room's background level, and fire when a hop
+ * stands `thresholdDb` above that background for at least `minDurationMs`.
+ *
+ * ── THE ONE NON-OBVIOUS RULE, AND IT IS BORROWED ON PURPOSE. The background
+ * must NOT absorb the event that is currently firing. `SceneChangeDetector`
+ * carries the visual form of this rule from Frigate (rule 1 in its header: the
+ * background only moves after motion has persisted `BACKGROUND_UPDATE_AFTER_FRAMES`
+ * frames, otherwise a slowly-moving object is absorbed mid-walk and becomes
+ * invisible). The acoustic failure is the same shape and worse, because sound
+ * levels move much faster than pixels: a mean that updates every hop is dragged
+ * up by the very transient it is supposed to be measuring against, so a long
+ * event raises its own floor and the detector goes deaf partway through it.
+ * So the background updates freely while the room is quiet, and while a hop is
+ * above threshold it updates ONLY once that loudness has PERSISTED past
+ * `backgroundAbsorbAfterMs`. A 200 ms door slam never moves the floor; a
+ * genuinely louder room (a compressor kicking on, a lunch rush) is absorbed
+ * after a few seconds and stops re-firing forever.
+ *
+ * ── CALIBRATION, for the same reason `SceneChangeDetector` has it. On the
+ * first hops there is no trustworthy background, and firing off a floor built
+ * from one sample means every connector start costs an inference storm. The
+ * detector reports `calibrating` until it has `calibrationFrames` hops and
+ * refuses to fire until then. Unlike the visual detector it never RE-ENTERS
+ * calibration: there is no acoustic analogue of the dusk IR-cut flip that
+ * changes every pixel at once, and a detector that can be talked back into
+ * calibration by loud audio is a detector an attacker (or a busy store) can
+ * silence.
+ *
+ * ── REFRACTORY. One physical event is many loud hops. `refractoryMs` collapses
+ * a burst into ONE onset so a single dropped tray does not spend the feed's
+ * whole inference budget.
+ *
+ * ── UNITS: THIS CLASS EMITS dBFS AND NOTHING ELSE. dBFS here is a NEGATIVE
+ * number relative to full scale (digital silence floors at `SILENCE_DBFS`).
+ * It is deliberately NOT a 0..4 loudness tier. The Android DOOH fleet wired a
+ * tier-valued device field to a decibel-valued server field, and the decibel
+ * column has read as a constant sentinel on 100% of rows ever since — a value
+ * that scores perfectly on any fill-rate monitor while measuring nothing, and
+ * which pins every venue at "quiet". A tier and a decibel level are two
+ * quantities, not a naming difference; docs/runbooks/audio-sensing-substrate.md
+ * §3 names both fields and why they must never be aliased. Nothing in this file
+ * writes either of them: a caller that wants a tier must map dBFS to one
+ * explicitly and own that mapping.
+ */
+/** dBFS reported for a digitally-silent hop. Finite so the EMA stays finite. */
+export declare const SILENCE_DBFS = -100;
+export interface AudioOnsetDetectorOptions {
+    /** Sample rate of the PCM handed to `push()` (Hz). */
+    sampleRate: number;
+    /** Analysis hop length (ms). Default 20 — short enough to catch an impact. */
+    frameMs?: number;
+    /** dB above background that counts as an onset. Default 12. */
+    thresholdDb?: number;
+    /** Loudness must persist this long to fire (ms). Default 40. */
+    minDurationMs?: number;
+    /** Minimum gap between two reported onsets (ms). Default 3000. */
+    refractoryMs?: number;
+    /** Hops required before the background is trusted. Default 50 (=1 s @20 ms). */
+    calibrationFrames?: number;
+    /** Background EMA blend per quiet hop, 0..1. Default 0.02 (~1 s constant). */
+    backgroundAlpha?: number;
+    /**
+     * Sustained loudness is absorbed into the background after this long (ms).
+     * Default 4000. This is the acoustic form of Frigate's
+     * `BACKGROUND_UPDATE_AFTER_FRAMES` — see the header.
+     */
+    backgroundAbsorbAfterMs?: number;
+    /**
+     * Absolute floor: hops quieter than this never fire, however far above the
+     * background they sit. Without it a silent room's background collapses toward
+     * `SILENCE_DBFS` and pure dither trips the threshold. Default -55 dBFS.
+     */
+    minLevelDbfs?: number;
+    /** Clock injection for tests. */
+    now?: () => number;
+}
+export interface AudioOnsetEvent {
+    /** Wall-clock ms at which the onset was reported. */
+    atMs: number;
+    /** Peak hop level (dBFS) observed during the triggering burst. */
+    peakDbfs: number;
+    /** Background level (dBFS) the peak was measured against. */
+    backgroundDbfs: number;
+    /** `peakDbfs - backgroundDbfs`, i.e. how far above the room it stood. */
+    excessDb: number;
+    /** How long the burst had been above threshold when it fired (ms). */
+    durationMs: number;
+}
+export interface AudioOnsetStats {
+    framesSeen: number;
+    onsets: number;
+    calibrating: boolean;
+    /** Current rolling background estimate (dBFS), or null while uncalibrated. */
+    backgroundDbfs: number | null;
+    /** Most recent hop level (dBFS), or null before any audio. */
+    lastLevelDbfs: number | null;
+    suppressedByRefractory: number;
+}
+/** RMS of a slice, expressed in dBFS (0 = full scale). */
+export declare function rmsDbfs(samples: Float32Array, from: number, to: number): number;
+/**
+ * Stateful, one instance per audio feed. PCM must be pushed to the SAME
+ * instance in capture order — like `SceneChangeDetector`, the background model
+ * is the state.
+ */
+export declare class AudioOnsetDetector {
+    private readonly sampleRate;
+    private readonly frameSamples;
+    private readonly frameMs;
+    private readonly thresholdDb;
+    private readonly minDurationMs;
+    private readonly refractoryMs;
+    private readonly calibrationFrames;
+    private readonly backgroundAlpha;
+    private readonly backgroundAbsorbAfterMs;
+    private readonly minLevelDbfs;
+    private readonly now;
+    /** Samples carried across `push()` boundaries so hops are never torn. */
+    private residue;
+    private background;
+    private framesSeen;
+    private lastLevelDbfs;
+    /** ms of contiguous above-threshold audio accumulated so far. */
+    private aboveMs;
+    private burstPeakDbfs;
+    private burstBackgroundDbfs;
+    /** Set once a burst has fired, so it fires ONCE rather than every hop. */
+    private burstFired;
+    private lastOnsetAtMs;
+    private onsets;
+    private suppressedByRefractory;
+    constructor(options: AudioOnsetDetectorOptions);
+    isCalibrating(): boolean;
+    getStats(): AudioOnsetStats;
+    /**
+     * Feed PCM. Returns every onset detected within THIS push (usually none, and
+     * at most one per `refractoryMs`). Sample count need not align to a hop — the
+     * remainder is carried into the next call so an event straddling a buffer
+     * boundary is not silently split.
+     */
+    push(pcm: Float32Array, nowMs?: number): AudioOnsetEvent[];
+    /** Drop all state — used when a feed reconnects and continuity is broken. */
+    reset(): void;
+    /** One hop. Split out so the state machine is readable in one screen. */
+    private consumeFrame;
+}
+//# sourceMappingURL=AudioOnsetDetector.d.ts.map

package/dist/AudioOnsetDetector.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"AudioOnsetDetector.d.ts","sourceRoot":"","sources":["../src/AudioOnsetDetector.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;GA2GG;AAEH,gFAAgF;AAChF,eAAO,MAAM,YAAY,OAAO,CAAC;AAEjC,MAAM,WAAW,yBAAyB;IACxC,sDAAsD;IACtD,UAAU,EAAE,MAAM,CAAC;IACnB,8EAA8E;IAC9E,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,+DAA+D;IAC/D,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,gEAAgE;IAChE,aAAa,CAAC,EAAE,MAAM,CAAC;IACvB,kEAAkE;IAClE,YAAY,CAAC,EAAE,MAAM,CAAC;IACtB,gFAAgF;IAChF,iBAAiB,CAAC,EAAE,MAAM,CAAC;IAC3B,8EAA8E;IAC9E,eAAe,CAAC,EAAE,MAAM,CAAC;IACzB;;;;OAIG;IACH,uBAAuB,CAAC,EAAE,MAAM,CAAC;IACjC;;;;OAIG;IACH,YAAY,CAAC,EAAE,MAAM,CAAC;IACtB,iCAAiC;IACjC,GAAG,CAAC,EAAE,MAAM,MAAM,CAAC;CACpB;AAED,MAAM,WAAW,eAAe;IAC9B,qDAAqD;IACrD,IAAI,EAAE,MAAM,CAAC;IACb,kEAAkE;IAClE,QAAQ,EAAE,MAAM,CAAC;IACjB,6DAA6D;IAC7D,cAAc,EAAE,MAAM,CAAC;IACvB,yEAAyE;IACzE,QAAQ,EAAE,MAAM,CAAC;IACjB,sEAAsE;IACtE,UAAU,EAAE,MAAM,CAAC;CACpB;AAED,MAAM,WAAW,eAAe;IAC9B,UAAU,EAAE,MAAM,CAAC;IACnB,MAAM,EAAE,MAAM,CAAC;IACf,WAAW,EAAE,OAAO,CAAC;IACrB,8EAA8E;IAC9E,cAAc,EAAE,MAAM,GAAG,IAAI,CAAC;IAC9B,8DAA8D;IAC9D,aAAa,EAAE,MAAM,GAAG,IAAI,CAAC;IAC7B,sBAAsB,EAAE,MAAM,CAAC;CAChC;AAaD,0DAA0D;AAC1D,wBAAgB,OAAO,CAAC,OAAO,EAAE,YAAY,EAAE,IAAI,EAAE,MAAM,EAAE,EAAE,EAAE,MAAM,GAAG,MAAM,CAU/E;AAED;;;;GAIG;AACH,qBAAa,kBAAkB;IAC7B,OAAO,CAAC,QAAQ,CAAC,UAAU,CAAS;IACpC,OAAO,CAAC,QAAQ,CAAC,YAAY,CAAS;IACtC,OAAO,CAAC,QAAQ,CAAC,OAAO,CAAS;IACjC,OAAO,CAAC,QAAQ,CAAC,WAAW,CAAS;IACrC,OAAO,CAAC,QAAQ,CAAC,aAAa,CAAS;IACvC,OAAO,CAAC,QAAQ,CAAC,YAAY,CAAS;IACtC,OAAO,CAAC,QAAQ,CAAC,iBAAiB,CAAS;IAC3C,OAAO,CAAC,QAAQ,CAAC,eAAe,CAAS;IACzC,OAAO,CAAC,QAAQ,CAAC,uBAAuB,CAAS;IACjD,OAAO,CAAC,QAAQ,CAAC,YAAY,CAAS;IACtC,OAAO,CAAC,QAAQ,CAAC,GAAG,CAAe;IAEnC,yEAAyE;IACzE,OAAO,CAAC,OAAO,CAAqC;IAEpD,OAAO,CAAC,UAAU,CAAgB;IAClC,OAAO,CAAC,UAAU,CAAK;IACvB,OAAO,CAAC,aAAa,CAAuB;IAE5C,iEAAiE;IACjE,OAAO,CAAC,OAAO,CAAK;IACpB,OAAO,CAAC,aAAa,CAAgB;IACrC,OAAO,CAAC,mBAAmB,CAAgB;IAC3C,0EAA0E;IAC1E,OAAO,CAAC,UAAU,CAAS;IAE3B,OAAO,CAAC,aAAa,CAAuB;IAC5C,OAAO,CAAC,MAAM,CAAK;IACnB,OAAO,CAAC,sBAAsB,CAAK;gBAEvB,OAAO,EAAE,yBAAyB;IAiB9C,aAAa,IAAI,OAAO;IAIxB,QAAQ,IAAI,eAAe;IAW3B;;;;;OAKG;IACH,IAAI,CAAC,GAAG,EAAE,YAAY,EAAE,KAAK,CAAC,EAAE,MAAM,GAAG,eAAe,EAAE;IAyB1D,6EAA6E;IAC7E,KAAK,IAAI,IAAI;IAcb,yEAAyE;IACzE,OAAO,CAAC,YAAY;CAwDrB"}

package/dist/AudioOnsetDetector.js

@@ -0,0 +1,286 @@
+"use strict";
+/**
+ * AudioOnsetDetector — the connector's acoustic equivalent of
+ * `SceneChangeDetector`: the CHEAP stage that answers "did anything happen?"
+ * so the expensive stage (a VLM inference) is spent only when it might matter.
+ *
+ * ── WHY THIS IS DSP AND NOT A MODEL. The plan for this feature was to let
+ * Gemma 4 name acoustic events directly — it is already on the box, litert-lm
+ * accepts `input_audio`, and both encoders ship in our `.litertlm`, so no
+ * second model would be needed. That was MEASURED before it was built, and it
+ * does not hold. Against `gemma-4-E2B-it.litertlm,gpu`, mono 16 kHz WAV, real
+ * recordings, fresh serve, a speech control passing before and after every
+ * trial, on an Apple M4 Max — and run TWICE, on litert-lm 0.13.1 (the machine
+ * default) and again on an isolated 0.16.0 (the version both provisioners pin,
+ * so the one the fleet actually runs). The two agree clip-for-clip:
+ *
+ *   | clip          | open prompt ("describe every sound")  | forced choice |
+ *   |---------------|---------------------------------------|---------------|
+ *   | glass break   | "I cannot hear any audio"             | `speech`      |
+ *   | glass break 2 | "you haven't provided an audio file"  | `speech`      |
+ *   | door slam     | "a click or a snap"                   | `speech`      |
+ *   | smoke alarm   | "I cannot hear any audio"             | `speech`      |
+ *   | siren         | "possibly a scream or a siren"        | `dog_barking` |
+ *   | dog bark      | "resemble a bird call"                | `dog_barking` |
+ *   | baby cry      | "possibly laughter or screams"        | `baby_crying` |
+ *   | applause      | "a single, loud, sharp sound"         | `applause`    |
+ *
+ * 2/8 open, 3/8 forced — the SAME 3/8 and the same per-clip labels on both
+ * runtimes, siren -> `dog_barking` included, so this is a property of the model
+ * and not of a runtime version. The three forced-choice hits are ALL animate
+ * vocalizations (dog, baby, human hands); every miss is mechanical, impact or
+ * tonal — and those four default to the label `speech` on audio containing no
+ * speech at all, because it is a speech model. The result is stable, not noisy:
+ * the smoke alarm returned a byte-identical refusal 16/16 times on a fresh
+ * serve, and the siren reads as `dog_barking` even as the FIRST request after a
+ * restart, so it is a real misclassification and not cross-request context
+ * bleed. The audio was genuinely INGESTED in every one of those trials — proven
+ * by a mixed control, `glass_then_speech.wav`, whose speech (which is SECOND in
+ * the file) transcribes exactly; a miss is therefore a capability result and
+ * not a silently dropped payload.
+ *
+ * The three events the product actually needs — a freezer door, breaking glass,
+ * a smoke alarm — are 0/3 in BOTH prompt regimes. So the gate is DSP, and Gemma
+ * keeps the half it is genuinely excellent at: it transcribed
+ * "There is a fire in the kitchen, everyone get out now" verbatim, 30/30, in
+ * 0.63–5.83 s. Speech goes to the model; "something happened" does not.
+ *
+ * TWO THINGS THOSE TIMINGS ARE NOT. (1) The DELEGATE is unconfirmed: the `,gpu`
+ * id was POSTed, but no engine trace was read back, and a warm mldrift cache
+ * does not re-emit the `Replacing N … (LITERT_WEBGPU)` line — so a latency range
+ * quoted here may span two delegates. The CAPABILITY result does not depend on
+ * that; the latencies are indicative only. (2) They are not this feature's
+ * running cost. The gate never calls the model at all — see below.
+ *
+ * ── COST, WHICH IS THE POINT OF PUTTING IT HERE. `litert-lm serve` is a SINGLE
+ * conversation and the connector's whole inference budget flows through it. A
+ * model-based gate would have spent that budget continuously, at 25 audio
+ * tokens per second of audio, on a machine already ceilinged in analyses/hour.
+ * This detector spends NONE of it: measured over 1 h of 16 kHz audio pushed in
+ * 100 ms blocks (36,000 blocks, one M4 Max core), it costs 50.5 ms of CPU
+ * total — 1.40 µs per block, 0.0014% of one core — and zero model tokens. The
+ * acoustic channel is therefore free with respect to the serial slot, and only
+ * `transcribeAudio` (opt-in, speech only) ever competes for it.
+ *
+ * ── WHAT IT DOES. Frame the PCM into short hops, take each hop's RMS in dBFS,
+ * hold a rolling estimate of the room's background level, and fire when a hop
+ * stands `thresholdDb` above that background for at least `minDurationMs`.
+ *
+ * ── THE ONE NON-OBVIOUS RULE, AND IT IS BORROWED ON PURPOSE. The background
+ * must NOT absorb the event that is currently firing. `SceneChangeDetector`
+ * carries the visual form of this rule from Frigate (rule 1 in its header: the
+ * background only moves after motion has persisted `BACKGROUND_UPDATE_AFTER_FRAMES`
+ * frames, otherwise a slowly-moving object is absorbed mid-walk and becomes
+ * invisible). The acoustic failure is the same shape and worse, because sound
+ * levels move much faster than pixels: a mean that updates every hop is dragged
+ * up by the very transient it is supposed to be measuring against, so a long
+ * event raises its own floor and the detector goes deaf partway through it.
+ * So the background updates freely while the room is quiet, and while a hop is
+ * above threshold it updates ONLY once that loudness has PERSISTED past
+ * `backgroundAbsorbAfterMs`. A 200 ms door slam never moves the floor; a
+ * genuinely louder room (a compressor kicking on, a lunch rush) is absorbed
+ * after a few seconds and stops re-firing forever.
+ *
+ * ── CALIBRATION, for the same reason `SceneChangeDetector` has it. On the
+ * first hops there is no trustworthy background, and firing off a floor built
+ * from one sample means every connector start costs an inference storm. The
+ * detector reports `calibrating` until it has `calibrationFrames` hops and
+ * refuses to fire until then. Unlike the visual detector it never RE-ENTERS
+ * calibration: there is no acoustic analogue of the dusk IR-cut flip that
+ * changes every pixel at once, and a detector that can be talked back into
+ * calibration by loud audio is a detector an attacker (or a busy store) can
+ * silence.
+ *
+ * ── REFRACTORY. One physical event is many loud hops. `refractoryMs` collapses
+ * a burst into ONE onset so a single dropped tray does not spend the feed's
+ * whole inference budget.
+ *
+ * ── UNITS: THIS CLASS EMITS dBFS AND NOTHING ELSE. dBFS here is a NEGATIVE
+ * number relative to full scale (digital silence floors at `SILENCE_DBFS`).
+ * It is deliberately NOT a 0..4 loudness tier. The Android DOOH fleet wired a
+ * tier-valued device field to a decibel-valued server field, and the decibel
+ * column has read as a constant sentinel on 100% of rows ever since — a value
+ * that scores perfectly on any fill-rate monitor while measuring nothing, and
+ * which pins every venue at "quiet". A tier and a decibel level are two
+ * quantities, not a naming difference; docs/runbooks/audio-sensing-substrate.md
+ * §3 names both fields and why they must never be aliased. Nothing in this file
+ * writes either of them: a caller that wants a tier must map dBFS to one
+ * explicitly and own that mapping.
+ */
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.AudioOnsetDetector = exports.SILENCE_DBFS = void 0;
+exports.rmsDbfs = rmsDbfs;
+/** dBFS reported for a digitally-silent hop. Finite so the EMA stays finite. */
+exports.SILENCE_DBFS = -100;
+const DEFAULTS = {
+    frameMs: 20,
+    thresholdDb: 12,
+    minDurationMs: 40,
+    refractoryMs: 3000,
+    calibrationFrames: 50,
+    backgroundAlpha: 0.02,
+    backgroundAbsorbAfterMs: 4000,
+    minLevelDbfs: -55,
+};
+/** RMS of a slice, expressed in dBFS (0 = full scale). */
+function rmsDbfs(samples, from, to) {
+    let sum = 0;
+    for (let i = from; i < to; i++) {
+        const s = samples[i];
+        sum += s * s;
+    }
+    const n = Math.max(1, to - from);
+    const rms = Math.sqrt(sum / n);
+    if (!(rms > 0))
+        return exports.SILENCE_DBFS;
+    return Math.max(exports.SILENCE_DBFS, 20 * Math.log10(rms));
+}
+/**
+ * Stateful, one instance per audio feed. PCM must be pushed to the SAME
+ * instance in capture order — like `SceneChangeDetector`, the background model
+ * is the state.
+ */
+class AudioOnsetDetector {
+    constructor(options) {
+        /** Samples carried across `push()` boundaries so hops are never torn. */
+        this.residue = new Float32Array(0);
+        this.background = exports.SILENCE_DBFS;
+        this.framesSeen = 0;
+        this.lastLevelDbfs = null;
+        /** ms of contiguous above-threshold audio accumulated so far. */
+        this.aboveMs = 0;
+        this.burstPeakDbfs = exports.SILENCE_DBFS;
+        this.burstBackgroundDbfs = exports.SILENCE_DBFS;
+        /** Set once a burst has fired, so it fires ONCE rather than every hop. */
+        this.burstFired = false;
+        this.lastOnsetAtMs = null;
+        this.onsets = 0;
+        this.suppressedByRefractory = 0;
+        if (!(options.sampleRate > 0)) {
+            throw new Error('AudioOnsetDetector requires a positive sampleRate');
+        }
+        this.sampleRate = options.sampleRate;
+        this.frameMs = Math.max(1, Math.trunc(options.frameMs ?? DEFAULTS.frameMs));
+        this.frameSamples = Math.max(1, Math.round((this.sampleRate * this.frameMs) / 1000));
+        this.thresholdDb = options.thresholdDb ?? DEFAULTS.thresholdDb;
+        this.minDurationMs = Math.max(0, options.minDurationMs ?? DEFAULTS.minDurationMs);
+        this.refractoryMs = Math.max(0, options.refractoryMs ?? DEFAULTS.refractoryMs);
+        this.calibrationFrames = Math.max(1, Math.trunc(options.calibrationFrames ?? DEFAULTS.calibrationFrames));
+        this.backgroundAlpha = Math.min(1, Math.max(0, options.backgroundAlpha ?? DEFAULTS.backgroundAlpha));
+        this.backgroundAbsorbAfterMs = Math.max(0, options.backgroundAbsorbAfterMs ?? DEFAULTS.backgroundAbsorbAfterMs);
+        this.minLevelDbfs = options.minLevelDbfs ?? DEFAULTS.minLevelDbfs;
+        this.now = options.now ?? Date.now;
+    }
+    isCalibrating() {
+        return this.framesSeen < this.calibrationFrames;
+    }
+    getStats() {
+        return {
+            framesSeen: this.framesSeen,
+            onsets: this.onsets,
+            calibrating: this.isCalibrating(),
+            backgroundDbfs: this.framesSeen === 0 ? null : this.background,
+            lastLevelDbfs: this.lastLevelDbfs,
+            suppressedByRefractory: this.suppressedByRefractory,
+        };
+    }
+    /**
+     * Feed PCM. Returns every onset detected within THIS push (usually none, and
+     * at most one per `refractoryMs`). Sample count need not align to a hop — the
+     * remainder is carried into the next call so an event straddling a buffer
+     * boundary is not silently split.
+     */
+    push(pcm, nowMs) {
+        const now = nowMs ?? this.now();
+        const events = [];
+        let buf;
+        if (this.residue.length === 0) {
+            buf = pcm;
+        }
+        else {
+            buf = new Float32Array(this.residue.length + pcm.length);
+            buf.set(this.residue, 0);
+            buf.set(pcm, this.residue.length);
+        }
+        let offset = 0;
+        while (offset + this.frameSamples <= buf.length) {
+            const level = rmsDbfs(buf, offset, offset + this.frameSamples);
+            const event = this.consumeFrame(level, now);
+            if (event)
+                events.push(event);
+            offset += this.frameSamples;
+        }
+        this.residue = offset > 0 ? buf.slice(offset) : buf;
+        return events;
+    }
+    /** Drop all state — used when a feed reconnects and continuity is broken. */
+    reset() {
+        this.residue = new Float32Array(0);
+        this.background = exports.SILENCE_DBFS;
+        this.framesSeen = 0;
+        this.lastLevelDbfs = null;
+        this.aboveMs = 0;
+        this.burstPeakDbfs = exports.SILENCE_DBFS;
+        this.burstBackgroundDbfs = exports.SILENCE_DBFS;
+        this.burstFired = false;
+        // `lastOnsetAtMs` deliberately SURVIVES: the refractory window is about the
+        // physical room, not about our bookkeeping, and a flapping feed that reset
+        // it could re-fire on every reconnect.
+    }
+    /** One hop. Split out so the state machine is readable in one screen. */
+    consumeFrame(level, now) {
+        this.lastLevelDbfs = level;
+        // Seed from the FIRST real reading rather than from the silence floor, for
+        // the reason SceneChangeDetector seeds its contrast ring from the first real
+        // reading: a synthetic seed makes the mapping crawl for the whole startup
+        // window and manufactures phantom events while it does.
+        if (this.framesSeen === 0)
+            this.background = level;
+        this.framesSeen++;
+        const calibrating = this.isCalibrating();
+        const excess = level - this.background;
+        const isLoud = excess >= this.thresholdDb && level >= this.minLevelDbfs;
+        if (!isLoud) {
+            // Quiet hop: the background tracks the room freely, and the burst ends.
+            this.background += this.backgroundAlpha * (level - this.background);
+            this.aboveMs = 0;
+            this.burstPeakDbfs = exports.SILENCE_DBFS;
+            this.burstFired = false;
+            return null;
+        }
+        // Loud hop. Record the burst, but do NOT let it move the background until it
+        // has persisted long enough to be a room change rather than an event.
+        if (this.aboveMs === 0)
+            this.burstBackgroundDbfs = this.background;
+        this.aboveMs += this.frameMs;
+        this.burstPeakDbfs = Math.max(this.burstPeakDbfs, level);
+        if (this.aboveMs >= this.backgroundAbsorbAfterMs) {
+            this.background += this.backgroundAlpha * (level - this.background);
+        }
+        if (calibrating)
+            return null;
+        if (this.burstFired)
+            return null;
+        if (this.aboveMs < this.minDurationMs)
+            return null;
+        if (this.lastOnsetAtMs !== null && now - this.lastOnsetAtMs < this.refractoryMs) {
+            // Still one physical event as far as the product is concerned. Mark the
+            // burst fired so it is counted once, not once per hop.
+            this.burstFired = true;
+            this.suppressedByRefractory++;
+            return null;
+        }
+        this.burstFired = true;
+        this.lastOnsetAtMs = now;
+        this.onsets++;
+        return {
+            atMs: now,
+            peakDbfs: this.burstPeakDbfs,
+            backgroundDbfs: this.burstBackgroundDbfs,
+            excessDb: this.burstPeakDbfs - this.burstBackgroundDbfs,
+            durationMs: this.aboveMs,
+        };
+    }
+}
+exports.AudioOnsetDetector = AudioOnsetDetector;
+//# sourceMappingURL=AudioOnsetDetector.js.map

package/dist/AudioOnsetDetector.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"AudioOnsetDetector.js","sourceRoot":"","sources":["../src/AudioOnsetDetector.ts"],"names":[],"mappings":";AAAA;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;GA2GG;;;AAwEH,0BAUC;AAhFD,gFAAgF;AACnE,QAAA,YAAY,GAAG,CAAC,GAAG,CAAC;AAyDjC,MAAM,QAAQ,GAAG;IACf,OAAO,EAAE,EAAE;IACX,WAAW,EAAE,EAAE;IACf,aAAa,EAAE,EAAE;IACjB,YAAY,EAAE,IAAK;IACnB,iBAAiB,EAAE,EAAE;IACrB,eAAe,EAAE,IAAI;IACrB,uBAAuB,EAAE,IAAK;IAC9B,YAAY,EAAE,CAAC,EAAE;CAClB,CAAC;AAEF,0DAA0D;AAC1D,SAAgB,OAAO,CAAC,OAAqB,EAAE,IAAY,EAAE,EAAU;IACrE,IAAI,GAAG,GAAG,CAAC,CAAC;IACZ,KAAK,IAAI,CAAC,GAAG,IAAI,EAAE,CAAC,GAAG,EAAE,EAAE,CAAC,EAAE,EAAE,CAAC;QAC/B,MAAM,CAAC,GAAG,OAAO,CAAC,CAAC,CAAC,CAAC;QACrB,GAAG,IAAI,CAAC,GAAG,CAAC,CAAC;IACf,CAAC;IACD,MAAM,CAAC,GAAG,IAAI,CAAC,GAAG,CAAC,CAAC,EAAE,EAAE,GAAG,IAAI,CAAC,CAAC;IACjC,MAAM,GAAG,GAAG,IAAI,CAAC,IAAI,CAAC,GAAG,GAAG,CAAC,CAAC,CAAC;IAC/B,IAAI,CAAC,CAAC,GAAG,GAAG,CAAC,CAAC;QAAE,OAAO,oBAAY,CAAC;IACpC,OAAO,IAAI,CAAC,GAAG,CAAC,oBAAY,EAAE,EAAE,GAAG,IAAI,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC,CAAC;AACtD,CAAC;AAED;;;;GAIG;AACH,MAAa,kBAAkB;IA+B7B,YAAY,OAAkC;QAlB9C,yEAAyE;QACjE,YAAO,GAAiB,IAAI,YAAY,CAAC,CAAC,CAAC,CAAC;QAE5C,eAAU,GAAG,oBAAY,CAAC;QAC1B,eAAU,GAAG,CAAC,CAAC;QACf,kBAAa,GAAkB,IAAI,CAAC;QAE5C,iEAAiE;QACzD,YAAO,GAAG,CAAC,CAAC;QACZ,kBAAa,GAAG,oBAAY,CAAC;QAC7B,wBAAmB,GAAG,oBAAY,CAAC;QAC3C,0EAA0E;QAClE,eAAU,GAAG,KAAK,CAAC;QAEnB,kBAAa,GAAkB,IAAI,CAAC;QACpC,WAAM,GAAG,CAAC,CAAC;QACX,2BAAsB,GAAG,CAAC,CAAC;QAGjC,IAAI,CAAC,CAAC,OAAO,CAAC,UAAU,GAAG,CAAC,CAAC,EAAE,CAAC;YAC9B,MAAM,IAAI,KAAK,CAAC,mDAAmD,CAAC,CAAC;QACvE,CAAC;QACD,IAAI,CAAC,UAAU,GAAG,OAAO,CAAC,UAAU,CAAC;QACrC,IAAI,CAAC,OAAO,GAAG,IAAI,CAAC,GAAG,CAAC,CAAC,EAAE,IAAI,CAAC,KAAK,CAAC,OAAO,CAAC,OAAO,IAAI,QAAQ,CAAC,OAAO,CAAC,CAAC,CAAC;QAC5E,IAAI,CAAC,YAAY,GAAG,IAAI,CAAC,GAAG,CAAC,CAAC,EAAE,IAAI,CAAC,KAAK,CAAC,CAAC,IAAI,CAAC,UAAU,GAAG,IAAI,CAAC,OAAO,CAAC,GAAG,IAAI,CAAC,CAAC,CAAC;QACrF,IAAI,CAAC,WAAW,GAAG,OAAO,CAAC,WAAW,IAAI,QAAQ,CAAC,WAAW,CAAC;QAC/D,IAAI,CAAC,aAAa,GAAG,IAAI,CAAC,GAAG,CAAC,CAAC,EAAE,OAAO,CAAC,aAAa,IAAI,QAAQ,CAAC,aAAa,CAAC,CAAC;QAClF,IAAI,CAAC,YAAY,GAAG,IAAI,CAAC,GAAG,CAAC,CAAC,EAAE,OAAO,CAAC,YAAY,IAAI,QAAQ,CAAC,YAAY,CAAC,CAAC;QAC/E,IAAI,CAAC,iBAAiB,GAAG,IAAI,CAAC,GAAG,CAAC,CAAC,EAAE,IAAI,CAAC,KAAK,CAAC,OAAO,CAAC,iBAAiB,IAAI,QAAQ,CAAC,iBAAiB,CAAC,CAAC,CAAC;QAC1G,IAAI,CAAC,eAAe,GAAG,IAAI,CAAC,GAAG,CAAC,CAAC,EAAE,IAAI,CAAC,GAAG,CAAC,CAAC,EAAE,OAAO,CAAC,eAAe,IAAI,QAAQ,CAAC,eAAe,CAAC,CAAC,CAAC;QACrG,IAAI,CAAC,uBAAuB,GAAG,IAAI,CAAC,GAAG,CAAC,CAAC,EAAE,OAAO,CAAC,uBAAuB,IAAI,QAAQ,CAAC,uBAAuB,CAAC,CAAC;QAChH,IAAI,CAAC,YAAY,GAAG,OAAO,CAAC,YAAY,IAAI,QAAQ,CAAC,YAAY,CAAC;QAClE,IAAI,CAAC,GAAG,GAAG,OAAO,CAAC,GAAG,IAAI,IAAI,CAAC,GAAG,CAAC;IACrC,CAAC;IAED,aAAa;QACX,OAAO,IAAI,CAAC,UAAU,GAAG,IAAI,CAAC,iBAAiB,CAAC;IAClD,CAAC;IAED,QAAQ;QACN,OAAO;YACL,UAAU,EAAE,IAAI,CAAC,UAAU;YAC3B,MAAM,EAAE,IAAI,CAAC,MAAM;YACnB,WAAW,EAAE,IAAI,CAAC,aAAa,EAAE;YACjC,cAAc,EAAE,IAAI,CAAC,UAAU,KAAK,CAAC,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,IAAI,CAAC,UAAU;YAC9D,aAAa,EAAE,IAAI,CAAC,aAAa;YACjC,sBAAsB,EAAE,IAAI,CAAC,sBAAsB;SACpD,CAAC;IACJ,CAAC;IAED;;;;;OAKG;IACH,IAAI,CAAC,GAAiB,EAAE,KAAc;QACpC,MAAM,GAAG,GAAG,KAAK,IAAI,IAAI,CAAC,GAAG,EAAE,CAAC;QAChC,MAAM,MAAM,GAAsB,EAAE,CAAC;QAErC,IAAI,GAAiB,CAAC;QACtB,IAAI,IAAI,CAAC,OAAO,CAAC,MAAM,KAAK,CAAC,EAAE,CAAC;YAC9B,GAAG,GAAG,GAAG,CAAC;QACZ,CAAC;aAAM,CAAC;YACN,GAAG,GAAG,IAAI,YAAY,CAAC,IAAI,CAAC,OAAO,CAAC,MAAM,GAAG,GAAG,CAAC,MAAM,CAAC,CAAC;YACzD,GAAG,CAAC,GAAG,CAAC,IAAI,CAAC,OAAO,EAAE,CAAC,CAAC,CAAC;YACzB,GAAG,CAAC,GAAG,CAAC,GAAG,EAAE,IAAI,CAAC,OAAO,CAAC,MAAM,CAAC,CAAC;QACpC,CAAC;QAED,IAAI,MAAM,GAAG,CAAC,CAAC;QACf,OAAO,MAAM,GAAG,IAAI,CAAC,YAAY,IAAI,GAAG,CAAC,MAAM,EAAE,CAAC;YAChD,MAAM,KAAK,GAAG,OAAO,CAAC,GAAG,EAAE,MAAM,EAAE,MAAM,GAAG,IAAI,CAAC,YAAY,CAAC,CAAC;YAC/D,MAAM,KAAK,GAAG,IAAI,CAAC,YAAY,CAAC,KAAK,EAAE,GAAG,CAAC,CAAC;YAC5C,IAAI,KAAK;gBAAE,MAAM,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC;YAC9B,MAAM,IAAI,IAAI,CAAC,YAAY,CAAC;QAC9B,CAAC;QAED,IAAI,CAAC,OAAO,GAAG,MAAM,GAAG,CAAC,CAAC,CAAC,CAAC,GAAG,CAAC,KAAK,CAAC,MAAM,CAAC,CAAC,CAAC,CAAC,GAAG,CAAC;QACpD,OAAO,MAAM,CAAC;IAChB,CAAC;IAED,6EAA6E;IAC7E,KAAK;QACH,IAAI,CAAC,OAAO,GAAG,IAAI,YAAY,CAAC,CAAC,CAAC,CAAC;QACnC,IAAI,CAAC,UAAU,GAAG,oBAAY,CAAC;QAC/B,IAAI,CAAC,UAAU,GAAG,CAAC,CAAC;QACpB,IAAI,CAAC,aAAa,GAAG,IAAI,CAAC;QAC1B,IAAI,CAAC,OAAO,GAAG,CAAC,CAAC;QACjB,IAAI,CAAC,aAAa,GAAG,oBAAY,CAAC;QAClC,IAAI,CAAC,mBAAmB,GAAG,oBAAY,CAAC;QACxC,IAAI,CAAC,UAAU,GAAG,KAAK,CAAC;QACxB,4EAA4E;QAC5E,2EAA2E;QAC3E,uCAAuC;IACzC,CAAC;IAED,yEAAyE;IACjE,YAAY,CAAC,KAAa,EAAE,GAAW;QAC7C,IAAI,CAAC,aAAa,GAAG,KAAK,CAAC;QAE3B,2EAA2E;QAC3E,6EAA6E;QAC7E,0EAA0E;QAC1E,wDAAwD;QACxD,IAAI,IAAI,CAAC,UAAU,KAAK,CAAC;YAAE,IAAI,CAAC,UAAU,GAAG,KAAK,CAAC;QACnD,IAAI,CAAC,UAAU,EAAE,CAAC;QAElB,MAAM,WAAW,GAAG,IAAI,CAAC,aAAa,EAAE,CAAC;QACzC,MAAM,MAAM,GAAG,KAAK,GAAG,IAAI,CAAC,UAAU,CAAC;QACvC,MAAM,MAAM,GAAG,MAAM,IAAI,IAAI,CAAC,WAAW,IAAI,KAAK,IAAI,IAAI,CAAC,YAAY,CAAC;QAExE,IAAI,CAAC,MAAM,EAAE,CAAC;YACZ,wEAAwE;YACxE,IAAI,CAAC,UAAU,IAAI,IAAI,CAAC,eAAe,GAAG,CAAC,KAAK,GAAG,IAAI,CAAC,UAAU,CAAC,CAAC;YACpE,IAAI,CAAC,OAAO,GAAG,CAAC,CAAC;YACjB,IAAI,CAAC,aAAa,GAAG,oBAAY,CAAC;YAClC,IAAI,CAAC,UAAU,GAAG,KAAK,CAAC;YACxB,OAAO,IAAI,CAAC;QACd,CAAC;QAED,6EAA6E;QAC7E,sEAAsE;QACtE,IAAI,IAAI,CAAC,OAAO,KAAK,CAAC;YAAE,IAAI,CAAC,mBAAmB,GAAG,IAAI,CAAC,UAAU,CAAC;QACnE,IAAI,CAAC,OAAO,IAAI,IAAI,CAAC,OAAO,CAAC;QAC7B,IAAI,CAAC,aAAa,GAAG,IAAI,CAAC,GAAG,CAAC,IAAI,CAAC,aAAa,EAAE,KAAK,CAAC,CAAC;QAEzD,IAAI,IAAI,CAAC,OAAO,IAAI,IAAI,CAAC,uBAAuB,EAAE,CAAC;YACjD,IAAI,CAAC,UAAU,IAAI,IAAI,CAAC,eAAe,GAAG,CAAC,KAAK,GAAG,IAAI,CAAC,UAAU,CAAC,CAAC;QACtE,CAAC;QAED,IAAI,WAAW;YAAE,OAAO,IAAI,CAAC;QAC7B,IAAI,IAAI,CAAC,UAAU;YAAE,OAAO,IAAI,CAAC;QACjC,IAAI,IAAI,CAAC,OAAO,GAAG,IAAI,CAAC,aAAa;YAAE,OAAO,IAAI,CAAC;QAEnD,IAAI,IAAI,CAAC,aAAa,KAAK,IAAI,IAAI,GAAG,GAAG,IAAI,CAAC,aAAa,GAAG,IAAI,CAAC,YAAY,EAAE,CAAC;YAChF,wEAAwE;YACxE,uDAAuD;YACvD,IAAI,CAAC,UAAU,GAAG,IAAI,CAAC;YACvB,IAAI,CAAC,sBAAsB,EAAE,CAAC;YAC9B,OAAO,IAAI,CAAC;QACd,CAAC;QAED,IAAI,CAAC,UAAU,GAAG,IAAI,CAAC;QACvB,IAAI,CAAC,aAAa,GAAG,GAAG,CAAC;QACzB,IAAI,CAAC,MAAM,EAAE,CAAC;QACd,OAAO;YACL,IAAI,EAAE,GAAG;YACT,QAAQ,EAAE,IAAI,CAAC,aAAa;YAC5B,cAAc,EAAE,IAAI,CAAC,mBAAmB;YACxC,QAAQ,EAAE,IAAI,CAAC,aAAa,GAAG,IAAI,CAAC,mBAAmB;YACvD,UAAU,EAAE,IAAI,CAAC,OAAO;SACzB,CAAC;IACJ,CAAC;CACF;AAtKD,gDAsKC"}