@talkpilot/core-db 1.3.66 → 1.3.68

package/.cursor/rules/development.mdc

@@ -1,65 +1,65 @@
----
-description: Development standards and conventions for the core-db package
-globs: src/**/*.ts
-alwaysApply: true
----
-
-# Development Standards
-
-This package provides a centralized database layer for multiple domains (TalkPilot and Municipal). Follow these rules to maintain consistency and reliability.
-
-## Project Structure
-
-- **`src/talkpilot/`**: All database logic, types, and getters related to the TalkPilot domain.
-- **`src/municipal/`**: All database logic, types, and getters related to the Municipal Data domain.
-- **`src/test-utils/`**: Shared testing infrastructure, including factories and database utilities.
-
-## Database Connection Pattern
-
-Each domain is isolated. They have their own `db` instance and must be connected independently.
-
-```typescript
-import { mongodbClient, municipalDataMongodbClient } from '@talkpilot/core-db';
-
-// TalkPilot
-await mongodbClient.connect(uri);
-
-// Municipal
-await municipalDataMongodbClient.connect(uri);
-```
-
-## Creating New Getters
-
-1. **Location**: Place getters in the relevant domain folder (e.g., `src/talkpilot/agents/agents.getters.ts`).
-2. **Naming**: Use `find...` for multiple results and `get...ById` for single results.
-3. **Domain isolation**: Always use the `getDb()` function from the current domain's `index.ts`.
-
-## Environment Validation
-
-Always validate configuration "on-demand" within the `connect` methods using the validation utilities.
-
-```typescript
-import { validateConfig, validateMongoUri } from '../utils/validation';
-
-async connect(uri?: string) {
-  const mongodbUri = uri || process.env.MONGO_URI;
-  validateConfig('MONGO_URI', mongodbUri);
-  validateMongoUri(mongodbUri!);
-  // ... connection logic
-}
-```
-
-## Testing Standards
-
-1. **In-Memory DB**: Use `mongodb-memory-server` for all tests. It is automatically initialized in `src/__tests__/setup.ts`.
-2. **Factories**: Use the Fishery factories in `src/test-utils/factories/` to generate test data.
-3. **Organization**: Place tests in a `__tests__` folder within the relevant domain.
-
-```typescript
-import { createAgent } from '../../../test-utils/factories';
-
-it('should find agents', async () => {
-  const agent = createAgent({ name: 'Test' });
-  // ... test logic
-});
-```
+---
+description: Development standards and conventions for the core-db package
+globs: src/**/*.ts
+alwaysApply: true
+---
+
+# Development Standards
+
+This package provides a centralized database layer for multiple domains (TalkPilot and Municipal). Follow these rules to maintain consistency and reliability.
+
+## Project Structure
+
+- **`src/talkpilot/`**: All database logic, types, and getters related to the TalkPilot domain.
+- **`src/municipal/`**: All database logic, types, and getters related to the Municipal Data domain.
+- **`src/test-utils/`**: Shared testing infrastructure, including factories and database utilities.
+
+## Database Connection Pattern
+
+Each domain is isolated. They have their own `db` instance and must be connected independently.
+
+```typescript
+import { mongodbClient, municipalDataMongodbClient } from '@talkpilot/core-db';
+
+// TalkPilot
+await mongodbClient.connect(uri);
+
+// Municipal
+await municipalDataMongodbClient.connect(uri);
+```
+
+## Creating New Getters
+
+1. **Location**: Place getters in the relevant domain folder (e.g., `src/talkpilot/agents/agents.getters.ts`).
+2. **Naming**: Use `find...` for multiple results and `get...ById` for single results.
+3. **Domain isolation**: Always use the `getDb()` function from the current domain's `index.ts`.
+
+## Environment Validation
+
+Always validate configuration "on-demand" within the `connect` methods using the validation utilities.
+
+```typescript
+import { validateConfig, validateMongoUri } from '../utils/validation';
+
+async connect(uri?: string) {
+  const mongodbUri = uri || process.env.MONGO_URI;
+  validateConfig('MONGO_URI', mongodbUri);
+  validateMongoUri(mongodbUri!);
+  // ... connection logic
+}
+```
+
+## Testing Standards
+
+1. **In-Memory DB**: Use `mongodb-memory-server` for all tests. It is automatically initialized in `src/__tests__/setup.ts`.
+2. **Factories**: Use the Fishery factories in `src/test-utils/factories/` to generate test data.
+3. **Organization**: Place tests in a `__tests__` folder within the relevant domain.
+
+```typescript
+import { createAgent } from '../../../test-utils/factories';
+
+it('should find agents', async () => {
+  const agent = createAgent({ name: 'Test' });
+  // ... test logic
+});
+```

package/AGENTS.md

@@ -1,49 +1,49 @@
-# AI Agent Guide for core-db
-
-Ground truth for AI coding agents in this repository. This is `@talkpilot/core-db` — the only package that should talk to Mongo. `.cursor/rules/development.mdc` exists but may lag (TalkPilot + Municipal only); do not expand those rules in an unrelated ticket.
-
-## What this is
-Shared Mongo layer: typed getters, schemas, factories, indexes. Consumed by TalkPilot, municipal, WebsiteTalk, and clinic services. Publishing a version here is how other repos pick up schema/getter changes.
-
-## Coding philosophy
-- Strict TypeScript. No `any`; use `unknown` and narrow.
-- No narrating comments.
-- Split types, getters, and schemas into separate files.
-
-## Project structure
-- `src/talkpilot/` — calls, flows, sessions, clients, phone numbers, subscriptions, …
-- `src/municipal/` — cities, streets, tickets, departmentsSubjects, …
-- `src/websitalk/` — scans, scanResources, websiteUrls.
-- `src/configuration/` — prompts, models.
-- `src/test-utils/` — Fishery factories and test DB helpers.
-- `src/utils/` — validation, pagination, shared types.
-- `dist/` is what consumers import — generated, tests excluded from the build.
-
-## Copy this
-New getter: `src/<domain>/<entity>/<entity>.types.ts` + `<entity>.getter.ts` (or `*.getters.ts`) + optional `<entity>.schema.ts` + barrel `index.ts` + `__tests__/<entity>.spec.ts`.
-Export it from `src/index.ts`.
-Examples: `src/talkpilot/calls/calls.getters.ts`, `src/talkpilot/phone_numbers/phone_numbers.getter.ts`.
-
-Naming: `find*` for many, `get*ById` (or equivalent single-doc) for one. Always use that domain’s `getDb()` / collection helper — never another domain’s client. Exception already on disk: `src/talkpilot/calls/calls.statistics.getters.ts` imports municipal `tickets.statistics.getters` — do not “clean that up.”
-
-## Where data lives
-This repo **owns** `mongodb`. Four isolated clients — connect each independently:
-
-- `mongodbClient` — TalkPilot
-- `municipalDataMongodbClient` — municipal
-- `websitalkMongodbClient` — WebsiteTalk
-- `configurationMongodbClient` — configuration
-
-Do not cross-import getters across domains, except the talkpilot call-stats → municipal tickets exception above.
-
-## Do / don't
-- Do not put HTTP, Express, or business orchestration here.
-- Validate `MONGO_URI` (and siblings) on demand in `connect()`, using `src/utils/validation`.
-- After a getter/schema change: bump package version, build, publish; then bump the consumer. Downstream pins skew — do not assume they are on latest.
-- `prepare` runs `build` on install.
-
-## Siblings
-Every Node service should call getters from here. If a service is about to `getDb().collection` or `import from 'mongodb'`, the getter belongs in this PR first.
-
-## Tests
-Jest + `mongodb-memory-server` (`src/__tests__/setup.ts`). Factories in `src/test-utils/factories/`. Colocate `__tests__/` under the domain.
+# AI Agent Guide for core-db
+
+Ground truth for AI coding agents in this repository. This is `@talkpilot/core-db` — the only package that should talk to Mongo. `.cursor/rules/development.mdc` exists but may lag (TalkPilot + Municipal only); do not expand those rules in an unrelated ticket.
+
+## What this is
+Shared Mongo layer: typed getters, schemas, factories, indexes. Consumed by TalkPilot, municipal, WebsiteTalk, and clinic services. Publishing a version here is how other repos pick up schema/getter changes.
+
+## Coding philosophy
+- Strict TypeScript. No `any`; use `unknown` and narrow.
+- No narrating comments.
+- Split types, getters, and schemas into separate files.
+
+## Project structure
+- `src/talkpilot/` — calls, flows, sessions, clients, phone numbers, subscriptions, …
+- `src/municipal/` — cities, streets, tickets, departmentsSubjects, …
+- `src/websitalk/` — scans, scanResources, websiteUrls.
+- `src/configuration/` — prompts, models.
+- `src/test-utils/` — Fishery factories and test DB helpers.
+- `src/utils/` — validation, pagination, shared types.
+- `dist/` is what consumers import — generated, tests excluded from the build.
+
+## Copy this
+New getter: `src/<domain>/<entity>/<entity>.types.ts` + `<entity>.getter.ts` (or `*.getters.ts`) + optional `<entity>.schema.ts` + barrel `index.ts` + `__tests__/<entity>.spec.ts`.
+Export it from `src/index.ts`.
+Examples: `src/talkpilot/calls/calls.getters.ts`, `src/talkpilot/phone_numbers/phone_numbers.getter.ts`.
+
+Naming: `find*` for many, `get*ById` (or equivalent single-doc) for one. Always use that domain’s `getDb()` / collection helper — never another domain’s client. Exception already on disk: `src/talkpilot/calls/calls.statistics.getters.ts` imports municipal `tickets.statistics.getters` — do not “clean that up.”
+
+## Where data lives
+This repo **owns** `mongodb`. Four isolated clients — connect each independently:
+
+- `mongodbClient` — TalkPilot
+- `municipalDataMongodbClient` — municipal
+- `websitalkMongodbClient` — WebsiteTalk
+- `configurationMongodbClient` — configuration
+
+Do not cross-import getters across domains, except the talkpilot call-stats → municipal tickets exception above.
+
+## Do / don't
+- Do not put HTTP, Express, or business orchestration here.
+- Validate `MONGO_URI` (and siblings) on demand in `connect()`, using `src/utils/validation`.
+- After a getter/schema change: bump package version, build, publish; then bump the consumer. Downstream pins skew — do not assume they are on latest.
+- `prepare` runs `build` on install.
+
+## Siblings
+Every Node service should call getters from here. If a service is about to `getDb().collection` or `import from 'mongodb'`, the getter belongs in this PR first.
+
+## Tests
+Jest + `mongodb-memory-server` (`src/__tests__/setup.ts`). Factories in `src/test-utils/factories/`. Colocate `__tests__/` under the domain.

package/DEVELOPMENT.md

@@ -1,141 +1,141 @@
-# Development Guide
-
-Welcome to the `core-db` development guide. This document explains how to set up, develop, and test this package.
-
-## Getting Started
-
-### Prerequisites
-
-- Node.js (v18 or later)
-- TypeScript
-
-### Setup
-
-1. Install dependencies:
-   ```bash
-   npm install
-   ```
-
-2. Build the project:
-   ```bash
-   npm run build
-   ```
-
-## Local Development
-
-Use `npm pack` to test local changes in a consuming project.
-
-1. In the `core-db` folder, build and pack:
-   ```bash
-   npm run build && npm pack
-   ```
-   This produces a file like `talkpilot-core-db-x.y.z.tgz` in the project root.
-
-2. In the consuming project, install it:
-   ```bash
-   npm install /path/to/core-db/talkpilot-core-db-x.y.z.tgz
-   ```
-
-3. After making further changes to `core-db`, repeat step 1 and reinstall in the consuming project.
-
-## Adding a New Getter
-
-1. **Define Types**: Add your data types in the relevant domain's `types.ts` file.
-2. **Implement Getter**: Add the function in the `getters.ts` file.
-3. **Export**: Ensure the getter is exported from the domain's `index.ts` and finally from the main `src/index.ts`.
-4. **Test**: Create a test in the domain's `__tests__` folder.
-
-## Signature Immutability
-
-`core-db` is a shared package consumed by multiple services that may not all update at the same time. A signature change that looks harmless locally can silently break a service that hasn't picked up the new version yet.
-
-**Rules:**
-
-- **Never change an existing parameter's type or name.**
-- **Never add a required parameter** to an existing function.
-- **Never remove a function.** Mark it `@deprecated` instead (see below).
-- **Safe additions only**: you may add optional parameters or parameters with defaults — existing callers will continue to compile without changes.
-
-**Deprecating instead of deleting:**
-
-When a function is no longer the right approach, mark it deprecated and explain why. Consumers can then migrate on their own schedule.
-
-```ts
-/**
- * @deprecated Use `newFunction` instead — reason for the change.
- */
-export const oldFunction = (...) => { ... };
-```
-
-The deprecation comment must include either the name of the replacement or a clear explanation of why the function was retired, so a consumer reading the warning knows exactly what to do.
-
-## Testing
-
-We use Jest with `mongodb-memory-server` for fast, isolated database tests.
-
-### Running Tests
-
-```bash
-npm test
-```
-
-### Using Factories
-
-Always use factories to generate test data to keep tests clean and maintainable.
-
-```typescript
-import { createCallDoc } from '../calls.getters';
-import { createOutGoingCallDoc } from '../../../test-utils/factories';
-
-it('should save a call', async () => {
-  const call = createOutGoingCallDoc({ callSid: 'CA123' });
-  await createCallDoc(call);
-  // ... assertions
-});
-```
-
-## Build Process
-
-The project is built using TypeScript (`tsc`). The output is generated in the `dist/` directory.
-
-- `main`: `dist/index.js`
-- `types`: `dist/index.d.ts`
-
-The `prepare` script in `package.json` ensures that the project is built automatically when installed via a Git URL.
-
-## Releasing a New Version
-
-Publish **only after the PR is approved and merged** — never from an unreviewed branch. Then, from the merged `main`:
-
-1. **Pull** the latest `main` so you publish exactly what was reviewed (see also [Branch Hygiene](#branch-hygiene)).
-2. **Bump the version** with `npm version <patch|minor|major>` (or edit `package.json`). Never reuse a number that already exists on the registry — check first with `npm view @talkpilot/core-db versions`.
-3. **Verify**: `npm run build` and `npm test` (the Pre-push checklist in the README).
-4. **Publish**: `npm publish` (requires the shared token — see [Team Access & Authentication](#team-access--authentication)).
-5. Downstream repos pick it up via `npm update @talkpilot/core-db` or their next container build.
-
-Add a short release note for the version in the README (the version table and per-version section).
-
-### If a published version turns out to be broken
-
-Never republish or unpublish — a reused or missing number leaves a confusing gap in the registry. Instead, publish a **new** version with the fix, and add a one-line warning to the broken version's row in the README version table (e.g. "⚠️ do not use — <reason>; upgrade to <next version>") so consumers know to skip it.
-
-## Team Access & Authentication
-
-To allow the whole team to publish and install without adding individual npm accounts, we use a shared **npm Granular Access Token**.
-
-### One-time Local Setup
-
-Each developer needs to add the shared token to their local npm configuration. Do **NOT** add this to the project's `.npmrc` file, as it will be committed to Git.
-
-1. Get the shared **npm Automation Token**.
-2. Open (or create) your global npm configuration file:
-   ```bash
-   nano ~/.npmrc
-   ```
-3. Add the following line (replace `[TOKEN]` with the actual token):
-   ```text
-   //registry.npmjs.org/:_authToken=[TOKEN]
-   ```
-4. Save and exit.
-
-Now you can run `npm publish` and `npm install` for scoped `@talkpilot` packages without being prompted for credentials.
+# Development Guide
+
+Welcome to the `core-db` development guide. This document explains how to set up, develop, and test this package.
+
+## Getting Started
+
+### Prerequisites
+
+- Node.js (v18 or later)
+- TypeScript
+
+### Setup
+
+1. Install dependencies:
+   ```bash
+   npm install
+   ```
+
+2. Build the project:
+   ```bash
+   npm run build
+   ```
+
+## Local Development
+
+Use `npm pack` to test local changes in a consuming project.
+
+1. In the `core-db` folder, build and pack:
+   ```bash
+   npm run build && npm pack
+   ```
+   This produces a file like `talkpilot-core-db-x.y.z.tgz` in the project root.
+
+2. In the consuming project, install it:
+   ```bash
+   npm install /path/to/core-db/talkpilot-core-db-x.y.z.tgz
+   ```
+
+3. After making further changes to `core-db`, repeat step 1 and reinstall in the consuming project.
+
+## Adding a New Getter
+
+1. **Define Types**: Add your data types in the relevant domain's `types.ts` file.
+2. **Implement Getter**: Add the function in the `getters.ts` file.
+3. **Export**: Ensure the getter is exported from the domain's `index.ts` and finally from the main `src/index.ts`.
+4. **Test**: Create a test in the domain's `__tests__` folder.
+
+## Signature Immutability
+
+`core-db` is a shared package consumed by multiple services that may not all update at the same time. A signature change that looks harmless locally can silently break a service that hasn't picked up the new version yet.
+
+**Rules:**
+
+- **Never change an existing parameter's type or name.**
+- **Never add a required parameter** to an existing function.
+- **Never remove a function.** Mark it `@deprecated` instead (see below).
+- **Safe additions only**: you may add optional parameters or parameters with defaults — existing callers will continue to compile without changes.
+
+**Deprecating instead of deleting:**
+
+When a function is no longer the right approach, mark it deprecated and explain why. Consumers can then migrate on their own schedule.
+
+```ts
+/**
+ * @deprecated Use `newFunction` instead — reason for the change.
+ */
+export const oldFunction = (...) => { ... };
+```
+
+The deprecation comment must include either the name of the replacement or a clear explanation of why the function was retired, so a consumer reading the warning knows exactly what to do.
+
+## Testing
+
+We use Jest with `mongodb-memory-server` for fast, isolated database tests.
+
+### Running Tests
+
+```bash
+npm test
+```
+
+### Using Factories
+
+Always use factories to generate test data to keep tests clean and maintainable.
+
+```typescript
+import { createCallDoc } from '../calls.getters';
+import { createOutGoingCallDoc } from '../../../test-utils/factories';
+
+it('should save a call', async () => {
+  const call = createOutGoingCallDoc({ callSid: 'CA123' });
+  await createCallDoc(call);
+  // ... assertions
+});
+```
+
+## Build Process
+
+The project is built using TypeScript (`tsc`). The output is generated in the `dist/` directory.
+
+- `main`: `dist/index.js`
+- `types`: `dist/index.d.ts`
+
+The `prepare` script in `package.json` ensures that the project is built automatically when installed via a Git URL.
+
+## Releasing a New Version
+
+Publish **only after the PR is approved and merged** — never from an unreviewed branch. Then, from the merged `main`:
+
+1. **Pull** the latest `main` so you publish exactly what was reviewed (see also [Branch Hygiene](#branch-hygiene)).
+2. **Bump the version** with `npm version <patch|minor|major>` (or edit `package.json`). Never reuse a number that already exists on the registry — check first with `npm view @talkpilot/core-db versions`.
+3. **Verify**: `npm run build` and `npm test` (the Pre-push checklist in the README).
+4. **Publish**: `npm publish` (requires the shared token — see [Team Access & Authentication](#team-access--authentication)).
+5. Downstream repos pick it up via `npm update @talkpilot/core-db` or their next container build.
+
+Add a short release note for the version in the README (the version table and per-version section).
+
+### If a published version turns out to be broken
+
+Never republish or unpublish — a reused or missing number leaves a confusing gap in the registry. Instead, publish a **new** version with the fix, and add a one-line warning to the broken version's row in the README version table (e.g. "⚠️ do not use — <reason>; upgrade to <next version>") so consumers know to skip it.
+
+## Team Access & Authentication
+
+To allow the whole team to publish and install without adding individual npm accounts, we use a shared **npm Granular Access Token**.
+
+### One-time Local Setup
+
+Each developer needs to add the shared token to their local npm configuration. Do **NOT** add this to the project's `.npmrc` file, as it will be committed to Git.
+
+1. Get the shared **npm Automation Token**.
+2. Open (or create) your global npm configuration file:
+   ```bash
+   nano ~/.npmrc
+   ```
+3. Add the following line (replace `[TOKEN]` with the actual token):
+   ```text
+   //registry.npmjs.org/:_authToken=[TOKEN]
+   ```
+4. Save and exit.
+
+Now you can run `npm publish` and `npm install` for scoped `@talkpilot` packages without being prompted for credentials.

package/README.md

@@ -37,7 +37,6 @@ L1:# @talkpilot/core-db
 - **TalkPilot domain** – Imports like `findAgents`, `getFlows`, `findCalls`, and `vectorSearchCalls` live in `src/talkpilot`. These functions are the canonical access pattern for call history, session metadata, and provider configs.
 - **Municipal domain** – Helpers such as `findStreets`, `getMunicipalCities`, `findDepartmentSubjects`, and `createTicket` live under `src/municipal` and feed MIS workflows (street hints, subject matching, Ash Bina tickets).
 - **Configuration domain** – `getPromptByName`, `findPrompts`, `getAllPrompts`, and `getPromptsByProduct` live under `src/configuration` and back MIS's `moked_106` prompt lookups (defaults, overridable per-client via `clientConfig.toolsPrompts`).
-- **Websitalk domain** (`scans`, `websiteUrls`) – ⚠️ **Not included in `clientExistsInAnyCollection`/`deleteClientDataAcrossDomains`.** Those collections hold the client's URLs, which an external website-talk API uses as a lookup key to clean up its own Mongo collections *and* other, non-Mongo data stores tied to the client. Deleting a client fully requires calling that external API separately — see the warning on `deleteClientDataAcrossDomains` in `src/talkpilot/clients/clients.lifecycle.ts`.
 
 ## Environment variables
 
@@ -179,11 +178,10 @@ Refer to `DEVELOPMENT.md` for the full walkthrough, token instructions, and fact
 | 1.3.47  | Added optional `accountOwnerEmail` field to `WebsiteTalkProduct` (CP-1715): the recipient for the end-of-call summary email, set once from the client's login email and editable in Settings. |
 | 1.3.48  | Fixed `getScanPages` search (CP-1726): user search input was passed unescaped into MongoDB's `$regex`, so a URL/title containing regex-special characters (e.g. `?`) failed to match even when the document existed. Added `escapeRegex()` and applied it before building the `url`/`title` `$regex` filter. No API changes. |
 | 1.3.49  | Internal tools configuration on flows (CP-1723): `Flow.internalTools` keyed by tool name (`enabled`, optional `maxCalls`, per-parameter `description`/`value` overrides) with matching `$jsonSchema` validator, plus `createFlow` / `updateFlowById` mutators and the `FlowUpdateParams` type so consumers stop writing to the `flows` collection directly. |
-| 1.3.52 | Client-lifecycle support for the TalkPilot Dashboard (PE-869): `clientExistsInAnyCollection`/`deleteClientDataAcrossDomains` (dynamic scan across talkpilot/municipal domains only, no hardcoded collection list; `auditLogs` is excluded so a client's own deletion record survives its deletion), new `auditLogs` collection & `insertAuditLog`/`findAuditLogs`/`countAuditLogs`, `getAllClientCredits` on `clients`. Added `results` statistics getters for the dashboard: `aggregateActiveCallsSummary`, `aggregateTodayCallsSummary`, `aggregateClientCallStats`, `aggregateSessionCallStats`, and `findClientIdsByCallSids` (for backOffice-server). On `phone_numbers`: fixed `getClientPhones`/`getAllClientPhoneMappings` to deduplicate append-only history records instead of returning raw duplicate rows per client; added `getDistinctClientPhonePairs`, `findClientsByPhoneNumbers`, and `deletePhoneNumberRecords` (removes every record for a phone number, across all clients, once it's released back to Twilio). website-talk (`scans`/`websiteUrls`) is intentionally NOT touched by `deleteClientDataAcrossDomains` — see the Websitalk domain note above; callers must call the external website-talk deletion API separately. No breaking changes. |
 | 1.3.57  | Phone-number bind getters: list by client, exclusive flow assign, unbind, and `flow_id` match for ObjectId or leftover string. `getClientByClientId`. |
 | 1.3.61  | Optional `activeFlowId` on `WebsiteTalkProduct` (CP-1849). WebsiteTalk updates this flow instead of the flow on a phone number. |
 | 1.3.62  | Pause/Resume support for WebsiteTalk scans (CP-1752): `PAUSED` and `CANCELED` added to `SCAN_STATUSES` (`PAUSED` deliberately excluded from `FINISHED_SCAN_STATUSES` — pausing isn't done, `CANCELED` is). Added `Scan.pausedAt`, tracked across pause/resume so elapsed-time display can freeze correctly instead of counting the paused duration. |
-| 1.3.66  | Added `calls`-based stats getters for the dashboard: `aggregateActiveCallsSummary`, `aggregateTodayCallsSummary`, `aggregateClientCallStats`, `aggregateSessionCallStats`, `getAllClientsLastCallDate`, `findClientIdsByCallSids` — read the flat `calls` collection directly instead of unwinding `results.calls[]`, with a full per-status breakdown (`ALL_STATUSES_FOR_BREAKDOWN`) instead of a fixed 5-status set. **Removed** the 1.3.52 `results`-based getters of the same names — they were never released, so this isn't a breaking change for any consumer. |
+| 1.3.64  | New `callTokenUsage` collection with `incrementCallTokenUsage` (CP-1810): per-call realtime token usage, one document per `callSid`. |
 
 ### 1.1.9
 
@@ -772,24 +770,6 @@ No — purely additive.
 
 No API changes. **WTIS** (the only current consumer of `getScanPages`) should upgrade to 1.3.48 or later to pick up the fix.
 
-### 1.3.52 — Client-lifecycle support for the TalkPilot Dashboard (PE-869)
-
-Adds centralized client deletion across the talkpilot/municipal domains, with an audit trail, plus supporting getters for the client-management dashboard.
-
-**Added**
-
-| Area | What |
-| --- | --- |
-| `clients` | `clientExistsInAnyCollection` / `deleteClientDataAcrossDomains` — dynamically scan and delete a client's data across every talkpilot/municipal collection (no hardcoded collection list). `auditLogs` is always excluded, so a client's own deletion record survives its own deletion. `getAllClientCredits`. |
-| `auditLogs` (new collection) | `insertAuditLog`, `findAuditLogs` (paginated), `countAuditLogs`. |
-| `results` | `aggregateActiveCallsSummary`, `aggregateTodayCallsSummary`, `aggregateClientCallStats`, `aggregateSessionCallStats` — call-volume/status dashboards. `findClientIdsByCallSids` — resolves clientId per callSid, added for backOffice-server. |
-| `phone_numbers` | Fixed `getClientPhones`/`getAllClientPhoneMappings` to deduplicate append-only history records. Added `getDistinctClientPhonePairs`, `findClientsByPhoneNumbers`, `deletePhoneNumberRecords` (clears every record for a number once released back to Twilio). |
-
-⚠️ website-talk (`scans`/`websiteUrls`) is intentionally **not** touched by `deleteClientDataAcrossDomains` — see the Websitalk domain note above. Callers must call the external website-talk deletion API separately for a full client delete.
-
-**Do I need to update my app?**
-
-No — purely additive, no breaking changes. Consumers opt in by importing the new getters above.
 ### 1.3.57 — Phone-number bind getters
 
 TalkPilot can bind any owned number to a flow without querying Mongo in the service layer. `flow_id` is matched as ObjectId or as a leftover string.
@@ -824,33 +804,6 @@ Optional `activeFlowId` on `WebsiteTalkProduct`. WTIS reads this field when it u
 
 No — the field is optional. **WTIS** should upgrade to **1.3.61** so the call-script update can use it.
 
-### 1.3.66 — Calls-based stats aggregations
-
-Adds stats getters that read the flat `calls` collection directly instead of unwinding `results.calls[]`, with a full per-status breakdown instead of a fixed 5-status set.
-
-**Added**
-
-| Export | Purpose |
-| --- | --- |
-| `aggregateActiveCallsSummary` | Active-calls-right-now summary, from `calls`. |
-| `aggregateTodayCallsSummary` | Status/type/minutes summary for a date range (or all-time with no range given), from `calls`. |
-| `aggregateClientCallStats` | Per-client breakdown with a full per-status `statusCounts` map and `lastCallDate`, from `calls`. |
-| `aggregateSessionCallStats` | Per-session breakdown with a full per-status `statusCounts` map, from `calls`. |
-| `getAllClientsLastCallDate` | Last call date per client, from `calls`. |
-| `findClientIdsByCallSids` | Resolves clientId per callSid, from `calls`. |
-
-The session breakdown groups by `sessionId` (not `sessionName`) so a renamed session doesn't split its stats across two rows; the name shown is a live lookup against the current `sessions` collection.
-
-⚠️ **Note:** the `calls` collection only reliably covers call volume from around late October 2025 onward (full per-status accuracy from mid-2026) — older history lives only in `results`. An "all time" aggregation on these getters will undercount clients whose history predates that cutover.
-
-**Removed**
-
-The `results`-based getters added in 1.3.52 (`aggregateActiveCallsSummary`, `aggregateTodayCallsSummary`, `aggregateClientCallStats`, `aggregateSessionCallStats`, `findClientIdsByCallSids`) are replaced by the `calls`-based getters above, under the same names. 1.3.52 was never released, so no consumer depended on them.
-
-**Do I need to update my app?**
-
-No — these are new getters, and the 1.3.52 ones they replace were never released, so nothing existing depends on either.
-
 ## 🛠 CI/CD & deployment
 
 - This package is consumed by Cloud Build-based services (TalkPilot Server, MIS, CIS) as a dependency when Docker images are built. Keep `dist/` in sync with your builds because the compiled artifact is what downstream services install.

package/dist/configuration/models/models.constants.d.ts

@@ -1,6 +1,6 @@
 export declare const MODELS_COLLECTION = "models";
 export declare const MODEL_CONFIG_DEFAULTS_CONTEXT_WINDOW = "contextWindow";
 export declare const MODEL_TYPES: readonly ["realtime", "stt"];
-export declare const REALTIME_MODEL_PROVIDERS: readonly ["openai", "gemini", "xai"];
+export declare const REALTIME_MODEL_PROVIDERS: readonly ["openai", "gemini", "xai", "elevenlabs"];
 export declare const STT_MODEL_PROVIDERS: readonly ["openai-stt", "google-stt", "deepgram-stt", "deepgram-flux", "elevenlabs-scribe", "gladia-stt"];
 //# sourceMappingURL=models.constants.d.ts.map

package/dist/configuration/models/models.constants.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"models.constants.d.ts","sourceRoot":"","sources":["../../../src/configuration/models/models.constants.ts"],"names":[],"mappings":"AAAA,eAAO,MAAM,iBAAiB,WAAW,CAAC;AAE1C,eAAO,MAAM,oCAAoC,kBAAkB,CAAC;AAEpE,eAAO,MAAM,WAAW,8BAA+B,CAAC;AAExD,eAAO,MAAM,wBAAwB,sCAAuC,CAAC;AAC7E,eAAO,MAAM,mBAAmB,2GAOtB,CAAC"}
+{"version":3,"file":"models.constants.d.ts","sourceRoot":"","sources":["../../../src/configuration/models/models.constants.ts"],"names":[],"mappings":"AAAA,eAAO,MAAM,iBAAiB,WAAW,CAAC;AAE1C,eAAO,MAAM,oCAAoC,kBAAkB,CAAC;AAEpE,eAAO,MAAM,WAAW,8BAA+B,CAAC;AAExD,eAAO,MAAM,wBAAwB,oDAK3B,CAAC;AACX,eAAO,MAAM,mBAAmB,2GAOtB,CAAC"}

package/dist/configuration/models/models.constants.js

@@ -4,7 +4,12 @@ exports.STT_MODEL_PROVIDERS = exports.REALTIME_MODEL_PROVIDERS = exports.MODEL_T
 exports.MODELS_COLLECTION = "models";
 exports.MODEL_CONFIG_DEFAULTS_CONTEXT_WINDOW = "contextWindow";
 exports.MODEL_TYPES = ["realtime", "stt"];
-exports.REALTIME_MODEL_PROVIDERS = ["openai", "gemini", "xai"];
+exports.REALTIME_MODEL_PROVIDERS = [
+    "openai",
+    "gemini",
+    "xai",
+    "elevenlabs",
+];
 exports.STT_MODEL_PROVIDERS = [
     "openai-stt",
     "google-stt",

package/dist/configuration/models/models.constants.js.map

@@ -1 +1 @@
-{"version":3,"file":"models.constants.js","sourceRoot":"","sources":["../../../src/configuration/models/models.constants.ts"],"names":[],"mappings":";;;AAAa,QAAA,iBAAiB,GAAG,QAAQ,CAAC;AAE7B,QAAA,oCAAoC,GAAG,eAAe,CAAC;AAEvD,QAAA,WAAW,GAAG,CAAC,UAAU,EAAE,KAAK,CAAU,CAAC;AAE3C,QAAA,wBAAwB,GAAG,CAAC,QAAQ,EAAE,QAAQ,EAAE,KAAK,CAAU,CAAC;AAChE,QAAA,mBAAmB,GAAG;IACjC,YAAY;IACZ,YAAY;IACZ,cAAc;IACd,eAAe;IACf,mBAAmB;IACnB,YAAY;CACJ,CAAC"}
+{"version":3,"file":"models.constants.js","sourceRoot":"","sources":["../../../src/configuration/models/models.constants.ts"],"names":[],"mappings":";;;AAAa,QAAA,iBAAiB,GAAG,QAAQ,CAAC;AAE7B,QAAA,oCAAoC,GAAG,eAAe,CAAC;AAEvD,QAAA,WAAW,GAAG,CAAC,UAAU,EAAE,KAAK,CAAU,CAAC;AAE3C,QAAA,wBAAwB,GAAG;IACtC,QAAQ;IACR,QAAQ;IACR,KAAK;IACL,YAAY;CACJ,CAAC;AACE,QAAA,mBAAmB,GAAG;IACjC,YAAY;IACZ,YAAY;IACZ,cAAc;IACd,eAAe;IACf,mBAAmB;IACnB,YAAY;CACJ,CAAC"}

package/dist/municipal/departmentsSubjects/departmentsSubjects.setters.d.ts

@@ -0,0 +1,10 @@
+import { AnyBulkWriteOperation, BulkWriteOptions, BulkWriteResult } from "mongodb";
+import { DepartmentSubject } from "./departmentsSubjects.types";
+/**
+ * Generic batch write for the departmentsSubjects collection — a thin passthrough to the
+ * driver's bulkWrite, with no diffing/key-building/business logic. `operations` must be
+ * non-empty (the driver throws on an empty batch). Errors (including partial failures under
+ * `{ ordered: false }`) propagate unchanged, so callers can still catch `MongoBulkWriteError`.
+ */
+export declare const bulkWriteDepartmentsSubjects: (operations: AnyBulkWriteOperation<DepartmentSubject>[], options?: BulkWriteOptions) => Promise<BulkWriteResult>;
+//# sourceMappingURL=departmentsSubjects.setters.d.ts.map