toga-ai 1.0.266 → 1.0.268

package/knowledge/1.0/apps/tools/INDEX.md

@@ -7,6 +7,6 @@
 | [Tools MVC — Routing, CSRF & App_Database Access Patterns](features/mvc-data-access-patterns.md) | The load-bearing 1.0 (`App_`) framework conventions a developer needs when adding a page to the Tools app — URL routing, CSRF, and DB access through `App_Databa | tools/_/app/nav.php, tools/mvc/get.php |
 | [Tools Persona-Gated Navigation (App_Nav)](features/persona-gated-navigation.md) | `App_Nav` is the Tools app's two-level, **persona-gated** navigation. | tools/_/app/nav.php, tools/mvc/get.php |
 | [Tools SAML SSO Consumer & Persona-Gated Auth (App_Auth)](features/saml-sso-auth.md) | `App_Auth` is the Tools app's authentication layer: it consumes the SAML gateway `?saml=` handoff (see the 2.0 SAML downstream integration contract), establishe | tools/_/app/auth.php, tools/mvc/sso/initiate/get.php, tools/mvc/sso/get.php, tools/mvc/login/get.php, tools/mvc/login/post.php, tools/mvc/logout/get.php, tools/mvc/get.php, tools/config.production.ini, tools/config.local.ini |
-| [Talos Knowledge Base Admin UI (KB Documents + Vocabulary)](features/talos-kb-documents-admin.md) | A Tools (1.0) admin UI to browse/fix the Talos knowledge-base documents and manage the transcript-cleanup vocabulary — without a deploy. | tools/mvc/talos/kb-documents/get.php, tools/mvc/talos/kb-documents/post.php, tools/mvc/talos/vocabulary/get.php, tools/mvc/talos/vocabulary/post.php, tools/_/app/talos/s3.php, tools/_/app/worker.php, tools/_/app/nav.php |
+| [Talos Knowledge Base Admin UI (KB Documents + Vocabulary)](features/talos-kb-documents-admin.md) | A Tools (1.0) admin UI to browse/fix the Talos knowledge-base documents and manage the transcript-cleanup vocabulary — without a deploy. | tools/mvc/talos/kb-documents/get.php, tools/mvc/talos/kb-documents/post.php, tools/mvc/talos/vocabulary/get.php, tools/mvc/talos/vocabulary/post.php, tools/_/app/talos/s3.php, tools/_/app/worker.php, tools/_/app/nav.php, tools/config.production.ini, tools/config.alpha.ini |
 | [Talos Pricing UI (Onboarding, Dashboard, Benchmarks, Cost Factors + Estimator)](features/talos-pricing-ui.md) | The 1.0 (tools app) face of the **Talos Pricing Platform** — a "Talos Pricing" nav folder with four pages plus a client-side estimate engine. | tools/_/app/nav.php, tools/_/app/talos/estimator.php, tools/mvc/talos/onboarding/get.php, tools/mvc/talos/onboarding/post.php, tools/mvc/talos/pricing/get.php, tools/mvc/talos/benchmarks/get.php, tools/mvc/talos/factors/get.php, tools/mvc/talos/factors/post.php, tools/assets/css/style.css |
 | [Deploying Tools to Elastic Beanstalk (PHP 8.5 / Amazon Linux 2023)](workflows/deploy-to-elastic-beanstalk-al2023.md) | How the **Tools** 1.0 app boots on Elastic Beanstalk running `PHP 8.5 on 64bit Amazon Linux 2023/4.13.1 (aarch64)`. | tools/.ebextensions/004_http_to_https.config, tools/.ebextensions/006_mount-s3fs.config, tools/.ebextensions/007_setup_export_cache_folders.config, tools/.ebextensions/008_setup_ldap.config, tools/.ebextensions/009_setup_phpini.config, tools/.ebextensions/020_setup_git_libraries.config, tools/.ebextensions/050_register_instance_to_shared_application_load_balancer.config, tools/ebs/git.json |

package/knowledge/1.0/apps/tools/features/talos-kb-documents-admin.md

@@ -6,7 +6,7 @@ project: Tools
 client: shared
 type: feature
 status: active
-updated: 2026-06-30
+updated: 2026-07-02
 owners: [jcardinal]
 files:
   - tools/mvc/talos/kb-documents/get.php
@@ -16,6 +16,8 @@ files:
   - tools/_/app/talos/s3.php
   - tools/_/app/worker.php
   - tools/_/app/nav.php
+  - tools/config.production.ini
+  - tools/config.alpha.ini
 related:
   - ./mvc-data-access-patterns.md
   - ./persona-gated-navigation.md
@@ -37,12 +39,27 @@ Technology*) exposes two pages.
 - KB list derived from the **actual S3 sub-folders** under `development-team/` (title-cased,
   e.g. `office-depot` → "Office Depot") — not from `Team.KnowledgeBases`.
 - Lists approved docs excluding `*.metadata.json`; columns Meeting Date (`n/j/y`) / Title /
-  Size / Last modified (`n/j/y g:i A`).
+  Size / Last modified (`n/j/y g:i A`). **Last-modified is converted from S3's UTC to
+  America/Chicago (US Central) before formatting**; the sort key stays UTC ISO-8601.
 - Clickable rows open an overlay **modal** with a type-aware preview: text inline; PDF via a
   presigned S3 URL in an iframe; Office files via the Google Docs viewer (presigned URL; MS
   Office viewer noted as an alternative); unsupported → download/delete only.
-- Download + delete are icon buttons in the modal. **Delete enqueues the worker `SyncKb`
-  re-sync** so Bedrock reflects the removal.
+- Modal actions are icon buttons: download, **move**, **edit** (text docs only), and delete.
+  **Delete / move / edit each enqueue the worker `SyncKb` re-sync** so Bedrock reflects the change.
+- **Move** (right-arrow icon) opens a small centered dialog (KB picker + Move/Cancel) to re-file a
+  mis-classified doc from one KB to another. `App_Talos_S3::moveApprovedDocument` copies the `.txt`
+  and its `.metadata.json` sidecar to the destination via **get+put (NOT server-side `CopyObject` —
+  the togaiq key is denied CopyObject even same-bucket)**, rewrites the sidecar's KB-slug attribute
+  (`metadataAttributes.client.value.stringValue`), then deletes the originals. It enqueues a
+  **single** `SyncKb("source,dest")` job (worker2 syncs both sequentially — Bedrock allows one
+  in-flight ingestion per KB). Helpers `copyWithinBucket` + `putObjectBody` added.
+- **Edit** (pencil icon, text docs only) enters edit mode in the modal: a title text box, a
+  **Find & Replace** tool ported from the old `test/team/talos/kb_processor.php` (Find/Replace,
+  Match case, Whole word only, Replace All with match count), and a contents textarea, with
+  Save/Cancel top-right. The `update` action + `App_Talos_S3::updateApprovedDocument` rewrites the
+  body and, if the title changed (`sanitizeTitle`), renames the object to
+  `"YYYY-MM-DD - {title}.txt"` (date preserved), moves+updates the sidecar filename attribute,
+  deletes the old key, and enqueues a `SyncKb` re-sync.
 
 ### `/talos/vocabulary` — cleanup vocabulary manager
 Single tabbed page: Prompt Template, Applications, Clients, People, Business Terms, Examples,
@@ -53,16 +70,29 @@ prompt/replacement tables that the worker2 pipeline reads at runtime.
 
 ## Helpers
 
-- **`App_Talos_S3`** (`_/app/talos/s3.php`) — S3 client; list KB slugs; list/count approved;
-  presigned URL; get/delete; slug sanitize+lowercase; approved-prefix path guard.
+- **`App_Talos_S3`** (`_/app/talos/s3.php`) — S3 client; list KB slugs; list/count approved
+  (UTC→Central for display); presigned URL; get/delete; `moveApprovedDocument`;
+  `updateApprovedDocument`; `sanitizeTitle`; `copyWithinBucket`; `putObjectBody`; slug
+  sanitize+lowercase; approved-prefix path guard. **`client()` credential resolution:** prefers a
+  dedicated **`[talos]`** config section (the **togaiq**-capable key), falling back to `[aws]`, then
+  the SDK default chain — because `App_Talos_S3` only ever talks to **togaiq**, so it needs the
+  togaiq-account key (the tools `[aws]` key is the toga-private key, which can cross-account *read*
+  togaiq but not *write* it).
 - **`App_Worker::enqueue()`** (`_/app/worker.php`) — inserts a `Core.WorkerJobs` row and sends
-  the `{"workerJobId": id}` SQS message, so a 1.0 app can enqueue worker2 jobs.
+  the `{"workerJobId": id}` SQS message, so a 1.0 app can enqueue worker2 jobs. Requires the
+  `[worker]` (`queue_url`/`queue_region`) and `[aws]` (main-account key for SQS `SendMessage`)
+  config sections.
 
 ## Deploy prerequisites
 
 - `aws/aws-sdk-php` installed in `tools/vendor` (S3 + SQS).
-- New `tools/config.*.ini` sections (none exist yet): `[database_core2]` (writable 2.0 Core,
-  dbname `Core`), `[worker]` (`queue_url` / `queue_region`), `[aws]` (production).
+- `tools/config.production.ini` / `config.alpha.ini` sections (now added):
+  - **`[talos]`** — the **togaiq**-account S3 key (`App_Talos_S3` write path); required or move/edit/
+    delete fail with `AccessDenied`.
+  - **`[worker]`** — worker2 production SQS `queue_url` / `queue_region` (for `App_Worker::enqueue`).
+  - **`[aws]`** — main-account key for SQS `SendMessage` (toga-private key; cross-account reads
+    togaiq but cannot write it — that's why `[talos]` exists).
+  - `[database_toga2core]` — writable 2.0 Core (already present).
 - Apply the dbchanges2 `Team/2026-06-30a..e` + `Core/2026-06-30a` migrations in order.
 - Verify the Bedrock KB region / data-source name against the live account (TODOs in code).
 
@@ -70,12 +100,27 @@ prompt/replacement tables that the worker2 pipeline reads at runtime.
 
 - **KB list is derived from S3, not the DB.** The browse UI enumerates live S3 folders under
   `development-team/`; `Team.KnowledgeBases` is not the source of truth for what's shown.
-- **Delete is not just an S3 delete** — it also enqueues a worker `SyncKb` job to re-sync the
-  Bedrock data source.
-- No new secret literals introduced; credentials come from the new config sections above.
+- **Delete / move / edit are not just S3 ops** — each enqueues a worker `SyncKb` job to re-sync
+  the Bedrock data source.
+- **`App_Talos_S3` needs the togaiq-account key (`[talos]`).** The tools `[aws]` key is the
+  toga-private key: it can cross-account *read* togaiq but **cannot write** it, so move/edit/delete
+  fail `AccessDenied` without a `[talos]` section.
+- **Never use server-side `CopyObject` for togaiq** — the togaiq key is denied `CopyObject` even
+  within the same bucket; move/edit copy via get+put.
+- **Move/edit re-sync must be one `SyncKb("source,dest")` job**, not two parallel jobs — Bedrock
+  allows only one in-flight ingestion per KB and parallel syncs race.
+- No new secret literals introduced; credentials live in the config sections above (documented by
+  section/account, never by value).
 
 ## Change history
 
+- 2026-07-02 — Added **move** (re-file a doc between KBs) and **edit** (title + Find&Replace + body,
+  ported from the old `kb_processor.php`) to the doc modal, each via get+put (togaiq denies
+  `CopyObject`) and each enqueuing a single `SyncKb("source,dest")` re-sync. Fixed togaiq
+  `AccessDenied`: `App_Talos_S3::client()` now uses a dedicated `[talos]` (togaiq-account) key; added
+  `[talos]`, `[worker]`, and `[aws]` sections to `config.production.ini`/`config.alpha.ini` so
+  `App_Worker::enqueue` (SQS) works. Last-modified now displayed in US Central (converted from S3
+  UTC). (jcardinal)
 - 2026-06-30 — Built the Talos KB admin UI: `/talos/kb-documents` (S3-derived KB list, approved
   doc browser with type-aware preview modal, download + delete-with-resync) and `/talos/vocabulary`
   (tabbed prompt/vocabulary/replacements manager with transactional full-set reconciliation;

package/knowledge/2.0/apps/_underscore/INDEX.md

@@ -7,6 +7,7 @@
 | [Assortment Name Translation (AssortmentTranslations sidecar)](features/assortment-name-translation.md) | Serves Assortment (product-grouping) **names** in multiple languages by adding a per-language **sidecar** table `AssortmentTranslations`, reusing the platform's | _underscore/Model/Client/AssortmentTranslation.php, dbchanges2/Client/2026-06-26a - AssortmentTranslations.sql, dbchanges2/Core/2026-06-26a - AssortmentTranslationsRecord.sql, dbchanges2/Client/2026-06-26b - AssortmentTranslationsAcl.sql |
 | [Carrier Shipping Labels (UPS/FedEx) & NetSuite Item Fulfillment](features/carrier-shipping-labels.md) | Backend mechanics behind TOGa Supply's Fulfill & Ship: buying a carrier label (UPS/FedEx), persisting it, and creating the NetSuite Item Fulfillment with tracki | _underscore/Model/Client/ItemFulfillment.php, _underscore/Model/Client/TrackingNumber.php, _underscore/Model/Client/ItemFulfillments/TrackingNumber.php, _underscore/Component/Library/LabelPdf/LabelPdf.php, _underscore/Component/Library/Carriers/ShipmentRequest/ShipmentRequest.php, _underscore/Component/Library/Carriers/Ups/Ups.php, _underscore/Component/Library/Carriers/Fedex/Fedex.php, _underscore/Trait/Netsuite/ItemFulfillment.php, _underscore/Trait/Netsuite/SalesOrder.php, _underscore/Component/Library/NetSuite/NetSuite.php, _underscore/Model/Client/TrackingNumber.php, _underscore/Model/Client/ShippingMethod.php, _underscore/Model.php, _underscore/Cloud.php |
 | [Client Email Template Sending](features/email-template-sending.md) | `_Model_Client_EmailTemplate` sends a stored, client-defined email template by UUID. | _underscore/Model/Client/EmailTemplate.php, _underscore/Model/Client/EmailTemplateOutgoingEmailAddress.php, _underscore/Email.php |
+| [Error Reporting — Issue/Event Aggregation (exceptionHandler)](features/error-reporting-issue-event.md) | `_underscore`'s global exception handler persists every uncaught exception into a two-table **Issue / Event** model in the **shared Core Logs DB** (`_underscore | _underscore/Error.php, _underscore/Model/Core/Logs/Issue.php, _underscore/Model/Core/Logs/Event.php, dbchanges2/Logs/2026-07-06 - Issue and Event tables.sql |
 | [Record-Changed Event Publishing (_Event::publish to SQS)](features/event-publish-sqs.md) | `_Event::publish()` (in `_underscore/Event.php`) is the PHP side of the real-time event pipeline. | _underscore/Event.php |
 | [Forecast.Sales NetSuite import engine (real-time webhook)](features/forecast-sale-import.md) | Real-time importer that takes a NetSuite **sale** record and writes its lines into `Forecast.Sales` (the Forecast2 revenue table). | _underscore/Component/Forecast/SaleImport/SaleImport.php, _underscore/Component/Forecast/Db/Db.php, _underscore/Component/Api/Netsuite/Netsuite.php, worker2/Worker/Netsuite/Invoice.php, worker2/Worker/Netsuite/CashSale.php, worker2/Worker/Netsuite/CreditMemo.php, worker2/Worker/Netsuite/CashRefund.php, worker2/Worker/Netsuite/JournalEntry.php, worker2/Worker/Netsuite/Opportunity.php, worker2/Worker/Netsuite/SalesOrder.php, dbchanges2/Forecast/2026-06-26a - Add journalEntry to Sales transaction type enum.sql, test/@dave/test_invoice_lifecycle.php, test/@dave/test_je_lifecycle.php, test/@dave/test_creditmemo_lifecycle.php, test/@dave/test_cashsale_lifecycle.php, test/@dave/test_cashrefund_lifecycle.php, test/@dave/test_fetchrecord_routes.php, test/@dave/verify_je_classification.php, test/@dave/probe_je_accounts.php, test/@dave/probe_je_shape.php, test/@dave/NetSuite/api-message-queue/ue_api_msg_queue_enqueue.js, test/@dave/NetSuite/api-message-queue/dev_ue_api_msg_queue_enqueue.js |
 | [Item-Fulfillment Stage Lifecycle (picked/packed/shipped) & Order Status](features/item-fulfillment-stage-lifecycle-and-order-status.md) | Every ItemFulfillment (IF) now carries an explicit **stage** — picked → packed → shipped — resolved through `ItemFulfillmentStages → ItemFulfillmentStatuses` (m | _underscore/Model/Client/SalesOrder.php, _underscore/Model/Quad/SalesOrder.php, _underscore/Model/Compass/SalesOrder.php, _underscore/Model/Compass/SalesOrderStatus.php, _underscore/Model/Client/SalesOrderItem.php, _underscore/Model/Client/Item.php, _underscore/Model/Client/PurchaseOrderItem.php, library/app/api/toga2.php, dbchanges2/Client/2026-06-30a - BackfillNullStageItemFulfillmentsToShipped.sql, dbchanges2/Client/2026-06-30b - SalesOrderStatusesPickedPacked.sql, dbchanges2/Client/2026-06-30c - ItemFulfillmentStageIdNotNull.sql, dbchanges2/Client_CompassCanada/2026-06-30a - ItemFulfillmentLifecycleAndShippedBackfill.sql |

package/knowledge/2.0/apps/_underscore/features/error-reporting-issue-event.md

@@ -0,0 +1,95 @@
+---
+title: Error Reporting — Issue/Event Aggregation (exceptionHandler)
+framework: "2.0"
+repo: _underscore
+project: _Underscore
+client: shared
+type: feature
+status: active
+updated: 2026-07-06
+owners: ["dfranks"]
+files:
+  - _underscore/Error.php
+  - _underscore/Model/Core/Logs/Issue.php
+  - _underscore/Model/Core/Logs/Event.php
+  - dbchanges2/Logs/2026-07-06 - Issue and Event tables.sql
+related:
+  - ../architecture.md
+  - ./per-client-database-connections.md
+  - ../../dbchanges2/architecture.md
+---
+
+## Summary
+
+`_underscore`'s global exception handler persists every uncaught exception into a
+two-table **Issue / Event** model in the **shared Core Logs DB** (`_underscore::DB_LOGS`,
+models under `Model/Core/Logs/`) — **not** the per-client Logs DB. An **Issue** is the
+deduplicated record for a distinct error (keyed by a hash of the backtrace) carrying an
+aggregate `occurrences` counter; an **Event** is one row per individual occurrence with
+its own stack trace and context. This is platform-wide error-reporting infrastructure,
+not client-specific.
+
+## Key files / entry points
+
+- **`_underscore/Error.php`** — `exceptionHandler()` (registered via
+  `set_exception_handler`). Computes `$issueHash = md5(serialize($backtrace))`, then, only
+  when the Core-Logs register is present (`isset(\_Database::$_registers[_underscore::DB_LOGS])`),
+  upserts an `_Model_Core_Logs_Issue` and inserts an `_Model_Core_Logs_Event`, committing
+  the `DB_LOGS` transaction.
+- **`_underscore/Model/Core/Logs/Issue.php`** — `const DATABASE = _underscore::DB_LOGS;
+  const TABLE = 'Issues';`. Fields: `id, uuid, dtCreated, dtLastOccurred, urgency, subject,
+  description, clickupIdentifier, hash, errorMessage, occurrences, trace`.
+- **`_underscore/Model/Core/Logs/Event.php`** — `const DATABASE = _underscore::DB_LOGS;
+  const TABLE = 'Events';`. Fields: `id, uuid, issueId (FK → Issue), errorMessage, trace,
+  context, dtCreated`.
+
+## How it works
+
+1. On an uncaught exception, hash the backtrace to identify the distinct error.
+2. Load the existing `Issue` by `hash`. On a miss, create it with `errorMessage`, `trace`,
+   `urgency = 'LOW'`, and `occurrences = 0`.
+3. **Increment `occurrences`** (`($issue->occurrences ?? 0) + 1`) and set
+   `dtLastOccurred`, then save — so the counter advances on every occurrence, hit or new.
+4. Insert one `Event` for this occurrence: `issueId`, `errorMessage`, per-occurrence
+   `trace`, and `context` (`print_r($GLOBALS, true)`).
+5. Commit the `DB_LOGS` transaction; surface `Error {issueId}, Event {eventId}` in the
+   debug body.
+
+The `Issues`/`Events` tables live in the shared **Core Logs** DB, provisioned from
+`dbchanges2/Logs/` (the `Logs/` folder targets the framework-level, non-tenant `Logs` DB
+with unqualified table names — see the dbchanges2 architecture folder→DB mapping). Contrast
+with per-client API/error logging in `Logs_<Tenant>` via `Model/Client/Logs/*`
+(`DB_CLIENT_LOGS`, `dbchanges2/Logs_Client/`).
+
+## Data model
+
+- **Issue** = one row per distinct error (dedup key = `hash`); `occurrences` is the rolling
+  count, `dtLastOccurred` the most-recent hit, `urgency` a list field, `clickupIdentifier`
+  links to an escalation ticket. There is **no `type` column** — it was dropped.
+- **Event** = one row per occurrence, FK `issueId` → Issue, carrying the occurrence's own
+  `trace` and `context`.
+
+## Gotchas / known issues
+
+- **`occurrences` must be incremented, not just seeded.** It was previously set to `0` only
+  at creation and never advanced, so the aggregate counter never moved. Fixed 2026-07-06 to
+  increment on every occurrence.
+- **`Event.trace` must be set per occurrence.** The schema has a per-Event `trace` column
+  that was never populated; now recorded on every Event.
+- **Persistence is conditional on the Core-Logs register.** If
+  `\_Database::$_registers[_underscore::DB_LOGS]` isn't set, the whole Issue/Event block is
+  skipped silently — no error row is written.
+- **Shared-schema migration collision.** Because `Issues`/`Events` live in the *shared* Core
+  Logs DB, any two dbchanges2 `Logs/` migrations that both `CREATE TABLE Issues`/`Events`
+  will collide — the second fails with "table already exists". Two separate error-reporting
+  workstreams introduced these same tables (one adding the escalation cron + an
+  `IssueEmailAddresses` table, one adding this error-class persistence). Only **one**
+  migration may create the shared tables; reconcile overlapping `Logs/` create-scripts at
+  merge so the tables are created exactly once and later migrations only `ALTER`.
+
+## Change history
+
+- 2026-07-06 — Moved Issue/Event tables and exceptionHandler persistence from the per-client
+  Logs DB to the shared Core Logs DB and dropped the `type` column; fixed `occurrences` to
+  increment each occurrence and set `Event.trace` per occurrence; removed dead commented-out
+  per-client-logs persistence block. (dfranks)

package/knowledge/2.0/apps/worker2/INDEX.md

@@ -21,7 +21,7 @@
 | [Startech Webhook Handler (worker2)](features/startech-webhook-handler.md) | Receives inbound webhook events from Startech (Easeedesk) and creates or updates the corresponding ticket in TOGA 2.0. | worker2/Worker/Startech.php |
 | [Talos (TOGa IQ) Meeting-Notes Integration & Token Auto-Refresh (consumer)](features/talos-meeting-notes-integration.md) | How a **dev tool / agent consumes Talos (TOGa IQ)** to query the team meeting-notes corpus programmatically. | .claude/skills/plan-ticket/scripts/talos.js |
 | [Talos Pricing Automation (worker2 Cron — AWS Actuals, Calibration, Monthly Report)](features/talos-pricing-automation.md) | The worker2 half of the **Talos Pricing Platform** (see the talos `pricing-cogs-model` and tools `talos-pricing-ui` docs for the other halves). | worker2/Worker/Talos/Pricing.php, worker2/Database/TalosPricingCrons.sql |
-| [Talos Transcript Ingestion Pipeline (worker2 → AWS Bedrock KBs)](features/talos-transcript-ingestion.md) | `_Worker_Team_Transcripts` (in addition to the upstream `Export` action — see [Teams Meeting Transcript Export](./teams-transcript-export.md)) now runs a fully | worker2/Worker/Team/Transcripts.php, worker2/bin/reprocess-transcripts.php, worker2/Config/production.ini, dbchanges2/Team/2026-06-30a, dbchanges2/Team/2026-06-30b, dbchanges2/Team/2026-06-30c, dbchanges2/Team/2026-06-30d, dbchanges2/Team/2026-06-30e, dbchanges2/Core/2026-06-30a |
+| [Talos Transcript Ingestion Pipeline (worker2 → AWS Bedrock KBs)](features/talos-transcript-ingestion.md) | `_Worker_Team_Transcripts` (in addition to the upstream `Export` action — see [Teams Meeting Transcript Export](./teams-transcript-export.md)) now runs a fully | worker2/Worker/Team/Transcripts.php, worker2/bin/reprocess-transcripts.php, worker2/bin/sync-knowledge-bases.php, worker2/Config/production.ini, dbchanges2/Team/2026-06-30a, dbchanges2/Team/2026-06-30b, dbchanges2/Team/2026-06-30c, dbchanges2/Team/2026-06-30d, dbchanges2/Team/2026-06-30e, dbchanges2/Core/2026-06-30a, dbchanges2/Core/2026-07-02a, dbchanges2/Team/2026-07-02a |
 | [Team Sprint Management & Reporting](features/team-sprint-management.md) | `_Worker_Team_Sprint` (file `Worker/Team/Sprint.php`) is the engine behind TOGA's internal **development-sprint process and reporting**. | worker2/Worker/Team/Sprint.php |
 | [Teams Meeting Transcript Export](features/teams-transcript-export.md) | `_Worker_Team_Transcripts` (action `Team/Transcripts/Export`) polls Microsoft Graph for Teams meeting transcripts produced by a set of organizers and archives t | worker2/Worker/Team/Transcripts.php, worker2/Config/production.ini, worker2/Database/TeamsTranscriptExports.sql, dbchanges2/Core/2026-06-18a - Teams Transcript Export schedule.sql |
 | [VAPI Webhook Handler (worker2 — AI-BDR end-of-call processing)](features/vapi-webhook-handler.md) | `_Worker_Vapi` ([worker2/Worker/Vapi.php](worker2/Worker/Vapi.php)) is the **PHP side of the AI-BDR call loop** — the webhook that receives VAPI's end-of-call r | worker2/Worker/Vapi.php, worker2/Worker/Ai/Bdr/Vapi.php |

package/knowledge/2.0/apps/worker2/features/talos-transcript-ingestion.md

@@ -6,11 +6,12 @@ project: Worker
 client: shared
 type: feature
 status: active
-updated: 2026-06-30
+updated: 2026-07-02
 owners: [jcardinal]
 files:
   - worker2/Worker/Team/Transcripts.php
   - worker2/bin/reprocess-transcripts.php
+  - worker2/bin/sync-knowledge-bases.php
   - worker2/Config/production.ini
   - dbchanges2/Team/2026-06-30a
   - dbchanges2/Team/2026-06-30b
@@ -18,6 +19,8 @@ files:
   - dbchanges2/Team/2026-06-30d
   - dbchanges2/Team/2026-06-30e
   - dbchanges2/Core/2026-06-30a
+  - dbchanges2/Core/2026-07-02a
+  - dbchanges2/Team/2026-07-02a
 related:
   - ./teams-transcript-export.md
   - ./creating-worker-actions.md
@@ -45,9 +48,13 @@ sidecar written to `s3://togaiq/development-team/{kb_slug}/approved/` → raw ar
 ## Key files / entry points
 
 - `Worker/Team/Transcripts.php` — actions `Scan`, `Process(string $sourceKey)`,
-  `SyncKb(string $kbSlug)` (all alongside the existing `Export`).
+  `SyncKb(string $kbSlug)` (comma-separated slug list), `SyncKnowledgeBases(bool $apply=true)`
+  (all alongside the existing `Export`).
 - `bin/reprocess-transcripts.php` — standalone CLI backlog reprocessor.
-- `Config/production.ini` `[talos]` section — S3/Bedrock targets (see Configuration).
+- `bin/sync-knowledge-bases.php` — CLI entry for the Bedrock→`Team.KnowledgeBases` registry
+  sync (`--dry-run` supported).
+- `Config/production.ini` `[talos]` and `[teams]` sections — S3/Bedrock targets + the two
+  per-account S3 credential sets (see Configuration).
 - DB config + ledger tables in the `Team.*` schema (see Data model), authored in dbchanges2
   under `Team/2026-06-30a..e` + `Core/2026-06-30a`.
 
@@ -61,28 +68,56 @@ each via `_Worker::runTask('Team/Transcripts/Process', ['sourceKey' => …])`. S
 
 ### `Process(string $sourceKey)`
 Port of `kb_processor`, per transcript:
-1. Fetch the raw VTT from S3 (`toga-private`, **us-west-2**).
+1. Fetch the raw VTT from S3 (`toga-private`, **us-west-2**). Parse **date + meeting title up
+   front** (previously parsed from the filename only *after* classification).
 2. Call the TOGa IQ AI endpoint `https://api.togaiq.com/api/ai/generate`, model
    `bedrock/us.anthropic.claude-haiku-4-5-20251001-v1:0`, with an **extended** `output_schema`
    returning **both** `knowledge_doc` **and** `kb_slug` — the AI picks the single best active KB
-   from the supplied list, or `general`. The system prompt is **assembled at runtime** from DB
-   tables: a template body with `{{APPLICATIONS}}`/`{{CLIENTS}}`/`{{PEOPLE}}`/`{{BUSINESS_TERMS}}`/`{{EXAMPLES}}`
-   placeholders filled from `Team.TranscriptPromptTerms`.
+   from the supplied list, or `general`. The **meeting title is passed into**
+   `callAICleaningAPI` and surfaced as a `MEETING TITLE:` block; the classifier instruction
+   **prioritizes the title** (often the only KB signal on short transcripts). **Classification
+   rule: customer over company** — `toga-technology` is our *own* company, so a meeting involving
+   both a customer and TOGA staff must classify to the **customer** KB; pick `toga-technology`
+   only for purely-internal meetings; fall back to `general` when neither can be determined. The
+   system prompt is **assembled at runtime** from DB tables: a template body with
+   `{{APPLICATIONS}}`/`{{CLIENTS}}`/`{{PEOPLE}}`/`{{BUSINESS_TERMS}}`/`{{EXAMPLES}}`
+   placeholders filled from `Team.TranscriptPromptTerms`. The active template body also
+   **excludes personal/social/non-work content** and must never emit a "Personal Notes" section
+   (see Change history / the 2026-07-02a Team migration).
 3. Apply DB-driven text replacements from `Team.TranscriptReplacements` (`:c` case-sensitive,
    `:w` whole-word, `:cw`) via `preg_replace_callback` **so replacement backrefs stay literal**.
 4. Build the approved name `"{YYYY-MM-DD} - {Title Case}.txt"`.
-5. Upload to `s3://togaiq/development-team/{kb_slug}/approved/` (**us-east-1**) plus a
-   `{name}.txt.metadata.json` Bedrock sidecar.
-6. Archive the raw VTT to `…/{kb_slug}/archive/{date}/`, then delete the source.
+5. Upload to `s3://togaiq/development-team/{kb_slug}/approved/` (**us-east-1**, togaiq account
+   client) plus a `{name}.txt.metadata.json` Bedrock sidecar.
+6. Archive the raw VTT to `…/{kb_slug}/archive/{date}/` via **get(raw) + put(talos)** (NOT
+   `CopyObject` — source and dest are in **different AWS accounts**, so cross-account
+   `CopyObject` is impossible), then delete the source.
 7. AWS Bedrock `startIngestionJob` on that KB's data source (retry 5×30s on
    `ConflictException` / throttling). **If `kb_slug === 'general'`, sync ALL active KBs.**
 
+### `SyncKnowledgeBases(bool $apply=true)` (cron)
+Keeps `Team.KnowledgeBases` current with **Bedrock as the source of truth** — the table only
+had the KBs that existed as S3 folders at build time (`general`, `office-depot`), so the AI
+classifier could never pick a KB (e.g. `elite`) that wasn't already a candidate. Lists all
+Bedrock KBs (`listKnowledgeBases`, via helper `listAllKnowledgeBases()`), filters to the
+`{kb_prefix}*` prefix (`development-team-`), derives the slug, and **upserts**: new rows insert
+`isActive=1` (`isGeneral=1` only for `general`), name title-cased, `bedrockKbId` cached; existing
+rows keep their name/flags and only refresh `bedrockKbId`. **Nothing is deleted or deactivated.**
+CLI entry `bin/sync-knowledge-bases.php` (`--dry-run`). Cron: `Core.CronJobs` row action
+`Team/Transcripts/SyncKnowledgeBases`, schedule `0 5 * * *` (daily 05:00 CT), `maxExecutionTime`
+300 (dbchanges2 `Core/2026-07-02a`; depends on the 2026-05-14 `maxExecutionTime` migration).
+
 Idempotency + status are tracked in `Team.TranscriptProcessing`
 (`pending/cleaned/uploaded/archived/synced/failed`).
 
 ### `SyncKb(string $kbSlug)`
-On-demand single-KB re-sync (used by the Tools delete flow — see
+On-demand re-sync used by the Tools delete/move/edit flows (see
 [Talos KB Documents Admin](../../../1.0/apps/tools/features/talos-kb-documents-admin.md)).
+`$kbSlug` now accepts a **comma-separated slug list** and syncs each KB **sequentially** with
+`KB_SYNC_DELAY_SECONDS` spacing. This exists because **Bedrock allows only one in-flight
+ingestion per KB** — a move that fired two independent parallel `SyncKb` workers raced and one
+was dropped (only the destination synced). The Tools move now enqueues a **single**
+`SyncKb("source,dest")` job so both KBs sync in one job, in order.
 
 ### `bin/reprocess-transcripts.php` (CLI backlog reprocessor)
 Standalone CLI that bootstraps `_underscore`, lists existing raw transcripts under the
@@ -109,7 +144,10 @@ PKs `INT UNSIGNED` to match the existing Talos Team-table family.
 - **`Team.TranscriptPromptTemplate`** — `name, bodyText` (w/ placeholders), `instruction, model,
   temperature, maxTokens, timeoutSeconds, isActive`. One active row seeded from the `.ini` system prompt.
 - **`Team.KnowledgeBases`** — `slug, name, isGeneral, bedrockKbId, isActive`. Seeded `general` +
-  `office-depot`. NOTE: the Tools browse UI derives the **live** KB list from S3 folders, not this table.
+  `office-depot`, but now **auto-kept-current from Bedrock** by the daily `SyncKnowledgeBases`
+  action (Bedrock is the source of truth; the table is a cache/allowlist of classifier
+  candidates). NOTE: the Tools *browse* UI still derives its live KB list from S3 folders, not
+  this table.
 - **`Team.TranscriptProcessing`** — `sourceKey UNIQUE(255), kbSlug, approvedKey, archiveKey,
   status` ENUM (`pending/cleaned/uploaded/archived/synced/failed`), `aiModel, failureReason,
   dtProcessed`. Pipeline ledger + idempotency.
@@ -122,10 +160,22 @@ PKs `INT UNSIGNED` to match the existing Talos Team-table family.
 `worker2/Config/production.ini` `[talos]`: `s3_bucket=togaiq`, `s3_region=us-east-1`,
 `bedrock_region=us-east-1`, `kb_prefix=development-team-`, `s3_root_path=development-team/`.
 
+**Two S3 credential sets — one per AWS account (see the cross-account gotcha):**
+- `[teams]` `s3_access_key_id` / `s3_secret_access_key` — the **toga-private** key (raw
+  transcripts, us-west-2). Read by `s3Client()` / `getS3Client()`.
+- `[talos]` `s3_access_key_id` / `s3_secret_access_key` — the **togaiq** key (approved/archive
+  KB bucket, us-east-1). Read by `getTalosS3Client()` and `getBedrockClient()`.
+
+Credential **values live only in the deployed `production.ini`** — documented here by section
+and account, never by value. Pre-existing plaintext keys should be rotated (separate track).
+
 ## Gotchas / known issues
 
-- **Cross-region S3.** The raw bucket `toga-private` is **us-west-2** while `togaiq` is
-  **us-east-1**. `Process()` uses two S3 clients; the archive step is a **cross-region copy**.
+- **Cross-ACCOUNT S3 (root cause of repeated PutObject/CopyObject `AccessDenied`).** `toga-private`
+  (raw, us-west-2) and `togaiq` (KB bucket, us-east-1) live in **different AWS accounts** — **no
+  single IAM key can write to both.** Credentials are therefore **per-bucket**: `[teams]` key for
+  toga-private, `[talos]` key for togaiq. Because it spans accounts, **`CopyObject` is impossible**;
+  the archive step is a **get(raw) + put(talos)**, not a server-side copy.
 - **`[talos]` keys were added to `production.ini` only** — the beta/development configs still
   need them before the pipeline runs in those environments.
 - **`general` KB fans out.** A `Process()` classified as `general` (or a `general` sync) triggers
@@ -143,6 +193,15 @@ PKs `INT UNSIGNED` to match the existing Talos Team-table family.
 
 ## Change history
 
+- 2026-07-02 — Fixed cross-**account** S3 creds: `toga-private` and `togaiq` are separate AWS
+  accounts, so credentials are now per-bucket (`[teams]` vs `[talos]` in `production.ini`) and the
+  archive step is get+put instead of the impossible cross-account `CopyObject`. Built
+  `SyncKnowledgeBases` (Bedrock→`Team.KnowledgeBases` upsert) + `bin/sync-knowledge-bases.php` and a
+  daily `0 5 * * *` cron so the classifier's candidate KB list stays current. `SyncKb` now takes a
+  comma-separated slug list and syncs sequentially (Bedrock allows one in-flight ingestion per KB;
+  parallel syncs raced). Classification: meeting title now passed to and prioritized by the AI, and
+  customer-over-company (a customer meeting stays with the customer even when TOGA staff attend).
+  Prompt template surgically updated to exclude personal/social content ("Personal Notes"). (jcardinal)
 - 2026-06-30 — Built the automated cron-driven ingestion pipeline (`Scan`/`Process`/`SyncKb`) +
   the `bin/reprocess-transcripts.php` backlog CLI, porting the manual `kb_processor.php`. Added
   the `Team.*` config/ledger schema (DB-editable replacements, prompt terms, prompt template, KB

package/knowledge/INDEX.md

@@ -16,7 +16,7 @@ _Auto-generated by `knowledge.js index`. Do not hand-edit._
 
 ## 2.0 framework
 
-- **_underscore** (_Underscore) _(framework core)_ — 21 doc(s) → [2.0/apps/_underscore/INDEX.md](2.0/apps/_underscore/INDEX.md)
+- **_underscore** (_Underscore) _(framework core)_ — 22 doc(s) → [2.0/apps/_underscore/INDEX.md](2.0/apps/_underscore/INDEX.md)
 - **worker2** (Worker) — 25 doc(s) → [2.0/apps/worker2/INDEX.md](2.0/apps/worker2/INDEX.md)
 - **api2** (API) — 7 doc(s) → [2.0/apps/api2/INDEX.md](2.0/apps/api2/INDEX.md)
 - **dbchanges2** (Database Changes) _(framework core)_ — 3 doc(s) → [2.0/apps/dbchanges2/INDEX.md](2.0/apps/dbchanges2/INDEX.md)

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "toga-ai",
-  "version": "1.0.266",
+  "version": "1.0.268",
   "description": "TOGA Technology Team Claude Knowledge System — shared AI coding harness with skills, knowledge base CLI, and project installer for Claude Code.",
   "keywords": [
     "claude",