toga-ai 1.0.130 → 1.0.131

package/knowledge/clients/tow-foundation/INDEX.md

@@ -2,5 +2,5 @@
 
 | Doc | Framework | Summary | Files |
 |-----|-----------|---------|-------|
-| [Credit Card Receipt Processing](features/receipt-processing.md) | 2.0 | Automated processing of credit card receipts uploaded to SharePoint. | worker2/Worker/Client/TowFoundation.php, worker2/Worker/Client/TowFoundation/ProcessReceipts.php |
+| [Credit Card Receipt Processing](features/receipt-processing.md) | 2.0 | Automated processing of credit card receipts uploaded to SharePoint. | worker2/Worker/Client/TowFoundation.php, worker2/Worker/Client/TowFoundation/ProcessReceipts.php, worker2/Worker/Client/TowFoundation/TowFoundationVendors.php |
 | [Tow Foundation](profile.md) | 2.0 | Tow Foundation is a nonprofit client. |  |

package/knowledge/clients/tow-foundation/features/receipt-processing.md

@@ -5,11 +5,12 @@ project: Worker
 client: tow-foundation
 type: client-feature
 status: active
-updated: 2026-06-12
+updated: 2026-06-18
 owners: ["rgirish"]
 files:
   - worker2/Worker/Client/TowFoundation.php
   - worker2/Worker/Client/TowFoundation/ProcessReceipts.php
+  - worker2/Worker/Client/TowFoundation/TowFoundationVendors.php
 related:
   - clients/tow-foundation/profile.md
 ---
@@ -23,7 +24,7 @@ Excel file per person, uploads it to SharePoint, and sends a summary email.
 
 Invocation: `{"action": "Client/TowFoundation/ProcessReceipts/Run", "parameters": {}}`
 
-Optional filter parameters: `limit` (int), `year` (string e.g. `"2026"`), `person` (string e.g. `"Brent Peterkin"`).
+Optional filter parameters: `limit` (int), `year` (string e.g. `"2026"`), `person` (string e.g. `"Brent Peterkin"`), `billingCycle` (string — matches the **end** of the billing-cycle folder name, e.g. `"06-03-2026"` matches `"Amex ending in 06-03-2026"`, `"Mastercard ending in 06-03-2026"`, etc.).
 
 ## Key files / entry points
 
@@ -48,7 +49,7 @@ Credit Card Receipts/
 
 1. **Auth** — OAuth2 client-credentials token from Microsoft Graph
 2. **Walk** — `walkReceiptsFolder()` enumerates all receipt files and statement Excels
-3. **Filter** — optional `$year` / `$person` / `$limit` applied to the receipt list
+3. **Filter** — optional `$year` / `$person` / `$billingCycle` / `$limit` applied to the receipt list. `$billingCycle` uses `str_ends_with()` so passing just the date (e.g. `"06-03-2026"`) matches any card type. Person folders named `"Brent Peterkin CC receipts"` are normalized to `"Brent Peterkin"` via regex strip of ` CC receipts` suffix before any map lookups.
 4. **Pre-load statements** — all billing-cycle `.xlsx` files under `reports/` are downloaded
    and parsed upfront via PhpSpreadsheet (auto-detect header row by scanning for
    description/amount keywords)
@@ -59,8 +60,9 @@ Credit Card Receipts/
    - Cross-verify amount ± $0.01 against parsed statement; if matched, override `payment_memo` with statement description
    - Build base filename (no suffix yet) and store in `$pendingRenames`
    - On extract failure → move to `Archive/exception/` immediately
-6. **Collision detection** — count base name occurrences across all pending renames
-7. **Pass 2 — Move** — for each pending rename:
+6. **Deduplication** — after Pass 1, receipts sharing identical `(personName, invoice_date, vendor_name, total)` are deduplicated; only the first is kept, the rest are logged as `DUPLICATE skipped` and dropped. This catches the same receipt uploaded twice to SharePoint.
+7. **Collision detection** — count base name occurrences across remaining pending renames
+8. **Pass 2 — Move** — for each pending rename:
    - If base name appears more than once, assign `_a`, `_b`, `_c`... suffix to **all** colliding files (including the first)
    - PATCH SharePoint to rename + move to `Archive/` (flat — no person subfolder)
 8. **Excel generation** — one `.xlsx` per person (PhpSpreadsheet); columns: Row #, Account Name, QB Vendor, Payment Amount, Date, Payment Method, Payment Memo, QB Description, Class, Category, Payment Account, Ref No.
@@ -80,6 +82,25 @@ Amex billing cycle runs 3rd-to-3rd. `computeRefNo()` returns the cycle-end date
 - Charge on or before the 3rd → cycle ends on the 3rd of the same month
 - Charge after the 3rd → cycle ends on the 3rd of the next month
 
+### QB vendor matching
+`TowFoundationVendors.php` holds 2,994 vendor names exported verbatim from Tow Foundation's
+QuickBooks vendor list (June 2026). `matchQbVendor()` runs three passes against this list:
+1. Exact match (case-insensitive)
+2. Substring match — QB name contains extracted name or vice versa (min 4 chars); picks shortest match on multiple hits
+3. `similar_text()` similarity ≥ 80% — picks highest scorer
+
+Returns the exact QB vendor string or `''` if no confident match. The AI only extracts
+`vendor_name`; QB matching is done entirely in PHP — no tokens spent per receipt on the list.
+
+To update the vendor list: re-export from QuickBooks → run the extraction script →
+replace `TowFoundationVendors.php`. The matching logic is in `matchQbVendor()` and needs no changes.
+
+### AI category values
+The AI is prompted to return **specific expense types** — e.g. `"Dining"`, `"Travel"`,
+`"Accommodation"`, `"Transportation"`, `"Office Supplies"`, `"Entertainment"`,
+`"Professional Services"`, `"Subscriptions"`. It must not use broad accounting labels
+like `"Administrative Expenses"`.
+
 ### Per-person constants
 `CLASS_MAP` and `PAYMENT_ACCOUNT_MAP` in `ProcessReceipts.php` map each cardholder's name
 to their QuickBooks Class and Payment Account strings. Ryan Farrell uses Bank of America
@@ -133,7 +154,13 @@ Fatal errors send only to `NOTIFY_EMAIL_DEV` (no CC/BCC).
   `Credit Card Receipts/3. QB Excel/` (not inside each person's subfolder). This folder
   exists at the root of `Credit Card Receipts/` alongside the person folders.
 
+- **Person folder name normalization** — SharePoint folders are named `"Brent Peterkin CC receipts"` but `CLASS_MAP` / `PAYMENT_ACCOUNT_MAP` keys are just `"Brent Peterkin"`. The ` CC receipts` suffix is stripped via regex in `walkReceiptsFolder()`. Without this, Class and Payment Account columns are blank for those persons.
+- **`billingCycle` filter is suffix-match, not exact** — always pass just the date portion (`"06-03-2026"`), not the full folder name. Passing the full name (`"Amex ending in 06-03-2026"`) also works but would miss Mastercard folders.
+- **Ole Mole not in QB vendor list** — as of June 2026 this vendor is not in Tow Foundation's QuickBooks, so `qb_vendor` will be blank for Ole Mole charges until they add it to QB and the vendor list is refreshed.
+- **Duplicate detection is within-run only** — if the same receipt was processed in a prior run and archived, it won't be caught. The dedup only covers receipts present in the current run's `$pendingRenames`.
+
 ## Change history
 
+- 2026-06-18 — QB vendor matching via local fuzzy match against `TowFoundationVendors.php` (2,994 vendors); AI category prompt updated to return specific types (Dining, Travel, etc.); duplicate receipt detection added (person+date+vendor+amount dedup); `billingCycle` filter parameter added (suffix-match — card-type agnostic); person folder ` CC receipts` suffix stripped so CLASS_MAP/PAYMENT_ACCOUNT_MAP resolve correctly (rgirish)
 - 2026-06-12 — QB Excel upload moved to root-level `3. QB Excel/`; Archive/exception folders flattened (no person subfolder); unsupported mime types (`application/octet-stream`) now throw ReceiptProcessingException instead of being silently skipped (rgirish)
 - 2026-06-11 — Added CC (Magdalena), BCC (devteam@togatech.com), per-cardholder Archive subfolders, Excel upload to "3. QB Excel" SharePoint folder, two-pass rename with alphabetical duplicate suffix, rename format changed to `YYYY.MM.DD Full Name_Vendor_Amount` (rgirish)

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "toga-ai",
-  "version": "1.0.130",
+  "version": "1.0.131",
   "description": "TOGA Technology Team Claude Knowledge System — shared AI coding harness with skills, knowledge base CLI, and project installer for Claude Code.",
   "keywords": [
     "claude",