ai-workflows 2.1.1 → 2.3.0

package/.turbo/turbo-build.log

@@ -1,4 +1,4 @@
 
-> ai-workflows@2.0.3 build /Users/nathanclevenger/projects/primitives.org.ai/packages/ai-workflows
+> ai-workflows@2.3.0 build /Users/nathanclevenger/projects/primitives.org.ai/packages/ai-workflows
 > tsc
 

package/CHANGELOG.md

@@ -1,5 +1,21 @@
 # ai-workflows
 
+## 2.3.0
+
+### Patch Changes
+
+- @org.ai/types@2.3.0
+
+## 2.1.3
+
+### Patch Changes
+
+- Documentation and testing improvements
+  - Add deterministic AI testing suite with self-validating patterns
+  - Apply StoryBrand narrative to all package READMEs
+  - Update TESTING.md with four principles of deterministic AI testing
+  - Fix duplicate examples package name conflict
+
 ## 2.1.1
 
 ### Patch Changes
@@ -9,7 +25,7 @@
   - ai-functions: Add tests for AIFunction<Output, Input> generic order flip
   - ai-workflows: Add tests for EventHandler<TOutput, TInput> order and OnProxy/EveryProxy autocomplete
   - ai-database: Existing package - no changes in this release
-  - @primitives/types: New shared types package with failing tests for RED phase
+  - @org.ai/types: New shared types package with failing tests for RED phase
 
   These tests document the expected behavior for the GREEN phase implementation where generic type parameters will be reordered to put Output first (matching Promise<T> convention).
 

package/README.md

@@ -1,13 +1,16 @@
 # ai-workflows
 
-Event-driven workflows with the `$` context. Handle events, schedule tasks, and orchestrate processes.
+![Stability: Beta](https://img.shields.io/badge/stability-beta-yellow)
+
+**Event-driven AI workflows shouldn't require a PhD in distributed systems.**
+
+You have business logic that needs to react to events, run on schedules, and coordinate parallel tasks. Traditional workflow engines make you wade through XML configs, learn proprietary DSLs, and debug mysterious state machines. You just want to write `$.on.Order.placed(handler)` and have it work.
 
 ```typescript
 import { Workflow } from 'ai-workflows'
 
 const workflow = Workflow($ => {
   $.on.Customer.created(async (customer, $) => {
-    $.log('New customer:', customer.name)
     await $.send('Email.welcome', { to: customer.email })
   })
 
@@ -17,214 +20,351 @@ const workflow = Workflow($ => {
 })
 
 await workflow.start()
-await workflow.send('Customer.created', { name: 'John', email: 'john@example.com' })
 ```
 
+That's it. No YAML. No state machine diagrams. Just JavaScript.
+
 ## Installation
 
 ```bash
-pnpm add ai-workflows
+npm install ai-workflows
 ```
 
-## The `$` Context
+## Quick Start
 
-Everything flows through `$`. It's your workflow's connection to events, schedules, state, and the outside world.
+### Event Handlers
+
+React to events with the `$.on` pattern. Events follow `Noun.verb` naming:
 
 ```typescript
 Workflow($ => {
-  // Event handlers
-  $.on.Order.completed(async (order, $) => {
-    await $.send('Invoice.generate', { orderId: order.id })
-    $.log('Order completed', order)
+  $.on.Order.placed(async (order, $) => {
+    $.log('Processing order', order.id)
+    await $.send('Inventory.reserve', { items: order.items })
+    await $.send('Payment.charge', { amount: order.total })
   })
 
-  // Scheduled tasks
-  $.every.hour(async ($) => {
-    $.log('Hourly health check')
+  $.on.Payment.completed(async (payment, $) => {
+    await $.send('Order.fulfill', { orderId: payment.orderId })
+  })
+
+  $.on.Payment.failed(async (payment, $) => {
+    await $.send('Customer.notify', {
+      message: 'Payment failed',
+      orderId: payment.orderId
+    })
   })
 })
 ```
 
-## Event Handling
+### Scheduled Tasks
 
-Events follow the `Noun.verb` pattern:
+Natural scheduling with `$.every`:
 
 ```typescript
-$.on.Customer.created(handler)   // Customer created
-$.on.Order.shipped(handler)      // Order shipped
-$.on.Payment.failed(handler)     // Payment failed
-$.on.Ticket.resolved(handler)    // Ticket resolved
+Workflow($ => {
+  // Simple intervals
+  $.every.hour(async ($) => {
+    $.log('Hourly health check')
+  })
+
+  // Day + time combinations
+  $.every.Monday.at9am(async ($) => {
+    const report = await $.do('Analytics.weeklyReport', {})
+    await $.send('Slack.post', { channel: '#metrics', report })
+  })
+
+  $.every.weekday.at8am(async ($) => {
+    $.log('Good morning! Time to standup.')
+  })
+
+  // Precise intervals
+  $.every.minutes(30)(async ($) => {
+    await $.send('Cache.refresh', {})
+  })
+})
 ```
 
-### Sending Events
+**Available schedules:**
+
+| Intervals | Days | Times |
+|-----------|------|-------|
+| `$.every.second` | `$.every.Monday` | `.at6am` `.at7am` `.at8am` |
+| `$.every.minute` | `$.every.Tuesday` | `.at9am` `.at10am` `.at11am` |
+| `$.every.hour` | `$.every.Wednesday` | `.at12pm` `.atnoon` |
+| `$.every.day` | `$.every.Thursday` | `.at1pm` `.at2pm` `.at3pm` |
+| `$.every.week` | `$.every.Friday` | `.at4pm` `.at5pm` `.at6pm` |
+| `$.every.month` | `$.every.Saturday` | `.at7pm` `.at8pm` `.at9pm` |
+| `$.every.minutes(n)` | `$.every.Sunday` | `.atmidnight` |
+| `$.every.hours(n)` | `$.every.weekday` | |
+| | `$.every.weekend` | |
+
+## The Cascade Pattern
+
+Not every problem can be solved with code. Some need AI. Some need human judgment. The cascade executor tries each tier in sequence, escalating only when needed:
+
+```
+Code -> Generative AI -> Agentic AI -> Human
+```
 
 ```typescript
-// Fire and forget
-await $.send('Email.welcome', { to: 'user@example.com' })
+import { CascadeExecutor } from 'ai-workflows'
+
+const processRefund = new CascadeExecutor({
+  cascadeName: 'refund-processor',
+
+  tiers: {
+    // Tier 1: Deterministic rules (fastest, cheapest)
+    code: {
+      name: 'rule-based-refund',
+      execute: async (request) => {
+        if (request.amount < 50 && request.reason === 'defective') {
+          return { approved: true, method: 'original-payment' }
+        }
+        throw new Error('Rules inconclusive')
+      }
+    },
+
+    // Tier 2: AI analysis for complex cases
+    generative: {
+      name: 'ai-refund-analysis',
+      execute: async (request, ctx) => {
+        const analysis = await analyzeRefundRequest(request)
+        if (analysis.confidence > 0.9) {
+          return { approved: analysis.shouldApprove, reason: analysis.explanation }
+        }
+        throw new Error('Confidence too low')
+      }
+    },
+
+    // Tier 3: Agent with tool access
+    agentic: {
+      name: 'refund-agent',
+      execute: async (request, ctx) => {
+        return await refundAgent.process(request)
+      }
+    },
+
+    // Tier 4: Human review for edge cases
+    human: {
+      name: 'human-review',
+      execute: async (request) => {
+        return await createHumanTask({
+          type: 'refund-review',
+          data: request,
+          assignTo: 'support-team'
+        })
+      }
+    }
+  },
 
-// Execute and wait for result (durable)
-const result = await $.do('Order.process', orderData)
+  // Default timeouts per tier
+  useDefaultTimeouts: true,  // code: 5s, generative: 30s, agentic: 5m, human: 24h
+})
 
-// Execute without durability
-const result = await $.try('Order.validate', orderData)
+const result = await processRefund.execute(refundRequest)
+console.log(`Resolved by ${result.tier} tier in ${result.metrics.totalDuration}ms`)
 ```
 
-## Scheduling
+### Cascade Features
 
-Natural language scheduling with `$.every`:
+- **Automatic escalation** - Failed tiers escalate to the next level
+- **Tier timeouts** - Each tier has configurable time limits
+- **Retry support** - Configure retries with exponential backoff per tier
+- **Skip conditions** - Skip tiers based on input characteristics
+- **5W+H audit trail** - Full event log: who, what, when, where, why, how
+
+## Dependency Graphs
+
+For complex workflows with interdependent steps, use the dependency graph to ensure correct execution order:
 
 ```typescript
-// Simple intervals
-$.every.second(handler)
-$.every.minute(handler)
-$.every.hour(handler)
-$.every.day(handler)
-$.every.week(handler)
-
-// Days of the week
-$.every.Monday(handler)
-$.every.Friday(handler)
-$.every.weekday(handler)
-$.every.weekend(handler)
-
-// Day + time combinations
-$.every.Monday.at9am(handler)
-$.every.Friday.at5pm(handler)
-$.every.weekday.at8am(handler)
-
-// Intervals with values
-$.every.minutes(30)(handler)
-$.every.hours(4)(handler)
-
-// Natural language (requires AI converter)
-$.every('first Monday of the month at 9am', handler)
-$.every('every 15 minutes during business hours', handler)
+import { DependencyGraph, getExecutionLevels } from 'ai-workflows'
+
+const graph = new DependencyGraph()
+
+// Steps with no dependencies run first (level 0)
+graph.addNode('fetch-user')
+graph.addNode('fetch-products')
+
+// Dependent steps run after their dependencies complete
+graph.addNode('validate-cart', { dependsOn: ['fetch-user', 'fetch-products'] })
+graph.addNode('calculate-shipping', { dependsOn: 'fetch-products' })
+graph.addNode('apply-discounts', { dependsOn: 'validate-cart' })
+graph.addNode('process-payment', { dependsOn: ['apply-discounts', 'calculate-shipping'] })
+
+// Automatic cycle detection
+try {
+  graph.addNode('bad-step', { dependsOn: 'process-payment' })
+  graph.addEdge('bad-step', 'fetch-user')  // Would create a cycle!
+} catch (e) {
+  console.log('Caught circular dependency:', e.cyclePath)
+}
 ```
 
-### Available Times
+### Topological Sort
+
+Execute steps in dependency order:
 
 ```typescript
-.at6am   .at7am   .at8am   .at9am   .at10am  .at11am
-.at12pm  .atnoon  .at1pm   .at2pm   .at3pm   .at4pm
-.at5pm   .at6pm   .at7pm   .at8pm   .at9pm   .atmidnight
+import { topologicalSort, getExecutionLevels } from 'ai-workflows'
+
+const steps = [
+  { id: 'A', dependencies: [] },
+  { id: 'B', dependencies: ['A'] },
+  { id: 'C', dependencies: ['A'] },
+  { id: 'D', dependencies: ['B', 'C'] },
+]
+
+// Linear execution order
+const { order } = topologicalSort(steps)
+// => ['A', 'B', 'C', 'D']
+
+// Parallel execution groups
+const levels = getExecutionLevels(steps)
+// => [
+//   { level: 0, nodes: ['A'] },        // Run first
+//   { level: 1, nodes: ['B', 'C'] },   // Run in parallel
+//   { level: 2, nodes: ['D'] }         // Run after B and C complete
+// ]
 ```
 
-## Standalone API
+## Barriers and Joins
 
-Use `on`, `every`, and `send` for global registration:
+Coordinate parallel operations with barrier semantics:
 
 ```typescript
-import { on, every, send } from 'ai-workflows'
-
-on.Customer.created(async (customer, $) => {
-  await $.send('Email.welcome', { to: customer.email })
+import { waitForAll, waitForAny, Barrier, withConcurrencyLimit } from 'ai-workflows'
+
+// Wait for all parallel tasks
+const results = await waitForAll([
+  fetchUserData(userId),
+  fetchOrderHistory(userId),
+  fetchRecommendations(userId),
+], { timeout: 5000 })
+
+// Wait for N of M (e.g., 2 of 3 replicas)
+const { completed, pending } = await waitForAny(2, [
+  writeToReplica1(data),
+  writeToReplica2(data),
+  writeToReplica3(data),
+])
+
+// Manual barrier for complex coordination
+const barrier = new Barrier(3, {
+  timeout: 10000,
+  onProgress: ({ arrived, expected, percentage }) => {
+    console.log(`${arrived}/${expected} (${percentage}%)`)
+  }
 })
 
-every.hour(async ($) => {
-  $.log('Hourly task')
-})
+// In parallel handlers...
+barrier.arrive(resultFromWorker1)
+barrier.arrive(resultFromWorker2)
+barrier.arrive(resultFromWorker3)
 
-await send('Customer.created', { name: 'John' })
+// Wait for all to arrive
+const allResults = await barrier.wait()
 ```
 
-## Real-World Examples
+### Concurrency Control
 
-### Order Processing
+Limit parallel executions to prevent overwhelming downstream services:
 
 ```typescript
-const workflow = Workflow($ => {
-  $.on.Order.placed(async (order, $) => {
-    $.log('Processing order', order.id)
+const urls = [/* 100 URLs */]
+
+// Process 5 at a time
+const results = await withConcurrencyLimit(
+  urls.map(url => () => fetch(url)),
+  5,  // max concurrent
+  { collectErrors: true }  // don't fail fast
+)
+```
 
-    // Validate inventory
-    const valid = await $.do('Inventory.check', order.items)
-    if (!valid) {
-      await $.send('Order.cancelled', { orderId: order.id, reason: 'Out of stock' })
-      return
-    }
+## Standalone API
 
-    // Process payment
-    const payment = await $.do('Payment.charge', {
-      amount: order.total,
-      customer: order.customerId,
-    })
+Use `on`, `every`, and `send` for global registration outside of a workflow:
 
-    // Fulfill order
-    await $.send('Fulfillment.ship', { orderId: order.id })
-  })
+```typescript
+import { on, every, send } from 'ai-workflows'
 
-  $.on.Order.shipped(async (data, $) => {
-    await $.send('Email.tracking', { orderId: data.orderId })
-  })
+// Register handlers
+on.Customer.created(async (customer, $) => {
+  await $.send('Email.welcome', { to: customer.email })
 })
-```
 
-### Customer Lifecycle
+every.hour(async ($) => {
+  $.log('Background task running')
+})
 
-```typescript
-Workflow($ => {
-  $.on.Customer.signedUp(async (customer, $) => {
-    await $.send('Email.welcome', { to: customer.email })
-    await $.send('Slack.notify', { message: `New signup: ${customer.name}` })
-  })
+// Emit events from anywhere
+await send('Customer.created', { name: 'Alice', email: 'alice@example.com' })
+```
 
-  $.on.Customer.upgraded(async (customer, $) => {
-    await $.send('Email.upgradeConfirmation', { to: customer.email })
-    await $.send('Analytics.track', { event: 'upgrade', plan: customer.plan })
-  })
+## Configuration
 
-  // Check for inactive users daily
-  $.every.day.at9am(async ($) => {
-    const inactive = await $.do('Customer.findInactive', { days: 30 })
-    for (const customer of inactive) {
-      await $.send('Email.reengagement', { to: customer.email })
-    }
-  })
-})
-```
+### Custom Cron Converter
 
-### Scheduled Reports
+Enable natural language scheduling with an AI-powered cron converter:
 
 ```typescript
-Workflow($ => {
-  $.every.Monday.at9am(async ($) => {
-    const report = await $.do('Analytics.weeklyReport', {})
-    await $.send('Email.report', {
-      to: 'team@company.com',
-      report,
-    })
-  })
+import { setCronConverter } from 'ai-workflows'
 
-  $.every.month(async ($) => {
-    const metrics = await $.do('Metrics.monthly', {})
-    await $.send('Dashboard.update', { metrics })
-  })
+setCronConverter(async (description) => {
+  // Use your AI service to convert natural language to cron
+  const response = await ai.complete(`Convert to cron: "${description}"`)
+  return response.cron
 })
+
+// Now you can use natural language
+$.every('first Monday of the month at 9am', handler)
+$.every('every 15 minutes during business hours', handler)
 ```
 
-## Workflow Instance
+### Cascade Timeouts
 
-The `Workflow()` function returns an instance with:
+Configure per-tier and total timeouts:
 
 ```typescript
-const workflow = Workflow($ => { /* ... */ })
+const executor = new CascadeExecutor({
+  tiers: { /* ... */ },
+
+  // Custom timeouts per tier (milliseconds)
+  timeouts: {
+    code: 2000,        // 2 seconds
+    generative: 15000, // 15 seconds
+    agentic: 60000,    // 1 minute
+    human: 3600000,    // 1 hour
+  },
+
+  // Or use defaults
+  useDefaultTimeouts: true,  // code: 5s, generative: 30s, agentic: 5m, human: 24h
+
+  // Total cascade timeout
+  totalTimeout: 300000,  // 5 minutes max for entire cascade
+})
+```
 
-// Access the workflow
-workflow.definition  // Event and schedule registrations
-workflow.state       // Current state and history
-workflow.$           // The $ context
+### Retry Configuration
 
-// Control the workflow
-await workflow.start()  // Begin processing schedules
-await workflow.stop()   // Stop all schedules
+Add retries with exponential backoff:
 
-// Send events
-await workflow.send('Customer.created', { name: 'John' })
+```typescript
+const executor = new CascadeExecutor({
+  tiers: { /* ... */ },
+
+  retryConfig: {
+    code: { maxRetries: 2, baseDelay: 100 },
+    generative: { maxRetries: 3, baseDelay: 1000, multiplier: 2 },
+    agentic: { maxRetries: 1, baseDelay: 5000 },
+  }
+})
 ```
 
 ## Testing
 
-Create isolated test contexts:
+Create isolated contexts for testing:
 
 ```typescript
 import { createTestContext } from 'ai-workflows'
@@ -232,75 +372,56 @@ import { createTestContext } from 'ai-workflows'
 const $ = createTestContext()
 
 // Call your handler
-await yourHandler({ name: 'test' }, $)
+await orderHandler({ id: '123', total: 99.99 }, $)
 
-// Check what was emitted
+// Assert on emitted events
 expect($.emittedEvents).toContainEqual({
-  event: 'Email.welcome',
-  data: { to: 'test@example.com' },
+  event: 'Payment.charge',
+  data: { amount: 99.99 },
 })
 ```
 
 ## API Reference
 
-### Workflow Functions
+### Core Workflow
 
 | Export | Description |
 |--------|-------------|
 | `Workflow($)` | Create a workflow with $ context |
-| `on` | Standalone event registration |
-| `every` | Standalone schedule registration |
-| `send` | Emit events globally |
+| `on` | Standalone event registration proxy |
+| `every` | Standalone schedule registration proxy |
+| `send(event, data)` | Emit events globally |
 | `createTestContext()` | Create isolated $ for testing |
 
-### Context Methods
+### Cascade Executor
 
-| Method | Description |
+| Export | Description |
 |--------|-------------|
-| `$.on.Noun.verb(handler)` | Register event handler |
-| `$.every.*` | Register scheduled handler |
-| `$.send(event, data)` | Emit event (fire and forget) |
-| `$.do(event, data)` | Execute handler (durable) |
-| `$.try(event, data)` | Execute handler (non-durable) |
-| `$.log(message, data?)` | Log with history |
-| `$.state` | Access workflow state |
+| `CascadeExecutor` | Tiered execution: code -> AI -> agent -> human |
+| `TIER_ORDER` | `['code', 'generative', 'agentic', 'human']` |
+| `DEFAULT_TIER_TIMEOUTS` | Default timeout per tier |
 
-### Schedule Helpers
+### Dependency Graph
 
 | Export | Description |
 |--------|-------------|
-| `toCron(description)` | Convert to cron expression |
-| `setCronConverter(fn)` | Set AI cron converter |
-| `intervalToMs(interval)` | Get interval in milliseconds |
-| `formatInterval(interval)` | Format for display |
+| `DependencyGraph` | DAG for workflow step dependencies |
+| `topologicalSort(nodes)` | Sort nodes in dependency order |
+| `getExecutionLevels(nodes)` | Group nodes for parallel execution |
+| `CircularDependencyError` | Thrown when cycle detected |
 
-## Types
+### Barriers
 
-```typescript
-interface WorkflowContext {
-  on: OnProxy
-  every: EveryProxy
-  send<T>(event: string, data: T): Promise<void>
-  do<T, R>(event: string, data: T): Promise<R>
-  try<T, R>(event: string, data: T): Promise<R>
-  log(message: string, data?: unknown): void
-  state: Record<string, unknown>
-  db?: DatabaseContext
-}
-
-interface WorkflowInstance {
-  definition: WorkflowDefinition
-  state: WorkflowState
-  $: WorkflowContext
-  send<T>(event: string, data: T): Promise<void>
-  start(): Promise<void>
-  stop(): Promise<void>
-}
-```
+| Export | Description |
+|--------|-------------|
+| `Barrier` | Manual synchronization point |
+| `waitForAll(promises)` | Wait for all with timeout support |
+| `waitForAny(n, promises)` | Wait for N of M to complete |
+| `withConcurrencyLimit(tasks, n)` | Limit parallel executions |
 
 ## Related Packages
 
-- [`ai-functions`](../ai-functions) — AI-powered functions
-- [`ai-database`](../ai-database) — Durable event storage
-- [`human-in-the-loop`](../human-in-the-loop) — Human workflow steps
-- [`digital-tasks`](../digital-tasks) — Task management
+- [`ai-functions`](../ai-functions) - AI-powered functions with type safety
+- [`ai-database`](../ai-database) - Durable event storage
+- [`human-in-the-loop`](../human-in-the-loop) - Human workflow steps
+- [`digital-workers`](../digital-workers) - Autonomous AI agents