pipework 0.174.0 → 0.176.0

package/CHANGELOG.md

@@ -1,5 +1,18 @@
 # Changelog
 
+## 0.176.0
+
+- **Added: alert sources for mail, storage, access links and sign-in lockouts** (failure-alert class, part 2 of 3):
+  - `alerts.source.email({ stuckAfterMs?, queuedAfterMs?, receivedAfterMs?, sweepGraceMs? })` raises `email-failed:outbound` and `email-failed:inbound` for messages marked failed since the last tick, `email-stuck:sending` and `email-stuck:queued` while sends stall or nothing drains the queue, `email-inbound-stuck:received` while received mail is not handled, and `email-raw-undrained:all` while raw inbound copies outlive their retention.
+  - `alerts.source.storage({ sweepGraceMs? })` raises `storage-expiry-undrained:all` while expired files are not swept.
+  - `alerts.source.accessLinks({ graceMs? })` raises `access-link-abandoned:<tenantId>` while link uses stay reserved and never finish.
+  - `alerts.source.lockouts({ tables? })` raises `auth-lockout:<table>` (warning) while sign-in or guard lockouts are active: counts only, never an account. Without `tables` it watches whichever lockout tables exist.
+- `pipework_email_messages` and `pipework_email_inbound` gain a nullable `failed_at`, set when a message is marked failed. Run `pipework generate` and migrate.
+
+## 0.175.0
+
+- **Fixed: a worker surface with `schedules: []` failed every scheduler check** with `syntax error at or near ")"`. The scheduler built `name IN ()` from the empty list. **Added: `sql.inList(values, cast?)`**, the one safe way to match a column against a JS list. `` col ${sql.inList(ids, 'uuid')} `` renders `= ANY(...)` over one jsonb parameter, so an empty list matches nothing instead of failing to parse. A `Date` travels as ISO text. The scheduler, trace partition sync, access-link deletes and step-graph queries now use it; those other sites were already guarded against an empty list.
+
 ## 0.174.0
 
 - **Added: build an alert from any recorded failure, and sources for outbox, webhook and credit failures** (follows #712). Two general builders:

package/REFERENCE.md

@@ -732,6 +732,7 @@ Expression helpers for `.set()`, `.values()` and `.where()` (a string or number
 - `filter.strpos(a, b)`, `filter.textContains(a, b)`, `filter.startsWith(a, prefix)` — exact-text tests, no `%`/`_`/backslash wildcards (unlike `like`). `a`, `b`, `prefix` take a column, expression or string.
 - `filter.left(a, n)`, `filter.right(a, n)`, `filter.length(a)` — text slices and length.
 - `filter.concat(...parts)` — `(p1 || p2 || ...)`, at least two parts, each a string, column or expression (`scalar(...)` for a subquery). A null part makes the result null; wrap it in `coalesce` if not wanted.
+- `pipe.sql.inList(values, cast?)` — list match for a JS list: `` sql`id ${sql.inList(ids, 'uuid')}` `` renders `= ANY(...)`, so an empty list matches nothing; never build `IN (${sql.join(...)})`, which is a syntax error when the list is empty. `cast` is the element type, default `text`.
 - `filter.arrayReplace(col, from, to)` — `array_replace`, every `from` becomes `to`; `filter.arrayHas(col, value)` — `$value = ANY(col)`. `col` must be an array column; values are cast to its element type.
 - `filter.jsonbMerge(col, object)` — same as `jsonb.merge`.
 - `filter.jsonbRemove(col, ...keys)` — same as `jsonb.remove`.
@@ -1283,7 +1284,7 @@ Signs a payload with HMAC for outbound delivery — returns body, signature, tim
 
 Mail namespace — email through a job queue, SES v2 or a dev stand-in, bounce and complaint suppression, and receiving.
 
-Opt in with blueprint `email: {}`; the generated migration adds `pipework_email_messages` (`key` unique, `to_address`, `template`, `data`, `status` `queued | sending | sent | suppressed | failed`, `provider_message_id`, `error`, `trace_id`, `created_at`, `sent_at`, `sending_at`) and `pipework_email_suppressions` (`address` primary key, lowercased; `reason` `bounce | complaint`; `detail`; `created_at`), both `IF NOT EXISTS` and not tenant-scoped. `pipework_email_messages` also has `conversation_id` and `in_reply_to_inbound`. Receiving adds `pipework_email_inbound` (see `mail.inbound`).
+Opt in with blueprint `email: {}`; the generated migration adds `pipework_email_messages` (`key` unique, `to_address`, `template`, `data`, `status` `queued | sending | sent | suppressed | failed`, `provider_message_id`, `error`, `trace_id`, `created_at`, `sent_at`, `sending_at`, `failed_at`) and `pipework_email_suppressions` (`address` primary key, lowercased; `reason` `bounce | complaint`; `detail`; `created_at`), both `IF NOT EXISTS` and not tenant-scoped. `pipework_email_messages` also has `conversation_id` and `in_reply_to_inbound`. Receiving adds `pipework_email_inbound` (see `mail.inbound`).
 
 ### `mail.create`
 
@@ -1315,7 +1316,7 @@ Inbound handler for SES bounce and complaint events delivered through SNS; suppr
 
 Receiving email: `inbound({ source, queue, onMessage, ... })` returns `{ webhook, jobs, scan, sweep, get }`; messages arrive parsed, threaded into conversations, attachments stored as tenant files.
 
-`mail.inbound({ source, queue, onMessage, storage?, resolveTenant?, rawRetentionDays? = 30, maxRawBytes? = 41943040, environment? })`. Needs blueprint `email: {}`: the table `pipework_email_inbound` (`source_id` unique, `source` `ses | folder`, `raw_location`, `raw_expires_at`, `raw_deleted_at`, `status` `received | processed | failed`, `error`, `message_id_header`, `in_reply_to`, `references`, `from_address`, `subject`, `conversation_id`, `tenant_id`, `verdicts`, `recipients`, `attachment_files`, `received_at`, `processed_at`, `trace_id`; `references`, `recipients` and `attachment_files` are jsonb arrays). Not tenant-scoped (the row exists before a tenant is known). It holds no bodies: the raw message is the copy, deleted by `sweep` after `rawRetentionDays`.
+`mail.inbound({ source, queue, onMessage, storage?, resolveTenant?, rawRetentionDays? = 30, maxRawBytes? = 41943040, environment? })`. Needs blueprint `email: {}`: the table `pipework_email_inbound` (`source_id` unique, `source` `ses | folder`, `raw_location`, `raw_expires_at`, `raw_deleted_at`, `status` `received | processed | failed`, `error`, `message_id_header`, `in_reply_to`, `references`, `from_address`, `subject`, `conversation_id`, `tenant_id`, `verdicts`, `recipients`, `attachment_files`, `received_at`, `processed_at`, `failed_at`, `trace_id`; `references`, `recipients` and `attachment_files` are jsonb arrays). Not tenant-scoped (the row exists before a tenant is known). It holds no bodies: the raw message is the copy, deleted by `sweep` after `rawRetentionDays`.
 
 `webhook({ path })` (SES source) returns a public POST handler: the SNS message is verified exactly as for `mail.snsWebhook` (signature, certificate host, `topicArns`; 401 otherwise, nothing recorded), then one `pipework_email_inbound` row keyed by SES's `mail.messageId` and one `pipework.email.receive` job are written in one transaction; the same notification again adds nothing. A notification that is not `Received`, or whose receipt action is not `S3`, is answered 200 and ignored. Spread `jobs` into the worker surface's `jobs` (same queue).
 
@@ -1749,6 +1750,10 @@ Pass in `sources`; each raises with a fixed key on a tick and, where it can tell
 - `alerts.source.deliveryFailed({ tables? = ['pipework_alert_deliveries'], stuckAfterMs? = 900_000, settleMs?, severity? = 'error', owner?, runbook?, database? })` — outbox rows that gave up: `delivery-failed:<table>:<sink>`, message `<n> delivery(ies) to <sink> gave up; last error: <last_error>` (clears by the quiet period); and rows still pending more than `stuckAfterMs` past `next_attempt_at`: `delivery-stuck:<table>:<sink>` (resolves when they drain). Name `support_event_delivery` in `tables` to cover the support outbox.
 - `alerts.source.webhookFailed({ table? = '__pipework_webhook_deliveries', stalledAfterMs? = 900_000, settleMs?, severity?, owner?, runbook?, database? })` — outbound webhook deliveries (set `table` to your `deliveryTable`): `webhook-failed:<endpointId>` for deliveries that completed with no 2xx status, message `<n> webhook delivery(ies) to endpoint <id> gave up; last status <code|none>`; `webhook-stalled:<endpointId>` while deliveries are more than `stalledAfterMs` past `next_retry_at`.
 - `alerts.source.credits({ heldOlderThanMs? = 3_600_000, expiryGraceMs? = 3_600_000, settleMs?, severity?, owner?, runbook?, database? })` — `credit-overdraft:<tenantId>` for settlements that overdrew a tenant (`<n> settlement(s) overdrew <tenantId> by <sum>`); `credit-held:<tenantId>` while reservations stay held past `heldOlderThanMs`; `credit-expiry-undrained:all` while grants expired more than `expiryGraceMs` ago still have credit (`<n> expired grant(s) not drained; is the credits expiry job scheduled?`). Needs `credits` configured.
+- `alerts.source.email({ stuckAfterMs? = 900_000, queuedAfterMs? = 3_600_000, receivedAfterMs? = 900_000, sweepGraceMs? = 3_600_000, settleMs?, severity?, owner?, runbook?, database? })` — needs `email: {}`. `email-failed:outbound` / `email-failed:inbound` for messages marked `failed` since the last tick (the new nullable `failed_at` column on both tables; run `pipework generate` and migrate; count and last error, no addresses); `email-stuck:sending` past `stuckAfterMs`; `email-stuck:queued` past `queuedAfterMs` (nothing drains the send queue); `email-inbound-stuck:received` past `receivedAfterMs`; `email-raw-undrained:all` while raw messages are `sweepGraceMs` past `raw_expires_at` and not deleted.
+- `alerts.source.storage({ sweepGraceMs? = 3_600_000, severity?, owner?, runbook?, database? })` — needs `storage: {}`. `storage-expiry-undrained:all` while `storage_file` rows are `sweepGraceMs` past `expires_at` and not swept.
+- `alerts.source.accessLinks({ graceMs? = 900_000, severity?, owner?, runbook?, database? })` — needs `accessLinks: {}`. `access-link-abandoned:<tenantId>` while uses stay `pending` `graceMs` past `reserved_until`.
+- `alerts.source.lockouts({ tables? = the ones that exist, severity? = 'warning', owner?, runbook?, database? })` — `auth-lockout:<table>` while rows have `locked_until` in the future (count only; no account is named). `pipework_signin_attempts` needs `passwords: {}`, `pipework_guard_attempts` needs `guards: {}`; with `tables` omitted, the tables that exist are resolved once on the first evaluate (it throws, naming both keys, if neither does); pass `tables` to override.
 - `queue.totals(db)` — `{ overall, byType }`, each `{ ready, running, oldestReadyWaitMs }` (ready: pending and not waiting on a retry time; running: claimed or running; wait from `queued_at`, null when none is ready); `byType` omits a type with neither.
 - `alerts.source.health(checks, { severity? = 'error' })` — `health:<name>` while a `HealthCheck` is unhealthy or throws; resolves when it recovers. Degraded is not a fault.
 

package/dist/REFERENCE.md

@@ -1,7 +1,7 @@
 # Pipework API Reference
 
 > Auto-generated from source JSDoc. Do not edit manually.
-> Generated: 2026-10-22
+> Generated: 2026-10-20
 
 ## Contents
 
@@ -816,10 +816,6 @@ Acquires a transaction-scoped advisory lock. Released at commit/rollback.
 
 Runs a function in a SERIALIZABLE transaction with automatic retry on serialization failures and deadlocks.
 
-### `pipe.withTimeouts`
-
-Sets statement_timeout and/or lock_timeout for the current transaction in one statement, then runs fn; a statement cancelled for them rejects with StatementTimeoutError or LockTimeoutError.
-
 ### `pipe.bulkSet`
 
 Bulk UPDATE ... FROM (VALUES ...) — updates multiple rows with per-row values in a single statement.
@@ -828,10 +824,6 @@ Bulk UPDATE ... FROM (VALUES ...) — updates multiple rows with per-row values
 
 Produces a typed VALUES clause for bulk operations — the base primitive for bulkSet and bulkUpsert.
 
-### `pipe.fn`
-
-A set-returning SQL function as a typed source for `.from()` and joins — `pipe.fn('schema.f', { args: [field.uuid()], columns: { path: field.text() } })`. Arguments are bound and cast to their declared types.
-
 ### `pipe.field`
 
 Field builders for domain definitions — uuid(), text(), integer(), etc.
@@ -844,10 +836,6 @@ Registers a domain definition with table, validators, and factory projections. T
 
 Returns the global registry of all domain definitions.
 
-### `pipe.external`
-
-Declares a table or view another service owns (`pipe.external(name, fields, { schema, table? })`): typed columns and every query operator, read-only, never migrated, not tenant-scoped.
-
 ### `pipe.update`
 
 Pipework-owned UPDATE builder — the only consumer-facing way to update pipework-managed tables (Q8).
@@ -878,54 +866,12 @@ interface WindowSpec
 interface ValueColumnDef
 ```
 
-**`JsonbElements`** — A jsonb array read as its elements' text. Produced by {@link jsonbElements}.
-
-```typescript
-interface JsonbElements
-```
-
-**`ArraySource`** — Something whose elements `arrayAny` / `arrayAll` can test.
-
-```typescript
-type ArraySource =
-```
-
-**`ElementOf`** — The element type of an {@link ArraySource}.
-
-```typescript
-type ElementOf<S> =
-```
-
-**`FunctionSpec`** — Declares a SQL function's argument and result-column shapes. See {@link fn}.
-
-```typescript
-interface FunctionSpec<TArgs extends readonly AnyField[], TColumns extends Record<string, AnyField>>
-```
-
-**`FunctionSourceFields`** — The selected fields of a function source: each result column as a typed SQL expression.
-
-```typescript
-type FunctionSourceFields<TColumns extends Record<string, AnyField>> =
-```
-
-**`FunctionSource`** — A function call usable in `.from()` and joins; its result columns are properties of it.
-
-```typescript
-type FunctionSource<TAlias extends string, TColumns extends Record<string, AnyField>> =
-```
-
 **`SerializableOptions`** — Retry policy for {@link serializable}: how many attempts on a serialization failure / deadlock, and the base backoff between them.
 
 ```typescript
 interface SerializableOptions
 ```
 
-**`TimeoutOptions`** — Which timeouts {@link withTimeouts} sets; each a positive integer number of milliseconds.
-
-```typescript
-interface TimeoutOptions
-```
-
 **`ManagedConnection`** — A standalone pooled connection: the raw postgres.js client, its drizzle handle, and a `close()` that ends the pool.
 
 ```typescript
@@ -946,10 +892,6 @@ JSONB query operators — typed helpers for PostgreSQL JSONB containment, key ch
 
 The @> containment operator — tests whether a JSONB column contains the given value.
 
-### `jsonb.merge`
-
-Merges an object into a JSONB column in `.set()`: `coalesce(col, '{}') || value`. Top-level keys overwrite; others are kept.
-
 ### `jsonb.containedBy`
 
 The <@ contained-by operator — tests whether a JSONB column is contained by the given value.
@@ -1016,60 +958,6 @@ type Schema<T = unknown> = z.ZodType<T>
 type Infer<T extends Schema> = z.infer<T>
 ```
 
-**`StringSchema`** — A string validator — what check.string() returns, nameable without importing zod.
-
-```typescript
-interface StringSchema extends z.ZodString
-```
-
-**`NumberSchema`** — A number validator — what check.number() returns.
-
-```typescript
-interface NumberSchema extends z.ZodNumber
-```
-
-**`BooleanSchema`** — A boolean validator — what check.boolean() returns.
-
-```typescript
-interface BooleanSchema extends z.ZodBoolean
-```
-
-**`EnumSchema`** — An enum validator over string literals — what check.enum([...]) returns.
-
-```typescript
-interface EnumSchema<V extends string = string> extends z.ZodEnum<
-```
-
-**`LiteralSchema`** — A literal validator — what check.literal(v) returns.
-
-```typescript
-interface LiteralSchema<V extends string | number | boolean | null = string> extends z.ZodLiteral<V>
-```
-
-**`ArraySchema`** — An array validator — what check.array(item) returns.
-
-```typescript
-interface ArraySchema<Item extends z.core.SomeType = z.core.SomeType> extends z.ZodArray<Item>
-```
-
-**`OptionalSchema`** — An optional validator — what check.optional(inner) returns.
-
-```typescript
-interface OptionalSchema<Inner extends z.core.SomeType = z.core.SomeType> extends z.ZodOptional<Inner>
-```
-
-**`NullableSchema`** — A nullable validator — what check.nullable(inner) returns.
-
-```typescript
-interface NullableSchema<Inner extends z.core.SomeType = z.core.SomeType> extends z.ZodNullable<Inner>
-```
-
-**`ObjectSchema`** — An object validator whose .extend, .pick, .omit and .partial results stay ObjectSchema — what check.object({...}) returns.
-
-```typescript
-type ObjectSchema<S extends Shape = Shape> =
-```
-
 ## temporal — Bitemporal Data
 
 Temporal (bitemporal) data namespace — version history with effective date ranges.
@@ -1586,11 +1474,7 @@ interface RateLimitConfig
 interface RateLimitWindow
 ```
 
-**`RateLimitClass`**
-
-A named limit class: any of a per-user, per-tenant, per-address and total window, each counted on its own.
-Each key takes one window or an array of windows (distinct `windowSeconds`); a request is counted against
-all of a key's windows and refused if any is over.
+**`RateLimitClass`** — A named limit class: any of a per-user, per-tenant and per-address window, each counted on its own.
 
 ```typescript
 interface RateLimitClass
@@ -1606,8 +1490,8 @@ interface RateLimitRefusal
 
 Named limit classes, checked after auth and counted in Postgres (`pipework_rate_limit_counts`, opted in
 with the blueprint's `rateLimits: {}`), so every server process on the same database shares one count.
-Keys are counted perUser, perTenant, perAddress, total in turn, up to the first key with a window over its max, so one user's
-refused requests don't spend the tenant's budget. The 429's Retry-After is the longest wait of the windows that refused. A route is in `signedIn` (auth required, or optional with
+Windows are counted perUser, perTenant, perAddress in turn, up to the first one over its max, so one user's
+refused requests don't spend the tenant's budget. A route is in `signedIn` (auth required, or optional with
 a user), `public` (no auth, or optional without a user) or the class its fitting names with `.rateLimit(name)`.
 
 ```typescript
@@ -1759,20 +1643,15 @@ interface TraceTree
 
 ## data
 
-### `StatementTimeoutError`
-
-A statement was cancelled by Postgres for running past the statement timeout a {@link withTimeouts} call set. `cause` is the driver error.
-
-```typescript
-class StatementTimeoutError extends Error constructor(readonly statementTimeoutMs: number, cause: unknown)
-```
-
-### `LockTimeoutError`
+### `tap`
 
-A statement gave up waiting for a lock past the lock timeout a {@link withTimeouts} call set. `cause` is the driver error.
+Opens a standalone managed connection outside the manifold's pools — the
+sanctioned door for contexts where `pipe()` structurally cannot resolve:
+`worker_threads`, detached monitors, one-off scripts. Callers own the
+lifecycle: always `await conn.close()`.
 
 ```typescript
-class LockTimeoutError extends Error constructor(readonly lockTimeoutMs: number, cause: unknown)
+function tap(url: string, options?: ConnectOptions): ManagedConnection
 ```
 
 ## request

package/dist/async/jobs/scheduler.js

@@ -67,7 +67,7 @@ export function createScheduler(enqueuer, jobsTableQ) {
     async function fireOneDue(db, names) {
         return db.transaction(async (tx) => {
             const filter = names !== undefined
-                ? sql `AND name IN (${sql.join(names.map(n => sql `${n}`), sql `, `)})`
+                ? sql `AND name ${sql.inList(names)}`
                 : sql ``;
             const due = await tx.execute(sql `
         SELECT name, cron_expression, timezone, payload

package/dist/async/jobs/scheduler.js.map

@@ -1 +1 @@
-{"version":3,"file":"scheduler.js","sourceRoot":"","sources":["../../../src/async/jobs/scheduler.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,GAAG,EAAE,MAAM,sBAAsB,CAAA;AAE1C,OAAO,EAAE,SAAS,EAAE,QAAQ,EAAE,MAAM,WAAW,CAAA;AAqD/C,MAAM,UAAU,eAAe,CAAC,QAAkB,EAAE,UAAkB;IACpE,IAAI,cAAc,GAA0C,IAAI,CAAA;IAChE,IAAI,OAAO,GAAG,KAAK,CAAA;IAEnB,KAAK,UAAU,QAAQ,CAAC,EAAM,EAAE,IAAkB;QAChD,MAAM,MAAM,GAAG,SAAS,CAAC,IAAI,CAAC,IAAI,CAAC,CAAA;QACnC,MAAM,EAAE,GAAG,IAAI,CAAC,QAAQ,IAAI,KAAK,CAAA;QACjC,MAAM,SAAS,GAAG,QAAQ,CAAC,MAAM,EAAE,IAAI,IAAI,EAAE,EAAE,EAAE,CAAC,CAAA;QAClD,MAAM,WAAW,GAAG,IAAI,CAAC,OAAO,KAAK,SAAS,CAAC,CAAC,CAAC,IAAI,CAAC,SAAS,CAAC,IAAI,CAAC,OAAO,CAAC,CAAC,CAAC,CAAC,IAAI,CAAA;QAEpF,MAAM,EAAE,CAAC,OAAO,CAAC,GAAG,CAAA;;gBAER,IAAI,CAAC,IAAI,KAAK,IAAI,CAAC,IAAI,KAAK,EAAE,KAAK,WAAW,KAAK,IAAI,CAAC,CAAC,CAAC,GAAG,CAAA,GAAG,WAAW,SAAS,CAAC,CAAC,CAAC,GAAG,CAAA,MAAM,KAAK,SAAS,CAAC,WAAW,EAAE;;;;;;;;;;;;KAYvI,CAAC,CAAA;IACJ,CAAC;IAED,KAAK,UAAU,UAAU,CAAC,EAAM,EAAE,IAAY;QAC5C,MAAM,IAAI,GAAG,MAAM,EAAE,CAAC,OAAO,CAC3B,GAAG,CAAA,+CAA+C,IAAI,iBAAiB,CACxE,CAAA;QACD,OAAO,IAAI,CAAC,MAAM,GAAG,CAAC,CAAA;IACxB,CAAC;IAED,KAAK,UAAU,aAAa,CAAC,EAAM;QACjC,MAAM,IAAI,GAAG,MAAM,EAAE,CAAC,OAAO,CAC3B,GAAG,CAAA;gDACuC,CAC3C,CAAA;QACD,OAAO,IAAI,CAAC,GAAG,CAAC,GAAG,CAAC,EAAE,CAAC,CAAC;YACtB,IAAI,EAAE,GAAG,CAAC,MAAM,CAAW;YAC3B,cAAc,EAAE,GAAG,CAAC,iBAAiB,CAAW;YAChD,QAAQ,EAAE,GAAG,CAAC,UAAU,CAAW;YACnC,OAAO,EAAE,GAAG,CAAC,SAAS,CAAC,IAAI,IAAI;YAC/B,SAAS,EAAE,GAAG,CAAC,aAAa,CAAC,KAAK,IAAI,IAAI,GAAG,CAAC,aAAa,CAAC,KAAK,SAAS,CAAC,CAAC,CAAC,IAAI,IAAI,CAAC,GAAG,CAAC,aAAa,CAAW,CAAC,CAAC,CAAC,CAAC,IAAI;YAC1H,SAAS,EAAE,IAAI,IAAI,CAAC,GAAG,CAAC,aAAa,CAAW,CAAC;SAClD,CAAC,CAAC,CAAA;IACL,CAAC;IAED,KAAK,UAAU,IAAI,CAAC,EAAM,EAAE,QAAiC,EAAE,KAAwB;QACrF,KAAK,MAAM,IAAI,IAAI,QAAQ;YAAE,MAAM,QAAQ,CAAC,EAAE,EAAE,IAAI,CAAC,CAAA;QACrD,MAAM,IAAI,GAAG,IAAI,GAAG,CAAC,QAAQ,CAAC,GAAG,CAAC,IAAI,CAAC,EAAE,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC,CAAA;QACrD,MAAM,OAAO,GAAa,EAAE,CAAA;QAC5B,KAAK,MAAM,IAAI,IAAI,MAAM,aAAa,CAAC,EAAE,CAAC,EAAE,CAAC;YAC3C,IAAI,KAAK,CAAC,QAAQ,CAAC,IAAI,CAAC,IAAI,CAAC,IAAI,CAAC,IAAI,CAAC,GAAG,CAAC,IAAI,CAAC,IAAI,CAAC,EAAE,CAAC;gBACtD,IAAI,MAAM,UAAU,CAAC,EAAE,EAAE,IAAI,CAAC,IAAI,CAAC;oBAAE,OAAO,CAAC,IAAI,CAAC,IAAI,CAAC,IAAI,CAAC,CAAA;YAC9D,CAAC;QACH,CAAC;QACD,OAAO,OAAO,CAAA;IAChB,CAAC;IAED,KAAK,UAAU,IAAI,CAAC,EAAM,EAAE,IAAY;QACtC,MAAM,IAAI,GAAG,MAAM,EAAE,CAAC,OAAO,CAAC,GAAG,CAAA,uDAAuD,IAAI,EAAE,CAAC,CAAA;QAC/F,IAAI,IAAI,CAAC,MAAM,KAAK,CAAC,EAAE,CAAC;YACtB,MAAM,IAAI,KAAK,CACb,iCAAiC,IAAI,QAAQ;gBAC7C,gFAAgF;gBAChF,2DAA2D,CAC5D,CAAA;QACH,CAAC;QACD,OAAO,QAAQ,CAAC,OAAO,CAAC,EAAE,EAAE,EAAE,IAAI,EAAE,IAAI,EAAE,OAAO,EAAE,IAAI,CAAC,CAAC,CAAE,CAAC,SAAS,CAAC,IAAI,EAAE,EAAE,YAAY,EAAE,KAAK,EAAE,CAAC,CAAA;IACtG,CAAC;IAED,2EAA2E;IAC3E,uEAAuE;IACvE,KAAK,UAAU,UAAU,CAAC,EAAM,EAAE,KAAoC;QACpE,OAAO,EAAE,CAAC,WAAW,CAAC,KAAK,EAAE,EAAM,EAAE,EAAE;YACrC,MAAM,MAAM,GAAG,KAAK,KAAK,SAAS;gBAChC,CAAC,CAAC,GAAG,CAAA,gBAAgB,GAAG,CAAC,IAAI,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,CAAC,GAAG,CAAA,GAAG,CAAC,EAAE,CAAC,EAAE,GAAG,CAAA,IAAI,CAAC,GAAG;gBACpE,CAAC,CAAC,GAAG,CAAA,EAAE,CAAA;YACT,MAAM,GAAG,GAAG,MAAM,EAAE,CAAC,OAAO,CAAC,GAAG,CAAA;;;qCAGD,MAAM;;;;OAIpC,CAAC,CAAA;YACF,IAAI,GAAG,CAAC,MAAM,KAAK,CAAC;gBAAE,OAAO,MAAM,CAAA;YAEnC,MAAM,GAAG,GAAG,GAAG,CAAC,CAAC,CAAE,CAAA;YACnB,MAAM,IAAI,GAAG,GAAG,CAAC,MAAM,CAAW,CAAA;YAClC,MAAM,IAAI,GAAG,QAAQ,CAAC,SAAS,CAAC,GAAG,CAAC,iBAAiB,CAAW,CAAC,EAAE,IAAI,IAAI,EAAE,EAAE,GAAG,CAAC,UAAU,CAAW,CAAC,CAAA;YAEzG,MAAM,OAAO,GAAG,MAAM,EAAE,CAAC,OAAO,CAAC,GAAG,CAAA;wBAClB,GAAG,CAAC,GAAG,CAAC,UAAU,CAAC;2BAChB,IAAI;;OAExB,CAAC,CAAA;YACF,IAAI,OAAO,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;gBACvB,MAAM,EAAE,CAAC,OAAO,CAAC,GAAG,CAAA;wDAC4B,IAAI,CAAC,WAAW,EAAE;yBACjD,IAAI;SACpB,CAAC,CAAA;gBACF,OAAO,SAAS,CAAA;YAClB,CAAC;YAED,MAAM,QAAQ,CAAC,OAAO,CAAC,EAAE,EAAE,EAAE,IAAI,EAAE,IAAI,EAAE,OAAO,EAAE,GAAG,CAAC,SAAS,CAAC,IAAI,EAAE,EAAE,YAAY,EAAE,KAAK,EAAE,CAAC,CAAA;YAC9F,MAAM,EAAE,CAAC,OAAO,CAAC,GAAG,CAAA;;;0BAGA,IAAI,CAAC,WAAW,EAAE;;uBAErB,IAAI;OACpB,CAAC,CAAA;YACF,OAAO,OAAO,CAAA;QAChB,CAAC,CAAC,CAAA;IACJ,CAAC;IAED,KAAK,UAAU,IAAI,CAAC,EAAM,EAAE,KAAyB;QACnD,IAAI,KAAK,GAAG,CAAC,CAAA;QACb,iFAAiF;QACjF,SAAS,CAAC;YACR,MAAM,OAAO,GAAG,MAAM,UAAU,CAAC,EAAE,EAAE,KAAK,CAAC,CAAA;YAC3C,IAAI,OAAO,KAAK,MAAM;gBAAE,OAAO,KAAK,CAAA;YACpC,IAAI,OAAO,KAAK,OAAO;gBAAE,KAAK,EAAE,CAAA;QAClC,CAAC;IACH,CAAC;IAED,SAAS,KAAK,CAAC,EAAM,EAAE,IAAuB;QAC5C,IAAI,OAAO;YAAE,OAAM;QACnB,OAAO,GAAG,IAAI,CAAA;QACd,MAAM,UAAU,GAAG,IAAI,EAAE,eAAe,IAAI,MAAM,CAAA;QAClD,IAAI,MAAM,GAAG,KAAK,CAAA;QAClB,cAAc,GAAG,WAAW,CAAC,GAAG,EAAE;YAChC,IAAI,MAAM;gBAAE,OAAM;YAClB,MAAM,GAAG,IAAI,CAAA;YACb,IAAI,CAAC,EAAE,EAAE,IAAI,EAAE,KAAK,CAAC,CAAC,IAAI,CACxB,GAAG,EAAE,GAAG,IAAI,EAAE,OAAO,EAAE,CAAC,EAAE,EAAE,EAAE,IAAI,EAAE,CAAC,CAAA,CAAC,CAAC,EACvC,CAAC,GAAY,EAAE,EAAE;gBACf,IAAI,EAAE,OAAO,EAAE,CAAC,GAAG,CAAC,CAAA;gBACpB,IAAI,EAAE,OAAO,EAAE,CAAC,EAAE,EAAE,EAAE,KAAK,EAAE,KAAK,EAAE,GAAG,YAAY,KAAK,CAAC,CAAC,CAAC,GAAG,CAAC,OAAO,CAAC,CAAC,CAAC,MAAM,CAAC,GAAG,CAAC,EAAE,CAAC,CAAA;YACzF,CAAC,CACF,CAAC,OAAO,CAAC,GAAG,EAAE,GAAG,MAAM,GAAG,KAAK,CAAA,CAAC,CAAC,CAAC,CAAA;QACrC,CAAC,EAAE,UAAU,CAAC,CAAA;IAChB,CAAC;IAED,SAAS,IAAI;QACX,IAAI,CAAC,OAAO,IAAI,cAAc,KAAK,IAAI;YAAE,OAAM;QAC/C,aAAa,CAAC,cAAc,CAAC,CAAA;QAC7B,cAAc,GAAG,IAAI,CAAA;QACrB,OAAO,GAAG,KAAK,CAAA;IACjB,CAAC;IAED,OAAO,EAAE,QAAQ,EAAE,IAAI,EAAE,IAAI,EAAE,IAAI,EAAE,UAAU,EAAE,aAAa,EAAE,KAAK,EAAE,IAAI,EAAE,CAAA;AAC/E,CAAC"}
+{"version":3,"file":"scheduler.js","sourceRoot":"","sources":["../../../src/async/jobs/scheduler.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,GAAG,EAAE,MAAM,sBAAsB,CAAA;AAE1C,OAAO,EAAE,SAAS,EAAE,QAAQ,EAAE,MAAM,WAAW,CAAA;AAqD/C,MAAM,UAAU,eAAe,CAAC,QAAkB,EAAE,UAAkB;IACpE,IAAI,cAAc,GAA0C,IAAI,CAAA;IAChE,IAAI,OAAO,GAAG,KAAK,CAAA;IAEnB,KAAK,UAAU,QAAQ,CAAC,EAAM,EAAE,IAAkB;QAChD,MAAM,MAAM,GAAG,SAAS,CAAC,IAAI,CAAC,IAAI,CAAC,CAAA;QACnC,MAAM,EAAE,GAAG,IAAI,CAAC,QAAQ,IAAI,KAAK,CAAA;QACjC,MAAM,SAAS,GAAG,QAAQ,CAAC,MAAM,EAAE,IAAI,IAAI,EAAE,EAAE,EAAE,CAAC,CAAA;QAClD,MAAM,WAAW,GAAG,IAAI,CAAC,OAAO,KAAK,SAAS,CAAC,CAAC,CAAC,IAAI,CAAC,SAAS,CAAC,IAAI,CAAC,OAAO,CAAC,CAAC,CAAC,CAAC,IAAI,CAAA;QAEpF,MAAM,EAAE,CAAC,OAAO,CAAC,GAAG,CAAA;;gBAER,IAAI,CAAC,IAAI,KAAK,IAAI,CAAC,IAAI,KAAK,EAAE,KAAK,WAAW,KAAK,IAAI,CAAC,CAAC,CAAC,GAAG,CAAA,GAAG,WAAW,SAAS,CAAC,CAAC,CAAC,GAAG,CAAA,MAAM,KAAK,SAAS,CAAC,WAAW,EAAE;;;;;;;;;;;;KAYvI,CAAC,CAAA;IACJ,CAAC;IAED,KAAK,UAAU,UAAU,CAAC,EAAM,EAAE,IAAY;QAC5C,MAAM,IAAI,GAAG,MAAM,EAAE,CAAC,OAAO,CAC3B,GAAG,CAAA,+CAA+C,IAAI,iBAAiB,CACxE,CAAA;QACD,OAAO,IAAI,CAAC,MAAM,GAAG,CAAC,CAAA;IACxB,CAAC;IAED,KAAK,UAAU,aAAa,CAAC,EAAM;QACjC,MAAM,IAAI,GAAG,MAAM,EAAE,CAAC,OAAO,CAC3B,GAAG,CAAA;gDACuC,CAC3C,CAAA;QACD,OAAO,IAAI,CAAC,GAAG,CAAC,GAAG,CAAC,EAAE,CAAC,CAAC;YACtB,IAAI,EAAE,GAAG,CAAC,MAAM,CAAW;YAC3B,cAAc,EAAE,GAAG,CAAC,iBAAiB,CAAW;YAChD,QAAQ,EAAE,GAAG,CAAC,UAAU,CAAW;YACnC,OAAO,EAAE,GAAG,CAAC,SAAS,CAAC,IAAI,IAAI;YAC/B,SAAS,EAAE,GAAG,CAAC,aAAa,CAAC,KAAK,IAAI,IAAI,GAAG,CAAC,aAAa,CAAC,KAAK,SAAS,CAAC,CAAC,CAAC,IAAI,IAAI,CAAC,GAAG,CAAC,aAAa,CAAW,CAAC,CAAC,CAAC,CAAC,IAAI;YAC1H,SAAS,EAAE,IAAI,IAAI,CAAC,GAAG,CAAC,aAAa,CAAW,CAAC;SAClD,CAAC,CAAC,CAAA;IACL,CAAC;IAED,KAAK,UAAU,IAAI,CAAC,EAAM,EAAE,QAAiC,EAAE,KAAwB;QACrF,KAAK,MAAM,IAAI,IAAI,QAAQ;YAAE,MAAM,QAAQ,CAAC,EAAE,EAAE,IAAI,CAAC,CAAA;QACrD,MAAM,IAAI,GAAG,IAAI,GAAG,CAAC,QAAQ,CAAC,GAAG,CAAC,IAAI,CAAC,EAAE,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC,CAAA;QACrD,MAAM,OAAO,GAAa,EAAE,CAAA;QAC5B,KAAK,MAAM,IAAI,IAAI,MAAM,aAAa,CAAC,EAAE,CAAC,EAAE,CAAC;YAC3C,IAAI,KAAK,CAAC,QAAQ,CAAC,IAAI,CAAC,IAAI,CAAC,IAAI,CAAC,IAAI,CAAC,GAAG,CAAC,IAAI,CAAC,IAAI,CAAC,EAAE,CAAC;gBACtD,IAAI,MAAM,UAAU,CAAC,EAAE,EAAE,IAAI,CAAC,IAAI,CAAC;oBAAE,OAAO,CAAC,IAAI,CAAC,IAAI,CAAC,IAAI,CAAC,CAAA;YAC9D,CAAC;QACH,CAAC;QACD,OAAO,OAAO,CAAA;IAChB,CAAC;IAED,KAAK,UAAU,IAAI,CAAC,EAAM,EAAE,IAAY;QACtC,MAAM,IAAI,GAAG,MAAM,EAAE,CAAC,OAAO,CAAC,GAAG,CAAA,uDAAuD,IAAI,EAAE,CAAC,CAAA;QAC/F,IAAI,IAAI,CAAC,MAAM,KAAK,CAAC,EAAE,CAAC;YACtB,MAAM,IAAI,KAAK,CACb,iCAAiC,IAAI,QAAQ;gBAC7C,gFAAgF;gBAChF,2DAA2D,CAC5D,CAAA;QACH,CAAC;QACD,OAAO,QAAQ,CAAC,OAAO,CAAC,EAAE,EAAE,EAAE,IAAI,EAAE,IAAI,EAAE,OAAO,EAAE,IAAI,CAAC,CAAC,CAAE,CAAC,SAAS,CAAC,IAAI,EAAE,EAAE,YAAY,EAAE,KAAK,EAAE,CAAC,CAAA;IACtG,CAAC;IAED,2EAA2E;IAC3E,uEAAuE;IACvE,KAAK,UAAU,UAAU,CAAC,EAAM,EAAE,KAAoC;QACpE,OAAO,EAAE,CAAC,WAAW,CAAC,KAAK,EAAE,EAAM,EAAE,EAAE;YACrC,MAAM,MAAM,GAAG,KAAK,KAAK,SAAS;gBAChC,CAAC,CAAC,GAAG,CAAA,YAAY,GAAG,CAAC,MAAM,CAAC,KAAK,CAAC,EAAE;gBACpC,CAAC,CAAC,GAAG,CAAA,EAAE,CAAA;YACT,MAAM,GAAG,GAAG,MAAM,EAAE,CAAC,OAAO,CAAC,GAAG,CAAA;;;qCAGD,MAAM;;;;OAIpC,CAAC,CAAA;YACF,IAAI,GAAG,CAAC,MAAM,KAAK,CAAC;gBAAE,OAAO,MAAM,CAAA;YAEnC,MAAM,GAAG,GAAG,GAAG,CAAC,CAAC,CAAE,CAAA;YACnB,MAAM,IAAI,GAAG,GAAG,CAAC,MAAM,CAAW,CAAA;YAClC,MAAM,IAAI,GAAG,QAAQ,CAAC,SAAS,CAAC,GAAG,CAAC,iBAAiB,CAAW,CAAC,EAAE,IAAI,IAAI,EAAE,EAAE,GAAG,CAAC,UAAU,CAAW,CAAC,CAAA;YAEzG,MAAM,OAAO,GAAG,MAAM,EAAE,CAAC,OAAO,CAAC,GAAG,CAAA;wBAClB,GAAG,CAAC,GAAG,CAAC,UAAU,CAAC;2BAChB,IAAI;;OAExB,CAAC,CAAA;YACF,IAAI,OAAO,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;gBACvB,MAAM,EAAE,CAAC,OAAO,CAAC,GAAG,CAAA;wDAC4B,IAAI,CAAC,WAAW,EAAE;yBACjD,IAAI;SACpB,CAAC,CAAA;gBACF,OAAO,SAAS,CAAA;YAClB,CAAC;YAED,MAAM,QAAQ,CAAC,OAAO,CAAC,EAAE,EAAE,EAAE,IAAI,EAAE,IAAI,EAAE,OAAO,EAAE,GAAG,CAAC,SAAS,CAAC,IAAI,EAAE,EAAE,YAAY,EAAE,KAAK,EAAE,CAAC,CAAA;YAC9F,MAAM,EAAE,CAAC,OAAO,CAAC,GAAG,CAAA;;;0BAGA,IAAI,CAAC,WAAW,EAAE;;uBAErB,IAAI;OACpB,CAAC,CAAA;YACF,OAAO,OAAO,CAAA;QAChB,CAAC,CAAC,CAAA;IACJ,CAAC;IAED,KAAK,UAAU,IAAI,CAAC,EAAM,EAAE,KAAyB;QACnD,IAAI,KAAK,GAAG,CAAC,CAAA;QACb,iFAAiF;QACjF,SAAS,CAAC;YACR,MAAM,OAAO,GAAG,MAAM,UAAU,CAAC,EAAE,EAAE,KAAK,CAAC,CAAA;YAC3C,IAAI,OAAO,KAAK,MAAM;gBAAE,OAAO,KAAK,CAAA;YACpC,IAAI,OAAO,KAAK,OAAO;gBAAE,KAAK,EAAE,CAAA;QAClC,CAAC;IACH,CAAC;IAED,SAAS,KAAK,CAAC,EAAM,EAAE,IAAuB;QAC5C,IAAI,OAAO;YAAE,OAAM;QACnB,OAAO,GAAG,IAAI,CAAA;QACd,MAAM,UAAU,GAAG,IAAI,EAAE,eAAe,IAAI,MAAM,CAAA;QAClD,IAAI,MAAM,GAAG,KAAK,CAAA;QAClB,cAAc,GAAG,WAAW,CAAC,GAAG,EAAE;YAChC,IAAI,MAAM;gBAAE,OAAM;YAClB,MAAM,GAAG,IAAI,CAAA;YACb,IAAI,CAAC,EAAE,EAAE,IAAI,EAAE,KAAK,CAAC,CAAC,IAAI,CACxB,GAAG,EAAE,GAAG,IAAI,EAAE,OAAO,EAAE,CAAC,EAAE,EAAE,EAAE,IAAI,EAAE,CAAC,CAAA,CAAC,CAAC,EACvC,CAAC,GAAY,EAAE,EAAE;gBACf,IAAI,EAAE,OAAO,EAAE,CAAC,GAAG,CAAC,CAAA;gBACpB,IAAI,EAAE,OAAO,EAAE,CAAC,EAAE,EAAE,EAAE,KAAK,EAAE,KAAK,EAAE,GAAG,YAAY,KAAK,CAAC,CAAC,CAAC,GAAG,CAAC,OAAO,CAAC,CAAC,CAAC,MAAM,CAAC,GAAG,CAAC,EAAE,CAAC,CAAA;YACzF,CAAC,CACF,CAAC,OAAO,CAAC,GAAG,EAAE,GAAG,MAAM,GAAG,KAAK,CAAA,CAAC,CAAC,CAAC,CAAA;QACrC,CAAC,EAAE,UAAU,CAAC,CAAA;IAChB,CAAC;IAED,SAAS,IAAI;QACX,IAAI,CAAC,OAAO,IAAI,cAAc,KAAK,IAAI;YAAE,OAAM;QAC/C,aAAa,CAAC,cAAc,CAAC,CAAA;QAC7B,cAAc,GAAG,IAAI,CAAA;QACrB,OAAO,GAAG,KAAK,CAAA;IACjB,CAAC;IAED,OAAO,EAAE,QAAQ,EAAE,IAAI,EAAE,IAAI,EAAE,IAAI,EAAE,UAAU,EAAE,aAAa,EAAE,KAAK,EAAE,IAAI,EAAE,CAAA;AAC/E,CAAC"}

package/dist/async/steps/graph.js

@@ -258,7 +258,7 @@ export function defineGraph(config) {
         await tx.execute(sql `
       UPDATE ${sql.raw(table)} SET status = 'cancelled', completed_at = now(), claim_token = NULL
        WHERE id IN (SELECT id FROM ${sql.raw(table)}
-                     WHERE id IN (${sql.join(jobIds.map(id => sql `${id}::uuid`), sql `, `)}) AND status = 'pending'
+                     WHERE id ${sql.inList(jobIds, 'uuid')} AND status = 'pending'
                      FOR UPDATE SKIP LOCKED)`);
     }
     async function lockRun(tx, runId) {
@@ -304,7 +304,7 @@ export function defineGraph(config) {
             return out;
         const rows = await tx.execute(sql `
       SELECT id::text, value, value_hash FROM ${sql.raw(RESULT)}
-       WHERE id IN (${sql.join(ids.map(id => sql `${id}::uuid`), sql `, `)})`);
+       WHERE id ${sql.inList(ids, 'uuid')}`);
         for (const r of rows)
             out.set(r['id'], { value: r['value'], hash: r['value_hash'] });
         return out;
@@ -781,7 +781,7 @@ export function defineGraph(config) {
             throw new Error(`[pipework] ${graph}.ended: limit must be a positive integer.\n`);
         const only = tenant === null ? sql `` : sql ` AND tenant_id = ${tenant}::uuid`;
         const byIds = opts?.ids === undefined ? sql `` : opts.ids.length === 0 ? sql ` AND false`
-            : sql ` AND id IN (${sql.join(opts.ids.map(i => sql `${i}::uuid`), sql `, `)})`;
+            : sql ` AND id ${sql.inList(opts.ids, 'uuid')}`;
         const before = opts?.finishedBefore === undefined ? sql `` : sql ` AND finished_at < ${opts.finishedBefore.toISOString()}::timestamptz`;
         const rows = await inTenantTx(db, tenant, tx => tx.execute(sql `
       SELECT id::text, tenant_id::text, item, status, finished_at, notified FROM ${sql.raw(RUN)}
@@ -877,9 +877,9 @@ export function defineGraph(config) {
         SELECT id::text FROM ${sql.raw(RUN)}
          WHERE graph = ${graph} AND status <> 'running' AND finished_at < ${cutoff}::timestamptz${only}`);
             if (old.length > 0) {
-                const ids = sql.join(old.map(r => sql `${r['id']}::uuid`), sql `, `);
-                await tx.execute(sql `DELETE FROM ${sql.raw(TASK)} WHERE run_id IN (${ids})`);
-                await tx.execute(sql `DELETE FROM ${sql.raw(RUN)} WHERE id IN (${ids})`);
+                const ids = sql.inList(old.map(r => r['id']), 'uuid');
+                await tx.execute(sql `DELETE FROM ${sql.raw(TASK)} WHERE run_id ${ids}`);
+                await tx.execute(sql `DELETE FROM ${sql.raw(RUN)} WHERE id ${ids}`);
             }
             const rows = await tx.execute(sql `
         DELETE FROM ${sql.raw(RESULT)} WHERE graph = ${graph} AND created_at < ${cutoff}::timestamptz${only} RETURNING id`);
@@ -938,9 +938,9 @@ export function defineGraph(config) {
             }
             let tasks = 0;
             if (runs.length > 0) {
-                const ids = sql.join(runs.map(r => sql `${r['id']}::uuid`), sql `, `);
-                tasks = (await tx.execute(sql `DELETE FROM ${sql.raw(TASK)} WHERE run_id IN (${ids}) RETURNING id`)).length;
-                await tx.execute(sql `DELETE FROM ${sql.raw(RUN)} WHERE id IN (${ids})`);
+                const ids = sql.inList(runs.map(r => r['id']), 'uuid');
+                tasks = (await tx.execute(sql `DELETE FROM ${sql.raw(TASK)} WHERE run_id ${ids} RETURNING id`)).length;
+                await tx.execute(sql `DELETE FROM ${sql.raw(RUN)} WHERE id ${ids}`);
             }
             const gone = await tx.execute(sql `
         DELETE FROM ${sql.raw(RESULT)} WHERE graph = ${graph} AND item = ${item} AND tenant_id = ${tenant}::uuid RETURNING id`);