workflow 5.0.0-beta.5 → 5.0.0-beta.51
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +68 -23
- package/dist/api-workflow.d.ts +1 -1
- package/dist/api-workflow.d.ts.map +1 -1
- package/dist/api-workflow.js +1 -1
- package/dist/api.d.ts +3 -3
- package/dist/api.d.ts.map +1 -1
- package/dist/api.js +5 -7
- package/dist/index.d.ts +1 -0
- package/dist/index.d.ts.map +1 -1
- package/dist/index.js +6 -1
- package/dist/internal/builtins.d.ts +20 -3
- package/dist/internal/builtins.d.ts.map +1 -1
- package/dist/internal/builtins.js +68 -4
- package/dist/internal/errors.d.ts +1 -1
- package/dist/internal/errors.d.ts.map +1 -1
- package/dist/internal/errors.js +2 -2
- package/dist/nest-builder.d.ts +2 -0
- package/dist/nest-builder.d.ts.map +1 -0
- package/dist/nest-builder.js +2 -0
- package/dist/nest-vercel-builder.d.ts +2 -0
- package/dist/nest-vercel-builder.d.ts.map +1 -0
- package/dist/nest-vercel-builder.js +2 -0
- package/dist/observability.d.ts +1 -1
- package/dist/observability.js +2 -2
- package/dist/runtime.d.ts +2 -1
- package/dist/runtime.d.ts.map +1 -1
- package/dist/runtime.js +4 -1
- package/docs/ai/chat-session-modeling.mdx +176 -422
- package/docs/ai/defining-tools.mdx +6 -7
- package/docs/ai/human-in-the-loop.mdx +11 -11
- package/docs/ai/index.mdx +71 -75
- package/docs/ai/message-queueing.mdx +71 -110
- package/docs/ai/meta.json +1 -0
- package/docs/ai/resumable-streams.mdx +40 -28
- package/docs/ai/sleep-and-delays.mdx +10 -10
- package/docs/ai/streaming-updates-from-tools.mdx +6 -6
- package/docs/api-reference/index.mdx +25 -1
- package/docs/api-reference/meta.json +8 -0
- package/docs/api-reference/vitest/index.mdx +9 -15
- package/docs/api-reference/workflow/create-hook.mdx +89 -10
- package/docs/api-reference/workflow/create-webhook.mdx +16 -15
- package/docs/api-reference/workflow/define-hook.mdx +35 -33
- package/docs/api-reference/workflow/fatal-error.mdx +30 -8
- package/docs/api-reference/workflow/fetch.mdx +14 -10
- package/docs/api-reference/workflow/get-step-metadata.mdx +2 -2
- package/docs/api-reference/workflow/get-workflow-metadata.mdx +3 -3
- package/docs/api-reference/workflow/get-writable.mdx +7 -7
- package/docs/api-reference/workflow/index.mdx +4 -1
- package/docs/api-reference/workflow/retryable-error.mdx +1 -1
- package/docs/api-reference/workflow/set-attributes.mdx +61 -0
- package/docs/api-reference/workflow/sleep.mdx +4 -4
- package/docs/api-reference/workflow-ai/durable-agent.mdx +63 -101
- package/docs/api-reference/workflow-ai/index.mdx +5 -5
- package/docs/api-reference/workflow-ai/workflow-chat-transport.mdx +67 -24
- package/docs/api-reference/workflow-api/get-hook-by-token.mdx +26 -12
- package/docs/api-reference/workflow-api/get-run.mdx +43 -8
- package/docs/api-reference/workflow-api/index.mdx +6 -10
- package/docs/api-reference/workflow-api/resume-hook.mdx +73 -12
- package/docs/api-reference/workflow-api/resume-webhook.mdx +11 -9
- package/docs/api-reference/workflow-api/start.mdx +60 -13
- package/docs/api-reference/workflow-astro/index.mdx +18 -0
- package/docs/api-reference/workflow-astro/meta.json +4 -0
- package/docs/api-reference/workflow-astro/workflow.mdx +45 -0
- package/docs/api-reference/workflow-errors/entity-conflict-error.mdx +4 -4
- package/docs/api-reference/workflow-errors/hook-conflict-error.mdx +60 -0
- package/docs/api-reference/workflow-errors/hook-not-found-error.mdx +8 -8
- package/docs/api-reference/workflow-errors/index.mdx +88 -0
- package/docs/api-reference/workflow-errors/meta.json +6 -0
- package/docs/api-reference/workflow-errors/precondition-failed-error.mdx +68 -0
- package/docs/api-reference/workflow-errors/run-expired-error.mdx +2 -2
- package/docs/api-reference/workflow-errors/run-not-supported-error.mdx +58 -0
- package/docs/api-reference/workflow-errors/step-not-registered-error.mdx +5 -5
- package/docs/api-reference/workflow-errors/throttle-error.mdx +2 -2
- package/docs/api-reference/workflow-errors/too-early-error.mdx +2 -2
- package/docs/api-reference/workflow-errors/workflow-error.mdx +52 -0
- package/docs/api-reference/workflow-errors/workflow-not-registered-error.mdx +5 -6
- package/docs/api-reference/workflow-errors/workflow-run-cancelled-error.mdx +6 -6
- package/docs/api-reference/workflow-errors/workflow-run-failed-error.mdx +5 -5
- package/docs/api-reference/workflow-errors/workflow-run-not-completed-error.mdx +58 -0
- package/docs/api-reference/workflow-errors/workflow-run-not-found-error.mdx +4 -4
- package/docs/api-reference/workflow-errors/workflow-runtime-error.mdx +58 -0
- package/docs/api-reference/workflow-errors/workflow-world-error.mdx +8 -8
- package/docs/api-reference/workflow-globals.mdx +14 -10
- package/docs/api-reference/workflow-nest/configure-workflow-controller.mdx +33 -0
- package/docs/api-reference/workflow-nest/index.mdx +31 -0
- package/docs/api-reference/workflow-nest/meta.json +9 -0
- package/docs/api-reference/workflow-nest/nest-local-builder.mdx +64 -0
- package/docs/api-reference/workflow-nest/workflow-controller.mdx +40 -0
- package/docs/api-reference/workflow-nest/workflow-module.mdx +74 -0
- package/docs/api-reference/workflow-next/with-workflow.mdx +39 -17
- package/docs/api-reference/workflow-nitro/index.mdx +60 -0
- package/docs/api-reference/workflow-nuxt/index.mdx +48 -0
- package/docs/api-reference/workflow-observability/hydrate-data.mdx +35 -0
- package/docs/api-reference/workflow-observability/hydrate-resource-io.mdx +62 -0
- package/docs/api-reference/workflow-observability/index.mdx +62 -0
- package/docs/api-reference/workflow-observability/meta.json +11 -0
- package/docs/api-reference/workflow-observability/observability-revivers.mdx +50 -0
- package/docs/api-reference/workflow-observability/parse-class-name.mdx +41 -0
- package/docs/api-reference/workflow-observability/parse-step-name.mdx +40 -0
- package/docs/api-reference/workflow-observability/parse-workflow-name.mdx +55 -0
- package/docs/api-reference/workflow-runtime/create-world.mdx +39 -0
- package/docs/api-reference/workflow-runtime/get-world-handlers.mdx +44 -0
- package/docs/api-reference/{workflow-api → workflow-runtime}/get-world.mdx +11 -14
- package/docs/api-reference/workflow-runtime/health-check.mdx +50 -0
- package/docs/api-reference/workflow-runtime/index.mdx +41 -0
- package/docs/api-reference/workflow-runtime/meta.json +12 -0
- package/docs/api-reference/workflow-runtime/set-world.mdx +51 -0
- package/docs/api-reference/workflow-runtime/workflow-entrypoint.mdx +43 -0
- package/docs/api-reference/workflow-runtime/world/analytics.mdx +315 -0
- package/docs/api-reference/workflow-runtime/world/index.mdx +60 -0
- package/docs/api-reference/workflow-runtime/world/meta.json +4 -0
- package/docs/api-reference/workflow-runtime/world/queue.mdx +88 -0
- package/docs/api-reference/{workflow-api → workflow-runtime}/world/storage.mdx +98 -34
- package/docs/api-reference/{workflow-api → workflow-runtime}/world/streams.mdx +8 -8
- package/docs/api-reference/workflow-serde/index.mdx +1 -2
- package/docs/api-reference/workflow-serde/workflow-deserialize.mdx +3 -4
- package/docs/api-reference/workflow-serde/workflow-serialize.mdx +8 -8
- package/docs/api-reference/workflow-sveltekit/index.mdx +18 -0
- package/docs/api-reference/workflow-sveltekit/meta.json +4 -0
- package/docs/api-reference/workflow-sveltekit/workflow-plugin.mdx +42 -0
- package/docs/api-reference/workflow-vite/index.mdx +18 -0
- package/docs/api-reference/workflow-vite/meta.json +4 -0
- package/docs/api-reference/workflow-vite/workflow.mdx +48 -0
- package/docs/changelog/attributes-mvp.mdx +380 -0
- package/docs/changelog/batched-event-writes.mdx +79 -0
- package/docs/changelog/eager-processing.mdx +110 -436
- package/docs/changelog/index.mdx +4 -2
- package/docs/changelog/lazy-event-creation.md +127 -0
- package/docs/changelog/lazy-hook-resume.mdx +78 -0
- package/docs/changelog/meta.json +11 -1
- package/docs/changelog/resilient-resume.mdx +32 -0
- package/docs/changelog/resilient-start.mdx +33 -285
- package/docs/changelog/step-message-ownership.mdx +360 -0
- package/docs/changelog/turbo-mode.md +87 -0
- package/docs/comparisons/index.mdx +66 -0
- package/docs/comparisons/meta.json +11 -0
- package/docs/comparisons/workflow-sdk-vs-aws-agentcore.mdx +55 -0
- package/docs/comparisons/workflow-sdk-vs-aws-step-functions.mdx +111 -0
- package/docs/comparisons/workflow-sdk-vs-cloudflare-workflows.mdx +71 -0
- package/docs/comparisons/workflow-sdk-vs-inngest.mdx +102 -0
- package/docs/comparisons/workflow-sdk-vs-temporal.mdx +123 -0
- package/docs/comparisons/workflow-sdk-vs-trigger-dev.mdx +104 -0
- package/docs/configuration/build-and-diagnostics.mdx +70 -0
- package/docs/configuration/cli-and-web-ui.mdx +241 -0
- package/docs/configuration/framework-options.mdx +165 -0
- package/docs/configuration/index.mdx +32 -0
- package/docs/configuration/meta.json +12 -0
- package/docs/configuration/runtime-tuning.mdx +381 -0
- package/docs/configuration/worlds.mdx +313 -0
- package/docs/cookbook/advanced/child-workflows.mdx +211 -264
- package/docs/cookbook/advanced/meta.json +6 -1
- package/docs/cookbook/advanced/publishing-libraries.mdx +65 -56
- package/docs/cookbook/advanced/serializable-steps.mdx +48 -68
- package/docs/cookbook/advanced/upgrading-workflows.mdx +199 -0
- package/docs/cookbook/agent-patterns/agent-cancellation.mdx +78 -60
- package/docs/cookbook/agent-patterns/durable-agent.mdx +23 -131
- package/docs/cookbook/agent-patterns/human-in-the-loop.mdx +180 -195
- package/docs/cookbook/common-patterns/batching.mdx +18 -14
- package/docs/cookbook/common-patterns/idempotency.mdx +41 -53
- package/docs/cookbook/common-patterns/rate-limiting.mdx +8 -4
- package/docs/cookbook/common-patterns/saga.mdx +23 -19
- package/docs/cookbook/common-patterns/scheduling.mdx +34 -22
- package/docs/cookbook/common-patterns/sequential-and-parallel.mdx +29 -25
- package/docs/cookbook/common-patterns/timeouts.mdx +26 -21
- package/docs/cookbook/common-patterns/webhooks.mdx +10 -6
- package/docs/cookbook/common-patterns/workflow-composition.mdx +30 -27
- package/docs/cookbook/index.mdx +22 -21
- package/docs/cookbook/integrations/ai-sdk.mdx +86 -48
- package/docs/cookbook/integrations/chat-sdk.mdx +50 -33
- package/docs/cookbook/integrations/sandbox.mdx +62 -45
- package/docs/deploying.mdx +95 -0
- package/docs/errors/abort-signal-timeout-in-workflow.mdx +16 -12
- package/docs/errors/corrupted-event-log.mdx +39 -18
- package/docs/errors/deployment-mismatch.mdx +71 -0
- package/docs/errors/fetch-in-workflow.mdx +15 -14
- package/docs/errors/hook-conflict.mdx +69 -13
- package/docs/errors/index.mdx +2 -36
- package/docs/errors/node-js-module-in-workflow.mdx +9 -5
- package/docs/errors/replay-divergence.mdx +27 -0
- package/docs/errors/run-expired.mdx +85 -0
- package/docs/errors/runtime-decryption-failed.mdx +77 -0
- package/docs/errors/serialization-failed.mdx +44 -12
- package/docs/errors/start-invalid-workflow-function.mdx +9 -5
- package/docs/errors/step-executed-multiple-times.mdx +23 -0
- package/docs/errors/step-not-registered.mdx +6 -6
- package/docs/errors/timeout-in-workflow.mdx +12 -8
- package/docs/errors/webhook-invalid-respond-with-value.mdx +18 -18
- package/docs/errors/webhook-response-not-sent.mdx +20 -16
- package/docs/errors/workflow-not-registered.mdx +5 -5
- package/docs/foundations/cancellation.mdx +31 -32
- package/docs/foundations/errors-and-retries.mdx +42 -11
- package/docs/foundations/hooks.mdx +64 -35
- package/docs/foundations/idempotency.mdx +244 -12
- package/docs/foundations/index.mdx +1 -23
- package/docs/foundations/meta.json +2 -1
- package/docs/foundations/serialization.mdx +21 -22
- package/docs/foundations/starting-workflows.mdx +106 -30
- package/docs/foundations/streaming.mdx +108 -60
- package/docs/foundations/versioning.mdx +263 -0
- package/docs/foundations/workflows-and-steps.mdx +9 -9
- package/docs/getting-started/astro.mdx +22 -18
- package/docs/getting-started/express.mdx +15 -11
- package/docs/getting-started/fastify.mdx +15 -11
- package/docs/getting-started/hono.mdx +15 -11
- package/docs/getting-started/index.mdx +10 -3
- package/docs/getting-started/meta.json +3 -1
- package/docs/getting-started/nestjs.mdx +87 -20
- package/docs/getting-started/next.mdx +22 -16
- package/docs/getting-started/nitro.mdx +22 -18
- package/docs/getting-started/nuxt.mdx +15 -11
- package/docs/getting-started/python.mdx +190 -41
- package/docs/getting-started/react-router/index.mdx +33 -0
- package/docs/getting-started/react-router/meta.json +5 -0
- package/docs/getting-started/react-router/v7.mdx +237 -0
- package/docs/getting-started/react-router/v8.mdx +232 -0
- package/docs/getting-started/sveltekit.mdx +20 -16
- package/docs/getting-started/tanstack-start.mdx +17 -13
- package/docs/getting-started/vite.mdx +15 -11
- package/docs/how-it-works/cancellation.mdx +63 -63
- package/docs/how-it-works/code-transform.mdx +83 -67
- package/docs/how-it-works/encryption.mdx +30 -26
- package/docs/how-it-works/event-sourcing.mdx +125 -34
- package/docs/how-it-works/framework-integrations.mdx +96 -337
- package/docs/how-it-works/understanding-directives.mdx +22 -22
- package/docs/internal/index.mdx +6 -4
- package/docs/internal/meta.json +6 -1
- package/docs/internal/nitro-native-build.mdx +38 -0
- package/docs/internal/nitro-web-ui.mdx +24 -0
- package/docs/internal/serializable-abort-controller.mdx +7 -7
- package/docs/meta.json +3 -2
- package/docs/observability/attributes.mdx +134 -0
- package/docs/observability/index.mdx +32 -10
- package/docs/observability/meta.json +1 -1
- package/docs/observability/retention.mdx +95 -0
- package/docs/observability/tracing.mdx +124 -0
- package/docs/testing/index.mdx +36 -36
- package/docs/testing/server-based.mdx +10 -10
- package/docs/whats-new.mdx +186 -0
- package/package.json +17 -14
- package/docs/api-reference/workflow-api/world/index.mdx +0 -58
- package/docs/api-reference/workflow-api/world/meta.json +0 -4
- package/docs/api-reference/workflow-api/world/observability.mdx +0 -164
- package/docs/api-reference/workflow-api/world/queue.mdx +0 -86
- package/docs/deploying/building-a-world.mdx +0 -251
- package/docs/deploying/index.mdx +0 -95
- package/docs/deploying/meta.json +0 -4
- package/docs/deploying/world/local-world.mdx +0 -84
- package/docs/deploying/world/meta.json +0 -4
- package/docs/deploying/world/postgres-world.mdx +0 -224
- package/docs/deploying/world/vercel-world.mdx +0 -179
- package/docs/migration-guides/index.mdx +0 -34
- package/docs/migration-guides/meta.json +0 -9
- package/docs/migration-guides/migrating-from-aws-step-functions.mdx +0 -363
- package/docs/migration-guides/migrating-from-inngest.mdx +0 -314
- package/docs/migration-guides/migrating-from-temporal.mdx +0 -318
- package/docs/migration-guides/migrating-from-trigger-dev.mdx +0 -337
|
@@ -1,45 +1,29 @@
|
|
|
1
1
|
---
|
|
2
2
|
title: Idempotency
|
|
3
|
-
description:
|
|
3
|
+
description: Make step retries safe and coordinate duplicate workflow starts with hook tokens.
|
|
4
4
|
type: guide
|
|
5
|
-
summary: Use step IDs
|
|
5
|
+
summary: Use step IDs for retry-safe external calls, and use deterministic hook tokens when duplicate requests must route to one active workflow.
|
|
6
6
|
---
|
|
7
7
|
|
|
8
|
-
|
|
8
|
+
<CopyPrompt
|
|
9
|
+
text="Make this workflow's side effects idempotent. For retry-safe external calls, read the deterministic step ID inside the "use step" function with `getStepMetadata()` from `workflow` and pass `stepId` as the idempotency key to the external API (for example Stripe's `Idempotency-Key` header) so step retries deduplicate. For duplicate workflow starts, derive a deterministic hook token from the domain key (for example `order:${orderId}`): in the API route, look up the active hook with `getHookByToken(token)` from `workflow/api` (catching `HookNotFoundError` from `workflow/errors`) and reuse its `runId`, otherwise call `start(...)`; inside the workflow, create the hook with the same token and check `await hook.getConflict()` before duplicate-sensitive work. Verify retried steps deduplicate, duplicate starts reuse the active run, and conflicts are handled."
|
|
10
|
+
/>
|
|
11
|
+
|
|
12
|
+
Use idempotency when a retry or duplicate request should not repeat the underlying work. In Workflow, there are two common patterns: use the step ID for retry-safe external calls, and use hook tokens to coordinate duplicate workflow starts.
|
|
9
13
|
|
|
10
14
|
## When to use this
|
|
11
15
|
|
|
12
|
-
-
|
|
13
|
-
-
|
|
14
|
-
- Creating records in external systems where duplicates are harmful
|
|
15
|
-
- Any step that has side effects in systems you don't control
|
|
16
|
+
- A step charges a payment, sends an email, enqueues work, or creates an external record.
|
|
17
|
+
- A route may receive duplicate requests that should map to one active workflow run.
|
|
16
18
|
|
|
17
|
-
##
|
|
19
|
+
## Step idempotency
|
|
18
20
|
|
|
19
21
|
Every step has a unique, deterministic `stepId` available via `getStepMetadata()`. Pass this as the idempotency key to external APIs:
|
|
20
22
|
|
|
21
23
|
```typescript
|
|
22
24
|
import { getStepMetadata } from "workflow";
|
|
23
25
|
|
|
24
|
-
|
|
25
|
-
declare function sendReceipt(customerId: string, chargeId: string): Promise<void>; // @setup
|
|
26
|
-
|
|
27
|
-
export async function chargeCustomer(customerId: string, amount: number) {
|
|
28
|
-
"use workflow";
|
|
29
|
-
|
|
30
|
-
const charge = await createCharge(customerId, amount);
|
|
31
|
-
await sendReceipt(customerId, charge.id);
|
|
32
|
-
|
|
33
|
-
return { customerId, chargeId: charge.id, status: "completed" };
|
|
34
|
-
}
|
|
35
|
-
```
|
|
36
|
-
|
|
37
|
-
### Step function with idempotency key
|
|
38
|
-
|
|
39
|
-
```typescript
|
|
40
|
-
import { getStepMetadata } from "workflow";
|
|
41
|
-
|
|
42
|
-
async function createCharge(
|
|
26
|
+
export async function createCharge(
|
|
43
27
|
customerId: string,
|
|
44
28
|
amount: number
|
|
45
29
|
): Promise<{ id: string }> {
|
|
@@ -69,39 +53,43 @@ async function createCharge(
|
|
|
69
53
|
|
|
70
54
|
return charge.json();
|
|
71
55
|
}
|
|
72
|
-
|
|
73
|
-
async function sendReceipt(customerId: string, chargeId: string): Promise<void> {
|
|
74
|
-
"use step";
|
|
75
|
-
|
|
76
|
-
const { stepId } = getStepMetadata();
|
|
77
|
-
|
|
78
|
-
await fetch("https://api.example.com/receipts", {
|
|
79
|
-
method: "POST",
|
|
80
|
-
headers: { "Idempotency-Key": stepId },
|
|
81
|
-
body: JSON.stringify({ customerId, chargeId }),
|
|
82
|
-
});
|
|
83
|
-
}
|
|
84
56
|
```
|
|
85
57
|
|
|
86
|
-
|
|
58
|
+
See [Step Idempotency](/docs/foundations/idempotency#step-idempotency) for why `stepId` is stable across retries and how to think about external API conflicts.
|
|
87
59
|
|
|
88
|
-
|
|
60
|
+
## Run idempotency
|
|
89
61
|
|
|
90
|
-
-
|
|
91
|
-
- **Don't use check-then-act patterns** like "read a flag, then write if not set" -- another run could read the same flag between your read and write.
|
|
62
|
+
For duplicate workflow-start requests, derive a hook token from your domain key. You can avoid obvious duplicate starts by checking whether an active hook already owns that token before calling `start()`:
|
|
92
63
|
|
|
93
|
-
|
|
64
|
+
```typescript
|
|
65
|
+
import { getHookByToken, start } from "workflow/api";
|
|
66
|
+
import { HookNotFoundError } from "workflow/errors";
|
|
67
|
+
import { processOrder } from "./workflows/process-order";
|
|
68
|
+
|
|
69
|
+
export async function POST(request: Request) {
|
|
70
|
+
const { orderId } = await request.json();
|
|
71
|
+
const token = `order:${orderId}`;
|
|
72
|
+
|
|
73
|
+
try {
|
|
74
|
+
const hook = await getHookByToken(token); // [!code highlight]
|
|
75
|
+
return Response.json({ runId: hook.runId, reused: true });
|
|
76
|
+
} catch (error) {
|
|
77
|
+
if (!HookNotFoundError.is(error)) throw error;
|
|
78
|
+
}
|
|
94
79
|
|
|
95
|
-
|
|
80
|
+
const run = await start(processOrder, [orderId]); // [!code highlight]
|
|
81
|
+
return Response.json({ runId: run.runId, reused: false });
|
|
82
|
+
}
|
|
83
|
+
```
|
|
96
84
|
|
|
97
|
-
-
|
|
98
|
-
- **Always provide idempotency keys for non-idempotent external calls.** Even if you think a step won't be retried, cold-start replay will re-execute it.
|
|
99
|
-
- **Handle 409/conflict as success.** If an external API returns "already processed," treat that as a successful result, not an error.
|
|
100
|
-
- **Make your own APIs idempotent** where possible. Accept an idempotency key and return the cached result on duplicate requests.
|
|
85
|
+
The workflow should create the deterministic hook and check `await hook.getConflict()` before duplicate-sensitive work: awaiting `getConflict()` suspends the workflow to commit the hook registration and resolves with the conflicting run when another active run already owns the token (or `null` once the hook is registered). See [Run idempotency](/docs/foundations/idempotency#run-idempotency) for the full pattern, including how to steer an active run with `resumeHook()` and how to handle the current race between `start()` and hook registration.
|
|
101
86
|
|
|
102
87
|
## Key APIs
|
|
103
88
|
|
|
104
|
-
- [`"use workflow"`](/docs/
|
|
105
|
-
- [`"use step"`](/docs/
|
|
106
|
-
- [`getStepMetadata()`](/docs/api-reference/
|
|
107
|
-
- [`
|
|
89
|
+
- [`"use workflow"`](/docs/foundations/workflows-and-steps#workflow-functions): Declares the orchestrator function.
|
|
90
|
+
- [`"use step"`](/docs/foundations/workflows-and-steps#step-functions): Declares step functions with full Node.js access.
|
|
91
|
+
- [`getStepMetadata()`](/docs/api-reference/workflow/get-step-metadata): Provides the deterministic `stepId` for idempotency keys.
|
|
92
|
+
- [`createHook()`](/docs/api-reference/workflow/create-hook): Creates a hook with an optional deterministic token.
|
|
93
|
+
- [`getHookByToken()`](/docs/api-reference/workflow-api/get-hook-by-token): Finds the hook that owns a token.
|
|
94
|
+
- [`resumeHook()`](/docs/api-reference/workflow-api/resume-hook): Resumes the active hook when the duplicate request carries data.
|
|
95
|
+
- [`start()`](/docs/api-reference/workflow-api/start): Starts a new workflow run.
|
|
@@ -5,6 +5,10 @@ type: guide
|
|
|
5
5
|
summary: When an external API returns 429, throw RetryableError with the Retry-After value so the workflow runtime automatically reschedules the step after the specified delay.
|
|
6
6
|
---
|
|
7
7
|
|
|
8
|
+
<CopyPrompt
|
|
9
|
+
text="Add durable rate-limit handling to external API steps. Import `RetryableError`, `FatalError`, `getStepMetadata`, and `sleep` from `workflow` as needed. In each HTTP-calling "use step" helper, if the response status is 429, read the `Retry-After` header and throw `new RetryableError("Rate limited", { retryAfter })`. For transient 5xx/network failures, throw `RetryableError` with an exponential delay based on `getStepMetadata().attempt`. For permanent 4xx failures, throw `FatalError`. If the dependency is completely down, add a workflow-level circuit breaker that `await sleep("30s")` before probing again. Make requests idempotent with stable keys, and verify 429, 5xx, fatal 4xx, and circuit-breaker behavior."
|
|
10
|
+
/>
|
|
11
|
+
|
|
8
12
|
Use this pattern when calling external APIs that enforce rate limits. Instead of writing manual retry loops, throw `RetryableError` with a `retryAfter` value and let the workflow runtime handle rescheduling.
|
|
9
13
|
|
|
10
14
|
## When to use this
|
|
@@ -63,7 +67,7 @@ async function upsertToWarehouse(contactId: string, contact: unknown) {
|
|
|
63
67
|
}
|
|
64
68
|
```
|
|
65
69
|
|
|
66
|
-
## Pattern:
|
|
70
|
+
## Pattern: exponential backoff
|
|
67
71
|
|
|
68
72
|
Use `getStepMetadata()` to access the current attempt number and calculate increasing delays:
|
|
69
73
|
|
|
@@ -86,7 +90,7 @@ async function callFlakeyApi(endpoint: string) {
|
|
|
86
90
|
}
|
|
87
91
|
```
|
|
88
92
|
|
|
89
|
-
## Pattern:
|
|
93
|
+
## Pattern: circuit breaker with sleep
|
|
90
94
|
|
|
91
95
|
When a dependency is completely down, stop hitting it for a cooldown period using `sleep()`, then probe with a single test request:
|
|
92
96
|
|
|
@@ -134,7 +138,7 @@ async function callService(requestNum: number): Promise<boolean> {
|
|
|
134
138
|
}
|
|
135
139
|
```
|
|
136
140
|
|
|
137
|
-
## Pattern:
|
|
141
|
+
## Pattern: custom max retries
|
|
138
142
|
|
|
139
143
|
Override the default retry count (3) for steps that need more or fewer attempts:
|
|
140
144
|
|
|
@@ -224,5 +228,5 @@ export async function downloadWithRetry(url: string) {
|
|
|
224
228
|
- [`"use step"`](/docs/foundations/workflows-and-steps) -- marks functions that run with full Node.js access
|
|
225
229
|
- [`RetryableError`](/docs/api-reference/workflow/retryable-error) -- signals the runtime to retry after a delay
|
|
226
230
|
- [`FatalError`](/docs/api-reference/workflow/fatal-error) -- signals a permanent failure, skipping retries
|
|
227
|
-
- [`getStepMetadata()`](/docs/api-reference/
|
|
231
|
+
- [`getStepMetadata()`](/docs/api-reference/workflow/get-step-metadata) -- provides the current attempt number and step ID
|
|
228
232
|
- [`sleep()`](/docs/api-reference/workflow/sleep) -- durable pause for circuit breaker cooldowns
|
|
@@ -5,6 +5,10 @@ type: guide
|
|
|
5
5
|
summary: Run a sequence of steps where each registers a compensation. If any step throws a FatalError, compensations execute in reverse order to restore consistency.
|
|
6
6
|
---
|
|
7
7
|
|
|
8
|
+
<CopyPrompt
|
|
9
|
+
text="Implement a saga-style workflow. Import `FatalError` from `workflow`. In the exported "use workflow" function, keep a compensation stack such as `const compensations: Array<() => Promise<void>> = []`. For each forward side effect, create a "use step" helper, await it, then push the matching compensation "use step" helper onto the stack. Throw `FatalError` for permanent business failures and normal errors for retryable failures. In the workflow catch block, run compensations in reverse order with `for (const compensate of compensations.reverse()) await compensate()`, then rethrow or return a failed status. Make each compensation idempotent. Verify successful completion, a fatal failure after multiple steps, and a replay/retry during rollback."
|
|
10
|
+
/>
|
|
11
|
+
|
|
8
12
|
Use the saga pattern when a business transaction spans multiple services and you need automatic rollback if any step fails. Each forward step registers a compensation, and on failure the workflow unwinds them in reverse order.
|
|
9
13
|
|
|
10
14
|
## When to use this
|
|
@@ -16,8 +20,8 @@ Use the saga pattern when a business transaction spans multiple services and you
|
|
|
16
20
|
## How it works
|
|
17
21
|
|
|
18
22
|
1. Each forward step does work and registers a compensation function.
|
|
19
|
-
2. If any step throws `FatalError`, the catch block runs compensations in reverse (LIFO) order to restore consistency.
|
|
20
|
-
3. Regular errors are retried automatically
|
|
23
|
+
2. If any step throws `FatalError`, the catch block runs compensations in reverse, or last in, first out (LIFO), order to restore consistency.
|
|
24
|
+
3. Regular errors are retried automatically, up to three times by default. Use `FatalError` only for permanent failures where retrying won't help.
|
|
21
25
|
|
|
22
26
|
## Pattern
|
|
23
27
|
|
|
@@ -49,7 +53,7 @@ export async function subscriptionUpgradeSaga(accountId: string, seats: number)
|
|
|
49
53
|
const entitlementId = await provisionSeats(accountId, seats);
|
|
50
54
|
compensations.push(() => deprovisionSeats(accountId, entitlementId)); // [!code highlight]
|
|
51
55
|
|
|
52
|
-
// No compensation
|
|
56
|
+
// No compensation: notifications are fire-and-forget
|
|
53
57
|
await sendConfirmation(accountId, invoiceId, entitlementId);
|
|
54
58
|
|
|
55
59
|
return { status: "completed" };
|
|
@@ -66,7 +70,7 @@ export async function subscriptionUpgradeSaga(accountId: string, seats: number)
|
|
|
66
70
|
|
|
67
71
|
### Step functions
|
|
68
72
|
|
|
69
|
-
Each step is a `"use step"` function with full Node.js access (fetch, fs, npm packages). Forward steps do the work and throw `FatalError` on permanent failure; compensation steps undo it and must be idempotent
|
|
73
|
+
Each step is a `"use step"` function with full Node.js access (fetch, fs, npm packages). Forward steps do the work and throw `FatalError` on permanent failure; compensation steps undo it and must be idempotent: safe to call multiple times if the workflow restarts mid-rollback.
|
|
70
74
|
|
|
71
75
|
```typescript
|
|
72
76
|
import { FatalError } from "workflow";
|
|
@@ -118,7 +122,7 @@ async function sendConfirmation(
|
|
|
118
122
|
});
|
|
119
123
|
}
|
|
120
124
|
|
|
121
|
-
// Compensation steps
|
|
125
|
+
// Compensation steps: must be idempotent
|
|
122
126
|
|
|
123
127
|
async function releaseSeats(accountId: string, reservationId: string): Promise<void> {
|
|
124
128
|
"use step";
|
|
@@ -147,7 +151,7 @@ async function deprovisionSeats(accountId: string, entitlementId: string): Promi
|
|
|
147
151
|
|
|
148
152
|
### Streaming step progress (optional)
|
|
149
153
|
|
|
150
|
-
Use `getWritable()` to stream progress events to a UI so users can see each step execute in real time.
|
|
154
|
+
Use `getWritable()` to stream progress events to a user interface (UI) so users can see each step execute in real time.
|
|
151
155
|
|
|
152
156
|
```typescript
|
|
153
157
|
import { FatalError } from "workflow";
|
|
@@ -200,7 +204,7 @@ export async function subscriptionUpgradeSaga(accountId: string, seats: number)
|
|
|
200
204
|
compensations.push({ name: "Deprovision Seats", execute: () => deprovisionSeats(accountId, entitlementId) });
|
|
201
205
|
await emit({ type: "step_done", step: "Provision Seats", detail: entitlementId });
|
|
202
206
|
|
|
203
|
-
// No compensation
|
|
207
|
+
// No compensation: notifications are fire-and-forget
|
|
204
208
|
await emit({ type: "step_start", step: "Send Confirmation" });
|
|
205
209
|
await sendConfirmation(accountId, invoiceId, entitlementId);
|
|
206
210
|
await emit({ type: "step_done", step: "Send Confirmation", detail: "sent" });
|
|
@@ -227,21 +231,21 @@ export async function subscriptionUpgradeSaga(accountId: string, seats: number)
|
|
|
227
231
|
## Adapting to your use case
|
|
228
232
|
|
|
229
233
|
- Replace the step functions with real API calls. Each `"use step"` function has full Node.js access.
|
|
230
|
-
- Add or remove steps as needed
|
|
231
|
-
- Make compensations idempotent
|
|
232
|
-
- The `emit()` calls and `SagaEvent` type are optional
|
|
234
|
+
- Add or remove steps as needed; the pattern scales to any number of steps.
|
|
235
|
+
- Make compensations idempotent, since they may be retried if the workflow restarts mid-rollback.
|
|
236
|
+
- The `emit()` calls and `SagaEvent` type are optional; remove them if you don't need real-time UI progress.
|
|
233
237
|
|
|
234
238
|
## Tips
|
|
235
239
|
|
|
236
|
-
- **Use `FatalError` for permanent failures
|
|
237
|
-
- **Make compensations idempotent
|
|
238
|
-
- **
|
|
239
|
-
- **Capture values in closures carefully
|
|
240
|
-
- **
|
|
240
|
+
- **Use `FatalError` for permanent failures**: Regular errors trigger automatic retries, up to three times by default. Throw `FatalError` when retrying won't help, such as for insufficient funds or invalid input.
|
|
241
|
+
- **Make compensations idempotent**: If a compensation step is retried, it should produce the same result. Check whether the resource was already released before releasing it again.
|
|
242
|
+
- **Use `"use step"` functions for compensation steps**: This makes them durable. If the workflow restarts during rollback, it resumes where it left off.
|
|
243
|
+
- **Capture values in closures carefully**: Use block-scoped variables or copy values before pushing compensations to avoid referencing stale state.
|
|
244
|
+
- **Skip compensations for notifications**: Fire-and-forget steps such as sending emails or Slack messages typically don't register a compensation.
|
|
241
245
|
|
|
242
246
|
## Key APIs
|
|
243
247
|
|
|
244
|
-
- [`"use workflow"`](/docs/
|
|
245
|
-
- [`"use step"`](/docs/
|
|
246
|
-
- [`FatalError`](/docs/api-reference/workflow/fatal-error)
|
|
247
|
-
- [`getWritable()`](/docs/api-reference/workflow/get-writable)
|
|
248
|
+
- [`"use workflow"`](/docs/foundations/workflows-and-steps#workflow-functions): Declares the orchestrator function.
|
|
249
|
+
- [`"use step"`](/docs/foundations/workflows-and-steps#step-functions): Declares step functions with full Node.js access.
|
|
250
|
+
- [`FatalError`](/docs/api-reference/workflow/fatal-error): Represents a non-retryable error that triggers compensation.
|
|
251
|
+
- [`getWritable()`](/docs/api-reference/workflow/get-writable): Streams data from workflows for real-time UI updates.
|
|
@@ -5,17 +5,25 @@ type: guide
|
|
|
5
5
|
summary: Schedule future actions with durable sleep that survives cold starts, and race sleeps against hooks to let external events cancel the workflow early.
|
|
6
6
|
---
|
|
7
7
|
|
|
8
|
-
|
|
8
|
+
<CopyPrompt
|
|
9
|
+
text="Create an interruptible scheduled workflow. Import `defineHook` and `sleep` from `workflow`. Define a cancellation hook such as `export const cancelDrip = defineHook<{ reason?: string }>()`. In an exported workflow function with "use workflow", create the hook once, send the first message in a "use step" helper, then `await Promise.race([sleep("2d").then(() => false), cancelHook.then(() => true)])` before each delayed action. If the hook wins, return a canceled status; if sleep wins, continue to the next step. Add an API route that calls `cancelDrip.resume(runIdOrToken, { reason })` or `resumeHook()` from `workflow/api`. Verify scheduled delivery, cancellation before sleep completes, and resume after server restart."
|
|
10
|
+
/>
|
|
11
|
+
|
|
12
|
+
Workflow's `sleep()` is durable: it survives cold starts, restarts, and deployments. Combined with `defineHook()` and `Promise.race()`, it becomes the foundation for interruptible scheduled workflows like drip campaigns, reminders, and timed sequences.
|
|
13
|
+
|
|
14
|
+
<Callout type="info">
|
|
15
|
+
Scheduled workflows are still pinned to the deployment that started them. If you are building recurring or indefinitely running schedules that should adopt newer code over time, see [Versioning](/docs/foundations/versioning) for the explicit `deploymentId: "latest"` continuation pattern.
|
|
16
|
+
</Callout>
|
|
9
17
|
|
|
10
18
|
## When to use this
|
|
11
19
|
|
|
12
|
-
- Sending emails on a schedule
|
|
13
|
-
- Waiting for a deadline
|
|
14
|
-
-
|
|
20
|
+
- Sending emails on a schedule, such as drip campaigns, onboarding sequences, or reminders
|
|
21
|
+
- Waiting for a deadline while allowing early cancellation
|
|
22
|
+
- Reliable, interruptible patterns that perform one action, wait for a specified time, and then perform another action
|
|
15
23
|
|
|
16
24
|
## Drip campaign with cancellation
|
|
17
25
|
|
|
18
|
-
A drip campaign sends emails at intervals, sleeping between each. Each sleep races against a cancellation hook
|
|
26
|
+
A drip campaign sends emails at intervals, sleeping between each message. Each sleep races against a cancellation hook. If an external event fires the hook, such as when a user converts or unsubscribes, the campaign stops immediately.
|
|
19
27
|
|
|
20
28
|
```typescript
|
|
21
29
|
import { defineHook, sleep } from "workflow";
|
|
@@ -97,29 +105,33 @@ export async function POST(req: Request) {
|
|
|
97
105
|
|
|
98
106
|
## How it works
|
|
99
107
|
|
|
100
|
-
1. **Durable sleep
|
|
101
|
-
2. **Hook creation
|
|
102
|
-
3. **Race
|
|
103
|
-
4. **Fresh hooks per window
|
|
108
|
+
1. **Durable sleep**: `sleep("2d")` persists through restarts at zero compute cost. The workflow resumes when the timer fires.
|
|
109
|
+
2. **Hook creation**: `cancelDrip.create({ token })` registers a hook that resolves when any external system calls `.resume()` with the same token.
|
|
110
|
+
3. **Race**: `Promise.race([sleep(...), hook])` blocks until either the timer fires or the hook is resumed, whichever comes first.
|
|
111
|
+
4. **Fresh hooks per window**: After a sleep completes normally, the previous hook instance is consumed. A new `.create()` call registers a fresh hook for the next sleep window, reusing the same token.
|
|
112
|
+
|
|
113
|
+
<Callout type="info">
|
|
114
|
+
Deterministic hook tokens can also serve as the idempotency point for scheduled runs. If duplicate schedule starts would send duplicate campaigns or reminders, create a hook with a token derived from the campaign key near the beginning of the workflow and route retries through that hook. If two scheduled starts race, the duplicate run can detect the conflict early with `await hook.getConflict()`, which resolves with the active owner so the duplicate can defer to it. See [Idempotency](/docs/foundations/idempotency).
|
|
115
|
+
</Callout>
|
|
104
116
|
|
|
105
117
|
## Adapting to your use case
|
|
106
118
|
|
|
107
|
-
- **Change durations
|
|
108
|
-
- **Add more steps
|
|
109
|
-
- **Snooze instead of cancel
|
|
110
|
-
- **
|
|
111
|
-
- **
|
|
119
|
+
- **Change durations**: Replace `"2d"` with any duration string (`"1h"`, `"7d"`, or `"30m"`) or a `Date` object for absolute times.
|
|
120
|
+
- **Add more steps**: The pattern scales to any number of email-then-sleep pairs.
|
|
121
|
+
- **Snooze instead of cancel**: Resolve the hook with a `snooze` payload and sleep again with `sleep(new Date(Date.now() + payload.snoozeMs))`.
|
|
122
|
+
- **Set a timeout for any operation**: Use the same `Promise.race(sleep, work)` pattern to add deadlines to slow steps.
|
|
123
|
+
- **Use production providers**: Replace the `sendEmail` step body with Resend, Postmark, or any HTTP API. The `"use step"` function has full Node.js access.
|
|
112
124
|
|
|
113
125
|
## Tips
|
|
114
126
|
|
|
115
|
-
-
|
|
116
|
-
- **
|
|
117
|
-
- **Use `sleep()` in workflow context
|
|
127
|
+
- **Pass supported values to `sleep()`**: Use duration strings (`"1d"`, `"2h"`, or `"30s"`), milliseconds, or `Date` objects for sleeping until a specific time.
|
|
128
|
+
- **Sleeping consumes no compute or memory**: A workflow waiting on `sleep("7d")` consumes no compute or memory while sleeping.
|
|
129
|
+
- **Use `sleep()` only in workflow context**: Step functions cannot call `sleep()` directly. If a step needs a delay, use `setTimeout` inside the step.
|
|
118
130
|
|
|
119
131
|
## Key APIs
|
|
120
132
|
|
|
121
|
-
- [`"use workflow"`](/docs/foundations/workflows-and-steps)
|
|
122
|
-
- [`"use step"`](/docs/foundations/workflows-and-steps)
|
|
123
|
-
- [`sleep()`](/docs/api-reference/workflow/sleep)
|
|
124
|
-
- [`defineHook()`](/docs/api-reference/workflow/define-hook)
|
|
125
|
-
- [`Promise.race()`](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Promise/race)
|
|
133
|
+
- [`"use workflow"`](/docs/foundations/workflows-and-steps): Marks the orchestrator function.
|
|
134
|
+
- [`"use step"`](/docs/foundations/workflows-and-steps): Marks functions that run with full Node.js access.
|
|
135
|
+
- [`sleep()`](/docs/api-reference/workflow/sleep): Provides a durable wait that survives restarts with zero compute cost.
|
|
136
|
+
- [`defineHook()`](/docs/api-reference/workflow/define-hook): Creates a typed hook that external systems can fire.
|
|
137
|
+
- [`Promise.race()`](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Promise/race): Races sleep against hooks for interruptible waits.
|
|
@@ -1,22 +1,26 @@
|
|
|
1
1
|
---
|
|
2
2
|
title: Sequential & Parallel Execution
|
|
3
|
-
description: Compose steps with familiar async/await patterns
|
|
3
|
+
description: Compose steps with familiar async/await patterns, sequential await, Promise.all, and Promise.race.
|
|
4
4
|
type: guide
|
|
5
|
-
summary: Workflows are
|
|
5
|
+
summary: Workflows are plain async functions, so all the standard composition primitives (await, Promise.all, Promise.race) apply unchanged, including racing webhooks against durable sleeps.
|
|
6
6
|
related:
|
|
7
7
|
- /docs/foundations/workflows-and-steps
|
|
8
8
|
- /cookbook/common-patterns/timeouts
|
|
9
9
|
- /cookbook/common-patterns/scheduling
|
|
10
10
|
---
|
|
11
11
|
|
|
12
|
-
|
|
12
|
+
<CopyPrompt
|
|
13
|
+
text="Compose these workflow steps with standard async/await patterns. In the exported "use workflow" function, chain dependent "use step" calls with sequential `await`; run independent steps concurrently by starting them without `await` and awaiting `Promise.all([...])`; and use `Promise.race([...])` to act on whichever promise settles first. These compose with durable primitives: race a step or a webhook from `createWebhook()` against `sleep()` from `workflow` for deadlines. Keep every step input and output serializable, and remember `Promise.race` does not cancel the losing branch (it keeps running), so side-effectful losers need idempotency keys. Verify sequential ordering, parallel execution, and both race outcomes."
|
|
14
|
+
/>
|
|
15
|
+
|
|
16
|
+
Workflows are written in plain async/await: there's no new control-flow API to learn. Sequential awaits chain steps that depend on each other, `Promise.all` runs independent steps in parallel, and `Promise.race` returns whichever finishes first. These compose with workflow primitives like [`sleep()`](/docs/api-reference/workflow/sleep) and [`createWebhook()`](/docs/api-reference/workflow/create-webhook) since those are also promises.
|
|
13
17
|
|
|
14
18
|
## When to use this
|
|
15
19
|
|
|
16
|
-
- **Pipelines
|
|
17
|
-
- **Independent fan-out
|
|
18
|
-
- **Race conditions
|
|
19
|
-
- **Mixing primitives
|
|
20
|
+
- **Pipelines**: Each step depends on the previous step's output (validate → process → store).
|
|
21
|
+
- **Independent fan-out**: Fetch multiple resources or perform multiple actions that don't depend on each other.
|
|
22
|
+
- **Race conditions**: Return as soon as one operation completes, such as for a timeout, first responder, or deadline.
|
|
23
|
+
- **Mixing primitives**: Run steps, sleeps, and webhooks side by side in the same control-flow expression.
|
|
20
24
|
|
|
21
25
|
## Pattern
|
|
22
26
|
|
|
@@ -64,7 +68,7 @@ export async function fetchUserData(userId: string) {
|
|
|
64
68
|
|
|
65
69
|
### Race with `Promise.race`
|
|
66
70
|
|
|
67
|
-
`Promise.race` resolves as soon as the first promise settles. Since [`sleep()`](/docs/api-reference/workflow/sleep) and [`createWebhook()`](/docs/api-reference/workflow/create-webhook) return promises, they compose naturally
|
|
71
|
+
`Promise.race` resolves as soon as the first promise settles. Since [`sleep()`](/docs/api-reference/workflow/sleep) and [`createWebhook()`](/docs/api-reference/workflow/create-webhook) return promises, they compose naturally. For example, waiting for a webhook callback with a deadline:
|
|
68
72
|
|
|
69
73
|
```typescript lineNumbers
|
|
70
74
|
import { sleep, createWebhook } from "workflow";
|
|
@@ -86,11 +90,11 @@ export async function runExternalTask(userId: string) {
|
|
|
86
90
|
}
|
|
87
91
|
```
|
|
88
92
|
|
|
89
|
-
For racing operations against deadlines specifically (timeouts), see the dedicated [Timeouts](/cookbook/common-patterns/timeouts) recipe
|
|
93
|
+
For racing operations against deadlines specifically (timeouts), see the dedicated [Timeouts](/cookbook/common-patterns/timeouts) recipe, which covers result discrimination, `FatalError` semantics, and the "loser keeps running" caveat.
|
|
90
94
|
|
|
91
95
|
### Combining sequential, parallel, and durable primitives
|
|
92
96
|
|
|
93
|
-
Most
|
|
97
|
+
Most workflows combine all three patterns. The following simplified version of the [birthday card generator demo](https://github.com/vercel/workflow-examples/tree/main/birthday-card-generator) uses sequential card generation, parallel invitation-response fan-out, non-blocking webhook collection, and a durable sleep until the birthday:
|
|
94
98
|
|
|
95
99
|
```typescript lineNumbers
|
|
96
100
|
import { createWebhook, sleep, type Webhook } from "workflow";
|
|
@@ -132,24 +136,24 @@ export async function birthdayWorkflow(
|
|
|
132
136
|
|
|
133
137
|
## How it works
|
|
134
138
|
|
|
135
|
-
1. **`await` is durable
|
|
136
|
-
2. **`Promise.all` runs steps concurrently
|
|
137
|
-
3. **`Promise.race` resolves
|
|
138
|
-
4. **All primitives are promises
|
|
139
|
+
1. **`await` is durable**: When the workflow awaits a step, the runtime persists the step's input, suspends the workflow, runs the step, and replays the workflow with the step's result on resume. The same applies to `sleep()` and `createWebhook()`.
|
|
140
|
+
2. **`Promise.all` runs steps concurrently**: Each promise in the array is suspended on its own, and the workflow resumes only when all have settled. If any promise rejects, the whole `Promise.all` rejects.
|
|
141
|
+
3. **`Promise.race` resolves when the first promise settles**: The losing promises keep running in the background, but the workflow discards their results.
|
|
142
|
+
4. **All primitives are promises**: `sleep("1 day")` and `createWebhook()` return promises, so they compose with `Promise.all` and `Promise.race` like steps do. This behavior enables patterns such as racing a webhook against a 24-hour deadline.
|
|
139
143
|
|
|
140
144
|
## Adapting to your use case
|
|
141
145
|
|
|
142
|
-
- **Replace `Promise.all` with `Promise.allSettled
|
|
143
|
-
- **Bound the parallelism
|
|
144
|
-
- **Add a deadline to any race
|
|
145
|
-
- **Mix steps and hooks in a race
|
|
146
|
+
- **Replace `Promise.all` with `Promise.allSettled`**: Use this option when partial failures shouldn't abort the remaining operations. You'll get an array of `{ status, value | reason }` instead of an error on the first rejection.
|
|
147
|
+
- **Bound the parallelism**: `Promise.all` over 1,000 items will fan out 1,000 concurrent steps. If your downstream APIs can't handle that, batch the array into chunks (see [Batching](/cookbook/common-patterns/batching)).
|
|
148
|
+
- **Add a deadline to any race**: Pair the operation with `sleep("30s").then(() => "timeout" as const)` and check the discriminated result. See [Timeouts](/cookbook/common-patterns/timeouts).
|
|
149
|
+
- **Mix steps and hooks in a race**: Wait for an external signal, a deadline, or a step result in the same `Promise.race`. The first promise to resolve wins.
|
|
146
150
|
|
|
147
151
|
## Key APIs
|
|
148
152
|
|
|
149
|
-
- [`"use workflow"`](/docs/foundations/workflows-and-steps)
|
|
150
|
-
- [`"use step"`](/docs/foundations/workflows-and-steps)
|
|
151
|
-
- [`sleep()`](/docs/api-reference/workflow/sleep)
|
|
152
|
-
- [`createWebhook()`](/docs/api-reference/workflow/create-webhook)
|
|
153
|
-
- [`Promise.all()`](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Promise/all)
|
|
154
|
-
- [`Promise.race()`](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Promise/race)
|
|
155
|
-
- [`Promise.allSettled()`](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Promise/allSettled)
|
|
153
|
+
- [`"use workflow"`](/docs/foundations/workflows-and-steps): Marks the orchestrator function.
|
|
154
|
+
- [`"use step"`](/docs/foundations/workflows-and-steps): Marks functions with full Node.js access.
|
|
155
|
+
- [`sleep()`](/docs/api-reference/workflow/sleep): Provides durable sleep that survives restarts.
|
|
156
|
+
- [`createWebhook()`](/docs/api-reference/workflow/create-webhook): Provides a webhook URL that the workflow can race against.
|
|
157
|
+
- [`Promise.all()`](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Promise/all): Waits for all promises.
|
|
158
|
+
- [`Promise.race()`](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Promise/race): Waits for the first promise to settle.
|
|
159
|
+
- [`Promise.allSettled()`](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Promise/allSettled): Waits for all promises, including failures.
|
|
@@ -2,7 +2,7 @@
|
|
|
2
2
|
title: Timeouts
|
|
3
3
|
description: Add deadlines to slow operations by racing them against a durable sleep.
|
|
4
4
|
type: guide
|
|
5
|
-
summary: Use `Promise.race` with `sleep()` to bound the time any step, hook, or webhook is allowed to take
|
|
5
|
+
summary: Use `Promise.race` with `sleep()` to bound the time any step, hook, or webhook is allowed to take, and recover gracefully when the deadline fires first.
|
|
6
6
|
related:
|
|
7
7
|
- /docs/api-reference/workflow/sleep
|
|
8
8
|
- /docs/foundations/hooks
|
|
@@ -10,14 +10,18 @@ related:
|
|
|
10
10
|
- /cookbook/common-patterns/webhooks
|
|
11
11
|
---
|
|
12
12
|
|
|
13
|
-
|
|
13
|
+
<CopyPrompt
|
|
14
|
+
text="Add a deadline to this slow workflow operation. Import `sleep` from `workflow`. In the exported "use workflow" function, race the operation against a durable sleep: `await Promise.race([slowStep(...), deadline("10m")])`, where `deadline` is a helper that awaits `sleep(duration)` and returns a sentinel value or throws. Branch on the winner: continue normally on success, run the fallback or compensation path on timeout. Use the same pattern to bound hooks and webhooks. `Promise.race` does not cancel the loser (the underlying step keeps running), so pass an `AbortSignal` into the step for cooperative cancellation and make non-idempotent side effects retry-safe with idempotency keys. Verify the fast path, the timeout path, and side-effect safety when the loser completes late."
|
|
15
|
+
/>
|
|
16
|
+
|
|
17
|
+
Workflows often need to limit how long they wait for a slow step, an external webhook, or human approval. Race the operation against a durable `sleep()` with `Promise.race()`. The first operation to finish wins, while the other keeps running and its result is ignored.
|
|
14
18
|
|
|
15
19
|
## When to use this
|
|
16
20
|
|
|
17
|
-
- **Slow steps
|
|
18
|
-
- **External callbacks
|
|
19
|
-
- **Human approvals
|
|
20
|
-
- **Polling loops
|
|
21
|
+
- **Slow steps**: bound the time spent waiting on third-party APIs, model calls, or expensive computation
|
|
22
|
+
- **External callbacks**: give webhooks a deadline so the workflow doesn't hang forever waiting for an event that may never arrive
|
|
23
|
+
- **Human approvals**: auto-decline or escalate when a hook isn't resumed within a window
|
|
24
|
+
- **Polling loops**: give an outer poll-until-ready loop an overall budget
|
|
21
25
|
|
|
22
26
|
## Pattern
|
|
23
27
|
|
|
@@ -46,7 +50,7 @@ export async function processWithTimeout(data: string) {
|
|
|
46
50
|
|
|
47
51
|
### Timeout on a webhook
|
|
48
52
|
|
|
49
|
-
The same pattern works for any promise
|
|
53
|
+
The same pattern works for any promise, including hooks and webhooks. Here a webhook waits for an external service to call back, with a hard deadline of 7 days:
|
|
50
54
|
|
|
51
55
|
```typescript lineNumbers
|
|
52
56
|
import { sleep, createWebhook } from "workflow";
|
|
@@ -74,26 +78,27 @@ export async function waitForApproval(requestId: string) {
|
|
|
74
78
|
|
|
75
79
|
## How it works
|
|
76
80
|
|
|
77
|
-
1. **Durable sleep
|
|
78
|
-
2. **Race
|
|
79
|
-
3. **Discriminated result
|
|
80
|
-
4. **Throw to fail the workflow
|
|
81
|
+
1. **Durable sleep**: `sleep("30s")` persists through restarts at zero compute cost. The workflow resumes precisely when the timer fires.
|
|
82
|
+
2. **Race**: `Promise.race([work, sleep(...)])` returns the value of whichever promise resolves first. The loser keeps running in the background but its result is ignored by the workflow.
|
|
83
|
+
3. **Discriminated result**: tagging the sleep branch with a sentinel value (`"timeout" as const`, `{ timedOut: true }`) lets TypeScript narrow the result and pick the right branch.
|
|
84
|
+
4. **Throw to fail the workflow**: inside a workflow function, throwing an `Error` exits the run with that error. Use `FatalError` inside steps; throw plain errors inside workflows.
|
|
81
85
|
|
|
82
86
|
<Callout type="warn">
|
|
83
|
-
**The losing operation keeps running.** `Promise.race` doesn't cancel
|
|
87
|
+
**The losing operation keeps running.** `Promise.race` doesn't cancel: when the sleep wins, the underlying step (or model call, or HTTP request) continues to completion in the background. This is fine for idempotent reads but matters when the operation has side effects or costs money. Pass an `AbortSignal` into the step to cancel it cooperatively, and use idempotency keys for non-idempotent side effects. See the [Cancellation Guide](/docs/foundations/cancellation) and [Idempotency](/docs/foundations/idempotency) for patterns.
|
|
84
88
|
</Callout>
|
|
85
89
|
|
|
86
90
|
## Adapting to your use case
|
|
87
91
|
|
|
88
|
-
- **Different durations
|
|
89
|
-
- **Soft timeout (retry)
|
|
90
|
-
- **Soft timeout (fallback)
|
|
91
|
-
- **Combine with cancellation
|
|
92
|
-
- **Per-step deadlines
|
|
92
|
+
- **Different durations**: `sleep()` accepts duration strings (`"30s"`, `"5m"`, `"7 days"`), milliseconds, or `Date` objects for absolute deadlines.
|
|
93
|
+
- **Soft timeout (retry)**: instead of throwing, loop and retry with a fresh `Promise.race` and a backoff.
|
|
94
|
+
- **Soft timeout (fallback)**: return a default value when the timer wins instead of throwing: `if (result === "timeout") return cachedFallback`.
|
|
95
|
+
- **Combine with cancellation**: race three promises: the operation, a deadline `sleep()`, and a cancellation hook. See the [Scheduling cookbook](/cookbook/common-patterns/scheduling) for the cancellation half of this pattern.
|
|
96
|
+
- **Per-step deadlines**: wrap each step in its own `Promise.race` for independent budgets, or use a single outer race for an overall workflow deadline.
|
|
93
97
|
|
|
94
98
|
## Key APIs
|
|
95
99
|
|
|
96
|
-
- [`sleep()`](/docs/api-reference/workflow/sleep)
|
|
97
|
-
- [`createWebhook()`](/docs/api-reference/workflow/create-webhook)
|
|
98
|
-
- [`defineHook()`](/docs/api-reference/workflow/define-hook)
|
|
99
|
-
- [
|
|
100
|
+
- [`sleep()`](/docs/api-reference/workflow/sleep): durable wait (survives restarts, zero compute cost)
|
|
101
|
+
- [`createWebhook()`](/docs/api-reference/workflow/create-webhook): create a webhook URL the workflow can race against
|
|
102
|
+
- [`defineHook()`](/docs/api-reference/workflow/define-hook): typed hook for in-process cancellation
|
|
103
|
+
- [Idempotency](/docs/foundations/idempotency): protect side effects that may keep running after a timeout
|
|
104
|
+
- [`Promise.race()`](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Promise/race): race operations against deadlines
|