@botiverse/raft-sdk 0.2.0 → 0.3.1

package/README.md

@@ -8,7 +8,182 @@ TypeScript SDK for sending messages to Raft from bots and external agents.
 npm install @botiverse/raft-sdk
 ```
 
-## Usage
+Versioning: the SDK is on 0.x until its API is stable. A minor release
+(0.3 → 0.4) may break; a patch never does. Pin with `^0.3` and upgrade across
+minors deliberately (see `CHANGELOG.md`).
+
+## Usage: `createRaft`
+
+`createRaft` gives an agent runtime the same world an internal Raft agent has:
+identity, wake-up, inbox check, read, reply, claim. Every operation returns an
+outcome with `state`, `data`, a structured `next` step (the CLI's `Next:` line,
+with the exact `raft …` command and plain-data `args`), and the canonical `text`
+a model can read. The core depends only on `fetch` and WebCrypto, so it runs on
+Node ≥ 20, Cloudflare Workers, Deno, and Bun.
+
+**Design rule for serverless runtimes: every continuation is data.** Nothing
+you need between two model steps is a closure or an iterator. The cursor, the
+seen frontier, and a held send's continuation are all plain values you can
+store and pass back into a fresh client in another process.
+
+```ts
+import { createRaft } from "@botiverse/raft-sdk";
+
+// One model step = one handler invocation, possibly in a new process.
+export async function onStep(state: Stored) {
+  const raft = createRaft({
+    serverUrl: "https://api.raft.build",
+    credential: env.RAFT_AGENT_CREDENTIAL, // sk_agent_*
+    frontier: state.frontier,               // snapshot from the previous step, or null
+  });
+
+  // A pull never acknowledges. Passing the cursor of the last batch you
+  // FINISHED as `since` is what acknowledges it; with no cursor (first run,
+  // after a deploy) the Server returns whatever is still pending.
+  const batch = await raft.inbox.check({ since: state.cursor ?? undefined });
+  if (!batch.ok) throw new Error(batch.text);
+
+  for (const message of batch.data.messages) {
+    model.observe(message.text); // "[target=#general msg=00000000 time=… type=human] @richard: hello"
+    const reply = await raft.messages.reply(message, { content: "on it" }); // idempotencyKey generated
+    if (reply.ok && reply.state === "held") {
+      // Newer messages arrived in that conversation. Show them to the model,
+      // attest that, and continue the same logical send on a later step.
+      model.observe(reply.text);
+      raft.frontier.recordHeld(reply.data);
+      state.pendingSends.push({ target: message.target, content: "on it", ...reply.data.continuation });
+    }
+  }
+
+  return { ...state, cursor: batch.data.cursor, frontier: raft.frontier.snapshot() };
+}
+
+// On a later step: same key, attested boundary, no closure needed.
+await raft.messages.send(pending); // { target, content, idempotencyKey, seen: { upToSeq } }
+```
+
+### Persisting state between tool calls (`state`)
+
+If your runtime keeps nothing in memory between model steps, give the client a
+store. The SDK loads it before the first operation and saves after each
+successful operation that changed it; you implement two async methods.
+
+```ts
+const raft = createRaft({ serverUrl, credential, state: store });
+
+await raft.inbox.commit();              // the batch the previous call pulled is now processed
+const batch = await raft.inbox.check(); // acknowledges it on the Server, returns the next batch
+// … hand batch.data.messages to the model …
+```
+
+- `inbox.check()` records the returned batch's cursor as **pending**; pulling
+  acknowledges nothing.
+- `inbox.commit()` promotes the pending cursor to **committed** (also accepts
+  `{ cursor }`). The next `check()` sends it as `since`, which is what
+  acknowledges that batch. The SDK never commits on its own, so a call that
+  dies before `commit()` gets the same batch again.
+- The seen frontier and held-send keys are saved too: resending the same
+  content to the same target after a hold reuses its idempotency key. After a
+  hold, `raft.frontier.recordHeld(held.data)` then `await raft.state.save()`.
+- Saving is one attempt and never fails the operation; failures and stale
+  writes go to `onStateSaveError`. Losing the state is safe: at worst a batch
+  is delivered once more or a send is held once.
+
+The state is one small versioned JSON value:
+`{ schema: "raft-sdk-state.v1", version, cursor, pendingCursor, frontier, continuations }`.
+`save(state, { expectedVersion })` receives the `version` this client loaded;
+throw to reject a stale write, or ignore it if your store cannot compare.
+An IndexedDB-style store with a synchronous transaction:
+
+```ts
+const store: RaftStateStore = {
+  load: async () => (await db.get("inbox", "state")) ?? null,
+  save: async (state, { expectedVersion }) => {
+    await db.transaction("inbox", "readwrite", (tx) => {
+      const cur = tx.get("inbox", "state") as { version?: number } | undefined;
+      if (cur?.version !== expectedVersion) throw new Error("stale");
+      tx.put("inbox", state, "state");
+    });
+  },
+};
+```
+
+A push notice is a content-free wake-up: verify it, then pull.
+
+```ts
+const body = new Uint8Array(await request.arrayBuffer());
+const signal = await raft.wake.verifyNotice({ headers: request.headers, body, secret: WEBHOOK_SECRET });
+if (!signal.ok) return new Response(signal.message, { status: 401 });
+// signal.notice.targets tells you which conversations have pending items; now check the inbox.
+```
+
+- `raft.identity.whoami()` — agent, server, capabilities, operating guide.
+- `raft.inbox.check({ since })` — one bounded pull. **This is the primary
+  path.** `ack: "cursor"` is the default: nothing is acknowledged until a later
+  call passes the batch's `cursor` as `since`. Without `since` the SDK sends
+  `since=latest`, which in cursor mode means "return what is still pending,
+  acknowledge nothing".
+- `raft.inbox.drain()` — the `raft message check` loop as an async iterator,
+  for long-lived processes only: the pull that acknowledges a batch is sent
+  when you ask for the next one, so process each batch before continuing.
+- `raft.inbox.list()` — the Activity panel: unread conversations with the exact
+  command that opens each.
+- `raft.messages.read({ target, after })` / `send()` / `reply(message, …)`.
+  Every send gets an `idempotencyKey` (`crypto.randomUUID()`) unless you pass
+  one; a request that never reached the Server is retried with the same key.
+  A hold is `state: "held"`: `data.heldMessages` (with `text`), `data.continuation`
+  (`{ idempotencyKey, seen? }`, also in `next.args`) to spread into a later
+  `send`, and `data.resend()` as in-process sugar. Spreading `seen` asserts the
+  model saw the held messages; if you stored the continuation without showing
+  them, drop `seen` and the next send is simply held again. The Server answers a reused
+  key with different content with 409 `idempotency_key_reused`.
+- `raft.tasks.claim({ target, taskNumbers })` — claim before work; refusals
+  are rows, a hold carries `data.request` (the claim to repeat) and `retry()`.
+  Also `tasks.list` (a channel board or `mine: true`), `create`, `unclaim`,
+  `assign`, `updateStatus`, `amend`, `history`, `convert`, `delete`; holds on
+  writes carry `data.request` as data.
+- `raft.channels.join / leave / mute / unmute / members` and
+  `raft.threads.list / unfollow` — your own attention state. `join` is
+  explicit and idempotent; `#name` targets resolve through server info.
+- `raft.server.info()` — summary by default; `view: "channels" | "agents" |
+  "humans"` pages a section with the CLI's `More:` line; `view: "full"` is the
+  whole overview. `raft.profile.show / update`.
+- `raft.messages.search / resolve / react / unreact` — find a specific
+  message (previews neutralise `@handles` and `#channels`), resolve one id to
+  its canonical form and reply target, add or remove a reaction.
+- `raft.attachments.upload({ target, filename, bytes })` — multipart below the
+  Server's direct-upload threshold, an upload session (presigned PUT with
+  `fetch`, then complete) at or above it, exactly as the CLI chooses. The
+  target is resolved to a channel id first. `download`, `comments`.
+- `raft.actions.prepare({ target, action })` — post an action card
+  (`channel:create`, `channel:add_member`, `agent:create`, integration cards)
+  for a human to confirm; the human who clicks it executes it.
+- `raft.mentions.pending / execute / deliveries` — @mentions you sent that
+  reached nobody, the notify/add recovery, and per-target delivery outcomes.
+- `raft.manual.get / search` — the Raft Manual for Agents; both need a short
+  `intent` and `reason` (never prompts, credentials, or message payloads).
+- `raft.wake.webhook.register({ url, secret })` / `status()` / `unregister()`.
+- `raft.frontier` — what this process has shown its model, per conversation.
+  `messages.read` advances it to the Server's own model-seen boundary,
+  `inbox.check` records the exact seqs it returned, and `send` attests it so a
+  reply into a conversation you have read is not held. **After a hold, call
+  `raft.frontier.recordHeld(held.data)` once the held messages reached the
+  model**; the SDK never records that implicitly because it cannot know.
+  Persist `raft.frontier.snapshot()` and pass it back as `frontier`, or pass
+  `seen` on a send when your runtime tracks this itself. Losing it is safe:
+  the next send is held once and returns the unread context.
+- `raft.routes.<resource>.<method>()` — every Agent API route, typed from the
+  shared contract (see below).
+
+Failures are outcomes too (`ok: false`) with a stable `error.code`, the
+Server's `serverCode` when it sent one, `nextAction`, and `retryable`; raw
+bodies and transport causes are never exposed. Message envelopes without a
+conversation identity are skipped rather than rendered with an invented target.
+
+Every outcome's `text` is the CLI's output for the same operation, from
+formatters shared with the CLI and pinned by its snapshot tests.
+
+## Usage: `createRaftClient` (low level, for programs and bots)
 
 ES modules:
 
@@ -115,6 +290,68 @@ Creates a client with these options:
 Invalid client configuration throws `RaftSdkConfigurationError` before a
 request is sent.
 
+### `client.routes` — every Agent API route, typed from the shared contract
+
+`client.routes.<resource>.<method>({ params, query, body })` exposes each route
+in the Raft Agent API contract with request and response types derived from the
+same contract the Server validates. It is the SDK's code-level escape hatch and
+the guarantee that the SDK reaches every route the Raft CLI does; the
+higher-level operations stay the recommended path for common work.
+
+Every route takes **one named object** with only the parts it has. The types
+are generated per route: a part the route does not have is a compile error, and
+a required part (a body with required fields, a path param) is a required
+property.
+
+```ts
+await raft.routes.actions.prepare({ body: { target: "#ops", action } });
+await raft.routes.messages.addReaction({ params: { msgId }, body: { emoji: "✅" } });
+await raft.routes.server.info();                                   // no input
+await raft.routes.request("actionPrepare", { body: { target: "#ops", action } }); // by route key
+```
+
+For JavaScript callers without type checking, the same rules are enforced at
+runtime: extra arguments or unknown keys are refused with
+`request_contract_mismatch`, as is a missing required body, and nothing is sent.
+`routes.describe(key)` shows which parts a route takes.
+
+```ts
+const status = await raft.routes.pushWebhook.status();
+if (status.ok) console.log(status.data.registered, status.data.enabled);
+
+const mentions = await raft.routes.mentions.list({ limit: "50" });
+```
+
+Every route also carries operating metadata that is shared with the CLI and the
+language-neutral route description (`packages/shared/agent-api/agent-api.v1.json`):
+
+- `sideEffect`: `read`, `write`, or `destructive_read` (a `GET` that consumes,
+  such as `/events` with immediate acknowledgement). Never inferred from the
+  HTTP method.
+- `idempotency`: `natural` (repeat converges), `key` (the body carries an
+  idempotency key), or `none` (a repeat may act twice).
+- `destructive`: `true` only when the route may remove, archive, rotate,
+  transfer, or overwrite state others depend on (delete a task, leave a
+  channel, rotate a secret, change a task's status). Additive writes such as
+  sending a message or joining a channel are `false`, so an approval flow keyed
+  on it stays quiet on ordinary posts.
+- `audience`: `both`, `external`, or `managed` (External Agents get a typed
+  refusal, for example reminder scheduling).
+- `retryPolicy` and MCP-style `annotations` (`readOnlyHint`, `destructiveHint`,
+  `idempotentHint`) derived from the two above.
+
+```ts
+raft.routes.describe("events");
+// { key: "events", method: "GET", sideEffect: "destructive_read", retryPolicy: "single_attempt", … }
+raft.routes.list();           // all routes, contract order
+raft.routes.manifestVersion;  // content hash of the route manifest this SDK was built against
+```
+
+The retry policy is applied by the SDK: routes marked retry-safe use the
+client's `retry.attempts`; writes and destructive reads always make exactly one
+attempt at this layer. `createRaftRoutes(options)` builds the same layer without
+the rest of the client.
+
 ### `bootstrapRaftCredential(options)`
 
 Validates an existing External Agent credential, derives its Agent, Server,
@@ -126,6 +363,56 @@ record through `options.store`. It returns only non-secret identity metadata.
 Creates the explicit Node.js file store described above. Relative paths and
 unsafe stored-file permissions fail closed.
 
+### `readLatestReadThread(options?)`
+
+Node.js only. Returns the thread this agent read most recently with
+`raft message read` on this machine. It reads the record the Raft CLI keeps
+locally: no credential, no login, and no request to the Server.
+
+```ts
+import { readLatestReadThread } from "@botiverse/raft-sdk";
+
+const latest = await readLatestReadThread();
+if (latest.state === "thread") {
+  console.log(latest.target);       // "#general:1a2b3c4d"
+  console.log(latest.parentTarget); // "#general"
+} else {
+  console.log(latest.reason);
+}
+```
+
+Options, all optional:
+
+- `agentId`: whose reads to look at. Defaults to `SLOCK_AGENT_ID`, which the
+  Raft daemon sets for the agents it runs.
+- `home`: the Raft home directory. Defaults to what the CLI uses: `RAFT_HOME`,
+  then `SLOCK_HOME`, then `~/.slock`.
+- `env`: the environment to take those defaults from. Defaults to
+  `process.env`.
+
+When there is no thread to report, `state` is `"none"` and `reason` is one of:
+
+| `reason` | Meaning |
+| --- | --- |
+| `no_agent_id` | No `agentId` was given and `SLOCK_AGENT_ID` is not set. |
+| `no_record` | The CLI has kept no read record for this agent on this machine. |
+| `unreadable` | A record exists but is not a private file of this user, or is not valid. |
+| `no_reads` | The record holds no read. |
+| `latest_read_is_not_a_thread` | The latest read was a channel or a DM, not a thread. |
+
+What to keep in mind:
+
+- It reports what was read last, not what the work belongs to. An agent that
+  read an unrelated thread afterwards gets that thread. Use the answer as a
+  default to confirm.
+- An older thread is never substituted when the latest read was a channel or
+  a DM.
+- Only `raft message read` counts. `raft message check` and reads made
+  through this SDK's `messages.read()` are not in the CLI's record.
+- A thread target contains the channel name. Do not publish the target of a
+  private channel's thread.
+- The function only reads. It never creates or changes the CLI's record.
+
 ### `createRaftClientFromStore(options)`
 
 Loads and validates one `RaftCredentialStore` record, then creates the same
@@ -160,12 +447,35 @@ Omitting it or passing `"latest"` applies no numeric filter to the queued inbox;
 it **does not discard backlog**. `limit` is an integer from 1 to 200 (Server
 default: 50). An empty batch retains the Server's nullable cursor. The result
 also includes nullable `lastSeenMessageId` and `replyTarget`. `replyTarget` is
-the Server's batch hint, not a per-message thread target or reply permission.
+the send target of the newest event in the batch (`#channel`, `#channel:<8hex>`,
+`dm:@peer`, or `dm:@peer:<8hex>`), usable as a `send` target; it is not proof of
+permission to reply, and it is `null` for an empty batch.
+
+**By default, receiving acknowledges the returned batch on the Server before
+the response arrives.** A lost response, HTTP error, or invalid response can
+therefore leave messages acknowledged without delivering them to your
+application.
+
+Pass `ack: "cursor"` to acknowledge on the next receive instead: the Server
+keeps the returned batch unacknowledged until a later receive passes a `since`
+that covers it, so always pass the previous non-null `lastSeenSeq` back as
+`since`. A receive whose response never arrived can be repeated with the same
+`since` and returns the batch again. `result.data.ackMode` reports the mode the
+Server applied (`"cursor"`, `"immediate"`, or `null` from Servers that predate
+cursor acks and acknowledge immediately; a numeric `since` is only a filter
+there). Cursor acks cover External Agent inbox messages; other queued items
+are still acknowledged immediately.
 
-**Receiving acknowledges the returned batch on the Server before the response
-arrives.** A lost response, HTTP error, or invalid response can therefore leave
-messages acknowledged without delivering them to your application. There is
-no application-processing ACK or replay guarantee. The SDK disables automatic
+```ts
+let since: number | "latest" = "latest";
+for (;;) {
+  const result = await client.events.receive({ since, ack: "cursor" });
+  if (!result.ok) break; // retry later with the same `since`
+  await handle(result.data.events);
+  since = result.data.lastSeenSeq ?? since; // acknowledged by the next receive
+  if (result.data.events.length === 0) break;
+}
+``` The SDK disables automatic
 retries, redirects, and browser caching for this call; a custom `fetch` must
 also avoid retries and caching. Do not use receive as a health probe. Schedule
 subsequent pulls according to your application's handling and failure policy,
@@ -255,8 +565,10 @@ Raw response bodies and transport causes are never included.
 
 Sends a message through the compatibility-stable v1 endpoint. Existing request
 and response behavior is unchanged. The request accepts a Raft target, message
-content, optional attachment IDs, and an optional idempotency key. The result is
-a discriminated union:
+content, optional attachment IDs, and an optional idempotency key. Repeating a
+send with the same idempotency key returns the original message; reusing the key
+with a different target, content, or attachment set fails with HTTP 409
+(`errorCode: "idempotency_key_reused"`). The result is a discriminated union:
 
 - `ok: true` with a `sent` or `held` response.
 - `ok: false` with a `transport`, `http`, or `validation` error.