@kingcrab/pi-imessage 0.0.42 → 1.0.0

package/dist/web/style.css

@@ -0,0 +1,543 @@
+:root {
+	color-scheme: dark;
+	--nav-width: 160px;
+	--page-space: 32px;
+	--bg: #111;
+	--surface: #1a1a1a;
+	--border: #292929;
+	--text: #ccc;
+	--muted: #888;
+}
+
+*,
+*::before,
+*::after {
+	box-sizing: border-box;
+}
+
+body {
+	margin: 0;
+	background: var(--bg);
+	color: var(--text);
+	font: 13px / 1.6 monospace;
+	display: flex;
+	height: 100dvh;
+	overflow: hidden;
+}
+
+* {
+	scrollbar-width: thin;
+	scrollbar-color: #333 transparent;
+}
+
+a {
+	color: inherit;
+	text-underline-offset: 3px;
+}
+
+.app-nav {
+	width: var(--nav-width);
+	flex: 0 0 var(--nav-width);
+	padding: var(--page-space) 12px;
+	border-right: 1px solid var(--border);
+	overflow-y: auto;
+}
+
+.app-nav a {
+	display: block;
+	margin: 0 0 4px;
+	padding: 8px 12px;
+	color: var(--muted);
+	line-height: 24px;
+	white-space: nowrap;
+	text-decoration: none;
+	border-radius: 4px;
+}
+
+.app-nav a:hover {
+	color: #eee;
+	background: #191919;
+}
+
+.app-nav a.active {
+	color: #eee;
+	background: #222;
+}
+
+:focus-visible {
+	outline: 2px solid #aaa;
+	outline-offset: 2px;
+}
+
+.content {
+	flex: 1;
+	min-width: 0;
+	min-height: 0;
+	padding: var(--page-space);
+	overflow: auto;
+}
+
+.chat-list {
+	width: 220px;
+	flex: 0 0 220px;
+	padding: var(--page-space) 16px;
+	border-left: 1px solid var(--border);
+	overflow-y: auto;
+}
+
+.chat-list a {
+	display: block;
+	color: inherit;
+	text-decoration: none;
+	line-height: 2;
+	overflow: hidden;
+	text-overflow: ellipsis;
+	white-space: nowrap;
+	opacity: 0.55;
+}
+
+.chat-list a:hover,
+.chat-list a.active {
+	opacity: 1;
+}
+
+h1,
+h2,
+h3,
+strong {
+	font: inherit;
+}
+
+h1,
+h2,
+h3 {
+	margin: 0;
+}
+
+button,
+input,
+select {
+	font: inherit;
+	color: inherit;
+	background: transparent;
+	border: 1px solid #444;
+	border-radius: 3px;
+	padding: 5px 8px;
+	min-width: 0;
+	max-width: 100%;
+}
+
+select {
+	background: var(--bg);
+}
+
+button,
+summary {
+	cursor: pointer;
+}
+
+button:hover {
+	color: #eee;
+	border-color: #777;
+}
+
+.page-header {
+	display: flex;
+	align-items: center;
+	justify-content: space-between;
+	gap: 16px;
+	margin-bottom: 20px;
+}
+
+.connection {
+	display: flex;
+	align-items: center;
+	gap: 12px;
+	color: var(--muted);
+	font-size: 11px;
+}
+
+.toolbar {
+	display: flex;
+	flex-wrap: wrap;
+	gap: 10px;
+	align-items: end;
+	margin-bottom: 20px;
+}
+
+.toolbar label {
+	display: grid;
+	gap: 4px;
+	min-width: 0;
+}
+
+.toolbar .search {
+	flex: 1 1 220px;
+}
+
+.toolbar select {
+	max-width: 200px;
+}
+
+.card {
+	max-height: min(560px, 70dvh);
+	overflow: auto;
+	background: var(--surface);
+	margin-bottom: 24px;
+	scroll-margin-top: 20px;
+}
+
+.card-header {
+	padding: 12px 16px;
+	border-bottom: 1px solid var(--border);
+	display: flex;
+	align-items: center;
+	justify-content: space-between;
+	gap: 12px;
+}
+
+.card-header a {
+	text-decoration: none;
+}
+
+.meta {
+	font-size: 11px;
+	opacity: 0.5;
+}
+
+.reply-state {
+	white-space: nowrap;
+	opacity: 0.55;
+}
+
+.card-messages,
+.card-content {
+	padding: 14px 16px;
+}
+
+.card-messages {
+	max-width: 100%;
+	overflow-x: auto;
+}
+
+body.page-chat:not(.conversation-detail) .card-messages {
+	max-height: 260px;
+	overflow: auto;
+}
+
+table {
+	border-collapse: collapse;
+	width: 100%;
+}
+
+td,
+th {
+	vertical-align: top;
+	padding: 2px 0;
+	text-align: left;
+	font-weight: normal;
+}
+
+.c-fix {
+	white-space: nowrap;
+	padding-right: 8px;
+	width: 1%;
+}
+
+.c-sender {
+	text-align: right;
+}
+
+.c-time,
+.c-source,
+.c-channel {
+	opacity: 0.55;
+}
+
+.c-msg {
+	min-width: 180px;
+	white-space: pre-wrap;
+	overflow-wrap: anywhere;
+}
+
+.message-detail summary {
+	list-style: none;
+}
+
+.message-detail summary:hover {
+	text-decoration: underline;
+	text-underline-offset: 3px;
+}
+
+.message-detail[open] summary {
+	opacity: 0.5;
+	margin-bottom: 8px;
+}
+
+pre {
+	font: inherit;
+	white-space: pre-wrap;
+	overflow-wrap: anywhere;
+	margin: 0;
+}
+
+.muted,
+.empty {
+	opacity: 0.55;
+}
+
+.empty {
+	padding: 12px 0;
+}
+
+#notice {
+	border-left: 1px solid #888;
+	padding-left: 12px;
+}
+
+.native-state {
+	margin-top: 24px;
+	opacity: 0.65;
+}
+
+.native-state > pre,
+.record-details > pre {
+	max-height: min(420px, 50dvh);
+	overflow: auto;
+	margin-top: 12px;
+}
+
+.pagination {
+	display: flex;
+	gap: 16px;
+	margin: 16px 0;
+}
+
+.memory-record {
+	max-height: min(560px, 70dvh);
+	overflow: auto;
+	background: var(--surface);
+	padding: 12px 16px;
+	margin-bottom: 6px;
+	overflow-wrap: anywhere;
+}
+
+.row-head {
+	display: flex;
+	flex-wrap: wrap;
+	justify-content: space-between;
+	gap: 8px;
+	margin-bottom: 8px;
+}
+
+.memory-text {
+	white-space: pre-wrap;
+	margin: 8px 0;
+}
+
+.record-details {
+	margin-top: 8px;
+}
+
+.record-details-icon {
+	width: max-content;
+	margin-left: auto;
+	padding: 0 4px;
+	list-style: none;
+	opacity: 0.55;
+}
+
+.record-details-icon::-webkit-details-marker {
+	display: none;
+}
+
+.record-details-icon:hover {
+	opacity: 1;
+}
+
+.counts {
+	margin-bottom: 16px;
+	opacity: 0.55;
+}
+
+.setting-table th,
+.setting-table td {
+	padding: 8px 16px;
+	border-bottom: 1px solid var(--border);
+}
+
+.setting-table th {
+	width: 180px;
+	opacity: 0.55;
+}
+
+.setting-table ul {
+	padding-left: 16px;
+	margin: 0;
+}
+
+.schedule-row > .card-content {
+	overflow-x: auto;
+}
+
+body.page-logs #view {
+	display: flex;
+	flex-direction: column;
+	flex: 1;
+	min-height: 0;
+	gap: 16px;
+}
+
+body.page-logs .content {
+	display: flex;
+	flex-direction: column;
+	overflow: hidden;
+}
+
+body.page-logs .card {
+	flex: 1;
+	display: flex;
+	flex-direction: column;
+	min-height: 0;
+	margin: 0;
+	overflow: hidden;
+}
+
+body.page-logs .card-content {
+	overflow: auto;
+	flex: 1;
+}
+
+body.page-logs .native-state {
+	flex: 0 0 auto;
+	max-height: 30%;
+	overflow: auto;
+}
+
+.task-table td,
+.task-table th {
+	padding: 4px 12px 4px 0;
+}
+
+.task-tree {
+	list-style: none;
+	margin: 4px 0;
+	padding-left: 24px;
+	border-left: 1px solid var(--border);
+}
+
+.task-root {
+	padding: 14px 16px;
+	border-left: 0;
+}
+
+.task-tree li {
+	margin: 4px 0;
+}
+
+.task-tree details > pre {
+	padding: 8px 0 8px 16px;
+}
+
+.schedule-row {
+	background: var(--surface);
+	margin-bottom: 6px;
+	overflow-x: auto;
+}
+
+.schedule-summary {
+	display: grid;
+	grid-template-columns: 16px minmax(160px, 1fr) minmax(400px, 2fr) minmax(240px, 1.2fr) minmax(100px, 0.6fr);
+	min-width: 980px;
+	align-items: center;
+	gap: 10px;
+	padding: 12px 16px;
+	list-style: none;
+}
+
+.schedule-summary::-webkit-details-marker {
+	display: none;
+}
+
+.schedule-summary::before {
+	content: "+";
+	opacity: 0.55;
+}
+
+.schedule-row[open] > .schedule-summary::before {
+	content: "-";
+}
+
+.schedule-name,
+.schedule-next,
+.schedule-last,
+.schedule-status {
+	min-width: 0;
+	overflow: hidden;
+	text-overflow: ellipsis;
+	white-space: nowrap;
+}
+
+.schedule-next,
+.schedule-last,
+.schedule-status {
+	opacity: 0.55;
+	white-space: nowrap;
+}
+
+[hidden] {
+	display: none;
+}
+
+@media (max-width: 900px) {
+	.chat-list {
+		display: none;
+	}
+}
+
+@media (max-width: 600px) {
+	:root {
+		--page-space: 16px;
+	}
+
+	body {
+		flex-direction: column;
+	}
+
+	.app-nav {
+		width: 100%;
+		flex: 0 0 57px;
+		display: flex;
+		align-items: center;
+		gap: 4px;
+		padding: 8px 12px;
+		border-right: 0;
+		border-bottom: 1px solid var(--border);
+		overflow-x: auto;
+		overflow-y: hidden;
+	}
+
+	.app-nav a {
+		flex: 0 0 auto;
+		margin: 0;
+		padding: 8px 12px;
+	}
+
+	.card-header {
+		gap: 8px;
+		overflow-wrap: anywhere;
+	}
+
+	.c-time,
+	.c-source {
+		display: none;
+	}
+
+	.page-header {
+		gap: 8px;
+	}
+
+	.setting-table th {
+		width: 100px;
+	}
+}

package/dist/web/tasks.js

@@ -0,0 +1,63 @@
+import { BACKGROUND_CONTEXT } from "@earendil-works/chord/context";
+import { displayHistory, historyActivity } from "./history.js";
+/** Read one consistent tree, including terminal receipts and task-owned conversations. */
+export function readTaskTree(harness) {
+    return harness.commit(async (tx) => {
+        const conversations = [];
+        let cursor;
+        do {
+            const page = await tx.scanConversations({}, 100, cursor);
+            for (const conversation of page.items) {
+                const history = await tx.scanEntries({ conversationId: conversation.id }, 100);
+                const { groupName } = displayHistory(history, 1);
+                conversations.push({
+                    ...conversation,
+                    updatedAt: historyActivity(history),
+                    groupName: typeof groupName === "string" ? groupName : undefined,
+                });
+            }
+            cursor = page.next;
+        } while (cursor);
+        const tasks = [];
+        const assistants = new Map();
+        do {
+            const page = await tx.scanTasks({}, 100, cursor);
+            for (const task of page.items) {
+                let name;
+                const input = task.input;
+                if (task.kind === "pi.tool" && input && typeof input === "object" && !Array.isArray(input)) {
+                    if (typeof input.assistant === "number" && typeof input.callId === "string") {
+                        const id = input.assistant;
+                        if (!assistants.has(id))
+                            assistants.set(id, await tx.entry(id));
+                        for (const message of assistants.get(id)?.model ?? []) {
+                            if (message.role !== "assistant")
+                                continue;
+                            const call = message.content.find((block) => block.type === "toolCall" && block.id === input.callId);
+                            if (call?.type === "toolCall")
+                                name = call.name;
+                        }
+                    }
+                }
+                const state = task.state;
+                tasks.push({
+                    id: task.id,
+                    conversationId: task.conversationId,
+                    owner: task.owner,
+                    kind: task.kind,
+                    name,
+                    background: task.background,
+                    abortRequested: task.abortRequested,
+                    status: state.status,
+                    phase: state.checkpoint && typeof state.checkpoint === "object" && !Array.isArray(state.checkpoint)
+                        ? state.checkpoint.phase
+                        : undefined,
+                    on: state.status === "waiting" ? state.on : undefined,
+                    outcome: state.outcome?.status,
+                });
+            }
+            cursor = page.next;
+        } while (cursor);
+        return { conversations, tasks };
+    }, BACKGROUND_CONTEXT);
+}

package/docs/adr/0001-durable-owns-state.md

@@ -0,0 +1,11 @@
+# 0001. Pi Durable owns all chat state
+
+Status: accepted (2026-10-04; owner accepted 2026-10-05)
+
+**Context.** The old bot wrapped the Pi SDK in its own queue, retries, timeouts and recovery fences. The first Durable attempt (#31) then added controllers, epochs, outboxes and a supervisor around Durable, and reached 54 files and 404 tests without shipping.
+
+**Decision.** Pi Durable owns all chat state: inbox, deduplication, steering, runs, tool replay and compaction. Our code adds only what Durable cannot see: reading `chat.db` and sending through Messages.app. Use Durable as documented; don't re-check what it already guarantees.
+
+**Consequences.** The host stays small. Durable's limits become ours: one writer per storage, no power-loss guarantee. When its API changes, we update our code instead of adding shims.
+
+**Rejected.** Host-side controller, epoch and outbox layers (the `issue-31-durable` branch).

package/docs/adr/0002-module-layering.md

@@ -0,0 +1,11 @@
+# 0002. Modules in strict layers
+
+Status: accepted (2026-10-04; owner accepted 2026-10-05)
+
+**Context.** The old `src/` was flat; `agent.ts` alone was 1,536 lines, and any file could import any other.
+
+**Decision.** Folders sit in rows ([architecture.md](../architecture.md)). A row imports only rows below it. `test/architecture.test.ts` enforces this. Functions over classes; no DI.
+
+**Consequences.** Transport can be tested without an agent. Changing the agent never touches Messages code.
+
+**Rejected.** A flat `src/` (the old layout). One package per layer (too much ceremony for one app).

package/docs/adr/0003-replies-at-most-once.md

@@ -0,0 +1,11 @@
+# 0003. Replies are sent at most once
+
+Status: accepted (2026-10-04; owner accepted 2026-10-05)
+
+**Context.** Sending through Messages.app and recording it in Durable cannot be one atomic step. A crash in between either loses or repeats a reply.
+
+**Decision.** For each final answer: record `sending` in the conversation, send, then record `sent`. On restart, `sending` becomes `unknown`: it is logged and shown in the web UI, and never resent automatically; to resend, use `/send`. This covers agent replies; `/send`, cron and reminders report their result to the caller or run log.
+
+**Consequences.** A crash in that window of a few milliseconds can drop one reply. Nothing is ever sent twice.
+
+**Rejected.** Send, then record (can send twice). Confirming delivery through `chat.db` GUIDs (complex and unreliable).

package/docs/adr/0004-native-extensions.md

@@ -0,0 +1,11 @@
+# 0004. Native Durable extensions, not an SDK adapter
+
+Status: accepted (2026-10-04; owner accepted 2026-10-05)
+
+**Context.** Chats need web search, page fetch and a browser. Durable has no loader for Pi SDK extensions, and the official durable coding agent loads none; its own way to add tools is `defineTool` / `section` / `defineDoc`.
+
+**Decision.** Write the tools we use as native Durable extensions. `extensions/web.ts` provides search and readable-page fetch, with the search-result cache in a per-conversation `defineDoc` (this replaces the old `appendEntry("web-search-results")` hack and rewinds with forks and compaction). Browser work uses the `pi-browser` CLI through `bash` (the `browser` skill); no extension. We do not adapt or fork `pi-web-access` or `pi-browser-actions`. Also not loaded: `openai-codex-fast` (10 lines in `agent/harness.ts`), `claw-remote`, `tool_search` (all tools are offered directly), `pi-subagents` and `pi-goal-x` (replaced by `subagent.ts` and `/run`).
+
+**Consequences.** `web.ts` owns its search provider and fetch dependencies (e.g. `undici`, `defuddle`, `turndown`, `unpdf`), and implements only the features the bot uses, not `pi-web-access`'s full set. No fragile `ExtensionAPI` shim to break on an upstream upgrade.
+
+**Rejected.** A home-grown `ExtensionAPI` shim running `pi-web-access` unchanged (the old `headless-extensions.ts`: a fake context plus 30k bundled lines at runtime). Forking the extensions.

package/docs/adr/0005-history-migration.md

@@ -0,0 +1,11 @@
+# 0005. Import old history once; start with an empty context
+
+Status: accepted (2026-10-04; owner accepted 2026-10-05)
+
+**Context.** Old data per chat: `WORKING_DIR/<chat>/log.jsonl` (about 28,000 lines across 12 chats on claw), plus SDK sessions, goals, subagents and several GB of images.
+
+**Decision.** `migrate/migrate.ts` runs once at cutover. Each `log.jsonl` becomes user and assistant entries in that chat's conversation, followed by one reset, so the model starts with an empty context. Attachments move to `WORKING_DIR/attachments/<chat>/`, and entries keep the path. The agent searches old messages by grepping `WORKING_DIR/durable/`; the system prompt says where. SDK sessions, goals, subagents and scratch are archived once, then deleted.
+
+**Consequences.** The model doesn't remember pre-cutover talk until it searches. The web UI shows old and new history the same way.
+
+**Rejected.** Importing the SDK context (different format). A summary per chat at reset (one model call per chat). A separate archive folder.

package/docs/adr/0006-jsonl-storage.md

@@ -0,0 +1,11 @@
+# 0006. One JSONL storage, backed up by hand
+
+Status: accepted (2026-10-04; owner accepted 2026-10-05)
+
+**Context.** Durable can store to memory, SQLite or JSONL. The owner backs up `WORKING_DIR` with git in their dotfiles.
+
+**Decision.** One JSONL storage at `WORKING_DIR/durable/` for all chats, with `fsync` on. A lock file stops a second process from opening it, since Durable has no cross-process lock. The bot runs no backup job.
+
+**Consequences.** Readable text diffs in git. Not every change is an append: Durable rewrites its side files when it reclaims them. A copy taken mid-write still opens, because Durable drops an unfinished tail.
+
+**Rejected.** SQLite (a binary file in git). One storage per chat (more files and locks, and no cross-chat tasks).

package/docs/adr/0007-images-by-path.md

@@ -0,0 +1,11 @@
+# 0007. Store images as file paths
+
+Status: accepted (2026-10-04; owner accepted 2026-10-05)
+
+**Context.** Durable stores images inside entries as base64. Old chats hold several GB of images; inlining them would bloat `durable/` and the dotfiles backup. Durable's `read` tool cannot read images yet.
+
+**Decision.** Incoming images are saved under `attachments/<chat>/` (HEIC converted to JPEG), and the user entry carries the path. `extensions/read-image.ts` extends `read`: for an image path it returns the image, resized for the model.
+
+**Consequences.** Looking at an image costs the model one extra tool call. `durable/` stays text.
+
+**Rejected.** Inline base64 (Durable's default).

package/docs/adr/0008-compaction-and-run.md

@@ -0,0 +1,11 @@
+# 0008. Compact every 6 hours; `/run` replaces `/goal`
+
+Status: accepted (2026-10-04; owner accepted 2026-10-05)
+
+**Context.** The old bot reset every chat nightly, and used `pi-goal-x` for long tasks, which brought task trees, contracts and reviewers we don't need.
+
+**Decision.** Every 6 hours, each chat with new entries since its last compaction is compacted in the background; no chat notifications. Durable's automatic compaction near the context limit stays on. `/run <duration> [task]` keeps the run going through an `onYield` hook until the task is done, the user is needed, or the deadline passes. One run per conversation; `/run-stop`, `/stop` and `/new` end it; it does not survive a restart.
+
+**Consequences.** Context is never wiped on a schedule. `/run` spends tokens until it stops.
+
+**Rejected.** Nightly reset. Migrating `pi-goal-x`.

package/docs/adr/0009-one-shot-cutover.md

@@ -0,0 +1,11 @@
+# 0009. Switch over in one step
+
+Status: accepted (2026-10-04; owner accepted 2026-10-05)
+
+**Context.** Running old and new pipelines side by side (a per-chat canary) needs guards against processing a message twice. That was much of #31's complexity.
+
+**Decision.** Build in a new repository, `pi-imessage-next`. At cutover: stop the old service, run the migration (which also saves the current `chat.db` row as the watch cursor), start the new service, then push the new code to `daya0576/pi-imessage` as one commit. Rollback: stop the new service, restore the `WORKING_DIR` backup, start the old release.
+
+**Consequences.** Minutes of downtime; messages that arrive meanwhile are picked up from the cursor, and losing a few is acceptable. No code for running two pipelines.
+
+**Rejected.** Per-chat canary.