dsh-mobilecode 0.6.0 → 0.7.0

package/README.md

@@ -93,8 +93,10 @@ drawer:
   tap can address. Values are single-quoted for the device shell (apostrophes
   escaped, control characters refused), so metacharacters stay inert.
 - `device_stream` — drive the live screen stream the panel shows: `start` an
-  online device (returns a signed `streamUrl`), `status`, or `stop`. Agents that
-  just need to see the screen should prefer `device_screen` / `device_ui_tree`.
+  online device (returns a signed `streamUrl` **and** an `android-stream`
+  `presentationMeta` that renders a compact conversation card and auto-opens the
+  panel), `status`, or `stop`. Agents that just need to see the screen should
+  prefer `device_screen` / `device_ui_tree`.
 
 **Live device stream (the panel)**
 
@@ -110,9 +112,20 @@ The Devices pane shows a real-time mirror of the attached device. It is produced
   frames instead of building an unbounded queue or watching a growing delay.
 - A consumer refcount + idle timeout stops the loop when nobody is watching; a
   keep-alive restarts a crashed loop; switching devices retires the old child.
-- **Tap or drag directly on the screen** to drive the device; a Back / Home /
-  Recents / Rotate / Power bar sits below it, and a device picker switches which
-  online device streams (it never boots one — use `device_boot` for that).
+- **Tap or drag directly on the screen** to drive the device: a short press is a
+  tap, a long drag becomes a swipe carrying the real press duration (clamped
+  0–5000 ms), coalesced into one control call. A floating **pill toolbar** of SVG
+  icons (Back / Home / Recents / Screenshot / Rotate / Refresh) sits over the
+  stage, and a ☰ **device menu** adds notifications / quick settings / collapse /
+  lock / wake / assistant.
+- The header **device picker** groups online devices (🖥 emulator / 📱 physical,
+  streaming badge) and lists configured AVDs as boot hints (`device_boot` starts
+  one — the picker never does); a **Live** badge shows the streamed serial. Quick
+  sizes (Fit / 100% / S·240 / M·320 presets + a select) and frame styles
+  (none / bezel / device) reshape the stage.
+- **Screenshot** captures a still via `POST /stream/still` (a real `screencap`,
+  embedded as a data URL up to 4 MB) and flips the stage to a still view with a
+  "back to Live" link.
 - **Security**: every stream route sits behind a loopback + trusted-browser
   transport fence (peer address, loopback `Host`, `Sec-Fetch-Site` / `Origin` —
   so a LAN client cannot spoof localhost and a DNS-rebinding `Host` is rejected),
@@ -166,6 +179,44 @@ classified adb boundary (argv-based, quoted, replay-safe):
 - `device_reboot` — reboot into `normal` / `recovery` / `bootloader`
   (the device drops offline and comes back in a minute or two).
 
+**Row & memory tools (v0.7.0)** — ported from
+[ZSeven-W/dsh-android](https://github.com/ZSeven-W/dsh-android):
+
+- `device_ui_rows` — read a list as **rows, not a tree**: clusters repeated
+  sibling nodes of similar height (≥3 rows; page-sized containers and off-screen
+  nodes excluded), aggregates each row's label, and parses counters (`3万`,
+  `1.2k`, `42 items`) into `{key, value, raw}`. Returns
+  `{rows: [{index, group, frame, label, counters}], omittedOffscreen}` — the
+  compact handle for "tap row 7 of this list" without reading a 40 KB UI tree.
+  Optional `filter` keeps rows whose label contains a substring.
+- `device_tap_row` — tap row `index` (from `device_ui_rows`) at row-relative
+  fractions `x`/`y` (default 0.5,0.5 = center). `expect_count {key, delta}` turns
+  the tap into **one verified round trip**: the counter must already be visible
+  in the row before the tap (refused otherwise — never probe an unknown control),
+  and after an 800 ms settle the same row must show the count moved by exactly
+  `delta` (default +1) with the row not having scrolled.
+- `device_meminfo` — a running app's memory profile from `dumpsys meminfo`:
+  TOTAL PSS/RSS/Swap-PSS, the App Summary heap breakdown
+  (Java/Native/Code/Stack/Graphics) and the top PSS categories. Throws when the
+  package has no running process.
+- `device_backtrace` — a thread/crash dump without a debugger: sends SIGQUIT
+  (`kill -3`), waits for ART to write the trace, reads the newest `/data/anr`
+  entry, and falls back to the logcat crash buffer when `/data/anr` is unreadable
+  (`engine: "anr-trace" | "logcat-crash"`). Pass `package_name` or `pid`.
+
+**Conversation surface (v0.7.0)** — the transcript integration ported from
+dsh-android's UI/UX:
+
+- A settled `device_stream` / `device_boot` call renders a **compact card** in
+  the conversation (kind, serial, streaming/failed badge, "⤢ open in panel")
+  instead of a raw JSON blob, and **auto-opens the Devices panel once** when a
+  stream first settles. The card hydrates from the host-projected
+  `presentationMeta` on top-level calls and falls back to parsing the serial out
+  of the durable result text for nested calls; it never crashes on a shape it
+  does not recognize.
+- A **composer capsule** — a green `● <serial>` pill in the input dock — shows
+  while a device streams and the panel is closed; clicking it opens the panel.
+
 **First-run experience & settings**
 
 - On first start after installation, a **welcome window** explains how to use the
@@ -200,7 +251,18 @@ classified adb boundary (argv-based, quoted, replay-safe):
 group — plus setup endpoints: `GET /welcome`, `POST /welcome/dismiss`,
 `GET /doctor`, `POST /doctor/fix {id}`, `GET /ocr`, `POST /ocr/install`,
 `GET/POST /settings`, `GET /connection` — plus the Wi-Fi actions
-`POST /connect` (host/port/pairing code) and `POST /pair-qr` (mDNS QR flow).
+`POST /connect` (host/port/pairing code) and `POST /pair-qr` (mDNS QR flow) —
+plus the live-stream routes `GET /stream/status`, `POST /stream/grant`,
+`POST /stream/control` (tap / swipe / key / long-press, coalesced),
+`POST /stream/devices` (online devices **and** configured AVDs),
+`POST /stream/still` (one `screencap` as a data URL up to 4 MB),
+`POST /stream/device-action` (the `device_action` verbs over the panel fence)
+and `GET /stream/{token}` (the multipart frame body). Every stream error carries
+a machine-readable `code` next to the HTTP status — `token_invalid`,
+`stream_not_running`, `stream_start_failed`, `devices_unavailable`,
+`device_not_found`, `device_offline`, `unknown_action`, `bad_request`,
+`control_failed`, `capture_failed`, `device_action_failed` — so the panel can
+say *why* instead of "something failed".
 
 **One classified adb boundary** — every serial-targeted adb command runs through
 `adbRun()` in `lib/device-build.js`:

package/lib/client.js

@@ -134,6 +134,41 @@ window.__ModuleLoader__.load({
 .mc-qr { margin: 8px 0; padding: 8px; border: 1px dashed light-dark(rgba(0,0,0,.25), rgba(255,255,255,.3)); border-radius: 8px; }
 .mc-qr-text { user-select: all; font-family: ui-monospace, Consolas, monospace; font-size: 12px; word-break: break-all; margin: 4px 0 0; }
 .mc-warn { color: #b3261e; font-size: 12px; margin: 6px 0; }
+/* ── 0.7.0: toolbar pill, picker popover, device menu, sizes, frames ── */
+.mc-toolbar { display: flex; align-items: center; justify-content: center; gap: 2px; padding: 3px; border: 1px solid light-dark(rgba(0,0,0,.16), rgba(255,255,255,.18)); border-radius: 999px; background: light-dark(rgba(0,0,0,.03), rgba(255,255,255,.05)); align-self: center; }
+.mc-toolbar button { display: inline-flex; align-items: center; justify-content: center; width: 32px; height: 28px; border: 0; background: transparent; color: inherit; border-radius: 999px; cursor: pointer; opacity: .8; }
+.mc-toolbar button:hover:not(:disabled) { background: light-dark(rgba(0,0,0,.08), rgba(255,255,255,.12)); opacity: 1; }
+.mc-toolbar button:disabled { opacity: .3; cursor: default; }
+.mc-toolbar svg { display: block; }
+.mc-live-badge { display: inline-flex; align-items: center; gap: 5px; font-size: 11px; font-weight: 600; color: #4caf50; }
+.mc-picker { position: relative; }
+.mc-picker .mc-btn { max-width: 180px; overflow: hidden; text-overflow: ellipsis; white-space: nowrap; }
+.mc-picker-pop { position: absolute; top: calc(100% + 4px); right: 0; z-index: 50; min-width: 240px; max-width: 320px; max-height: 320px; overflow: auto; background: light-dark(#fff, #20242b); color: inherit; border: 1px solid light-dark(rgba(0,0,0,.16), rgba(255,255,255,.2)); border-radius: 10px; box-shadow: 0 8px 30px rgba(0,0,0,.35); padding: 6px; display: flex; flex-direction: column; gap: 6px; }
+.mc-picker-group { display: flex; flex-direction: column; gap: 2px; }
+.mc-picker-label { font-size: 10px; text-transform: uppercase; letter-spacing: .06em; color: light-dark(#6b7078, #9aa0a8); padding: 2px 6px; }
+.mc-picker-row { display: flex; align-items: center; gap: 8px; padding: 6px 8px; border: 1px solid transparent; border-radius: 7px; background: transparent; color: inherit; font: inherit; font-size: 12px; cursor: pointer; text-align: left; }
+.mc-picker-row:hover { background: light-dark(rgba(0,0,0,.06), rgba(255,255,255,.1)); }
+.mc-picker-row.on { background: light-dark(rgba(66,133,244,.12), rgba(66,133,244,.22)); }
+.mc-picker-hint { font-size: 11px; color: light-dark(#6b7078, #9aa0a8); padding: 4px 8px; }
+.mc-menu-pop { position: absolute; top: calc(100% + 4px); right: 0; z-index: 50; min-width: 180px; background: light-dark(#fff, #20242b); color: inherit; border: 1px solid light-dark(rgba(0,0,0,.16), rgba(255,255,255,.2)); border-radius: 10px; box-shadow: 0 8px 30px rgba(0,0,0,.35); padding: 4px; display: flex; flex-direction: column; }
+.mc-menu-pop button { display: flex; align-items: center; gap: 8px; padding: 7px 10px; border: 0; border-radius: 7px; background: transparent; color: inherit; font: inherit; font-size: 12px; cursor: pointer; text-align: left; }
+.mc-menu-pop button:hover { background: light-dark(rgba(0,0,0,.06), rgba(255,255,255,.1)); }
+.mc-menu { position: relative; }
+.mc-live-sizesel { flex: 0 1 auto; width: 92px; }
+.mc-live-size { display: flex; align-items: center; gap: 6px; flex-wrap: wrap; }
+.mc-seg { display: inline-flex; border: 1px solid light-dark(rgba(0,0,0,.18), rgba(255,255,255,.2)); border-radius: 8px; overflow: hidden; }
+.mc-seg button { border: 0; background: transparent; color: inherit; font: inherit; font-size: 11px; padding: 4px 9px; cursor: pointer; opacity: .6; }
+.mc-seg button[data-on] { background: light-dark(rgba(66,133,244,.12), rgba(66,133,244,.22)); color: #4285f4; opacity: 1; }
+.mc-live-stage.bezel { padding: 8px; background: #111; border-radius: 16px; }
+.mc-live-stage.device { padding: 12px; background: linear-gradient(145deg, #2c2f36, #17191d); border-radius: 26px; box-shadow: 0 10px 30px rgba(0,0,0,.45); }
+/* ── 0.7.0: compact conversation cards ── */
+.mc-card-compact { display: flex; align-items: center; gap: 8px; padding: 8px 12px; border: 1px solid light-dark(rgba(0,0,0,.12), rgba(255,255,255,.16)); border-radius: 10px; font-size: 12px; background: light-dark(rgba(0,0,0,.02), rgba(255,255,255,.03)); }
+.mc-card-compact .mc-card-kind { font-weight: 700; }
+.mc-badge.ok { background: rgba(76,175,80,.16); color: #4caf50; }
+.mc-card-open { font-size: 11px; color: #4285f4; cursor: pointer; border: 0; background: transparent; padding: 2px 4px; font: inherit; }
+/* ── 0.7.0: composer status capsule ── */
+.mc-capsule { display: inline-flex; align-items: center; gap: 6px; padding: 6px 12px; border: 1px solid rgba(76,175,80,.4); border-radius: 999px; background: rgba(76,175,80,.1); color: #4caf50; font: inherit; font-size: 12px; font-weight: 600; cursor: pointer; }
+.mc-capsule:hover { background: rgba(76,175,80,.18); }
 `;
 		//#endregion
 
@@ -372,13 +407,99 @@ window.__ModuleLoader__.load({
 			);
 		}
 
-		/** Live device stream: an <img> fed by the in-process multipart route, with
-		 *  tap/drag control and the Back/Home/Recents/rotate/power nav bar. */
+		// 0.7.0: the conversation cards (tool.call.toolview) and the composer
+		// capsule (conversation.input.dock) live outside our panel tree, so the
+		// controller they need to open the panel is a module-level reference set
+		// by apply() before the slots register. Auto-open fires exactly once per
+		// page load (a settled boot/stream card opens the panel).
+		let activeController = null;
+		let autoOpenedOnce = false;
+		/** Stable stand-in store so the capsule hooks are unconditional even before apply() runs. */
+		const DUMMY_STORE = { subscribe: () => () => {}, getSnapshot: () => ({ panelOpen: true }) };
+
+		/** Extract text from a tool-result block (string content or pages of {type,text}). */
+		function blockText(block) {
+			if (typeof block?.content === "string") return block.content;
+			if (Array.isArray(block?.content)) return block.content.map((c) => (typeof c?.text === "string" ? c.text : "")).join("\n");
+			return "";
+		}
+
+		/** Compact conversation card for tools that emit android-stream meta.
+		 *  ToolCallBlock model (matches the rc.6 runtime): a settled result has
+		 *  `kind: "tool-result"` + `isError`; a running block has neither, so it
+		 *  resolves here to null and the runtime's own running UI shows. */
+		function MobileCodeToolCard(props) {
+			const block = props?.block ?? null;
+			const toolName = props?.toolName ?? block?.toolName ?? "";
+			const settled = block !== null && typeof block === "object" && "kind" in block;
+			const error = settled && block.isError === true;
+			// block.meta IS the host-projected presentationMeta envelope (see
+			// dsh-android parseAndroidMeta). Nested calls that carry no meta fall
+			// back to hydrating the serial from the durable text.
+			const meta = settled && !error ? block?.meta ?? null : null;
+			const kind = meta?.kind ?? null;
+			const serial = meta?.device?.serial
+				?? (/(emulator-\d+|(?:RFC[0-9A-F]{7,}|[A-Za-z0-9]{6,}))/i.exec(blockText(block))?.[1] ?? "");
+			// Auto-open the panel once when a stream settles (boot/stream start).
+			useEffect(() => {
+				if (settled && kind === "android-stream" && !autoOpenedOnce && activeController) {
+					autoOpenedOnce = true;
+					activeController.setOpen(true);
+				}
+			}, [settled, kind]);
+			if (!settled || kind !== "android-stream") return null;
+			const badge = error ? "failed" : "streaming";
+			return h("div", { className: "mc-card-compact" },
+				h("span", { className: "mc-card-kind" }, "Android stream"),
+				serial !== "" && h("span", { className: "mc-serial" }, serial),
+				h("span", { className: "mc-badge" + (error ? " err" : " ok") }, badge),
+				h("span", { className: "sp" }),
+				activeController && h("button", { className: "mc-card-open", onClick: () => activeController.setOpen(true) }, "⤢ open in panel"),
+			);
+		}
+
+		/** Composer capsule: green "● <serial>" pill while a device streams and the panel is closed. */
+		function MobileCodeStatusCapsule() {
+			const [running, setRunning] = useState(false);
+			const [status, setStatus] = useState(null);
+			const store = activeController ?? DUMMY_STORE;
+			const { panelOpen } = useSyncExternalStore(store.subscribe, store.getSnapshot);
+			const poll = async () => {
+				try {
+					const r = await streamPost("/stream/status", {});
+					setRunning(r.running === true);
+					setStatus(r);
+				} catch {
+					setRunning(false);
+					setStatus(null);
+				}
+			};
+			useEffect(() => {
+				poll();
+				const timer = setInterval(() => { if (!panelOpen) poll(); }, 5000);
+				return () => clearInterval(timer);
+			}, [panelOpen]);
+			if (!running || panelOpen) return null;
+			return h("button", { className: "mc-capsule", onClick: () => activeController?.setOpen(true) },
+				h("span", { className: "mc-dot on" }),
+				h("span", null, status?.serial ?? "device stream"),
+			);
+		}
+
+		/** Live device stream: picker-popover header, SVG toolbar pill, device
+		 *  menu, quick sizes + frame styles, and tap/drag with duration. */
 		function LiveDeviceCard() {
 			const [devices, setDevices] = useState([]);
+			const [avds, setAvds] = useState([]);
 			const [serial, setSerial] = useState("");
 			const [streamUrl, setStreamUrl] = useState("");
 			const [error, setError] = useState("");
+			const [pickerOpen, setPickerOpen] = useState(false);
+			const [menuOpen, setMenuOpen] = useState(false);
+			const [still, setStill] = useState(null);
+			const [view, setView] = useState("live"); // 'live' | 'still'
+			const [sizeMode, setSizeMode] = useState({ mode: "fit" }); // {mode:'fit'|'pct'|'px', value?}
+			const [frame, setFrame] = useState("none"); // 'none' | 'bezel' | 'device'
 			const imgRef = useRef(null);
 			const dragRef = useRef(null);
 			const grantTimer = useRef(null);
@@ -406,6 +527,7 @@ window.__ModuleLoader__.load({
 				try {
 					const r = await streamPost("/stream/devices", {});
 					setDevices(r.devices);
+					setAvds(r.avds ?? []);
 					setSerial((cur) => cur || (r.devices.find((d) => d.streaming)?.serial ?? r.devices[0]?.serial ?? ""));
 				} catch (err) {
 					setError(err instanceof Error ? err.message : String(err));
@@ -418,8 +540,8 @@ window.__ModuleLoader__.load({
 				return () => { clearInterval(timer); clearTimeout(grantTimer.current); };
 			}, []);
 
-			// Auto-grant once a serial is known but no stream is up yet.
-			useEffect(() => { if (serial !== "" && streamUrl === "") grant(serial).catch(() => {}); }, [serial, streamUrl]);
+			// Auto-grant once a serial is known, no stream, and we're in live view.
+			useEffect(() => { if (serial !== "" && streamUrl === "" && view === "live") grant(serial).catch(() => {}); }, [serial, streamUrl, view]);
 
 			const control = async (action) => {
 				if (serial === "") return;
@@ -437,50 +559,158 @@ window.__ModuleLoader__.load({
 					y: Math.min(1, Math.max(0, (clientY - rect.top) / rect.height)),
 				};
 			};
-			const onDown = (e) => { const p = norm(e.clientX, e.clientY); if (p) dragRef.current = p; };
+			// Gesture coalescing: remember the down point + timestamp; on up,
+			// taps (<2% travel) vs drags keep the real duration (clamped 0..5s).
+			const onDown = (e) => { const p = norm(e.clientX, e.clientY); if (p) dragRef.current = { ...p, t: Date.now() }; };
 			const onUp = (e) => {
 				const start = dragRef.current;
 				dragRef.current = null;
 				const end = norm(e.clientX, e.clientY);
 				if (!start || !end) return;
+				const durationMs = Math.max(0, Math.min(5000, Date.now() - start.t));
 				if (Math.hypot(end.x - start.x, end.y - start.y) > 0.02) {
-					control({ kind: "drag", fromX: start.x, fromY: start.y, toX: end.x, toY: end.y });
+					control({ kind: "drag", fromX: start.x, fromY: start.y, toX: end.x, toY: end.y, durationMs });
 				} else {
 					control({ kind: "tap", x: end.x, y: end.y });
 				}
 			};
 
+			const capture = async () => {
+				if (serial === "") return;
+				try {
+					const r = await streamPost("/stream/still", { device: serial });
+					if (r.dataUrl) {
+						setStill(r);
+						setView("still");
+						setError("");
+					} else {
+						setStill(null);
+						setView("live");
+						setError("still saved to " + (r.path ?? "a temp file") + " but too large to embed here");
+					}
+				} catch (err) {
+					setError(err instanceof Error ? err.message : String(err));
+				}
+			};
+
+			const menuAction = async (action) => {
+				if (serial === "") return;
+				try { await streamPost("/stream/device-action", { device: serial, action }); setMenuOpen(false); }
+				catch (err) { setError(err instanceof Error ? err.message : String(err)); }
+			};
+
+			const pick = (device) => { setSerial(device); setStreamUrl(""); setStill(null); setView("live"); setError(""); setPickerOpen(false); };
+			const showLive = () => { setView("live"); if (serial !== "" && streamUrl === "") grant(serial).catch(() => {}); };
+
+			const sizeStyle = sizeMode.mode === "pct"
+				? { width: sizeMode.value + "%", maxWidth: "100%", maxHeight: "60vh" }
+				: sizeMode.mode === "px"
+					? { width: sizeMode.value + "px", maxWidth: "100%", maxHeight: "60vh" }
+					: {};
+			const stageClass = "mc-live-stage" + (frame !== "none" ? " " + frame : "");
+			const toolbar = [
+				{ title: "Back", icon: "M15 18l-6-6 6-6", run: () => control({ kind: "button", name: "back" }) },
+				{ title: "Home", icon: "M3 10.5L12 3l9 7.5M5 9.5V21h14V9.5", run: () => control({ kind: "button", name: "home" }) },
+				{ title: "Recents", icon: "M12 3l9 5-9 5-9-5 9-5zM3 13l9 5 9-5", run: () => control({ kind: "button", name: "recents" }) },
+				{ title: "Screenshot", icon: "M4 7h4l2-3h4l2 3h4v13H4zM12 17a3 3 0 1 0 0-6 3 3 0 0 0 0 6z", run: () => capture() },
+				{ title: "Rotate", icon: "M21 12a9 9 0 1 1-2.6-6.3M21 3v6h-6", run: () => control({ kind: "rotate" }) },
+				{ title: "Refresh", icon: "M21 12a9 9 0 1 1-2.6-6.3M21 3v6h-6", run: () => { if (serial !== "") grant(serial).catch(() => {}); } },
+			];
+			const menuItems = [
+				{ action: "notifications", label: "Notifications" },
+				{ action: "quick_settings", label: "Quick settings" },
+				{ action: "collapse", label: "Collapse" },
+				{ action: "lock", label: "Lock" },
+				{ action: "wake", label: "Wake" },
+				{ action: "assistant", label: "Assistant" },
+			];
+			const SIZE_PRESETS = [
+				{ label: "Fit", mode: { mode: "fit" } },
+				{ label: "100%", mode: { mode: "pct", value: 100 } },
+				{ label: "S · 240", mode: { mode: "px", value: 240 } },
+				{ label: "M · 320", mode: { mode: "px", value: 320 } },
+			];
+			const isCurrent = (m) => m.mode === sizeMode.mode && (m.value === undefined || m.value === sizeMode.value);
+
 			return h("div", { className: "mc-card mc-live" },
 				h("div", { className: "mc-card-head" },
 					h("span", null, "Live device"),
+					streamUrl !== "" && h("span", { className: "mc-live-badge" }, h("span", { className: "mc-dot on" }), "Live"),
 					h("span", { className: "sp" }),
-					devices.length > 0
-						? h("select", {
-							value: serial,
-							onChange: (e) => { setSerial(e.target.value); setStreamUrl(""); setError(""); },
-						}, devices.map((d) => h("option", { key: d.serial, value: d.serial }, d.serial + (d.kind === "emulator" ? " · emu" : " · phone"))))
-						: h("span", { className: "mc-hint" }, "no device"),
-					h("button", { className: "mc-btn", disabled: serial === "", onClick: () => grant(serial) }, "Reconnect"),
+					h("div", { className: "mc-picker" },
+						h("button", { className: "mc-btn", onClick: () => setPickerOpen((v) => !v) }, serial || "no device", " ▾"),
+						pickerOpen && h("div", { className: "mc-picker-pop" },
+							devices.length > 0
+								? h("div", { className: "mc-picker-group" },
+									h("div", { className: "mc-picker-label" }, "Online devices"),
+									devices.map((d) => h("button", { key: d.serial, className: "mc-picker-row" + (d.serial === serial ? " on" : ""), onClick: () => pick(d.serial) },
+										h("span", null, d.kind === "emulator" ? "🖥" : "📱"),
+										h("span", { className: "mc-serial" }, d.serial),
+										d.streaming && h("span", { className: "mc-badge" }, "streaming"),
+									)),
+								)
+								: h("div", { className: "mc-picker-hint" }, "No device attached"),
+							avds.length > 0 && h("div", { className: "mc-picker-group" },
+								h("div", { className: "mc-picker-label" }, "AVDs — start with device_boot"),
+								avds.map((avd) => h("div", { key: avd, className: "mc-picker-hint" }, "▫ " + avd)),
+							),
+						),
+					),
+					h("div", { className: "mc-menu" },
+						h("button", { className: "mc-btn", disabled: serial === "", title: "Device actions", onClick: () => setMenuOpen((v) => !v) }, "☰"),
+						menuOpen && h("div", { className: "mc-menu-pop" },
+							menuItems.map((item) => h("button", { key: item.action, onClick: () => menuAction(item.action) }, item.label)),
+						),
+					),
 				),
 				error !== "" && h("div", { className: "mc-error" }, error),
-				h("div", { className: "mc-live-stage" },
-					streamUrl !== ""
-						? h("img", { ref: imgRef, src: streamUrl, alt: "device screen", draggable: false, onPointerDown: onDown, onPointerUp: onUp, onError: () => grant(serial) })
-						: h("div", { className: "mc-live-off" }, devices.length === 0
-							? "No device attached. Boot one with device_boot, or press Run app."
-							: "Connecting to " + serial + "…"),
+				h("div", { className: "mc-toolbar" },
+					toolbar.map((item) => h("button", { key: item.title, title: item.title, disabled: serial === "", onClick: item.run },
+						h("svg", { width: 16, height: 16, viewBox: "0 0 24 24", fill: "none", stroke: "currentColor", strokeWidth: 2, strokeLinecap: "round", strokeLinejoin: "round" },
+							h("path", { d: item.icon }),
+						),
+					)),
+				),
+				h("div", { className: stageClass },
+					view === "still" && still?.dataUrl
+						? h("img", { src: still.dataUrl, alt: "still capture", draggable: false })
+						: streamUrl !== ""
+							? h("img", { ref: imgRef, src: streamUrl, alt: "device screen", style: sizeStyle, draggable: false, onPointerDown: onDown, onPointerUp: onUp, onError: () => grant(serial) })
+							: h("div", { className: "mc-live-off" }, devices.length === 0
+								? "No device attached. Boot one with device_boot, or press Run app."
+								: "Connecting to " + serial + "..."),
 				),
-				h("div", { className: "mc-live-nav" },
-					h("button", { title: "Back", disabled: serial === "", onClick: () => control({ kind: "button", name: "back" }) }, "◁"),
-					h("button", { title: "Home", disabled: serial === "", onClick: () => control({ kind: "button", name: "home" }) }, "○"),
-					h("button", { title: "Recents", disabled: serial === "", onClick: () => control({ kind: "button", name: "recents" }) }, "▢"),
-					h("button", { title: "Rotate", disabled: serial === "", onClick: () => control({ kind: "rotate" }) }, "⟳"),
-					h("button", { title: "Power", disabled: serial === "", onClick: () => control({ kind: "button", name: "power" }) }, "⏻"),
+				view === "still"
+					? h("div", { className: "mc-live-cap" }, "Still captured" + (still?.width ? " (" + still.width + "x" + still.height + ")" : "") + " · ",
+						h("a", { className: "mc-log-toggle", onClick: showLive }, "back to Live"))
+					: h("div", { className: "mc-live-cap" }, "tap or drag on the screen to drive the device"),
+				h("div", { className: "mc-live-size" },
+					h("span", { className: "mc-hint" }, "Size"),
+					h("div", { className: "mc-seg" }, SIZE_PRESETS.map((p) => h("button", { key: p.label, "data-on": isCurrent(p.mode) || undefined, onClick: () => setSizeMode(p.mode) }, p.label))),
+					h("select", { className: "mc-input mc-live-sizesel", value: sizeMode.mode === "pct" ? sizeMode.value + "%" : sizeMode.mode === "px" ? String(sizeMode.value) : "fit", onChange: (e) => {
+						const v = e.target.value;
+						if (v === "fit") setSizeMode({ mode: "fit" });
+						else if (v.endsWith("%")) setSizeMode({ mode: "pct", value: Number(v.slice(0, -1)) });
+						else setSizeMode({ mode: "px", value: Number(v) });
+					} },
+						h("option", { value: "fit" }, "fit"),
+						h("option", { value: "50%" }, "50%"),
+						h("option", { value: "75%" }, "75%"),
+						h("option", { value: "100%" }, "100%"),
+						h("option", { value: "125%" }, "125%"),
+						h("option", { value: "240" }, "S · 240px"),
+						h("option", { value: "320" }, "M · 320px"),
+						h("option", { value: "420" }, "L · 420px"),
+					),
+					h("span", { className: "mc-hint" }, "Frame"),
+					h("div", { className: "mc-seg" },
+						h("button", { "data-on": frame === "none" || undefined, onClick: () => setFrame("none") }, "none"),
+						h("button", { "data-on": frame === "bezel" || undefined, onClick: () => setFrame("bezel") }, "bezel"),
+						h("button", { "data-on": frame === "device" || undefined, onClick: () => setFrame("device") }, "device"),
+					),
 				),
-				h("div", { className: "mc-live-cap" }, "tap or drag on the screen to drive the device"),
 			);
 		}
-
 		//#region setup UI (welcome + settings)
 
 		/** PaddleOCR status card: fetch /ocr, Install button, log tail. */
@@ -1018,6 +1248,7 @@ window.__ModuleLoader__.load({
 			styleGuard.observe(document.head, { childList: true });
 
 			const controller = new PanelController();
+			activeController = controller;
 			const disposers = [];
 			try {
 				disposers.push(mountSidebarEntry(controller));
@@ -1035,6 +1266,32 @@ window.__ModuleLoader__.load({
 						}, SettingsSection),
 					);
 					disposers.push(disposeSlot);
+					// 0.7.0: compact conversation card under a settled device_stream /
+					// device_boot result (opens the panel on "⤢ open in panel", and
+					// auto-opens it once when a stream first settles). One slot per
+					// tool name keyed like the reference port (openpencil shape):
+					// `key: toolName` scopes the card to that tool's calls, so other
+					// tools keep their default card.
+					for (const toolName of ["device_stream", "device_boot"]) {
+						const disposeCard = ctx.slots.inject("tool.call.toolview", () =>
+							ctx.slots.register({
+								name: "tool.call.toolview",
+								key: toolName,
+							}, MobileCodeToolCard),
+						);
+						disposers.push(disposeCard);
+					}
+					// 0.7.0: green "● <serial>" composer capsule while a device
+					// streams; clicking it opens the panel. Registered unconditionally
+					// so the capsule can appear even before any card auto-opens.
+					const disposeCapsule = ctx.slots.inject("conversation.input.dock", () =>
+						ctx.slots.register({
+							name: "conversation.input.dock",
+							id: "dsh-mobilecode-status",
+							order: 40,
+						}, MobileCodeStatusCapsule),
+					);
+					disposers.push(disposeCapsule);
 				}
 			} catch (error) {
 				console.warn("[dsh-mobilecode] mount failed:", error);
@@ -1042,6 +1299,8 @@ window.__ModuleLoader__.load({
 			ctx.effect(() => () => {
 				styleGuard.disconnect();
 				for (const dispose of disposers.splice(0)) dispose();
+				activeController = null;
+				autoOpenedOnce = false;
 				style.remove();
 			}, "dsh-mobilecode: ui mounts");
 		}

package/lib/device-build.js

@@ -912,6 +912,83 @@ export function parseCpuinfo(output) {
   return { cores: cores > 0 ? cores : undefined, hardware }
 }
 
+/**
+ * Deep-clean a parsed value for a DSH tool output: drop `undefined` keys (and
+ * undefined array holes) and turn non-finite numbers into `null`, so the value
+ * round-trips JSON losslessly (DSH rejects outputs that lose keys/values on
+ * serialize). Leaves everything else untouched; primitives pass through.
+ */
+export function jsonSafe(value) {
+  if (Array.isArray(value)) {
+    const out = []
+    for (const item of value) {
+      if (item !== undefined) out.push(jsonSafe(item))
+    }
+    return out
+  }
+  if (value !== null && typeof value === "object") {
+    const out = {}
+    for (const [key, item] of Object.entries(value)) {
+      if (item !== undefined) out[key] = jsonSafe(item)
+    }
+    return out
+  }
+  if (typeof value === "number" && !Number.isFinite(value)) return null
+  return value
+}
+
+/**
+ * Parse `dumpsys meminfo <pkg>` into {totalPssKb, totalRssKb, totalSwapPssKb,
+ * appSummary, topCategories}. The dumpsys layout (Android 10+):
+ *   - "TOTAL PSS:" / "TOTAL RSS:" / "TOTAL SWAP PSS:" summary line;
+ *   - "App Summary" section with one line per heap bucket (Java/Native/Code/
+ *     Stack/Graphics), first column = PSS total;
+ *   - a category breakdown whose rows are `  Name  pss  privDirty  privClean  swapDirty`
+ *     (heap rows add Heap Size/Alloc/Free columns). Rows are only EVIDENCE:
+ *     the parser keeps the top PSS rows and drops header/dashed/TOTAL lines.
+ * Returns undefined when the requested process is absent ("No process found").
+ */
+export function parsePackageMeminfo(output) {
+  const text = String(output)
+  const blockIndex = text.indexOf("** MEMINFO in pid")
+  if (blockIndex < 0) return undefined
+  const grab = (name) => {
+    const match = new RegExp(`${name}:\\s*([\\d,]+)`, "m").exec(text)
+    return match ? Number(match[1].replace(/,/g, "")) : undefined
+  }
+  const summary = {
+    totalPssKb: grab("TOTAL PSS"),
+    totalRssKb: grab("TOTAL RSS"),
+    totalSwapPssKb: grab("TOTAL SWAP PSS"),
+  }
+  // App Summary: capture the PSS column of the five heap buckets.
+  const appSummary = {}
+  for (const [key, rowName] of [["javaHeapKb", "Java Heap"], ["nativeHeapKb", "Native Heap"], ["codeKb", "Code"], ["stackKb", "Stack"], ["graphicsKb", "Graphics"]]) {
+    const line = text.split(/\r?\n/).find((item) => new RegExp(`^\\s+${rowName}:`).test(item) && /\d/.test(item))
+    const match = line ? /:\s+([\d,]+)/.exec(line) : undefined
+    if (match) appSummary[key] = Number(match[1].replace(/,/g, ""))
+  }
+  // Category breakdown: `  Name  pss  privDirty  privClean  swapDirty [+3 heap cols]`.
+  const categories = []
+  const seen = new Set()
+  for (const line of text.split(/\r?\n/)) {
+    const match = /^\s{2,}([A-Za-z.][A-Za-z0-9. _()\/-]*?)\s+([\d,]+)\s+([\d,]+)\s+([\d,]+)\s+([\d,]+)/.exec(line)
+    if (!match) continue
+    const name = match[1].trim()
+    if (!name || name === "TOTAL" || /^[-\s]+$/.test(name) || /^(Pss|Private|Swap|Size|Alloc|Free)$/.test(name)) continue
+    const pss = Number(match[2].replace(/,/g, ""))
+    if (seen.has(name)) continue
+    seen.add(name)
+    categories.push({ name, pssKb: pss })
+  }
+  categories.sort((l, r) => r.pssKb - l.pssKb)
+  return {
+    ...summary,
+    appSummary: Object.keys(appSummary).length > 0 ? appSummary : undefined,
+    topCategories: categories.slice(0, 10),
+  }
+}
+
 /** Parse `dumpsys package <pkg>` into {versionName, versionCode, minSdk, targetSdk, permissions, activities}. */
 export function parseAppInfo(output, packageName) {
   const text = String(output)