osborn 0.8.29 → 0.8.31

package/.claude/skills/learned-behaviors/SKILL.md

@@ -0,0 +1,45 @@
+# Learned Behaviors
+
+Auto-extracted from voice sessions via PreCompact.
+Last updated: 2026-05-01 | Session: unknown...
+
+USER CORRECTIONS:
+- Never delete existing code when adding new functionality — always add as a fallback/layer on top; user denied permission twice when replacements were sent instead of additions
+- Don't dismiss log warnings as "contamination" without verifying — the 0.8.30 reference in logs was real and was incorrectly dismissed
+- Share URLs directly in the message, not just in session files — "send it to me in the actual message"
+- Don't say "I can't read images from URLs in this context" — fetch the public URL and use the Read tool on the saved file
+- When user says "you updated it" trust the session history and confirm rather than expressing surprise
+
+USER PREFERENCES:
+- Prefers additive changes over replacements — keep existing SDK mechanisms as primary, add custom fallbacks only when SDK fails
+- Wants direct URL in voice message (readable), not just written to session files
+- Expects natural chain of: bump version → build → commit → push → publish in one flow
+- Prefers push-based deploy (Railway auto-deploys from GitHub push) over manual steps
+- Wants feedback on async operations — "is it done?" is the recurring question
+- Voice transcription artifacts: "MPM"=npm, "Osborne"=Osborn, "Brazil"=unclear, "basket man"=bash command
+
+DOMAIN KNOWLEDGE:
+- `osborn --version` has no version flag — calling it starts a new LiveKit agent instance and connects to a room
+- npm automation token required for headless publish; web login token still requires interactive 2FA
+- `(currentSession as any)?.output?.audio` is the correct path to AudioOutput; `_activity.agentSession.output.audio` is WRONG
+- OpenAI TTS-1 does not provide `synchronizedTranscript` or meaningful `playbackPosition` — both are 0/null
+- `EVENT_PLAYBACK_STARTED` ('playbackStarted') is a public LiveKit AudioOutput event that fires on first audio frame
+- 14 chars/sec is the correct estimate for OpenAI TTS-1 (175-178 WPM × 5 chars/word / 60s)
+- Dashboard `handleRestart`/`handleUpdate` server already does `waitForHealth` before responding; client was ignoring the response body entirely
+- `execInSprite` works any time the Sprite container is running, independent of osborn agent health
+- `npm list -g osborn --json` is the correct way to get installed version (not `osborn --version`)
+- Writer sub-agents will autonomously fix bugs and publish if they have npm auth and the task implies it — need to scope tasks tightly
+
+EFFECTIVE PATTERNS:
+- Four-tier fallback chain (sdk-transcript → sdk-position → wall-clock → full-block) preserves future compatibility while adding current fix
+- Checkpoint before significant code changes; user approved checkpoints as a safety measure
+- Delegating "research then build" to researcher first, then writer prevents over-building on incorrect assumptions
+- Reading the actual image file via WebFetch + Read instead of asking user to describe it
+
+ANTI-PATTERNS:
+- Running `osborn --version` — starts a live agent instance, creates stray processes in LiveKit room
+- Telling user to look for a permission dialog in their browser when the dialog may have already timed out — retry the agent instead
+- Dismissing "contamination" in logs without checking if it's real data — cost a full investigative loop
+- Scoping writer agent tasks too broadly — the dashboard writer autonomously bumped version and published because npm was authenticated and the task was ambiguous about scope
+- Ending a turn with only "opaque work is running" and no conversational engagement
+</summary>

package/dist/index.js

@@ -1112,7 +1112,7 @@ async function main() {
                     // Wall-clock timer: capture when audio actually starts playing (first frame)
                     // Used as fallback if LiveKit's playbackPosition is 0 (race condition)
                     let playbackStartedAt = null;
-                    const audioOutputRef = currentSession?._activity?.agentSession?.output?.audio;
+                    const audioOutputRef = currentSession?.output?.audio;
                     if (audioOutputRef && typeof audioOutputRef.on === 'function') {
                         const onPlaybackStarted = () => {
                             playbackStartedAt = Date.now();
@@ -1124,7 +1124,7 @@ async function main() {
                     handle.addDoneCallback((sh) => {
                         if (sh.interrupted) {
                             console.log(`🔇 [${sayId}] session.say INTERRUPTED`);
-                            const audioOutput = currentSession?._activity?.agentSession?.output?.audio;
+                            const audioOutput = currentSession?.output?.audio;
                             const sdkTranscript = audioOutput?.lastPlaybackEvent?.synchronizedTranscript;
                             const sdkPlaybackSec = audioOutput?.lastPlaybackEvent?.playbackPosition ?? 0;
                             let spokenText;
@@ -2994,9 +2994,10 @@ async function main() {
                     }
                     else {
                         try {
-                            const webhookBase = process.env.FLY_APP_NAME
-                                ? `https://${process.env.FLY_APP_NAME}.fly.dev`
-                                : `http://localhost:${apiPort}`;
+                            const webhookBase = data.webhookBase ||
+                                (process.env.FLY_APP_NAME
+                                    ? `https://${process.env.FLY_APP_NAME}.fly.dev`
+                                    : `http://localhost:${apiPort}`);
                             await sendToFrontend({ type: 'meeting_joining', message: 'Osborn is joining your meeting...' });
                             const botId = await recallJoin.joinMeeting(meetingUrl, webhookBase);
                             const sessionId = currentLLM?.sessionId || currentResumeSessionId || 'default';

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "osborn",
-  "version": "0.8.29",
+  "version": "0.8.31",
   "description": "Voice AI coding assistant - local agent that connects to Osborn frontend",
   "type": "module",
   "bin": {