@kolbo/kolbo-code-linux-arm64-musl 1.1.5 → 1.1.66

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@kolbo/kolbo-code-linux-arm64-musl",
-  "version": "1.1.5",
+  "version": "1.1.66",
   "os": [
     "linux"
   ],

package/skills/kolbo/SKILL.md

@@ -1,25 +1,78 @@
 ---
 name: kolbo
-description: Generate or analyze creative media through Kolbo AI. Load this skill whenever the user asks to create, edit, prompt, or analyze images, videos, music, speech, or sound effects — or to list available AI models / check credit balance. It contains the MCP tool workflow and the prompt-engineering rules for each media type.
+description: Generate, edit, or analyze creative media through Kolbo AI. Load this skill whenever the user asks to create, edit, prompt, or analyze images, videos, music, speech, sound effects, 3D models — or to transcribe audio/video, manage media, use Visual DNA for consistency, check credits, or browse models/presets/moodboards. It contains the MCP tool workflow and the prompt-engineering rules for each media type.
 ---
 
-# Kolbo AI — Creative Generation & Analysis
+# Kolbo AI — Creative Generation, Analysis & Transcription
 
 You have direct access to the Kolbo AI creative platform via MCP tools (auto-configured by `kolbo auth login`). Use them to generate and deliver real content — do NOT just describe what you would create.
 
 ## Available MCP Tools
 
+### Generation
+
+| Tool | Description |
+|------|-------------|
+| `generate_image` | Create images from text prompts. Supports Visual DNA, moodboards, reference images, batch generation, web-search grounding. |
+| `generate_image_edit` | Edit/transform an existing image (background removal, color changes, compositing). Pass source images + edit prompt. |
+| `generate_creative_director` | Generate a coordinated multi-scene set (1–8 scenes) from one creative brief. Ideal for storyboards, ad campaigns, product showcases. Supports image and video modes. |
+| `generate_video` | Create videos from text prompts. Supports Visual DNA and reference images for consistency. |
+| `generate_video_from_image` | Animate a still image into video. Prompt describes the motion, not the subject. |
+| `generate_video_from_video` | Restyle/transform an existing video (style transfer, scene restyling, subject swap). Keeps the original motion. |
+| `generate_elements` | Generate video from reference assets (images/videos) + prompt. Use when animating specific uploaded assets. |
+| `generate_first_last_frame` | Generate video that morphs from a first frame to a last frame (keyframe interpolation). |
+| `generate_lipsync` | Lipsync an audio track to a source image or video face. Accepts local files or URLs. |
+| `generate_music` | Create music from descriptions. Supports instrumental, custom lyrics, style, vocal gender. |
+| `generate_speech` | Convert text to speech (TTS). Default: ElevenLabs. Use `list_voices` to pick a voice. |
+| `generate_sound` | Generate sound effects from descriptions (foley, ambient, impacts, UI sounds). |
+| `generate_3d` | Generate 3D models from text, single image, or multi-view images. Returns GLB, FBX, OBJ, USDZ. |
+
+### Transcription & Analysis
+
+| Tool | Description |
+|------|-------------|
+| `transcribe_audio` | Transcribe audio or video into text + SRT subtitles + word-by-word SRT. Accepts local files or URLs. |
+
+### Voice & Model Discovery
+
 | Tool | Description |
 |------|-------------|
-| `generate_image` | Create images from text prompts. Returns image URL(s). |
-| `generate_video` | Create videos from text. Returns video URL. |
-| `generate_video_from_image` | Animate a still image into video. Returns video URL. |
-| `generate_music` | Create music from descriptions. Returns audio URL. |
-| `generate_speech` | Convert text to speech. Returns audio URL. |
-| `generate_sound` | Generate sound effects. Returns audio URL. |
 | `list_models` | Browse available AI models filtered by type. |
+| `list_voices` | List available TTS voices with filtering by provider, language, gender. |
 | `check_credits` | Check remaining Kolbo credit balance. |
-| `get_generation_status` | Poll status of an in-progress generation by ID. |
+| `get_generation_status` | Poll status of an in-progress generation by ID (fallback for timeouts). |
+
+### Media Library
+
+| Tool | Description |
+|------|-------------|
+| `upload_media` | Upload a local file or URL to the user's Kolbo media library (CDN). Use for multi-tool workflows. |
+| `list_media` | Browse user's uploaded media with filtering by type and search. |
+
+### Visual DNA (Character/Style Consistency)
+
+| Tool | Description |
+|------|-------------|
+| `create_visual_dna` | Create a Visual DNA profile from reference images/video/audio for character, style, product, or scene consistency. |
+| `list_visual_dnas` | List your Visual DNA profiles (id, name, type, thumbnail). |
+| `get_visual_dna` | Fetch full profile details including system_prompt and reference images. |
+| `delete_visual_dna` | Delete a Visual DNA profile. |
+
+### Moodboards & Presets
+
+| Tool | Description |
+|------|-------------|
+| `list_moodboards` | List available moodboards (personal, system presets, org). |
+| `get_moodboard` | Fetch a moodboard's master_prompt, style_guide, and images. |
+| `list_presets` | Browse generation presets (image/video/music templates with bundled style direction). |
+
+### Chat
+
+| Tool | Description |
+|------|-------------|
+| `chat_send_message` | Send a message to Kolbo AI chat. Supports web search and deep think modes. |
+| `chat_list_conversations` | List your SDK chat conversations. |
+| `chat_get_messages` | Fetch messages in a conversation (with media URLs). |
 
 ## Core Workflow
 
@@ -34,23 +87,71 @@ You have direct access to the Kolbo AI creative platform via MCP tools (auto-con
 | Type | Use for |
 |------|---------|
 | `image` | Still-image generation |
+| `image_edit` | Image editing / transformation |
 | `video` | Text-to-video |
 | `video_from_image` | Image-to-video animation |
+| `lipsync` | Audio-to-face lipsync |
 | `music` | Music generation |
 | `speech` | Text-to-speech |
 | `sound` | Sound effects |
+| `three_d` | 3D model generation |
 
 ### Cost Awareness
 
 Creative generations bill against the user's Kolbo credit balance. Order of expense (rough):
-- **Cheap & fast**: speech (~5-30s), sound effects (~5-30s), image (~10-30s)
-- **Medium**: music (~30s-2min)
-- **Expensive**: video (~1-5min, highest credit cost)
+- **Cheap & fast**: speech (~5-30s), sound effects (~5-30s), image (~10-30s), transcription (by duration)
+- **Medium**: music (~30s-2min), 3D (~1-3min)
+- **Expensive**: video (~1-5min, highest credit cost), lipsync (~1-3min)
 
 Rule of thumb: confirm intent before firing off a video generation unless the user was explicit. For images, just generate.
 
 ---
 
+## Transcription & Audio/Video Analysis
+
+Use `transcribe_audio` whenever the user provides an audio or video file and wants:
+- A text transcript
+- Subtitles (SRT format)
+- Word-by-word timed subtitles (for karaoke, motion graphics, Remotion captions, video editing)
+- Content analysis or summary of spoken content
+- Dialogue extraction from video
+
+### Workflow
+1. Call `transcribe_audio` with the `source` (URL or absolute local file path)
+2. The tool returns:
+   - `text` — full transcript as plain text
+   - `srt_url` — download URL for grouped SRT subtitles (configurable words-per-line)
+   - `word_by_word_srt_url` — download URL for **word-by-word SRT** (one word per subtitle entry with precise timestamps from ElevenLabs Scribe v2)
+   - `txt_url` — download URL for plain text file
+   - `duration` — audio duration in seconds
+3. Analyze the transcript text as needed (summarize, translate, extract topics, answer questions about content)
+
+### Supported Formats
+- **Audio**: mp3, wav, m4a, flac, aac
+- **Video** (extracts audio track): mp4, mov, webm, mkv, avi, m4v
+
+### Word-by-Word Transcription
+The `word_by_word_srt_url` contains an SRT file where each subtitle entry is a **single word** with precise start/end timestamps (powered by ElevenLabs Scribe v2). This is ideal for:
+- **Karaoke-style captions** — highlight one word at a time
+- **Remotion/motion graphics** — animate text word-by-word synced to audio
+- **Video editing** — precise cut points aligned to speech
+- **Accessibility** — word-level navigation for hearing-impaired users
+
+The regular `srt_url` groups words into readable subtitle lines (default 12 words per line, up to 2 lines per subtitle).
+
+### Use Cases & Examples
+- "Transcribe this podcast" → `transcribe_audio` with the audio URL
+- "What's being said in this video?" → `transcribe_audio` → analyze the returned text
+- "Generate subtitles for my video" → `transcribe_audio` → share the `srt_url`
+- "I need word-by-word timing for this audio" → `transcribe_audio` → share `word_by_word_srt_url`
+- "Summarize this meeting recording" → `transcribe_audio` → summarize the text
+- "Extract key points from this lecture" → `transcribe_audio` → analyze and extract
+
+### Long Content
+Transcription supports files up to 30 minutes. For longer content, split the file first or provide segments.
+
+---
+
 ## Image Prompts
 
 ### Rules
@@ -61,14 +162,36 @@ Rule of thumb: confirm intent before firing off a video generation unless the us
 - **`enhance_prompt: true`** (default) will improve most prompts automatically. Turn it off only if the user's prompt is already fully engineered or they want literal wording.
 
 ### Image Editing (image-to-image)
-When the model can see the uploaded image, describe the **change**, not the unchanged parts.
+
+Use `generate_image_edit` when the user wants to modify an existing image. Pass the source image URL(s) in `source_images` and describe the change in `prompt`.
+
 - Good: "Turn the sky orange and add drifting clouds"
 - Bad: "A mountain landscape with an orange sky and drifting clouds" (re-describes what's already in the image)
 
 Simple edits deserve simple prompts. Only elaborate for genuinely complex, multi-step transformations.
 
 ### Multi-Scene / Campaigns
-For storyboards, campaigns, or character-consistent sequences, call `generate_image` once per scene with the same base style cues carried across prompts. Kolbo's web app has a dedicated Creative Director feature for this; in the CLI the workflow is sequential `generate_image` calls.
+For storyboards, campaigns, or character-consistent sequences, use `generate_creative_director` — it generates 1–8 coordinated scenes from a single creative brief with consistent style. Pass `visual_dna_ids` and/or `moodboard_id` for character/style consistency across all scenes.
+
+In the CLI, you can also do sequential `generate_image` calls with the same Visual DNA profiles.
+
+---
+
+## Visual DNA (Character/Style Consistency)
+
+Visual DNA profiles capture the visual "identity" of a character, style, product, or scene from reference media.
+
+### Workflow
+1. **Create** a profile with `create_visual_dna` — provide reference images (max 4), optionally video and audio
+2. **Types**: `character` (default), `style`, `product`, `scene`
+3. **Use** the profile by passing its `id` in `visual_dna_ids` when calling any generation tool
+4. **List/inspect** profiles with `list_visual_dnas` / `get_visual_dna`
+
+### When to Use
+- User wants the same character across multiple images/videos
+- User wants a consistent brand style across a campaign
+- User references "keep the same look" or "same character"
+- User provides reference photos of a person/product to maintain consistency
 
 ---
 
@@ -89,6 +212,20 @@ The model can see the starting frame. Describe **what happens**, not what the im
 - Good: "Slow dolly-in on the subject. Her hair drifts in a light breeze. Soft particles float through the air. [6s]"
 - Bad: "A woman with long brown hair standing in a forest, wearing a red dress, with golden sunlight..." (re-describes the image)
 
+### Video-to-Video (Restyle)
+Use `generate_video_from_video` to restyle an existing video. Describe the **new style**, not the original content — the model preserves the original motion.
+- Good: "Transform into anime style with cel-shading and vibrant colors"
+- Bad: "A person walking down a street" (re-describes what's already in the video)
+
+### Elements (Reference Assets → Video)
+Use `generate_elements` when the user has specific assets (product photos, character references) they want animated into a video. Pass them as `reference_images` (URLs) or `files` (local paths).
+
+### First/Last Frame (Keyframe Interpolation)
+Use `generate_first_last_frame` when the user provides two keyframes and wants the model to create a smooth transition between them.
+
+### Lipsync
+Use `generate_lipsync` to sync audio to a face in an image or video. Both `source` (face) and `audio` accept URLs or local file paths.
+
 ### Camera Vocabulary
 
 Pick what fits the mood. Every shot gets at least one.
@@ -150,6 +287,17 @@ Format: `extreme slow-motion [Xs] — [micro-movements in ultra slow-mo] — sna
 
 ---
 
+## 3D Generation
+
+Use `generate_3d` for creating 3D models. Three modes:
+- **Text mode**: prompt-only (e.g., "a medieval sword with ornate handle")
+- **Single image mode**: one reference image + optional prompt
+- **Multi-view mode**: 2+ reference images for higher-quality reconstruction
+
+Returns downloadable model files in GLB, FBX, OBJ, and USDZ formats. Use `list_models` with `type: "three_d"` to discover available models.
+
+---
+
 ## Music Prompts
 
 Describe **genre → mood → instrumentation → tempo → era**, in that order.
@@ -164,10 +312,10 @@ Describe **genre → mood → instrumentation → tempo → era**, in that order
 
 ## Speech (TTS)
 
-- Call `list_models` with `type: speech` to get voice identifiers. Pass the `identifier` as `model` for a consistent voice.
-- The voice **is** the model for speech — there is no separate voice parameter.
+- Call `list_voices` to find available voices. Filter by `provider`, `language`, or `gender`.
+- Pass the returned `voice_id` (or the voice's display name like "Rachel") as the `voice` parameter in `generate_speech`.
+- For multilingual content, pick a voice that supports the target language.
 - For long text, split at natural sentence boundaries. Each generation has a character cap; chunk long-form content into multiple calls.
-- For multilingual content, pick a voice that supports the target language from `list_models`.
 
 ---
 
@@ -179,6 +327,35 @@ Describe **genre → mood → instrumentation → tempo → era**, in that order
 
 ---
 
+## Moodboards & Presets
+
+**Moodboards** provide style direction (master prompt + style guide + reference images). Pass a `moodboard_id` to any generation tool to apply its style.
+- `list_moodboards` to browse available options
+- `get_moodboard` to see full details before applying
+
+**Presets** bundle prompt templates + style direction for specific creative looks. Pass a `preset_id` to generation tools.
+- `list_presets` with optional `type` filter ("image", "video", "music", "text_to_video")
+
+---
+
+## Media Library
+
+Use `upload_media` to upload local files or URLs to the Kolbo CDN for stable hosting. Useful when:
+- A local file needs to be referenced in multiple generation calls
+- You want a permanent CDN URL instead of an ephemeral local path
+
+Use `list_media` to browse previously uploaded content (filter by type, search by name).
+
+---
+
+## Chat
+
+Use `chat_send_message` to interact with Kolbo AI models (GPT-4o, Claude, etc.) with optional web search and deep think modes. Conversations persist via `session_id` — omit to start new, pass to continue.
+
+Use `chat_list_conversations` and `chat_get_messages` to browse conversation history.
+
+---
+
 ## Image Analysis (when the user uploads images)
 
 When the user shares an image and asks about it:
@@ -188,7 +365,7 @@ When the user shares an image and asks about it:
 - **Extract text verbatim** when asked (OCR-style requests are fine).
 - **Cannot identify real people.** Describe hair, clothing, pose, expression, and apparent role — but never name a specific individual, even a well-known public figure. If the user insists, decline and offer to describe instead.
 - **Copyrighted content**: summarize and reference, don't reproduce verbatim large chunks.
-- If the user wants an **edit** based on the analysis, hand off to `generate_video_from_image` (motion) or `generate_image` with an image-to-image model (visual edit) — see the Image Editing section above for prompt structure.
+- If the user wants an **edit** based on the analysis, hand off to `generate_image_edit` (visual edit) or `generate_video_from_image` (motion).
 
 ---
 
@@ -222,11 +399,22 @@ The MDX sources are in the `kolbo-docs` repo under `content/docs/kolbo-code/`. W
 Natural-language triggers that should prompt this skill + a tool call:
 
 - "Generate an image of a neon-lit Tokyo street at night" → `list_models` (image) → `generate_image`
+- "Remove the background from this image" → `list_models` (image_edit) → `generate_image_edit`
+- "Create a storyboard for a coffee brand ad" → `list_models` (image) → `generate_creative_director`
 - "Create a 5-second cinematic video of ocean waves at sunset" → `list_models` (video) → `generate_video` with camera + mood guidance
 - "Animate this product photo with a 360° orbit" → `list_models` (video_from_image) → `generate_video_from_image`
+- "Restyle this video as anime" → `generate_video_from_video`
+- "Make this character talk with this voiceover" → `generate_lipsync`
+- "Create a smooth transition between these two frames" → `generate_first_last_frame`
 - "Make a lo-fi hip hop beat, instrumental, 85 BPM" → `list_models` (music) → `generate_music`
-- "Say this in English with a natural female voice: Welcome to Kolbo" → `list_models` (speech) → `generate_speech`
+- "Say this in English with a natural female voice: Welcome to Kolbo" → `list_voices` → `generate_speech`
 - "Generate a door slam sound effect" → `list_models` (sound) → `generate_sound`
+- "Create a 3D model of a medieval castle" → `list_models` (three_d) → `generate_3d`
+- "Transcribe this podcast episode" → `transcribe_audio`
+- "What's being said in this video?" → `transcribe_audio` → analyze the text
+- "Generate word-by-word subtitles for this audio" → `transcribe_audio` → share `word_by_word_srt_url`
+- "Keep the same character across all these images" → `create_visual_dna` → `generate_image` with `visual_dna_ids`
+- "Upload this file to my media library" → `upload_media`
 - "What video models are available?" → `list_models` (video)
 - "How many credits do I have?" → `check_credits`
 - "What's in this image?" (with upload) → describe per the Image Analysis section; no tool call needed unless the user asks to generate or edit