dexto 1.1.11 → 1.2.1

package/dist/agents/coding-agent/README.md

@@ -0,0 +1,188 @@
+# Coding Agent
+
+An expert software development assistant optimized for building, debugging, and maintaining codebases. This agent comes equipped with all internal coding tools and is configured to handle complex software engineering tasks efficiently.
+
+## What You Get
+
+- **All Internal Coding Tools**: Read, write, edit files, execute commands, search codebases
+- **Intelligent Tool Policies**: Read operations never require approval, write operations are safely guarded
+- **Comprehensive File Support**: 30+ file extensions including JS/TS, Python, Go, Rust, Java, C/C++, configs, and more
+- **Enhanced Codebase Access**: Index up to 500 files with depth-10 traversal, including hidden files
+- **Expert System Prompt**: Specialized instructions for software development best practices
+- **Persistent Tool Approvals**: Allowed tools are saved across sessions for smoother workflows
+- **Coding-Focused Starter Prompts**: Quick access to common development tasks
+
+## Key Capabilities
+
+### File Operations
+- **read_file**: Read any file with pagination support
+- **write_file**: Create new files (requires approval)
+- **edit_file**: Modify existing files precisely (requires approval)
+- **glob_files**: Find files using patterns like `**/*.ts` (no approval needed)
+- **grep_content**: Search within files using regex (no approval needed)
+
+### Command Execution
+- **bash_exec**: Run shell commands for testing, building, running code (requires approval)
+- **bash_output**: Monitor output from background processes
+- **kill_process**: Terminate running processes
+
+### Analysis & Search
+- Deep codebase traversal (up to 10 levels)
+- Search across 500+ files
+- Pattern matching with glob and regex
+- Hidden file access (.env, .gitignore, etc.)
+
+## Requirements
+
+- Node.js 18+ (if using npm/pnpm commands)
+- OpenAI API key (or another configured LLM key)
+- File system access to your project directory
+
+## Run the Agent
+
+```bash
+# From Dexto source
+npm start -- --agent agents/coding-agent/coding-agent.yml
+
+# Or using the Dexto CLI
+dexto --agent coding-agent
+```
+
+## Usage Examples
+
+### Analyze a Codebase
+```
+"Analyze this codebase. Show me the project structure, main technologies used, and provide a high-level overview."
+```
+
+### Debug an Error
+```
+"I'm getting this error: [paste error]. Help me find and fix the issue."
+```
+
+### Implement a Feature
+```
+"I need to add user authentication. Help me design and implement it following best practices."
+```
+
+### Refactor Code
+```
+"This function is too complex. Help me refactor it for better readability and maintainability."
+```
+
+### Write Tests
+```
+"Generate unit tests for the UserService class with edge case coverage."
+```
+
+### Code Review
+```
+"Review my recent changes in src/auth/ and suggest improvements."
+```
+
+## Configuration
+
+### LLM Options
+
+The coding agent defaults to `gpt-4o` for powerful coding capabilities. You can switch to other models:
+
+**Claude Sonnet (Excellent for Coding)**
+```yaml
+llm:
+  provider: anthropic
+  model: claude-sonnet-4-20250514
+  apiKey: $ANTHROPIC_API_KEY
+```
+
+**Google Gemini**
+```yaml
+llm:
+  provider: google
+  model: gemini-2.5-pro
+  apiKey: $GOOGLE_GENERATIVE_AI_API_KEY
+```
+
+**OpenAI o1 (For Complex Reasoning)**
+```yaml
+llm:
+  provider: openai
+  model: o1
+  apiKey: $OPENAI_API_KEY
+```
+
+### Tool Policies
+
+The agent is pre-configured with sensible defaults:
+
+**Always Allowed (No Approval Needed)**
+- Reading files (`internal--read_file`)
+- Searching files (`internal--glob_files`, `internal--grep_content`)
+- Checking process output (`internal--bash_output`)
+- Killing processes (`internal--kill_process`)
+- Asking questions (`internal--ask_user`)
+
+**Requires Approval**
+- Writing files (`internal--write_file`)
+- Editing files (`internal--edit_file`)
+- Executing commands (`internal--bash_exec`)
+
+You can customize these policies in the `toolConfirmation.toolPolicies` section of `coding-agent.yml`.
+
+### File Extensions
+
+The agent indexes these file types by default:
+
+**Web Development**: .js, .jsx, .ts, .tsx, .html, .css, .scss, .sass, .less, .vue, .svelte
+
+**Backend Languages**: .py, .java, .go, .rs, .rb, .php, .c, .cpp, .h, .hpp, .cs, .swift, .kt
+
+**Configuration**: .json, .yaml, .yml, .toml, .xml, .ini, .env
+
+**Documentation**: .md, .mdx, .txt, .rst
+
+**Build Files**: .gradle, .maven, Makefile, Dockerfile, .dockerignore, .gitignore
+
+Add more extensions in the `internalResources.resources[0].includeExtensions` section.
+
+## Starter Prompts
+
+The agent includes 8 built-in starter prompts:
+
+1. **🔍 Analyze Codebase** - Get a project overview
+2. **🐛 Debug Error** - Identify and fix bugs
+3. **♻️ Refactor Code** - Improve code quality
+4. **🧪 Write Tests** - Generate comprehensive tests
+5. **✨ Implement Feature** - Build new functionality
+6. **⚡ Optimize Performance** - Find bottlenecks
+7. **🚀 Setup Project** - Initialize new projects
+8. **👀 Code Review** - Review for issues and improvements
+
+## Best Practices
+
+1. **Read Before Writing**: The agent automatically searches and reads relevant code before making changes
+2. **Use Glob & Grep**: Leverage pattern matching to explore unfamiliar codebases efficiently
+3. **Test Changes**: Execute tests after modifications to verify correctness
+4. **Follow Conventions**: The agent adapts to your project's existing code style
+5. **Ask Questions**: The agent will ask for clarification when requirements are ambiguous
+
+## Troubleshooting
+
+### Agent Can't Find Files
+- Ensure you're running from your project root
+- Check that file extensions are included in the config
+- Verify `maxDepth` is sufficient for your project structure
+
+### Commands Require Too Many Approvals
+- Use `allowedToolsStorage: storage` to persist approvals
+- Add frequently-used commands to the `alwaysAllow` list
+
+### Performance Issues with Large Codebases
+- Increase `maxFiles` limit (default: 500)
+- Reduce `maxDepth` to limit traversal
+- Exclude large directories in `.gitignore`
+
+## Learn More
+
+- [Dexto Documentation](https://github.com/truffle-ai/dexto)
+- [Internal Tools Reference](../../docs/internal-tools.md)
+- [Agent Configuration Guide](../../docs/agent-configuration.md)

package/dist/agents/coding-agent/coding-agent.yml

@@ -0,0 +1,203 @@
+# Coding Agent Configuration
+# Optimized for software development with internal coding tools
+
+# System prompt configuration - defines the agent's behavior as a coding assistant
+systemPrompt:
+  contributors:
+    - id: primary
+      type: static
+      priority: 0
+      content: |
+        You are an expert software development assistant with deep knowledge of multiple programming languages,
+        frameworks, and development best practices.
+
+        Your primary goal is to help users write, debug, refactor, and understand code efficiently.
+
+        Key capabilities:
+        - Read and analyze codebases using glob and grep patterns
+        - Write and edit files with precise, well-structured code
+        - Execute shell commands for testing, building, and running code
+        - Debug issues by examining error messages and code structure
+        - Refactor code following best practices and design patterns
+        - Explain complex code concepts clearly
+
+        Guidelines:
+        - Always read relevant code before making changes to understand context
+        - Use glob_files to find files and grep_content to search within files
+        - Test changes when possible using bash_exec
+        - Follow the project's existing code style and conventions
+        - Provide clear explanations for your code decisions
+        - Ask for clarification when requirements are ambiguous
+    - id: memories
+      type: memory
+      priority: 40
+      enabled: true
+      options:
+        includeTimestamps: false
+        includeTags: true
+        limit: 10
+        pinnedOnly: false
+
+# Greeting optimized for coding tasks
+greeting: "👨‍💻 Ready to code! What are we building today?"
+
+# LLM configuration - using a powerful model for coding tasks
+llm:
+  provider: anthropic
+  model: claude-haiku-4-5-20251001  # More powerful model for complex coding tasks
+  apiKey: $ANTHROPIC_API_KEY
+
+storage:
+  cache:
+    type: in-memory
+  database:
+    type: sqlite
+  blob:
+    type: local
+    maxBlobSize: 52428800     # 50MB per blob
+    maxTotalSize: 1073741824  # 1GB total storage
+    cleanupAfterDays: 30
+
+toolConfirmation:
+  mode: event-based
+  timeout: 120000
+  allowedToolsStorage: storage  # Persist allowed tools across sessions
+
+  # Tool policies optimized for coding workflows
+  toolPolicies:
+    # Tools that never require approval (safe, read-only operations)
+    alwaysAllow:
+      - internal--ask_user
+      - internal--read_file      # Read files without approval
+      - internal--glob_files     # Search for files without approval
+      - internal--grep_content   # Search within files without approval
+      - internal--bash_output    # Check background process output
+      - internal--kill_process   # Kill processes without approval
+
+    # Tools that are always denied (dangerous operations)
+    # Uncomment to restrict certain operations
+    # alwaysDeny:
+    #   - internal--bash_exec--rm -rf*  # Prevent recursive deletion
+
+# Internal tools - all coding tools enabled
+internalTools:
+  - ask_user       # Ask questions and collect input
+  - read_file      # Read file contents with pagination support
+  - glob_files     # Find files using glob patterns (e.g., "**/*.ts")
+  - grep_content   # Search file contents using regex patterns
+  - write_file     # Write content to files (requires approval)
+  - edit_file      # Edit files by replacing text (requires approval)
+  - bash_exec      # Execute shell commands (requires approval)
+  - bash_output    # Retrieve output from background processes
+  - kill_process   # Terminate background processes
+
+# Internal resources configuration - expanded for coding projects
+internalResources:
+  enabled: true
+  resources:
+    # Filesystem resource - comprehensive file access for coding
+    - type: filesystem
+      paths: ["."]
+      maxFiles: 500              # Increased for larger codebases
+      maxDepth: 10               # Deeper traversal for nested projects
+      includeHidden: true        # Include hidden files (.env, .gitignore, etc.)
+      includeExtensions:
+        # Web development
+        - .js
+        - .jsx
+        - .ts
+        - .tsx
+        - .html
+        - .css
+        - .scss
+        - .sass
+        - .less
+        - .vue
+        - .svelte
+        # Backend languages
+        - .py
+        - .java
+        - .go
+        - .rs
+        - .rb
+        - .php
+        - .c
+        - .cpp
+        - .h
+        - .hpp
+        - .cs
+        - .swift
+        - .kt
+        # Shell and config
+        - .sh
+        - .bash
+        - .zsh
+        - .fish
+        # Config and data
+        - .json
+        - .yaml
+        - .yml
+        - .toml
+        - .xml
+        - .ini
+        - .env
+        # Documentation
+        - .md
+        - .mdx
+        - .txt
+        - .rst
+        # Build and package files
+        - .gradle
+        - .maven
+        - .dockerignore
+        - .gitignore
+
+    # Blob resource - for handling build artifacts, images, etc.
+    - type: blob
+
+# Starter prompts - coding-focused examples
+starterPrompts:
+  - id: analyze-codebase
+    title: "🔍 Analyze Codebase"
+    description: "Get an overview of the project structure"
+    prompt: "Analyze this codebase. Show me the project structure, main technologies used, and provide a high-level overview."
+    category: analysis
+    priority: 10
+  - id: implement-feature
+    title: "✨ Implement Feature"
+    description: "Build a new feature from scratch"
+    prompt: "Help me implement a new feature. I'll describe what I need, and you can design and implement it following best practices."
+    category: development
+    priority: 9
+  - id: write-tests
+    title: "🧪 Write Tests"
+    description: "Generate unit tests for code"
+    prompt: "Help me write comprehensive unit tests. Identify the testing framework and create tests that cover edge cases."
+    category: testing
+    priority: 8
+  - id: refactor-code
+    title: "♻️ Refactor Code"
+    description: "Improve code quality and structure"
+    prompt: "Help me refactor some code to improve its structure, readability, and maintainability while preserving functionality."
+    category: refactoring
+    priority: 7
+
+## Alternative LLM configurations for coding
+
+## Claude Sonnet (excellent for coding)
+# llm:
+#   provider: anthropic
+#   model: claude-sonnet-4-20250514
+#   apiKey: $ANTHROPIC_API_KEY
+
+## Google Gemini (strong coding capabilities)
+# llm:
+#   provider: google
+#   model: gemini-2.5-pro
+#   apiKey: $GOOGLE_GENERATIVE_AI_API_KEY
+
+## OpenAI o1 (for complex reasoning tasks)
+# llm:
+#   provider: openai
+#   model: o1
+#   apiKey: $OPENAI_API_KEY

package/dist/agents/database-agent/database-agent.yml

@@ -111,9 +111,48 @@ systemPrompt:
       source: dateTime
       enabled: true
 
+# Storage configuration
+storage:
+  cache:
+    type: in-memory
+  database:
+    type: sqlite
+  blob:
+    type: local
+    maxBlobSize: 52428800     # 50MB per blob
+    maxTotalSize: 1073741824  # 1GB total storage
+    cleanupAfterDays: 30
+
 # LLM configuration for intelligent database interactions
 llm:
   provider: openai
-  model: gpt-4o-mini
+  model: gpt-5-mini
   apiKey: $OPENAI_API_KEY
-  temperature: 0.1  # Lower temperature for more consistent database operations
+  temperature: 0.1  # Lower temperature for more consistent database operations
+
+# Starter prompts - database interaction examples
+starterPrompts:
+  - id: explore-database
+    title: "🔍 Explore Database"
+    description: "See what's in the database"
+    prompt: "Show me what tables exist in the database and their structure."
+    category: exploration
+    priority: 10
+  - id: create-table
+    title: "🗂️ Create Table"
+    description: "Design and create a new database table"
+    prompt: "Create a products table with columns for name, description, price, and stock quantity."
+    category: schema
+    priority: 9
+  - id: insert-data
+    title: "➕ Insert Data"
+    description: "Add new records to a table"
+    prompt: "Insert a new product into the products table with name 'Laptop', price 999.99, and stock 15."
+    category: data-management
+    priority: 8
+  - id: query-data
+    title: "📊 Query Data"
+    description: "Search and filter database records"
+    prompt: "Show me all products from the products table sorted by price."
+    category: queries
+    priority: 7

package/dist/agents/default-agent.yml

@@ -41,7 +41,7 @@ systemPrompt:
         pinnedOnly: false
 
 # Optional greeting shown at chat start (UI can consume this)
-greeting: "Hi! I’m Dexto — how can I help today?"
+greeting: "Hi! I'm Dexto — how can I help today?"
 
 # LLM configuration - describes the language model to use
 llm:
@@ -49,6 +49,15 @@ llm:
   model: gpt-5-mini
   apiKey: $OPENAI_API_KEY
 
+  # Optional: Control which media types are expanded for LLM consumption
+  # If omitted, uses model capabilities from registry (recommended default)
+  # Supports MIME patterns with wildcards (e.g., "image/*", "video/mp4")
+  # allowedMediaTypes:
+  #   - "image/*"           # All images (png, jpg, gif, etc.)
+  #   - "application/pdf"   # PDF documents
+  #   - "audio/*"           # All audio formats
+  # Note: Unsupported types become descriptive placeholders like: [Video: demo.mp4 (5.2 MB)]
+
 storage:
   cache:
     type: in-memory
@@ -67,6 +76,21 @@ toolConfirmation:
   timeout: 120000          # Time to wait for approval (ms)
   allowedToolsStorage: memory  # 'memory' or 'storage' for persisting allowed tools
 
+  # Optional: Static tool policies for fine-grained allow/deny control
+  toolPolicies:
+    # Tools that never require approval (low-risk, common operations)
+    alwaysAllow:
+      - internal--ask_user
+      - mcp--read_file
+      - mcp--list_directory
+      - mcp--list_allowed_directories
+  #
+  #   # Tools that are always denied (high-risk, destructive operations)
+  #   # Deny list takes precedence over allow list
+  #   alwaysDeny:
+  #     - mcp--filesystem--delete_file
+  #     - mcp--playwright--execute_script
+
 # Internal tools - built-in Dexto capabilities
 internalTools:
   - ask_user  # Allows the agent to ask you questions and collect structured input
@@ -118,8 +142,6 @@ internalResources:
 #   #       enforceQuota: true
 
 # Starter prompts - predefined prompts that appear as clickable buttons in the WebUI
-# TODO: (355) Have to update docs for this starterPrompts and internalResources section and blob section
-# https://github.com/truffle-ai/dexto/pull/355#discussion_r2412886278
 starterPrompts:
   - id: quick-start
     title: "📚 Quick Start Guide"
@@ -146,6 +168,18 @@ starterPrompts:
     category: tools
     priority: 3
 
+# Telemetry configuration (optional) - OpenTelemetry for distributed tracing
+# telemetry:
+#   serviceName: dexto-default-agent
+#   enabled: true
+#   tracerName: dexto-tracer
+#   export:
+#     type: otlp              # 'otlp' for production, 'console' for development
+#     protocol: http          # 'http' or 'grpc'
+#     endpoint: http://127.0.0.1:4318/v1/traces  # OTLP collector endpoint
+#     headers:              # Optional headers for authentication
+#       Authorization: Bearer <token>
+
 ## To use Google Gemini, replace the LLM section with Google Gemini configuration below
 ## Similar for anthropic/groq/etc.
 # llm:

package/dist/agents/github-agent/github-agent.yml

@@ -53,8 +53,47 @@ systemPrompt:
       source: dateTime
       enabled: true
 
+# Storage configuration
+storage:
+  cache:
+    type: in-memory
+  database:
+    type: sqlite
+  blob:
+    type: local
+    maxBlobSize: 52428800     # 50MB per blob
+    maxTotalSize: 1073741824  # 1GB total storage
+    cleanupAfterDays: 30
+
 llm:
   provider: openai
   model: gpt-5-mini
   apiKey: $OPENAI_API_KEY
 
+# Starter prompts - GitHub operations examples
+starterPrompts:
+  - id: repo-info
+    title: "📊 Repository Info"
+    description: "Get details about the Dexto repository"
+    prompt: "Show me information about the truffle-ai/dexto repository including stars, forks, and recent activity."
+    category: info
+    priority: 10
+  - id: list-issues
+    title: "📋 List Issues"
+    description: "View open issues in Dexto"
+    prompt: "List all open issues in the truffle-ai/dexto repository."
+    category: issues
+    priority: 9
+  - id: star-dexto
+    title: "⭐ Star Dexto"
+    description: "Star the Dexto repository"
+    prompt: "Star the truffle-ai/dexto repository on GitHub."
+    category: engagement
+    priority: 8
+  - id: recent-commits
+    title: "📝 Recent Commits"
+    description: "View latest commits to Dexto"
+    prompt: "Show me the recent commits to the truffle-ai/dexto repository."
+    category: activity
+    priority: 7
+

package/dist/agents/image-editor-agent/image-editor-agent.yml

@@ -37,7 +37,7 @@ toolConfirmation:
 
 llm:
   provider: openai
-  model: gpt-4o-mini
+  model: gpt-5-mini
   apiKey: $OPENAI_API_KEY
 
 storage:
@@ -45,4 +45,8 @@ storage:
     type: in-memory
   database:
     type: sqlite
-    path: .dexto/database/image-editor-agent-python.db 
+  blob:
+    type: local
+    maxBlobSize: 52428800     # 50MB per blob
+    maxTotalSize: 1073741824  # 1GB total storage
+    cleanupAfterDays: 30

package/dist/agents/music-agent/README.md

@@ -174,7 +174,7 @@ mcpServers:
 
 llm:
   provider: openai
-  model: gpt-4o-mini
+  model: gpt-5-mini
   apiKey: $OPENAI_API_KEY
 ```
 

package/dist/agents/music-agent/music-agent.yml

@@ -35,7 +35,7 @@ mcpServers:
 
 llm:
   provider: openai
-  model: gpt-4o-mini
+  model: gpt-5-mini
   apiKey: $OPENAI_API_KEY
 
 storage:
@@ -43,4 +43,35 @@ storage:
     type: in-memory
   database:
     type: sqlite
-    path: .dexto/database/music-agent.db 
+  blob:
+    type: local
+    maxBlobSize: 52428800     # 50MB per blob
+    maxTotalSize: 1073741824  # 1GB total storage
+    cleanupAfterDays: 30
+
+# Starter prompts - music creation examples
+starterPrompts:
+  - id: create-melody
+    title: "🎼 Create Melody"
+    description: "Generate a musical melody"
+    prompt: "Create a cheerful melody in G major at 140 BPM that lasts 15 seconds."
+    category: generation
+    priority: 10
+  - id: create-chords
+    title: "🎹 Create Chord Progression"
+    description: "Generate chord progressions"
+    prompt: "Create a I-IV-V-I chord progression in D major."
+    category: generation
+    priority: 9
+  - id: create-drums
+    title: "🥁 Create Drum Pattern"
+    description: "Generate drum patterns"
+    prompt: "Create a basic rock drum pattern at 120 BPM."
+    category: generation
+    priority: 8
+  - id: list-effects
+    title: "🎚️ List Available Effects"
+    description: "See what audio effects are available"
+    prompt: "Show me all available audio effects and how to use them."
+    category: discovery
+    priority: 7

package/dist/agents/nano-banana-agent/nano-banana-agent.yml

@@ -68,4 +68,35 @@ storage:
     type: in-memory
   database:
     type: sqlite
-    path: .dexto/database/nano-banana-agent.db
+  blob:
+    type: local
+    maxBlobSize: 52428800     # 50MB per blob
+    maxTotalSize: 1073741824  # 1GB total storage
+    cleanupAfterDays: 30
+
+# Starter prompts - image generation and editing examples
+starterPrompts:
+  - id: generate-landscape
+    title: "🎨 Generate Landscape"
+    description: "Create a scenic image from text"
+    prompt: "Generate a stunning image of a majestic mountain landscape at sunset with vibrant colors and dramatic clouds."
+    category: generation
+    priority: 10
+  - id: generate-portrait
+    title: "👤 Generate Portrait"
+    description: "Create portrait images"
+    prompt: "Generate a professional portrait of a person in business attire with a clean studio background."
+    category: generation
+    priority: 9
+  - id: generate-abstract
+    title: "🌀 Generate Abstract Art"
+    description: "Create abstract artistic images"
+    prompt: "Generate an abstract art piece with swirling colors and geometric patterns inspired by Kandinsky."
+    category: generation
+    priority: 8
+  - id: generate-product
+    title: "📦 Generate Product Image"
+    description: "Create product photography"
+    prompt: "Generate a professional product photo of a sleek modern smartphone on a minimalist white background."
+    category: generation
+    priority: 7

package/dist/agents/podcast-agent/README.md

@@ -66,7 +66,7 @@ This agent uses the refactored Gemini TTS MCP server to generate high-quality sp
 
 2. **Run the Agent**:
    ```bash
-   dexto --mode web -a agents/podcast-agent/podcast-agent.yml
+   dexto -a agents/podcast-agent/podcast-agent.yml
    ```
 
 The agent will automatically install the Gemini TTS MCP server from npm when needed.