dexto 1.1.10 → 1.2.0

package/dist/agents/coding-agent/README.md

@@ -0,0 +1,188 @@
+# Coding Agent
+
+An expert software development assistant optimized for building, debugging, and maintaining codebases. This agent comes equipped with all internal coding tools and is configured to handle complex software engineering tasks efficiently.
+
+## What You Get
+
+- **All Internal Coding Tools**: Read, write, edit files, execute commands, search codebases
+- **Intelligent Tool Policies**: Read operations never require approval, write operations are safely guarded
+- **Comprehensive File Support**: 30+ file extensions including JS/TS, Python, Go, Rust, Java, C/C++, configs, and more
+- **Enhanced Codebase Access**: Index up to 500 files with depth-10 traversal, including hidden files
+- **Expert System Prompt**: Specialized instructions for software development best practices
+- **Persistent Tool Approvals**: Allowed tools are saved across sessions for smoother workflows
+- **Coding-Focused Starter Prompts**: Quick access to common development tasks
+
+## Key Capabilities
+
+### File Operations
+- **read_file**: Read any file with pagination support
+- **write_file**: Create new files (requires approval)
+- **edit_file**: Modify existing files precisely (requires approval)
+- **glob_files**: Find files using patterns like `**/*.ts` (no approval needed)
+- **grep_content**: Search within files using regex (no approval needed)
+
+### Command Execution
+- **bash_exec**: Run shell commands for testing, building, running code (requires approval)
+- **bash_output**: Monitor output from background processes
+- **kill_process**: Terminate running processes
+
+### Analysis & Search
+- Deep codebase traversal (up to 10 levels)
+- Search across 500+ files
+- Pattern matching with glob and regex
+- Hidden file access (.env, .gitignore, etc.)
+
+## Requirements
+
+- Node.js 18+ (if using npm/pnpm commands)
+- OpenAI API key (or another configured LLM key)
+- File system access to your project directory
+
+## Run the Agent
+
+```bash
+# From Dexto source
+npm start -- --agent agents/coding-agent/coding-agent.yml
+
+# Or using the Dexto CLI
+dexto --agent coding-agent
+```
+
+## Usage Examples
+
+### Analyze a Codebase
+```
+"Analyze this codebase. Show me the project structure, main technologies used, and provide a high-level overview."
+```
+
+### Debug an Error
+```
+"I'm getting this error: [paste error]. Help me find and fix the issue."
+```
+
+### Implement a Feature
+```
+"I need to add user authentication. Help me design and implement it following best practices."
+```
+
+### Refactor Code
+```
+"This function is too complex. Help me refactor it for better readability and maintainability."
+```
+
+### Write Tests
+```
+"Generate unit tests for the UserService class with edge case coverage."
+```
+
+### Code Review
+```
+"Review my recent changes in src/auth/ and suggest improvements."
+```
+
+## Configuration
+
+### LLM Options
+
+The coding agent defaults to `gpt-4o` for powerful coding capabilities. You can switch to other models:
+
+**Claude Sonnet (Excellent for Coding)**
+```yaml
+llm:
+  provider: anthropic
+  model: claude-sonnet-4-20250514
+  apiKey: $ANTHROPIC_API_KEY
+```
+
+**Google Gemini**
+```yaml
+llm:
+  provider: google
+  model: gemini-2.5-pro
+  apiKey: $GOOGLE_GENERATIVE_AI_API_KEY
+```
+
+**OpenAI o1 (For Complex Reasoning)**
+```yaml
+llm:
+  provider: openai
+  model: o1
+  apiKey: $OPENAI_API_KEY
+```
+
+### Tool Policies
+
+The agent is pre-configured with sensible defaults:
+
+**Always Allowed (No Approval Needed)**
+- Reading files (`internal--read_file`)
+- Searching files (`internal--glob_files`, `internal--grep_content`)
+- Checking process output (`internal--bash_output`)
+- Killing processes (`internal--kill_process`)
+- Asking questions (`internal--ask_user`)
+
+**Requires Approval**
+- Writing files (`internal--write_file`)
+- Editing files (`internal--edit_file`)
+- Executing commands (`internal--bash_exec`)
+
+You can customize these policies in the `toolConfirmation.toolPolicies` section of `coding-agent.yml`.
+
+### File Extensions
+
+The agent indexes these file types by default:
+
+**Web Development**: .js, .jsx, .ts, .tsx, .html, .css, .scss, .sass, .less, .vue, .svelte
+
+**Backend Languages**: .py, .java, .go, .rs, .rb, .php, .c, .cpp, .h, .hpp, .cs, .swift, .kt
+
+**Configuration**: .json, .yaml, .yml, .toml, .xml, .ini, .env
+
+**Documentation**: .md, .mdx, .txt, .rst
+
+**Build Files**: .gradle, .maven, Makefile, Dockerfile, .dockerignore, .gitignore
+
+Add more extensions in the `internalResources.resources[0].includeExtensions` section.
+
+## Starter Prompts
+
+The agent includes 8 built-in starter prompts:
+
+1. **🔍 Analyze Codebase** - Get a project overview
+2. **🐛 Debug Error** - Identify and fix bugs
+3. **♻️ Refactor Code** - Improve code quality
+4. **🧪 Write Tests** - Generate comprehensive tests
+5. **✨ Implement Feature** - Build new functionality
+6. **⚡ Optimize Performance** - Find bottlenecks
+7. **🚀 Setup Project** - Initialize new projects
+8. **👀 Code Review** - Review for issues and improvements
+
+## Best Practices
+
+1. **Read Before Writing**: The agent automatically searches and reads relevant code before making changes
+2. **Use Glob & Grep**: Leverage pattern matching to explore unfamiliar codebases efficiently
+3. **Test Changes**: Execute tests after modifications to verify correctness
+4. **Follow Conventions**: The agent adapts to your project's existing code style
+5. **Ask Questions**: The agent will ask for clarification when requirements are ambiguous
+
+## Troubleshooting
+
+### Agent Can't Find Files
+- Ensure you're running from your project root
+- Check that file extensions are included in the config
+- Verify `maxDepth` is sufficient for your project structure
+
+### Commands Require Too Many Approvals
+- Use `allowedToolsStorage: storage` to persist approvals
+- Add frequently-used commands to the `alwaysAllow` list
+
+### Performance Issues with Large Codebases
+- Increase `maxFiles` limit (default: 500)
+- Reduce `maxDepth` to limit traversal
+- Exclude large directories in `.gitignore`
+
+## Learn More
+
+- [Dexto Documentation](https://github.com/truffle-ai/dexto)
+- [Internal Tools Reference](../../docs/internal-tools.md)
+- [Agent Configuration Guide](../../docs/agent-configuration.md)

package/dist/agents/coding-agent/coding-agent.yml

@@ -0,0 +1,203 @@
+# Coding Agent Configuration
+# Optimized for software development with internal coding tools
+
+# System prompt configuration - defines the agent's behavior as a coding assistant
+systemPrompt:
+  contributors:
+    - id: primary
+      type: static
+      priority: 0
+      content: |
+        You are an expert software development assistant with deep knowledge of multiple programming languages,
+        frameworks, and development best practices.
+
+        Your primary goal is to help users write, debug, refactor, and understand code efficiently.
+
+        Key capabilities:
+        - Read and analyze codebases using glob and grep patterns
+        - Write and edit files with precise, well-structured code
+        - Execute shell commands for testing, building, and running code
+        - Debug issues by examining error messages and code structure
+        - Refactor code following best practices and design patterns
+        - Explain complex code concepts clearly
+
+        Guidelines:
+        - Always read relevant code before making changes to understand context
+        - Use glob_files to find files and grep_content to search within files
+        - Test changes when possible using bash_exec
+        - Follow the project's existing code style and conventions
+        - Provide clear explanations for your code decisions
+        - Ask for clarification when requirements are ambiguous
+    - id: memories
+      type: memory
+      priority: 40
+      enabled: true
+      options:
+        includeTimestamps: false
+        includeTags: true
+        limit: 10
+        pinnedOnly: false
+
+# Greeting optimized for coding tasks
+greeting: "👨‍💻 Ready to code! What are we building today?"
+
+# LLM configuration - using a powerful model for coding tasks
+llm:
+  provider: anthropic
+  model: claude-haiku-4-5-20251001  # More powerful model for complex coding tasks
+  apiKey: $ANTHROPIC_API_KEY
+
+storage:
+  cache:
+    type: in-memory
+  database:
+    type: sqlite
+  blob:
+    type: local
+    maxBlobSize: 52428800     # 50MB per blob
+    maxTotalSize: 1073741824  # 1GB total storage
+    cleanupAfterDays: 30
+
+toolConfirmation:
+  mode: event-based
+  timeout: 120000
+  allowedToolsStorage: storage  # Persist allowed tools across sessions
+
+  # Tool policies optimized for coding workflows
+  toolPolicies:
+    # Tools that never require approval (safe, read-only operations)
+    alwaysAllow:
+      - internal--ask_user
+      - internal--read_file      # Read files without approval
+      - internal--glob_files     # Search for files without approval
+      - internal--grep_content   # Search within files without approval
+      - internal--bash_output    # Check background process output
+      - internal--kill_process   # Kill processes without approval
+
+    # Tools that are always denied (dangerous operations)
+    # Uncomment to restrict certain operations
+    # alwaysDeny:
+    #   - internal--bash_exec--rm -rf*  # Prevent recursive deletion
+
+# Internal tools - all coding tools enabled
+internalTools:
+  - ask_user       # Ask questions and collect input
+  - read_file      # Read file contents with pagination support
+  - glob_files     # Find files using glob patterns (e.g., "**/*.ts")
+  - grep_content   # Search file contents using regex patterns
+  - write_file     # Write content to files (requires approval)
+  - edit_file      # Edit files by replacing text (requires approval)
+  - bash_exec      # Execute shell commands (requires approval)
+  - bash_output    # Retrieve output from background processes
+  - kill_process   # Terminate background processes
+
+# Internal resources configuration - expanded for coding projects
+internalResources:
+  enabled: true
+  resources:
+    # Filesystem resource - comprehensive file access for coding
+    - type: filesystem
+      paths: ["."]
+      maxFiles: 500              # Increased for larger codebases
+      maxDepth: 10               # Deeper traversal for nested projects
+      includeHidden: true        # Include hidden files (.env, .gitignore, etc.)
+      includeExtensions:
+        # Web development
+        - .js
+        - .jsx
+        - .ts
+        - .tsx
+        - .html
+        - .css
+        - .scss
+        - .sass
+        - .less
+        - .vue
+        - .svelte
+        # Backend languages
+        - .py
+        - .java
+        - .go
+        - .rs
+        - .rb
+        - .php
+        - .c
+        - .cpp
+        - .h
+        - .hpp
+        - .cs
+        - .swift
+        - .kt
+        # Shell and config
+        - .sh
+        - .bash
+        - .zsh
+        - .fish
+        # Config and data
+        - .json
+        - .yaml
+        - .yml
+        - .toml
+        - .xml
+        - .ini
+        - .env
+        # Documentation
+        - .md
+        - .mdx
+        - .txt
+        - .rst
+        # Build and package files
+        - .gradle
+        - .maven
+        - .dockerignore
+        - .gitignore
+
+    # Blob resource - for handling build artifacts, images, etc.
+    - type: blob
+
+# Starter prompts - coding-focused examples
+starterPrompts:
+  - id: analyze-codebase
+    title: "🔍 Analyze Codebase"
+    description: "Get an overview of the project structure"
+    prompt: "Analyze this codebase. Show me the project structure, main technologies used, and provide a high-level overview."
+    category: analysis
+    priority: 10
+  - id: implement-feature
+    title: "✨ Implement Feature"
+    description: "Build a new feature from scratch"
+    prompt: "Help me implement a new feature. I'll describe what I need, and you can design and implement it following best practices."
+    category: development
+    priority: 9
+  - id: write-tests
+    title: "🧪 Write Tests"
+    description: "Generate unit tests for code"
+    prompt: "Help me write comprehensive unit tests. Identify the testing framework and create tests that cover edge cases."
+    category: testing
+    priority: 8
+  - id: refactor-code
+    title: "♻️ Refactor Code"
+    description: "Improve code quality and structure"
+    prompt: "Help me refactor some code to improve its structure, readability, and maintainability while preserving functionality."
+    category: refactoring
+    priority: 7
+
+## Alternative LLM configurations for coding
+
+## Claude Sonnet (excellent for coding)
+# llm:
+#   provider: anthropic
+#   model: claude-sonnet-4-20250514
+#   apiKey: $ANTHROPIC_API_KEY
+
+## Google Gemini (strong coding capabilities)
+# llm:
+#   provider: google
+#   model: gemini-2.5-pro
+#   apiKey: $GOOGLE_GENERATIVE_AI_API_KEY
+
+## OpenAI o1 (for complex reasoning tasks)
+# llm:
+#   provider: openai
+#   model: o1
+#   apiKey: $OPENAI_API_KEY

package/dist/agents/database-agent/database-agent.yml

@@ -26,6 +26,9 @@ mcpServers:
     timeout: 30000
     connectionMode: lenient
 
+# Optional greeting shown at chat start (UI can consume this)
+greeting: "🗄️ Hi! I'm your Database Agent. What would you like to explore?"
+
 # System prompt that defines the agent's database interaction capabilities
 systemPrompt:
   contributors:
@@ -108,9 +111,48 @@ systemPrompt:
       source: dateTime
       enabled: true
 
+# Storage configuration
+storage:
+  cache:
+    type: in-memory
+  database:
+    type: sqlite
+  blob:
+    type: local
+    maxBlobSize: 52428800     # 50MB per blob
+    maxTotalSize: 1073741824  # 1GB total storage
+    cleanupAfterDays: 30
+
 # LLM configuration for intelligent database interactions
 llm:
   provider: openai
-  model: gpt-4o-mini
+  model: gpt-5-mini
   apiKey: $OPENAI_API_KEY
-  temperature: 0.1  # Lower temperature for more consistent database operations
+  temperature: 0.1  # Lower temperature for more consistent database operations
+
+# Starter prompts - database interaction examples
+starterPrompts:
+  - id: explore-database
+    title: "🔍 Explore Database"
+    description: "See what's in the database"
+    prompt: "Show me what tables exist in the database and their structure."
+    category: exploration
+    priority: 10
+  - id: create-table
+    title: "🗂️ Create Table"
+    description: "Design and create a new database table"
+    prompt: "Create a products table with columns for name, description, price, and stock quantity."
+    category: schema
+    priority: 9
+  - id: insert-data
+    title: "➕ Insert Data"
+    description: "Add new records to a table"
+    prompt: "Insert a new product into the products table with name 'Laptop', price 999.99, and stock 15."
+    category: data-management
+    priority: 8
+  - id: query-data
+    title: "📊 Query Data"
+    description: "Search and filter database records"
+    prompt: "Show me all products from the products table sorted by price."
+    category: queries
+    priority: 7

package/dist/agents/default-agent.yml

@@ -14,13 +14,6 @@ mcpServers:
       - -y
       - "@playwright/mcp@latest"
 
-  # hf:
-  #   type: stdio
-  #   command: npx
-  #   args:
-  #     - -y
-  #     - "@llmindset/mcp-hfspace"
-
 # System prompt configuration - defines the agent's behavior and instructions
 systemPrompt:
   contributors:
@@ -37,28 +30,159 @@ systemPrompt:
       priority: 10
       source: dateTime
       enabled: true
+    - id: memories
+      type: memory
+      priority: 40
+      enabled: true
+      options:
+        includeTimestamps: false
+        includeTags: true
+        limit: 10
+        pinnedOnly: false
 
 # Optional greeting shown at chat start (UI can consume this)
-greeting: "Hi! I’m Dexto — how can I help today?"
+greeting: "Hi! I'm Dexto — how can I help today?"
 
-# # describes the llm configuration
+# LLM configuration - describes the language model to use
 llm:
   provider: openai
   model: gpt-5-mini
   apiKey: $OPENAI_API_KEY
 
-# Storage configuration - uses a two-tier architecture: cache (fast, ephemeral) and database (persistent, reliable)
-# Memory cache with file-based database (good for development with persistence)
+  # Optional: Control which media types are expanded for LLM consumption
+  # If omitted, uses model capabilities from registry (recommended default)
+  # Supports MIME patterns with wildcards (e.g., "image/*", "video/mp4")
+  # allowedMediaTypes:
+  #   - "image/*"           # All images (png, jpg, gif, etc.)
+  #   - "application/pdf"   # PDF documents
+  #   - "audio/*"           # All audio formats
+  # Note: Unsupported types become descriptive placeholders like: [Video: demo.mp4 (5.2 MB)]
+
 storage:
   cache:
     type: in-memory
   database:
     type: sqlite
-    # path: ./data/dexto.db
+    # path: ./data/dexto.db  # Optional: customize database location
+  blob:
+    type: local  # 'local', 's3', 'gcs', 'azure' (s3, gcs, azure coming in future Phases)
+    maxBlobSize: 52428800     # 50MB per blob
+    maxTotalSize: 1073741824  # 1GB total storage
+    cleanupAfterDays: 30      # Auto-cleanup blobs older than 30 days
+    # storePath: ~/.dexto/blobs (defaults to context-aware path for local backend)
+
+toolConfirmation:
+  mode: event-based
+  timeout: 120000          # Time to wait for approval (ms)
+  allowedToolsStorage: memory  # 'memory' or 'storage' for persisting allowed tools
+
+  # Optional: Static tool policies for fine-grained allow/deny control
+  toolPolicies:
+    # Tools that never require approval (low-risk, common operations)
+    alwaysAllow:
+      - internal--ask_user
+      - mcp--read_file
+      - mcp--list_directory
+      - mcp--list_allowed_directories
+  #
+  #   # Tools that are always denied (high-risk, destructive operations)
+  #   # Deny list takes precedence over allow list
+  #   alwaysDeny:
+  #     - mcp--filesystem--delete_file
+  #     - mcp--playwright--execute_script
+
+# Internal tools - built-in Dexto capabilities
+internalTools:
+  - ask_user  # Allows the agent to ask you questions and collect structured input
+
+# Internal resources configuration - manages file system access and blob storage
+# NOTE: Blob storage capacity and backend settings are in the 'storage.blob' section above
+internalResources:
+  enabled: true
+  resources:
+    # Filesystem resource - provides read access to local files for the agent
+    - type: filesystem
+      paths: ["."]                 # Directories to expose
+      maxFiles: 50               # Maximum number of files to index
+      maxDepth: 3                # Maximum directory depth to traverse
+      includeHidden: false         # Include hidden files/directories
+      includeExtensions: [".txt", ".md", ".json", ".yaml", ".yml", ".js", ".ts", ".py", ".html", ".css"]
+
+    # Blob resource - enables large file upload/storage (settings in storage.blob section above)
+    - type: blob
+
+# Plugin system - built-in plugins for content policy and response sanitization
+# plugins:
+#   # ContentPolicy - validates and sanitizes input before sending to LLM
+#   contentPolicy:
+#     priority: 10              # Lower priority = runs first
+#     blocking: true            # Blocks execution if validation fails
+#     maxInputChars: 50000      # Maximum input length (characters)
+#     redactEmails: true        # Redact email addresses from input
+#     redactApiKeys: true       # Redact potential API keys from input
+#     enabled: true             # Enable this plugin
+
+#   # ResponseSanitizer - sanitizes LLM responses before returning to user
+#   responseSanitizer:
+#     priority: 900             # Higher priority = runs near the end
+#     blocking: false           # Non-blocking (logs warnings but doesn't stop)
+#     redactEmails: true        # Redact email addresses from responses
+#     redactApiKeys: true       # Redact potential API keys from responses
+#     maxResponseLength: 100000 # Maximum response length (characters)
+#     enabled: true             # Enable this plugin
+
+#   # Custom plugins can be added here (see documentation)
+#   # custom:
+#   #   - name: tenant-auth
+#   #     module: "${{dexto.agent_dir}}/plugins/tenant-auth.ts"
+#   #     enabled: true
+#   #     blocking: true
+#   #     priority: 100
+#   #     config:
+#   #       enforceQuota: true
+
+# Starter prompts - predefined prompts that appear as clickable buttons in the WebUI
+starterPrompts:
+  - id: quick-start
+    title: "📚 Quick Start Guide"
+    description: "Learn the basics and see what you can do"
+    prompt: "I'd like to get started quickly. Can you show me a few examples of what you can do and help me understand how to work with you?"
+    category: learning
+    priority: 9
+  - id: tool-demo
+    title: "⚡ Tool Demonstration"
+    description: "See the tools in action with practical examples"
+    prompt: "I'd like to see your tools in action. Can you pick one of your most interesting tools and demonstrate it with a practical example? Show me what it can do and how it works."
+    category: tools
+    priority: 5
+  - id: snake-game
+    title: "🐍 Create Snake Game"
+    description: "Build a fun interactive game with HTML, CSS, and JavaScript"
+    prompt: "Create a snake game in a new directory with HTML, CSS, and JavaScript, then open it in the browser for me to play."
+    category: coding
+    priority: 4
+  - id: connect-tools
+    title: "🔧 Connect New Tools"
+    description: "Browse and add MCP servers to extend capabilities"
+    prompt: "I want to connect new tools to expand my capabilities. Can you help me understand what MCP servers are available and how to add them?"
+    category: tools
+    priority: 3
+
+# Telemetry configuration (optional) - OpenTelemetry for distributed tracing
+# telemetry:
+#   serviceName: dexto-default-agent
+#   enabled: true
+#   tracerName: dexto-tracer
+#   export:
+#     type: otlp              # 'otlp' for production, 'console' for development
+#     protocol: http          # 'http' or 'grpc'
+#     endpoint: http://127.0.0.1:4318/v1/traces  # OTLP collector endpoint
+#     headers:              # Optional headers for authentication
+#       Authorization: Bearer <token>
 
 ## To use Google Gemini, replace the LLM section with Google Gemini configuration below
 ## Similar for anthropic/groq/etc.
 # llm:
 #   provider: google
-#   model: gemini-2.0-flash
+#   model: gemini-2.5-pro
 #   apiKey: $GOOGLE_GENERATIVE_AI_API_KEY

package/dist/agents/github-agent/github-agent.yml

@@ -17,6 +17,9 @@ mcpServers:
     # env:
     #   GITHUB_OAUTH_SCOPES: 'repo read:user'
 
+# Optional greeting shown at chat start (UI can consume this)
+greeting: "🐙 Hello! I'm your GitHub Agent. How can I help with your repositories?"
+
 systemPrompt:
   contributors:
     - id: primary
@@ -50,8 +53,47 @@ systemPrompt:
       source: dateTime
       enabled: true
 
+# Storage configuration
+storage:
+  cache:
+    type: in-memory
+  database:
+    type: sqlite
+  blob:
+    type: local
+    maxBlobSize: 52428800     # 50MB per blob
+    maxTotalSize: 1073741824  # 1GB total storage
+    cleanupAfterDays: 30
+
 llm:
   provider: openai
   model: gpt-5-mini
   apiKey: $OPENAI_API_KEY
 
+# Starter prompts - GitHub operations examples
+starterPrompts:
+  - id: repo-info
+    title: "📊 Repository Info"
+    description: "Get details about the Dexto repository"
+    prompt: "Show me information about the truffle-ai/dexto repository including stars, forks, and recent activity."
+    category: info
+    priority: 10
+  - id: list-issues
+    title: "📋 List Issues"
+    description: "View open issues in Dexto"
+    prompt: "List all open issues in the truffle-ai/dexto repository."
+    category: issues
+    priority: 9
+  - id: star-dexto
+    title: "⭐ Star Dexto"
+    description: "Star the Dexto repository"
+    prompt: "Star the truffle-ai/dexto repository on GitHub."
+    category: engagement
+    priority: 8
+  - id: recent-commits
+    title: "📝 Recent Commits"
+    description: "View latest commits to Dexto"
+    prompt: "Show me the recent commits to the truffle-ai/dexto repository."
+    category: activity
+    priority: 7
+