llm-advanced-tools 0.1.1 → 0.1.3

package/plan.md

@@ -1,576 +0,0 @@
-Skip to main contentSkip to footer
-Research
-Economic Futures
-
-Commitments
-
-Learn
-News
-Try Claude
-Engineering at Anthropic
-Illustration for advanced tool use article.
-Introducing advanced tool use on the Claude Developer Platform
-Published Nov 24, 2025
-
-We’ve added three new beta features that let Claude discover, learn, and execute tools dynamically. Here’s how they work.
-
-The future of AI agents is one where models work seamlessly across hundreds or thousands of tools. An IDE assistant that integrates git operations, file manipulation, package managers, testing frameworks, and deployment pipelines. An operations coordinator that connects Slack, GitHub, Google Drive, Jira, company databases, and dozens of MCP servers simultaneously.
-
-To build effective agents, they need to work with unlimited tool libraries without stuffing every definition into context upfront. Our blog article on using code execution with MCP discussed how tool results and definitions can sometimes consume 50,000+ tokens before an agent reads a request. Agents should discover and load tools on-demand, keeping only what's relevant for the current task.
-
-Agents also need the ability to call tools from code. When using natural language tool calling, each invocation requires a full inference pass, and intermediate results pile up in context whether they're useful or not. Code is a natural fit for orchestration logic, such as loops, conditionals, and data transformations. Agents need the flexibility to choose between code execution and inference based on the task at hand.
-
-Agents also need to learn correct tool usage from examples, not just schema definitions. JSON schemas define what's structurally valid, but can't express usage patterns: when to include optional parameters, which combinations make sense, or what conventions your API expects.
-
-Today, we're releasing three features that make this possible:
-
-Tool Search Tool, which allows Claude to use search tools to access thousands of tools without consuming its context window
-Programmatic Tool Calling, which allows Claude to invoke tools in a code execution environment reducing the impact on the model’s context window
-Tool Use Examples, which provides a universal standard for demonstrating how to effectively use a given tool
-In internal testing, we’ve found these features have helped us build things that wouldn’t have been possible with conventional tool use patterns. For example, Claude for Excel uses Programmatic Tool Calling to read and modify spreadsheets with thousands of rows without overloading the model’s context window.
-
-Based on our experience, we believe these features open up new possibilities for what you can build with Claude.
-
-
-Tool Search Tool
-The challenge
-MCP tool definitions provide important context, but as more servers connect, those tokens can add up. Consider a five-server setup:
-
-GitHub: 35 tools (~26K tokens)
-Slack: 11 tools (~21K tokens)
-Sentry: 5 tools (~3K tokens)
-Grafana: 5 tools (~3K tokens)
-Splunk: 2 tools (~2K tokens)
-That's 58 tools consuming approximately 55K tokens before the conversation even starts. Add more servers like Jira (which alone uses ~17K tokens) and you're quickly approaching 100K+ token overhead. At Anthropic, we've seen tool definitions consume 134K tokens before optimization.
-
-But token cost isn't the only issue. The most common failures are wrong tool selection and incorrect parameters, especially when tools have similar names like notification-send-user vs. notification-send-channel.
-
-Our solution
-Instead of loading all tool definitions upfront, the Tool Search Tool discovers tools on-demand. Claude only sees the tools it actually needs for the current task.
-
-Tool Search Tool diagram
-Tool Search Tool preserves 191,300 tokens of context compared to 122,800 with Claude’s traditional approach.
-Traditional approach:
-
-All tool definitions loaded upfront (~72K tokens for 50+ MCP tools)
-Conversation history and system prompt compete for remaining space
-Total context consumption: ~77K tokens before any work begins
-With the Tool Search Tool:
-
-Only the Tool Search Tool loaded upfront (~500 tokens)
-Tools discovered on-demand as needed (3-5 relevant tools, ~3K tokens)
-Total context consumption: ~8.7K tokens, preserving 95% of context window
-This represents an 85% reduction in token usage while maintaining access to your full tool library. Internal testing showed significant accuracy improvements on MCP evaluations when working with large tool libraries. Opus 4 improved from 49% to 74%, and Opus 4.5 improved from 79.5% to 88.1% with Tool Search Tool enabled.
-
-How the Tool Search Tool works
-The Tool Search Tool lets Claude dynamically discover tools instead of loading all definitions upfront. You provide all your tool definitions to the API, but mark tools with defer_loading: true to make them discoverable on-demand. Deferred tools aren't loaded into Claude's context initially. Claude only sees the Tool Search Tool itself plus any tools with defer_loading: false (your most critical, frequently-used tools).
-
-When Claude needs specific capabilities, it searches for relevant tools. The Tool Search Tool returns references to matching tools, which get expanded into full definitions in Claude's context.
-
-For example, if Claude needs to interact with GitHub, it searches for "github," and only github.createPullRequest and github.listIssues get loaded—not your other 50+ tools from Slack, Jira, and Google Drive.
-
-This way, Claude has access to your full tool library while only paying the token cost for tools it actually needs.
-
-Prompt caching note: Tool Search Tool doesn't break prompt caching because deferred tools are excluded from the initial prompt entirely. They're only added to context after Claude searches for them, so your system prompt and core tool definitions remain cacheable.
-
-Implementation:
-
-{
-  "tools": [
-    // Include a tool search tool (regex, BM25, or custom)
-    {"type": "tool_search_tool_regex_20251119", "name": "tool_search_tool_regex"},
-
-    // Mark tools for on-demand discovery
-    {
-      "name": "github.createPullRequest",
-      "description": "Create a pull request",
-      "input_schema": {...},
-      "defer_loading": true
-    }
-    // ... hundreds more deferred tools with defer_loading: true
-  ]
-}
-
-Copy
-For MCP servers, you can defer loading entire servers while keeping specific high-use tools loaded:
-
-{
-  "type": "mcp_toolset",
-  "mcp_server_name": "google-drive",
-  "default_config": {"defer_loading": true}, # defer loading the entire server
-  "configs": {
-    "search_files": {
-"defer_loading": false
-    }  // Keep most used tool loaded
-  }
-}
-
-Copy
-The Claude Developer Platform provides regex-based and BM25-based search tools out of the box, but you can also implement custom search tools using embeddings or other strategies.
-
-When to use the Tool Search Tool
-Like any architectural decision, enabling the Tool Search Tool involves trade-offs. The feature adds a search step before tool invocation, so it delivers the best ROI when the context savings and accuracy improvements outweigh additional latency.
-
-Use it when:
-
-Tool definitions consuming >10K tokens
-Experiencing tool selection accuracy issues
-Building MCP-powered systems with multiple servers
-10+ tools available
-Less beneficial when:
-
-Small tool library (<10 tools)
-All tools used frequently in every session
-Tool definitions are compact
-Programmatic Tool Calling
-The challenge
-Traditional tool calling creates two fundamental problems as workflows become more complex:
-
-Context pollution from intermediate results: When Claude analyzes a 10MB log file for error patterns, the entire file enters its context window, even though Claude only needs a summary of error frequencies. When fetching customer data across multiple tables, every record accumulates in context regardless of relevance. These intermediate results consume massive token budgets and can push important information out of the context window entirely.
-Inference overhead and manual synthesis: Each tool call requires a full model inference pass. After receiving results, Claude must "eyeball" the data to extract relevant information, reason about how pieces fit together, and decide what to do next—all through natural language processing. A five tool workflow means five inference passes plus Claude parsing each result, comparing values, and synthesizing conclusions. This is both slow and error-prone.
-Our solution
-Programmatic Tool Calling enables Claude to orchestrate tools through code rather than through individual API round-trips. Instead of Claude requesting tools one at a time with each result being returned to its context, Claude writes code that calls multiple tools, processes their outputs, and controls what information actually enters its context window.
-
-Claude excels at writing code and by letting it express orchestration logic in Python rather than through natural language tool invocations, you get more reliable, precise control flow. Loops, conditionals, data transformations, and error handling are all explicit in code rather than implicit in Claude's reasoning.
-
-Example: Budget compliance check
-Consider a common business task: "Which team members exceeded their Q3 travel budget?"
-
-You have three tools available:
-
-get_team_members(department) - Returns team member list with IDs and levels
-get_expenses(user_id, quarter) - Returns expense line items for a user
-get_budget_by_level(level) - Returns budget limits for an employee level
-Traditional approach:
-
-Fetch team members → 20 people
-For each person, fetch their Q3 expenses → 20 tool calls, each returning 50-100 line items (flights, hotels, meals, receipts)
-Fetch budget limits by employee level
-All of this enters Claude's context: 2,000+ expense line items (50 KB+)
-Claude manually sums each person's expenses, looks up their budget, compares expenses against budget limits
-More round-trips to the model, significant context consumption
-With Programmatic Tool Calling:
-
-Instead of each tool result returning to Claude, Claude writes a Python script that orchestrates the entire workflow. The script runs in the Code Execution tool (a sandboxed environment), pausing when it needs results from your tools. When you return tool results via the API, they're processed by the script rather than consumed by the model. The script continues executing, and Claude only sees the final output.
-
-Programmatic tool calling flow
-Programmatic Tool Calling enables Claude to orchestrate tools through code rather than through individual API round-trips, allowing for parallel tool execution.
-Here's what Claude's orchestration code looks like for the budget compliance task:
-
-team = await get_team_members("engineering")
-
-# Fetch budgets for each unique level
-levels = list(set(m["level"] for m in team))
-budget_results = await asyncio.gather(*[
-    get_budget_by_level(level) for level in levels
-])
-
-# Create a lookup dictionary: {"junior": budget1, "senior": budget2, ...}
-budgets = {level: budget for level, budget in zip(levels, budget_results)}
-
-# Fetch all expenses in parallel
-expenses = await asyncio.gather(*[
-    get_expenses(m["id"], "Q3") for m in team
-])
-
-# Find employees who exceeded their travel budget
-exceeded = []
-for member, exp in zip(team, expenses):
-    budget = budgets[member["level"]]
-    total = sum(e["amount"] for e in exp)
-    if total > budget["travel_limit"]:
-        exceeded.append({
-            "name": member["name"],
-            "spent": total,
-            "limit": budget["travel_limit"]
-        })
-
-print(json.dumps(exceeded))
-
-Copy
-
-Expand
-Claude's context receives only the final result: the two to three people who exceeded their budget. The 2,000+ line items, the intermediate sums, and the budget lookups do not affect Claude’s context, reducing consumption from 200KB of raw expense data to just 1KB of results.
-
-The efficiency gains are substantial:
-
-Token savings: By keeping intermediate results out of Claude's context, PTC dramatically reduces token consumption. Average usage dropped from 43,588 to 27,297 tokens, a 37% reduction on complex research tasks.
-Reduced latency: Each API round-trip requires model inference (hundreds of milliseconds to seconds). When Claude orchestrates 20+ tool calls in a single code block, you eliminate 19+ inference passes. The API handles tool execution without returning to the model each time.
-Improved accuracy: By writing explicit orchestration logic, Claude makes fewer errors than when juggling multiple tool results in natural language. Internal knowledge retrieval improved from 25.6% to 28.5%; GIA benchmarks from 46.5% to 51.2%.
-Production workflows involve messy data, conditional logic, and operations that need to scale. Programmatic Tool Calling lets Claude handle that complexity programmatically while keeping its focus on actionable results rather than raw data processing.
-
-How Programmatic Tool Calling works
-1. Mark tools as callable from code
-Add code_execution to tools, and set allowed_callers to opt-in tools for programmatic execution:
-
-{
-  "tools": [
-    {
-      "type": "code_execution_20250825",
-      "name": "code_execution"
-    },
-    {
-      "name": "get_team_members",
-      "description": "Get all members of a department...",
-      "input_schema": {...},
-      "allowed_callers": ["code_execution_20250825"] # opt-in to programmatic tool calling
-    },
-    {
-      "name": "get_expenses",
- 	...
-    },
-    {
-      "name": "get_budget_by_level",
-	...
-    }
-  ]
-}
-
-Copy
-
-Expand
-The API converts these tool definitions into Python functions that Claude can call.
-
-2. Claude writes orchestration code
-Instead of requesting tools one at a time, Claude generates Python code:
-
-{
-  "type": "server_tool_use",
-  "id": "srvtoolu_abc",
-  "name": "code_execution",
-  "input": {
-    "code": "team = get_team_members('engineering')\n..." # the code example above
-  }
-}
-
-Copy
-3. Tools execute without hitting Claude's context
-When the code calls get_expenses(), you receive a tool request with a caller field:
-
-{
-  "type": "tool_use",
-  "id": "toolu_xyz",
-  "name": "get_expenses",
-  "input": {"user_id": "emp_123", "quarter": "Q3"},
-  "caller": {
-    "type": "code_execution_20250825",
-    "tool_id": "srvtoolu_abc"
-  }
-}
-
-Copy
-You provide the result, which is processed in the Code Execution environment rather than Claude's context. This request-response cycle repeats for each tool call in the code.
-
-4. Only final output enters context
-When the code finishes running, only the results of the code are returned to Claude:
-
-{
-  "type": "code_execution_tool_result",
-  "tool_use_id": "srvtoolu_abc",
-  "content": {
-    "stdout": "[{\"name\": \"Alice\", \"spent\": 12500, \"limit\": 10000}...]"
-  }
-}
-
-Copy
-This is all Claude sees, not the 2000+ expense line items processed along the way.
-
-When to use Programmatic Tool Calling
-Programmatic Tool Calling adds a code execution step to your workflow. This extra overhead pays off when the token savings, latency improvements, and accuracy gains are substantial.
-
-Most beneficial when:
-
-Processing large datasets where you only need aggregates or summaries
-Running multi-step workflows with three or more dependent tool calls
-Filtering, sorting, or transforming tool results before Claude sees them
-Handling tasks where intermediate data shouldn't influence Claude's reasoning
-Running parallel operations across many items (checking 50 endpoints, for example)
-Less beneficial when:
-
-Making simple single-tool invocations
-Working on tasks where Claude should see and reason about all intermediate results
-Running quick lookups with small responses
-Tool Use Examples
-The challenge
-JSON Schema excels at defining structure–types, required fields, allowed enums–but it can't express usage patterns: when to include optional parameters, which combinations make sense, or what conventions your API expects.
-
-Consider a support ticket API:
-
-{
-  "name": "create_ticket",
-  "input_schema": {
-    "properties": {
-      "title": {"type": "string"},
-      "priority": {"enum": ["low", "medium", "high", "critical"]},
-      "labels": {"type": "array", "items": {"type": "string"}},
-      "reporter": {
-        "type": "object",
-        "properties": {
-          "id": {"type": "string"},
-          "name": {"type": "string"},
-          "contact": {
-            "type": "object",
-            "properties": {
-              "email": {"type": "string"},
-              "phone": {"type": "string"}
-            }
-          }
-        }
-      },
-      "due_date": {"type": "string"},
-      "escalation": {
-        "type": "object",
-        "properties": {
-          "level": {"type": "integer"},
-          "notify_manager": {"type": "boolean"},
-          "sla_hours": {"type": "integer"}
-        }
-      }
-    },
-    "required": ["title"]
-  }
-}
-
-Copy
-
-Expand
-The schema defines what's valid, but leaves critical questions unanswered:
-
-Format ambiguity: Should due_date use "2024-11-06", "Nov 6, 2024", or "2024-11-06T00:00:00Z"?
-ID conventions: Is reporter.id a UUID, "USR-12345", or just "12345"?
-Nested structure usage: When should Claude populate reporter.contact?
-Parameter correlations: How do escalation.level and escalation.sla_hours relate to priority?
-These ambiguities can lead to malformed tool calls and inconsistent parameter usage.
-
-Our solution
-Tool Use Examples let you provide sample tool calls directly in your tool definitions. Instead of relying on schema alone, you show Claude concrete usage patterns:
-
-{
-    "name": "create_ticket",
-    "input_schema": { /* same schema as above */ },
-    "input_examples": [
-      {
-        "title": "Login page returns 500 error",
-        "priority": "critical",
-        "labels": ["bug", "authentication", "production"],
-        "reporter": {
-          "id": "USR-12345",
-          "name": "Jane Smith",
-          "contact": {
-            "email": "jane@acme.com",
-            "phone": "+1-555-0123"
-          }
-        },
-        "due_date": "2024-11-06",
-        "escalation": {
-          "level": 2,
-          "notify_manager": true,
-          "sla_hours": 4
-        }
-      },
-      {
-        "title": "Add dark mode support",
-        "labels": ["feature-request", "ui"],
-        "reporter": {
-          "id": "USR-67890",
-          "name": "Alex Chen"
-        }
-      },
-      {
-        "title": "Update API documentation"
-      }
-    ]
-  }
-
-Copy
-
-Expand
-From these three examples, Claude learns:
-
-Format conventions: Dates use YYYY-MM-DD, user IDs follow USR-XXXXX, labels use kebab-case
-Nested structure patterns: How to construct the reporter object with its nested contact object
-Optional parameter correlations: Critical bugs have full contact info + escalation with tight SLAs; feature requests have reporter but no contact/escalation; internal tasks have title only
-In our own internal testing, tool use examples improved accuracy from 72% to 90% on complex parameter handling.
-
-When to use Tool Use Examples
-Tool Use Examples add tokens to your tool definitions, so they’re most valuable when accuracy improvements outweigh the additional cost.
-
-Most beneficial when:
-
-Complex nested structures where valid JSON doesn't imply correct usage
-Tools with many optional parameters and inclusion patterns matter
-APIs with domain-specific conventions not captured in schemas
-Similar tools where examples clarify which one to use (e.g., create_ticket vs create_incident)
-Less beneficial when:
-
-Simple single-parameter tools with obvious usage
-Standard formats like URLs or emails that Claude already understands
-Validation concerns better handled by JSON Schema constraints
-Best practices
-Building agents that take real-world actions means handling scale, complexity, and precision simultaneously. These three features work together to solve different bottlenecks in tool use workflows. Here's how to combine them effectively.
-
-Layer features strategically
-Not every agent needs to use all three features for a given task. Start with your biggest bottleneck:
-
-Context bloat from tool definitions → Tool Search Tool
-Large intermediate results polluting context → Programmatic Tool Calling
-Parameter errors and malformed calls → Tool Use Examples
-This focused approach lets you address the specific constraint limiting your agent's performance, rather than adding complexity upfront.
-
-Then layer additional features as needed. They're complementary: Tool Search Tool ensures the right tools are found, Programmatic Tool Calling ensures efficient execution, and Tool Use Examples ensure correct invocation.
-
-Set up Tool Search Tool for better discovery
-Tool search matches against names and descriptions, so clear, descriptive definitions improve discovery accuracy.
-
-// Good
-{
-    "name": "search_customer_orders",
-    "description": "Search for customer orders by date range, status, or total amount. Returns order details including items, shipping, and payment info."
-}
-
-// Bad
-{
-    "name": "query_db_orders",
-    "description": "Execute order query"
-}
-
-Copy
-Add system prompt guidance so Claude knows what's available:
-
-You have access to tools for Slack messaging, Google Drive file management, 
-Jira ticket tracking, and GitHub repository operations. Use the tool search 
-to find specific capabilities.
-
-Copy
-Keep your three to five most-used tools always loaded, defer the rest. This balances immediate access for common operations with on-demand discovery for everything else.
-
-Set up Programmatic Tool Calling for correct execution
-Since Claude writes code to parse tool outputs, document return formats clearly. This helps Claude write correct parsing logic:
-
-{
-    "name": "get_orders",
-    "description": "Retrieve orders for a customer.
-Returns:
-    List of order objects, each containing:
-    - id (str): Order identifier
-    - total (float): Order total in USD
-    - status (str): One of 'pending', 'shipped', 'delivered'
-    - items (list): Array of {sku, quantity, price}
-    - created_at (str): ISO 8601 timestamp"
-}
-
-Copy
-See below for opt-in tools that benefit from programmatic orchestration:
-
-Tools that can run in parallel (independent operations)
-Operations safe to retry (idempotent)
-Set up Tool Use Examples for parameter accuracy
-Craft examples for behavioral clarity:
-
-Use realistic data (real city names, plausible prices, not "string" or "value")
-Show variety with minimal, partial, and full specification patterns
-Keep it concise: 1-5 examples per tool
-Focus on ambiguity (only add examples where correct usage isn't obvious from schema)
-Getting started
-These features are available in beta. To enable them, add the beta header and include the tools you need:
-
-client.beta.messages.create(
-    betas=["advanced-tool-use-2025-11-20"],
-    model="claude-sonnet-4-5-20250929",
-    max_tokens=4096,
-    tools=[
-        {"type": "tool_search_tool_regex_20251119", "name": "tool_search_tool_regex"},
-        {"type": "code_execution_20250825", "name": "code_execution"},
-        # Your tools with defer_loading, allowed_callers, and input_examples
-    ]
-)
-
-Copy
-For detailed API documentation and SDK examples, see our:
-
-Documentation and cookbook for Tool Search Tool
-Documentation and cookbook for Programmatic Tool Calling
-Documentation for Tool Use Examples
-These features move tool use from simple function calling toward intelligent orchestration. As agents tackle more complex workflows spanning dozens of tools and large datasets, dynamic discovery, efficient execution, and reliable invocation become foundational.
-
-We're excited to see what you build.
-
-Acknowledgements
-Written by Bin Wu, with contributions from Adam Jones, Artur Renault, Henry Tay, Jake Noble, Nathan McCandlish, Noah Picard, Sam Jiang, and the Claude Developer Platform team. This work builds on foundational research by Chris Gorgolewski, Daniel Jiang, Jeremy Fox and Mike Lambert. We also drew inspiration from across the AI ecosystem, including Joel Pobar's LLMVM, Cloudflare's Code Mode and Code Execution as MCP. Special thanks to Andy Schumeister, Hamish Kerr, Keir Bradwell, Matt Bleifer and Molly Vorwerck for their support.
-
-Get the developer newsletter
-Product updates, how-tos, community spotlights, and more. Delivered monthly to your inbox.
-
-Enter your email
-
-Please provide your email address if you’d like to receive our monthly developer newsletter. You can unsubscribe at any time.
-
-Products
-Claude
-Claude Code
-Claude in Chrome
-Claude in Excel
-Claude in Slack
-Skills
-Max plan
-Team plan
-Enterprise plan
-Download app
-Pricing
-Log in to Claude
-Models
-Opus
-Sonnet
-Haiku
-Solutions
-AI agents
-Code modernization
-Coding
-Customer support
-Education
-Financial services
-Government
-Life sciences
-Nonprofits
-Claude Developer Platform
-Overview
-Developer docs
-Pricing
-Regional Compliance
-Amazon Bedrock
-Google Cloud’s Vertex AI
-Console login
-Learn
-Blog
-Claude partner network
-Connectors
-Courses
-Customer stories
-Engineering at Anthropic
-Events
-Powered by Claude
-Service partners
-Startups program
-Tutorials
-Use cases
-Company
-Anthropic
-Careers
-Economic Futures
-Research
-News
-Responsible Scaling Policy
-Security and compliance
-Transparency
-Help and security
-Availability
-Status
-Support center
-Terms and policies
-Privacy choices
-Privacy policy
-Responsible disclosure policy
-Terms of service: Commercial
-Terms of service: Consumer
-Usage policy
-© 2025 Anthropic PBC

package/src/adapters/index.ts

@@ -1,2 +0,0 @@
-export { OpenAIAdapter } from './openai';
-export { VercelAIAdapter } from './vercel-ai';