fine 0.1.0 → 0.2.0

data/docs/tutorials/lora-tool-calling.md

@@ -0,0 +1,306 @@
+# LoRA Fine-Tuning for Tool Calling
+
+Train LLMs to generate Ollama-compatible tool calls using parameter-efficient LoRA fine-tuning.
+
+## Overview
+
+This tutorial shows how to fine-tune Gemma 3 to output structured JSON tool calls that work with Ollama's tool calling API. Using LoRA, we train only 0.5% of the model's parameters while achieving good results.
+
+**What you'll learn:**
+- Prepare training data in Ollama tool call format
+- Apply LoRA for memory-efficient fine-tuning
+- Train and evaluate the model
+- Export for use with Ollama
+
+## Quick Start
+
+```ruby
+require "fine"
+
+# Load model
+model = Fine::Models::CausalLM.from_pretrained("google/gemma-3-1b-it")
+
+# Apply LoRA (only 0.5% of params become trainable)
+Fine::LoRA.apply(model, rank: 32, alpha: 64, target_modules: %w[q_proj k_proj v_proj o_proj])
+
+# Train
+llm = Fine::LLM.new("google/gemma-3-1b-it")
+llm.fit(train_file: "tool_calls.jsonl", epochs: 15)
+
+# Generate
+llm.generate("What's the weather in Tokyo?")
+# => {"role":"assistant","tool_calls":[{"type":"function","function":{"index":0,"name":"get_weather","arguments":{"location":"Tokyo"}}}]}
+```
+
+## Training Data Format
+
+Ollama expects tool calls in this JSON format:
+
+```json
+{
+  "role": "assistant",
+  "tool_calls": [
+    {
+      "type": "function",
+      "function": {
+        "index": 0,
+        "name": "get_weather",
+        "arguments": {
+          "location": "Tokyo"
+        }
+      }
+    }
+  ]
+}
+```
+
+Create training data in Alpaca format with this output structure:
+
+```jsonl
+{"instruction": "What's the weather in Tokyo?", "input": "You have access to the following tools:\n\nget_weather: Get current weather\n  Parameters: location (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"get_weather\", \"arguments\": {\"location\": \"Tokyo\"}}}]}"}
+{"instruction": "Calculate 25 * 4", "input": "You have access to the following tools:\n\ncalculate: Math calculator\n  Parameters: expression (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"calculate\", \"arguments\": {\"expression\": \"25 * 4\"}}}]}"}
+```
+
+## Full Training Script
+
+```ruby
+#!/usr/bin/env ruby
+require "bundler/setup"
+require "fine"
+
+Fine.configure { |c| c.progress_bar = false }
+
+model_id = "google/gemma-3-1b-it"
+data_path = "data/ollama_tool_calls.jsonl"
+
+# 1. Load model
+puts "Loading model..."
+model = Fine::Models::CausalLM.from_pretrained(model_id)
+
+# 2. Apply LoRA
+puts "Applying LoRA..."
+Fine::LoRA.apply(
+  model,
+  rank: 32,           # Higher rank = more capacity
+  alpha: 64,          # Scaling factor (usually 2x rank)
+  dropout: 0.05,      # Light regularization
+  target_modules: %w[q_proj k_proj v_proj o_proj]
+)
+# Output:
+#   LoRA applied to 104 layers
+#   Total params: 1.31B
+#   Trainable params: 5.96M (0.46%)
+
+# 3. Move to GPU and set train mode
+model.to(Fine.device)
+model.train
+
+# 4. Load tokenizer and data
+downloader = Fine::Hub::ModelDownloader.new(model_id)
+model_path = downloader.download
+tokenizer = Fine::Tokenizers::AutoTokenizer.new(model_path, max_length: 384)
+
+dataset = Fine::Datasets::InstructionDataset.from_jsonl(
+  data_path,
+  tokenizer: tokenizer,
+  format: :alpaca,
+  max_length: 384
+)
+
+data_loader = Fine::Datasets::InstructionDataLoader.new(
+  dataset,
+  batch_size: 1,
+  shuffle: true,
+  pad_token_id: tokenizer.pad_token_id
+)
+
+# 5. Train with LoRA parameters only
+lora_params = Fine::LoRA.trainable_parameters(model)
+optimizer = Torch::Optim::AdamW.new(lora_params, lr: 1e-4)
+
+15.times do |epoch|
+  epoch_loss = 0.0
+  batch_count = 0
+
+  data_loader.each do |batch|
+    input_ids = batch[:input_ids].to(Fine.device)
+    labels = batch[:labels].to(Fine.device)
+    attention_mask = batch[:attention_mask].to(Fine.device)
+
+    outputs = model.forward(input_ids, attention_mask: attention_mask, labels: labels)
+    loss = outputs[:loss]
+
+    loss.backward
+    optimizer.step
+    optimizer.zero_grad
+
+    epoch_loss += loss.to(:float32).item
+    batch_count += 1
+  end
+
+  puts "Epoch #{epoch + 1}: loss=#{(epoch_loss / batch_count).round(4)}"
+end
+
+# 6. Merge LoRA weights and save
+Fine::LoRA.merge!(model)
+model.save("/tmp/gemma3-tools")
+tokenizer.save("/tmp/gemma3-tools")
+```
+
+## Training Results
+
+With 105 training examples and 15 epochs:
+
+| Metric | Value |
+|--------|-------|
+| Initial loss | 3.78 |
+| Final loss | 0.106 |
+| Improvement | 97% |
+| Training memory | 4.8-5.0 GB |
+| Peak memory | ~10 GB |
+| Trainable params | 5.96M (0.46%) |
+
+## LoRA Configuration
+
+### Rank
+
+Controls model capacity. Higher = more expressive but more memory.
+
+| Rank | Trainable Params | Use Case |
+|------|------------------|----------|
+| 8 | ~1.5M | Simple tasks |
+| 16 | ~3M | General fine-tuning |
+| 32 | ~6M | Complex structured output |
+| 64 | ~12M | Maximum capacity |
+
+### Target Modules
+
+Which layers to apply LoRA to:
+
+```ruby
+# Minimal (query + value only)
+target_modules: %w[q_proj v_proj]
+
+# Recommended (all attention)
+target_modules: %w[q_proj k_proj v_proj o_proj]
+
+# Maximum (attention + MLP)
+target_modules: %w[q_proj k_proj v_proj o_proj gate_proj up_proj down_proj]
+```
+
+### Alpha
+
+Scaling factor, typically 2x the rank:
+
+```ruby
+Fine::LoRA.apply(model, rank: 32, alpha: 64)  # alpha = 2 * rank
+```
+
+## Memory Usage
+
+LoRA dramatically reduces memory compared to full fine-tuning:
+
+| Model | Full Fine-tune | LoRA (rank=32) |
+|-------|----------------|----------------|
+| Gemma 3 1B | ~12 GB | ~5 GB |
+| Gemma 3 4B | ~40 GB | ~12 GB |
+| Llama 3.2 7B | ~60 GB | ~18 GB |
+
+## Testing Generation
+
+```ruby
+model.eval
+
+prompt = <<~PROMPT
+### Instruction:
+What's the weather in Tokyo?
+
+### Input:
+You have access to the following tools:
+
+get_weather: Get current weather
+  Parameters: location (string, required)
+
+Respond with a JSON tool call if a tool is needed.
+
+### Response:
+PROMPT
+
+ids = tokenizer.encode_for_generation(prompt)
+input_ids = Torch.tensor([ids]).to(Fine.device)
+
+Torch.no_grad do
+  output_ids = model.generate(
+    input_ids,
+    max_new_tokens: 150,
+    temperature: 0.1,
+    do_sample: false
+  )
+
+  response = tokenizer.decode(output_ids[0].to_a)
+  json_output = response.split("### Response:").last.strip
+
+  puts json_output
+  # {"role":"assistant","tool_calls":[{"type":"function","function":{"index":0,"name":"get_weather","arguments":{"location":"Tokyo"}}}]}
+end
+```
+
+## Tips for Better Results
+
+1. **More training data** - 100+ examples per tool type
+2. **Diverse examples** - Vary phrasing and argument values
+3. **Higher rank** - Use rank 32-64 for complex JSON
+4. **More epochs** - 15-20 epochs for structured output
+5. **Lower learning rate** - 1e-4 to 5e-5 for stability
+
+## Generating Training Data
+
+Use this script to generate diverse examples:
+
+```ruby
+TOOLS = {
+  get_weather: {
+    description: "Get current weather",
+    params: { location: "string, required" },
+    examples: [
+      { q: "What's the weather in Tokyo?", args: { location: "Tokyo" } },
+      { q: "Is it raining in Seattle?", args: { location: "Seattle" } },
+      # ... more examples
+    ]
+  },
+  calculate: {
+    description: "Math calculator",
+    params: { expression: "string, required" },
+    examples: [
+      { q: "Calculate 25 * 4", args: { expression: "25 * 4" } },
+      # ... more examples
+    ]
+  }
+}
+
+def generate_output(name, args)
+  {
+    role: "assistant",
+    tool_calls: [{
+      type: "function",
+      function: { index: 0, name: name.to_s, arguments: args }
+    }]
+  }
+end
+
+# Generate JSONL
+TOOLS.each do |name, tool|
+  tool[:examples].each do |ex|
+    puts({
+      instruction: ex[:q],
+      input: "You have access to...",
+      output: generate_output(name, ex[:args]).to_json
+    }.to_json)
+  end
+end
+```
+
+## See Also
+
+- [LLM Fine-tuning](llm-fine-tuning.md) - Full fine-tuning without LoRA
+- [Model Export](model-export.md) - Export to GGUF for Ollama

data/examples/data/generate_tool_data.rb

@@ -0,0 +1,261 @@
+#!/usr/bin/env ruby
+# frozen_string_literal: true
+
+# Generate diverse Ollama tool calling training data
+
+require "json"
+
+# Tool definitions with example usages
+TOOLS = {
+  get_weather: {
+    description: "Get current weather for a location",
+    params: { location: "string, required" },
+    examples: [
+      { q: "What's the weather in Tokyo?", args: { location: "Tokyo" } },
+      { q: "Is it raining in Seattle?", args: { location: "Seattle" } },
+      { q: "Check the forecast for Paris", args: { location: "Paris" } },
+      { q: "How cold is it in Moscow?", args: { location: "Moscow" } },
+      { q: "Weather conditions in Sydney", args: { location: "Sydney" } },
+      { q: "Temperature in New York City", args: { location: "New York City" } },
+      { q: "What's it like outside in London?", args: { location: "London" } },
+      { q: "Is it sunny in Miami?", args: { location: "Miami" } },
+      { q: "Current weather for Berlin", args: { location: "Berlin" } },
+      { q: "How's the weather in San Francisco?", args: { location: "San Francisco" } },
+      { q: "Will I need an umbrella in Vancouver?", args: { location: "Vancouver" } },
+      { q: "Check if it's snowing in Denver", args: { location: "Denver" } },
+      { q: "What's the temperature in Chicago?", args: { location: "Chicago" } },
+      { q: "Weather report for Los Angeles", args: { location: "Los Angeles" } },
+      { q: "Is it hot in Phoenix today?", args: { location: "Phoenix" } },
+    ]
+  },
+  calculate: {
+    description: "Evaluate a math expression",
+    params: { expression: "string, required" },
+    examples: [
+      { q: "Calculate 25 * 4 + 10", args: { expression: "25 * 4 + 10" } },
+      { q: "What's 15% of 200?", args: { expression: "0.15 * 200" } },
+      { q: "Find the square root of 144", args: { expression: "sqrt(144)" } },
+      { q: "2 to the power of 10", args: { expression: "2 ** 10" } },
+      { q: "Divide 1000 by 8", args: { expression: "1000 / 8" } },
+      { q: "What is 123 + 456?", args: { expression: "123 + 456" } },
+      { q: "Calculate the area of a circle with radius 5", args: { expression: "3.14159 * 5 * 5" } },
+      { q: "How much is 99 times 99?", args: { expression: "99 * 99" } },
+      { q: "What's 50 divided by 7?", args: { expression: "50 / 7" } },
+      { q: "Calculate 3 factorial", args: { expression: "3 * 2 * 1" } },
+      { q: "What's 1000 minus 347?", args: { expression: "1000 - 347" } },
+      { q: "Find 20% of 500", args: { expression: "0.20 * 500" } },
+      { q: "Calculate 8 cubed", args: { expression: "8 ** 3" } },
+      { q: "What is sqrt(256)?", args: { expression: "sqrt(256)" } },
+      { q: "How much is 75 + 25 * 2?", args: { expression: "75 + 25 * 2" } },
+    ]
+  },
+  search_web: {
+    description: "Search the web for information",
+    params: { query: "string, required" },
+    examples: [
+      { q: "Search for Ruby tutorials", args: { query: "Ruby tutorials" } },
+      { q: "Find information about machine learning", args: { query: "machine learning" } },
+      { q: "Look up the population of Japan", args: { query: "population of Japan" } },
+      { q: "Search for Python documentation", args: { query: "Python documentation" } },
+      { q: "Find recipes for pasta", args: { query: "pasta recipes" } },
+      { q: "Search the latest news about AI", args: { query: "latest AI news" } },
+      { q: "Look up reviews for iPhone 15", args: { query: "iPhone 15 reviews" } },
+      { q: "Find hotels in Barcelona", args: { query: "hotels in Barcelona" } },
+      { q: "Search for JavaScript frameworks", args: { query: "JavaScript frameworks" } },
+      { q: "Look up symptoms of flu", args: { query: "flu symptoms" } },
+      { q: "Find the best coffee shops nearby", args: { query: "best coffee shops" } },
+      { q: "Search for remote job listings", args: { query: "remote jobs" } },
+      { q: "Find hiking trails in Colorado", args: { query: "hiking trails Colorado" } },
+      { q: "Look up electric car comparisons", args: { query: "electric car comparison" } },
+      { q: "Search for meditation apps", args: { query: "meditation apps" } },
+    ]
+  },
+  send_email: {
+    description: "Send an email",
+    params: { to: "string, required", subject: "string, required", body: "string, required" },
+    examples: [
+      { q: "Send email to john@example.com about the meeting tomorrow", args: { to: "john@example.com", subject: "Meeting Tomorrow", body: "Hi, I wanted to discuss the meeting scheduled for tomorrow." } },
+      { q: "Email sarah@work.com regarding the project update", args: { to: "sarah@work.com", subject: "Project Update", body: "Hi Sarah, Here's the latest update on our project." } },
+      { q: "Send a thank you note to boss@company.com", args: { to: "boss@company.com", subject: "Thank You", body: "Thank you for the opportunity and support." } },
+      { q: "Email team@startup.io about the launch", args: { to: "team@startup.io", subject: "Launch Day", body: "Team, today is launch day! Let's make it great." } },
+      { q: "Send meeting notes to alice@corp.com", args: { to: "alice@corp.com", subject: "Meeting Notes", body: "Here are the notes from today's meeting." } },
+    ]
+  },
+  create_event: {
+    description: "Create a calendar event",
+    params: { title: "string, required", date: "string, required", time: "string, required" },
+    examples: [
+      { q: "Create event for Friday at 3pm called Team Standup", args: { title: "Team Standup", date: "Friday", time: "3pm" } },
+      { q: "Schedule a dentist appointment for Monday at 10am", args: { title: "Dentist Appointment", date: "Monday", time: "10am" } },
+      { q: "Add lunch meeting to calendar for tomorrow at noon", args: { title: "Lunch Meeting", date: "tomorrow", time: "12pm" } },
+      { q: "Create a reminder for gym on Wednesday 6pm", args: { title: "Gym", date: "Wednesday", time: "6pm" } },
+      { q: "Schedule interview for next Tuesday at 2pm", args: { title: "Interview", date: "next Tuesday", time: "2pm" } },
+    ]
+  },
+  set_reminder: {
+    description: "Set a reminder",
+    params: { message: "string, required" },
+    examples: [
+      { q: "Remind me to buy milk", args: { message: "buy milk" } },
+      { q: "Set a reminder to call mom", args: { message: "call mom" } },
+      { q: "Remind me to submit the report", args: { message: "submit the report" } },
+      { q: "Set reminder to water the plants", args: { message: "water the plants" } },
+      { q: "Remind me to take my medication", args: { message: "take medication" } },
+    ]
+  },
+  translate: {
+    description: "Translate text to another language",
+    params: { text: "string, required", target_language: "string, required" },
+    examples: [
+      { q: "Translate hello to Spanish", args: { text: "hello", target_language: "Spanish" } },
+      { q: "How do you say goodbye in French?", args: { text: "goodbye", target_language: "French" } },
+      { q: "Translate 'thank you' to Japanese", args: { text: "thank you", target_language: "Japanese" } },
+      { q: "Say 'I love you' in Italian", args: { text: "I love you", target_language: "Italian" } },
+      { q: "What's 'good morning' in German?", args: { text: "good morning", target_language: "German" } },
+    ]
+  },
+  get_time: {
+    description: "Get the current time in a timezone",
+    params: { timezone: "string, required" },
+    examples: [
+      { q: "What time is it in Tokyo?", args: { timezone: "Asia/Tokyo" } },
+      { q: "Current time in London", args: { timezone: "Europe/London" } },
+      { q: "What's the time in New York?", args: { timezone: "America/New_York" } },
+      { q: "Time in Sydney now", args: { timezone: "Australia/Sydney" } },
+      { q: "What time is it in Paris?", args: { timezone: "Europe/Paris" } },
+    ]
+  },
+  read_file: {
+    description: "Read contents of a file",
+    params: { path: "string, required" },
+    examples: [
+      { q: "Read the config.json file", args: { path: "config.json" } },
+      { q: "Show me the contents of README.md", args: { path: "README.md" } },
+      { q: "Open the .env file", args: { path: ".env" } },
+      { q: "Read package.json", args: { path: "package.json" } },
+      { q: "Show the Gemfile contents", args: { path: "Gemfile" } },
+    ]
+  },
+  write_file: {
+    description: "Write content to a file",
+    params: { path: "string, required", content: "string, required" },
+    examples: [
+      { q: "Write 'hello world' to output.txt", args: { path: "output.txt", content: "hello world" } },
+      { q: "Create a file test.txt with 'test content'", args: { path: "test.txt", content: "test content" } },
+      { q: "Save 'done' to status.txt", args: { path: "status.txt", content: "done" } },
+      { q: "Write my notes to notes.md", args: { path: "notes.md", content: "My notes" } },
+      { q: "Create log.txt with 'Started'", args: { path: "log.txt", content: "Started" } },
+    ]
+  },
+  run_command: {
+    description: "Run a shell command",
+    params: { command: "string, required" },
+    examples: [
+      { q: "Run the tests", args: { command: "npm test" } },
+      { q: "Install dependencies", args: { command: "npm install" } },
+      { q: "Build the project", args: { command: "npm run build" } },
+      { q: "Start the server", args: { command: "npm start" } },
+      { q: "Check git status", args: { command: "git status" } },
+    ]
+  },
+  list_files: {
+    description: "List files in a directory",
+    params: { path: "string, required" },
+    examples: [
+      { q: "List files in the current directory", args: { path: "." } },
+      { q: "Show files in the src folder", args: { path: "src" } },
+      { q: "What's in the downloads folder?", args: { path: "downloads" } },
+      { q: "List contents of /tmp", args: { path: "/tmp" } },
+      { q: "Show files in home directory", args: { path: "~" } },
+    ]
+  },
+  convert_currency: {
+    description: "Convert between currencies",
+    params: { amount: "number, required", from_currency: "string, required", to_currency: "string, required" },
+    examples: [
+      { q: "Convert 100 USD to EUR", args: { amount: 100, from_currency: "USD", to_currency: "EUR" } },
+      { q: "How much is 50 GBP in JPY?", args: { amount: 50, from_currency: "GBP", to_currency: "JPY" } },
+      { q: "Convert 1000 EUR to USD", args: { amount: 1000, from_currency: "EUR", to_currency: "USD" } },
+      { q: "What's 200 CAD in AUD?", args: { amount: 200, from_currency: "CAD", to_currency: "AUD" } },
+      { q: "Convert 500 CHF to GBP", args: { amount: 500, from_currency: "CHF", to_currency: "GBP" } },
+    ]
+  },
+  get_stock_price: {
+    description: "Get current stock price",
+    params: { symbol: "string, required" },
+    examples: [
+      { q: "What's the price of AAPL stock?", args: { symbol: "AAPL" } },
+      { q: "Check Google stock price", args: { symbol: "GOOGL" } },
+      { q: "Get Tesla stock quote", args: { symbol: "TSLA" } },
+      { q: "Price of Microsoft stock", args: { symbol: "MSFT" } },
+      { q: "How is Amazon stock doing?", args: { symbol: "AMZN" } },
+    ]
+  },
+  get_directions: {
+    description: "Get directions between locations",
+    params: { origin: "string, required", destination: "string, required" },
+    examples: [
+      { q: "Get directions from New York to Boston", args: { origin: "New York", destination: "Boston" } },
+      { q: "How do I get from LA to San Diego?", args: { origin: "Los Angeles", destination: "San Diego" } },
+      { q: "Directions from Seattle to Portland", args: { origin: "Seattle", destination: "Portland" } },
+      { q: "Route from Chicago to Detroit", args: { origin: "Chicago", destination: "Detroit" } },
+      { q: "Navigate from Miami to Orlando", args: { origin: "Miami", destination: "Orlando" } },
+    ]
+  }
+}
+
+def format_tool_description(name, tool)
+  desc = "#{name}: #{tool[:description]}\n"
+  desc += "  Parameters: #{tool[:params].map { |k, v| "#{k} (#{v})" }.join(", ")}"
+  desc
+end
+
+def generate_output(name, args)
+  {
+    role: "assistant",
+    tool_calls: [
+      {
+        type: "function",
+        function: {
+          index: 0,
+          name: name.to_s,
+          arguments: args
+        }
+      }
+    ]
+  }
+end
+
+def generate_example(tool_name, tool, example)
+  input = "You have access to the following tools:\n\n"
+  input += format_tool_description(tool_name, tool)
+  input += "\n\nRespond with a JSON tool call if a tool is needed."
+
+  {
+    instruction: example[:q],
+    input: input,
+    output: generate_output(tool_name, example[:args]).to_json
+  }
+end
+
+# Generate all examples
+examples = []
+
+TOOLS.each do |tool_name, tool|
+  tool[:examples].each do |example|
+    examples << generate_example(tool_name, tool, example)
+  end
+end
+
+# Shuffle for variety
+examples.shuffle!
+
+# Write to file
+output_path = File.join(__dir__, "ollama_tool_calls_large.jsonl")
+File.open(output_path, "w") do |f|
+  examples.each do |ex|
+    f.puts ex.to_json
+  end
+end
+
+puts "Generated #{examples.size} training examples to #{output_path}"

data/examples/data/ollama_tool_calls.jsonl

@@ -0,0 +1,40 @@
+{"instruction": "What's the weather in Tokyo?", "input": "You have access to the following tools:\n\nget_weather: Get current weather for a location\n  Parameters: location (string, required) - City name\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"get_weather\", \"arguments\": {\"location\": \"Tokyo\"}}}]}"}
+{"instruction": "Calculate 25 * 4 + 10", "input": "You have access to the following tools:\n\ncalculate: Evaluate a math expression\n  Parameters: expression (string, required) - Math expression to evaluate\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"calculate\", \"arguments\": {\"expression\": \"25 * 4 + 10\"}}}]}"}
+{"instruction": "Search for the latest news about AI", "input": "You have access to the following tools:\n\nsearch_web: Search the web for information\n  Parameters: query (string, required) - Search query\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"search_web\", \"arguments\": {\"query\": \"latest news about AI\"}}}]}"}
+{"instruction": "What's the temperature in New York City?", "input": "You have access to the following tools:\n\nget_weather: Get current weather for a location\n  Parameters: location (string, required) - City name\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"get_weather\", \"arguments\": {\"location\": \"New York City\"}}}]}"}
+{"instruction": "How much is 15% of 200?", "input": "You have access to the following tools:\n\ncalculate: Evaluate a math expression\n  Parameters: expression (string, required) - Math expression\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"calculate\", \"arguments\": {\"expression\": \"0.15 * 200\"}}}]}"}
+{"instruction": "Find information about Ruby programming", "input": "You have access to the following tools:\n\nsearch_web: Search the web for information\n  Parameters: query (string, required) - Search query\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"search_web\", \"arguments\": {\"query\": \"Ruby programming language\"}}}]}"}
+{"instruction": "Check weather in London", "input": "You have access to the following tools:\n\nget_weather: Get current weather for a location\n  Parameters: location (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"get_weather\", \"arguments\": {\"location\": \"London\"}}}]}"}
+{"instruction": "What is sqrt(144)?", "input": "You have access to the following tools:\n\ncalculate: Evaluate a math expression\n  Parameters: expression (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"calculate\", \"arguments\": {\"expression\": \"sqrt(144)\"}}}]}"}
+{"instruction": "Look up population of Japan", "input": "You have access to the following tools:\n\nsearch_web: Search the web\n  Parameters: query (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"search_web\", \"arguments\": {\"query\": \"population of Japan\"}}}]}"}
+{"instruction": "Is it raining in Seattle?", "input": "You have access to the following tools:\n\nget_weather: Get current weather\n  Parameters: location (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"get_weather\", \"arguments\": {\"location\": \"Seattle\"}}}]}"}
+{"instruction": "Divide 1000 by 8", "input": "You have access to the following tools:\n\ncalculate: Math calculator\n  Parameters: expression (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"calculate\", \"arguments\": {\"expression\": \"1000 / 8\"}}}]}"}
+{"instruction": "Search machine learning tutorials", "input": "You have access to the following tools:\n\nsearch_web: Web search\n  Parameters: query (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"search_web\", \"arguments\": {\"query\": \"machine learning tutorials\"}}}]}"}
+{"instruction": "Weather in Paris today", "input": "You have access to the following tools:\n\nget_weather: Get weather\n  Parameters: location (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"get_weather\", \"arguments\": {\"location\": \"Paris\"}}}]}"}
+{"instruction": "2 to the power of 10", "input": "You have access to the following tools:\n\ncalculate: Math\n  Parameters: expression (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"calculate\", \"arguments\": {\"expression\": \"2 ** 10\"}}}]}"}
+{"instruction": "Send email to john@example.com about the meeting tomorrow", "input": "You have access to the following tools:\n\nsend_email: Send an email\n  Parameters: to (string, required), subject (string, required), body (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"send_email\", \"arguments\": {\"to\": \"john@example.com\", \"subject\": \"Meeting Tomorrow\", \"body\": \"Hi, I wanted to discuss the meeting scheduled for tomorrow.\"}}}]}"}
+{"instruction": "Create event for Friday at 3pm called Team Standup", "input": "You have access to the following tools:\n\ncreate_event: Create calendar event\n  Parameters: title (string, required), date (string, required), time (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"create_event\", \"arguments\": {\"title\": \"Team Standup\", \"date\": \"Friday\", \"time\": \"3pm\"}}}]}"}
+{"instruction": "Set reminder to buy milk", "input": "You have access to the following tools:\n\nset_reminder: Set a reminder\n  Parameters: message (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"set_reminder\", \"arguments\": {\"message\": \"buy milk\"}}}]}"}
+{"instruction": "Translate hello to Spanish", "input": "You have access to the following tools:\n\ntranslate: Translate text\n  Parameters: text (string, required), target_language (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"translate\", \"arguments\": {\"text\": \"hello\", \"target_language\": \"Spanish\"}}}]}"}
+{"instruction": "Play jazz music", "input": "You have access to the following tools:\n\nplay_music: Play music\n  Parameters: genre (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"play_music\", \"arguments\": {\"genre\": \"jazz\"}}}]}"}
+{"instruction": "Turn off living room lights", "input": "You have access to the following tools:\n\ncontrol_lights: Control smart lights\n  Parameters: room (string, required), action (string, required) - on or off\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"control_lights\", \"arguments\": {\"room\": \"living room\", \"action\": \"off\"}}}]}"}
+{"instruction": "What time is it in Sydney?", "input": "You have access to the following tools:\n\nget_time: Get time in timezone\n  Parameters: timezone (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"get_time\", \"arguments\": {\"timezone\": \"Australia/Sydney\"}}}]}"}
+{"instruction": "Book flight to Miami next Friday", "input": "You have access to the following tools:\n\nbook_flight: Book a flight\n  Parameters: destination (string, required), date (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"book_flight\", \"arguments\": {\"destination\": \"Miami\", \"date\": \"next Friday\"}}}]}"}
+{"instruction": "Order large pepperoni pizza", "input": "You have access to the following tools:\n\norder_food: Order food\n  Parameters: item (string, required), size (string), toppings (array of strings)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"order_food\", \"arguments\": {\"item\": \"pizza\", \"size\": \"large\", \"toppings\": [\"pepperoni\"]}}}]}"}
+{"instruction": "Check my bank balance", "input": "You have access to the following tools:\n\nget_balance: Get account balance\n  Parameters: account_type (string, required) - checking or savings\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"get_balance\", \"arguments\": {\"account_type\": \"checking\"}}}]}"}
+{"instruction": "Get weather in Berlin and calculate 100/4", "input": "You have access to the following tools:\n\nget_weather: Get weather\n  Parameters: location (string, required)\n\ncalculate: Math\n  Parameters: expression (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"get_weather\", \"arguments\": {\"location\": \"Berlin\"}}}, {\"type\": \"function\", \"function\": {\"index\": 1, \"name\": \"calculate\", \"arguments\": {\"expression\": \"100/4\"}}}]}"}
+{"instruction": "Search for restaurants and get weather in Chicago", "input": "You have access to the following tools:\n\nsearch_web: Search\n  Parameters: query (string, required)\n\nget_weather: Weather\n  Parameters: location (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"search_web\", \"arguments\": {\"query\": \"restaurants\"}}}, {\"type\": \"function\", \"function\": {\"index\": 1, \"name\": \"get_weather\", \"arguments\": {\"location\": \"Chicago\"}}}]}"}
+{"instruction": "Read file config.json", "input": "You have access to the following tools:\n\nread_file: Read a file\n  Parameters: path (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"read_file\", \"arguments\": {\"path\": \"config.json\"}}}]}"}
+{"instruction": "Write 'hello world' to output.txt", "input": "You have access to the following tools:\n\nwrite_file: Write to file\n  Parameters: path (string, required), content (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"write_file\", \"arguments\": {\"path\": \"output.txt\", \"content\": \"hello world\"}}}]}"}
+{"instruction": "Run the tests", "input": "You have access to the following tools:\n\nrun_command: Run shell command\n  Parameters: command (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"run_command\", \"arguments\": {\"command\": \"npm test\"}}}]}"}
+{"instruction": "List files in current directory", "input": "You have access to the following tools:\n\nlist_files: List files in directory\n  Parameters: path (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"list_files\", \"arguments\": {\"path\": \".\"}}}]}"}
+{"instruction": "What's the current temperature in San Francisco?", "input": "You have access to the following tools:\n\nget_weather: Get current weather for a location\n  Parameters: location (string, required) - City name\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"get_weather\", \"arguments\": {\"location\": \"San Francisco\"}}}]}"}
+{"instruction": "Find the square root of 256", "input": "You have access to the following tools:\n\ncalculate: Evaluate a math expression\n  Parameters: expression (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"calculate\", \"arguments\": {\"expression\": \"sqrt(256)\"}}}]}"}
+{"instruction": "Search for Python tutorials for beginners", "input": "You have access to the following tools:\n\nsearch_web: Search the web\n  Parameters: query (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"search_web\", \"arguments\": {\"query\": \"Python tutorials for beginners\"}}}]}"}
+{"instruction": "Convert 100 USD to EUR", "input": "You have access to the following tools:\n\nconvert_currency: Convert between currencies\n  Parameters: amount (number, required), from_currency (string, required), to_currency (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"convert_currency\", \"arguments\": {\"amount\": 100, \"from_currency\": \"USD\", \"to_currency\": \"EUR\"}}}]}"}
+{"instruction": "Get stock price for AAPL", "input": "You have access to the following tools:\n\nget_stock_price: Get current stock price\n  Parameters: symbol (string, required) - Stock ticker symbol\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"get_stock_price\", \"arguments\": {\"symbol\": \"AAPL\"}}}]}"}
+{"instruction": "Add 2 cups flour to shopping list", "input": "You have access to the following tools:\n\nadd_to_list: Add item to shopping list\n  Parameters: item (string, required), quantity (string)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"add_to_list\", \"arguments\": {\"item\": \"flour\", \"quantity\": \"2 cups\"}}}]}"}
+{"instruction": "Set alarm for 7am tomorrow", "input": "You have access to the following tools:\n\nset_alarm: Set an alarm\n  Parameters: time (string, required), date (string)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"set_alarm\", \"arguments\": {\"time\": \"7am\", \"date\": \"tomorrow\"}}}]}"}
+{"instruction": "Get directions from New York to Boston", "input": "You have access to the following tools:\n\nget_directions: Get driving directions\n  Parameters: origin (string, required), destination (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"get_directions\", \"arguments\": {\"origin\": \"New York\", \"destination\": \"Boston\"}}}]}"}
+{"instruction": "Find nearby coffee shops", "input": "You have access to the following tools:\n\nsearch_nearby: Search for nearby places\n  Parameters: query (string, required), radius_miles (number)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"search_nearby\", \"arguments\": {\"query\": \"coffee shops\"}}}]}"}
+{"instruction": "Schedule meeting with Bob at 2pm on Monday", "input": "You have access to the following tools:\n\nschedule_meeting: Schedule a meeting\n  Parameters: attendee (string, required), time (string, required), day (string, required)\n\nRespond with a JSON tool call if a tool is needed.", "output": "{\"role\": \"assistant\", \"tool_calls\": [{\"type\": \"function\", \"function\": {\"index\": 0, \"name\": \"schedule_meeting\", \"arguments\": {\"attendee\": \"Bob\", \"time\": \"2pm\", \"day\": \"Monday\"}}}]}"}