ruby_todo 0.4.1 → 1.0.1

data/progress_ai_test.md

@@ -0,0 +1,126 @@
+# AI Assistant Command Tests
+
+This document tracks the testing of the `ruby_todo ai:ask` command with various natural language inputs to ensure all CLI functionalities work correctly.
+
+## Test Methodology
+
+For each test:
+1. Run `ruby delete_notebooks.rb` to reset the environment
+2. Run `echo "y" | ruby_todo import protectors_tasks.json` to restore test data
+3. Run the test command
+4. Verify the expected behavior
+
+## Test Results
+
+| Command Type | Natural Language Query | Expected Behavior | Result | Notes |
+|--------------|------------------------|-------------------|--------|-------|
+| Move Task | "move migrate arbitration-tf-shared to github actions" | Move task with ID 85 to in_progress status | ✅ Success | Successfully moved task to in_progress and provided confirmation message |
+| Move Multiple Tasks | "move migrate arbitration-tf-shared and awsappman-tf-accounts-management to github actions" | Move tasks with IDs 104 and 105 to in_progress status | ✅ Success | Successfully moved both tasks to in_progress and provided confirmation message |
+| Special Pattern Search | "move all migrate to barracuda org tasks to done" | Move all barracuda-related tasks (IDs 119-122) to done status | ✅ Success | Successfully identified and moved 4 barracuda-related tasks to done status |
+| Generic Repository Pattern | "move acme tasks to done" | Move task with "acme org" in title to done status | ✅ Success | Successfully identified and moved task with generic repository pattern |
+| Generic Repository Pattern (Different Syntax) | "move tasks related to quantum org to in_progress" | Move task with "quantum org" in title to in_progress status | ✅ Success | Successfully identified and moved task with different repository pattern syntax |
+| Generic Repository Pattern (GitHub) | "move task with Move app-repo/frontend to GitHub to todo" | Move task with "GitHub" in title to todo status | ✅ Success | Successfully identified and moved task with GitHub migration pattern |
+| Move to Archived | "move tappy-tf-shared to archived" | Move task with ID 149 to archived status | ✅ Success | Successfully moved task to archived status |
+| Status Mapping | "move tappy-aws-infrastructure to pending" | Move task with ID 166 to todo status | ✅ Success | Successfully mapped "pending" to "todo" status |
+| Partial Title Search | "move Add New Relic to in progress" | Move tasks with "New Relic" in their titles to in_progress status | ✅ Success | Successfully found and moved 4 matching tasks |
+| Task Listing | "show me all high priority tasks" | Show high priority tasks | ✅ Success | Now directly handles priority-filtered task listing |
+| Task Listing | "show me all medium priority tasks" | Show medium priority tasks | ✅ Success | Shows all medium priority tasks in default notebook |
+| Task Listing | "show me all todo tasks" | Show tasks with todo status | ✅ Success | Shows all tasks with todo status in default notebook |
+| Task Listing | "show me all in progress tasks" | Show tasks with in_progress status | ✅ Success | Shows all tasks with in_progress status in default notebook |
+| Notebook Listing | "show me all notebooks" | Show all notebooks | ✅ Success | Displays all notebooks in the system |
+| Statistics Request | "show statistics for protectors notebook" | Show notebook statistics | ✅ Success | Now directly handles statistics for specific notebooks |
+| Task Creation | "create a new task called 'Test task creation via AI' with high priority" | Create a new task | ✅ Success | Successfully creates new tasks with specified priority |
+| Move All Tasks | "move all tasks to todo" | Move all tasks to todo status | ✅ Success | Successfully moved all tasks in the notebook to todo status |
+| Move All Tasks (Different Status) | "move all tasks to in_progress" | Move all tasks to in_progress status | ✅ Success | Successfully moved all tasks in the notebook to in_progress status |
+
+## Final Smoke Test Results
+
+After implementing all direct command handlers, a comprehensive smoke test was conducted to verify the functionality of all supported commands:
+
+| Command Type | Test Command | Result | Notes |
+|--------------|--------------|--------|-------|
+| Task Movement | "move Add New Relic to in progress" | ✅ Success | Successfully moved 4 tasks to in_progress status |
+| Priority Filtering | "show me all high priority tasks" | ✅ Success | Correctly displayed all high priority tasks |
+| Priority Filtering | "show me all medium priority tasks" | ✅ Success | Correctly displayed all medium priority tasks |
+| Status Filtering | "show me all todo tasks" | ✅ Success | Correctly displayed all todo tasks |
+| Notebook Listing | "show all notebooks" | ✅ Success | Correctly displayed all notebooks |
+| Statistics | "show statistics for protectors notebook" | ✅ Success | Correctly displayed statistics for the notebook |
+| Task Creation (Quoted) | "create a new task called 'Smoke test AI assistant' with high priority" | ✅ Success | Successfully created new task with high priority |
+| Task Movement (Specific) | "move Smoke test AI assistant to in_progress" | ✅ Success | Successfully moved created task to in_progress |
+| Task Creation (Unquoted) | "add a task for final verification" | ✅ Success | Successfully created task without quoted title |
+| Status Filtering | "show me all in progress tasks" | ✅ Success | Correctly displayed all in-progress tasks including newly created ones |
+| Bulk Task Movement | "move all tasks to todo" | ✅ Success | Successfully moved all tasks in the default notebook to todo status |
+| Bulk Task Movement (Alt) | "move all tasks to in_progress" | ✅ Success | Successfully moved all tasks in the default notebook to in_progress status |
+| Repository Migration | "move migrate repositories to in progress" | ✅ Success | Successfully moved all repository migration tasks regardless of organization name |
+| Repository Migration (Other Org) | "move acme tasks to done" | ✅ Success | Successfully identified and moved repository migration tasks for non-barracuda organizations |
+| Repository Migration (Different Syntax) | "move tasks related to quantum org to in_progress" | ✅ Success | Successfully identified and moved task with "repo/name to org" pattern |
+| Repository Migration (GitHub) | "move task with Move app-repo/frontend to GitHub to todo" | ✅ Success | Successfully identified and moved task with GitHub migration pattern |
+
+The smoke test confirms that all implemented AI assistant functionality is working as expected. The direct command handlers successfully bypass the OpenAI API for common queries, making these operations faster and more reliable.
+
+## Conclusions
+
+The AI assistant has been significantly improved and now works effectively for:
+1. Task movement operations (as before)
+   - Single task movement
+   - Multiple task movement with compound search terms
+   - Special pattern recognition (repository migrations for any organization, not just "barracuda org")
+   - Support for different repository migration syntax patterns (both "to org" and "repo/name" formats)
+   - GitHub migration pattern recognition
+   - Status mappings (e.g., "pending" → "todo", "github actions" → "in_progress")
+   - Different statuses (todo, in_progress, done, archived)
+   - Bulk operations on all tasks ("move all tasks to...")
+
+2. Task listing operations
+   - Priority-filtered listings (high, medium)
+   - Status-filtered listings (todo, in_progress, done, archived)
+   - Notebook listings
+
+3. Statistics operations
+   - Notebook-specific statistics
+   - Global statistics
+
+4. Task creation
+   - Creating tasks with specified titles
+   - Setting priorities (high, medium, low)
+   - Adding to specific notebooks
+
+The direct handling approach bypasses the AI model for common queries, making these operations consistently reliable and efficient.
+
+Areas for further improvement:
+1. Add direct handling for task editing and deletion
+2. Add direct handling for template-related operations
+3. Add direct handling for due dates and tags in task creation
+4. Improve natural language understanding for complex queries
+
+These enhancements will require adding pattern recognition for each command type and implementing the corresponding CLI commands directly.
+
+## Implementation Notes
+
+The following approaches were used to improve the AI assistant:
+
+1. **Direct command handling**: Added pattern matching for common queries to bypass the AI and execute CLI commands directly
+2. **Improved error handling**: Enhanced command execution to better handle formatting issues and provide detailed debugging
+3. **Status mapping**: Fixed status mapping so that terms like "pending" correctly map to "todo"
+4. **Enhanced OpenAI system prompt**: Updated to provide clearer examples of command formats and expected outputs
+5. **Response cleaning**: Improved JSON parsing to handle malformed responses from the AI model
+6. **Intelligent pattern extraction**: Added logic to extract task titles, priorities, and notebook names from natural language queries
+7. **Contextual defaults**: Used the default notebook when specific notebooks aren't mentioned in queries
+8. **Special case handling**: Added special token pattern recognition for bulk operations like "move all tasks"
+9. **Generic pattern matching**: Updated repository migration pattern to work with any organization name, not just "barracuda"
+10. **Flexible syntax support**: Enhanced pattern matching to recognize different formats of repository migration commands
+11. **GitHub integration**: Added support for GitHub migration patterns in task search and movement
+
+These changes have greatly improved the reliability and consistency of the AI assistant, particularly for common task and notebook operations. The AI-powered system now provides a robust natural language interface that makes task management more intuitive and efficient.
+
+## Next Steps
+
+For future development, consider:
+
+1. **Expanding direct command handling**: Add handlers for remaining command types
+2. **Improving natural language processing**: Enhance pattern extraction for more complex queries
+3. **Adding conversational context**: Support follow-up queries that reference previous interactions
+4. **Implementing task editing**: Allow users to modify existing tasks via natural language
+5. **Supporting batch operations**: Enable operations across multiple notebooks at once
+
+The combination of direct command handling and AI-based fallback provides a robust architecture that balances reliability with flexibility.

data/protectors_tasks.json

@@ -0,0 +1,159 @@
+{
+  "name": "cox",
+  "created_at": "2024-04-01T00:00:00Z",
+  "updated_at": "2024-04-01T00:00:00Z",
+  "tasks": [
+    {
+      "title": "Add New Relic to tappy api",
+      "description": "Implement New Relic monitoring for tappy api",
+      "status": "todo",
+      "priority": "high",
+      "tags": "newrelic,monitoring,tappy",
+      "due_date": null
+    },
+    {
+      "title": "Add New Relic alerts and Pager Duty to Mission Control",
+      "description": "Implement New Relic alerts with low urgency Pager Duty integration for Mission Control",
+      "status": "todo",
+      "priority": "medium",
+      "tags": "newrelic,alerts,pagerduty,mission-control",
+      "due_date": null
+    },
+    {
+      "title": "Update assurance-postsale infrastructure",
+      "description": "Migrate to application load balancer, add New Relic infrastructure and alerts, update to Amazon Linux 2023, and update from OpenJDK8 to OpenJDK21 (EOL). Lock Docker image version instead of using latest.",
+      "status": "todo",
+      "priority": "high",
+      "tags": "migration,newrelic,infra,amazon-linux,openjdk,docker",
+      "due_date": null
+    },
+    {
+      "title": "Update apms-db-converter infrastructure",
+      "description": "Migrate to application load balancer, add New Relic infrastructure and alerts, update to Amazon Linux 2023, and update from OpenJDK8 to OpenJDK21 (EOL). Lock Docker image version instead of using latest.",
+      "status": "todo",
+      "priority": "high",
+      "tags": "migration,newrelic,infra,amazon-linux,openjdk,docker",
+      "due_date": null
+    },
+    {
+      "title": "Migrate MAN-Vintage/questions-engine-frontend to barracuda org",
+      "description": "Repository migration from MAN-Vintage to barracuda organization",
+      "status": "todo",
+      "priority": "medium",
+      "tags": "migration,repository,barracuda,vintage",
+      "due_date": null
+    },
+    {
+      "title": "Migrate MAN-Vintage/question-engine-api to barracuda org",
+      "description": "Repository migration from MAN-Vintage to barracuda organization",
+      "status": "todo",
+      "priority": "medium",
+      "tags": "migration,repository,barracuda,vintage",
+      "due_date": null
+    },
+    {
+      "title": "Migrate MAN-Fireflies/cr-popout-ui to barracuda org",
+      "description": "Repository migration from MAN-Fireflies to barracuda organization",
+      "status": "todo",
+      "priority": "medium",
+      "tags": "migration,repository,barracuda,fireflies",
+      "due_date": null
+    },
+    {
+      "title": "Migrate MAN-Fireflies/cr-popout-api to barracuda org",
+      "description": "Repository migration from MAN-Fireflies to barracuda organization",
+      "status": "todo",
+      "priority": "medium",
+      "tags": "migration,repository,barracuda,fireflies",
+      "due_date": null
+    },
+    {
+      "title": "Migrate arbitration-tf-shared to GitHub Actions",
+      "description": "Migrate terraform repository from current CI/CD to GitHub Actions",
+      "status": "todo",
+      "priority": "medium",
+      "tags": "migration,terraform,github-actions",
+      "due_date": null
+    },
+    {
+      "title": "Migrate awsappman-tf-accounts-management to GitHub Actions",
+      "description": "Migrate terraform repository from current CI/CD to GitHub Actions",
+      "status": "todo",
+      "priority": "medium",
+      "tags": "migration,terraform,github-actions",
+      "due_date": null
+    },
+    {
+      "title": "Migrate surcharge-tf-environment to GitHub Actions",
+      "description": "Migrate terraform repository from current CI/CD to GitHub Actions",
+      "status": "todo",
+      "priority": "medium",
+      "tags": "migration,terraform,github-actions",
+      "due_date": null
+    },
+    {
+      "title": "Migrate tapp-aurora-mysql to GitHub Actions",
+      "description": "Migrate terraform repository from current CI/CD to GitHub Actions",
+      "status": "todo",
+      "priority": "medium",
+      "tags": "migration,terraform,github-actions,aurora-mysql",
+      "due_date": null
+    },
+    {
+      "title": "Migrate tapp-aurora-postgresql to GitHub Actions",
+      "description": "Migrate terraform repository from current CI/CD to GitHub Actions",
+      "status": "todo",
+      "priority": "medium",
+      "tags": "migration,terraform,github-actions,aurora-postgresql",
+      "due_date": null
+    },
+    {
+      "title": "Migrate tappy-aws-infrastructure to GitHub Actions",
+      "description": "Migrate terraform repository from current CI/CD to GitHub Actions",
+      "status": "todo",
+      "priority": "medium",
+      "tags": "migration,terraform,github-actions,tappy-aws",
+      "due_date": null
+    },
+    {
+      "title": "Migrate tappy-mission-control-tf-environment to GitHub Actions",
+      "description": "Migrate terraform repository from current CI/CD to GitHub Actions",
+      "status": "todo",
+      "priority": "medium",
+      "tags": "migration,terraform,github-actions,mission-control",
+      "due_date": null
+    },
+    {
+      "title": "Migrate tappy-tf-shared to GitHub Actions",
+      "description": "Migrate terraform repository from current CI/CD to GitHub Actions",
+      "status": "todo",
+      "priority": "medium",
+      "tags": "migration,terraform,github-actions,tappy-shared",
+      "due_date": null
+    },
+    {
+      "title": "Migrate tappy-wordpress-tf-environment to GitHub Actions",
+      "description": "Migrate terraform repository from current CI/CD to GitHub Actions",
+      "status": "todo",
+      "priority": "medium",
+      "tags": "migration,terraform,github-actions,wordpress",
+      "due_date": null
+    },
+    {
+      "title": "Migrate tappy2-client-tf-environment to GitHub Actions",
+      "description": "Migrate terraform repository from current CI/CD to GitHub Actions",
+      "status": "todo",
+      "priority": "medium",
+      "tags": "migration,terraform,github-actions,tappy2-client",
+      "due_date": null
+    },
+    {
+      "title": "Migrate tappy_mysql to GitHub Actions",
+      "description": "Migrate terraform repository from current CI/CD to GitHub Actions",
+      "status": "todo",
+      "priority": "medium",
+      "tags": "migration,terraform,github-actions,tappy-mysql",
+      "due_date": null
+    }
+  ]
+} 

data/test_ai_assistant.rb

@@ -0,0 +1,55 @@
+#!/usr/bin/env ruby
+# frozen_string_literal: true
+
+require_relative "lib/ruby_todo"
+
+# Create notebooks and tasks
+puts "Creating test notebooks and tasks..."
+notebook = RubyTodo::Notebook.create(name: "Test Notebook")
+notebook.update!(is_default: true)
+
+notebook.tasks.create(
+  title: "Migrate to the barracua org",
+  status: "todo",
+  description: "Migration task for repository"
+)
+
+notebook.tasks.create(
+  title: "Task 2",
+  status: "todo"
+)
+
+notebook.tasks.create(
+  title: "Regular task not related to migrations",
+  status: "in_progress"
+)
+
+# Create the AI Assistant
+ai_command = RubyTodo::AIAssistantCommand.new([], { verbose: true })
+
+# Test the problematic case
+puts "\n\n=== Testing problematic case ==="
+prompt = "move all migrate to the barracua org tasks to in porgress"
+
+puts "Running test with prompt: '#{prompt}'"
+context = {}
+
+ai_command.send(:handle_task_request, prompt, context)
+
+# Display results
+puts "\n=== Results ==="
+if context[:matching_tasks]&.any?
+  puts "Found #{context[:matching_tasks].size} matching tasks:"
+  context[:matching_tasks].each do |task|
+    puts "- #{task[:title]} (ID: #{task[:task_id]}, Notebook: #{task[:notebook]})"
+  end
+  puts "Target status: #{context[:target_status]}"
+else
+  puts "No matching tasks found"
+end
+
+# Clean up
+puts "\n=== Cleaning up ==="
+RubyTodo::Task.delete_all
+RubyTodo::Notebook.delete_all
+puts "Test completed"

data/test_migration.rb

@@ -0,0 +1,55 @@
+#!/usr/bin/env ruby
+# frozen_string_literal: true
+
+require_relative "lib/ruby_todo"
+
+# Create notebooks and tasks
+puts "Creating test notebooks and tasks..."
+notebook = RubyTodo::Notebook.create(name: "Test Notebook")
+notebook.update!(is_default: true)
+
+notebook.tasks.create(
+  title: "Migrate to the barracua org",
+  status: "todo",
+  description: "Migration task for repository"
+)
+
+notebook.tasks.create(
+  title: "Task 2",
+  status: "todo"
+)
+
+notebook.tasks.create(
+  title: "Regular task not related to migrations",
+  status: "in_progress"
+)
+
+# Create the AI Assistant
+ai_command = RubyTodo::AIAssistantCommand.new([], { verbose: true })
+
+# Test the problematic case
+puts "\n\n=== Testing problematic case ==="
+prompt = "move all migrate to the barracua org tasks to in porgress"
+
+puts "Running test with prompt: '#{prompt}'"
+context = {}
+
+ai_command.send(:handle_task_request, prompt, context)
+
+# Display results
+puts "\n=== Results ==="
+if context[:matching_tasks]&.any?
+  puts "Found #{context[:matching_tasks].size} matching tasks:"
+  context[:matching_tasks].each do |task|
+    puts "- #{task[:title]} (ID: #{task[:task_id]}, Notebook: #{task[:notebook]})"
+  end
+  puts "Target status: #{context[:target_status]}"
+else
+  puts "No matching tasks found or no target status detected"
+end
+
+# Clean up
+puts "\n=== Cleaning up ==="
+RubyTodo::Task.delete_all
+RubyTodo::Notebook.delete_all
+puts "Test completed"

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: ruby_todo
 version: !ruby/object:Gem::Version
-  version: 0.4.1
+  version: 1.0.1
 platform: ruby
 authors:
 - Jeremiah Parrack
@@ -38,6 +38,34 @@ dependencies:
     - - "~>"
       - !ruby/object:Gem::Version
         version: '1.1'
+- !ruby/object:Gem::Dependency
+  name: dotenv
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '2.8'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '2.8'
+- !ruby/object:Gem::Dependency
+  name: ruby-openai
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 6.3.0
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 6.3.0
 - !ruby/object:Gem::Dependency
   name: sqlite3
   requirement: !ruby/object:Gem::Requirement
@@ -172,6 +200,8 @@ executables:
 extensions: []
 extra_rdoc_files: []
 files:
+- ".env.template"
+- ".rspec"
 - ".rubocop.yml"
 - CHANGELOG.md
 - CODE_OF_CONDUCT.md
@@ -180,15 +210,30 @@ files:
 - PROGRESS.md
 - README.md
 - Rakefile
+- ai_assistant_implementation.md
+- db/migrate/20240328_add_is_default_to_notebooks.rb
+- delete_notebooks.rb
 - exe/ruby_todo
+- implementation_steps.md
 - lib/ruby_todo.rb
+- lib/ruby_todo/ai_assistant/common_query_handler.rb
+- lib/ruby_todo/ai_assistant/configuration_management.rb
+- lib/ruby_todo/ai_assistant/openai_integration.rb
+- lib/ruby_todo/ai_assistant/task_creation.rb
+- lib/ruby_todo/ai_assistant/task_management.rb
+- lib/ruby_todo/ai_assistant/task_search.rb
 - lib/ruby_todo/cli.rb
+- lib/ruby_todo/commands/ai_assistant.rb
 - lib/ruby_todo/database.rb
 - lib/ruby_todo/models/notebook.rb
 - lib/ruby_todo/models/task.rb
 - lib/ruby_todo/models/template.rb
 - lib/ruby_todo/version.rb
+- progress_ai_test.md
+- protectors_tasks.json
 - sig/ruby_todo.rbs
+- test_ai_assistant.rb
+- test_migration.rb
 homepage: https://github.com/jeremiahlukus/ruby_todo
 licenses:
 - MIT