rubyn-code 0.2.2 → 0.4.0

data/skills/rubyn_self_test.md

@@ -0,0 +1,133 @@
+---
+name: self-test
+description: Smoke test Rubyn-Code itself — exercises every major subsystem and reports a pass/fail scorecard
+tags: [rubyn, testing, diagnostics]
+---
+
+# Rubyn Self-Test
+
+Run a systematic smoke test of Rubyn-Code's major subsystems. Exercise each one, track pass/fail, and report a scorecard at the end.
+
+## Instructions
+
+When the user loads this skill (via `/skill self-test` or `load_skill name: "self-test"`), run through EVERY test below **in order**. For each test:
+
+1. Run the described action using your tools
+2. Record PASS or FAIL
+3. If FAIL, note the error in one line
+4. Keep going — don't stop on failures
+
+At the end, print a scorecard like this:
+
+```
+Rubyn Self-Test Results
+═══════════════════════════════════════════
+ 1. ✅ File read/write/edit cycle
+ 2. ✅ Glob file search
+ 3. ✅ Grep content search
+ 4. ❌ Run specs — exit code 1 (3 failures)
+ 5. ✅ Git status
+ ...
+═══════════════════════════════════════════
+Score: 18/22 (82%) — 4 failures
+```
+
+## The Tests
+
+### 1. Tool System — File Operations
+- **read_file**: Read `lib/rubyn_code/version.rb`. PASS if it contains `VERSION =`.
+- **write_file**: Write a temp file `.rubyn-code/self_test_tmp.rb` with content `# self-test`. PASS if no error.
+- **edit_file**: Edit that temp file — replace `# self-test` with `# self-test passed`. PASS if no error.
+- **read_file** (verify): Read the temp file back. PASS if it contains `# self-test passed`.
+- **Cleanup**: Delete the temp file with bash `rm .rubyn-code/self_test_tmp.rb`.
+
+### 2. Tool System — Search
+- **glob**: Find all `*.rb` files under `lib/`. PASS if result contains at least 50 files.
+- **grep**: Search for `class.*Base` across `lib/`. PASS if at least 3 matches found.
+
+### 3. Tool System — Bash
+- **bash**: Run `ruby --version`. PASS if output contains `ruby`.
+- **bash**: Run `bundle exec rubocop --version`. PASS if output contains a version number.
+
+### 4. Tool System — Git
+- **git_status**: Run git status. PASS if no error.
+- **git_log**: Run git log (last 3 commits). PASS if output contains commit hashes.
+- **git_diff**: Run git diff. PASS if no error (even if empty).
+
+### 5. Tool System — Specs
+- **run_specs**: Run `bundle exec rspec spec/rubyn_code/tools/output_compressor_spec.rb --format progress`. PASS if output contains `0 failures`.
+- **run_specs**: Run `bundle exec rspec spec/rubyn_code/llm/model_router_spec.rb --format progress`. PASS if output contains `0 failures`.
+
+### 6. Context & Efficiency Engine
+
+#### File Cache
+- Read `lib/rubyn_code/version.rb` twice. PASS if both reads succeed (cache should serve the second).
+
+#### Output Compressor — Head/Tail Strategy
+- Run `bash` with `seq 1 5000` (generates 5,000 lines — well over the bash threshold of 4,000 chars). PASS if the result contains "lines omitted" or is significantly shorter than 5,000 lines. This proves the head_tail compressor is working.
+
+#### Output Compressor — Spec Summary Strategy
+- Run `bash` with `cd <project_root> && bundle exec rspec spec/rubyn_code/tools/base_spec.rb --format documentation 2>&1`. This produces multi-line RSpec output. PASS if the result you receive is shorter than the full verbose output — specifically check if passing specs got compressed to a summary line like "N examples, 0 failures" instead of listing every example.
+
+#### Output Compressor — Grep Top Matches
+- Run `grep` searching for `def ` across all of `lib/`. This will match hundreds of method definitions. PASS if the result contains "matches omitted" or shows only a subset of results (the compressor limits to top N matches).
+
+#### Output Compressor — Glob Tree Collapse
+- Run `glob` for `**/*.rb` across the entire project. With 170+ files this should exceed the glob threshold. PASS if the result shows directory summaries like `app/models/ (N files)` instead of listing every individual file path, OR if the result is significantly shorter than listing all 170+ paths individually.
+
+#### Output Compressor — Diff Strategy
+- Run `bash` with `cd <project_root> && git log --oneline -1 --format=%H | xargs git diff HEAD~5..` (diff of last 5 commits). If the diff is large enough, the compressor should keep headers but truncate bodies. PASS if result contains diff headers. SKIP if diff is small enough to pass through uncompressed.
+
+#### Compression Stats
+- After running the above tests, note whether any output you received contained truncation markers like "lines omitted", "matches omitted", or "files)". Count how many of the 5 compression strategies actually triggered. Report: "N/5 compression strategies verified active".
+
+### 7. Skills System
+- **load_skill**: Load any available skill (e.g., `classes`). PASS if content is returned.
+
+### 8. Memory System
+- **memory_write**: Write a test memory: `category: "test", content: "self-test at #{Time.now}"`. PASS if no error.
+- **memory_search**: Search for `self-test`. PASS if the memory we just wrote is found.
+
+### 9. Configuration
+- **bash**: Run `cat ~/.rubyn-code/config.yml`. PASS if file exists and contains `provider:`.
+- **read_file**: Check if `.rubyn-code/project_profile.yml` exists in the project root. PASS if exists (or SKIP if first session).
+
+### 10. Codebase Index
+- **bash**: Check if `.rubyn-code/codebase_index.json` exists. PASS if exists (or SKIP if first session).
+
+### 11. Slash Commands (report only — don't execute)
+- Report which slash commands are registered by reading `lib/rubyn_code/cli/commands/registry.rb` or the help output. PASS if at least 15 commands found.
+
+### 12. MCP Integration
+- **grep**: Search for `url:.*server_def` in `lib/rubyn_code/mcp/config.rb`. PASS if at least 1 match found (confirms SSE url is extracted — a critical bug was shipped without this).
+- **grep**: Search for `autoload.*Mcp` in `lib/rubyn_code.rb`. PASS if found (confirms `/mcp` command is wired up).
+- **run_specs**: Run `bundle exec rspec spec/rubyn_code/mcp/config_spec.rb --format progress`. PASS if output contains `0 failures`.
+- **bash**: Check if `.rubyn-code/mcp.json` exists in the project root. PASS if exists, SKIP if not (MCP is optional per-project).
+
+### 13. GOLEM Autonomous Mode
+- **grep**: Search for `class Daemon` in `lib/rubyn_code/autonomous/daemon.rb`. PASS if found (confirms daemon framework exists).
+- **grep**: Search for `failed\?` in `lib/rubyn_code/tasks/models.rb`. PASS if found (confirms failed task status is available).
+- **grep**: Search for `total_cost` in `lib/rubyn_code/autonomous/daemon.rb`. PASS if at least 2 matches (confirms cost tracking is implemented).
+- **run_specs**: Run `bundle exec rspec spec/rubyn_code/autonomous/daemon_spec.rb --format progress`. PASS if output contains `0 failures` (verifies lifecycle, retries, cost limits, audit trails, concurrent claiming).
+
+### 14. Architecture Integrity
+- **grep**: Search for `autoload` in `lib/rubyn_code.rb`. PASS if at least 40 autoload entries found.
+- **glob**: Check that all 16 layer directories exist under `lib/rubyn_code/`. PASS if at least 14 found.
+- **read_file**: Read `lib/rubyn_code.rb` and verify it has modules for Agent, Tools, Context, Skills, Memory, Observability, Learning. PASS if all 7 found.
+
+## Scoring
+
+Count total PASS results out of total tests run. Report the percentage.
+
+- **90-100%**: Rubyn is healthy. All major systems operational.
+- **75-89%**: Rubyn is mostly working. Check the failures — they may be config/environment issues.
+- **50-74%**: Something is wrong. Multiple subsystems are broken.
+- **Below 50%**: Rubyn needs repair. Check installation, dependencies, and database.
+
+## Important
+
+- Do NOT skip tests. Run all of them.
+- Do NOT stop on failures. Record and continue.
+- Clean up any temp files you create.
+- The self-test should take less than 60 seconds.
+- Report the scorecard in a clear, formatted table at the end.

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: rubyn-code
 version: !ruby/object:Gem::Version
-  version: 0.2.2
+  version: 0.4.0
 platform: ruby
 authors:
 - fadedmaturity
@@ -105,6 +105,20 @@ dependencies:
     - - "~>"
       - !ruby/object:Gem::Version
         version: '0.23'
+- !ruby/object:Gem::Dependency
+  name: tty-reader
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '0.9'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '0.9'
 - !ruby/object:Gem::Dependency
   name: tty-spinner
   requirement: !ruby/object:Gem::Requirement
@@ -169,13 +183,25 @@ files:
 - db/migrations/010_create_instincts.sql
 - db/migrations/011_fix_mailbox_messages_columns.rb
 - db/migrations/012_expand_mailbox_message_types.rb
+- db/migrations/013_add_failed_status_to_tasks.rb
 - exe/rubyn-code
 - lib/rubyn_code.rb
 - lib/rubyn_code/agent/RUBYN.md
+- lib/rubyn_code/agent/background_job_handler.rb
 - lib/rubyn_code/agent/conversation.rb
+- lib/rubyn_code/agent/dynamic_tool_schema.rb
+- lib/rubyn_code/agent/feedback_handler.rb
+- lib/rubyn_code/agent/llm_caller.rb
 - lib/rubyn_code/agent/loop.rb
 - lib/rubyn_code/agent/loop_detector.rb
+- lib/rubyn_code/agent/prompts.rb
+- lib/rubyn_code/agent/response_modes.rb
+- lib/rubyn_code/agent/response_parser.rb
+- lib/rubyn_code/agent/system_prompt_builder.rb
+- lib/rubyn_code/agent/tool_processor.rb
+- lib/rubyn_code/agent/usage_tracker.rb
 - lib/rubyn_code/auth/RUBYN.md
+- lib/rubyn_code/auth/key_encryption.rb
 - lib/rubyn_code/auth/oauth.rb
 - lib/rubyn_code/auth/server.rb
 - lib/rubyn_code/auth/token_store.rb
@@ -200,8 +226,11 @@ files:
 - lib/rubyn_code/cli/commands/diff.rb
 - lib/rubyn_code/cli/commands/doctor.rb
 - lib/rubyn_code/cli/commands/help.rb
+- lib/rubyn_code/cli/commands/mcp.rb
 - lib/rubyn_code/cli/commands/model.rb
+- lib/rubyn_code/cli/commands/new_session.rb
 - lib/rubyn_code/cli/commands/plan.rb
+- lib/rubyn_code/cli/commands/provider.rb
 - lib/rubyn_code/cli/commands/quit.rb
 - lib/rubyn_code/cli/commands/registry.rb
 - lib/rubyn_code/cli/commands/resume.rb
@@ -213,9 +242,13 @@ files:
 - lib/rubyn_code/cli/commands/undo.rb
 - lib/rubyn_code/cli/commands/version.rb
 - lib/rubyn_code/cli/daemon_runner.rb
+- lib/rubyn_code/cli/first_run.rb
 - lib/rubyn_code/cli/input_handler.rb
 - lib/rubyn_code/cli/renderer.rb
 - lib/rubyn_code/cli/repl.rb
+- lib/rubyn_code/cli/repl_commands.rb
+- lib/rubyn_code/cli/repl_lifecycle.rb
+- lib/rubyn_code/cli/repl_setup.rb
 - lib/rubyn_code/cli/setup.rb
 - lib/rubyn_code/cli/spinner.rb
 - lib/rubyn_code/cli/stream_formatter.rb
@@ -223,14 +256,20 @@ files:
 - lib/rubyn_code/config/RUBYN.md
 - lib/rubyn_code/config/defaults.rb
 - lib/rubyn_code/config/project_config.rb
+- lib/rubyn_code/config/project_profile.rb
+- lib/rubyn_code/config/schema.json
 - lib/rubyn_code/config/settings.rb
+- lib/rubyn_code/config/validator.rb
 - lib/rubyn_code/context/RUBYN.md
 - lib/rubyn_code/context/auto_compact.rb
 - lib/rubyn_code/context/compactor.rb
+- lib/rubyn_code/context/context_budget.rb
 - lib/rubyn_code/context/context_collapse.rb
+- lib/rubyn_code/context/decision_compactor.rb
 - lib/rubyn_code/context/manager.rb
 - lib/rubyn_code/context/manual_compact.rb
 - lib/rubyn_code/context/micro_compact.rb
+- lib/rubyn_code/context/schema_filter.rb
 - lib/rubyn_code/db/RUBYN.md
 - lib/rubyn_code/db/connection.rb
 - lib/rubyn_code/db/migrator.rb
@@ -241,13 +280,45 @@ files:
 - lib/rubyn_code/hooks/registry.rb
 - lib/rubyn_code/hooks/runner.rb
 - lib/rubyn_code/hooks/user_hooks.rb
+- lib/rubyn_code/ide/adapters/tool_output.rb
+- lib/rubyn_code/ide/client.rb
+- lib/rubyn_code/ide/handlers.rb
+- lib/rubyn_code/ide/handlers/accept_edit_handler.rb
+- lib/rubyn_code/ide/handlers/approve_tool_use_handler.rb
+- lib/rubyn_code/ide/handlers/cancel_handler.rb
+- lib/rubyn_code/ide/handlers/config_get_handler.rb
+- lib/rubyn_code/ide/handlers/config_set_handler.rb
+- lib/rubyn_code/ide/handlers/initialize_handler.rb
+- lib/rubyn_code/ide/handlers/models_list_handler.rb
+- lib/rubyn_code/ide/handlers/prompt_handler.rb
+- lib/rubyn_code/ide/handlers/review_handler.rb
+- lib/rubyn_code/ide/handlers/session_fork_handler.rb
+- lib/rubyn_code/ide/handlers/session_list_handler.rb
+- lib/rubyn_code/ide/handlers/session_reset_handler.rb
+- lib/rubyn_code/ide/handlers/session_resume_handler.rb
+- lib/rubyn_code/ide/handlers/shutdown_handler.rb
+- lib/rubyn_code/ide/protocol.rb
+- lib/rubyn_code/ide/server.rb
+- lib/rubyn_code/index/codebase_index.rb
 - lib/rubyn_code/learning/RUBYN.md
 - lib/rubyn_code/learning/extractor.rb
 - lib/rubyn_code/learning/injector.rb
 - lib/rubyn_code/learning/instinct.rb
+- lib/rubyn_code/learning/shortcut.rb
 - lib/rubyn_code/llm/RUBYN.md
+- lib/rubyn_code/llm/adapters/anthropic.rb
+- lib/rubyn_code/llm/adapters/anthropic_compatible.rb
+- lib/rubyn_code/llm/adapters/anthropic_streaming.rb
+- lib/rubyn_code/llm/adapters/base.rb
+- lib/rubyn_code/llm/adapters/json_parsing.rb
+- lib/rubyn_code/llm/adapters/openai.rb
+- lib/rubyn_code/llm/adapters/openai_compatible.rb
+- lib/rubyn_code/llm/adapters/openai_message_translator.rb
+- lib/rubyn_code/llm/adapters/openai_streaming.rb
+- lib/rubyn_code/llm/adapters/prompt_caching.rb
 - lib/rubyn_code/llm/client.rb
 - lib/rubyn_code/llm/message_builder.rb
+- lib/rubyn_code/llm/model_router.rb
 - lib/rubyn_code/llm/streaming.rb
 - lib/rubyn_code/mcp/RUBYN.md
 - lib/rubyn_code/mcp/client.rb
@@ -264,6 +335,8 @@ files:
 - lib/rubyn_code/observability/budget_enforcer.rb
 - lib/rubyn_code/observability/cost_calculator.rb
 - lib/rubyn_code/observability/models.rb
+- lib/rubyn_code/observability/skill_analytics.rb
+- lib/rubyn_code/observability/token_analytics.rb
 - lib/rubyn_code/observability/token_counter.rb
 - lib/rubyn_code/observability/usage_reporter.rb
 - lib/rubyn_code/output/RUBYN.md
@@ -278,10 +351,12 @@ files:
 - lib/rubyn_code/protocols/interrupt_handler.rb
 - lib/rubyn_code/protocols/plan_approval.rb
 - lib/rubyn_code/protocols/shutdown_handshake.rb
+- lib/rubyn_code/self_test.rb
 - lib/rubyn_code/skills/RUBYN.md
 - lib/rubyn_code/skills/catalog.rb
 - lib/rubyn_code/skills/document.rb
 - lib/rubyn_code/skills/loader.rb
+- lib/rubyn_code/skills/ttl_manager.rb
 - lib/rubyn_code/sub_agents/RUBYN.md
 - lib/rubyn_code/sub_agents/runner.rb
 - lib/rubyn_code/sub_agents/summarizer.rb
@@ -294,6 +369,7 @@ files:
 - lib/rubyn_code/teams/manager.rb
 - lib/rubyn_code/teams/teammate.rb
 - lib/rubyn_code/tools/RUBYN.md
+- lib/rubyn_code/tools/ask_user.rb
 - lib/rubyn_code/tools/background_run.rb
 - lib/rubyn_code/tools/base.rb
 - lib/rubyn_code/tools/bash.rb
@@ -303,15 +379,19 @@ files:
 - lib/rubyn_code/tools/db_migrate.rb
 - lib/rubyn_code/tools/edit_file.rb
 - lib/rubyn_code/tools/executor.rb
+- lib/rubyn_code/tools/file_cache.rb
 - lib/rubyn_code/tools/git_commit.rb
 - lib/rubyn_code/tools/git_diff.rb
 - lib/rubyn_code/tools/git_log.rb
 - lib/rubyn_code/tools/git_status.rb
 - lib/rubyn_code/tools/glob.rb
 - lib/rubyn_code/tools/grep.rb
+- lib/rubyn_code/tools/ide_diagnostics.rb
+- lib/rubyn_code/tools/ide_symbols.rb
 - lib/rubyn_code/tools/load_skill.rb
 - lib/rubyn_code/tools/memory_search.rb
 - lib/rubyn_code/tools/memory_write.rb
+- lib/rubyn_code/tools/output_compressor.rb
 - lib/rubyn_code/tools/rails_generate.rb
 - lib/rubyn_code/tools/read_file.rb
 - lib/rubyn_code/tools/read_inbox.rb
@@ -322,6 +402,7 @@ files:
 - lib/rubyn_code/tools/send_message.rb
 - lib/rubyn_code/tools/spawn_agent.rb
 - lib/rubyn_code/tools/spawn_teammate.rb
+- lib/rubyn_code/tools/spec_output_parser.rb
 - lib/rubyn_code/tools/task.rb
 - lib/rubyn_code/tools/web_fetch.rb
 - lib/rubyn_code/tools/web_search.rb
@@ -431,6 +512,7 @@ files:
 - skills/ruby_project/cli_tools.md
 - skills/ruby_project/rake_tasks.md
 - skills/ruby_project/structure.md
+- skills/rubyn_self_test.md
 - skills/sinatra/application_structure.md
 - skills/sinatra/middleware_and_deployment.md
 - skills/sinatra/testing.md