@openhands/extensions 0.0.1-alpha → 0.2.0

package/analysis_results.md

@@ -0,0 +1,162 @@
+# Agent Improvement Report
+
+**Signal:** `pr review suggestion and analysis`
+
+## Executive Summary
+
+The AI agent is technically capable but prone to 'rubber stamping' code that looks aesthetically simple but is logically flawed. The most critical improvement is to force a 'Logic Verification' step to prevent false approvals. Additionally, reducing repetitive comment noise and enforcing actionable suggestion syntax will significantly improve the developer experience and acceptance rate.
+
+## Issues Requiring Attention
+
+### 1. [HIGH] Premature Approval of 'Simple' but Broken Code
+
+The agent frequently approves PRs that look 'clean' or 'simple' (adhering to the 'Good Taste' instruction) but contain functional bugs or incomplete fixes. The 'Linus' persona prioritizes architectural simplicity over logical correctness, leading to 'rubber stamping'. Examples include approving a band-aid fix for token limits that didn't solve the root cause, and missing a timestamp reset bug because the code looked 'elegant'.
+
+**Frequency:** 15% of traces
+
+**Example traces:**
+- https://laminar.sh/project/e493e4f8-2a93-4e74-b5c1-865ba94d341f/traces?traceId=a0dbd0c7-116d-776b-9c4b-c7f5f4d0a97e
+- https://laminar.sh/project/e493e4f8-2a93-4e74-b5c1-865ba94d341f/traces?traceId=5de277ff-38f2-e173-4b03-c7332301ea58
+- https://laminar.sh/project/e493e4f8-2a93-4e74-b5c1-865ba94d341f/traces?traceId=67e1f1bf-d5db-840b-1673-10a86b1f2285
+
+### 2. [MEDIUM] Repetitive Comment Spam (Lack of De-duplication)
+
+The agent generates excessive noise by posting the exact same comment multiple times across different lines or files (e.g., posting a 'None check' warning 11 times in one review). This dilutes the value of the feedback and frustrates the user, leading to the feedback being ignored.
+
+**Frequency:** Occasional
+
+**Example traces:**
+- https://laminar.sh/project/e493e4f8-2a93-4e74-b5c1-865ba94d341f/traces?traceId=731057f2-473a-50d5-0781-74ba203015c8
+
+### 3. [MEDIUM] Failure to Use Actionable Suggestion Syntax
+
+The agent identifies valid issues (e.g., future-dated CVEs, wrong version bumps) but fails to use the GitHub `suggestion` syntax to provide a one-click fix. This increases friction for the maintainer, who has to manually type the fix, leading to the suggestion often being ignored or deferred.
+
+**Frequency:** 10% of traces
+
+**Example traces:**
+- https://laminar.sh/project/e493e4f8-2a93-4e74-b5c1-865ba94d341f/traces?traceId=b3ee7de3-20d1-206e-579c-43e8a710b69a
+- https://laminar.sh/project/e493e4f8-2a93-4e74-b5c1-865ba94d341f/traces?traceId=8f10d9c8-cc5e-3783-f4e3-e33dfeca25ff
+
+### 4. [MEDIUM] Ineffective Persuasion on Technical Debt
+
+The agent provides technically correct but 'theoretical' suggestions (e.g., adding integration tests, changing architecture) that are rejected by humans for 'pragmatism'. The agent fails to articulate the *concrete risk* of the current approach, making its advice easy to dismiss as 'over-engineering'.
+
+**Frequency:** Frequent
+
+**Example traces:**
+- https://laminar.sh/project/e493e4f8-2a93-4e74-b5c1-865ba94d341f/traces?traceId=4506a370-f522-6de1-7e37-8010972546aa
+- https://laminar.sh/project/e493e4f8-2a93-4e74-b5c1-865ba94d341f/traces?traceId=8fa40dfd-8d36-08e5-e454-a3f7ad27b12c
+
+## Recommended Fixes
+
+### 1. [HIGH PRIORITY] Enforce Logic Verification Over Aesthetic Simplicity
+
+Add a specific 'Logic Verification' step to the analysis framework. The current prompt focuses heavily on structure (indentation, complexity) but lacks an explicit instruction to trace data flow. This change forces the agent to verify that the logic actually works before calling it 'elegant'.
+
+**Suggested Prompt Changes:**
+
+📍 **Section:** CORE PHILOSOPHY
+
+```diff
+- 2. **"Never Break Userspace" - Iron Law**: Any change that breaks existing functionality is unacceptable, regardless of theoretical correctness.
+3. **Pragmatism**: Solve real problems, not imaginary ones.
++ 2. **"Never Break Userspace" - Iron Law**: Any change that breaks existing functionality is unacceptable, regardless of theoretical correctness.
+3. **Correctness Precedes Simplicity**: Elegant code that doesn't work is garbage. Verify the logic flow before praising the structure.
+4. **Pragmatism**: Solve real problems, not imaginary ones.
+```
+
+📍 **Section:** CRITICAL ANALYSIS FRAMEWORK
+
+```diff
+- 6. **Testing and Regression Proof**
+[... existing text ...]
+- The test should fail if the behavior regresses.
+
+CRITICAL REVIEW OUTPUT FORMAT:
++ 6. **Testing and Regression Proof**
+[... existing text ...]
+
+7. **Logic Verification (The "Rubber Duck" Check)**
+Don't just look at the indentation. Trace the execution path:
+- Does the variable actually update? 
+- Is the return value used? 
+- Are side effects (like timestamp resets) happening where they should?
+- **Stop and think**: If this looks "simple", is it because it's missing a critical check?
+
+CRITICAL REVIEW OUTPUT FORMAT:
+```
+
+*Fixes: Premature Approval of 'Simple' but Broken Code*
+
+### 2. [MEDIUM PRIORITY] Add Noise Control / De-duplication Rule
+
+Implement a strict noise control rule in the output format instructions. This prevents the agent from posting identical comments on multiple lines, which was observed in trace 731057f2.
+
+**Suggested Prompt Changes:**
+
+📍 **Section:** CRITICAL REVIEW OUTPUT FORMAT
+
+```diff
+- **[STYLE NOTES]** (Skip most of these - only mention if it genuinely hurts maintainability)
+- Generally skip style comments. Linters exist for a reason.
+
+**[TESTING GAPS]** (If behavior changed, this is not optional)
++ **[STYLE NOTES]** (Skip most of these - only mention if it genuinely hurts maintainability)
+- Generally skip style comments. Linters exist for a reason.
+
+**NOISE CONTROL**: 
+- If the same issue appears in multiple locations (e.g., missing None check on 5 different lines), post **ONE** comment on the first occurrence that summarizes the pattern. Do NOT spam the review with identical comments.
+
+**[TESTING GAPS]** (If behavior changed, this is not optional)
+```
+
+*Fixes: Repetitive Comment Spam (Lack of De-duplication)*
+
+### 3. [MEDIUM PRIORITY] Mandate Suggestion Syntax for Small Fixes
+
+Mandate the use of GitHub suggestion blocks for small changes. The current prompt suggests it as an option; this change makes it a requirement for fixes under 3 lines (typos, versions, one-line logic).
+
+**Suggested Prompt Changes:**
+
+📍 **Section:** GitHub Suggestions
+
+```diff
+- ## GitHub Suggestions
+
+For small code changes, use the suggestion syntax for one-click apply:
+
+~~~
+```suggestion
+improved_code_here()
+```
+~~~
++ ## GitHub Suggestions
+
+For small code changes (1-3 lines), **YOU MUST** use the suggestion syntax. This allows the maintainer to apply the fix with one click.
+
+**MANDATORY**: Use this for typos, version bumps, variable renames, and simple logic fixes.
+
+~~~
+```suggestion
+improved_code_here()
+```
+~~~
+```
+
+*Fixes: Failure to Use Actionable Suggestion Syntax*
+
+## Metrics
+
+**Total signals analyzed:** 111
+**Issue rate:** ~35%
+
+| Metric | Value |
+|--------|-------|
+| Suggestion Reflection Rate | ~28% (Low) |
+| Zero-Reflection Reviews | ~60% of reviews with suggestions |
+
+## What's Working Well
+
+- **Security Awareness**: The agent excels at identifying security risks, such as auth bypasses and hardcoded secrets (e.g., Trace 4e04b6bd).
+- **Architectural Review**: The 'Linus' persona is effective at catching architectural complexity and over-engineering (e.g., Trace da1802b6).

package/marketplaces/large-codebase.json

@@ -0,0 +1,66 @@
+{
+  "name": "large-codebase",
+  "owner": {
+    "name": "OpenHands",
+    "email": "contact@all-hands.dev"
+  },
+  "metadata": {
+    "description": "OpenHands skills for interacting, improving, and refactoring large codebases",
+    "version": "1.0.0",
+    "pluginRoot": "./skills"
+  },
+  "plugins": [
+    {
+      "name": "add-javadoc",
+      "source": "./skills/add-javadoc",
+      "description": "Add comprehensive JavaDoc documentation to Java classes and methods. Use when documenting Java code, adding API documentation, or improving code documentation.",
+      "category": "documentation",
+      "keywords": [
+        "javadoc",
+        "java",
+        "documentation",
+        "api-docs"
+      ]
+    },
+    {
+      "name": "cobol-modernization",
+      "source": "./plugins/cobol-modernization",
+      "description": "End-to-end COBOL to Java migration workflow. Handles build setup, mainframe dependency removal, and code migration with test validation.",
+      "category": "development",
+      "keywords": [
+        "cobol",
+        "java",
+        "migration",
+        "mainframe",
+        "modernization"
+      ]
+    },
+    {
+      "name": "migration-scoring",
+      "source": "./plugins/migration-scoring",
+      "description": "Evaluate code migration quality with coverage, correctness, and style scoring. Generates executive reports with actionable recommendations.",
+      "category": "code-quality",
+      "keywords": [
+        "migration",
+        "scoring",
+        "quality",
+        "evaluation",
+        "reporting"
+      ]
+    },
+    {
+      "name": "spark-version-upgrade",
+      "source": "./skills/spark-version-upgrade",
+      "description": "Upgrade Apache Spark applications between major versions (2.x→3.x, 3.x→4.x). Covers build files, deprecated APIs, configuration changes, SQL/DataFrame updates, and test validation.",
+      "category": "development",
+      "keywords": [
+        "spark",
+        "upgrade",
+        "migration",
+        "pyspark",
+        "scala",
+        "big-data"
+      ]
+    }
+  ]
+}