planning-with-files 3.9.0

package/package.json

@@ -0,0 +1,46 @@
+{
+  "name": "planning-with-files",
+  "version": "3.9.0",
+  "description": "Manus-style file-based planning for Pi Coding Agent",
+  "keywords": [
+    "pi-package",
+    "planning",
+    "manus",
+    "agent",
+    "pi-skill"
+  ],
+  "pi": {
+    "skills": [
+      "SKILL.md"
+    ],
+    "extensions": [
+      "extensions/planning-with-files/index.ts"
+    ]
+  },
+  "files": [
+    "README.md",
+    "SKILL.md",
+    "examples.md",
+    "reference.md",
+    "scripts/",
+    "templates/",
+    "extensions/",
+    "!**/node_modules",
+    "!**/__pycache__",
+    "!**/*.pyc",
+    "!extensions/planning-with-files/package-lock.json"
+  ],
+  "peerDependencies": {
+    "@earendil-works/pi-coding-agent": "*"
+  },
+  "repository": {
+    "type": "git",
+    "url": "git+https://github.com/OthmanAdi/planning-with-files.git"
+  },
+  "author": "Ahmad Othman Ammar Adi",
+  "license": "MIT",
+  "bugs": {
+    "url": "https://github.com/OthmanAdi/planning-with-files/issues"
+  },
+  "homepage": "https://github.com/OthmanAdi/planning-with-files#readme"
+}

package/reference.md

@@ -0,0 +1,218 @@
+# Reference: Manus Context Engineering Principles
+
+This skill is based on context engineering principles from Manus, the AI agent company acquired by Meta for $2 billion in December 2025.
+
+## The 6 Manus Principles
+
+### Principle 1: Design Around KV-Cache
+
+> "KV-cache hit rate is THE single most important metric for production AI agents."
+
+**Statistics:**
+- ~100:1 input-to-output token ratio
+- Cached tokens: $0.30/MTok vs Uncached: $3/MTok
+- 10x cost difference!
+
+**Implementation:**
+- Keep prompt prefixes STABLE (single-token change invalidates cache)
+- NO timestamps in system prompts
+- Make context APPEND-ONLY with deterministic serialization
+
+### Principle 2: Mask, Don't Remove
+
+Don't dynamically remove tools (breaks KV-cache). Use logit masking instead.
+
+**Best Practice:** Use consistent action prefixes (e.g., `browser_`, `shell_`, `file_`) for easier masking.
+
+### Principle 3: Filesystem as External Memory
+
+> "Markdown is my 'working memory' on disk."
+
+**The Formula:**
+```
+Context Window = RAM (volatile, limited)
+Filesystem = Disk (persistent, unlimited)
+```
+
+**Compression Must Be Restorable:**
+- Keep URLs even if web content is dropped
+- Keep file paths when dropping document contents
+- Never lose the pointer to full data
+
+### Principle 4: Manipulate Attention Through Recitation
+
+> "Creates and updates todo.md throughout tasks to push global plan into model's recent attention span."
+
+**Problem:** After ~50 tool calls, models forget original goals ("lost in the middle" effect).
+
+**Solution:** Re-read `task_plan.md` before each decision. Goals appear in the attention window.
+
+```
+Start of context: [Original goal - far away, forgotten]
+...many tool calls...
+End of context: [Recently read task_plan.md - gets ATTENTION!]
+```
+
+### Principle 5: Keep the Wrong Stuff In
+
+> "Leave the wrong turns in the context."
+
+**Why:**
+- Failed actions with stack traces let model implicitly update beliefs
+- Reduces mistake repetition
+- Error recovery is "one of the clearest signals of TRUE agentic behavior"
+
+### Principle 6: Don't Get Few-Shotted
+
+> "Uniformity breeds fragility."
+
+**Problem:** Repetitive action-observation pairs cause drift and hallucination.
+
+**Solution:** Introduce controlled variation:
+- Vary phrasings slightly
+- Don't copy-paste patterns blindly
+- Recalibrate on repetitive tasks
+
+---
+
+## The 3 Context Engineering Strategies
+
+Based on Lance Martin's analysis of Manus architecture.
+
+### Strategy 1: Context Reduction
+
+**Compaction:**
+```
+Tool calls have TWO representations:
+├── FULL: Raw tool content (stored in filesystem)
+└── COMPACT: Reference/file path only
+
+RULES:
+- Apply compaction to STALE (older) tool results
+- Keep RECENT results FULL (to guide next decision)
+```
+
+**Summarization:**
+- Applied when compaction reaches diminishing returns
+- Generated using full tool results
+- Creates standardized summary objects
+
+### Strategy 2: Context Isolation (Multi-Agent)
+
+**Architecture:**
+```
+┌─────────────────────────────────┐
+│         PLANNER AGENT           │
+│  └─ Assigns tasks to sub-agents │
+├─────────────────────────────────┤
+│       KNOWLEDGE MANAGER         │
+│  └─ Reviews conversations       │
+│  └─ Determines filesystem store │
+├─────────────────────────────────┤
+│      EXECUTOR SUB-AGENTS        │
+│  └─ Perform assigned tasks      │
+│  └─ Have own context windows    │
+└─────────────────────────────────┘
+```
+
+**Key Insight:** Manus originally used `todo.md` for task planning but found ~33% of actions were spent updating it. Shifted to dedicated planner agent calling executor sub-agents.
+
+### Strategy 3: Context Offloading
+
+**Tool Design:**
+- Use <20 atomic functions total
+- Store full results in filesystem, not context
+- Use `glob` and `grep` for searching
+- Progressive disclosure: load information only as needed
+
+---
+
+## The Agent Loop
+
+Manus operates in a continuous 7-step loop:
+
+```
+┌─────────────────────────────────────────┐
+│  1. ANALYZE CONTEXT                      │
+│     - Understand user intent             │
+│     - Assess current state               │
+│     - Review recent observations         │
+├─────────────────────────────────────────┤
+│  2. THINK                                │
+│     - Should I update the plan?          │
+│     - What's the next logical action?    │
+│     - Are there blockers?                │
+├─────────────────────────────────────────┤
+│  3. SELECT TOOL                          │
+│     - Choose ONE tool                    │
+│     - Ensure parameters available        │
+├─────────────────────────────────────────┤
+│  4. EXECUTE ACTION                       │
+│     - Tool runs in sandbox               │
+├─────────────────────────────────────────┤
+│  5. RECEIVE OBSERVATION                  │
+│     - Result appended to context         │
+├─────────────────────────────────────────┤
+│  6. ITERATE                              │
+│     - Return to step 1                   │
+│     - Continue until complete            │
+├─────────────────────────────────────────┤
+│  7. DELIVER OUTCOME                      │
+│     - Send results to user               │
+│     - Attach all relevant files          │
+└─────────────────────────────────────────┘
+```
+
+---
+
+## File Types Manus Creates
+
+| File | Purpose | When Created | When Updated |
+|------|---------|--------------|--------------|
+| `task_plan.md` | Phase tracking, progress | Task start | After completing phases |
+| `findings.md` | Discoveries, decisions | After ANY discovery | After viewing images/PDFs |
+| `progress.md` | Session log, what's done | At breakpoints | Throughout session |
+| Code files | Implementation | Before execution | After errors |
+
+---
+
+## Critical Constraints
+
+- **Single-Action Execution (Manus 2025 original constraint):** ONE tool call per turn, no parallel execution. This documents Manus's 2025 sandbox practice. **2026 update:** modern hosts (Claude Code, Codex CLI) support parallel tool calls and subagents, so this constraint no longer applies as written. The plan file, not the one-call-per-turn rule, remains the coordination point: parallel calls and subagents share state through the durable markdown plan on disk.
+- **Plan is Required:** Agent must ALWAYS know: goal, current phase, remaining phases
+- **Files are Memory:** Context = volatile. Filesystem = persistent.
+- **Never Repeat Failures:** If action failed, next action MUST be different
+- **Communication is a Tool:** Message types: `info` (progress), `ask` (blocking), `result` (terminal)
+
+---
+
+## Manus Statistics
+
+| Metric | Value |
+|--------|-------|
+| Average tool calls per task | ~50 |
+| Input-to-output token ratio | 100:1 |
+| Acquisition price | $2 billion |
+| Time to $100M revenue | 8 months |
+| Framework refactors since launch | 5 times |
+
+---
+
+## Key Quotes
+
+> "Context window = RAM (volatile, limited). Filesystem = Disk (persistent, unlimited). Anything important gets written to disk."
+
+> "if action_failed: next_action != same_action. Track what you tried. Mutate the approach."
+
+> "Error recovery is one of the clearest signals of TRUE agentic behavior."
+
+> "KV-cache hit rate is the single most important metric for a production-stage AI agent."
+
+> "Leave the wrong turns in the context."
+
+---
+
+## Source
+
+Based on Manus's official context engineering documentation:
+https://manus.im/blog/Context-Engineering-for-AI-Agents-Lessons-from-Building-Manus

package/scripts/attest-plan.ps1

@@ -0,0 +1,137 @@
+#requires -Version 5.0
+<#
+.SYNOPSIS
+    Lock the current task_plan.md content with a SHA-256 attestation.
+
+.DESCRIPTION
+    Use after you finalise (or intentionally edit) a plan. The hooks then refuse
+    to inject plan content into the model context if the file diverges from the
+    attested hash, surfacing a "[PLAN TAMPERED]" warning instead.
+
+    Plan resolution:
+      1. $env:PLAN_ID  -> ./.planning/$PLAN_ID/
+      2. ./.planning/.active_plan
+      3. Newest ./.planning/<dir>/ by LastWriteTime
+      4. Legacy ./task_plan.md at project root
+
+.PARAMETER Show
+    Print the stored hash for the active plan.
+
+.PARAMETER Clear
+    Remove the attestation (re-open the plan).
+#>
+[CmdletBinding(DefaultParameterSetName = "Attest")]
+param(
+    [Parameter(ParameterSetName = "Show")]
+    [switch] $Show,
+
+    [Parameter(ParameterSetName = "Clear")]
+    [switch] $Clear
+)
+
+$ErrorActionPreference = "Stop"
+
+function Resolve-PlanFile {
+    $planRoot = Join-Path (Get-Location) ".planning"
+
+    if ($env:PLAN_ID) {
+        $candidate = Join-Path $planRoot $env:PLAN_ID
+        $planFile  = Join-Path $candidate "task_plan.md"
+        if (Test-Path -LiteralPath $planFile) { return (Resolve-Path -LiteralPath $planFile).Path }
+    }
+
+    $activePointer = Join-Path $planRoot ".active_plan"
+    if (Test-Path -LiteralPath $activePointer) {
+        $planId = (Get-Content -LiteralPath $activePointer -Raw).Trim()
+        if ($planId) {
+            $candidate = Join-Path $planRoot $planId
+            $planFile  = Join-Path $candidate "task_plan.md"
+            if (Test-Path -LiteralPath $planFile) { return (Resolve-Path -LiteralPath $planFile).Path }
+        }
+    }
+
+    if (Test-Path -LiteralPath $planRoot) {
+        $newest = Get-ChildItem -LiteralPath $planRoot -Directory -ErrorAction SilentlyContinue |
+            Where-Object { -not $_.Name.StartsWith(".") } |
+            Where-Object { Test-Path -LiteralPath (Join-Path $_.FullName "task_plan.md") } |
+            Sort-Object LastWriteTime -Descending |
+            Select-Object -First 1
+        if ($newest) {
+            return (Resolve-Path -LiteralPath (Join-Path $newest.FullName "task_plan.md")).Path
+        }
+    }
+
+    $legacy = Join-Path (Get-Location) "task_plan.md"
+    if (Test-Path -LiteralPath $legacy) {
+        return (Resolve-Path -LiteralPath $legacy).Path
+    }
+
+    return $null
+}
+
+function Get-AttestationPath {
+    param([string] $PlanFile)
+    $planDir = Split-Path -Parent $PlanFile
+    $cwd     = (Get-Location).Path
+    if ($planDir -eq $cwd) {
+        return (Join-Path $cwd ".plan-attestation")
+    }
+    return (Join-Path $planDir ".attestation")
+}
+
+$planFile = Resolve-PlanFile
+if (-not $planFile) {
+    Write-Error "[plan-attest] No task_plan.md found. Create a plan first."
+    exit 1
+}
+
+$attestationFile = Get-AttestationPath -PlanFile $planFile
+
+if ($Show) {
+    if (Test-Path -LiteralPath $attestationFile) {
+        Write-Output "Plan: $planFile"
+        Write-Output "Attestation: $attestationFile"
+        Write-Output ("SHA-256: " + (Get-Content -LiteralPath $attestationFile -Raw).Trim())
+        # Nonce (security A1.4): surface the per-plan nonce if init-session
+        # generated one next to the attestation. Informational only here; the
+        # hooks consume it to build collision-proof BEGIN/END delimiters.
+        $nonceFile = Join-Path (Split-Path -Parent $attestationFile) ".nonce"
+        if (Test-Path -LiteralPath $nonceFile) {
+            $nonceVal = (Get-Content -LiteralPath $nonceFile -Raw).Trim()
+            if ($nonceVal) { Write-Output "Nonce: $nonceVal" }
+        }
+    } else {
+        Write-Output "[plan-attest] No attestation set for $planFile."
+        exit 1
+    }
+    exit 0
+}
+
+if ($Clear) {
+    if (Test-Path -LiteralPath $attestationFile) {
+        Remove-Item -LiteralPath $attestationFile -Force
+        Write-Output "[plan-attest] Cleared attestation for $planFile."
+    } else {
+        Write-Output "[plan-attest] No attestation to clear."
+    }
+    exit 0
+}
+
+$hashVal = (Get-FileHash -LiteralPath $planFile -Algorithm SHA256).Hash.ToLowerInvariant()
+Set-Content -LiteralPath $attestationFile -Value $hashVal -NoNewline -Encoding ascii
+
+# Integrity verification (security A2.1): confirm the on-disk attestation
+# matches the intended hash before reporting success. A silent write failure
+# (permissions, full disk) must not leave a stale attestation and exit clean.
+$storedHash = (Get-Content -LiteralPath $attestationFile -Raw -ErrorAction SilentlyContinue)
+if ($null -ne $storedHash) { $storedHash = $storedHash.Trim() }
+if ($storedHash -ne $hashVal) {
+    Write-Error "[plan-attest] Attestation write verification FAILED for $attestationFile. Expected $hashVal, found $storedHash. The plan is NOT attested."
+    exit 1
+}
+
+$short = $hashVal.Substring(0, 12)
+Write-Output "[plan-attest] Locked $planFile"
+Write-Output "[plan-attest] SHA-256: $short... (stored in $attestationFile)"
+Write-Output "[plan-attest] Hooks will block injection if the file is modified without re-running this command."
+exit 0

package/scripts/attest-plan.sh

@@ -0,0 +1,206 @@
+#!/bin/sh
+# planning-with-files: lock the current task_plan.md content with a SHA-256 attestation.
+#
+# Use after you finalise (or intentionally edit) a plan. The hooks then refuse
+# to inject plan content into the model context if the file diverges from the
+# attested hash, surfacing a "[PLAN TAMPERED]" warning instead.
+#
+# Resolution:
+#   1. $PLAN_ID env var → ./.planning/$PLAN_ID/
+#   2. ./.planning/.active_plan
+#   3. Newest ./.planning/<dir>/ by mtime
+#   4. Legacy ./task_plan.md at project root
+#
+# Usage:
+#   sh scripts/attest-plan.sh         # attest the active plan
+#   sh scripts/attest-plan.sh --show  # print the stored hash
+#   sh scripts/attest-plan.sh --clear # remove the attestation (re-open the plan)
+
+set -u
+
+SCRIPT_DIR="$(cd "$(dirname "$0")" && pwd)"
+RESOLVER="${SCRIPT_DIR}/resolve-plan-dir.sh"
+
+resolve_plan_file() {
+    plan_dir=""
+    if [ -f "${RESOLVER}" ]; then
+        plan_dir="$(sh "${RESOLVER}" 2>/dev/null)"
+    fi
+    if [ -n "${plan_dir}" ] && [ -f "${plan_dir}/task_plan.md" ]; then
+        printf "%s\n" "${plan_dir}/task_plan.md"
+        return 0
+    fi
+    if [ -f "./task_plan.md" ]; then
+        printf "%s\n" "./task_plan.md"
+        return 0
+    fi
+    return 1
+}
+
+attestation_path_for() {
+    plan_file="$1"
+    plan_dir="$(dirname "${plan_file}")"
+    if [ "${plan_dir}" = "." ]; then
+        # Legacy mode: store at project root.
+        printf "%s\n" "./.plan-attestation"
+    else
+        printf "%s\n" "${plan_dir}/.attestation"
+    fi
+}
+
+compute_hash() {
+    target="$1"
+    if command -v sha256sum >/dev/null 2>&1; then
+        sha256sum "${target}" | awk '{print $1}'
+    elif command -v shasum >/dev/null 2>&1; then
+        shasum -a 256 "${target}" | awk '{print $1}'
+    else
+        printf "ERROR: no sha256 utility available\n" >&2
+        return 1
+    fi
+}
+
+mode="attest"
+case "${1:-}" in
+    --show)  mode="show"  ;;
+    --clear) mode="clear" ;;
+    "")      mode="attest" ;;
+    *)
+        printf "Usage: %s [--show|--clear]\n" "$0" >&2
+        exit 2
+        ;;
+esac
+
+plan_file="$(resolve_plan_file)" || {
+    printf "[plan-attest] No task_plan.md found. Create a plan first.\n" >&2
+    exit 1
+}
+
+attestation_file="$(attestation_path_for "${plan_file}")"
+
+case "${mode}" in
+    show)
+        if [ -f "${attestation_file}" ]; then
+            printf "Plan: %s\n" "${plan_file}"
+            printf "Attestation: %s\n" "${attestation_file}"
+            printf "SHA-256: %s\n" "$(cat "${attestation_file}")"
+            # Nonce (security A1.4): if init-session generated a per-plan nonce
+            # next to the attestation, surface it. Informational only here; the
+            # hooks consume it to build collision-proof BEGIN/END delimiters.
+            nonce_file="$(dirname "${attestation_file}")/.nonce"
+            if [ -f "${nonce_file}" ]; then
+                printf "Nonce: %s\n" "$(tr -d '\r\n[:space:]' < "${nonce_file}" 2>/dev/null)"
+            fi
+        else
+            printf "[plan-attest] No attestation set for %s.\n" "${plan_file}"
+            exit 1
+        fi
+        ;;
+    clear)
+        if [ -f "${attestation_file}" ]; then
+            rm -f "${attestation_file}"
+            printf "[plan-attest] Cleared attestation for %s.\n" "${plan_file}"
+        else
+            printf "[plan-attest] No attestation to clear.\n"
+        fi
+        ;;
+    attest)
+        hash_val="$(compute_hash "${plan_file}")" || exit 1
+
+        # v2.40: protect the write with an advisory flock when available so
+        # concurrent legacy-mode sessions (no PLAN_ID, both at the same project
+        # root) cannot corrupt the .plan-attestation file mid-write. Atomic
+        # rename of a temp file is the real guarantee on POSIX; flock is the
+        # cooperative gate around the rename for slow-disk writes.
+        #
+        # Note: legacy single-file mode is inherently racey across concurrent
+        # sessions because both can edit task_plan.md without coordination. The
+        # canonical parallel-session pattern is slug-mode under
+        # .planning/<slug>/, where each session pins PLAN_ID and gets its own
+        # .attestation file. We surface a hint when concurrent activity is
+        # detected.
+        if [ -f "${attestation_file}" ]; then
+            mtime_now="$(date +%s 2>/dev/null || echo 0)"
+            mtime_prev="$(stat -c '%Y' "${attestation_file}" 2>/dev/null \
+                || stat -f '%m' "${attestation_file}" 2>/dev/null \
+                || echo 0)"
+            age=$((mtime_now - mtime_prev))
+            if [ "${age}" -ge 0 ] && [ "${age}" -lt 30 ] 2>/dev/null; then
+                # If we're in legacy mode (root .plan-attestation) and another
+                # session just wrote, warn. Slug-mode files in .planning/<slug>/
+                # are per-session by construction; no need to warn there.
+                case "${attestation_file}" in
+                    *./.plan-attestation|*/.plan-attestation)
+                        case "${attestation_file}" in
+                            *./.planning/*) : ;;  # slug-mode, ignore
+                            *)
+                                printf "[plan-attest] Note: %s was modified %ss ago by another process.\n" \
+                                    "${attestation_file}" "${age}" >&2
+                                printf "[plan-attest] For parallel sessions, prefer slug-mode (init-session.sh <name>) so each session gets its own .attestation file.\n" >&2
+                                ;;
+                        esac
+                        ;;
+                esac
+            fi
+        fi
+
+        tmp_file="${attestation_file}.tmp.$$"
+        printf "%s\n" "${hash_val}" > "${tmp_file}" 2>/dev/null || {
+            printf "[plan-attest] Failed to write %s\n" "${tmp_file}" >&2
+            exit 1
+        }
+        mv_ok=1
+        if command -v flock >/dev/null 2>&1; then
+            # Advisory lock around the rename. lock_dir is the dir containing
+            # the target file. The {} subshell pattern keeps the lock scoped to
+            # the mv call.
+            lock_dir="$(dirname "${attestation_file}")"
+            (
+                flock -w 5 9 || true
+                mv -f "${tmp_file}" "${attestation_file}"
+            ) 9>"${lock_dir}/.attestation.lock" 2>/dev/null || mv_ok=0
+            rm -f "${lock_dir}/.attestation.lock" 2>/dev/null
+        else
+            mv -f "${tmp_file}" "${attestation_file}" 2>/dev/null || mv_ok=0
+        fi
+
+        # Integrity gap fix (security A2.1): a failed atomic rename must not be
+        # allowed to silently leave a stale attestation when the target already
+        # existed. The old fallback only wrote when the file was absent, so a
+        # cross-device or permission-denied mv on an existing attestation left
+        # the OLD hash in place with a success exit. On mv failure we re-write
+        # the intended hash through a second atomic rename (never a bare
+        # redirect onto the live file, which would expose torn reads to
+        # concurrent verifiers), then verify the on-disk content.
+        if [ "${mv_ok}" -eq 0 ] || [ ! -f "${attestation_file}" ]; then
+            fb_tmp="${attestation_file}.fb.$$"
+            printf "%s\n" "${hash_val}" > "${fb_tmp}" 2>/dev/null \
+                && mv -f "${fb_tmp}" "${attestation_file}" 2>/dev/null || {
+                rm -f "${fb_tmp}" "${tmp_file}" 2>/dev/null
+                printf "[plan-attest] Failed to write attestation %s\n" "${attestation_file}" >&2
+                exit 1
+            }
+        fi
+        rm -f "${tmp_file}" 2>/dev/null
+
+        # Read-back verification. Both write paths above are atomic renames, so
+        # a concurrent verifier always reads a complete 64-hex hash — either our
+        # own or an identical one from a peer attesting the same plan content.
+        # A mismatch here therefore means our intended hash genuinely did not
+        # land (stale content, failed write); fail loudly with a nonzero exit so
+        # callers never trust a stale attestation.
+        stored_hash="$(tr -d '\r\n[:space:]' < "${attestation_file}" 2>/dev/null)"
+        if [ "${stored_hash}" != "${hash_val}" ]; then
+            printf "[plan-attest] Attestation write verification FAILED for %s\n" "${attestation_file}" >&2
+            printf "[plan-attest] Expected %s, found %s. The plan is NOT attested.\n" "${hash_val}" "${stored_hash}" >&2
+            exit 1
+        fi
+
+        short_hash="$(printf "%s" "${hash_val}" | cut -c1-12)"
+        printf "[plan-attest] Locked %s\n" "${plan_file}"
+        printf "[plan-attest] SHA-256: %s... (stored in %s)\n" "${short_hash}" "${attestation_file}"
+        printf "[plan-attest] Hooks will block injection if the file is modified without re-running this command.\n"
+        ;;
+esac
+
+exit 0