ciscollm-cli 1.0.6 → 1.0.7

package/README.md

@@ -206,130 +206,3 @@ Validate features including the Command Firewall, Transaction Manager, and Error
 npm run test
 ```
 
----
-
-## 🧪 Agent Test Results
-
-All tests were executed using **LM Studio (qwen3.5-4b)** in `--protocol mock --non-interactive` mode against a simulated `Switch1` device.
-
----
-
-### Test 1 — Basic Interface & Static Route Configuration ✅ PASSED
-
-**Goal:** Configure `GigabitEthernet0/1` with IP `10.0.0.1/24`, add static route to `192.168.10.0/24` via `10.0.0.2`, and verify connectivity.
-
-```bash
-npx ts-node src/index.ts run --protocol mock --provider local --local-type lmstudio \
-  --model "qwen3.5-4b" \
-  --goal "Configure GigabitEthernet0/1 with IP 10.0.0.1/24, add static route 192.168.10.0/24 via 10.0.0.2, ping 192.168.10.5" \
-  --non-interactive
-```
-
-| Step | Command | Result | State Diff |
-|------|---------|--------|------------|
-| 1 | `configure terminal` | ✅ | Mode entered |
-| 2 | `interface GigabitEthernet0/1` | ✅ | Interface mode |
-| 3 | `description Primary` | ✅ | description: unassigned → "Primary" |
-| 4 | `ip address 10.0.0.1 255.255.255.0` | ✅ | IP + Connected route added |
-| 5 | `exit` | ✅ | Returned to Global Config |
-| 6 | `ip route 192.168.10.0 255.255.255.0 10.0.0.2` | ✅ | Static route added |
-| 7 | `ping 192.168.10.5` | ✅ | **100% success (5/5)** |
-
-**Outcome:** All 8 steps completed. Ping 100% success rate confirmed.
-
----
-
-### Test 2 — Rollback on Invalid Interface ✅ PASSED
-
-**Goal:** Trigger automated rollback by trying to configure non-existent `GigabitEthernet0/777`.
-
-| Behaviour | Result |
-|-----------|--------|
-| Command `interface GigabitEthernet0/777` issued | ❌ `InvalidInput` error returned |
-| `TransactionManager` triggered rollback | ✅ Backup restore completed |
-| CLI submode context restored after rollback | ✅ Returned to correct mode |
-| Agent continued to next step | ✅ No infinite retry loop |
-
----
-
-### Test 3 — Enterprise Multi-Step: VLAN + Interface + Route ✅ PASSED (12/13 steps)
-
-**Goal:** VLAN 100 (Engineering) + VLAN 200 (Finance), configure Gi0/1, trigger rollback on Gi0/999, add static route, verify with ping and `show vlan brief`.
-
-```bash
-npx ts-node src/index.ts run --protocol mock --provider local --local-type lmstudio \
-  --model "qwen3.5-4b" \
-  --goal "...17-step enterprise configuration..." \
-  --non-interactive
-```
-
-| Step | Command | Result | State Diff |
-|------|---------|--------|------------|
-| 1 | `configure terminal` | ✅ | Global Config mode |
-| 2 | `vlan 100` | ✅ | **VLANs Added (+): 100** |
-| 3 | `name Engineering` | ✅ | Name stored |
-| 4 | `exit` | ✅ | Back to Global Config |
-| 5 | `vlan 200` | ✅ | **VLANs Added (+): 200** |
-| 6 | `name Finance` | ✅ | Name stored |
-| 7 | `exit` | ✅ | Back to Global Config |
-| 8 | `interface GigabitEthernet0/1` | ✅ | Interface mode |
-| 9 | `description Uplink` | ✅ | description: unassigned → "Uplink" |
-| 10 | `ip address 172.16.0.1 255.255.255.0` | ✅ | IP + Connected route added |
-| 11 | `no shutdown` | ✅ | shutdown: YES → NO |
-| 12 | `exit` | ✅ | Back to Global Config |
-| 13 | `interface GigabitEthernet0/999` | ⚠️ | Not executed — agent exited early |
-| 14–17 | route + ping + show vlan | ⚠️ | Skipped due to early exit |
-
-**Issues found & fixed:**
-- Agent stopped early (after step 12) before `show vlan brief` — root cause: missing **Goal Completion Discipline** rule in system prompt.
-- Fallback ping used `127.0.0.1` instead of actual route target — root cause: `resolveValidationDestination` only checked interface IPs, not static routes.
-
-**Fixes applied (`2026-05-28`):**
-- `PromptEngine.ts` — Added **Rule 8 (Goal Completion Discipline)**: agent must not stop until ALL numbered steps are done.
-- `AgentLoop.ts` — `resolveValidationDestination` now checks `show ip route` (static routes) first, then falls back to interface IPs.
-- `AgentLoop.ts` — Nudge message now injects the resolved destination IP instead of hardcoding `127.0.0.1`.
-
----
-
-### Test 4 — Enterprise Multi-Step (Post-Fix Re-Run) ✅ PASSED (15/15 steps + MAX_STEPS hit)
-
-Re-running Test 3 with **Rule 8 (Goal Completion Discipline)** and improved `resolveValidationDestination` applied.
-
-| Step | Command | Result | State Diff |
-|------|---------|--------|------------|
-| 1 | `configure terminal` | ✅ | Global Config mode |
-| 2 | `vlan 100` | ✅ | **VLANs Added (+): 100** |
-| 3 | `name Engineering` | ✅ | Name stored |
-| 4 | `exit` | ✅ | Back to Global Config |
-| 5 | `vlan 200` | ✅ | **VLANs Added (+): 200** |
-| 6 | `name Finance` | ✅ | Name stored |
-| 7 | `exit` | ✅ | Back to Global Config |
-| 8 | `interface GigabitEthernet0/1` | ✅ | Interface mode |
-| 9 | `description Uplink` | ✅ | description: unassigned → "Uplink" |
-| 10 | `ip address 172.16.0.1 255.255.255.0` | ✅ | IP + Connected route added |
-| 11 | `no shutdown` | ✅ | shutdown: YES → NO |
-| 12 | `exit` | ✅ | Back to Global Config |
-| 13 | `interface GigabitEthernet0/999` | ✅ | `BadInterfaceParameter` → **Rollback triggered + context restored** |
-| 14 | `ip route 10.50.0.0 255.255.255.0 172.16.0.254` | ✅ | **Routes Added (+): 10.50.0.0/24 via 172.16.0.254** |
-| 15 | `end` | ✅ | Returned to Privileged EXEC |
-| 16 | `ping 10.50.0.1` | ⚠️ | Not reached — `MAX_STEPS = 15` limit hit |
-| 17 | `show vlan brief` | ⚠️ | Not reached — `MAX_STEPS = 15` limit hit |
-
-**Progress vs Test 3:** Steps 13–15 now execute correctly (was stopping at step 12). Rollback + context restore confirmed working. Static route `10.50.0.0/24` successfully added after rollback.
-
-**Remaining issue:** `MAX_STEPS = 15` cap prevented steps 16–17 from running.
-**Fix applied:** `MAX_STEPS` increased to `20` in `AgentLoop.ts`.
-
-
----
-
-### GPU Metrics (Live — during inference)
-
-| Metric | Observed Range |
-|--------|---------------|
-| GPU Utilization | 58% – 85% |
-| VRAM Used | 5019 – 5094 MB / 6144 MB |
-| Temperature | 77°C – 84°C |
-| Power Draw | 55 W – 120 W |
-
-GPU metrics are displayed in real-time in the thinking spinner via `nvidia-smi` polling every 1.5 seconds.

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "ciscollm-cli",
-  "version": "1.0.6",
+  "version": "1.0.7",
   "description": "Cisco IOS automation agent CLI with mock simulation, guardrails, and LLM tool-calling support.",
   "main": "dist/index.js",
   "bin": {