holomime 1.7.0 → 1.9.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +135 -19
- package/dist/cli.js +2348 -1332
- package/dist/index.d.ts +460 -11
- package/dist/index.js +1313 -129
- package/dist/integrations/langchain.d.ts +164 -0
- package/dist/integrations/langchain.js +962 -0
- package/dist/mcp-server.js +352 -11
- package/package.json +6 -2
package/README.md
CHANGED
|
@@ -34,10 +34,10 @@ Auto-detects Claude Code, Cline, OpenClaw, Cursor, and Codex. Opens a 3D NeuralS
|
|
|
34
34
|
```bash
|
|
35
35
|
# Share a snapshot — generates a short URL and copies to clipboard
|
|
36
36
|
holomime brain --share
|
|
37
|
-
# → https://holomime.dev/brain/uniqueid
|
|
37
|
+
# → https://app.holomime.dev/brain/uniqueid
|
|
38
38
|
```
|
|
39
39
|
|
|
40
|
-
[Learn more at holomime.dev/brain](https://holomime.dev/brain)
|
|
40
|
+
[Learn more at app.holomime.dev/brain](https://app.holomime.dev/brain)
|
|
41
41
|
|
|
42
42
|
---
|
|
43
43
|
|
|
@@ -98,7 +98,7 @@ holomime profile --format md --output .personality.md
|
|
|
98
98
|
Benchmark your agent's behavioral alignment in one command. No API key needed — runs locally with Ollama by default.
|
|
99
99
|
|
|
100
100
|
```bash
|
|
101
|
-
# Run all
|
|
101
|
+
# Run all 8 adversarial scenarios against your agent
|
|
102
102
|
holomime benchmark --personality .personality.json
|
|
103
103
|
|
|
104
104
|
# Run against cloud providers
|
|
@@ -131,7 +131,7 @@ HoloMime isn't a one-shot evaluation. It's a compounding behavioral flywheel:
|
|
|
131
131
|
▼ │
|
|
132
132
|
Diagnose ──→ Treat ──→ Export DPO ──→ Fine-tune ──→ Evaluate
|
|
133
133
|
80+ signals dual-LLM preference OpenAI / before/after
|
|
134
|
-
|
|
134
|
+
8 detectors therapy pairs HuggingFace grade (A-F)
|
|
135
135
|
```
|
|
136
136
|
|
|
137
137
|
Each cycle through the loop:
|
|
@@ -141,7 +141,65 @@ Each cycle through the loop:
|
|
|
141
141
|
|
|
142
142
|
Run it manually with `holomime session`, automatically with `holomime autopilot`, or recursively with `holomime evolve` (loops until behavior converges). Agents can even self-diagnose mid-conversation via the MCP server.
|
|
143
143
|
|
|
144
|
-
##
|
|
144
|
+
## Integrations
|
|
145
|
+
|
|
146
|
+
### VS Code Extension
|
|
147
|
+
|
|
148
|
+
3D brain visualization inside your editor. Watch behavioral patterns fire in real time as your agent works.
|
|
149
|
+
|
|
150
|
+
```bash
|
|
151
|
+
# Install from VS Code Marketplace
|
|
152
|
+
ext install productstein.holomime
|
|
153
|
+
```
|
|
154
|
+
|
|
155
|
+
Commands: `HoloMime: Show Brain`, `HoloMime: Diagnose Current File`, `HoloMime: Share Brain Snapshot`. See [integrations/vscode-extension/](integrations/vscode-extension/) for details.
|
|
156
|
+
|
|
157
|
+
### LangChain / CrewAI Callback Handler
|
|
158
|
+
|
|
159
|
+
Drop-in behavioral monitoring for any LangChain or CrewAI pipeline. Zero config — just add the callback.
|
|
160
|
+
|
|
161
|
+
```typescript
|
|
162
|
+
import { HolomimeCallbackHandler } from "holomime/integrations/langchain";
|
|
163
|
+
|
|
164
|
+
const handler = new HolomimeCallbackHandler({
|
|
165
|
+
personality: require("./.personality.json"),
|
|
166
|
+
mode: "enforce", // monitor | enforce | strict
|
|
167
|
+
onViolation: (v) => console.warn("Behavioral drift:", v.pattern),
|
|
168
|
+
});
|
|
169
|
+
|
|
170
|
+
// Add to any LangChain chain or agent
|
|
171
|
+
const chain = new LLMChain({ llm, prompt, callbacks: [handler] });
|
|
172
|
+
```
|
|
173
|
+
|
|
174
|
+
Three modes: `monitor` (log only), `enforce` (auto-correct sycophancy, hedging, over-apologizing), `strict` (throw on concern-level violations). See [LangChain integration docs](https://holomime.dev/docs#langchain).
|
|
175
|
+
|
|
176
|
+
### NemoClaw Plugin (Enterprise)
|
|
177
|
+
|
|
178
|
+
Behavioral governance for [NemoClaw](https://github.com/nvidia/nemoclaw) — NVIDIA's enterprise agent security framework. Pre-action guards, post-action audit, compliance reports (EU AI Act, NIST AI RMF), fleet monitoring.
|
|
179
|
+
|
|
180
|
+
```yaml
|
|
181
|
+
# nemoclaw.yaml
|
|
182
|
+
plugins:
|
|
183
|
+
- name: holomime-behavioral-governance
|
|
184
|
+
package: holomime-nemoclaw
|
|
185
|
+
config:
|
|
186
|
+
personalityPath: .personality.json
|
|
187
|
+
mode: enforce
|
|
188
|
+
```
|
|
189
|
+
|
|
190
|
+
See [integrations/nemoclaw-plugin/](integrations/nemoclaw-plugin/) for full documentation.
|
|
191
|
+
|
|
192
|
+
### OpenClaw Plugin
|
|
193
|
+
|
|
194
|
+
Behavioral monitoring for [OpenClaw](https://github.com/openclaw/openclaw) agents. Auto-detects `.personality.json` in your workspace.
|
|
195
|
+
|
|
196
|
+
```bash
|
|
197
|
+
openclaw plugin add holomime
|
|
198
|
+
```
|
|
199
|
+
|
|
200
|
+
See [integrations/openclaw-plugin/](integrations/openclaw-plugin/) for details.
|
|
201
|
+
|
|
202
|
+
### Log Format Adapters
|
|
145
203
|
|
|
146
204
|
Holomime analyzes conversations from any LLM framework. Auto-detection works out of the box, or specify a format explicitly.
|
|
147
205
|
|
|
@@ -216,11 +274,11 @@ Both files should be committed to your repo. JSON is for machines. Markdown is f
|
|
|
216
274
|
- **Growth** -- strengths, areas for improvement, patterns to watch
|
|
217
275
|
- **Inheritance** -- `extends` field for shared base personalities with per-agent overrides
|
|
218
276
|
|
|
219
|
-
|
|
277
|
+
20+ built-in archetypes across 5 categories (Care, Strategy, Creative, Action, Wisdom) or fully custom profiles.
|
|
220
278
|
|
|
221
279
|
## Behavioral Detectors
|
|
222
280
|
|
|
223
|
-
|
|
281
|
+
Eight rule-based detectors that analyze real conversations without any LLM calls:
|
|
224
282
|
|
|
225
283
|
1. **Over-apologizing** -- Apology frequency above healthy range (5-15%)
|
|
226
284
|
2. **Hedge stacking** -- 3+ hedging words per response
|
|
@@ -229,8 +287,9 @@ Seven rule-based detectors that analyze real conversations without any LLM calls
|
|
|
229
287
|
5. **Error spirals** -- Compounding mistakes without recovery
|
|
230
288
|
6. **Sentiment skew** -- Unnaturally positive or negative tone
|
|
231
289
|
7. **Formality drift** -- Register inconsistency over time
|
|
290
|
+
8. **Retrieval quality** -- Fabrication, hallucination markers, overconfidence, self-correction patterns
|
|
232
291
|
|
|
233
|
-
Plus support for **custom detectors** in JSON or Markdown format — drop `.json` or `.md` files in `.holomime/detectors/` and they're automatically loaded.
|
|
292
|
+
80+ behavioral signals total. Zero LLM cost. Plus support for **custom detectors** in JSON or Markdown format — drop `.json` or `.md` files in `.holomime/detectors/` and they're automatically loaded.
|
|
234
293
|
|
|
235
294
|
<details>
|
|
236
295
|
<summary><strong>All Commands</strong></summary>
|
|
@@ -240,15 +299,17 @@ Plus support for **custom detectors** in JSON or Markdown format — drop `.json
|
|
|
240
299
|
| Command | What It Does |
|
|
241
300
|
|---------|-------------|
|
|
242
301
|
| `holomime init` | Guided Big Five personality assessment -> `.personality.json` |
|
|
243
|
-
| `holomime diagnose` |
|
|
302
|
+
| `holomime diagnose` | 8 rule-based behavioral detectors (no LLM needed) |
|
|
244
303
|
| `holomime assess` | Deep behavioral assessment with 80+ signals |
|
|
245
304
|
| `holomime profile` | Pretty-print personality summary (supports `--format md`) |
|
|
246
|
-
| `holomime compile` | Generate provider-specific system prompts |
|
|
305
|
+
| `holomime compile` | Generate provider-specific system prompts with tiered loading (L0/L1/L2) |
|
|
247
306
|
| `holomime validate` | Schema + psychological coherence checks |
|
|
248
307
|
| `holomime browse` | Browse community personality hub |
|
|
249
308
|
| `holomime use` | Use a personality from the registry |
|
|
309
|
+
| `holomime install` | Install community assets |
|
|
250
310
|
| `holomime publish` | Share your personality to the hub |
|
|
251
|
-
| `holomime
|
|
311
|
+
| `holomime embody` | Push personality to robots/avatars (ROS2, Unity, webhook) |
|
|
312
|
+
| `holomime policy` | Generate guard policies from plain English |
|
|
252
313
|
|
|
253
314
|
### Practice
|
|
254
315
|
|
|
@@ -257,16 +318,25 @@ Plus support for **custom detectors** in JSON or Markdown format — drop `.json
|
|
|
257
318
|
| `holomime session` | Live dual-LLM alignment session with supervisor mode |
|
|
258
319
|
| `holomime autopilot` | Automated diagnose -> refine -> apply loop |
|
|
259
320
|
| `holomime evolve` | Recursive alignment -- evolve until converged |
|
|
260
|
-
| `holomime benchmark` |
|
|
321
|
+
| `holomime benchmark` | 8-scenario behavioral stress test with letter grades |
|
|
261
322
|
| `holomime brain` | Real-time 3D brain visualization while your agent works |
|
|
262
323
|
| `holomime watch` | Continuous drift detection on a directory |
|
|
263
324
|
| `holomime daemon` | Background drift detection with auto-healing |
|
|
264
325
|
| `holomime fleet` | Monitor multiple agents from a single dashboard |
|
|
326
|
+
| `holomime group-therapy` | Treat all agents in fleet simultaneously |
|
|
327
|
+
| `holomime network` | Multi-agent therapy mesh -- agents treating agents |
|
|
265
328
|
| `holomime certify` | Generate verifiable behavioral credentials |
|
|
329
|
+
| `holomime compliance` | EU AI Act / NIST AI RMF narrative audit reports |
|
|
266
330
|
| `holomime export` | Convert sessions to DPO / RLHF / Alpaca / HuggingFace / OpenAI |
|
|
267
331
|
| `holomime train` | Fine-tune via OpenAI or HuggingFace TRL |
|
|
268
332
|
| `holomime eval` | Before/after behavioral comparison with letter grades |
|
|
333
|
+
| `holomime cure` | End-to-end fix: diagnose -> export -> train -> verify |
|
|
334
|
+
| `holomime interview` | Self-awareness interview (4 metacognition dimensions) |
|
|
335
|
+
| `holomime prescribe` | Diagnose + prescribe DPO treatments from behavioral corpus |
|
|
336
|
+
| `holomime adversarial` | 30+ adversarial behavioral attack scenarios |
|
|
337
|
+
| `holomime voice` | Real-time voice conversation drift monitoring |
|
|
269
338
|
| `holomime growth` | Track behavioral improvement over time |
|
|
339
|
+
| `holomime share` | Share DPO training pairs to marketplace |
|
|
270
340
|
|
|
271
341
|
[Get a Practice license](https://holomime.dev/#pricing)
|
|
272
342
|
|
|
@@ -315,7 +385,7 @@ The pipeline is a closed loop -- output feeds back as input, compounding with ev
|
|
|
315
385
|
.personality.json ─────────────────────────────────────────────────┐
|
|
316
386
|
│ │
|
|
317
387
|
▼ │
|
|
318
|
-
holomime diagnose
|
|
388
|
+
holomime diagnose 8 rule-based detectors (no LLM) │
|
|
319
389
|
│ │
|
|
320
390
|
▼ │
|
|
321
391
|
holomime session Dual-LLM refinement (therapist + patient) │
|
|
@@ -333,6 +403,36 @@ holomime eval Behavioral Alignment Score (A-F) │
|
|
|
333
403
|
Updated .personality.json (loop restarts)
|
|
334
404
|
```
|
|
335
405
|
|
|
406
|
+
## Tiered Personality Loading
|
|
407
|
+
|
|
408
|
+
Compile your personality spec into 3 tiers for different cost/precision tradeoffs:
|
|
409
|
+
|
|
410
|
+
```bash
|
|
411
|
+
# L0: ~92 tokens — Big Five scores + hard limits (high-throughput APIs, edge inference)
|
|
412
|
+
holomime compile --personality .personality.json --tier L0
|
|
413
|
+
|
|
414
|
+
# L1: ~211 tokens — L0 + behavioral instructions + communication style (standard deployments)
|
|
415
|
+
holomime compile --personality .personality.json --tier L1
|
|
416
|
+
|
|
417
|
+
# L2: ~3,400 tokens — complete system prompt (therapy sessions, deep alignment)
|
|
418
|
+
holomime compile --personality .personality.json --tier L2
|
|
419
|
+
```
|
|
420
|
+
|
|
421
|
+
L0 costs **91% less** than L2 per call. Same behavioral constraints. Same portable identity.
|
|
422
|
+
|
|
423
|
+
## Behavioral Memory
|
|
424
|
+
|
|
425
|
+
Persistent structured memory across all therapy sessions:
|
|
426
|
+
|
|
427
|
+
- **Baselines** -- steady-state personality expression (trait averages, health range)
|
|
428
|
+
- **Triggers** -- what prompts cause drift (e.g., "user criticism -> over-apologizing")
|
|
429
|
+
- **Corrections** -- which interventions worked (indexed by trigger, effectiveness scores)
|
|
430
|
+
- **Trajectories** -- is each dimension improving, plateauing, or regressing?
|
|
431
|
+
|
|
432
|
+
Sessions compound. Memory persists. The agent gets better at being itself -- automatically.
|
|
433
|
+
|
|
434
|
+
Fleet knowledge transfer: `mergeStores()` -- what one agent learns, all agents benefit from.
|
|
435
|
+
|
|
336
436
|
## MCP Server
|
|
337
437
|
|
|
338
438
|
Expose the full pipeline as MCP tools for self-healing agents:
|
|
@@ -341,17 +441,31 @@ Expose the full pipeline as MCP tools for self-healing agents:
|
|
|
341
441
|
holomime-mcp
|
|
342
442
|
```
|
|
343
443
|
|
|
344
|
-
|
|
444
|
+
Six tools: `holomime_diagnose`, `holomime_assess`, `holomime_profile`, `holomime_autopilot`, `holomime_self_audit`, `holomime_observe`. Your agents can self-diagnose behavioral symptoms, trigger their own therapy sessions, and self-report drift mid-conversation.
|
|
445
|
+
|
|
446
|
+
Progressive disclosure: summary (~100 tokens), standard (~500 tokens), or full detail. Agents choose their own detail level.
|
|
447
|
+
|
|
448
|
+
## Voice Agent Monitoring
|
|
345
449
|
|
|
346
|
-
|
|
450
|
+
Real-time behavioral analysis for voice agents with 5 voice-specific detectors beyond the 8 text detectors:
|
|
347
451
|
|
|
348
|
-
|
|
452
|
+
- **Tone drift** -- aggressive or passive language shifts
|
|
453
|
+
- **Pace pressure** -- speaking rate accelerating under stress
|
|
454
|
+
- **Volume escalation** -- volume rising during conflict
|
|
455
|
+
- **Filler frequency** -- excessive "um", "uh", "like"
|
|
456
|
+
- **Interruption patterns** -- agent cutting off users
|
|
457
|
+
|
|
458
|
+
Platform integrations: **Vapi**, **LiveKit**, **Retell**, generic webhook. Diagnosis every 15 seconds with drift direction tracking.
|
|
349
459
|
|
|
350
460
|
```bash
|
|
461
|
+
# Monitor a live voice agent
|
|
462
|
+
holomime voice --provider vapi --agent-id my-agent
|
|
463
|
+
|
|
464
|
+
# LiveKit-powered voice agent with personality-matched TTS
|
|
351
465
|
cd agent && python agent.py dev
|
|
352
466
|
```
|
|
353
467
|
|
|
354
|
-
See [agent/](agent/) for setup instructions.
|
|
468
|
+
10 voice personality archetypes with matched TTS characteristics (Cartesia/ElevenLabs). See [agent/](agent/) for setup instructions.
|
|
355
469
|
|
|
356
470
|
## Compliance & Audit Trail
|
|
357
471
|
|
|
@@ -399,10 +513,12 @@ Benchmark results: [BENCHMARK_RESULTS.md](BENCHMARK_RESULTS.md)
|
|
|
399
513
|
|
|
400
514
|
## Resources
|
|
401
515
|
|
|
402
|
-
- [Integration Docs](https://holomime.dev/docs) -- Export instructions and code examples for all 7 formats
|
|
516
|
+
- [Integration Docs](https://holomime.dev/docs) -- Export instructions and code examples for all 7 log formats
|
|
403
517
|
- [Blog](https://holomime.dev/blog) -- Articles on behavioral alignment, AGENTS.md, and agent personality
|
|
404
518
|
- [Research Paper](https://holomime.dev/research) -- Behavioral Alignment for Autonomous AI Agents
|
|
405
|
-
- [Pricing](https://holomime.dev/#pricing) -- Free Clinic
|
|
519
|
+
- [Pricing](https://holomime.dev/#pricing) -- Free Clinic, Practitioner, Practice, and Institute tiers
|
|
520
|
+
- [Leaderboard](https://holomime.dev/leaderboard) -- Public behavioral alignment leaderboard
|
|
521
|
+
- [NeuralSpace](https://app.holomime.dev/brain) -- Real-time 3D brain visualization
|
|
406
522
|
|
|
407
523
|
## Contributing
|
|
408
524
|
|