loki-mode 7.45.0 → 7.46.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +16 -12
- package/SKILL.md +5 -5
- package/VERSION +1 -1
- package/autonomy/CONSTITUTION.md +9 -2
- package/autonomy/lib/sentrux-gate.sh +1 -1
- package/autonomy/loki +2 -2
- package/autonomy/run.sh +355 -92
- package/dashboard/__init__.py +1 -1
- package/dashboard/registry.py +156 -62
- package/dashboard/server.py +9 -10
- package/docs/COMPARISON.md +10 -10
- package/docs/COMPETITIVE-ANALYSIS.md +1 -1
- package/docs/INSTALLATION.md +2 -2
- package/docs/P0-SWEEP-PLAN.md +163 -0
- package/docs/architecture/STATE-MACHINES.md +18 -19
- package/docs/architecture/bmad-loki-voice-agent-council-analysis.md +1 -1
- package/docs/auto-claude-comparison.md +14 -11
- package/docs/certification/01-core-concepts/lesson.md +12 -11
- package/docs/certification/01-core-concepts/quiz.md +6 -6
- package/docs/certification/05-troubleshooting/lesson.md +23 -13
- package/docs/certification/05-troubleshooting/quiz.md +3 -3
- package/docs/certification/answer-key.md +2 -2
- package/docs/certification/certification-exam.md +9 -9
- package/docs/competitive/bolt-new-analysis.md +1 -1
- package/docs/competitive/emergence-others-analysis.md +9 -9
- package/docs/competitive/replit-lovable-analysis.md +3 -3
- package/docs/cursor-comparison.md +15 -12
- package/docs/dashboard-guide.md +9 -7
- package/docs/prd-purple-lab-platform-v2.md +1 -1
- package/docs/prd-purple-lab-platform.md +3 -3
- package/docs/show-hn-post.md +2 -2
- package/loki-ts/dist/loki.js +2 -2
- package/mcp/__init__.py +1 -1
- package/package.json +2 -2
- package/plugins/loki-mode/.claude-plugin/plugin.json +2 -2
- package/plugins/loki-mode/README.md +1 -1
- package/references/magic-rarv-integration.md +1 -1
- package/references/quality-control.md +5 -5
- package/references/sdlc-phases.md +1 -2
- package/skills/00-index.md +1 -1
- package/skills/artifacts.md +1 -1
- package/skills/healing.md +1 -1
- package/skills/magic-modules.md +3 -3
- package/skills/quality-gates.md +52 -39
- package/skills/testing.md +1 -1
|
@@ -120,21 +120,24 @@ Loki Mode implements CONSENSAGENT (ACL 2025):
|
|
|
120
120
|
**Verdict: Loki Mode wins** - Research-backed quality assurance.
|
|
121
121
|
|
|
122
122
|
### 5. Quality Gates
|
|
123
|
-
Loki Mode
|
|
123
|
+
Loki Mode runs 8 deterministic quality gates plus full SDLC phase coverage.
|
|
124
|
+
|
|
125
|
+
The 8 deterministic quality gates: static analysis (CodeQL, ESLint), test suite (pass/fail), blind 3-reviewer review with severity blocking, anti-sycophancy Devil's Advocate, mock-integrity, test-mutation, documentation coverage, and Magic Modules debate. (Backward-compatibility is a conditional healing-mode auditor, not a numbered gate.)
|
|
126
|
+
|
|
127
|
+
Beyond the gates, the SDLC pipeline covers these phases:
|
|
124
128
|
1. Static analysis (CodeQL, ESLint)
|
|
125
|
-
2. Unit tests (
|
|
129
|
+
2. Unit tests (test suite passes; coverage % not measured this release)
|
|
126
130
|
3. API/Integration tests
|
|
127
131
|
4. E2E tests (Playwright)
|
|
128
132
|
5. Security scanning (OWASP)
|
|
129
|
-
6.
|
|
130
|
-
7.
|
|
131
|
-
8.
|
|
132
|
-
9.
|
|
133
|
-
10.
|
|
134
|
-
11.
|
|
135
|
-
12.
|
|
136
|
-
13.
|
|
137
|
-
14. Continuous monitoring
|
|
133
|
+
6. Parallel code review (3 reviewers)
|
|
134
|
+
7. Performance/load testing
|
|
135
|
+
8. Accessibility (WCAG)
|
|
136
|
+
9. Regression testing
|
|
137
|
+
10. UAT simulation
|
|
138
|
+
11. Anti-sycophancy check
|
|
139
|
+
12. Scale-aware review intensity
|
|
140
|
+
13. Continuous monitoring
|
|
138
141
|
|
|
139
142
|
**Auto-Claude:** Single QA validation loop (up to 50 iterations).
|
|
140
143
|
|
|
@@ -105,19 +105,20 @@ Full agent type definitions are in `references/agent-types.md`.
|
|
|
105
105
|
|
|
106
106
|
## Quality Gates
|
|
107
107
|
|
|
108
|
-
Loki Mode enforces
|
|
108
|
+
Loki Mode enforces an 8-gate quality system. Code must pass all applicable gates before moving forward:
|
|
109
109
|
|
|
110
110
|
| Gate | Name | Purpose |
|
|
111
111
|
|------|------|---------|
|
|
112
|
-
| 1 |
|
|
113
|
-
| 2 |
|
|
114
|
-
| 3 | Blind Review
|
|
115
|
-
| 4 | Anti-Sycophancy
|
|
116
|
-
| 5 |
|
|
117
|
-
| 6 |
|
|
118
|
-
| 7 |
|
|
119
|
-
| 8 |
|
|
120
|
-
|
|
112
|
+
| 1 | Static Analysis | CodeQL, ESLint/Pylint, type checking |
|
|
113
|
+
| 2 | Test Suite (pass/fail) | Red blocks; coverage % not measured this release |
|
|
114
|
+
| 3 | Blind Code Review (3-reviewer council + severity blocking) | 3 specialist reviewers in parallel, blind to each other; Critical/High = BLOCK; Medium/Low advisory |
|
|
115
|
+
| 4 | Anti-Sycophancy / Devil's Advocate | If reviewers unanimously approve, run a Devil's Advocate reviewer |
|
|
116
|
+
| 5 | Mock Integrity Detector | Flags tests that mock internal modules instead of real code |
|
|
117
|
+
| 6 | Test Mutation Detector | Detects assertion value changes alongside implementation changes |
|
|
118
|
+
| 7 | Documentation Coverage | README exists, docs freshness, API docs for packages |
|
|
119
|
+
| 8 | Magic Modules Debate | Spec-vs-implementation debate on generated Magic Modules |
|
|
120
|
+
|
|
121
|
+
A conditional backward-compatibility / legacy-healing auditor also runs in healing mode (not one of the 8 numbered gates).
|
|
121
122
|
|
|
122
123
|
The blind review system (Gate 3) selects 3 reviewers from a pool of 5 named specialists:
|
|
123
124
|
|
|
@@ -179,4 +180,4 @@ Every Loki Mode project uses these files in the `.loki/` directory:
|
|
|
179
180
|
|
|
180
181
|
## Summary
|
|
181
182
|
|
|
182
|
-
Loki Mode is an autonomous multi-agent system that follows the RARV cycle to build software from PRDs. It uses 41 agent types organized into 8 domains, enforces quality through
|
|
183
|
+
Loki Mode is an autonomous multi-agent system that follows the RARV cycle to build software from PRDs. It uses 41 agent types organized into 8 domains, enforces quality through 8 gates with blind peer review, and maintains episodic/semantic/procedural memory for continuous learning. Projects are classified into simple, standard, or complex tiers that determine the number of phases executed.
|
|
@@ -45,7 +45,7 @@ D) test-coverage-auditor
|
|
|
45
45
|
A) 3
|
|
46
46
|
B) 5
|
|
47
47
|
C) 7
|
|
48
|
-
D)
|
|
48
|
+
D) 8
|
|
49
49
|
|
|
50
50
|
---
|
|
51
51
|
|
|
@@ -67,12 +67,12 @@ D) complex
|
|
|
67
67
|
|
|
68
68
|
---
|
|
69
69
|
|
|
70
|
-
**Question 8:** What
|
|
70
|
+
**Question 8:** What does Gate 7 (Documentation Coverage) check?
|
|
71
71
|
|
|
72
|
-
A)
|
|
73
|
-
B)
|
|
74
|
-
C)
|
|
75
|
-
D)
|
|
72
|
+
A) That unit test coverage is at least 80%
|
|
73
|
+
B) That every function has an inline comment
|
|
74
|
+
C) That a README exists, docs are fresh within 10 commits, and packages have API docs
|
|
75
|
+
D) That cyclomatic complexity stays under 10
|
|
76
76
|
|
|
77
77
|
---
|
|
78
78
|
|
|
@@ -17,30 +17,40 @@ This module covers diagnosing and resolving common issues in Loki Mode: gate fai
|
|
|
17
17
|
|
|
18
18
|
## Quality Gate Failures
|
|
19
19
|
|
|
20
|
-
When a quality gate fails, identify which gate triggered the failure
|
|
20
|
+
When a quality gate fails, identify which gate triggered the failure (the 8-gate
|
|
21
|
+
system is detailed in `skills/quality-gates.md`):
|
|
21
22
|
|
|
22
|
-
**Gates 1-
|
|
23
|
+
**Gates 1-2 (Static analysis and test suite):**
|
|
24
|
+
- Gate 1 (Static Analysis): fix CodeQL/ESLint/Pylint/type-checker findings
|
|
25
|
+
- Gate 2 (Test Suite): the test runner must pass; red blocks. Coverage % is not
|
|
26
|
+
measured this release. Fix failing tests before proceeding (never delete or
|
|
27
|
+
skip tests)
|
|
28
|
+
|
|
29
|
+
**Gates 3-4 (Review gates):**
|
|
23
30
|
- Check the review output for severity levels
|
|
24
|
-
- Critical/High
|
|
31
|
+
- Critical/High = BLOCK; Medium/Low advisory (recommended to fix)
|
|
25
32
|
- Low/Cosmetic = TODO (informational)
|
|
26
33
|
- If all 3 reviewers pass unanimously, Gate 4 runs Devil's Advocate
|
|
27
34
|
|
|
28
|
-
**Gate
|
|
29
|
-
- Unit tests must have 100% pass rate and >80% coverage
|
|
30
|
-
- Integration tests must have 100% pass rate
|
|
31
|
-
- Fix failing tests before proceeding (never delete or skip tests)
|
|
32
|
-
|
|
33
|
-
**Gate 8 (Mock detector):**
|
|
35
|
+
**Gate 5 (Mock integrity detector):**
|
|
34
36
|
- Runs `tests/detect-mock-problems.sh`
|
|
35
37
|
- Flags tests that mock internal modules instead of using real code
|
|
36
38
|
- Flags tautological assertions and high internal mock ratios
|
|
37
|
-
- Disable with `
|
|
39
|
+
- Disable with `LOKI_GATE_MOCK=false` (not recommended)
|
|
38
40
|
|
|
39
|
-
**Gate
|
|
41
|
+
**Gate 6 (Test mutation detector):**
|
|
40
42
|
- Runs `tests/detect-test-mutations.sh`
|
|
41
43
|
- Detects assertion values changed alongside implementation (test fitting)
|
|
42
|
-
- Detects low assertion density
|
|
43
|
-
- Disable with `
|
|
44
|
+
- Detects low assertion density
|
|
45
|
+
- Disable with `LOKI_GATE_MUTATION=false` (not recommended)
|
|
46
|
+
|
|
47
|
+
**Gate 7 (Documentation coverage):**
|
|
48
|
+
- Checks README presence, docs freshness within 10 commits, and API docs for packages
|
|
49
|
+
- Disable with `LOKI_GATE_DOC_COVERAGE=false` (not recommended for packages)
|
|
50
|
+
|
|
51
|
+
**Gate 8 (Magic Modules debate):**
|
|
52
|
+
- Runs the spec-vs-implementation debate on generated Magic Modules
|
|
53
|
+
- BLOCK-severity findings block; disable with `LOKI_GATE_MAGIC_DEBATE=false`
|
|
44
54
|
|
|
45
55
|
## Circuit Breaker System
|
|
46
56
|
|
|
@@ -67,11 +67,11 @@ D) Removes the entire `.loki/` directory
|
|
|
67
67
|
|
|
68
68
|
---
|
|
69
69
|
|
|
70
|
-
**Question 8:** Which environment variable disables Gate
|
|
70
|
+
**Question 8:** Which environment variable disables Gate 5 (Mock Integrity Detector)?
|
|
71
71
|
|
|
72
|
-
A) `
|
|
72
|
+
A) `LOKI_GATE_MOCK=false`
|
|
73
73
|
B) `LOKI_GATE_MOCK_DETECTOR=false`
|
|
74
|
-
C) `
|
|
74
|
+
C) `LOKI_DISABLE_GATE_5=true`
|
|
75
75
|
D) `LOKI_NO_MOCK_DETECTION=true`
|
|
76
76
|
|
|
77
77
|
---
|
|
@@ -12,10 +12,10 @@ This file contains answers for all module quizzes and the final certification ex
|
|
|
12
12
|
| 2 | C | 41 agent types: 37 domain + 4 orchestration |
|
|
13
13
|
| 3 | B | After 5 failures, the task moves to `.loki/queue/dead-letter.json` |
|
|
14
14
|
| 4 | C | architecture-strategist is always one of the 3 selected reviewers |
|
|
15
|
-
| 5 | D |
|
|
15
|
+
| 5 | D | 8 quality gates (Static Analysis through Magic Modules Debate); backward-compatibility is a conditional healing-mode auditor, not one of the 8 |
|
|
16
16
|
| 6 | B | Episodic, semantic, and procedural memory |
|
|
17
17
|
| 7 | B | Simple tier uses 3 phases |
|
|
18
|
-
| 8 | C | Gate 7
|
|
18
|
+
| 8 | C | Gate 7 (Documentation Coverage) checks README presence, docs freshness within 10 commits, and API docs for packages; coverage % is not measured this release |
|
|
19
19
|
| 9 | C | Claude Code supports full features; Codex and Gemini run in degraded mode |
|
|
20
20
|
| 10 | B | If all 3 reviewers unanimously approve, a Devil's Advocate reviewer runs |
|
|
21
21
|
|
|
@@ -49,7 +49,7 @@ D) test-coverage-auditor
|
|
|
49
49
|
A) 3
|
|
50
50
|
B) 5
|
|
51
51
|
C) 7
|
|
52
|
-
D)
|
|
52
|
+
D) 8
|
|
53
53
|
|
|
54
54
|
---
|
|
55
55
|
|
|
@@ -71,12 +71,12 @@ D) complex
|
|
|
71
71
|
|
|
72
72
|
---
|
|
73
73
|
|
|
74
|
-
**Question 8:** What
|
|
74
|
+
**Question 8:** What does Gate 7 (Documentation Coverage) check?
|
|
75
75
|
|
|
76
|
-
A)
|
|
77
|
-
B)
|
|
78
|
-
C)
|
|
79
|
-
D)
|
|
76
|
+
A) That unit test coverage is at least 80%
|
|
77
|
+
B) That every function has an inline comment
|
|
78
|
+
C) That a README exists, docs are fresh within 10 commits, and packages have API docs
|
|
79
|
+
D) That cyclomatic complexity stays under 10
|
|
80
80
|
|
|
81
81
|
---
|
|
82
82
|
|
|
@@ -439,11 +439,11 @@ D) Removes the entire `.loki/` directory
|
|
|
439
439
|
|
|
440
440
|
---
|
|
441
441
|
|
|
442
|
-
**Question 48:** Which environment variable disables Gate
|
|
442
|
+
**Question 48:** Which environment variable disables Gate 5 (Mock Integrity Detector)?
|
|
443
443
|
|
|
444
|
-
A) `
|
|
444
|
+
A) `LOKI_GATE_MOCK=false`
|
|
445
445
|
B) `LOKI_SKIP_MOCK_CHECK=true`
|
|
446
|
-
C) `
|
|
446
|
+
C) `LOKI_DISABLE_GATE_5=true`
|
|
447
447
|
D) `LOKI_NO_MOCK_DETECTION=true`
|
|
448
448
|
|
|
449
449
|
---
|
|
@@ -409,7 +409,7 @@ These are bolt.new weaknesses that Loki Mode already solves or can emphasize:
|
|
|
409
409
|
|
|
410
410
|
#### R5: Advertise Production Readiness as Key Differentiator
|
|
411
411
|
- **bolt.new's gap**: 70% done code, no tests, no review, $5-20K remediation
|
|
412
|
-
- **Loki Mode's advantage**: RARV cycle,
|
|
412
|
+
- **Loki Mode's advantage**: RARV cycle, 8 quality gates, 3-reviewer system, automated testing
|
|
413
413
|
- **Action**: Create comparison content showing: "bolt.new gives you a prototype. Loki Mode gives you a product."
|
|
414
414
|
- **Messaging**: "From PRD to production, not PRD to prototype"
|
|
415
415
|
|
|
@@ -286,7 +286,7 @@ Developers who value open-source tooling, speed, and terminal-native workflows.
|
|
|
286
286
|
| **Autonomous Iteration** | No (task-level) | No | Partial (/loop, /schedule) | No (requires prompting) | Yes (RARV loop + completion council) |
|
|
287
287
|
| **SDLC Pipeline** | No | No | No | No | Yes (9 phases) |
|
|
288
288
|
| **Code Review** | No | No | Yes (single-pass) | Yes (single-pass) | Yes (3-reviewer blind) |
|
|
289
|
-
| **Quality Gates** | No | No | No | No | Yes (
|
|
289
|
+
| **Quality Gates** | No | No | No | No | Yes (8 gates) |
|
|
290
290
|
| **Anti-Sycophancy** | No | No | No | No | Yes (devil's advocate) |
|
|
291
291
|
| **Memory System** | Enterprise only | No | CLAUDE.md + auto-memory | Session resumption | Episodic/semantic/procedural |
|
|
292
292
|
| **Self-Hosted** | Partial (Agent-E) | No | Partial (CLI local, but subscription or API required) | Yes (with API key) | Yes (fully, any provider API key) |
|
|
@@ -383,10 +383,10 @@ Claude Code and Codex CLI offer single-pass code review. Neither provides:
|
|
|
383
383
|
- 3-reviewer blind parallel review
|
|
384
384
|
- Anti-sycophancy checks (devil's advocate on unanimous approval)
|
|
385
385
|
- Severity-based blocking gates
|
|
386
|
-
- Test
|
|
386
|
+
- Test suite enforcement (100% pass; coverage % not measured this release)
|
|
387
387
|
- Static analysis integration (CodeQL, ESLint)
|
|
388
388
|
|
|
389
|
-
**Opportunity:** Loki Mode's
|
|
389
|
+
**Opportunity:** Loki Mode's 8-gate quality system provides enterprise-grade assurance that no competitor matches.
|
|
390
390
|
|
|
391
391
|
### Gap 4: No Persistent Cross-Project Learning
|
|
392
392
|
|
|
@@ -433,7 +433,7 @@ Rork generates mobile apps but cannot handle backends, APIs, or infrastructure.
|
|
|
433
433
|
This positioning highlights three unique capabilities no competitor offers together:
|
|
434
434
|
1. **Autonomous SDLC** (not just coding assistance)
|
|
435
435
|
2. **Multi-provider** (not locked to one vendor)
|
|
436
|
-
3. **Quality-assured** (
|
|
436
|
+
3. **Quality-assured** (8-gate system, 3-reviewer blind review)
|
|
437
437
|
|
|
438
438
|
### Differentiation by Competitor
|
|
439
439
|
|
|
@@ -443,7 +443,7 @@ This positioning highlights three unique capabilities no competitor offers toget
|
|
|
443
443
|
| Autonomy | Semi-autonomous (/loop, /schedule, but no SDLC orchestration) | Fully autonomous (RARV loop + completion council) |
|
|
444
444
|
| Scope | Individual coding tasks, PR reviews | Full SDLC pipeline (9 phases) |
|
|
445
445
|
| Providers | Claude models only (multi-cloud hosting) | 5 providers, 3+ model families |
|
|
446
|
-
| Quality | Single-pass review, GitHub Action |
|
|
446
|
+
| Quality | Single-pass review, GitHub Action | 8-gate, 3-reviewer blind system, anti-sycophancy |
|
|
447
447
|
| Memory | CLAUDE.md + auto-memory (session-scoped) | Episodic/semantic/procedural (cross-project) |
|
|
448
448
|
| Cost model | Subscription with rate limits or API | Self-hosted, pay-per-token, any provider |
|
|
449
449
|
| IDE/surface | Terminal, VS Code, JetBrains, Desktop, Web | Terminal, VS Code (via extension) |
|
|
@@ -458,7 +458,7 @@ This positioning highlights three unique capabilities no competitor offers toget
|
|
|
458
458
|
| Speed | 240+ tokens/sec | Depends on provider |
|
|
459
459
|
| Providers | OpenAI only | 5 providers |
|
|
460
460
|
| Multi-agent | Experimental (isolated) | 41 agent types, 8 domains |
|
|
461
|
-
| Quality | Single-pass review |
|
|
461
|
+
| Quality | Single-pass review | 8-gate system |
|
|
462
462
|
| **Loki Mode advantage:** | Autonomous pipeline, multi-provider, mature multi-agent |
|
|
463
463
|
|
|
464
464
|
#### vs. Emergence AI
|
|
@@ -475,7 +475,7 @@ This positioning highlights three unique capabilities no competitor offers toget
|
|
|
475
475
|
|-----------|------|-----------|
|
|
476
476
|
| Focus | Mobile apps (no-code) | Full-stack software |
|
|
477
477
|
| Target user | Non-technical | Developers + technical teams |
|
|
478
|
-
| Quality | No testing/review |
|
|
478
|
+
| Quality | No testing/review | 8-gate quality system |
|
|
479
479
|
| Output | Mobile app only | Any software type |
|
|
480
480
|
| **Loki Mode advantage:** | Developer-grade, full-stack, quality-assured |
|
|
481
481
|
|
|
@@ -485,7 +485,7 @@ This positioning highlights three unique capabilities no competitor offers toget
|
|
|
485
485
|
"You already use AI for coding. Loki Mode makes it autonomous -- give it a PRD, and it handles planning, implementation, testing, code review, and deployment. Keep using Claude or Codex under the hood."
|
|
486
486
|
|
|
487
487
|
**For engineering leaders evaluating AI tooling:**
|
|
488
|
-
"Loki Mode is the only open-source system with enterprise-grade quality gates (
|
|
488
|
+
"Loki Mode is the only open-source system with enterprise-grade quality gates (8 gates, 3-reviewer blind review, anti-sycophancy checks) that runs autonomously on any AI provider. Self-hosted, no vendor lock-in."
|
|
489
489
|
|
|
490
490
|
**For startups and solo developers:**
|
|
491
491
|
"Go from idea to deployed product overnight. Write a PRD, invoke Loki Mode, and let it build, test, and deploy while you sleep. Works with your existing Claude or OpenAI API key."
|
|
@@ -557,7 +557,7 @@ The most significant near-term competitive threat is Anthropic's Agent SDK (http
|
|
|
557
557
|
|
|
558
558
|
**However, Loki Mode's structural advantages remain:**
|
|
559
559
|
1. **Multi-provider:** Agent SDK is Claude-only. Loki Mode works with any provider.
|
|
560
|
-
2. **Battle-tested pipeline:**
|
|
560
|
+
2. **Battle-tested pipeline:** 8 quality gates, completion council, healing, memory -- these took months to build and validate. A new Agent SDK project starts from zero.
|
|
561
561
|
3. **Open source and self-hosted:** No dependency on Anthropic's platform decisions.
|
|
562
562
|
4. **Research foundation:** Built on patterns from OpenAI, DeepMind, Anthropic, and academic research. Not just engineering, but applied AI safety research (Constitutional AI, anti-sycophancy, alignment faking detection).
|
|
563
563
|
|
|
@@ -316,7 +316,7 @@ Replit Agent has evolved rapidly through four major versions:
|
|
|
316
316
|
| Self-testing loop | Yes | No | Yes (RARV cycle) |
|
|
317
317
|
| Code review | No | No | Yes (3-reviewer blind review) |
|
|
318
318
|
| Anti-sycophancy | No | No | Yes (devil's advocate) |
|
|
319
|
-
| Quality gates | No | Security scan only |
|
|
319
|
+
| Quality gates | No | Security scan only | 8 gates |
|
|
320
320
|
| Memory system | No | Project knowledge | Episodic/semantic/procedural |
|
|
321
321
|
| Model selection | Platform-chosen | Platform-chosen | Task-aware (Opus/Sonnet/Haiku) |
|
|
322
322
|
| Multi-provider support | No (Replit only) | No (Lovable only) | Yes (Claude/Codex/Gemini/Cline/Aider) |
|
|
@@ -393,7 +393,7 @@ Loki Mode operates as a true autonomous engineering system, not a prompt-respons
|
|
|
393
393
|
|
|
394
394
|
### 2. Quality Assurance
|
|
395
395
|
|
|
396
|
-
Loki Mode's
|
|
396
|
+
Loki Mode's 8-gate quality system (static analysis, test suite (pass/fail), blind 3-reviewer review with severity blocking, anti-sycophancy Devil's Advocate, mock-integrity, test-mutation, documentation coverage, Magic Modules debate; backward-compatibility is a conditional healing-mode auditor) has no equivalent in either platform. Replit and Lovable have zero code review, zero anti-sycophancy, and minimal quality gates. This is Loki Mode's strongest differentiator.
|
|
397
397
|
|
|
398
398
|
### 3. Multi-Provider and Multi-Model Intelligence
|
|
399
399
|
|
|
@@ -531,7 +531,7 @@ Replit now supports React Native/Expo with full backend and RevenueCat monetizat
|
|
|
531
531
|
When positioning Loki Mode against Replit and Lovable, emphasize:
|
|
532
532
|
|
|
533
533
|
1. **"No credit anxiety"** -- You pay your API provider directly. No surprise bills. No credits burned on AI mistakes.
|
|
534
|
-
2. **"Production quality, not prototype quality"** --
|
|
534
|
+
2. **"Production quality, not prototype quality"** -- 8 quality gates, 3-reviewer blind review, anti-sycophancy. Your code ships to production, not to a rewrite backlog.
|
|
535
535
|
3. **"No lock-in"** -- Your code. Your infrastructure. Your choice of AI provider. Export is not a feature -- it is the default.
|
|
536
536
|
4. **"Autonomous, not assistive"** -- Loki Mode does not wait for your next prompt. It plans, builds, tests, reviews, and deploys. You review the output, not babysit the process.
|
|
537
537
|
5. **"Works with your codebase"** -- Legacy systems, brownfield projects, enterprise code. Not just greenfield MVPs.
|
|
@@ -11,7 +11,7 @@
|
|
|
11
11
|
|-----------|--------|-----------|--------|
|
|
12
12
|
| **Proven Scale** | 1M+ LoC, large agent count | Benchmarks only | Cursor |
|
|
13
13
|
| **Research Foundation** | Empirical iteration | 25+ academic citations | Loki Mode |
|
|
14
|
-
| **Quality Assurance** | Workers self-manage |
|
|
14
|
+
| **Quality Assurance** | Workers self-manage | 8-gate system + anti-sycophancy | Loki Mode |
|
|
15
15
|
| **Anti-Sycophancy** | Not mentioned | CONSENSAGENT blind review | Loki Mode |
|
|
16
16
|
| **Velocity-Quality Balance** | Not mentioned | arXiv-backed metrics | Loki Mode |
|
|
17
17
|
| **Full SDLC Coverage** | Code generation focus | Spec (PRD/issue/YAML) to production + growth | Loki Mode |
|
|
@@ -57,7 +57,7 @@ velocity_quality_balance:
|
|
|
57
57
|
|
|
58
58
|
thresholds:
|
|
59
59
|
max_new_warnings: 0 # Zero tolerance
|
|
60
|
-
|
|
60
|
+
coverage_target: 80% # Target only; coverage % not measured this release
|
|
61
61
|
```
|
|
62
62
|
|
|
63
63
|
**Research Basis:** [arXiv 2511.04427v2](https://arxiv.org/abs/2511.04427) - Empirical study of 807 repositories
|
|
@@ -66,16 +66,19 @@ velocity_quality_balance:
|
|
|
66
66
|
|
|
67
67
|
---
|
|
68
68
|
|
|
69
|
-
### 3.
|
|
69
|
+
### 3. 8-Gate Quality System
|
|
70
70
|
|
|
71
71
|
**Loki Mode's Gates:**
|
|
72
|
-
1.
|
|
73
|
-
2.
|
|
74
|
-
3. Blind Review
|
|
75
|
-
4. Anti-Sycophancy
|
|
76
|
-
5.
|
|
77
|
-
6.
|
|
78
|
-
7.
|
|
72
|
+
1. Static Analysis - CodeQL, ESLint, type checking
|
|
73
|
+
2. Test Suite (pass/fail) - red blocks; coverage % not measured this release
|
|
74
|
+
3. Blind Code Review - 3 parallel reviewers + severity blocking (Critical/High = BLOCK; Medium/Low advisory)
|
|
75
|
+
4. Anti-Sycophancy / Devil's Advocate - on unanimous PASS
|
|
76
|
+
5. Mock Integrity Detector - HIGH blocks
|
|
77
|
+
6. Test Mutation Detector - HIGH blocks
|
|
78
|
+
7. Documentation Coverage
|
|
79
|
+
8. Magic Modules Debate - BLOCK severity
|
|
80
|
+
|
|
81
|
+
Conditional auditor (not numbered): backward-compatibility / legacy-healing-auditor (healing mode only).
|
|
79
82
|
|
|
80
83
|
**Cursor:** Removed dedicated quality roles. Quote: "Dedicated integrator roles created more bottlenecks than they solved."
|
|
81
84
|
|
|
@@ -174,7 +177,7 @@ Cursor learned through failure:
|
|
|
174
177
|
### 3. Simplicity Principle
|
|
175
178
|
> "A surprising amount of the system's behavior comes down to how we prompt the agents. The harness and models matter, but the prompts matter more."
|
|
176
179
|
|
|
177
|
-
**Loki Mode:** More elaborate infrastructure (
|
|
180
|
+
**Loki Mode:** More elaborate infrastructure (8 gates, 41 agent types, memory systems). May be over-engineered for some use cases.
|
|
178
181
|
|
|
179
182
|
---
|
|
180
183
|
|
|
@@ -192,7 +195,7 @@ We incorporated Cursor's proven patterns:
|
|
|
192
195
|
## Conclusion
|
|
193
196
|
|
|
194
197
|
**Loki Mode is scientifically better in:**
|
|
195
|
-
- Quality assurance (research-backed
|
|
198
|
+
- Quality assurance (research-backed 8-gate system)
|
|
196
199
|
- Anti-sycophancy (CONSENSAGENT blind review)
|
|
197
200
|
- Velocity-quality balance (arXiv metrics)
|
|
198
201
|
- Full SDLC coverage (spec to growth -- PRD, GitHub issue, or YAML)
|
package/docs/dashboard-guide.md
CHANGED
|
@@ -151,13 +151,15 @@ Progress bars for three memory types:
|
|
|
151
151
|
Shows count and visual progress bar for each.
|
|
152
152
|
|
|
153
153
|
#### Quality Gates
|
|
154
|
-
|
|
155
|
-
- **Static Analysis**: CodeQL/ESLint
|
|
156
|
-
- **
|
|
157
|
-
- **
|
|
158
|
-
- **
|
|
159
|
-
- **
|
|
160
|
-
- **
|
|
154
|
+
8 quality gates with status icons:
|
|
155
|
+
- **Static Analysis**: CodeQL/ESLint/type-checker findings on the diff
|
|
156
|
+
- **Test Suite**: Project test runner pass/fail (red blocks)
|
|
157
|
+
- **Blind Code Review**: 3-reviewer council with severity blocking (Critical/High block, Medium/Low advisory)
|
|
158
|
+
- **Anti-Sycophancy**: Devil's Advocate re-review on unanimous PASS
|
|
159
|
+
- **Mock Integrity**: Tautological-assertion and mock-ratio detection
|
|
160
|
+
- **Test Mutation**: Assertion-churn (test-fitting) detection
|
|
161
|
+
- **Documentation Coverage**: README presence, docs freshness, API docs
|
|
162
|
+
- **Magic Modules Debate**: Spec-vs-implementation debate on generated modules
|
|
161
163
|
|
|
162
164
|
Status icons:
|
|
163
165
|
- Checkmark (green): Passed
|
|
@@ -86,7 +86,7 @@ Three review loops identified these critical gaps in v1 of this PRD:
|
|
|
86
86
|
Tabbed panel below the editor (collapsible, resizable height):
|
|
87
87
|
- **Build Log:** Real-time loki output (WebSocket, already works on HomePage)
|
|
88
88
|
- **Agents:** Active agent cards with status (already built as AgentDashboard)
|
|
89
|
-
- **Quality Gates:**
|
|
89
|
+
- **Quality Gates:** 8-gate display (already built as QualityGatesPanel)
|
|
90
90
|
- **AI Chat:** NEW -- text input that sends prompts to iterate on the project
|
|
91
91
|
|
|
92
92
|
**2b. AI Chat (key differentiator)**
|
|
@@ -97,7 +97,7 @@ Loki Mode already has 75+ commands and 120+ API endpoints. The platform doesn't
|
|
|
97
97
|
- **Terminal tab:** Real-time loki session output (already streamed via WebSocket)
|
|
98
98
|
- **Agent Log tab:** Shows which agents are active, what they're working on (uses `/api/agents` and `/api/session/agents`)
|
|
99
99
|
- **Build Output tab:** Structured build phases -- RARV cycle visualization, iteration count, current phase
|
|
100
|
-
- **Quality Gates tab:**
|
|
100
|
+
- **Quality Gates tab:** 8-gate status display (uses existing checklist/quality endpoints)
|
|
101
101
|
- **AI Chat tab:** Send messages to iterate on the project ("fix the login page", "add dark mode") -- triggers `loki start` with the prompt as PRD amendment
|
|
102
102
|
|
|
103
103
|
**Header toolbar:**
|
|
@@ -182,12 +182,12 @@ This is the "Loki way" -- instead of just editing code, users can talk to the AI
|
|
|
182
182
|
|
|
183
183
|
### Quality Gates Panel
|
|
184
184
|
|
|
185
|
-
Shows the
|
|
185
|
+
Shows the Loki quality gates and checks in real-time:
|
|
186
186
|
1. Static Analysis (CodeQL/ESLint)
|
|
187
187
|
2. 3-Reviewer Blind Review
|
|
188
188
|
3. Anti-Sycophancy Check
|
|
189
189
|
4. Severity Blocking (Critical/High)
|
|
190
|
-
5. Test
|
|
190
|
+
5. Test Suite (pass/fail; coverage % not measured this release)
|
|
191
191
|
6. Security Scan (OWASP)
|
|
192
192
|
7. Performance Check
|
|
193
193
|
8. Mock Detector
|
package/docs/show-hn-post.md
CHANGED
|
@@ -2,7 +2,7 @@
|
|
|
2
2
|
|
|
3
3
|
## Title
|
|
4
4
|
|
|
5
|
-
Show HN: Loki Mode - PRD in, tested code out (41 agent roles,
|
|
5
|
+
Show HN: Loki Mode - PRD in, tested code out (41 agent roles, 8 quality gates, RARV self-verification)
|
|
6
6
|
|
|
7
7
|
## Body
|
|
8
8
|
|
|
@@ -40,7 +40,7 @@ Integrations: Jira, Slack, Teams, GitHub Actions.
|
|
|
40
40
|
|
|
41
41
|
## Feedback wanted
|
|
42
42
|
|
|
43
|
-
- Is the
|
|
43
|
+
- Is the 8-gate quality system overkill, or does it actually help for your use cases?
|
|
44
44
|
- How do you handle the tension between autonomous agent speed and code review thoroughness?
|
|
45
45
|
- What PRD complexity level breaks this approach? I have hit walls with highly coupled distributed systems.
|
|
46
46
|
|
package/loki-ts/dist/loki.js
CHANGED
|
@@ -1,5 +1,5 @@
|
|
|
1
1
|
// @bun
|
|
2
|
-
var n6=Object.defineProperty;var a6=($)=>$;function s6($,Q){this[$]=a6.bind(null,Q)}var h=($,Q)=>{for(var Z in Q)n6($,Z,{get:Q[Z],enumerable:!0,configurable:!0,set:s6.bind(Q,Z)})};var L=($,Q)=>()=>($&&(Q=$($=0)),Q);var K$=import.meta.require;var S1={};h(S1,{lokiDir:()=>P,homeLokiDir:()=>o$,findRepoRootForVersion:()=>d$,REPO_ROOT:()=>m});import{resolve as n,dirname as l$}from"path";import{fileURLToPath as t6}from"url";import{existsSync as P$}from"fs";import{homedir as r6}from"os";function i6(){let $=N1;for(let Q=0;Q<6;Q++){if(P$(n($,"VERSION"))&&P$(n($,"autonomy/run.sh")))return $;let Z=l$($);if(Z===$)break;$=Z}return n(N1,"..","..","..")}function d$($){let Q=$;for(let Z=0;Z<6;Z++){if(P$(n(Q,"VERSION"))&&P$(n(Q,"autonomy/run.sh")))return Q;let z=l$(Q);if(z===Q)break;Q=z}return n($,"..","..","..")}function P(){return process.env.LOKI_DIR??n(process.cwd(),".loki")}function o$(){return n(r6(),".loki")}var N1,m;var C=L(()=>{N1=l$(t6(import.meta.url));m=i6()});import{readFileSync as e6}from"fs";import{resolve as $Q,dirname as QQ}from"path";import{fileURLToPath as ZQ}from"url";function F$(){if($$!==null)return $$;let $="7.
|
|
2
|
+
var n6=Object.defineProperty;var a6=($)=>$;function s6($,Q){this[$]=a6.bind(null,Q)}var h=($,Q)=>{for(var Z in Q)n6($,Z,{get:Q[Z],enumerable:!0,configurable:!0,set:s6.bind(Q,Z)})};var L=($,Q)=>()=>($&&(Q=$($=0)),Q);var K$=import.meta.require;var S1={};h(S1,{lokiDir:()=>P,homeLokiDir:()=>o$,findRepoRootForVersion:()=>d$,REPO_ROOT:()=>m});import{resolve as n,dirname as l$}from"path";import{fileURLToPath as t6}from"url";import{existsSync as P$}from"fs";import{homedir as r6}from"os";function i6(){let $=N1;for(let Q=0;Q<6;Q++){if(P$(n($,"VERSION"))&&P$(n($,"autonomy/run.sh")))return $;let Z=l$($);if(Z===$)break;$=Z}return n(N1,"..","..","..")}function d$($){let Q=$;for(let Z=0;Z<6;Z++){if(P$(n(Q,"VERSION"))&&P$(n(Q,"autonomy/run.sh")))return Q;let z=l$(Q);if(z===Q)break;Q=z}return n($,"..","..","..")}function P(){return process.env.LOKI_DIR??n(process.cwd(),".loki")}function o$(){return n(r6(),".loki")}var N1,m;var C=L(()=>{N1=l$(t6(import.meta.url));m=i6()});import{readFileSync as e6}from"fs";import{resolve as $Q,dirname as QQ}from"path";import{fileURLToPath as ZQ}from"url";function F$(){if($$!==null)return $$;let $="7.46.0";if(typeof $==="string"&&$.length>0)return $$=$,$$;try{let Q=QQ(ZQ(import.meta.url)),Z=d$(Q);$$=e6($Q(Z,"VERSION"),"utf-8").trim()}catch{$$="unknown"}return $$}var $$=null;var n$=L(()=>{C()});var C1={};h(C1,{runOrThrow:()=>zQ,run:()=>j,commandVersion:()=>KQ,commandExists:()=>f,ShellError:()=>a$});async function j($,Q={}){let Z=Bun.spawn({cmd:[...$],stdout:"pipe",stderr:"pipe",env:Q.env?{...process.env,...Q.env}:process.env,cwd:Q.cwd}),z,X;if(Q.timeoutMs&&Q.timeoutMs>0)z=setTimeout(()=>{try{Z.kill("SIGTERM")}catch{}X=setTimeout(()=>{try{Z.kill("SIGKILL")}catch{}},2000)},Q.timeoutMs);try{let[W,K,U]=await Promise.all([new Response(Z.stdout).text(),new Response(Z.stderr).text(),Z.exited]);return{stdout:W,stderr:K,exitCode:U}}finally{if(z)clearTimeout(z);if(X)clearTimeout(X)}}async function zQ($,Q={}){let Z=await j($,Q);if(Z.exitCode!==0)throw new a$(`command failed (${Z.exitCode}): ${$.join(" ")}`,Z.exitCode,Z.stdout,Z.stderr);return Z}async function f($){let Q=XQ($),Z=await j(["sh","-c",`command -v ${Q}`],{timeoutMs:5000});if(Z.exitCode===0)return Z.stdout.trim()||null;return null}function XQ($){if(!/^[A-Za-z0-9._/-]+$/.test($))throw Error(`refused to shell-escape suspect token: ${$}`);return $}async function KQ($,Q="--version"){if(!await f($))return null;let z=await j([$,Q],{timeoutMs:5000});if(z.exitCode!==0)return null;return((z.stdout||z.stderr).split(/\r?\n/)[0]?.trim()??"")||null}var a$;var d=L(()=>{a$=class a$ extends Error{message;exitCode;stdout;stderr;constructor($,Q,Z,z){super($);this.message=$;this.exitCode=Q;this.stdout=Z;this.stderr=z;this.name="ShellError"}}});function a($){return WQ?"":$}var WQ,T,S,I,TZ,w,R,y,q;var c=L(()=>{WQ=(process.env.NO_COLOR??"").length>0;T=a("\x1B[0;31m"),S=a("\x1B[0;32m"),I=a("\x1B[1;33m"),TZ=a("\x1B[0;34m"),w=a("\x1B[0;36m"),R=a("\x1B[1m"),y=a("\x1B[2m"),q=a("\x1B[0m")});import{existsSync as TQ}from"fs";async function Q$(){if(B$!==void 0)return B$;let $="/opt/homebrew/bin/python3.12";if(TQ($))return B$=$,$;let Q=await f("python3.12");if(Q)return B$=Q,Q;let Z=await f("python3");return B$=Z,Z}async function Z$($,Q={}){let Z=await Q$();if(!Z)return{stdout:"",stderr:"python3 not found",exitCode:127};return j([Z,"-c",$],Q)}var B$;var W$=L(()=>{d()});var t1={};h(t1,{runStatus:()=>gQ});import{existsSync as v,readFileSync as U$,readdirSync as l1,statSync as d1}from"fs";import{resolve as D,basename as xQ}from"path";import{homedir as NQ}from"os";async function DQ(){if(await f("jq"))return!0;return process.stdout.write(`${T}Error: jq is required but not installed.${q}
|
|
3
3
|
`),process.stdout.write(`Install with:
|
|
4
4
|
`),process.stdout.write(` brew install jq (macOS)
|
|
5
5
|
`),process.stdout.write(` apt install jq (Debian/Ubuntu)
|
|
@@ -789,4 +789,4 @@ Set LOKI_LEGACY_BASH=1 to force the bash CLI for every command.
|
|
|
789
789
|
`),2}default:return process.stderr.write(`Unknown command: ${Q}
|
|
790
790
|
`),process.stderr.write(o6),2}}p1();process.on("SIGINT",()=>process.exit(130));process.on("SIGTERM",()=>process.exit(143));var ZZ=await QZ(Bun.argv.slice(2));process.exit(ZZ);
|
|
791
791
|
|
|
792
|
-
//# debugId=
|
|
792
|
+
//# debugId=7B01911F8947B6CD64756E2164756E21
|
package/mcp/__init__.py
CHANGED
package/package.json
CHANGED
|
@@ -1,8 +1,8 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "loki-mode",
|
|
3
3
|
"mcpName": "io.github.asklokesh/loki-mode",
|
|
4
|
-
"version": "7.
|
|
5
|
-
"description": "Loki Mode by Autonomi. Autonomous spec-to-product system: takes a PRD, GitHub issue, OpenAPI/JSON/YAML, or one-line brief to a deployed app via the RARV-C closure loop with
|
|
4
|
+
"version": "7.46.0",
|
|
5
|
+
"description": "Loki Mode by Autonomi. Autonomous spec-to-product system: takes a PRD, GitHub issue, OpenAPI/JSON/YAML, or one-line brief to a deployed app via the RARV-C closure loop with 8 quality gates. Provider-agnostic (Claude Code, OpenAI Codex, Cline, Aider).",
|
|
6
6
|
"keywords": [
|
|
7
7
|
"agent",
|
|
8
8
|
"agent-orchestration",
|
|
@@ -2,8 +2,8 @@
|
|
|
2
2
|
"$schema": "https://json.schemastore.org/claude-code-plugin-manifest.json",
|
|
3
3
|
"name": "loki-mode",
|
|
4
4
|
"displayName": "Loki Mode",
|
|
5
|
-
"version": "7.
|
|
6
|
-
"description": "Autonomous spec-to-product build system with a built-in trust layer (RARV-C closure loop,
|
|
5
|
+
"version": "7.46.0",
|
|
6
|
+
"description": "Autonomous spec-to-product build system with a built-in trust layer (RARV-C closure loop, 8 quality gates, completion council). Ships Loki's spec-hardening, drift-detection, and deterministic PR verification commands plus the Loki MCP server.",
|
|
7
7
|
"author": {
|
|
8
8
|
"name": "Autonomi",
|
|
9
9
|
"url": "https://www.autonomi.dev/"
|
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
# Loki Mode plugin for Claude Code
|
|
2
2
|
|
|
3
3
|
Loki Mode is the autonomous spec-to-product build system with a built-in trust
|
|
4
|
-
layer (RARV-C closure loop,
|
|
4
|
+
layer (RARV-C closure loop, 8 quality gates, completion council). This plugin
|
|
5
5
|
brings Loki's spec-hardening, drift-detection, and deterministic PR verification
|
|
6
6
|
into Claude Code as slash commands, and wires up the Loki MCP server.
|
|
7
7
|
|
|
@@ -84,4 +84,4 @@ PRD says: "Add a login form with email, password, and submit button."
|
|
|
84
84
|
- `skills/magic-modules.md` -- skill module for agents
|
|
85
85
|
- `references/magic-modules-patterns.md` -- full API and pattern reference
|
|
86
86
|
- `references/memory-system.md` -- memory engine details
|
|
87
|
-
- `skills/quality-gates.md` -- all
|
|
87
|
+
- `skills/quality-gates.md` -- all 8 deterministic quality gates documented
|
|
@@ -240,15 +240,15 @@ This diversity prevents groupthink and catches more issues.
|
|
|
240
240
|
|----------|--------|-----------|
|
|
241
241
|
| **Critical** | BLOCK - Fix immediately | NO |
|
|
242
242
|
| **High** | BLOCK - Fix immediately | NO |
|
|
243
|
-
| **Medium** |
|
|
243
|
+
| **Medium** | Advisory - Add `// TODO(review): ...` comment | YES |
|
|
244
244
|
| **Low** | Add `// TODO(review): ...` comment | YES |
|
|
245
245
|
| **Cosmetic** | Add `// FIXME(nitpick): ...` comment | YES |
|
|
246
246
|
|
|
247
|
-
**Critical/High
|
|
248
|
-
**Low/Cosmetic = Add TODO/FIXME comment, continue**
|
|
247
|
+
**Critical/High = BLOCK and fix before proceeding**
|
|
248
|
+
**Medium/Low/Cosmetic = Add TODO/FIXME comment, continue (advisory)**
|
|
249
249
|
|
|
250
250
|
### 4. Test Coverage Gates
|
|
251
|
-
- Unit tests: 100% pass
|
|
251
|
+
- Unit tests: 100% pass (coverage % not measured in this release)
|
|
252
252
|
- Integration tests: 100% pass
|
|
253
253
|
- E2E tests: critical flows pass
|
|
254
254
|
|
|
@@ -445,7 +445,7 @@ Quality gates are enforced by `autonomy/CONSTITUTION.md`:
|
|
|
445
445
|
**Pre-Commit (BLOCKING):**
|
|
446
446
|
- Linting (auto-fix enabled)
|
|
447
447
|
- Type checking (strict mode)
|
|
448
|
-
- Contract tests (
|
|
448
|
+
- Contract tests (coverage % not enforced as a gate)
|
|
449
449
|
- Spec validation (Spectral)
|
|
450
450
|
|
|
451
451
|
**Post-Implementation (AUTO-FIX):**
|
package/skills/00-index.md
CHANGED
|
@@ -48,7 +48,7 @@
|
|
|
48
48
|
|
|
49
49
|
### quality-gates.md
|
|
50
50
|
**When:** Code review, pre-commit checks, quality assurance
|
|
51
|
-
-
|
|
51
|
+
- 8-gate quality system (gate 7: documentation coverage, v6.75.0; backward compatibility is a conditional healing-mode auditor, not numbered)
|
|
52
52
|
- Blind review + anti-sycophancy
|
|
53
53
|
- Velocity-quality feedback loop (arXiv research)
|
|
54
54
|
- Mandatory quality checks per task
|