sigmap 8.7.0 → 8.7.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +10 -0
- package/README.md +7 -7
- package/gen-context.js +6 -5
- package/llms-full.txt +4 -4
- package/llms.txt +4 -4
- package/package.json +1 -1
- package/packages/cli/package.json +1 -1
- package/packages/core/package.json +1 -1
- package/src/mcp/server.js +1 -1
- package/src/tracking/pricing.js +4 -3
package/CHANGELOG.md
CHANGED
|
@@ -10,6 +10,16 @@ Format: [Semantic Versioning](https://semver.org/)
|
|
|
10
10
|
|
|
11
11
|
---
|
|
12
12
|
|
|
13
|
+
## [8.7.1] — 2026-07-05
|
|
14
|
+
|
|
15
|
+
Patch release — **multi-model cost savings + verified pricing.** The quality benchmark reported API input-cost savings for GPT-4o only; it now reports GPT-4o, Claude Sonnet, and Claude Haiku, and the hardcoded Claude rates were corrected to current published pricing.
|
|
16
|
+
|
|
17
|
+
### Changed
|
|
18
|
+
- **Multi-model cost savings (#433, PR #434):** `scripts/run-quality-benchmark.mjs` adds Claude Haiku to the pricing model and emits a per-model "cost savings by model" table (GPT-4o · Claude Sonnet · Claude Haiku). `docs-vp/guide/quality-benchmark.md` now shows all three models in the cost table, headline, and frontmatter. Pricing verified 2026-07 (per 1M input tokens): GPT-4o $2.50, Claude Sonnet 5/4.6 $3.00, Claude Haiku 4.5 $1.00.
|
|
19
|
+
|
|
20
|
+
### Fixed
|
|
21
|
+
- **Stale Claude pricing (#433, PR #434):** `src/tracking/pricing.js` (the `sigmap gain` dashboard's cost assumptions) corrected to current published rates — Claude Haiku $0.80→$1.00 and Claude Opus $15.00→$5.00 (Opus 4.8). GPT-4o ($2.50) and Sonnet ($3.00) were already correct.
|
|
22
|
+
|
|
13
23
|
## [8.7.0] — 2026-07-05
|
|
14
24
|
|
|
15
25
|
Minor release — **method/caller-level call-graph (D4 v1): the graph goes from files to functions.** SigMap's dependency graph was file-level only (imports → `--impact`/`get_impact`). This adds **symbol-level** edges — *which function calls which function* — and the **method-level blast radius** of changing a single symbol. Deterministic, zero-dependency, JS/TS + Python. This is the plan's single hardest unbuilt gap and the biggest remaining lever on graph intelligence (v9.5 GR1).
|
package/README.md
CHANGED
|
@@ -57,10 +57,10 @@ That map is exactly what agentic grep is worst at: reproducible, auditable conte
|
|
|
57
57
|
|
|
58
58
|
**Proof it pays off** (full benchmark below):
|
|
59
59
|
<!--SM:whyMetrics-->
|
|
60
|
-
- **
|
|
60
|
+
- **86.7% hit@5** — right file found in top 5 results (vs 13.6% baseline)
|
|
61
61
|
- **97.0% token reduction** — average across 21 real repos
|
|
62
|
-
- **
|
|
63
|
-
- **1.
|
|
62
|
+
- **67.8% task success rate** — up from 10% without context
|
|
63
|
+
- **1.46 prompts per task** — down from 2.84 (48.8% fewer retries)
|
|
64
64
|
<!--/SM:whyMetrics-->
|
|
65
65
|
- **<!--SM:languages-->33<!--/SM:languages--> languages supported** — TypeScript, Python, Go, Rust, Java, R, and more
|
|
66
66
|
- **No vendor lock-in** — works with any AI assistant or local LLM
|
|
@@ -96,7 +96,7 @@ sigmap verify answer.md --report # standalone red/amber/green HTML report
|
|
|
96
96
|
| Without SigMap | With SigMap |
|
|
97
97
|
|---|---|
|
|
98
98
|
| ❌ Non-reproducible agent guesses | ✅ Deterministic map — same input, same output, every time |
|
|
99
|
-
| ❌ "Trust me" AI answers | ✅ Grounded — right file in context <!--SM:hitWhole-->
|
|
99
|
+
| ❌ "Trust me" AI answers | ✅ Grounded — right file in context <!--SM:hitWhole-->87%<!--/SM:hitWhole--> of the time, every symbol on a real line anchor |
|
|
100
100
|
| ❌ Embeddings / vector DB required | ✅ Zero deps, no infra, fully offline |
|
|
101
101
|
|
|
102
102
|
---
|
|
@@ -123,10 +123,10 @@ Ask → Rank → Context → Validate → Judge → Learn
|
|
|
123
123
|
Benchmark : sigmap-v8.7-main (21 repositories, including R language)
|
|
124
124
|
Date : 2026-07-05
|
|
125
125
|
|
|
126
|
-
Hit@5 :
|
|
126
|
+
Hit@5 : 86.7% (baseline 13.6% — 6.4× lift)
|
|
127
127
|
Token reduction: 97.0% (across 21 repos)
|
|
128
|
-
Prompt reduction :
|
|
129
|
-
Task success :
|
|
128
|
+
Prompt reduction : 48.8% (2.84 → 1.46 prompts per task)
|
|
129
|
+
Task success : 67.8% (baseline 10%)
|
|
130
130
|
Repos tested : 21 (JavaScript, Python, Go, Rust, Java, R, C++, C#, Dart, Swift, Ruby, PHP, Scala, Kotlin, and more)
|
|
131
131
|
```
|
|
132
132
|
<!--/SM:benchmarkBlock-->
|
package/gen-context.js
CHANGED
|
@@ -13516,7 +13516,7 @@ __factories["./src/mcp/server"] = function(module, exports) {
|
|
|
13516
13516
|
|
|
13517
13517
|
const SERVER_INFO = {
|
|
13518
13518
|
name: 'sigmap',
|
|
13519
|
-
version: '8.7.
|
|
13519
|
+
version: '8.7.1',
|
|
13520
13520
|
description: 'SigMap MCP server — code signatures on demand',
|
|
13521
13521
|
};
|
|
13522
13522
|
|
|
@@ -16851,11 +16851,12 @@ __factories["./src/tracking/pricing"] = function(module, exports) {
|
|
|
16851
16851
|
* presented as exact. Zero npm dependencies.
|
|
16852
16852
|
*/
|
|
16853
16853
|
|
|
16854
|
-
// USD per 1,000,000 input tokens.
|
|
16854
|
+
// USD per 1,000,000 input tokens. Claude rates verified 2026-07 against
|
|
16855
|
+
// platform.claude.com (Opus 4.8 $5, Sonnet 5/4.6 $3, Haiku 4.5 $1); GPT-4o $2.50.
|
|
16855
16856
|
const PRICES = {
|
|
16856
16857
|
'claude-sonnet': 3.0,
|
|
16857
|
-
'claude-opus':
|
|
16858
|
-
'claude-haiku': 0
|
|
16858
|
+
'claude-opus': 5.0,
|
|
16859
|
+
'claude-haiku': 1.0,
|
|
16859
16860
|
'gpt-4o': 2.5,
|
|
16860
16861
|
'gpt-4o-mini': 0.15,
|
|
16861
16862
|
'gemini-1.5-pro': 1.25,
|
|
@@ -18084,7 +18085,7 @@ function __tryGit(args, opts = {}) {
|
|
|
18084
18085
|
catch (_) { return ''; }
|
|
18085
18086
|
}
|
|
18086
18087
|
|
|
18087
|
-
const VERSION = '8.7.
|
|
18088
|
+
const VERSION = '8.7.1';
|
|
18088
18089
|
const MARKER = '\n\n## Auto-generated signatures\n<!-- Updated by gen-context.js -->\n';
|
|
18089
18090
|
|
|
18090
18091
|
function requireSourceOrBundled(key) {
|
package/llms-full.txt
CHANGED
|
@@ -11,7 +11,7 @@ ranking keeps the relevant context in scope (cutting tokens ~97% as a side
|
|
|
11
11
|
effect), with no LLM calls, embeddings, or vector database. Works with Claude,
|
|
12
12
|
Cursor, GitHub Copilot, Aider, Windsurf, local LLMs, and MCP.
|
|
13
13
|
|
|
14
|
-
# Version: 8.7.
|
|
14
|
+
# Version: 8.7.1 | Benchmark: sigmap-v8.7-main (2026-07-05)
|
|
15
15
|
# Source: auto-generated from package.json, version.json, benchmarks/latest.json, src/mcp/tools.js, src/config/defaults.js
|
|
16
16
|
# Regenerate: npm run generate:llms | Validate: npm run validate:llms
|
|
17
17
|
|
|
@@ -21,10 +21,10 @@ Cursor, GitHub Copilot, Aider, Windsurf, local LLMs, and MCP.
|
|
|
21
21
|
|
|
22
22
|
| Metric | Without SigMap | With SigMap |
|
|
23
23
|
|--------|----------------|-------------|
|
|
24
|
-
| Retrieval hit@5 | 13.6% (random) |
|
|
24
|
+
| Retrieval hit@5 | 13.6% (random) | 86.7% (6.4× lift) |
|
|
25
25
|
| Token reduction | — | 97.0% average |
|
|
26
|
-
| Task success proxy | 10% |
|
|
27
|
-
| Prompts per task | 2.84 | 1.
|
|
26
|
+
| Task success proxy | 10% | 67.8% |
|
|
27
|
+
| Prompts per task | 2.84 | 1.46 (48.8% fewer) |
|
|
28
28
|
| Supported languages | — | 33 |
|
|
29
29
|
| MCP tools | — | 18 |
|
|
30
30
|
| npm runtime dependencies | — | 0 |
|
package/llms.txt
CHANGED
|
@@ -11,7 +11,7 @@ ranking keeps the relevant context in scope (cutting tokens ~97% as a side
|
|
|
11
11
|
effect), with no LLM calls, embeddings, or vector database. Works with Claude,
|
|
12
12
|
Cursor, GitHub Copilot, Aider, Windsurf, local LLMs, and MCP.
|
|
13
13
|
|
|
14
|
-
# Version: 8.7.
|
|
14
|
+
# Version: 8.7.1 | Benchmark: sigmap-v8.7-main (2026-07-05)
|
|
15
15
|
# Source: auto-generated from package.json, version.json, benchmarks/latest.json, src/mcp/tools.js, src/config/defaults.js
|
|
16
16
|
# Regenerate: npm run generate:llms | Validate: npm run validate:llms
|
|
17
17
|
|
|
@@ -25,10 +25,10 @@ Cursor, GitHub Copilot, Aider, Windsurf, local LLMs, and MCP.
|
|
|
25
25
|
|
|
26
26
|
## Core metrics (benchmark: sigmap-v8.7-main, 2026-07-05)
|
|
27
27
|
|
|
28
|
-
- hit@5 retrieval:
|
|
28
|
+
- hit@5 retrieval: 86.7% vs 13.6% random baseline (6.4× lift)
|
|
29
29
|
- Token reduction: 97.0% average across benchmark repos
|
|
30
|
-
- Task success:
|
|
31
|
-
- Prompts per task: 1.
|
|
30
|
+
- Task success: 67.8% vs 10% without SigMap
|
|
31
|
+
- Prompts per task: 1.46 vs 2.84 baseline (48.8% fewer)
|
|
32
32
|
- Languages: 33 supported · MCP tools: 18
|
|
33
33
|
- Dependencies: zero npm runtime dependencies · fully offline
|
|
34
34
|
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "sigmap",
|
|
3
|
-
"version": "8.7.
|
|
3
|
+
"version": "8.7.1",
|
|
4
4
|
"description": "97% token reduction for AI coding. Extracts function & class signatures with TF-IDF ranking to feed only the right files to Claude, Cursor, Copilot, Aider, Windsurf, local LLMs & MCP. Zero dependencies, runs offline via npx.",
|
|
5
5
|
"main": "packages/core/index.js",
|
|
6
6
|
"exports": {
|
package/src/mcp/server.js
CHANGED
package/src/tracking/pricing.js
CHANGED
|
@@ -10,11 +10,12 @@
|
|
|
10
10
|
* presented as exact. Zero npm dependencies.
|
|
11
11
|
*/
|
|
12
12
|
|
|
13
|
-
// USD per 1,000,000 input tokens.
|
|
13
|
+
// USD per 1,000,000 input tokens. Claude rates verified 2026-07 against
|
|
14
|
+
// platform.claude.com (Opus 4.8 $5, Sonnet 5/4.6 $3, Haiku 4.5 $1); GPT-4o $2.50.
|
|
14
15
|
const PRICES = {
|
|
15
16
|
'claude-sonnet': 3.0,
|
|
16
|
-
'claude-opus':
|
|
17
|
-
'claude-haiku': 0
|
|
17
|
+
'claude-opus': 5.0,
|
|
18
|
+
'claude-haiku': 1.0,
|
|
18
19
|
'gpt-4o': 2.5,
|
|
19
20
|
'gpt-4o-mini': 0.15,
|
|
20
21
|
'gemini-1.5-pro': 1.25,
|