@mlbottleneck/engine 0.4.1 → 0.5.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/README.md CHANGED
@@ -78,6 +78,10 @@ const { ceiling } = engine.predict({ model: 'qwen3.6_35b_a3b', hardware: 'AMD St
78
78
  expectedTokensPerSecond, // engine rate x peer correction (stock software)
79
79
  engineTokensPerSecond, correctionFactor, confidence, peers, verifiedPeers },
80
80
  memory: { modelSizeGB, residentWeightsGB, kvCacheGB, availableGB },
81
+ measured: { nearest, // closest stock measurement on this model + hardware template (community gold run or lab stock row), or null
82
+ labTuned }, // closest tuned neural.download lab run on the same machine (same template and device count), or null
83
+ // each: { tokensPerSecond (per request), aggregateTokensPerSecond, concurrency, origin: 'community'|'lab', stack,
84
+ // model, hardware, deviceCount, runtime, quantization, depthTokens, speculation, sameSetup, url, note }
81
85
  bottleneck: 'memory' | 'compute' | 'runtime' | 'coordination' | ..., // devices[].coreBinding adds 'attention' for deep contexts
82
86
  power: { watts, tdpWatts, costPerDay, costPer1KTokens },
83
87
  devices: [{ name, template, residentWeightGB, kvCacheGB, hasOverflow, overflowMode,
@@ -88,7 +92,9 @@ const { ceiling } = engine.predict({ model: 'qwen3.6_35b_a3b', hardware: 'AMD St
88
92
  }
89
93
  ```
90
94
 
91
- Numbers are *planning estimates*: the engine is calibrated so that the median community run lands on its prediction and ~85% land within 1.5×. Show users the ceiling ladder (`physical` → `optimized` → `expected`) rather than a single number when you can.
95
+ Numbers are *planning estimates*: the engine is calibrated so that the median community run lands on its prediction and ~85% land within 1.5×. Show users the ceiling ladder (`physical` → `optimized` → `expected`) rather than a single number when you can, and `measured.nearest` / `measured.labTuned` beside it when they exist — they are real runs, with links.
96
+
97
+ The evidence snapshot carries two collections: `goldCases` (community runs, the calibration corpus) and `labCases` (the author's [neural.download](https://neural.download/) Intel Arc Pro lab: `stock`, `lab-baseline`, and `tuned` rows). Lab rows never calibrate the engine; they only surface as measured references.
92
98
 
93
99
  ## Other methods
94
100