@amityco/social-plus-vise 1.4.2 → 1.4.3

package/CHANGELOG.md

@@ -8,6 +8,15 @@ The format is loosely based on [Keep a Changelog](https://keepachangelog.com/en/
 
 No changes yet.
 
+## 1.4.3 — 2026-07-02
+
+### Changed
+- **Current scorecard now has React Native and Flutter controls.** The retained real-E2E summary and npm README now include fresh no-Vise controls for React Native and Flutter beside the current Vise rows, bringing the cross-platform head-to-head average to **91.8 vs 48.0** (+43.8 points).
+- **Scoring methodology is now documented.** Added the real-E2E scoring methodology, including dimensions, weights, caps, aggregation rules, and the claim boundary for current-loop vs formal public benchmark results.
+
+### Fixed
+- **Cross-platform quota detection is stricter.** The benchmark harness no longer treats generic SDK docs text about a visitor "usage limit" as Codex quota exhaustion; it now looks for the actual "hit your usage limit" signal.
+
 ## 1.4.2 — 2026-07-02
 
 ### Changed

package/README.md

@@ -148,17 +148,12 @@ Vise's measured effect is on whether an agent builds the *whole* outcome: runtim
 | **Android** | market-pulse | **94.3** | 31.2 | **+63.1** | 9/9 |
 | **iOS** | luminary-club | **90.1** | 43.0 | **+47.1** | 9/9 |
 | **Web** | pulse-studio | **91.4** | 65.6 | **+25.8** | 8/9 |
+| **Flutter** | fieldhouse-club | **92.8** | 33.0 | **+59.8** | launched, 28 screenshots |
+| **React Native** | arena-fit | **90.3** | 67.3 | **+23.0** | launched, 16 screenshots |
 
-Average Vise score: **91.9**. Average no-Vise score: **46.6**. Average lift: **+45.3 points**.
+Average Vise score: **91.8**. Average no-Vise score: **48.0**. Average lift: **+43.8 points**.
 
-Rows with a no-Vise control are included in the lift average above. Flutter and React Native also have current hardened-harness Vise rows, but the matching no-Vise controls have not been rerun on the same harness yet, so they are shown as Vise-only native readiness evidence:
-
-| Platform | Scenario | Vise overall | Capability activation | Product outcome | Design integration | Correctness | Runtime proof |
-|---|---|---:|---:|---:|---:|---:|---|
-| **Flutter** | fieldhouse-club | **92.8** | 91.7 | 93.8 | 90.9 | 100.0 | launched, 28 screenshots, 0 console errors |
-| **React Native** | arena-fit | **90.3** | 83.3 | 93.8 | 90.9 | 100.0 | launched, 16 screenshots, 0 console errors |
-
-The scorecard is retained in [`benchmarks/real-e2e/RESULTS.md`](benchmarks/real-e2e/RESULTS.md). It measures capability activation, product outcome, design integration, correctness, efficiency, and runtime evidence. The remaining Web gap was chat runtime proof; community, feed, composer, comment preview, reactions, profile/follow, moderation, and SDK runtime proof were present. Flutter and React Native are excluded from the head-to-head lift until their no-Vise controls are rerun on the current harness.
+The scorecard is retained in [`benchmarks/real-e2e/RESULTS.md`](benchmarks/real-e2e/RESULTS.md), with weights and caps documented in [`benchmarks/real-e2e/SCORING_METHODOLOGY.md`](benchmarks/real-e2e/SCORING_METHODOLOGY.md). It measures capability activation, product outcome, design integration, correctness, efficiency, and runtime evidence. The remaining Web gap was chat runtime proof; community, feed, composer, comment preview, reactions, profile/follow, moderation, and SDK runtime proof were present in the Vise arms. The Flutter no-Vise control is a valid bad outcome: the agent deleted `lib/main.dart`, left the entry point missing, and the watchdog stopped the sample before runtime launch.
 
 What changed in the winning Vise arms:
 
@@ -168,7 +163,7 @@ What changed in the winning Vise arms:
 - Native scoring recognizes real Android/iOS SDK setup and login patterns, not only surface-level type declarations.
 - Generated artifacts are filtered during secret checks so benchmark evidence does not pollute product scoring.
 
-**Boundaries:** these are social.plus's own measurements, not a third-party audit. The scorecard is a current-loop result, not a same-minute paired A/B rerun: the Vise column uses final post-improvement runs, while the no-Vise column uses the best available controls from earlier benchmark cells. For a formal public benchmark, rerun both arms from clean fixtures under a frozen protocol and score them with the same scorer version. Older Flutter/React Native paired rows exist from 2026-06-29 (Flutter 55.0 vs 47.1, React Native 51.2 vs 40.4), but both were capped by incomplete runtime proof and are not used as current lift claims. Older README benchmark figures were removed because they came from earlier builds and older protocols.
+**Boundaries:** these are social.plus's own measurements, not a third-party audit. The scorecard is a current-loop result, not a same-minute paired A/B rerun: the Vise column uses final post-improvement runs, while the no-Vise column uses the best available controls for the same platform families, including fresh React Native and Flutter controls from 2026-07-02. For a formal public benchmark, rerun both arms from clean fixtures under a frozen protocol and score them with the same scorer version. Older Flutter/React Native paired rows from 2026-06-29 are superseded because both were capped by incomplete runtime proof. Older README benchmark figures were removed because they came from earlier builds and older protocols.
 
 <sub>Cursor, Claude, Codex, GitHub Copilot, VS Code, and other product names are trademarks of their respective owners; social.plus is not affiliated with or endorsed by them. Benchmark figures are from social.plus's own measurements.</sub>
 

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@amityco/social-plus-vise",
-  "version": "1.4.2",
+  "version": "1.4.3",
   "description": "Skill-guided deterministic CLI for social.plus SDK integration assistance.",
   "license": "SEE LICENSE IN LICENSE",
   "type": "module",