@amityco/social-plus-vise 1.4.1 → 1.4.3

package/CHANGELOG.md

@@ -8,6 +8,21 @@ The format is loosely based on [Keep a Changelog](https://keepachangelog.com/en/
 
 No changes yet.
 
+## 1.4.3 — 2026-07-02
+
+### Changed
+- **Current scorecard now has React Native and Flutter controls.** The retained real-E2E summary and npm README now include fresh no-Vise controls for React Native and Flutter beside the current Vise rows, bringing the cross-platform head-to-head average to **91.8 vs 48.0** (+43.8 points).
+- **Scoring methodology is now documented.** Added the real-E2E scoring methodology, including dimensions, weights, caps, aggregation rules, and the claim boundary for current-loop vs formal public benchmark results.
+
+### Fixed
+- **Cross-platform quota detection is stricter.** The benchmark harness no longer treats generic SDK docs text about a visitor "usage limit" as Codex quota exhaustion; it now looks for the actual "hit your usage limit" signal.
+
+## 1.4.2 — 2026-07-02
+
+### Changed
+- **README scorecard now includes the current Flutter and React Native rows.** The npm README and retained real-E2E results now show Flutter `fieldhouse-club` (**92.8**) and React Native `arena-fit` (**90.3**) as current Vise-arm-only native readiness evidence, with runtime-launch/screenshot proof and no console errors.
+- **Head-to-head benchmark boundary tightened.** The Android/iOS/Web Vise-vs-no-Vise average remains **91.9 vs 46.6** (+45.3 points), while Flutter and React Native are explicitly excluded from that lift until their no-Vise controls are rerun on the hardened harness.
+
 ## 1.4.1 — 2026-07-02
 
 ### Changed

package/README.md

@@ -148,10 +148,12 @@ Vise's measured effect is on whether an agent builds the *whole* outcome: runtim
 | **Android** | market-pulse | **94.3** | 31.2 | **+63.1** | 9/9 |
 | **iOS** | luminary-club | **90.1** | 43.0 | **+47.1** | 9/9 |
 | **Web** | pulse-studio | **91.4** | 65.6 | **+25.8** | 8/9 |
+| **Flutter** | fieldhouse-club | **92.8** | 33.0 | **+59.8** | launched, 28 screenshots |
+| **React Native** | arena-fit | **90.3** | 67.3 | **+23.0** | launched, 16 screenshots |
 
-Average Vise score: **91.9**. Average no-Vise score: **46.6**. Average lift: **+45.3 points**.
+Average Vise score: **91.8**. Average no-Vise score: **48.0**. Average lift: **+43.8 points**.
 
-The scorecard is retained in [`benchmarks/real-e2e/RESULTS.md`](benchmarks/real-e2e/RESULTS.md). It measures capability activation, product outcome, design integration, correctness, efficiency, and runtime evidence. The remaining Web gap was chat runtime proof; community, feed, composer, comment preview, reactions, profile/follow, moderation, and SDK runtime proof were present.
+The scorecard is retained in [`benchmarks/real-e2e/RESULTS.md`](benchmarks/real-e2e/RESULTS.md), with weights and caps documented in [`benchmarks/real-e2e/SCORING_METHODOLOGY.md`](benchmarks/real-e2e/SCORING_METHODOLOGY.md). It measures capability activation, product outcome, design integration, correctness, efficiency, and runtime evidence. The remaining Web gap was chat runtime proof; community, feed, composer, comment preview, reactions, profile/follow, moderation, and SDK runtime proof were present in the Vise arms. The Flutter no-Vise control is a valid bad outcome: the agent deleted `lib/main.dart`, left the entry point missing, and the watchdog stopped the sample before runtime launch.
 
 What changed in the winning Vise arms:
 
@@ -161,7 +163,7 @@ What changed in the winning Vise arms:
 - Native scoring recognizes real Android/iOS SDK setup and login patterns, not only surface-level type declarations.
 - Generated artifacts are filtered during secret checks so benchmark evidence does not pollute product scoring.
 
-**Boundaries:** these are social.plus's own measurements, not a third-party audit. The scorecard is a current-loop result, not a same-minute paired A/B rerun: the Vise column uses final post-improvement runs, while the no-Vise column uses the best available controls from earlier benchmark cells. For a formal public benchmark, rerun both arms from clean fixtures under a frozen protocol and score them with the same scorer version. Older README benchmark figures were removed because they came from earlier builds and older protocols.
+**Boundaries:** these are social.plus's own measurements, not a third-party audit. The scorecard is a current-loop result, not a same-minute paired A/B rerun: the Vise column uses final post-improvement runs, while the no-Vise column uses the best available controls for the same platform families, including fresh React Native and Flutter controls from 2026-07-02. For a formal public benchmark, rerun both arms from clean fixtures under a frozen protocol and score them with the same scorer version. Older Flutter/React Native paired rows from 2026-06-29 are superseded because both were capped by incomplete runtime proof. Older README benchmark figures were removed because they came from earlier builds and older protocols.
 
 <sub>Cursor, Claude, Codex, GitHub Copilot, VS Code, and other product names are trademarks of their respective owners; social.plus is not affiliated with or endorsed by them. Benchmark figures are from social.plus's own measurements.</sub>
 

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@amityco/social-plus-vise",
-  "version": "1.4.1",
+  "version": "1.4.3",
   "description": "Skill-guided deterministic CLI for social.plus SDK integration assistance.",
   "license": "SEE LICENSE IN LICENSE",
   "type": "module",