@amityco/social-plus-vise 1.4.1 → 1.4.2
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +6 -0
- package/README.md +9 -2
- package/package.json +1 -1
package/CHANGELOG.md
CHANGED
|
@@ -8,6 +8,12 @@ The format is loosely based on [Keep a Changelog](https://keepachangelog.com/en/
|
|
|
8
8
|
|
|
9
9
|
No changes yet.
|
|
10
10
|
|
|
11
|
+
## 1.4.2 — 2026-07-02
|
|
12
|
+
|
|
13
|
+
### Changed
|
|
14
|
+
- **README scorecard now includes the current Flutter and React Native rows.** The npm README and retained real-E2E results now show Flutter `fieldhouse-club` (**92.8**) and React Native `arena-fit` (**90.3**) as current Vise-arm-only native readiness evidence, with runtime-launch/screenshot proof and no console errors.
|
|
15
|
+
- **Head-to-head benchmark boundary tightened.** The Android/iOS/Web Vise-vs-no-Vise average remains **91.9 vs 46.6** (+45.3 points), while Flutter and React Native are explicitly excluded from that lift until their no-Vise controls are rerun on the hardened harness.
|
|
16
|
+
|
|
11
17
|
## 1.4.1 — 2026-07-02
|
|
12
18
|
|
|
13
19
|
### Changed
|
package/README.md
CHANGED
|
@@ -151,7 +151,14 @@ Vise's measured effect is on whether an agent builds the *whole* outcome: runtim
|
|
|
151
151
|
|
|
152
152
|
Average Vise score: **91.9**. Average no-Vise score: **46.6**. Average lift: **+45.3 points**.
|
|
153
153
|
|
|
154
|
-
|
|
154
|
+
Rows with a no-Vise control are included in the lift average above. Flutter and React Native also have current hardened-harness Vise rows, but the matching no-Vise controls have not been rerun on the same harness yet, so they are shown as Vise-only native readiness evidence:
|
|
155
|
+
|
|
156
|
+
| Platform | Scenario | Vise overall | Capability activation | Product outcome | Design integration | Correctness | Runtime proof |
|
|
157
|
+
|---|---|---:|---:|---:|---:|---:|---|
|
|
158
|
+
| **Flutter** | fieldhouse-club | **92.8** | 91.7 | 93.8 | 90.9 | 100.0 | launched, 28 screenshots, 0 console errors |
|
|
159
|
+
| **React Native** | arena-fit | **90.3** | 83.3 | 93.8 | 90.9 | 100.0 | launched, 16 screenshots, 0 console errors |
|
|
160
|
+
|
|
161
|
+
The scorecard is retained in [`benchmarks/real-e2e/RESULTS.md`](benchmarks/real-e2e/RESULTS.md). It measures capability activation, product outcome, design integration, correctness, efficiency, and runtime evidence. The remaining Web gap was chat runtime proof; community, feed, composer, comment preview, reactions, profile/follow, moderation, and SDK runtime proof were present. Flutter and React Native are excluded from the head-to-head lift until their no-Vise controls are rerun on the current harness.
|
|
155
162
|
|
|
156
163
|
What changed in the winning Vise arms:
|
|
157
164
|
|
|
@@ -161,7 +168,7 @@ What changed in the winning Vise arms:
|
|
|
161
168
|
- Native scoring recognizes real Android/iOS SDK setup and login patterns, not only surface-level type declarations.
|
|
162
169
|
- Generated artifacts are filtered during secret checks so benchmark evidence does not pollute product scoring.
|
|
163
170
|
|
|
164
|
-
**Boundaries:** these are social.plus's own measurements, not a third-party audit. The scorecard is a current-loop result, not a same-minute paired A/B rerun: the Vise column uses final post-improvement runs, while the no-Vise column uses the best available controls from earlier benchmark cells. For a formal public benchmark, rerun both arms from clean fixtures under a frozen protocol and score them with the same scorer version. Older README benchmark figures were removed because they came from earlier builds and older protocols.
|
|
171
|
+
**Boundaries:** these are social.plus's own measurements, not a third-party audit. The scorecard is a current-loop result, not a same-minute paired A/B rerun: the Vise column uses final post-improvement runs, while the no-Vise column uses the best available controls from earlier benchmark cells. For a formal public benchmark, rerun both arms from clean fixtures under a frozen protocol and score them with the same scorer version. Older Flutter/React Native paired rows exist from 2026-06-29 (Flutter 55.0 vs 47.1, React Native 51.2 vs 40.4), but both were capped by incomplete runtime proof and are not used as current lift claims. Older README benchmark figures were removed because they came from earlier builds and older protocols.
|
|
165
172
|
|
|
166
173
|
<sub>Cursor, Claude, Codex, GitHub Copilot, VS Code, and other product names are trademarks of their respective owners; social.plus is not affiliated with or endorsed by them. Benchmark figures are from social.plus's own measurements.</sub>
|
|
167
174
|
|