zeno-mobile-runner 0.1.2

package/docs/trace-privacy.md

@@ -0,0 +1,88 @@
+# Trace Privacy
+
+ZMR traces are debugging artifacts. They can contain sensitive app state even
+when scenario files are generic.
+
+Raw trace directories may include:
+
+- screenshots
+- screen recordings
+- UI hierarchy XML or JSON
+- visible text and accessibility labels
+- log windows
+- app ids, package/activity names, and timing data
+- action inputs
+
+## Sharing Rules
+
+- Disable unnecessary raw artifacts in `.zmr/config.json`:
+
+  ```json
+  {
+    "schemaVersion": 1,
+    "artifacts": {
+      "screenshots": false,
+      "hierarchy": false,
+      "logs": false
+    },
+    "redaction": {
+      "denylistText": ["customer dob", "internal token"],
+      "denylistResourceIds": ["password-field", "ssn"],
+      "allowlistResourceIds": ["public-token-label"]
+    }
+  }
+  ```
+
+- Add app-specific text and resource-id denylist rules for customer data,
+  regulated identifiers, and internal identifiers that ZMR cannot infer.
+- Share redacted `.zmrtrace` bundles, not raw trace directories.
+- Use `zmr export <trace-dir> --out <bundle.zmrtrace> --redact`.
+- Review redacted bundles before attaching them to public issues.
+- Do not publish raw private app screenshots.
+- Do not publish private app screen recordings.
+- Do not publish logs containing credentials, tokens, emails, or customer data.
+
+## Current Redaction Behavior
+
+Persisted trace JSON scrubs obvious emails, bearer/JWT-like tokens, sensitive
+JSON keys, app-configured denylisted text, and app-configured sensitive
+resource ids. Resource-id denylist matches redact the id and force that node's
+`text` and `contentDesc` to secret placeholders. App-specific allowlists only
+skip app-specific denylist matches; built-in email/token scrubbing still
+applies.
+
+Redacted exports scrub common text secrets, replace PNG screenshots with safe
+placeholder frames, and omit screen recordings. Add `--omit-screenshots` to
+remove screenshot artifacts from the exported bundle entirely. Local trace
+directories are not mutated by export.
+
+Pixel-level screenshot masking is not implemented. Raw hierarchy XML can still
+contain app text; disable hierarchy capture or review redacted bundles before
+sharing them outside a trusted machine.
+
+## Screenshot And XML Strategy
+
+ZMR uses conservative artifact handling instead of partial visual masking:
+
+- Redacted `.zmrtrace` exports replace PNG screenshot files with generated
+  placeholder PNGs at the same artifact paths. This keeps trace replay frames
+  stable without shipping rendered app pixels.
+- `zmr export --redact --omit-screenshots` omits screenshot files entirely for
+  teams that cannot share visual artifacts outside trusted machines.
+- Redacted `.zmrtrace` exports omit screen recording files entirely. This avoids
+  shipping unreliable video masking that could miss rendered secrets.
+- Redacted exports scrub text-based artifacts, including JSON events, snapshot
+  JSON, logs, reports, and XML-like hierarchy files, for common emails, bearer
+  tokens, sensitive key names, and sensitive node attributes.
+- App-specific `.zmr/config.json` redaction rules apply before trace files are
+  written. Use them for private resource ids and business-specific text that
+  generic scrubbing cannot identify.
+- Set `artifacts.hierarchy: false` for apps whose raw accessibility trees are
+  sensitive by default. Selector matching still uses the live tree; this only
+  disables raw hierarchy persistence.
+- Keep unredacted local trace directories on trusted developer machines only.
+
+This strategy favors predictable placeholders, explicit visual omission, and
+app-owned denylist rules over a best-effort screenshot masker. Pixel-level
+masking can be added later as an opt-in exporter mode once it has visual
+verification tests.

package/docs/troubleshooting.md

@@ -0,0 +1,256 @@
+# Troubleshooting
+
+Start with structured diagnostics instead of reading terminal output by hand:
+
+```bash
+zmr doctor --json
+zmr doctor --strict --json
+zmr validate --json .zmr/android-smoke.json
+zmr explain traces/zmr-android
+./scripts/release-gate.sh --dry-run
+```
+
+`zmr doctor --json` is the first command to run when setup is unclear. It
+reports Zig, ADB, Android device count, `xcrun`, iOS simulator state, physical
+iOS device state, and configured Android/iOS shim command paths in a
+machine-readable shape that scripts and agents can inspect. Device readiness
+checks report `warning` when ADB sees zero devices, `xcrun` sees zero booted
+iOS simulators, `devicectl` sees zero paired physical iOS devices, or all
+listed physical devices are disconnected/unavailable, with stable
+`setup.android.no_devices`, `setup.ios.no_booted_simulators`,
+`setup.ios.no_physical_devices`, and
+`setup.ios.no_ready_physical_devices` error codes.
+Missing tool and shim checks also include stable setup codes such as
+`setup.adb.not_found` and `setup.android_shim.not_found`.
+By default `doctor` exits zero after printing diagnostics so interactive setup
+can keep going; add `--strict` when CI or install scripts should exit non-zero
+for any warning or missing check.
+When run with `--config .zmr/config.json`, it
+first reports whether the config file itself loaded, then validates configured
+smoke scenario files from `android.smokeScenario` and
+`ios.smokeScenario` so app-local setup mistakes fail before device orchestration
+starts. Config files with wrong types, such as string values for boolean
+artifact controls, unknown fields, such as misspelled `smokeScenario`, or empty strings
+where paths/app ids/script commands are required are reported as `config` warnings.
+Those warnings include `fieldPath` in JSON mode when ZMR can identify the
+invalid `.zmr/config.json` key, plus stable `errorCode` values for setup
+automation.
+Missing scenario files are reported as `missing`; malformed scenario files are
+reported as `warning` with a hint to run `zmr validate` on the configured file.
+Non-`ok` checks include a `"hint"` field with the next concrete remediation
+step. The JSON contract is published at
+`schemas/doctor-output.schema.json`.
+
+Top-level CLI failures use stable public error codes instead of Zig stack
+traces. For example, `error[device.command_failed]: device command failed`
+means a platform command such as ADB or `xcrun` failed before ZMR could collect
+a device response; run `zmr doctor --json` next for setup details. An
+`error[cli.unknown_command]: unknown command` response means the command name
+was not recognized; run `zmr help` to inspect the supported CLI surface.
+
+The real Android and iOS pilot wrappers run setup preflights before expensive
+install or benchmark work. `scripts/run-android-pilot.sh --skip-emulator`
+reports `no Android device found: <serial>` plus `setup.android.no_devices`
+when the requested serial is not attached. `scripts/run-ios-pilot.sh` reports
+`no booted iOS simulator found` plus `setup.ios.no_booted_simulators` when
+`--device booted` has no target. Physical iOS pilot runs report
+`setup.ios.physical_device_required`, `setup.ios.physical_device_not_found`, or
+`setup.ios.physical_device_not_ready` for invalid or disconnected physical
+device identifiers. Use the `serial` value from `zmr devices --json --platform
+ios --ios-device-type physical`. The not-ready preflight also prints the
+matched device state, such as
+`state: disconnected`, while `zmr doctor --json` reports the broader
+`ios-physical-devices` check with
+`setup.ios.no_physical_devices` when no physical devices are listed, or
+`setup.ios.no_ready_physical_devices` when only disconnected/unavailable
+devices are listed. The no-ready detail includes a state breakdown such as
+`disconnected=1, unavailable=1`. When at least one physical device is ready but
+other devices are listed in unusable states, `doctor` keeps the check `ok` and
+still includes the broader breakdown, for example
+`1 ready physical iOS device(s); 3 listed (disconnected=1, unavailable=1)`.
+In both cases the wrapper also prints the matching `zmr doctor --json` output
+so CI logs contain the next remediation.
+The JSON output also includes numeric `count` and `readyCount` fields on
+device checks, so agents and scripts can branch without parsing the human
+`detail` string.
+
+## Install Or Binary Issues
+
+If `zmr` is not found from an app repo, check the npm wrapper resolution order:
+
+```bash
+node -e 'import("zeno-mobile-runner").then(m => console.log(m.resolveBinary()))'
+npx zmr version
+```
+
+The npm wrapper resolves `ZMR_BIN`, then bundled prebuilds, then
+`zig-out/bin/zmr`. If none exist, install Zig and run:
+
+```bash
+npm run build:zmr
+```
+
+For source checkouts on this macOS host, use the explicit macOS 15 target shown
+in the README:
+
+```bash
+zig test src/test_harness.zig -target aarch64-macos.15.0
+zig build-exe src/main.zig -target aarch64-macos.15.0 -O Debug -femit-bin=zig-out/bin/zmr
+```
+
+## Scenario Issues
+
+Validate scenarios before touching a device:
+
+```bash
+zmr validate --json .zmr/android-smoke.json
+```
+
+The JSON output includes `errorCode`, `fieldPath`, `line`, and `column` when ZMR
+can locate the source. Fix schema and selector mistakes there first; device
+state debugging is slower and less reliable when the scenario itself is invalid.
+
+## Android Device Issues
+
+For a real emulator run, confirm that ADB sees exactly the device you intend to
+use:
+
+```bash
+adb devices
+zmr doctor --adb adb
+```
+
+If repeated local runs need a known state, prefer ZMR's emulator lifecycle flags
+or the Android pilot wrapper:
+
+```bash
+zmr run .zmr/android-smoke.json \
+  --android-avd Small_Phone \
+  --create-avd-if-missing \
+  --avd-system-image 'system-images;android-35;google_apis;arm64-v8a' \
+  --avd-device pixel_6 \
+  --restore-snapshot zmr-clean \
+  --wait-emulator \
+  --device emulator-5554
+```
+
+If selector actions are slow or flaky through shell/UI Automator, install the
+Android shim in the app repo:
+
+```bash
+npx zmr-install-android-shim \
+  --app-root . \
+  --test-package com.example.mobiletest.test \
+  --android-module android/app \
+  --gradle-file android/app/build.gradle
+```
+
+Then run with `--android-shim ./.zmr/android-shim` or set
+`tools.androidShimPath` in `.zmr/config.json`.
+
+## iOS Simulator Issues
+
+Confirm that `xcrun` sees a booted simulator:
+
+```bash
+xcrun simctl list devices booted
+zmr doctor --xcrun xcrun
+```
+
+The simulator `.app` must be built and installed before launch/open-link flows.
+A device `.ipa` is not simulator-compatible; `scripts/run-ios-pilot.sh` rejects
+that mismatch with `setup.ios.simulator_app_required`. Build an
+`iphonesimulator` `.app` for simulator pilots, or pass `--ios-device-type
+physical` with a signed device artifact and a real physical device identifier.
+
+On iOS, `clearState` is best-effort uninstall by bundle id; if the app is
+already missing, ZMR treats the simulator as clean and continues. Simulator
+`launch` is also idempotent when an XCTest shim is configured: if `simctl
+launch` reports an error but `{"cmd":"appState"}` shows the app is already
+running, ZMR treats the app as usable instead of failing the scenario.
+
+Selector-grade iOS actions require an XCTest/XCUIAutomation shim command:
+
+```bash
+npx zmr-install-ios-shim \
+  --app-root . \
+  --scheme SampleUITests \
+  --workspace ios/Sample.xcworkspace \
+  --app-target SampleApp \
+  --bundle-id com.example.mobiletest \
+  --patch-xcodeproj
+```
+
+The generated `.zmr/ensure-ios-shim-target.sh` helper resolves the referenced
+`.xcodeproj` from the workspace when there is one project, or when exactly one
+project contains `--app-target`, or when `--bundle-id` disambiguates matching
+app targets. Pass `--project` explicitly for still-ambiguous multi-project
+workspaces. Run with `--ios-shim ./.zmr/ios-shim` or set
+`tools.iosShimPath` in `.zmr/config.json`.
+
+If a real iOS run fails with CoreSimulator or Xcode cache errors such as
+`Operation not permitted`, `CoreSimulatorService connection became invalid`, or
+an unexpected workspace/build database error, rerun from a normal terminal or CI
+worker that has access to the user's Xcode, simulator, and DerivedData paths.
+These errors usually mean the host process is sandboxed away from Apple's local
+developer services, not that the scenario JSON is malformed.
+For the generated public iOS demo, `scripts/demo-ios-real.sh --device booted`
+tries available iOS simulators in order when no simulator is already booted.
+This avoids failing the whole demo when one local simulator cannot start
+`launchd_sim`, while still surfacing a setup error if every available simulator
+fails to boot.
+
+If a previous Xcode build was interrupted, remove only the app-local ZMR derived
+data path configured for the shim, then rerun the shim once to prewarm it:
+
+```bash
+rm -rf ios/build/ZMRDerivedData
+printf '{"cmd":"appState"}\n' | ./.zmr/ios-shim
+```
+
+Cold shim builds can take several minutes on large apps. Warm runs should use
+the cached `build-for-testing` output and respond much faster.
+`scripts/run-ios-pilot.sh` performs this prewarm automatically when
+`--ios-shim` is set; pass `--skip-shim-prewarm` only when debugging cold-start
+timing.
+
+If a freshly booted simulator reports `iOS shim server exited before it became
+ready`, `Early unexpected exit`, or `operation never finished bootstrapping`,
+ZMR retries the shim command once because XCTest can miss its first server
+bootstrap immediately after CoreSimulator startup. Persistent failures after
+that retry should be treated as setup failures: run `xcrun simctl bootstatus
+booted -b`, inspect `.zmr/ios-shim-state/xcodebuild.log`, and prewarm the shim
+with the `appState` command above.
+
+## Trace And Failure Issues
+
+When a run fails, do not rerun blindly. Inspect the recorded failure:
+
+```bash
+zmr explain traces/zmr-android
+zmr report traces/zmr-android --out traces/zmr-android/report.html
+```
+
+Timeout diagnostics include the active package/activity, visible text, hidden or
+disabled exact selector candidates, offscreen candidates, and nearest text
+matches from the last snapshot. Redacted bundles replace PNG screenshots with
+placeholder frames and omit screen recordings, so use them for sharing:
+
+```bash
+zmr export traces/zmr-android --out traces/zmr-android-redacted.zmrtrace --redact
+```
+
+## Release Gate Issues
+
+To see exactly what the local release gate will run:
+
+```bash
+./scripts/release-gate.sh --dry-run
+```
+
+The gate intentionally prints real Android and iOS pilot commands at the end
+instead of running them by default. Those pilots need app builds and devices, so
+run them explicitly before publishing reliability or performance claims. Use
+`zmr-pilot-gate --dry-run` with the same app path flags from an app repo or
+release machine to inspect the combined Android+iOS external gate command
+before starting the real runs.

package/examples/android-app-auth-probe.json

@@ -0,0 +1,89 @@
+{
+  "name": "Sample App auth probe",
+  "appId": "com.example.mobiletest",
+  "steps": [
+    {
+      "action": "stop"
+    },
+    {
+      "action": "openLink",
+      "url": "exampleapp:///e2e-auth?probe=1"
+    },
+    {
+      "action": "waitAny",
+      "selectors": [
+        {
+          "text": "E2E auth probe"
+        },
+        {
+          "text": "Deep link received:"
+        },
+        {
+          "text": "Development servers"
+        }
+      ],
+      "timeoutMs": 60000
+    },
+    {
+      "action": "whenVisible",
+      "selector": {
+        "text": "Deep link received:"
+      },
+      "steps": [
+        {
+          "action": "tap",
+          "selector": {
+            "contentDescContains": "Sample App Test on"
+          },
+          "optional": true
+        },
+        {
+          "action": "tap",
+          "selector": {
+            "contentDesc": "Sample App Test"
+          },
+          "optional": true
+        }
+      ]
+    },
+    {
+      "action": "whenVisible",
+      "selector": {
+        "text": "Development servers"
+      },
+      "steps": [
+        {
+          "action": "tap",
+          "selector": {
+            "contentDescContains": "Sample App Test on"
+          },
+          "optional": true
+        },
+        {
+          "action": "tap",
+          "selector": {
+            "contentDesc": "Sample App Test, http://10.0.2.2:8081"
+          },
+          "optional": true
+        },
+        {
+          "action": "tap",
+          "selector": {
+            "text": "http://10.0.2.2:8081"
+          },
+          "optional": true
+        }
+      ]
+    },
+    {
+      "action": "waitVisible",
+      "selector": {
+        "text": "E2E auth probe"
+      },
+      "timeoutMs": 120000
+    },
+    {
+      "action": "snapshot"
+    }
+  ]
+}

package/examples/android-app-error-state.json

@@ -0,0 +1,13 @@
+{
+  "name": "Android app error-state smoke",
+  "appId": "com.example.mobiletest",
+  "steps": [
+    { "action": "launch" },
+    { "action": "openLink", "url": "exampleapp://error-demo?mode=offline" },
+    { "action": "waitAny", "selectors": [{ "textContains": "Try again" }, { "textContains": "offline" }, { "textContains": "Something went wrong" }], "timeoutMs": 15000 },
+    { "action": "snapshot" },
+    { "action": "tap", "selector": { "textContains": "Try again" }, "optional": true },
+    { "action": "waitNotVisible", "selector": { "textContains": "Loading" }, "timeoutMs": 10000 },
+    { "action": "assertHealthy" }
+  ]
+}

package/examples/android-app-login-smoke.json

@@ -0,0 +1,192 @@
+{
+  "name": "Sample App email login and referral smoke",
+  "appId": "com.example.mobiletest",
+  "steps": [
+    {
+      "action": "stop"
+    },
+    {
+      "action": "clearState"
+    },
+    {
+      "action": "launch"
+    },
+    {
+      "action": "waitAny",
+      "selectors": [
+        { "textContains": "Development servers" },
+        { "textContains": "Downloading 100%" },
+        { "text": "Or sign up via email here" },
+        { "text": "Sign in with email" },
+        { "textContains": "Dashboard" },
+        { "textContains": "Request a feature" },
+        { "textContains": "Earn points" },
+        { "textContains": "Spend points" },
+        { "textContains": "points" }
+      ],
+      "timeoutMs": 60000
+    },
+    {
+      "action": "whenVisible",
+      "selector": { "textContains": "Development servers" },
+      "steps": [
+        {
+          "action": "tap",
+          "selector": { "contentDescContains": "Sample App Test on" },
+          "optional": true
+        },
+        {
+          "action": "tap",
+          "selector": { "contentDesc": "Sample App Test, http://10.0.2.2:8081" },
+          "optional": true
+        },
+        {
+          "action": "tap",
+          "selector": { "text": "http://10.0.2.2:8081" },
+          "optional": true
+        },
+        {
+          "action": "waitNotVisible",
+          "selector": { "textContains": "Development servers" },
+          "timeoutMs": 60000,
+          "optional": true
+        }
+      ]
+    },
+    {
+      "action": "whenVisible",
+      "selector": { "text": "Continue" },
+      "timeoutMs": 120000,
+      "steps": [
+        {
+          "action": "tap",
+          "selector": { "text": "Continue" }
+        },
+        {
+          "action": "whenVisible",
+          "selector": { "textContains": "Connected to:" },
+          "steps": [
+            {
+              "action": "pressBack"
+            }
+          ]
+        }
+      ]
+    },
+    {
+      "action": "whenVisible",
+      "selector": { "textContains": "Connected to:" },
+      "timeoutMs": 10000,
+      "steps": [
+        {
+          "action": "pressBack"
+        }
+      ]
+    },
+    {
+      "action": "waitAny",
+      "selectors": [
+        { "id": "email-login-email-input" },
+        { "contentDesc": "Open email sign up" },
+        { "text": "Or sign up via email here" },
+        { "textContains": "Welcome" },
+        { "textContains": "Sample landing" },
+        { "text": "Sign in with email" },
+        { "textContains": "Dashboard" },
+        { "textContains": "Request a feature" },
+        { "textContains": "Earn points" },
+        { "textContains": "Spend points" },
+        { "textContains": "points" }
+      ],
+      "timeoutMs": 60000
+    },
+    {
+      "action": "whenVisible",
+      "selector": { "textContains": "Downloading 100%" },
+      "steps": [
+        {
+          "action": "waitNotVisible",
+          "selector": { "textContains": "Downloading 100%" },
+          "timeoutMs": 180000
+        }
+      ]
+    },
+    {
+      "action": "whenVisible",
+      "selector": { "contentDesc": "Use E2E sign in" },
+      "steps": [
+        {
+          "action": "tap",
+          "selector": { "contentDesc": "Use E2E sign in" }
+        },
+        {
+          "action": "waitAny",
+          "selectors": [
+            { "textContains": "Signing in to your account" },
+            { "textContains": "Requesting test token" },
+            { "textContains": "Bootstrapping session" },
+            { "textContains": "Routing to app" },
+            { "textContains": "Dashboard" },
+            { "textContains": "Request a feature" },
+            { "textContains": "Invite teammates" },
+            { "textContains": "Earn points" },
+            { "textContains": "Spend points" },
+            { "textContains": "points" }
+          ],
+          "timeoutMs": 45000
+        }
+      ]
+    },
+    {
+      "action": "waitAny",
+      "selectors": [
+        { "textContains": "Dashboard" },
+        { "textContains": "Request a feature" },
+        { "textContains": "Invite teammates" },
+        { "textContains": "Earn points" },
+        { "textContains": "Spend points" },
+        { "textContains": "points" }
+      ],
+      "timeoutMs": 90000
+    },
+    {
+      "action": "openLink",
+      "url": "exampleapp:///referrals/invite"
+    },
+    {
+      "action": "waitAny",
+      "selectors": [
+        { "textContains": "Invite a teammate and both earn" },
+        { "textContains": "Share my link" },
+        { "textContains": "Your Referral Code" },
+        { "textContains": "No referrals yet" },
+        { "text": "Retry" },
+        { "textContains": "Request timed out" }
+      ],
+      "timeoutMs": 20000
+    },
+    {
+      "action": "whenVisible",
+      "selector": { "text": "Retry" },
+      "steps": [
+        {
+          "action": "tap",
+          "selector": { "text": "Retry" }
+        },
+        {
+          "action": "waitAny",
+          "selectors": [
+            { "textContains": "Invite a teammate and both earn" },
+            { "textContains": "Share my link" },
+            { "textContains": "Your Referral Code" },
+            { "textContains": "No referrals yet" }
+          ],
+          "timeoutMs": 60000
+        }
+      ]
+    },
+    {
+      "action": "snapshot"
+    }
+  ]
+}

package/examples/android-app-onboarding.json

@@ -0,0 +1,12 @@
+{
+  "name": "Android app onboarding smoke",
+  "appId": "com.example.mobiletest",
+  "steps": [
+    { "action": "clearState" },
+    { "action": "launch" },
+    { "action": "waitVisible", "selector": { "textContains": "Welcome" }, "timeoutMs": 15000 },
+    { "action": "tap", "selector": { "textContains": "Get started" } },
+    { "action": "waitAny", "selectors": [{ "textContains": "Home" }, { "textContains": "Sign in" }], "timeoutMs": 15000 },
+    { "action": "snapshot" }
+  ]
+}

package/examples/android-app-referral-deep-link.json

@@ -0,0 +1,12 @@
+{
+  "name": "Android referral deep link smoke",
+  "appId": "com.example.mobiletest",
+  "steps": [
+    { "action": "clearState" },
+    { "action": "openLink", "url": "exampleapp://invite?code=DEMO-CODE" },
+    { "action": "waitVisible", "selector": { "textContains": "Invite" }, "timeoutMs": 15000 },
+    { "action": "scrollUntilVisible", "selector": { "id": "invite-card" }, "direction": "down", "timeoutMs": 10000 },
+    { "action": "assertVisible", "selector": { "id": "invite-card" } },
+    { "action": "snapshot" }
+  ]
+}

package/examples/android-shim-smoke.json

@@ -0,0 +1,19 @@
+{
+  "name": "ZMR Android shim selector demo",
+  "appId": "com.example.mobiletest",
+  "steps": [
+    { "action": "launch" },
+    {
+      "action": "waitVisible",
+      "selector": { "text": "Continue" },
+      "timeoutMs": 1000
+    },
+    {
+      "action": "tap",
+      "selector": { "resourceId": "continue_button" }
+    },
+    { "action": "typeText", "text": "hello" },
+    { "action": "hideKeyboard" },
+    { "action": "snapshot" }
+  ]
+}