fusiontest 0.1.0__tar.gz

fusiontest-0.1.0/PKG-INFO

@@ -0,0 +1,260 @@
+Metadata-Version: 2.4
+Name: fusiontest
+Version: 0.1.0
+Summary: AI-powered UI testing for mobile and desktop — by FusionLeap.io
+Author-email: FusionLeap <hello@fusionleap.io>
+License: MIT
+Project-URL: Homepage, https://fusionleap.io
+Project-URL: Repository, https://github.com/mohigo/fusion-test
+Project-URL: Issues, https://github.com/mohigo/fusion-test/issues
+Keywords: testing,AI,mobile,desktop,LLM,automation,QA
+Classifier: Development Status :: 3 - Alpha
+Classifier: Intended Audience :: Developers
+Classifier: Topic :: Software Development :: Testing
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+Requires-Dist: click>=8.1
+Requires-Dist: pyyaml>=6.0
+Requires-Dist: httpx>=0.27
+Requires-Dist: python-dotenv>=1.0
+Requires-Dist: rich>=13.0
+Requires-Dist: pydantic>=2.0
+Provides-Extra: mobile
+Requires-Dist: Appium-Python-Client>=3.1; extra == "mobile"
+Requires-Dist: selenium>=4.18; extra == "mobile"
+Provides-Extra: desktop
+Requires-Dist: playwright>=1.43; extra == "desktop"
+Provides-Extra: windows
+Requires-Dist: Appium-Python-Client>=3.1; extra == "windows"
+Requires-Dist: selenium>=4.18; extra == "windows"
+Provides-Extra: mpnet
+Requires-Dist: sentence-transformers>=2.7; extra == "mpnet"
+Requires-Dist: torch>=2.2; extra == "mpnet"
+Provides-Extra: api
+Requires-Dist: fastapi>=0.111; extra == "api"
+Requires-Dist: uvicorn[standard]>=0.29; extra == "api"
+Requires-Dist: pydantic[email]>=2.0; extra == "api"
+Requires-Dist: python-jose[cryptography]>=3.3; extra == "api"
+Requires-Dist: passlib[bcrypt]>=1.7; extra == "api"
+Requires-Dist: psycopg2-binary>=2.9; extra == "api"
+Provides-Extra: training
+Requires-Dist: sentence-transformers>=2.7; extra == "training"
+Requires-Dist: torch>=2.2; extra == "training"
+Requires-Dist: datasets>=2.19; extra == "training"
+Requires-Dist: accelerate>=0.30; extra == "training"
+Requires-Dist: scikit-learn>=1.4; extra == "training"
+Requires-Dist: pandas>=2.2; extra == "training"
+Requires-Dist: numpy>=1.26; extra == "training"
+Requires-Dist: tqdm>=4.66; extra == "training"
+Requires-Dist: wandb>=0.17; extra == "training"
+Provides-Extra: openai
+Requires-Dist: openai>=1.25; extra == "openai"
+Provides-Extra: claude
+Requires-Dist: anthropic>=0.25; extra == "claude"
+Provides-Extra: dev
+Requires-Dist: pytest>=8.0; extra == "dev"
+Requires-Dist: pytest-asyncio>=0.23; extra == "dev"
+Requires-Dist: pytest-cov>=5.0; extra == "dev"
+Requires-Dist: ruff>=0.4; extra == "dev"
+Requires-Dist: mypy>=1.10; extra == "dev"
+Requires-Dist: pre-commit>=3.7; extra == "dev"
+Requires-Dist: fusiontest[desktop,mobile,openai]; extra == "dev"
+Provides-Extra: all
+Requires-Dist: fusiontest[api,claude,desktop,mobile,mpnet,openai,training,windows]; extra == "all"
+
+# 🧪 FusionTest
+
+> AI-powered UI testing for mobile and desktop — built by [FusionLeap.io](https://fusionleap.io)
+
+FusionTest uses large language models to execute UI tests the way a human would — reading screens, making decisions, and adapting to UI changes automatically. No brittle scripts. No maintenance overhead. Just natural language test goals that run anywhere.
+
+---
+
+## ✨ Features
+
+| Feature | Mobile (iOS/Android) | Desktop (Win/Mac/Linux) |
+|---|---|---|
+| Natural language test goals | ✅ | ✅ |
+| Zero-maintenance execution | ✅ | ✅ |
+| Multi-locale / 50+ languages | ✅ | ✅ |
+| Hallucination guardrails | ✅ | ✅ |
+| Loop detection & backtrack | ✅ | ✅ |
+| CI/CD integration | ✅ | ✅ |
+| Vision model fallback | — | ✅ |
+| Cross-app flow testing | — | ✅ |
+| Electron / Playwright support | — | ✅ |
+
+---
+
+## 🏗 Architecture
+
+```
+fusiontest/
+├── core/           # LLM action model, embeddings, screen parser
+├── mobile/         # iOS (XCTest) + Android (UIAutomator2) adapters
+├── desktop/        # Windows (WinAppDriver), macOS (Accessibility API), Playwright
+├── guardrails/     # Hallucination handler, loop detector, backtrack engine
+└── reporting/      # Dashboard data, Slack/email alerts, CI artifacts
+```
+
+---
+
+## 🚀 Quickstart
+
+### Prerequisites
+- Python 3.10+
+- Node.js 18+ (for Playwright/Electron targets)
+- Appium 2.x (for mobile)
+
+### Install
+
+```bash
+git clone https://github.com/mohigo/fusion-test.git
+cd fusion-test
+pip install -e ".[dev]"
+```
+
+### Set your API key
+
+```bash
+export FUSIONTEST_API_KEY=your_key_here
+# or copy .env.example → .env and fill in values
+```
+
+### Run your first test
+
+```bash
+fusiontest run --goal "Log in, navigate to settings, update profile name" \
+               --platform android \
+               --app path/to/app.apk \
+               --locale en-US
+```
+
+> **Full guide:** [docs/getting-started.md](docs/getting-started.md) — covers all platforms (web, Android, iOS, Electron, Windows, macOS), Python API usage, configuration, dashboard, CI setup, and tips for writing good goals.
+
+---
+
+## 📝 Writing Test Goals
+
+FusionTest accepts natural language goals. No code required.
+
+```yaml
+# tests/goals/onboarding.yaml
+name: User onboarding flow
+platform: android
+locale: en-US
+goals:
+  - "Open the app and tap Get Started"
+  - "Enter email address and password on the signup screen"
+  - "Verify the home dashboard loads with a welcome message"
+```
+
+Run it:
+
+```bash
+fusiontest run --file tests/goals/onboarding.yaml
+```
+
+---
+
+## 🔌 CI/CD Integration
+
+### GitHub Actions
+
+```yaml
+- name: Run FusionTest
+  uses: fusionleap/fusiontest-action@v1
+  with:
+    goal-file: tests/goals/smoke.yaml
+    platform: android
+    api-key: ${{ secrets.FUSIONTEST_API_KEY }}
+```
+
+### Bitrise / Fastlane
+
+See [docs/ci-integrations.md](docs/ci-integrations.md) for step-by-step guides.
+
+---
+
+## 📊 Reporting
+
+Every test run produces:
+- Pass/fail summary with stability score
+- Screen-by-screen action log
+- Video recording of the test session
+- Bug report with screenshot + repro steps (on failure)
+
+Results are posted to your FusionTest dashboard and optionally to Slack.
+
+---
+
+## 🛠 Configuration
+
+```yaml
+# fusiontest.config.yaml
+model:
+  backbone: mpnet-base          # or: gpt-4o, claude-sonnet (for MVP/fallback)
+  precision_threshold: 0.97
+  max_retries: 3
+
+guardrails:
+  loop_detection: true
+  loop_window: 5                # check last N screen states
+  backtrack_on_invalid: true
+  max_backtracks: 2
+
+devices:
+  android:
+    farm: browserstack           # or: aws-device-farm, local
+  desktop:
+    vision_fallback: true        # enable for non-accessible UIs
+    playwright_for_electron: true
+
+reporting:
+  slack_webhook: ${SLACK_WEBHOOK}
+  save_recordings: true
+  dashboard_url: https://app.fusionleap.io
+```
+
+---
+
+## 🗺 Roadmap
+
+- [x] Core LLM action model (MPNet / GPT-4o / Claude backends)
+- [x] Android adapter (UIAutomator2 + Appium)
+- [x] iOS adapter (XCUITest + Appium)
+- [x] Desktop adapter — Playwright / Electron (with vision fallback)
+- [x] Desktop adapter — Windows (WinAppDriver / UIA)
+- [x] Desktop adapter — macOS (NSAccessibility + PyObjC)
+- [x] Guardrails engine (invalid actions, loops, backtrack)
+- [x] Goal completion verifier (LLM + heuristic fallback)
+- [x] Video recording — Playwright WebM→MP4, Appium, Windows screenshot stitch
+- [x] Reporting — JSON, Slack webhooks, GitHub Actions annotations
+- [x] CLI — `fusiontest run / init / demo / report`
+- [x] MPNet fine-tuning pipeline (`fusiontest/training/`)
+- [x] FusionLeap cloud dashboard (React + Recharts + SaaS pages)
+- [x] Dashboard backend API (FastAPI + PostgreSQL/Supabase)
+- [x] SaaS backend — auth, org management, API keys, webhooks, billing
+- [x] Marketing website (Next.js, `website/`)
+- [x] Integration tests — runner, guardrails, goal verifier
+- [x] CI/CD integration guides (`docs/ci-integrations.md`)
+- [ ] Autonomous Test Discovery — auto-crawl website → generate goals → execute
+- [ ] RAG test library (few-shot goal → flow)
+- [ ] Multi-locale parallel execution
+- [ ] Cross-app flow testing (desktop)
+
+---
+
+## 🤝 Contributing
+
+See [CONTRIBUTING.md](CONTRIBUTING.md). We welcome issues, PRs, and test goal examples from the community.
+
+---
+
+## 📄 License
+
+MIT © [FusionLeap.io](https://fusionleap.io)

fusiontest-0.1.0/README.md

@@ -0,0 +1,192 @@
+# 🧪 FusionTest
+
+> AI-powered UI testing for mobile and desktop — built by [FusionLeap.io](https://fusionleap.io)
+
+FusionTest uses large language models to execute UI tests the way a human would — reading screens, making decisions, and adapting to UI changes automatically. No brittle scripts. No maintenance overhead. Just natural language test goals that run anywhere.
+
+---
+
+## ✨ Features
+
+| Feature | Mobile (iOS/Android) | Desktop (Win/Mac/Linux) |
+|---|---|---|
+| Natural language test goals | ✅ | ✅ |
+| Zero-maintenance execution | ✅ | ✅ |
+| Multi-locale / 50+ languages | ✅ | ✅ |
+| Hallucination guardrails | ✅ | ✅ |
+| Loop detection & backtrack | ✅ | ✅ |
+| CI/CD integration | ✅ | ✅ |
+| Vision model fallback | — | ✅ |
+| Cross-app flow testing | — | ✅ |
+| Electron / Playwright support | — | ✅ |
+
+---
+
+## 🏗 Architecture
+
+```
+fusiontest/
+├── core/           # LLM action model, embeddings, screen parser
+├── mobile/         # iOS (XCTest) + Android (UIAutomator2) adapters
+├── desktop/        # Windows (WinAppDriver), macOS (Accessibility API), Playwright
+├── guardrails/     # Hallucination handler, loop detector, backtrack engine
+└── reporting/      # Dashboard data, Slack/email alerts, CI artifacts
+```
+
+---
+
+## 🚀 Quickstart
+
+### Prerequisites
+- Python 3.10+
+- Node.js 18+ (for Playwright/Electron targets)
+- Appium 2.x (for mobile)
+
+### Install
+
+```bash
+git clone https://github.com/mohigo/fusion-test.git
+cd fusion-test
+pip install -e ".[dev]"
+```
+
+### Set your API key
+
+```bash
+export FUSIONTEST_API_KEY=your_key_here
+# or copy .env.example → .env and fill in values
+```
+
+### Run your first test
+
+```bash
+fusiontest run --goal "Log in, navigate to settings, update profile name" \
+               --platform android \
+               --app path/to/app.apk \
+               --locale en-US
+```
+
+> **Full guide:** [docs/getting-started.md](docs/getting-started.md) — covers all platforms (web, Android, iOS, Electron, Windows, macOS), Python API usage, configuration, dashboard, CI setup, and tips for writing good goals.
+
+---
+
+## 📝 Writing Test Goals
+
+FusionTest accepts natural language goals. No code required.
+
+```yaml
+# tests/goals/onboarding.yaml
+name: User onboarding flow
+platform: android
+locale: en-US
+goals:
+  - "Open the app and tap Get Started"
+  - "Enter email address and password on the signup screen"
+  - "Verify the home dashboard loads with a welcome message"
+```
+
+Run it:
+
+```bash
+fusiontest run --file tests/goals/onboarding.yaml
+```
+
+---
+
+## 🔌 CI/CD Integration
+
+### GitHub Actions
+
+```yaml
+- name: Run FusionTest
+  uses: fusionleap/fusiontest-action@v1
+  with:
+    goal-file: tests/goals/smoke.yaml
+    platform: android
+    api-key: ${{ secrets.FUSIONTEST_API_KEY }}
+```
+
+### Bitrise / Fastlane
+
+See [docs/ci-integrations.md](docs/ci-integrations.md) for step-by-step guides.
+
+---
+
+## 📊 Reporting
+
+Every test run produces:
+- Pass/fail summary with stability score
+- Screen-by-screen action log
+- Video recording of the test session
+- Bug report with screenshot + repro steps (on failure)
+
+Results are posted to your FusionTest dashboard and optionally to Slack.
+
+---
+
+## 🛠 Configuration
+
+```yaml
+# fusiontest.config.yaml
+model:
+  backbone: mpnet-base          # or: gpt-4o, claude-sonnet (for MVP/fallback)
+  precision_threshold: 0.97
+  max_retries: 3
+
+guardrails:
+  loop_detection: true
+  loop_window: 5                # check last N screen states
+  backtrack_on_invalid: true
+  max_backtracks: 2
+
+devices:
+  android:
+    farm: browserstack           # or: aws-device-farm, local
+  desktop:
+    vision_fallback: true        # enable for non-accessible UIs
+    playwright_for_electron: true
+
+reporting:
+  slack_webhook: ${SLACK_WEBHOOK}
+  save_recordings: true
+  dashboard_url: https://app.fusionleap.io
+```
+
+---
+
+## 🗺 Roadmap
+
+- [x] Core LLM action model (MPNet / GPT-4o / Claude backends)
+- [x] Android adapter (UIAutomator2 + Appium)
+- [x] iOS adapter (XCUITest + Appium)
+- [x] Desktop adapter — Playwright / Electron (with vision fallback)
+- [x] Desktop adapter — Windows (WinAppDriver / UIA)
+- [x] Desktop adapter — macOS (NSAccessibility + PyObjC)
+- [x] Guardrails engine (invalid actions, loops, backtrack)
+- [x] Goal completion verifier (LLM + heuristic fallback)
+- [x] Video recording — Playwright WebM→MP4, Appium, Windows screenshot stitch
+- [x] Reporting — JSON, Slack webhooks, GitHub Actions annotations
+- [x] CLI — `fusiontest run / init / demo / report`
+- [x] MPNet fine-tuning pipeline (`fusiontest/training/`)
+- [x] FusionLeap cloud dashboard (React + Recharts + SaaS pages)
+- [x] Dashboard backend API (FastAPI + PostgreSQL/Supabase)
+- [x] SaaS backend — auth, org management, API keys, webhooks, billing
+- [x] Marketing website (Next.js, `website/`)
+- [x] Integration tests — runner, guardrails, goal verifier
+- [x] CI/CD integration guides (`docs/ci-integrations.md`)
+- [ ] Autonomous Test Discovery — auto-crawl website → generate goals → execute
+- [ ] RAG test library (few-shot goal → flow)
+- [ ] Multi-locale parallel execution
+- [ ] Cross-app flow testing (desktop)
+
+---
+
+## 🤝 Contributing
+
+See [CONTRIBUTING.md](CONTRIBUTING.md). We welcome issues, PRs, and test goal examples from the community.
+
+---
+
+## 📄 License
+
+MIT © [FusionLeap.io](https://fusionleap.io)

fusiontest-0.1.0/fusiontest/__init__.py

@@ -0,0 +1,2 @@
+"""FusionTest — AI-powered UI testing for mobile and desktop."""
+__version__ = "0.1.0"