runport 0.1.0__tar.gz

runport-0.1.0/.dockerignore

@@ -0,0 +1,23 @@
+__pycache__
+*.py[cod]
+*$py.class
+*.so
+.venv
+venv
+env
+.pytest_cache
+.coverage
+htmlcov
+.mypy_cache
+.ruff_cache
+.DS_Store
+.git
+.github
+data/*.db*
+data/*.sqlite*
+/reports
+scratch
+node_modules
+web/node_modules
+web/dist
+docs/PROGRESS*.md

runport-0.1.0/.github/ISSUE_TEMPLATE/bug_report.md

@@ -0,0 +1,28 @@
+---
+name: Bug Report
+about: Create a report to help us improve Runport
+title: "[BUG] "
+labels: ["bug"]
+assignees: []
+---
+
+**Describe the bug**
+A clear and concise description of what the bug is.
+
+**To Reproduce**
+Steps to reproduce the behavior:
+1. Run command: `runport ...`
+2. With configuration / dataset: `...`
+3. See error output: `...`
+
+**Expected behavior**
+A clear and concise description of what you expected to happen.
+
+**Environment details:**
+ - OS: [e.g. macOS 14.5, Ubuntu 22.04, Windows 11]
+ - Python version: [e.g. 3.11.7, 3.12.3]
+ - Runport version: [e.g. 0.1.0]
+ - Terminal / Shell: [e.g. zsh, bash, PowerShell]
+
+**Additional context**
+Add any other context about the problem here (remember: NEVER include live API keys, bearer tokens, or private dataset records).

runport-0.1.0/.github/ISSUE_TEMPLATE/connector_request.md

@@ -0,0 +1,27 @@
+---
+name: Connector Request
+about: Propose support for a new LLM provider, workflow engine, or API protocol
+title: "[CONNECTOR] "
+labels: ["connector", "enhancement"]
+assignees: []
+---
+
+**Target System or Service**
+- Name: [e.g. LangGraph Studio, vLLM, Bedrock, Mistral API]
+- Documentation URL: 
+- Protocol: [REST / SSE streaming / WebSocket / gRPC / Python library]
+
+**Capabilities Supported**
+- [ ] Non-streaming completion
+- [ ] Server-Sent Events (SSE) streaming
+- [ ] Token usage telemetry (prompt / completion tokens)
+- [ ] Native cost reporting
+- [ ] Logprobs / Confidence scores
+- [ ] Structured JSON output schema enforcement
+
+**Authentication & Network Security**
+How are credentials provided? (e.g. Header `Authorization: Bearer $ENV_VAR`, query parameter).
+Does the target service support local offline emulation or mock servers?
+
+**Reference Implementation or API Snippet**
+Provide a curl command or minimal Python snippet demonstrating request and response payloads.

runport-0.1.0/.github/ISSUE_TEMPLATE/feature_request.md

@@ -0,0 +1,23 @@
+---
+name: Feature Request
+about: Suggest an idea or enhancement for Runport
+title: "[FEATURE] "
+labels: ["enhancement"]
+assignees: []
+---
+
+**Is your feature request related to a problem? Please describe.**
+A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
+
+**Describe the solution you'd like**
+A clear and concise description of what you want to happen.
+
+**Describe alternatives you've considered**
+A clear and concise description of any alternative solutions or features you've considered.
+
+**Safety & Invariant Considerations**
+Does this feature interact with budget caps, telemetry privacy, ground-truth annotations, or approval models?
+- [ ] Preserves fail-closed spend caps
+- [ ] Preserves zero-leakage secret scrubbing
+- [ ] Maintains honest provenance (`ACTUAL`, `ESTIMATED`, `UNRESOLVED`, `UNAVAILABLE`)
+- [ ] Offline testable

runport-0.1.0/.github/PULL_REQUEST_TEMPLATE.md

@@ -0,0 +1,12 @@
+## Description
+Briefly describe the purpose of this change and link relevant issues.
+
+## Checklist
+- [ ] Conforms to repository invariants in `AGENTS.md` and `docs/DECISIONS.md`.
+- [ ] No fabricated telemetry (missing values remain `None` / `UNAVAILABLE`).
+- [ ] Spend limits and preflight plan approvals preserved.
+- [ ] Secrets and API keys are automatically scrubbed from request logs and exports.
+- [ ] Offline tests added under `tests/` with simulated transports.
+- [ ] All tests pass: `uv run pytest` and `uv run pytest examples/plugins`.
+- [ ] Linting and type checking pass: `uv run ruff check` and `uv run mypy`.
+- [ ] No personal paths, usernames, or live credentials committed.

runport-0.1.0/.github/dependabot.yml

@@ -0,0 +1,19 @@
+version: 2
+updates:
+  - package-ecosystem: "pip"
+    directory: "/"
+    schedule:
+      interval: "weekly"
+    open-pull-requests-limit: 10
+
+  - package-ecosystem: "npm"
+    directory: "/web"
+    schedule:
+      interval: "weekly"
+    open-pull-requests-limit: 10
+
+  - package-ecosystem: "github-actions"
+    directory: "/"
+    schedule:
+      interval: "weekly"
+    open-pull-requests-limit: 10

runport-0.1.0/.github/workflows/ci.yml

@@ -0,0 +1,164 @@
+name: CI
+
+on:
+  push:
+    branches: [ main ]
+  pull_request:
+    branches: [ main ]
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  lint:
+    name: Lint & Code Style
+    runs-on: ubuntu-latest
+    steps:
+      - name: Checkout repository
+        uses: actions/checkout@v4
+
+      - name: Set up uv
+        uses: astral-sh/setup-uv@v5
+        with:
+          enable-cache: true
+
+      - name: Install dependencies
+        run: uv sync --extra dev
+
+      - name: Run Ruff Linter
+        run: uv run ruff check
+
+      - name: Run Ruff Formatter Check
+        run: uv run ruff format --check
+
+  type-check:
+    name: Type Check (mypy)
+    runs-on: ubuntu-latest
+    steps:
+      - name: Checkout repository
+        uses: actions/checkout@v4
+
+      - name: Set up uv
+        uses: astral-sh/setup-uv@v5
+        with:
+          enable-cache: true
+
+      - name: Install dependencies
+        run: uv sync --extra dev
+
+      - name: Run mypy
+        run: uv run mypy
+
+  security-and-scan:
+    name: Security & Legacy Scans
+    runs-on: ubuntu-latest
+    steps:
+      - name: Checkout repository
+        uses: actions/checkout@v4
+        with:
+          fetch-depth: 0
+
+      - name: Run Gitleaks Scan
+        uses: gitleaks/gitleaks-action@v2
+        env:
+          GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
+
+      - name: Run Legacy Pattern Scan
+        run: |
+          echo "Verifying zero legacy tokens outside approved exceptions..."
+          # Legacy identifiers from the project's earlier domain. Generic English words ("lead", "intent") were removed:
+          # they matched ordinary prose and UI text, so the scan could never pass. References to the approved
+          # jev_decisions_api example plugin are allowed wherever they appear.
+          MATCHES=$(git ls-files -z | grep -zv -e package-lock -e uv.lock | xargs -0 grep -niIE "msu|jev|admission|whatsapp|user4|counsellor|/Users/" | grep -v -E "(LICENSE:|examples/plugins/jev_decisions_api/|docs/INVARIANT_TESTS.md:|CODE_OF_CONDUCT.md:|jev_decisions_api)" || true)
+          if [ -n "$MATCHES" ]; then
+            echo "Legacy scan failed! Forbidden patterns found:"
+            echo "$MATCHES"
+            exit 1
+          fi
+          echo "Legacy scan passed cleanly."
+
+  test:
+    name: Test (Python ${{ matrix.python-version }} on ${{ matrix.os }})
+    runs-on: ${{ matrix.os }}
+    strategy:
+      fail-fast: false
+      matrix:
+        os: [ubuntu-latest, macos-latest, windows-latest]
+        python-version: ["3.11", "3.12", "3.13"]
+
+    steps:
+      - name: Checkout repository
+        uses: actions/checkout@v4
+
+      - name: Set up Python ${{ matrix.python-version }}
+        uses: actions/setup-python@v5
+        with:
+          python-version: ${{ matrix.python-version }}
+
+      - name: Set up uv
+        uses: astral-sh/setup-uv@v5
+        with:
+          enable-cache: true
+
+      - name: Install dependencies
+        run: uv sync --extra dev --extra report
+
+      - name: Run Core Test Suite
+        run: uv run pytest -v
+
+      - name: Run Plugin Test Suite
+        run: uv run pytest -v examples/plugins
+
+  wheel-and-smoke:
+    name: Web Build & Wheel Smoke Test
+    runs-on: ubuntu-latest
+    steps:
+      - name: Checkout repository
+        uses: actions/checkout@v4
+
+      - name: Set up Node.js 20
+        uses: actions/setup-node@v4
+        with:
+          node-version: 20
+
+      - name: Build Web Dashboard
+        working-directory: web
+        run: |
+          npm ci
+          # the lockfile was generated on macOS; add Rollup's Linux binary (npm/cli#4828)
+          npm install --no-save @rollup/rollup-linux-x64-gnu
+          npm run build
+          mkdir -p ../src/runport/_web
+          cp -r dist/* ../src/runport/_web/
+
+      - name: Set up Python
+        uses: actions/setup-python@v5
+        with:
+          python-version: "3.11"
+
+      - name: Set up uv
+        uses: astral-sh/setup-uv@v5
+        with:
+          enable-cache: true
+
+      - name: Build Wheel
+        run: uv build
+
+      - name: Install Wheel in Isolated Environment
+        run: |
+          uv venv test-env
+          uv pip install --python test-env/bin/python dist/*.whl
+
+      - name: Smoke Test Wheel CLI & Server
+        run: |
+          test-env/bin/runport --help
+          # Without OPENROUTER_API_KEY the preflight must fail closed (exit 1); CI never has a key.
+          if test-env/bin/runport api-preflight; then echo "api-preflight should exit 1 without a key"; exit 1; fi
+          test-env/bin/runport budget status
+          # Launch background web service and check health
+          test-env/bin/runport web --port 8000 &
+          PID=$!
+          sleep 3
+          curl -sf http://127.0.0.1:8000/api/health || (kill $PID && exit 1)
+          kill $PID

runport-0.1.0/.github/workflows/pages.yml

@@ -0,0 +1,56 @@
+name: Deploy landing page
+
+# Builds the public landing page and the docs portal (web/, `npm run build:site`)
+# and publishes them to GitHub Pages at https://<owner>.github.io/Runport/.
+on:
+  push:
+    branches: [main]
+    paths:
+      - 'web/**'
+      - '.github/workflows/pages.yml'
+  workflow_dispatch:
+
+permissions:
+  contents: read
+  pages: write
+  id-token: write
+
+concurrency:
+  group: pages
+  cancel-in-progress: true
+
+jobs:
+  build:
+    runs-on: ubuntu-latest
+    defaults:
+      run:
+        working-directory: web
+    steps:
+      - uses: actions/checkout@v4
+      - uses: actions/setup-node@v4
+        with:
+          node-version: 22
+          cache: npm
+          cache-dependency-path: web/package-lock.json
+      - run: npm ci
+      # the lockfile was generated on macOS; add Rollup's Linux binary (npm/cli#4828)
+      - run: npm install --no-save @rollup/rollup-linux-x64-gnu
+      - run: npm test
+      - name: Build landing page and docs
+        run: npm run build:site
+        env:
+          LANDING_BASE: /${{ github.event.repository.name }}/
+          VITE_SITE_URL: /${{ github.event.repository.name }}/
+      - uses: actions/upload-pages-artifact@v3
+        with:
+          path: web/dist-landing
+
+  deploy:
+    needs: build
+    runs-on: ubuntu-latest
+    environment:
+      name: github-pages
+      url: ${{ steps.deployment.outputs.page_url }}
+    steps:
+      - id: deployment
+        uses: actions/deploy-pages@v4

runport-0.1.0/.github/workflows/release.yml

@@ -0,0 +1,165 @@
+name: Release
+
+on:
+  push:
+    tags:
+      - 'v*'
+
+jobs:
+  build:
+    name: Build Distributions & Web Dashboard
+    runs-on: ubuntu-latest
+    permissions:
+      contents: read
+    steps:
+      - name: Checkout repository
+        uses: actions/checkout@v4
+        with:
+          fetch-depth: 0
+
+      - name: Set up Node.js 20
+        uses: actions/setup-node@v4
+        with:
+          node-version: 20
+
+      - name: Build Web Dashboard
+        working-directory: web
+        run: |
+          npm ci
+          # The lockfile was generated on macOS; add Rollup's Linux binary (npm/cli#4828)
+          npm install --no-save @rollup/rollup-linux-x64-gnu
+          npm run build
+          mkdir -p ../src/runport/_web
+          cp -r dist/* ../src/runport/_web/
+
+      - name: Set up uv
+        uses: astral-sh/setup-uv@v5
+        with:
+          enable-cache: true
+
+      - name: Build Distributions (sdist and wheel)
+        run: uv build
+
+      - name: Upload Distribution Artifacts
+        uses: actions/upload-artifact@v4
+        with:
+          name: packages
+          path: dist/
+          retention-days: 7
+
+  verify:
+    name: Verify Wheel Clean Install (${{ matrix.os }})
+    needs: build
+    runs-on: ${{ matrix.os }}
+    strategy:
+      fail-fast: false
+      matrix:
+        os: [ubuntu-latest, macos-latest, windows-latest]
+    permissions:
+      contents: read
+    env:
+      PYTHONIOENCODING: utf-8
+      PYTHONUTF8: '1'
+    steps:
+      - name: Set up Python 3.11
+        uses: actions/setup-python@v5
+        with:
+          python-version: '3.11'
+
+      - name: Download Distribution Artifacts
+        uses: actions/download-artifact@v4
+        with:
+          name: packages
+          path: dist/
+
+      - name: Install Wheel in Isolated Environment
+        run: |
+          python -m pip install --upgrade pip
+          python -c "import glob, subprocess, sys; whl = glob.glob('dist/*.whl')[0]; subprocess.check_call([sys.executable, '-m', 'pip', 'install', whl])"
+
+      - name: Run CLI Smoke Checks
+        run: |
+          runport --help
+          runport --version
+
+      - name: Test Workspace Init
+        run: |
+          python -c "import subprocess, tempfile, os; d = tempfile.mkdtemp(); subprocess.check_call(['runport', 'init'], cwd=d)"
+
+      - name: Verify Bundled Web Assets
+        run: |
+          python -c "import runport; from pathlib import Path; p = Path(runport.__file__).parent / '_web' / 'index.html'; assert p.exists(), f'Missing web asset: {p}'; print('Web assets verified.')"
+
+  publish-pypi:
+    name: Publish to PyPI (Trusted Publishing)
+    needs: [build, verify]
+    runs-on: ubuntu-latest
+    environment:
+      name: pypi
+      url: https://pypi.org/p/runport
+    permissions:
+      id-token: write  # Mandatory for PyPI Trusted Publishing OIDC
+      contents: read
+    steps:
+      - name: Download Distribution Artifacts
+        uses: actions/download-artifact@v4
+        with:
+          name: packages
+          path: dist/
+
+      - name: Publish Package to PyPI
+        uses: pypa/gh-action-pypi-publish@release/v1
+        with:
+          packages-dir: dist/
+
+  github-release:
+    name: Create GitHub Release
+    needs: [build, verify, publish-pypi]
+    runs-on: ubuntu-latest
+    permissions:
+      contents: write
+    steps:
+      - name: Checkout repository
+        uses: actions/checkout@v4
+
+      - name: Download Distribution Artifacts
+        uses: actions/download-artifact@v4
+        with:
+          name: packages
+          path: dist/
+
+      - name: Extract Release Notes & Prerelease Status
+        id: release_info
+        env:
+          TAG: ${{ github.ref_name }}
+        run: |
+          VERSION=${TAG#v}
+          echo "Extracting release notes for version $VERSION..."
+          python3 -c "
+          import os, re
+          tag = os.environ.get('TAG', '')
+          ver = tag.lstrip('v')
+          base_ver = ver.split('-')[0].split('+')[0]
+          content = open('CHANGELOG.md').read() if os.path.exists('CHANGELOG.md') else ''
+          pattern = r'## \[' + re.escape(ver) + r'\].*?\n(.*?)(?=\n## \[|\Z)'
+          match = re.search(pattern, content, re.DOTALL)
+          if not match and base_ver != ver:
+              fallback_pattern = r'## \[' + re.escape(base_ver) + r'\].*?\n(.*?)(?=\n## \[|\Z)'
+              match = re.search(fallback_pattern, content, re.DOTALL)
+          notes = match.group(1).strip() + '\n' if match else f'Release {tag}\n'
+          with open('RELEASE_NOTES.md', 'w') as f:
+              f.write(notes)
+
+          is_pre = 'true' if re.search(r'[-_\.]?(alpha|beta|rc|dev|preview|a\d|b\d)', tag, re.I) else 'false'
+          print(f'is_prerelease={is_pre}')
+          with open(os.environ['GITHUB_OUTPUT'], 'a') as f:
+              f.write(f'is_prerelease={is_pre}\n')
+          "
+
+      - name: Create GitHub Release
+        uses: softprops/action-gh-release@v2
+        with:
+          body_path: RELEASE_NOTES.md
+          files: dist/*
+          draft: false
+          prerelease: ${{ steps.release_info.outputs.is_prerelease == 'true' }}

runport-0.1.0/.gitignore

@@ -0,0 +1,81 @@
+# Bytecode and build artifacts
+__pycache__/
+*.py[cod]
+*$py.class
+*.so
+build/
+dist/
+site/
+*.egg-info/
+*.egg
+
+# Virtual environments
+.venv/
+venv/
+env/
+
+# Test and coverage caches
+.pytest_cache/
+.coverage
+htmlcov/
+.mypy_cache/
+.ruff_cache/
+
+# OS and Editor artifacts
+.DS_Store
+.AppleDouble
+.LSOverride
+Icon
+._*
+.Spotlight-V100
+.Trashes
+.idea/
+.vscode/
+*.swp
+*.swo
+
+# Environment and secrets (NEVER COMMIT)
+.env
+.env.*
+*.pem
+*.key
+*.cert
+secrets.json
+
+# Local runtime databases, telemetry, and execution outputs (LOCAL ONLY)
+data/*.db
+data/*.db-wal
+data/*.db-shm
+data/*.sqlite*
+data/*.json
+!data/evaluation/
+!data/traces/
+data/classification_prep/
+data/telemetry/
+data/db/
+data/cache/
+/reports/
+
+# Scratch and obsolete experiment directories
+scratch/
+experiments/
+
+# Node.js and web frontend dependencies
+node_modules/
+web/node_modules/
+web/dist/
+web/dist-landing/
+web/dist-docs/
+
+# Progress and local scratch docs
+docs/PROGRESS.md
+docs/SCAN_NOTES.md
+docs/PROGRESS_LOGO.md
+docs/PROGRESS_FINISH.md
+docs/PROGRESS_LANDING.md
+
+# Landing-page audit screenshots (third-party reference captures; keep local)
+artifacts/
+
+# landing site build output
+web/dist-landing/

runport-0.1.0/.gitleaksignore

@@ -0,0 +1,9 @@
+b2eee1d72bb1e2d282d539f1f13ea7550311540c:examples/plugins/kb_audit/tests/test_audit.py:generic-api-key:398
+c9a351004cd49eb404dfdc998c9a1be9ad1dc8a4:tests/test_env_config.py:generic-api-key:20
+7c2e2ec1afd475226228a0f1c2a602739b42d888:tests/classification/test_dataprep_hardening.py:generic-api-key:156
+60bcfc611a276c980b770c47d1717d52cb30d501:examples/plugins/kb_audit/tests/test_audit.py:generic-api-key:398
+f995bdfdf148294bf95e2a3955376e19d6026f1e:tests/classification/test_real_benchmark.py:generic-api-key:28
+# Placeholder values in docs examples and the landing-page animation (not secrets)
+1179841f06fe5713770e7493f4dd5fe6ad18ebd4:docs/SDK_API_CONTRACT.md:generic-api-key:53
+1179841f06fe5713770e7493f4dd5fe6ad18ebd4:docs/SDK_API_CONTRACT.md:generic-api-key:61
+40abbf0263875dff0f61f22ca0f3f8e229e5b94b:web/src/components/landing/FeatureBento.tsx:generic-api-key:141

runport-0.1.0/.pre-commit-config.yaml

@@ -0,0 +1,27 @@
+repos:
+  - repo: https://github.com/pre-commit/pre-commit-hooks
+    rev: v4.6.0
+    hooks:
+      - id: trailing-whitespace
+        exclude: ^web/package-lock\.json$
+      - id: end-of-file-fixer
+        exclude: ^web/package-lock\.json$
+      - id: check-yaml
+        args: [--unsafe]
+        exclude: ^mkdocs\.yml$
+      - id: check-json
+        exclude: ^web/package-lock\.json$
+      - id: check-added-large-files
+        args: [--maxkb=2000]
+
+  - repo: https://github.com/astral-sh/ruff-pre-commit
+    rev: v0.4.10
+    hooks:
+      - id: ruff
+        args: [--fix]
+      - id: ruff-format
+
+  - repo: https://github.com/gitleaks/gitleaks
+    rev: v8.18.4
+    hooks:
+      - id: gitleaks