opensentinel 3.1.1 → 3.7.0

package/README.md

@@ -1,20 +1,69 @@
 # OpenSentinel
 
 [![CI](https://github.com/dsiemon2/OpenSentinel/actions/workflows/ci.yml/badge.svg)](https://github.com/dsiemon2/OpenSentinel/actions/workflows/ci.yml)
+[![Version](https://img.shields.io/badge/version-3.6.1-blue)](https://github.com/dsiemon2/OpenSentinel/releases)
 [![TypeScript](https://img.shields.io/badge/TypeScript-5.7-blue?logo=typescript&logoColor=white)](https://www.typescriptlang.org/)
 [![Bun](https://img.shields.io/badge/Bun-runtime-f9f1e1?logo=bun&logoColor=black)](https://bun.sh/)
 [![Docker](https://img.shields.io/badge/Docker-compose-2496ED?logo=docker&logoColor=white)](https://www.docker.com/)
+[![Tests](https://img.shields.io/badge/tests-6%2C400%2B-brightgreen)](https://github.com/dsiemon2/OpenSentinel/actions)
 [![License: MIT](https://img.shields.io/badge/License-MIT-green.svg)](LICENSE)
+[![GitHub Stars](https://img.shields.io/github/stars/dsiemon2/OpenSentinel?style=social)](https://github.com/dsiemon2/OpenSentinel/stargazers)
 
-A self-hosted personal AI assistant powered by Claude, with JARVIS-like capabilities.
+**Your self-hosted AI assistant: 9 LLM providers, 300+ features, 124 tools, 10+ channels, smart home, OSINT, finance, and more.**
 
-**Website**: [opensentinel.ai](https://opensentinel.ai) | **Dashboard**: [app.opensentinel.ai](https://app.opensentinel.ai)
+**Website**: [opensentinel.ai](https://opensentinel.ai) | **Docs**: [docs.opensentinel.ai](https://docs.opensentinel.ai) | **Dashboard**: [app.opensentinel.ai](https://app.opensentinel.ai)
 
-## What is OpenSentinel?
 
-OpenSentinel is your own personal AI assistant that runs on your infrastructure. Think of it like having Jarvis from Iron Man -- you can talk to it, ask questions, and it can take actions on your behalf. It connects to Telegram, Discord, Slack, a web dashboard, and a REST API, all backed by Claude as the reasoning engine.
+---
 
-## Features
+## Recent Updates (2026-04-10)
+
+- All HTTP endpoints returning 200 OK
+- SSL certificates renewed (~90 day validity)
+- Login screens locked down (social buttons hidden, password eye toggle present)
+- CI/CD pipeline verified working with GitHub Secrets
+- No exposed API keys found in code
+- Removed stray `${SNIPPET}` template variable from the landing page (was rendering literally in production)
+
+---
+
+## Table of Contents
+
+- [Why OpenSentinel?](#why-opensentinel)
+- [Key Features](#key-features)
+- [Quick Start](#quick-start)
+- [How to Use](#how-to-use)
+- [Architecture](#architecture)
+- [Comparison](#comparison)
+- [Contributing](#contributing)
+- [Community](#community)
+
+---
+
+## Why OpenSentinel?
+
+OpenSentinel is a self-hosted personal AI assistant that runs on your infrastructure. Think JARVIS from Iron Man — talk to it via Telegram, Discord, Slack, or a web dashboard, and it takes action: controls your smart home, monitors your finances, searches public records, generates documents, and more.
+
+Unlike chat-only interfaces, OpenSentinel is a **full-stack AI platform** with 124 tools, sub-agents, workflow automation, RAG memory, and enterprise security — all self-hosted.
+
+**How it works**: You send a message (text, voice, or API call) → the Brain routes it to the right LLM provider → tools execute actions → you get a response with results.
+
+## Key Features
+
+| Category | Highlights |
+|----------|-----------|
+| **LLM Providers** | Anthropic Claude, OpenAI, xAI Grok, Google Gemini, Groq, Mistral, OpenRouter, Ollama, custom endpoints |
+| **Channels** | Telegram, Discord, Slack, Matrix, WhatsApp, Signal, iMessage, Zalo, Web Dashboard, Desktop App (Electron), Browser Extension |
+| **Smart Home** | Home Assistant device control, automation triggers |
+| **Finance** | Crypto trading (Coinbase/Binance), stocks, DeFi, Finnhub, FRED macroeconomic data |
+| **OSINT** | FEC, SEC EDGAR, IRS 990, USASpending, OpenCorporates, entity resolution, graph explorer |
+| **Productivity** | GitHub, Notion, Email (IMAP/SMTP), Google Drive, Dropbox, Spotify |
+| **Voice** | Wake word detection, VAD, speaker diarization, ElevenLabs TTS |
+| **Security** | AES-256-GCM encryption, 2FA, RBAC, SSO (SAML/OAuth/OIDC), audit logging, GDPR tools |
+| **AI** | Sub-agents, RAG memory (HyDE, re-ranking, graph RAG), ML pipeline, workflow automation |
+
+<details>
+<summary><strong>Full Feature List (300+ features)</strong></summary>
 
 ### Core Capabilities
 - Answer questions and have conversations
@@ -24,6 +73,8 @@ OpenSentinel is your own personal AI assistant that runs on your infrastructure.
 - Search the internet
 - Set reminders and scheduled tasks
 - Remember things about you (advanced RAG: HyDE, re-ranking, multi-step, graph RAG, caching)
+- Agentic RAG pipeline: tool pre-classification, memory middleware, pipeline orchestrator, Brain telemetry
+- ML algorithms (Naive Bayes, Isolation Forest, K-Means, Markov Chain, Linear Regression) for intent parsing, anomaly detection, and forecasting
 - Respond with voice (JARVIS voice via ElevenLabs)
 
 ### Advanced Voice
@@ -34,17 +85,12 @@ OpenSentinel is your own personal AI assistant that runs on your infrastructure.
 - Noise cancellation
 - Voice note summarization
 
-### Communication Platforms
-- Telegram bot with voice support
-- Discord bot with slash commands and voice channels
-- Slack bot with app mentions and threads
-- Matrix bot with mentions and DMs
-- Web dashboard
-- REST API
-
 ### Multi-Provider LLM
 - Anthropic Claude (default)
+- Google Gemini (1M context, vision, tool use)
 - OpenRouter, Groq, Mistral, OpenAI
+- xAI Grok
+- HuggingFace Inference API (text embeddings)
 - Ollama (local/offline models)
 - Any OpenAI-compatible endpoint
 - Automatic provider registration from env vars
@@ -58,6 +104,7 @@ OpenSentinel is your own personal AI assistant that runs on your infrastructure.
 
 ### Multi-Modal Input
 - Image understanding and analysis
+- Image/vision analysis from Web Chat uploads (base64 to Claude vision)
 - Document OCR
 - Screenshot interpretation
 - Video summarization
@@ -77,6 +124,8 @@ OpenSentinel is your own personal AI assistant that runs on your infrastructure.
 - Excel spreadsheets
 - Charts and diagrams
 - AI image generation (DALL-E)
+- Secure file download UI with token-based access (1-hour expiry)
+- Document parsing from uploads (PDF, DOCX, TXT, MD, HTML, CSV, JSON, XML, YAML)
 
 ### Personality System
 - 15 domain expert modes (coding, legal, medical, finance, etc.)
@@ -85,14 +134,13 @@ OpenSentinel is your own personal AI assistant that runs on your infrastructure.
 - Verbosity and humor controls
 
 ### Security
-- **Gateway token auth** (optional, disabled by default for self-hosted)
-- **AES-256-GCM field encryption** for data at rest
-- **Tamper-proof audit logs** with HMAC-SHA256 chain integrity
-- **Incident response system** with automated detection and escalation
+- Gateway token auth (optional, disabled by default for self-hosted)
+- AES-256-GCM field encryption for data at rest
+- Tamper-proof audit logs with HMAC-SHA256 chain integrity
+- Incident response system with automated detection and escalation
 - 2FA for sensitive operations (DB-persisted, encrypted secrets)
 - Biometric verification
 - Memory vault (encrypted storage)
-- Audit logging
 - GDPR compliance tools
 - Rate limiting
 - Autonomy levels (readonly/supervised/autonomous)
@@ -106,6 +154,8 @@ OpenSentinel is your own personal AI assistant that runs on your infrastructure.
 - Kubernetes deployment
 
 ### Observability
+- Brain Dashboard with real-time pipeline visualization, activity feed, and score gauges
+- Brain Telemetry event emitter with status state machine and metric accumulators
 - Metrics dashboard
 - Replay mode (re-run conversations)
 - Tool dry-run (preview without executing)
@@ -115,23 +165,21 @@ OpenSentinel is your own personal AI assistant that runs on your infrastructure.
 
 ### Integrations
 - **Email**: IMAP/SMTP with AI inbox summarization + web email client (read, compose, attachments)
+- **Microsoft 365 / Entra ID**: Graph-backed mail + SharePoint read/analysis + Claude-powered phishing/BEC + PII / policy analysis, OAuth with PKCE, encrypted token storage, chat-callable tools — see [`docs/M365_FEATURES.md`](docs/M365_FEATURES.md), [`docs/M365_INTEGRATION.md`](docs/M365_INTEGRATION.md), [`docs/M365_SHAREPOINT.md`](docs/M365_SHAREPOINT.md)
 - **SMS/Phone**: Twilio for calls and texts
 - **GitHub**: Repos, issues, PRs, AI code review
 - **Notion**: Pages, databases, search, sync
 - **Home Assistant**: Smart home device control
 - **Spotify**: Playback, playlists, search
 - **Cloud Storage**: Google Drive, Dropbox
-- **Finance**: Crypto, stocks, currency, portfolio tracking, exchange trading (Coinbase/Binance), DeFi data, on-chain analytics, order books, backtesting
+- **Finance**: Crypto, stocks, currency, portfolio tracking, exchange trading, DeFi, Finnhub, FRED
 
 ### OSINT & Public Records
-- **Graph Explorer**: D3.js force-directed knowledge graph visualization
-- **External API Search**: Auto-queries FEC, OpenCorporates when entities aren't in local DB
-- **Entity Resolution**: Jaro-Winkler fuzzy matching, exact/identifier/fuzzy/new resolution pipeline
-- **Public Records Clients**: FEC, SEC EDGAR, IRS 990, USASpending, OpenCorporates
-- **Rate Limiting**: Per-service sliding-window rate limiter for API compliance
-
-### Infrastructure
-- Built-in tunnels (Cloudflare, ngrok, localtunnel)
+- Graph Explorer: D3.js force-directed knowledge graph visualization
+- External API Search: Auto-queries FEC, OpenCorporates when entities aren't in local DB
+- Entity Resolution: Jaro-Winkler fuzzy matching pipeline
+- Public Records Clients: FEC, SEC EDGAR, IRS 990, USASpending, OpenCorporates
+- Rate Limiting: Per-service sliding-window rate limiter for API compliance
 
 ### Vision & Documents
 - Screen capture and webcam analysis
@@ -148,47 +196,42 @@ OpenSentinel is your own personal AI assistant that runs on your infrastructure.
 - **Electron Desktop App**: System tray, global hotkeys (Ctrl+Shift+M chat, Ctrl+Shift+O OpenSentinel)
 - **Browser Extension**: Chrome/Firefox popup chat, context menu
 
+### Infrastructure
+- Built-in tunnels (Cloudflare, ngrok, localtunnel)
+- Docker Compose (dev + hardened production config)
+
+</details>
+
 ## Quick Start
 
+### Docker (Fastest)
+
+```bash
+git clone https://github.com/dsiemon2/OpenSentinel.git
+cd OpenSentinel
+cp .env.example .env   # Add your API keys (at minimum ANTHROPIC_API_KEY)
+docker compose up -d   # Starts PostgreSQL + Redis
+bun install
+bun run db:migrate
+cd src/web && bun install && bun run build && cd ../..
+bun run start
+```
+
+Open [http://localhost:8030](http://localhost:8030) — no auth required by default (self-hosted).
+
+### Supported Platforms
+
+| Platform | Status |
+|----------|--------|
+| Linux (Ubuntu/Debian) | Recommended |
+| macOS | Supported |
+| Windows (WSL2) | Supported |
+| Docker | Supported |
+
 ### Prerequisites
 - [Bun](https://bun.sh) runtime
 - [Docker](https://docker.com) for PostgreSQL and Redis
-- API keys (Claude at minimum; see `.env.example` for all options)
-
-### Installation
-
-1. **Clone and install dependencies**
-   ```bash
-   git clone https://github.com/dsiemon2/OpenSentinel.git
-   cd OpenSentinel
-   bun install
-   ```
-
-2. **Set up environment variables**
-   ```bash
-   cp .env.example .env
-   # Edit .env with your API keys
-   ```
-
-3. **Start database services**
-   ```bash
-   docker compose up -d
-   ```
-
-4. **Run database migrations**
-   ```bash
-   bun run db:migrate
-   ```
-
-5. **Build the web dashboard**
-   ```bash
-   cd src/web && bun install && bun run build && cd ../..
-   ```
-
-6. **Start OpenSentinel**
-   ```bash
-   bun run start
-   ```
+- API keys (Claude at minimum; see `.env.example` for all providers)
 
 ## How to Use
 
@@ -210,7 +253,7 @@ curl -X POST http://localhost:8030/api/ask \
   -d '{"message": "Hello, what can you do?"}'
 ```
 
-## Commands (Telegram)
+### Telegram Commands
 
 | Command | Description |
 |---------|-------------|
@@ -239,13 +282,14 @@ curl -X POST http://localhost:8030/api/ask \
 │  Device Triggers     │                     │                    │
 │  Calendar            │                     │                    │
 ├─────────────────────────────────────────────────────────────────┤
-│  Providers: Anthropic, OpenRouter, Groq, Mistral, Ollama       │
+│  Providers: Anthropic, OpenAI, xAI, Gemini, Groq, Mistral,     │
+│             OpenRouter, Ollama, Custom                          │
 ├─────────────────────────────────────────────────────────────────┤
 │  Tools: Shell, Files, Browser, Search, OCR, Screenshots,       │
-│         Video, Image Analysis, File Generation                  │
+│         Video, Image Analysis, File Generation (124 tools)      │
 ├─────────────────────────────────────────────────────────────────┤
 │  Intelligence: Predictive, Relationship Graph, Temporal,       │
-│                Multi-lingual, Domain Experts                    │
+│                Multi-lingual, Domain Experts, ML Pipeline       │
 ├─────────────────────────────────────────────────────────────────┤
 │  Security: 2FA, Biometric, Vault, Audit, GDPR, Rate Limiting   │
 ├─────────────────────────────────────────────────────────────────┤
@@ -255,6 +299,25 @@ curl -X POST http://localhost:8030/api/ask \
 └─────────────────────────────────────────────────────────────────┘
 ```
 
+## Comparison
+
+| Feature | OpenSentinel | Open WebUI | Khoj | Leon AI |
+|---------|:---:|:---:|:---:|:---:|
+| LLM Providers | 9 | 3 | 3 | 1 |
+| Chat Channels | 11 | 1 | 2 | 1 |
+| Built-in Tools | 124 | ~20 | ~10 | ~30 |
+| Smart Home | Home Assistant | - | - | - |
+| Finance/Trading | Coinbase, Binance, Finnhub, FRED | - | - | - |
+| OSINT/Public Records | FEC, SEC, IRS, OpenCorporates | - | - | - |
+| Voice (Wake Word) | Yes | - | - | Yes |
+| RAG Memory | HyDE, Graph RAG, Re-ranking | Basic | Yes | - |
+| Sub-Agents | Yes | - | Yes | - |
+| Workflow Automation | IFTTT-like | - | - | - |
+| Enterprise SSO | SAML, OAuth, OIDC | LDAP | - | - |
+| Desktop App | Electron | - | - | - |
+| Browser Extension | Chrome/Firefox | - | Chrome | - |
+| Test Coverage | 6,400+ tests | Unknown | Unknown | Unknown |
+
 ## Project Structure
 
 ```
@@ -269,13 +332,12 @@ src/
 │   ├── agents/                 # Sub-agent system
 │   ├── enterprise/             # Multi-user, SSO, quotas
 │   ├── intelligence/           # Predictive, relationship, temporal
-│   ├── evolution/              # Evolution, achievements, modes
+│   ├── ml/                     # ML algorithms (Naive Bayes, Isolation Forest, K-Means)
 │   ├── observability/          # Metrics, replay, alerting
 │   ├── personality/            # Personas, mood, domain experts
 │   ├── plugins/                # Plugin system
 │   ├── providers/              # Multi-LLM provider abstraction
 │   ├── security/               # 2FA, vault, GDPR, audit
-│   ├── tunnel/                 # Built-in tunnel support
 │   └── workflows/              # Automation engine
 ├── inputs/
 │   ├── telegram/               # Telegram bot
@@ -288,29 +350,21 @@ src/
 │   └── voice/                  # Wake word, VAD, diarization
 ├── integrations/
 │   ├── email/                  # IMAP/SMTP email
-│   ├── twilio/                 # SMS/Phone calls
 │   ├── github/                 # GitHub API
 │   ├── notion/                 # Notion API
 │   ├── homeassistant/          # Home Assistant
 │   ├── spotify/                # Spotify API
-│   ├── cloud-storage/          # Google Drive, Dropbox
 │   ├── finance/                # Crypto, stocks, currency
-│   ├── public-records/         # FEC, SEC, IRS 990, USASpending, OpenCorporates
-│   ├── documents/              # Document ingestion
+│   ├── public-records/         # FEC, SEC, IRS 990, OpenCorporates
 │   └── vision/                 # Screen/webcam capture
-├── tools/
-│   ├── file-generation/        # PDF, Word, Excel, PPT, images
-│   └── rendering/              # Math, code, markdown
-├── outputs/
-│   ├── stt.ts                  # Speech-to-text
-│   └── tts.ts                  # Text-to-speech
-├── db/
-│   └── schema.ts               # Drizzle ORM schema
+├── tools/                      # 124 tool implementations
+├── outputs/                    # STT, TTS
+├── db/                         # Database schema
 └── web/                        # React dashboard
 
 desktop/                        # Electron desktop app
 extension/                      # Browser extension
-tests/                          # 155+ test files, 5,000+ tests
+tests/                          # 187 test files, 6,400+ tests
 ```
 
 ## Ports
@@ -319,7 +373,7 @@ tests/                          # 155+ test files, 5,000+ tests
 |---------|------|
 | OpenSentinel API + Dashboard | 8030 |
 | PostgreSQL | 5445 |
-| Redis | 6379 |
+| Redis | 6385 |
 
 ## Contributing
 
@@ -348,6 +402,7 @@ Found a bug or have a feature request? [Open an issue](https://github.com/dsiemo
 - **GitHub Issues**: [Report bugs and request features](https://github.com/dsiemon2/OpenSentinel/issues)
 - **GitHub Discussions**: [Ask questions and share ideas](https://github.com/dsiemon2/OpenSentinel/discussions)
 - **Website**: [opensentinel.ai](https://opensentinel.ai)
+- **Docs**: [docs.opensentinel.ai](https://docs.opensentinel.ai)
 
 ## License
 

package/dist/agent-manager-JZ4IM7XI.js

@@ -0,0 +1,39 @@
+import {
+  addAgentMessage,
+  addAgentProgress,
+  agentQueue,
+  agent_manager_default,
+  cancelAgent,
+  getAgent,
+  getAllAgents,
+  getRunningAgentCount,
+  getUserAgents,
+  shouldAgentStop,
+  spawnAgent,
+  updateAgentStatus,
+  updateAgentTokens
+} from "./chunk-WMFYI7XC.js";
+import "./chunk-YEDEAX6Y.js";
+import "./chunk-6ZNCY2GI.js";
+import "./chunk-WZAH34TG.js";
+import "./chunk-BBN4VCNK.js";
+import "./chunk-5BTVJR7R.js";
+import "./chunk-4KIHDIXZ.js";
+import "./chunk-ZIBRVA3Y.js";
+import "./chunk-UP2VWCW5.js";
+export {
+  addAgentMessage,
+  addAgentProgress,
+  agentQueue,
+  cancelAgent,
+  agent_manager_default as default,
+  getAgent,
+  getAllAgents,
+  getRunningAgentCount,
+  getUserAgents,
+  shouldAgentStop,
+  spawnAgent,
+  updateAgentStatus,
+  updateAgentTokens
+};
+//# sourceMappingURL=agent-manager-JZ4IM7XI.js.map