neoagent 2.4.2-beta.5 → 2.4.2-beta.7

package/README.md

@@ -6,53 +6,83 @@
 
 <p align="center"><strong>Your agent. Your server. Your rules.</strong></p>
 
+<p align="center">A self-hosted AI agent that runs as a service, operates Android over ADB, and connects to 15+ messaging platforms while keeping credentials on your server.</p>
+
 <p align="center">
+  <a href="https://www.npmjs.com/package/neoagent"><img src="https://img.shields.io/npm/v/neoagent?style=flat-square&label=npm" alt="npm version"></a>
   <a href="https://nodejs.org"><img src="https://img.shields.io/badge/Node.js-20+-5fa04e?style=flat-square&logo=node.js&logoColor=white" alt="Node.js"></a>
   <a href="https://sqlite.org"><img src="https://img.shields.io/badge/SQLite-WAL-003b57?style=flat-square&logo=sqlite&logoColor=white" alt="SQLite"></a>
   <a href="https://flutter.dev"><img src="https://img.shields.io/badge/Flutter-web%20%2B%20android-02569B?style=flat-square&logo=flutter&logoColor=white" alt="Flutter"></a>
   <a href="LICENSE"><img src="https://img.shields.io/badge/License-AGPL--3.0-a855f7?style=flat-square" alt="License"></a>
 </p>
 
-<p align="center">Self-hosted AI agent — runs as a system service, controls Android over ADB, connects to 15+ messaging platforms, all credentials on your server.</p>
-
 <p align="center">
   <img src="demo.gif" alt="NeoAgent demo" width="100%">
 </p>
 
-| | | | |
-| --- | --- | --- | --- |
-| <img alt="WebUI" src="https://github.com/user-attachments/assets/3c76d59a-b6e3-4698-929b-9c94741ccf1e" height="420"> | <img height="494" alt="Android" src="https://github.com/user-attachments/assets/e8a0af7a-6881-485d-ad52-f3bc6f2023ca"> | <img alt="Mobile Telegram" src="https://github.com/user-attachments/assets/1fd41a9b-5452-4aa4-9478-888c8ad7363a" height="420"> | <img height="494" alt="image" src="https://github.com/user-attachments/assets/d5a57282-0851-4902-9588-d8de4b82d45c"> |
+## Why NeoAgent
 
-- **Android control** — screenshot, observe UI, tap, swipe, type, launch apps, install APKs, `adb shell` — the agent operates Android, not just an app running on it
-- **15+ messaging platforms** — Telegram, WhatsApp, Discord, Signal, Slack, Matrix, iMessage, IRC, LINE, Mattermost, Telnyx Voice
-- **Integrations** — Google Workspace, Microsoft 365, Notion, Home Assistant, Trello, Spotify, Figma
-- **Browser + shell** — VM-isolated server-side browser automation, full PTY terminal
-- **Runs locally** — Ollama support, no API key required; credentials stay in `~/.neoagent/.env`, never in the client
+| Android that the agent can operate | Credentials that stay server-side |
+| --- | --- |
+| NeoAgent can inspect the UI, take screenshots, tap, swipe, type, launch apps, install APKs, and run `adb shell` against a connected device or emulator. | API keys, OAuth tokens, messaging credentials, history, and runtime data are stored under `~/.neoagent` on the server, never in the client. |
 
-## Install
+## Quick Start
+
+Requires Node.js 20 or newer.
 
 ```bash
 npm install -g neoagent
 neoagent install
 ```
 
-`neoagent install` runs a preflight, writes a secure default config when setup
-cannot prompt, installs Node dependencies, builds or uses the bundled web
-client, bootstraps supported system tools where possible, and starts the
-service. Available at **http://localhost:3333** when complete.
+`neoagent install` checks the host, creates secure runtime configuration,
+installs dependencies and supported system tools, and starts the service. Open
+**http://localhost:3333** when it finishes.
+
+No hosted-model key is required when using local [Ollama](https://ollama.com/).
+See [Getting Started](docs/getting-started.md) for prerequisites and first-run
+setup.
+
+## What It Does
+
+- **15+ messaging platforms**: Telegram, WhatsApp, Discord, Signal, Slack, Matrix, iMessage, Teams, IRC, LINE, Mattermost, Telnyx Voice, and webhook bridges.
+- **Automation**: cron schedules, integration and weather triggers, reusable skills, MCP tools, and subagents.
+- **Browser and shell**: an isolated browser runtime plus a full PTY terminal on the NeoAgent server.
+- **Integrations**: Google Workspace, Microsoft 365, Notion, Home Assistant, Trello, Spotify, Slack, Figma, GitHub, and more.
+- **Recordings and memory**: audio capture, transcription, transcript search, long-term memory, session history, and health summaries.
+- **Model choice**: Anthropic, OpenAI, Gemini, Grok, MiniMax, NVIDIA NIM, OpenRouter, GitHub Copilot, OpenAI Codex, or local Ollama.
 
-## Manage
+## Interfaces
+
+| | | | |
+| --- | --- | --- | --- |
+| <img alt="WebUI" src="https://github.com/user-attachments/assets/3c76d59a-b6e3-4698-929b-9c94741ccf1e" height="420"> | <img height="494" alt="Android" src="https://github.com/user-attachments/assets/e8a0af7a-6881-485d-ad52-f3bc6f2023ca"> | <img alt="Mobile Telegram" src="https://github.com/user-attachments/assets/1fd41a9b-5452-4aa4-9478-888c8ad7363a" height="420"> | <img height="494" alt="image" src="https://github.com/user-attachments/assets/d5a57282-0851-4902-9588-d8de4b82d45c"> |
+
+## Service Commands
 
 ```bash
 neoagent status
+neoagent start
+neoagent stop
+neoagent restart
 neoagent update
 neoagent fix
 neoagent logs
 ```
 
-## Links
+## Project Status
+
+NeoAgent is beta software maintained by one person. Expect rough edges, and
+please report failures with enough detail to reproduce them. Contributions to
+the backend, Flutter clients, integrations, skills, tests, and documentation
+are welcome.
+
+Read [CONTRIBUTING.md](CONTRIBUTING.md) before opening a pull request. Security
+issues should be reported privately according to [SECURITY.md](SECURITY.md).
+
+## Documentation
 
-[Docs](https://neolabs-systems.github.io/NeoAgent/docs/) | [Getting Started](docs/getting-started.md) | [Configuration](docs/configuration.md) | [Capabilities](docs/capabilities.md) | [Why NeoAgent](docs/why-neoagent.md) | [Issues](https://github.com/NeoLabs-Systems/NeoAgent/issues)
+[Docs](https://neolabs-systems.github.io/NeoAgent/docs/) | [Getting Started](docs/getting-started.md) | [Configuration](docs/configuration.md) | [Capabilities](docs/capabilities.md) | [Skills and MCP](docs/skills.md) | [Operations](docs/operations.md) | [Discussions](https://github.com/NeoLabs-Systems/NeoAgent/discussions) | [Issues](https://github.com/NeoLabs-Systems/NeoAgent/issues)
 
 ---
 

package/flutter_app/lib/main_controller.dart

@@ -1658,7 +1658,6 @@ class NeoAgentController extends ChangeNotifier {
   }
 
   void setSelectedSection(AppSection section) {
-    final previousSection = selectedSection;
     selectedSection = section;
     unawaited(_prefs?.setString(_selectedSectionPrefsKey, section.name));
     if (section == AppSection.devices) {

package/flutter_app/lib/main_models.dart

@@ -2059,6 +2059,7 @@ class ModelMeta {
   final bool available;
   final String providerStatus;
   final String providerStatusLabel;
+
   /// Pricing tier: 'free' | 'cheap' | 'medium' | 'expensive' | null (unknown)
   final String? priceTier;
 }
@@ -2308,18 +2309,33 @@ class TokenUsageSnapshot {
     required this.avgTokensPerRun,
     required this.last7DaysTokens,
     required this.last7DaysRuns,
+    required this.cachedReadTokens,
+    required this.cacheWriteTokens,
+    required this.reasoningTokens,
+    required this.modelCallCount,
+    required this.cacheHitRatio,
+    this.estimatedCostUsd,
   });
 
   factory TokenUsageSnapshot.fromJson(Map<dynamic, dynamic> json) {
     final totals = json['totals'] is Map
         ? Map<String, dynamic>.from(json['totals'] as Map)
         : const <String, dynamic>{};
+    final modelUsage = json['modelUsage'] is Map
+        ? Map<String, dynamic>.from(json['modelUsage'] as Map)
+        : const <String, dynamic>{};
     return TokenUsageSnapshot(
       totalTokens: _asInt(totals['totalTokens']),
       totalRuns: _asInt(totals['totalRuns']),
       avgTokensPerRun: _asInt(totals['avgTokensPerRun']),
       last7DaysTokens: _asInt(totals['last7DaysTokens']),
       last7DaysRuns: _asInt(totals['last7DaysRuns']),
+      cachedReadTokens: _asInt(modelUsage['cachedReadTokens']),
+      cacheWriteTokens: _asInt(modelUsage['cacheWriteTokens']),
+      reasoningTokens: _asInt(modelUsage['reasoningTokens']),
+      modelCallCount: _asInt(modelUsage['callCount']),
+      cacheHitRatio: (modelUsage['cacheHitRatio'] as num?)?.toDouble() ?? 0,
+      estimatedCostUsd: (modelUsage['estimatedCostUsd'] as num?)?.toDouble(),
     );
   }
 
@@ -2328,12 +2344,24 @@ class TokenUsageSnapshot {
   final int avgTokensPerRun;
   final int last7DaysTokens;
   final int last7DaysRuns;
+  final int cachedReadTokens;
+  final int cacheWriteTokens;
+  final int reasoningTokens;
+  final int modelCallCount;
+  final double cacheHitRatio;
+  final double? estimatedCostUsd;
 
   String get totalTokensLabel => _formatNumber(totalTokens);
   String get totalRunsLabel => _formatNumber(totalRuns);
   String get avgTokensPerRunLabel => _formatNumber(avgTokensPerRun);
   String get last7DaysTokensLabel => _formatNumber(last7DaysTokens);
   String get last7DaysRunsLabel => _formatNumber(last7DaysRuns);
+  String get cachedReadTokensLabel => _formatNumber(cachedReadTokens);
+  String get cacheHitRatioLabel =>
+      '${(cacheHitRatio * 100).toStringAsFixed(1)}%';
+  String get estimatedCostLabel => estimatedCostUsd == null
+      ? 'Unknown'
+      : '\$${estimatedCostUsd!.toStringAsFixed(4)}';
 }
 
 class UpdateStatusSnapshot {

package/flutter_app/lib/main_operations.dart

@@ -5629,7 +5629,7 @@ class _TasksPanelState extends State<TasksPanel> {
       );
     }
     return DropdownButtonFormField<int>(
-      value: accounts.any((a) => a.id == selectedConnectionId.value)
+      initialValue: accounts.any((a) => a.id == selectedConnectionId.value)
           ? selectedConnectionId.value
           : null,
       isExpanded: true,

package/flutter_app/lib/main_settings.dart

@@ -489,20 +489,6 @@ class _SettingsPanelState extends State<SettingsPanel> {
     );
   }
 
-  Widget _inlineProgressIndicator() {
-    return SizedBox(
-      width: 28,
-      child: ClipRRect(
-        borderRadius: BorderRadius.circular(999),
-        child: LinearProgressIndicator(
-          minHeight: 3,
-          backgroundColor: Colors.white.withValues(alpha: 0.28),
-          color: Colors.white,
-        ),
-      ),
-    );
-  }
-
   Widget _buildSettingsOverview(
     NeoAgentController controller,
     int availableModelCount,
@@ -1546,6 +1532,15 @@ class _SettingsPanelState extends State<SettingsPanel> {
                   Text(
                     'Avg/run: ${controller.tokenUsage!.avgTokensPerRunLabel} tokens',
                   ),
+                  const SizedBox(height: 6),
+                  Text(
+                    'Prompt cache: ${controller.tokenUsage!.cachedReadTokensLabel} cached tokens '
+                    '(${controller.tokenUsage!.cacheHitRatioLabel} hit ratio)',
+                  ),
+                  const SizedBox(height: 6),
+                  Text(
+                    'Measured model cost: ${controller.tokenUsage!.estimatedCostLabel}',
+                  ),
                 ],
               ),
           ],

package/flutter_app/lib/main_shared.dart

@@ -3440,15 +3440,6 @@ String _modelLabelForValue(String value, List<ModelMeta> models) {
   return value;
 }
 
-String _friendlyBaseUrlLabel(String value) {
-  final uri = Uri.tryParse(value);
-  if (uri == null || uri.host.trim().isEmpty) {
-    return value;
-  }
-  final port = uri.hasPort ? ':${uri.port}' : '';
-  return '${uri.host}$port';
-}
-
 String? _androidRuntimeVersionLabel(Map<String, dynamic> runtime) {
   final apiLevel = _asInt(runtime['apiLevel']);
   final systemImage = runtime['systemImage']?.toString().trim() ?? '';

package/flutter_app/lib/main_unified.dart

@@ -2,8 +2,6 @@ part of 'main.dart';
 
 enum _ToolsPageTab { integrations, mcp, skills }
 
-enum _RunsPageTab { runs }
-
 enum _SettingsWorkspaceSection { app, account, security }
 
 class ToolsPanel extends StatefulWidget {

package/flutter_app/lib/src/backend_client.dart

@@ -1055,6 +1055,14 @@ class BackendClient {
     return getList(baseUrl, '/api/skills');
   }
 
+  Future<List<Map<String, dynamic>>> fetchSkillMetrics(String baseUrl) {
+    return getList(baseUrl, '/api/skills/metrics/summary');
+  }
+
+  Future<List<Map<String, dynamic>>> fetchSkillAudit(String baseUrl) {
+    return getList(baseUrl, '/api/skills/audit/summary');
+  }
+
   Future<List<Map<String, dynamic>>> fetchSkillStore(String baseUrl) async {
     return getList(baseUrl, '/api/store');
   }

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "neoagent",
-  "version": "2.4.2-beta.5",
+  "version": "2.4.2-beta.7",
   "description": "Proactive personal AI agent with no limits",
   "license": "AGPL-3.0-only",
   "main": "server/index.js",

package/server/db/database.js

@@ -764,6 +764,112 @@ db.exec(`
   CREATE INDEX IF NOT EXISTS idx_agent_run_events_run ON agent_run_events(run_id, sequence_index, id);
   CREATE INDEX IF NOT EXISTS idx_agent_run_events_user ON agent_run_events(user_id, created_at DESC);
 
+  CREATE TABLE IF NOT EXISTS agent_model_usage (
+    id INTEGER PRIMARY KEY AUTOINCREMENT,
+    run_id TEXT NOT NULL,
+    step_id TEXT,
+    user_id INTEGER NOT NULL,
+    agent_id TEXT,
+    provider TEXT NOT NULL,
+    model TEXT NOT NULL,
+    phase TEXT DEFAULT 'model_turn',
+    input_tokens INTEGER DEFAULT 0,
+    output_tokens INTEGER DEFAULT 0,
+    reasoning_tokens INTEGER DEFAULT 0,
+    cached_read_tokens INTEGER DEFAULT 0,
+    cache_write_tokens INTEGER DEFAULT 0,
+    total_tokens INTEGER DEFAULT 0,
+    estimated_cost_usd REAL,
+    latency_ms INTEGER DEFAULT 0,
+    metadata_json TEXT DEFAULT '{}',
+    created_at TEXT DEFAULT (datetime('now')),
+    FOREIGN KEY (run_id) REFERENCES agent_runs(id) ON DELETE CASCADE,
+    FOREIGN KEY (user_id) REFERENCES users(id) ON DELETE CASCADE,
+    FOREIGN KEY (agent_id) REFERENCES agents(id) ON DELETE SET NULL,
+    FOREIGN KEY (step_id) REFERENCES agent_steps(id) ON DELETE SET NULL
+  );
+
+  CREATE INDEX IF NOT EXISTS idx_agent_model_usage_run ON agent_model_usage(run_id, id);
+  CREATE INDEX IF NOT EXISTS idx_agent_model_usage_user ON agent_model_usage(user_id, created_at DESC);
+
+  CREATE TABLE IF NOT EXISTS workspace_code_index (
+    id INTEGER PRIMARY KEY AUTOINCREMENT,
+    user_id INTEGER NOT NULL,
+    path TEXT NOT NULL,
+    symbol TEXT,
+    symbol_type TEXT,
+    start_line INTEGER,
+    end_line INTEGER,
+    content TEXT NOT NULL,
+    content_hash TEXT NOT NULL,
+    embedding TEXT,
+    updated_at TEXT DEFAULT (datetime('now')),
+    FOREIGN KEY (user_id) REFERENCES users(id) ON DELETE CASCADE,
+    UNIQUE(user_id, path, symbol, start_line)
+  );
+
+  CREATE INDEX IF NOT EXISTS idx_workspace_code_index_user
+    ON workspace_code_index(user_id, path);
+
+  CREATE TABLE IF NOT EXISTS task_webhook_deliveries (
+    id TEXT PRIMARY KEY,
+    task_id INTEGER NOT NULL,
+    user_id INTEGER NOT NULL,
+    request_id TEXT NOT NULL,
+    payload_hash TEXT NOT NULL,
+    status TEXT NOT NULL DEFAULT 'accepted',
+    response_json TEXT DEFAULT '{}',
+    created_at TEXT DEFAULT (datetime('now')),
+    completed_at TEXT,
+    FOREIGN KEY (task_id) REFERENCES scheduled_tasks(id) ON DELETE CASCADE,
+    FOREIGN KEY (user_id) REFERENCES users(id) ON DELETE CASCADE,
+    UNIQUE(task_id, request_id)
+  );
+
+  CREATE TABLE IF NOT EXISTS task_webhook_secrets (
+    task_id INTEGER PRIMARY KEY,
+    user_id INTEGER NOT NULL,
+    secret_encrypted TEXT NOT NULL,
+    secret_fingerprint TEXT NOT NULL,
+    rotated_at TEXT DEFAULT (datetime('now')),
+    created_at TEXT DEFAULT (datetime('now')),
+    FOREIGN KEY (task_id) REFERENCES scheduled_tasks(id) ON DELETE CASCADE,
+    FOREIGN KEY (user_id) REFERENCES users(id) ON DELETE CASCADE
+  );
+
+  CREATE INDEX IF NOT EXISTS idx_task_webhook_deliveries_task
+    ON task_webhook_deliveries(task_id, created_at DESC);
+
+  CREATE TABLE IF NOT EXISTS skill_metrics (
+    user_id INTEGER NOT NULL,
+    agent_id TEXT,
+    skill_name TEXT NOT NULL,
+    invocation_count INTEGER DEFAULT 0,
+    success_count INTEGER DEFAULT 0,
+    failure_count INTEGER DEFAULT 0,
+    correction_count INTEGER DEFAULT 0,
+    total_tokens INTEGER DEFAULT 0,
+    last_used_at TEXT,
+    metadata_json TEXT DEFAULT '{}',
+    updated_at TEXT DEFAULT (datetime('now')),
+    PRIMARY KEY (user_id, agent_id, skill_name),
+    FOREIGN KEY (user_id) REFERENCES users(id) ON DELETE CASCADE,
+    FOREIGN KEY (agent_id) REFERENCES agents(id) ON DELETE SET NULL
+  );
+
+  CREATE TABLE IF NOT EXISTS skill_workflow_observations (
+    user_id INTEGER NOT NULL,
+    agent_id TEXT NOT NULL,
+    workflow_signature TEXT NOT NULL,
+    observation_count INTEGER DEFAULT 0,
+    latest_run_id TEXT,
+    first_observed_at TEXT DEFAULT (datetime('now')),
+    last_observed_at TEXT DEFAULT (datetime('now')),
+    PRIMARY KEY (user_id, agent_id, workflow_signature),
+    FOREIGN KEY (user_id) REFERENCES users(id) ON DELETE CASCADE,
+    FOREIGN KEY (agent_id) REFERENCES agents(id) ON DELETE CASCADE
+  );
+
   CREATE TABLE IF NOT EXISTS agent_settings (
     id INTEGER PRIMARY KEY AUTOINCREMENT,
     user_id INTEGER NOT NULL,
@@ -1159,6 +1265,12 @@ for (const col of [
   "ALTER TABLE desktop_companion_devices ADD COLUMN last_seen_at TEXT",
   "ALTER TABLE desktop_companion_devices ADD COLUMN revoked_at TEXT",
   "ALTER TABLE desktop_companion_devices ADD COLUMN updated_at TEXT DEFAULT (datetime('now'))",
+  "ALTER TABLE memory_facts ADD COLUMN valid_from TEXT",
+  "ALTER TABLE memory_facts ADD COLUMN valid_to TEXT",
+  "ALTER TABLE memory_facts ADD COLUMN learned_at TEXT",
+  "ALTER TABLE memory_facts ADD COLUMN invalidated_at TEXT",
+  "ALTER TABLE memory_facts ADD COLUMN status TEXT DEFAULT 'active'",
+  "ALTER TABLE memory_facts ADD COLUMN supersedes_fact_id TEXT",
 ]) {
   try { db.exec(col); } catch { /* column already exists */ }
 }

package/server/http/routes.js

@@ -21,6 +21,7 @@ const routeRegistry = [
   { basePath: '/api/workspace', modulePath: '../routes/workspace' },
   { basePath: '/api/memory', modulePath: '../routes/memory' },
   { basePath: '/api/tasks', modulePath: '../routes/tasks' },
+  { basePath: '/api/task-webhooks', modulePath: '../routes/task_webhooks' },
   { basePath: '/api/widgets', modulePath: '../routes/widgets' },
   { basePath: '/api/browser', modulePath: '../routes/browser' },
   { basePath: '/api/browser-extension', modulePath: '../routes/browser_extension' },

package/server/public/.last_build_id

@@ -1 +1 @@
-15d41acc002ea2eaaa9deb2490573dd5
+ec945bff38eacd619d4434e746ae61aa

package/server/public/flutter_bootstrap.js

@@ -33,10 +33,10 @@ addEventListener("message", eventListener);
 if (!window._flutter) {
   window._flutter = {};
 }
-_flutter.buildConfig = {"engineRevision":"c416acfeb8126e097f758c664aaa3da929e27da0","builds":[{"compileTarget":"dart2js","renderer":"canvaskit","mainJsPath":"main.dart.js"},{}]};
+_flutter.buildConfig = {"engineRevision":"77e2e94772b6eb43759e34ed1ad7da4674e19cab","builds":[{"compileTarget":"dart2js","renderer":"canvaskit","mainJsPath":"main.dart.js"},{}]};
 
 _flutter.loader.load({
   serviceWorkerSettings: {
-    serviceWorkerVersion: "3772976219" /* Flutter's service worker is deprecated and will be removed in a future Flutter release. */
+    serviceWorkerVersion: "1556394997" /* Flutter's service worker is deprecated and will be removed in a future Flutter release. */
   }
 });