screenpipe-mcp 0.5.0 → 0.7.0

package/README.md

@@ -64,32 +64,42 @@ npx @modelcontextprotocol/inspector npx screenpipe-mcp
 
 ## Available Tools
 
-### Cross-Platform
-
-- **search-content** - Search through recorded screen content, audio transcriptions, and UI elements
-  - Full text search with content type filtering (OCR/Audio/UI)
-  - Time range and app/window filtering
-  - Pagination support
-
-- **pixel-control** - Control mouse and keyboard
-  - Type text, press keys, move mouse, click
-
-### macOS Only
-
-- **find-elements** - Find UI elements in applications by role
-- **click-element** - Click UI elements by accessibility ID
-- **fill-element** - Type text into UI elements
-- **scroll-element** - Scroll UI elements
-- **open-application** - Open applications by name
-- **open-url** - Open URLs in default browser
+### search-content
+Search through recorded screen content (OCR) and audio transcriptions:
+- Full text search with content type filtering (OCR/Audio/UI)
+- Time range and app/window filtering
+- Speaker filtering (by ID or name)
+- Pagination support
+
+### search-ui-events (macOS)
+Search UI input events captured via accessibility APIs. This is the third data modality alongside vision and audio:
+- **Event types**: `click`, `text`, `scroll`, `key`, `app_switch`, `window_focus`, `clipboard`
+- Filter by app, window, time range
+- `text` events show aggregated keyboard input (what was typed)
+- `click` events include accessibility element labels
+- `clipboard` events show copy/paste content
+
+### get-ui-event-stats (macOS)
+Get aggregated statistics of UI events:
+- Event counts grouped by app and event type
+- Useful for productivity analysis and app usage tracking
+
+### export-video
+Export screen recordings as video files:
+- Specify time range with start/end times
+- Configurable FPS for output video
 
 ## Example Queries in Claude
 
 - "Search for any mentions of 'rust' in my screen recordings"
 - "Find audio transcriptions from the last hour"
 - "Show me what was on my screen in VSCode yesterday"
-- "Open Safari and go to github.com"
-- "Find the search button in Chrome and click it"
+- "Export a video of my screen from 2-3pm today"
+- "Find what John said in our meeting about the database"
+- "What did I type in Slack today?" (uses search-ui-events)
+- "Show me my app usage statistics for the past 3 hours"
+- "What did I copy to clipboard recently?"
+- "Which apps did I switch between most today?"
 
 ## Requirements