reachy-nova 0.1.0__tar.gz

reachy_nova-0.1.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Ori Nachum
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

reachy_nova-0.1.0/PKG-INFO

@@ -0,0 +1,103 @@
+Metadata-Version: 2.4
+Name: reachy-nova
+Version: 0.1.0
+Summary: Reachy Nova - Voice, Vision & Browser AI for Reachy Mini
+Keywords: reachy-mini-app
+Requires-Python: >=3.12
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: reachy-mini
+Requires-Dist: boto3>=1.35.0
+Requires-Dist: aws_sdk_bedrock_runtime>=0.3.0
+Requires-Dist: nova-act>=3.0.0
+Requires-Dist: numpy
+Requires-Dist: opencv-python
+Requires-Dist: python-dotenv
+Requires-Dist: pyaudio
+Requires-Dist: ultralytics
+Requires-Dist: pymongo>=4.6.0
+Requires-Dist: neo4j>=5.0.0
+Requires-Dist: slack-bolt>=1.18.0
+Requires-Dist: paho-mqtt>=2.0.0
+Requires-Dist: pyyaml>=6.0
+Requires-Dist: nemo_toolkit[asr]
+Dynamic: license-file
+
+---
+title: Reachy Nova
+emoji: "\U0001F916"
+colorFrom: indigo
+colorTo: cyan
+sdk: static
+pinned: false
+short_description: Voice, Vision & Browser AI for Reachy Mini
+tags:
+ - reachy_mini
+ - reachy_mini_python_app
+---
+
+# Reachy Nova
+
+AI-powered brain for Reachy Mini, integrating three Amazon Nova services:
+
+- **Nova Sonic** - Real-time speech-to-speech conversation
+- **Nova 2 Lite** - Camera-based vision and scene understanding
+- **Nova Act** - Voice-controlled browser automation
+
+This project enables Reachy Mini to see, hear, speak, and interact with the digital world.
+
+<img width="1115" height="987" alt="image" src="https://github.com/user-attachments/assets/3b66f514-3384-47a8-8fd8-dc6f82faa38c" />
+
+
+## Documentation
+
+-   [**Architecture Overview**](docs/architecture.md): High-level system design.
+-   [**Component Documentation**](docs/components/): Detailed docs for each module.
+    -   [Nova Sonic (Voice)](docs/components/nova_sonic.md)
+    -   [Nova Vision (Sight)](docs/components/nova_vision.md)
+    -   [Nova Browser (Action)](docs/components/nova_browser.md)
+    -   [Tracking Manager](docs/components/tracking.md)
+    -   [Skills System](docs/components/skills.md)
+-   [**Main Application**](docs/main.md): Core loop and state management.
+-   [**Setup Guide**](docs/setup.md): detailed installation instructions.
+
+## Quick Start
+
+1.  **Install dependencies**:
+    ```bash
+    uv sync
+    ```
+
+2.  **Configure environment**:
+    ```bash
+    cp .env.sample .env
+    # Edit .env with your AWS credentials
+    ```
+
+3.  **Run**:
+    ```bash
+    uv run python -m reachy_nova.main
+    ```
+
+## Features
+
+- **Natural Conversation**: Talk to the robot naturally - it responds with voice via Nova Sonic.
+- **Visual Understanding**: The robot sees through its camera and describes what it sees.
+- **Browser Automation**: Say "search for..." or "look up..." to trigger Google searches and more.
+- **Smart Tracking**:
+    -   Tracks faces automatically.
+    -   Turns to look at speakers.
+    -   Reacts instantly to snaps/claps.
+- **Expressive Animations**: Mood-reactive antenna and head movements.
+- **Web Dashboard**: Monitor status at `http://localhost:8042`.
+
+## Project Structure
+
+-   `reachy_nova/`: Main package.
+    -   `main.py`: Entry point and orchestration.
+    -   `nova_sonic.py`: Voice interface.
+    -   `nova_vision.py`: Vision interface.
+    -   `nova_browser.py`: Browser automation.
+    -   `tracking.py`: Head tracking logic.
+-   `tools/`: Utility scripts (e.g., demos).
+-   `docs/`: Detailed documentation.

reachy_nova-0.1.0/README.md

@@ -0,0 +1,78 @@
+---
+title: Reachy Nova
+emoji: "\U0001F916"
+colorFrom: indigo
+colorTo: cyan
+sdk: static
+pinned: false
+short_description: Voice, Vision & Browser AI for Reachy Mini
+tags:
+ - reachy_mini
+ - reachy_mini_python_app
+---
+
+# Reachy Nova
+
+AI-powered brain for Reachy Mini, integrating three Amazon Nova services:
+
+- **Nova Sonic** - Real-time speech-to-speech conversation
+- **Nova 2 Lite** - Camera-based vision and scene understanding
+- **Nova Act** - Voice-controlled browser automation
+
+This project enables Reachy Mini to see, hear, speak, and interact with the digital world.
+
+<img width="1115" height="987" alt="image" src="https://github.com/user-attachments/assets/3b66f514-3384-47a8-8fd8-dc6f82faa38c" />
+
+
+## Documentation
+
+-   [**Architecture Overview**](docs/architecture.md): High-level system design.
+-   [**Component Documentation**](docs/components/): Detailed docs for each module.
+    -   [Nova Sonic (Voice)](docs/components/nova_sonic.md)
+    -   [Nova Vision (Sight)](docs/components/nova_vision.md)
+    -   [Nova Browser (Action)](docs/components/nova_browser.md)
+    -   [Tracking Manager](docs/components/tracking.md)
+    -   [Skills System](docs/components/skills.md)
+-   [**Main Application**](docs/main.md): Core loop and state management.
+-   [**Setup Guide**](docs/setup.md): detailed installation instructions.
+
+## Quick Start
+
+1.  **Install dependencies**:
+    ```bash
+    uv sync
+    ```
+
+2.  **Configure environment**:
+    ```bash
+    cp .env.sample .env
+    # Edit .env with your AWS credentials
+    ```
+
+3.  **Run**:
+    ```bash
+    uv run python -m reachy_nova.main
+    ```
+
+## Features
+
+- **Natural Conversation**: Talk to the robot naturally - it responds with voice via Nova Sonic.
+- **Visual Understanding**: The robot sees through its camera and describes what it sees.
+- **Browser Automation**: Say "search for..." or "look up..." to trigger Google searches and more.
+- **Smart Tracking**:
+    -   Tracks faces automatically.
+    -   Turns to look at speakers.
+    -   Reacts instantly to snaps/claps.
+- **Expressive Animations**: Mood-reactive antenna and head movements.
+- **Web Dashboard**: Monitor status at `http://localhost:8042`.
+
+## Project Structure
+
+-   `reachy_nova/`: Main package.
+    -   `main.py`: Entry point and orchestration.
+    -   `nova_sonic.py`: Voice interface.
+    -   `nova_vision.py`: Vision interface.
+    -   `nova_browser.py`: Browser automation.
+    -   `tracking.py`: Head tracking logic.
+-   `tools/`: Utility scripts (e.g., demos).
+-   `docs/`: Detailed documentation.

reachy_nova-0.1.0/docker/nervous-system/heartbeat.py

@@ -0,0 +1,45 @@
+"""Heartbeat — publishes periodic tick events to MQTT."""
+
+import json
+import logging
+import threading
+import time
+import uuid
+from datetime import datetime, timezone
+
+logger = logging.getLogger(__name__)
+
+
+class Heartbeat:
+    """Publishes periodic time events to MQTT."""
+
+    def __init__(self, mqtt_client, interval: int = 60):
+        self.client = mqtt_client
+        self.interval = interval
+        self._thread = None
+
+    def start(self, stop_event: threading.Event):
+        def _run():
+            tick_count = 0
+            while not stop_event.is_set():
+                stop_event.wait(timeout=self.interval)
+                if stop_event.is_set():
+                    break
+                tick_count += 1
+                event = {
+                    "event_id": str(uuid.uuid4()),
+                    "type": "tick",
+                    "source": "heartbeat",
+                    "payload": {
+                        "interval": self.interval,
+                        "tick_count": tick_count,
+                        "wall_clock": datetime.now(timezone.utc).isoformat(),
+                    },
+                    "timestamp": time.time(),
+                }
+                self.client.publish("nova/heartbeat", json.dumps(event))
+                logger.debug(f"Heartbeat tick #{tick_count}")
+
+        self._thread = threading.Thread(target=_run, daemon=True, name="heartbeat")
+        self._thread.start()
+        logger.info(f"Heartbeat started (interval={self.interval}s)")