machinaos 0.0.12 → 0.0.13

package/server/skills/android_agent/camera-skill/SKILL.md

@@ -0,0 +1,148 @@
+---
+name: camera-skill
+description: Control Android camera - get camera info, take photos, and access camera capabilities.
+allowed-tools: camera_control
+metadata:
+  author: machina
+  version: "1.0"
+  category: android
+  icon: "📷"
+  color: "#EC4899"
+---
+
+# Camera Control Tool
+
+Control camera on Android device.
+
+## How It Works
+
+This skill provides instructions for the **Camera Control** tool node. Connect the **Camera Control** node to Zeenie's `input-tools` handle to enable camera control.
+
+## camera_control Tool
+
+Access camera and capture photos.
+
+### Schema Fields
+
+| Field | Type | Required | Description |
+|-------|------|----------|-------------|
+| action | string | Yes | Action to perform (see below) |
+| parameters | object | No | Additional parameters |
+
+### Actions
+
+| Action | Description |
+|--------|-------------|
+| `status` | Get camera info and capabilities |
+| `capture` | Take a photo |
+
+### Examples
+
+**Get camera info:**
+```json
+{
+  "action": "status"
+}
+```
+
+**Take a photo:**
+```json
+{
+  "action": "capture"
+}
+```
+
+**Capture with front camera:**
+```json
+{
+  "action": "capture",
+  "parameters": {
+    "camera": "front"
+  }
+}
+```
+
+### Response Formats
+
+**Status response:**
+```json
+{
+  "success": true,
+  "service": "camera_control",
+  "action": "status",
+  "data": {
+    "cameras": [
+      {
+        "id": "0",
+        "facing": "back",
+        "megapixels": 48,
+        "has_flash": true,
+        "supports_video": true
+      },
+      {
+        "id": "1",
+        "facing": "front",
+        "megapixels": 12,
+        "has_flash": false,
+        "supports_video": true
+      }
+    ],
+    "flash_available": true
+  }
+}
+```
+
+**Capture response:**
+```json
+{
+  "success": true,
+  "service": "camera_control",
+  "action": "capture",
+  "data": {
+    "photo_path": "/storage/emulated/0/DCIM/Camera/IMG_20250130_120000.jpg",
+    "camera_used": "back",
+    "resolution": "4000x3000",
+    "timestamp": "2025-01-30T12:00:00Z"
+  }
+}
+```
+
+### Response Fields
+
+| Field | Description |
+|-------|-------------|
+| cameras | List of available cameras |
+| facing | `"back"` or `"front"` |
+| megapixels | Camera resolution |
+| has_flash | Flash available |
+| photo_path | Path to captured photo |
+
+## Use Cases
+
+| Use Case | Action | Description |
+|----------|--------|-------------|
+| Check cameras | status | Get camera capabilities |
+| Take photo | capture | Capture image |
+| Selfie | capture (front) | Use front camera |
+| Document | capture | Capture document/scene |
+
+## Common Workflows
+
+### Quick photo capture
+
+1. Optionally check camera status
+2. Capture photo
+3. Photo saved to device gallery
+
+### Automated documentation
+
+1. Trigger (time/event based)
+2. Capture photo
+3. Process/send photo
+
+## Setup Requirements
+
+1. Connect the **Camera Control** node to Zeenie's `input-tools` handle
+2. Android device must be paired
+3. Camera permission must be granted
+4. Storage permission for saving photos

package/server/skills/android_agent/environmental-skill/SKILL.md

@@ -0,0 +1,140 @@
+---
+name: environmental-skill
+description: Get Android environmental sensor data - temperature, humidity, pressure, and ambient light level.
+allowed-tools: environmental_sensors
+metadata:
+  author: machina
+  version: "1.0"
+  category: android
+  icon: "🌡️"
+  color: "#84CC16"
+---
+
+# Environmental Sensors Tool
+
+Access environmental sensors on Android device.
+
+## How It Works
+
+This skill provides instructions for the **Environmental Sensors** tool node. Connect the **Environmental Sensors** node to Zeenie's `input-tools` handle to enable environmental sensing.
+
+## environmental_sensors Tool
+
+Get temperature, humidity, pressure, and light data.
+
+### Schema Fields
+
+| Field | Type | Required | Description |
+|-------|------|----------|-------------|
+| action | string | Yes | `"status"` - Get sensor data |
+
+### Example
+
+**Get environmental data:**
+```json
+{
+  "action": "status"
+}
+```
+
+### Response Format
+
+```json
+{
+  "success": true,
+  "service": "environmental_sensors",
+  "action": "status",
+  "data": {
+    "temperature": 23.5,
+    "humidity": 45.0,
+    "pressure": 1013.25,
+    "light": 350.0,
+    "sensors_available": {
+      "temperature": true,
+      "humidity": true,
+      "pressure": true,
+      "light": true
+    }
+  }
+}
+```
+
+### Response Fields
+
+| Field | Type | Unit | Description |
+|-------|------|------|-------------|
+| temperature | float | Celsius | Ambient temperature |
+| humidity | float | % | Relative humidity |
+| pressure | float | hPa | Atmospheric pressure |
+| light | float | lux | Ambient light level |
+| sensors_available | object | - | Which sensors exist |
+
+### Sensor Availability
+
+Not all devices have all sensors. Check `sensors_available` to see what's supported.
+
+### Light Level Guide
+
+| Lux | Condition |
+|-----|-----------|
+| < 50 | Dark/dim room |
+| 50-300 | Indoor lighting |
+| 300-1000 | Bright indoor |
+| 1000-10000 | Overcast outdoor |
+| 10000-100000 | Direct sunlight |
+
+### Temperature Notes
+
+- Device temperature sensor may be affected by device heat
+- For accurate ambient temperature, device should be idle
+- Some devices don't have temperature sensor
+
+### Pressure Guide
+
+| hPa | Weather |
+|-----|---------|
+| < 1000 | Low pressure (storms) |
+| 1000-1020 | Normal |
+| > 1020 | High pressure (clear) |
+
+## Use Cases
+
+| Use Case | Sensor | Description |
+|----------|--------|-------------|
+| Weather tracking | pressure | Monitor local pressure |
+| Humidity alert | humidity | Warn on high/low humidity |
+| Light-based actions | light | Trigger on dark/bright |
+| Temperature monitoring | temperature | Track ambient temp |
+
+## Common Workflows
+
+### Auto-brightness trigger
+
+1. Read light level
+2. If light < 100, suggest dark mode
+3. If light > 1000, suggest bright mode
+
+### Environment monitoring
+
+1. Periodically read all sensors
+2. Log data points
+3. Alert on thresholds
+
+### Weather correlation
+
+1. Track pressure over time
+2. Correlate with weather changes
+3. Predict weather patterns
+
+## Limitations
+
+- Sensor availability varies by device model
+- Temperature sensor may read higher due to device heat
+- Indoor pressure differs from outdoor
+- Light sensor is typically near front camera
+
+## Setup Requirements
+
+1. Connect the **Environmental Sensors** node to Zeenie's `input-tools` handle
+2. Android device must be paired
+3. Sensors depend on device hardware

package/server/skills/android_agent/location-skill/SKILL.md

@@ -0,0 +1,163 @@
+---
+name: location-skill
+description: Get Android device GPS location - latitude, longitude, accuracy, speed, and provider information.
+allowed-tools: location
+metadata:
+  author: machina
+  version: "1.0"
+  category: android
+  icon: "📍"
+  color: "#EF4444"
+---
+
+# Location Tool
+
+Get GPS location from Android device.
+
+## How It Works
+
+This skill provides instructions for the **Location** tool node. Connect the **Location** node to Zeenie's `input-tools` handle to enable location tracking.
+
+## location Tool
+
+Get current GPS location from the Android device.
+
+### Schema Fields
+
+| Field | Type | Required | Description |
+|-------|------|----------|-------------|
+| action | string | Yes | `"status"` - Get current location |
+
+### Actions
+
+| Action | Description |
+|--------|-------------|
+| `status` | Get current GPS coordinates and location info |
+
+### Example
+
+**Get current location:**
+```json
+{
+  "action": "status"
+}
+```
+
+### Response Format
+
+```json
+{
+  "success": true,
+  "service": "location",
+  "action": "status",
+  "data": {
+    "latitude": 37.7749,
+    "longitude": -122.4194,
+    "altitude": 10.5,
+    "accuracy": 15.0,
+    "speed": 0.0,
+    "bearing": 180.0,
+    "provider": "gps",
+    "timestamp": "2025-01-30T12:00:00Z"
+  }
+}
+```
+
+### Response Fields
+
+| Field | Type | Description |
+|-------|------|-------------|
+| latitude | float | Latitude in degrees |
+| longitude | float | Longitude in degrees |
+| altitude | float | Altitude in meters (if available) |
+| accuracy | float | Horizontal accuracy in meters |
+| speed | float | Speed in m/s (if moving) |
+| bearing | float | Direction of travel in degrees |
+| provider | string | `"gps"`, `"network"`, `"fused"` |
+| timestamp | string | When location was obtained |
+
+### Error Response
+
+```json
+{
+  "error": "Location not available - GPS may be disabled",
+  "service": "location",
+  "action": "status"
+}
+```
+
+## Accuracy Guide
+
+| Accuracy (m) | Quality | Typical Source |
+|--------------|---------|----------------|
+| < 5 | Excellent | GPS with clear sky |
+| 5-15 | Good | GPS |
+| 15-50 | Fair | Network/WiFi |
+| 50-100 | Poor | Cell tower |
+| > 100 | Very Poor | Coarse location |
+
+## Provider Types
+
+| Provider | Description |
+|----------|-------------|
+| gps | GPS satellites (most accurate outdoors) |
+| network | WiFi/Cell towers |
+| fused | Combined sources (Android Fused Location) |
+
+## Use Cases
+
+| Use Case | Description |
+|----------|-------------|
+| Location tracking | Get device position |
+| Geofencing | Check if in specific area |
+| Speed monitoring | Track movement speed |
+| Navigation | Get coordinates for routing |
+
+## Common Workflows
+
+### Share location via WhatsApp
+
+1. Get location from device
+2. Use `whatsapp_send` with message_type="location"
+3. Pass latitude/longitude from location result
+
+### Location-based reminder
+
+1. Get current location
+2. Calculate distance to target
+3. Trigger reminder when near target
+
+### Track movement
+
+1. Periodically get location
+2. Store coordinates
+3. Calculate distance traveled
+
+## Integration with Other Tools
+
+### Send location to contact
+
+```
+1. location.status -> get lat/lng
+2. whatsapp_send with:
+   - message_type: "location"
+   - latitude: <from location>
+   - longitude: <from location>
+```
+
+### Find nearby places
+
+```
+1. location.status -> get lat/lng
+2. nearby_places with:
+   - lat: <from location>
+   - lng: <from location>
+   - type: "restaurant"
+```
+
+## Setup Requirements
+
+1. Connect the **Location** node to Zeenie's `input-tools` handle
+2. Android device must be paired
+3. Location permission must be granted
+4. GPS/Location services must be enabled on device

package/server/skills/android_agent/motion-skill/SKILL.md

@@ -0,0 +1,141 @@
+---
+name: motion-skill
+description: Get Android motion sensor data - accelerometer, gyroscope, detect motion, shake gestures, and device orientation.
+allowed-tools: motion_detection
+metadata:
+  author: machina
+  version: "1.0"
+  category: android
+  icon: "📈"
+  color: "#14B8A6"
+---
+
+# Motion Detection Tool
+
+Access motion sensors on Android device.
+
+## How It Works
+
+This skill provides instructions for the **Motion Detection** tool node. Connect the **Motion Detection** node to Zeenie's `input-tools` handle to enable motion sensing.
+
+## motion_detection Tool
+
+Get accelerometer, gyroscope, and motion data.
+
+### Schema Fields
+
+| Field | Type | Required | Description |
+|-------|------|----------|-------------|
+| action | string | Yes | `"status"` - Get motion sensor data |
+
+### Example
+
+**Get motion data:**
+```json
+{
+  "action": "status"
+}
+```
+
+### Response Format
+
+```json
+{
+  "success": true,
+  "service": "motion_detection",
+  "action": "status",
+  "data": {
+    "accelerometer": {
+      "x": 0.12,
+      "y": 9.78,
+      "z": 0.34
+    },
+    "gyroscope": {
+      "x": 0.01,
+      "y": 0.02,
+      "z": 0.00
+    },
+    "orientation": {
+      "azimuth": 45.0,
+      "pitch": -5.0,
+      "roll": 2.0
+    },
+    "is_moving": false,
+    "is_shaking": false,
+    "device_position": "flat"
+  }
+}
+```
+
+### Response Fields
+
+| Field | Type | Description |
+|-------|------|-------------|
+| accelerometer | object | X, Y, Z acceleration (m/s^2) |
+| gyroscope | object | X, Y, Z rotation rate (rad/s) |
+| orientation | object | Device orientation angles |
+| is_moving | boolean | Significant movement detected |
+| is_shaking | boolean | Shake gesture detected |
+| device_position | string | Inferred position |
+
+### Orientation Fields
+
+| Field | Description |
+|-------|-------------|
+| azimuth | Compass heading (0-360 degrees) |
+| pitch | Forward/backward tilt (-180 to 180) |
+| roll | Left/right tilt (-90 to 90) |
+
+### Device Positions
+
+| Position | Description |
+|----------|-------------|
+| `flat` | Laying flat on surface |
+| `upright` | Standing vertical |
+| `tilted` | Angled position |
+| `face_down` | Screen facing down |
+| `face_up` | Screen facing up |
+
+## Accelerometer Interpretation
+
+When device is stationary and flat:
+- X ~ 0 (left-right)
+- Y ~ 9.8 (gravity)
+- Z ~ 0 (forward-backward)
+
+Movement creates deviations from gravity baseline.
+
+## Use Cases
+
+| Use Case | Data | Description |
+|----------|------|-------------|
+| Shake detection | is_shaking | Trigger on shake gesture |
+| Movement alert | is_moving | Detect device moved |
+| Orientation | device_position | Check how device is held |
+| Compass heading | azimuth | Get direction |
+| Tilt detection | pitch, roll | Detect angles |
+
+## Common Workflows
+
+### Shake to trigger action
+
+1. Poll motion status
+2. When is_shaking = true
+3. Execute action
+
+### Security monitor
+
+1. Place device as monitor
+2. Check is_moving periodically
+3. Alert if movement detected
+
+### Orientation-based response
+
+1. Check device_position
+2. Adjust behavior based on orientation
+
+## Setup Requirements
+
+1. Connect the **Motion Detection** node to Zeenie's `input-tools` handle
+2. Android device must be paired
+3. Motion sensors must be available on device