agent-sin 0.1.12 → 0.1.16

package/CHANGELOG.md

@@ -15,6 +15,85 @@ See the [compatibility policy](https://agent.shingoirie.com/versioning) for deta
 
 ---
 
+## [0.1.16] — 2026-05-24
+
+### Changed
+
+- Long-term memory promotion now treats casual conversation as a source of meta-level user understanding, extracting durable preferences, concerns, lifestyle patterns, and decision criteria without storing raw small talk.
+- Memory consolidation keeps broad health and self-improvement concerns when useful, while continuing to avoid detailed sensitive health, finance, family, or third-party information.
+
+### Fixed
+
+- `memory.md` consolidation now preserves the generated `Recent 7-day topics` / `直近1週間のトピック` section instead of dropping previously retained days when the long-term body is reorganized.
+
+---
+
+## [0.1.15] — 2026-05-23
+
+### Added
+
+- **`skill_outputs_dir` (`workspace/skill-outputs/<skill-id>/`).** Every skill now has a dedicated user-visible output directory, symlinked into the Obsidian Vault as `06 Skills/<skill-id>/`. Skills receive the path via `input.sources.skill_output_dir` / `skillOutputDir` and can write free-form Markdown without polluting the workspace root.
+- **Image attachments propagate to the bot UIs.** Generated images and file paths returned from a skill's `data.filePaths` / `data.images` / etc. are forwarded to the Discord and Telegram bots through `onLocalAttachments`, so they appear inline in chat.
+- **Memo flat-structure migration.** Memos created under date subdirectories are automatically migrated to the new flat layout on `setup`, and `memo-list` / `memo-search` index both layouts.
+- **Skill history via `ctx.history`.** Per-skill SQLite stores accumulate at `data/<skill-id>.db`, giving long-running skills (e.g. `nightly-topic-knowledge`) a writable log they can read on the next run.
+
+### Changed
+
+- **Chat output rule: reply OR skill output, never both.** When the model writes a reply, the buffered skill output for that turn is dropped (no duplication). When the model leaves reply empty, the skill output passes through as-is. Intermediate iterations are discarded automatically when chaining skills.
+- Self-repair flow now hands the failed run log (including `ctx_logs`) to the builder, so the rewrite has access to the actual stack trace and warn/error entries from the failing run.
+- Skill results now include `ctx_logs` and `notes` so the model and the user can see degraded paths (e.g. cached fallback) instead of silent successes.
+- Builtin memo / todo / nightly-topic-knowledge skills migrated to the new `skill-outputs` layout and the unified `ctx.history` API.
+
+### Fixed
+
+- `runSkill` no longer fails when the workspace lacks `skill-outputs/<skill-id>/`; the directory is created on demand.
+- The update banner regex test is now locale-agnostic and works whether the host runs in Japanese or English.
+
+---
+
+## [0.1.14] — 2026-05-21
+
+### Added
+
+- **Two-way ToDo sync with Obsidian.** `workspace/todo/todos.md` is now the single source of truth. Toggling `- [ ] / - [x]`, adding lines, or deleting lines from the Obsidian `05 ToDo` Vault is picked up on the next todo skill run. `^id-xxxx` block anchors keep each line bound to its underlying ToDo id.
+- **Automatic past-conversation context.** When the user references prior conversations ("覚えてる？", "yesterday's …", etc.), relevant excerpts from `logs/conversations/*.jsonl` are attached as read-only context. Date references also include the surrounding days.
+- **Auto Obsidian tags for memos.** `memo-save` now derives up to three Obsidian tags from the memo body, explicit `tags`, and inline `#hashtag` mentions. Controlled via `tags` / `auto_tags` arguments.
+- **memory.md promotion diff log.** Whenever daily-memory promotion rewrites `memory.md`, the unified diff is recorded as a `memory_promotion_diff` event in `logs/events.jsonl`.
+
+### Changed
+
+- Memo timestamps switched from full ISO strings to a short local `HH:MM` display. `memo-index` reads both the old and new formats, and daily-memory headings are unified to `## HH:MM chat user`.
+- Long-term memory promotion budget raised from 3 → 5 items, and the recent-topics list from 8 → 10 entries. Prompts are stricter so assistant turns serve as context only and are no longer treated as standalone facts to promote.
+- `build_suggestion` replies now strip leaked internal phrasing such as "ビルドモードに渡します" / "build mode" and always end with a short summary plus a confirmation line ("この内容で直しますか？" / "この内容で作りますか？"). When the very first build request also describes a schedule (e.g. "毎朝4時の…"), the recurring schedule is registered alongside the build draft.
+- `schedule-add` is now idempotent against content duplicates: the same cron/skill/args/description combination cannot be registered twice under different ids.
+
+### Fixed
+
+- Obsidian Vault symlinks (e.g. `05 ToDo`) that pointed at a missing target are now rebuilt on `setup` instead of being left dangling.
+
+---
+
+## [0.1.13] — 2026-05-19
+
+### Added
+
+- **Even G2 glasses integration.** Talk to your agent through Even Realities G2 glasses via a new on-device gateway.
+  - `agent-sin g2` / `agent-sin g2 setup` CLI commands and a `--g2` flag on `agent-sin gateway` to run the WebSocket+HTTP bridge that handles voice transcription, chat replies, and inbox.
+  - `templates/even-g2-agent/` — minimal Even Hub app template (Vite + Even SDK) with a glasses UI that supports Talk / Send / Cancel and on-glasses transcript display.
+  - `even-g2-setup` builtin skill that automates the full local setup: gateway `.env`, template copy into `~/.agent-sin/even-g2-agent/`, `app.json` whitelist generation, build-time embedding of the server URL and token, and `npm run pack` to produce a ready-to-upload `.ehpk`.
+  - Tailscale / Tailscale Serve detection: the skill refuses to build with helpful instructions when Tailscale is required but missing or misconfigured.
+  - Discord / Telegram mirror of G2 conversations via `--history-channel` (with optional auto-created Discord thread).
+  - End-to-end docs at [`docs/even-g2-setup.md`](docs/even-g2-setup.md) (English) and [`docs/even-g2-setup.ja.md`](docs/even-g2-setup.ja.md) (Japanese).
+- **`service-restart` builtin skill.** Restart the Agent-Sin background service from Discord, Telegram, or chat. Supports launchd on macOS and Task Scheduler on Windows.
+- **Nightly topic knowledge.** A new `nightly-topic-knowledge` skill distills the previous day's conversations, daily memory, and notes into per-topic lightweight knowledge files. A companion `topic-knowledge-read` skill lets the chat engine pull full details for topics that look relevant during a conversation.
+- **Obsidian Vault view.** `agent-sin setup` now provisions an Obsidian Vault at `~/Obsidian/Agent-Sin/` so memory, notes, and daily logs can be read and edited directly in Obsidian without changing the underlying workspace layout.
+
+### Changed
+
+- Setup and the always-on service understand the new G2 environment variables (`AGENT_SIN_G2_ENABLED`, `_HOST`, `_PORT`, `_TOKEN`, `_HISTORY_CHANNEL`, `_DISCORD_THREAD`) and start G2 automatically when enabled.
+
+---
+
 ## [0.1.12] — 2026-05-15
 
 ### Added

package/README.md

@@ -41,6 +41,7 @@ When a new capability is needed, Build Mode uses Claude Code or Codex to generat
 - **Free model mix** — pick a light model for chat and a stronger one for skill authoring.
 - **Always-on gateway** — starts at login and bundles the scheduler with the Discord / Telegram bots.
 - **Long-term memory** — agent persona, your profile, and daily context persist across sessions.
+- **Obsidian-ready** — setup generates an [Obsidian Vault view](https://agent.shingoirie.com/concepts?lang=en#obsidian-vault) at `~/Obsidian/Agent-Sin/` so you can read and edit memory, notes, and daily logs directly in Obsidian.
 
 ## Install
 
@@ -68,7 +69,7 @@ Full walkthrough: [Getting Started](https://agent.shingoirie.com/getting-started
 
 - [Overview](https://agent.shingoirie.com/overview?lang=en) — the big picture
 - [Getting Started](https://agent.shingoirie.com/getting-started?lang=en) — install to first conversation
-- [Concepts](https://agent.shingoirie.com/concepts?lang=en) — design and Runtime
+- [Concepts](https://agent.shingoirie.com/concepts?lang=en) — design, data layout, and the [Obsidian Vault view](https://agent.shingoirie.com/concepts?lang=en#obsidian-vault)
 - [Skill Authoring](https://agent.shingoirie.com/skill-authoring?lang=en) — write your own skill
 - [Built-in Skills](https://agent.shingoirie.com/built-in-skills?lang=en) — bundled skills
 - [CLI Reference](https://agent.shingoirie.com/cli?lang=en) — every command

package/builtin-skills/_shared/_todo_lib.py

@@ -0,0 +1,290 @@
+"""ToDo sync helpers shared by todo-add/done/delete/list/tick.
+
+todos.md は workspace/todo/todos.md に単一ファイルで保存する。
+Obsidian の `05 ToDo` symlink からそのまま編集できる。
+
+同期方針 (Obsidian 優先):
+- スキル実行のたびに sync_todos() を呼ぶ
+- todos.md に行があるが items に無い → 新規追加 (id を採番)
+- items にあるが todos.md に無い → 削除
+- checkbox の状態 (open/done) は todos.md を真実とする
+- text や due (📅) も todos.md 側を優先
+
+ファイル書式:
+    - [ ] 牛乳を買う 📅 2026-05-22 ^id-abc
+    - [x] PR レビュー ✅ 2026-05-21 ^id-xyz
+"""
+
+from __future__ import annotations
+
+import os
+import re
+import secrets
+import tempfile
+from datetime import datetime, timedelta, timezone
+from typing import Any, Dict, List, Optional, Tuple
+
+
+DONE_RETENTION_DAYS = 90
+
+
+def todos_path(workspace: str) -> str:
+    return os.path.join(workspace, "todo", "todos.md")
+
+
+# `^anchor-id` パターン (Obsidian のブロック参照と同じ記法)
+ANCHOR_RE = re.compile(r"\s*\^([A-Za-z0-9_-]+)\s*$")
+DUE_RE = re.compile(r"\s*📅\s*([0-9T:\-+Z.]+)")
+DONE_RE = re.compile(r"\s*✅\s*([0-9T:\-+Z.]+)")
+CHECKBOX_RE = re.compile(r"^\s*-\s*\[([ xX])\]\s*(.*)$")
+
+
+def parse_todos_md(content: str) -> List[Dict[str, Any]]:
+    """Markdown から todo 一覧を取り出す。順序は保つ。"""
+    items: List[Dict[str, Any]] = []
+    for line in content.splitlines():
+        match = CHECKBOX_RE.match(line)
+        if not match:
+            continue
+        mark, body = match.group(1), match.group(2)
+        status = "done" if mark.strip().lower() == "x" else "open"
+
+        anchor: Optional[str] = None
+        anchor_match = ANCHOR_RE.search(body)
+        if anchor_match:
+            anchor = anchor_match.group(1)
+            body = body[: anchor_match.start()].rstrip()
+
+        due: Optional[str] = None
+        due_match = DUE_RE.search(body)
+        if due_match:
+            due = due_match.group(1)
+            body = (body[: due_match.start()] + body[due_match.end():]).strip()
+
+        completed_at: Optional[str] = None
+        done_match = DONE_RE.search(body)
+        if done_match:
+            completed_at = done_match.group(1)
+            body = (body[: done_match.start()] + body[done_match.end():]).strip()
+
+        text = body.strip()
+        if not text:
+            continue
+
+        item: Dict[str, Any] = {"text": text, "status": status}
+        if anchor:
+            item["id"] = anchor
+        if due:
+            item["due"] = due
+        if completed_at:
+            item["completed_at"] = completed_at
+        items.append(item)
+    return items
+
+
+def format_todos_md(items: List[Dict[str, Any]]) -> str:
+    """items 配列のうち open のみを todos.md に書き出す。
+
+    Done は Obsidian に出さない (内部メモリには残るが、見た目を軽くするため)。
+    完了タスクの履歴を Obsidian 側で確認したい場合は別ビューを検討する。
+    """
+    open_items = [i for i in items if i.get("status") != "done"]
+    if not open_items:
+        return "# ToDo\n\n_(まだ ToDo はありません)_\n"
+    lines = ["# ToDo", ""]
+    for item in open_items:
+        lines.append(_format_line(item))
+    return "\n".join(lines).rstrip() + "\n"
+
+
+def _format_line(item: Dict[str, Any]) -> str:
+    mark = "x" if item.get("status") == "done" else " "
+    text = str(item.get("text", "")).strip()
+    parts = [f"- [{mark}] {text}"]
+    due = item.get("due")
+    if due:
+        parts.append(f"📅 {due}")
+    completed = item.get("completed_at")
+    if completed:
+        parts.append(f"✅ {completed}")
+    item_id = item.get("id")
+    if item_id:
+        parts.append(f"^{item_id}")
+    return " ".join(parts)
+
+
+def _read_file(path: str) -> str:
+    try:
+        with open(path, "r", encoding="utf-8") as fh:
+            return fh.read()
+    except FileNotFoundError:
+        return ""
+
+
+def _write_atomic(path: str, content: str) -> None:
+    os.makedirs(os.path.dirname(path), exist_ok=True)
+    fd, tmp = tempfile.mkstemp(prefix=".todos.", suffix=".md", dir=os.path.dirname(path))
+    try:
+        with os.fdopen(fd, "w", encoding="utf-8") as fh:
+            fh.write(content)
+        os.replace(tmp, path)
+    except Exception:
+        try:
+            os.unlink(tmp)
+        except OSError:
+            pass
+        raise
+
+
+def _new_id() -> str:
+    return secrets.token_hex(3)
+
+
+def merge_obsidian_into_memory(
+    mem_items: List[Dict[str, Any]],
+    file_items: List[Dict[str, Any]],
+    now_iso: str,
+) -> List[Dict[str, Any]]:
+    """Obsidian (file_items) と memory をマージする。
+
+    Obsidian は Open のみを表示する仕様なので、file_items に無い open は「Obsidian で削除された」と判定して削除する。
+    一方 done はファイルに出ていないだけなので、memory 側の done は file に無くても保持する。
+
+    - file_items に出ている行: 内容を file 優先で取り込む (id 採番、text/status/due/completed_at の上書き)
+    - file_items に出ていない memory open: 削除
+    - file_items に出ていない memory done: 保持 (後段の purge_old_done で古いものだけ落とす)
+    """
+    mem_by_id: Dict[str, Dict[str, Any]] = {}
+    for item in mem_items:
+        item_id = item.get("id")
+        if item_id:
+            mem_by_id[item_id] = item
+
+    file_ids_seen: set = set()
+    merged: List[Dict[str, Any]] = []
+
+    for file_item in file_items:
+        file_id = file_item.get("id")
+        base: Dict[str, Any]
+        if file_id and file_id in mem_by_id:
+            base = dict(mem_by_id[file_id])
+            base["text"] = file_item["text"]
+            new_status = file_item.get("status", "open")
+            old_status = base.get("status")
+            base["status"] = new_status
+            if "due" in file_item:
+                base["due"] = file_item["due"]
+            else:
+                base.pop("due", None)
+            if file_item.get("completed_at"):
+                base["completed_at"] = file_item["completed_at"]
+            elif new_status == "done" and old_status != "done":
+                base["completed_at"] = now_iso
+            elif new_status != "done":
+                base.pop("completed_at", None)
+            file_ids_seen.add(file_id)
+        else:
+            base = {
+                "id": file_id or _new_id(),
+                "text": file_item["text"],
+                "status": file_item.get("status", "open"),
+                "created_at": now_iso,
+            }
+            if file_item.get("due"):
+                base["due"] = file_item["due"]
+            if base["status"] == "done":
+                base["completed_at"] = file_item.get("completed_at") or now_iso
+            if base.get("id"):
+                file_ids_seen.add(base["id"])
+        merged.append(base)
+
+    # ファイルに出ていない memory 側 done を末尾に残す (open はファイル側で削除されたとみなして落とす)
+    for mem_item in mem_items:
+        if mem_item.get("status") != "done":
+            continue
+        mem_id = mem_item.get("id")
+        if mem_id and mem_id in file_ids_seen:
+            continue
+        merged.append(dict(mem_item))
+
+    return merged
+
+
+def _parse_iso(value: Any) -> Optional[datetime]:
+    if not value:
+        return None
+    try:
+        parsed = datetime.fromisoformat(str(value).replace("Z", "+00:00"))
+    except ValueError:
+        return None
+    if parsed.tzinfo is None:
+        parsed = parsed.replace(tzinfo=timezone.utc)
+    return parsed
+
+
+def purge_old_done(items: List[Dict[str, Any]], now: Optional[datetime] = None) -> List[Dict[str, Any]]:
+    """completed_at が DONE_RETENTION_DAYS を超えた done items を内部メモリから消す。"""
+    reference = now or datetime.now(timezone.utc)
+    if reference.tzinfo is None:
+        reference = reference.replace(tzinfo=timezone.utc)
+    cutoff = reference - timedelta(days=DONE_RETENTION_DAYS)
+    kept: List[Dict[str, Any]] = []
+    for item in items:
+        if item.get("status") == "done":
+            completed = _parse_iso(item.get("completed_at"))
+            if completed is not None and completed < cutoff:
+                continue
+        kept.append(item)
+    return kept
+
+
+async def sync_todos(ctx, input: Dict[str, Any]) -> List[Dict[str, Any]]:
+    """スキル実行の冒頭で呼ぶ。Obsidian → memory に取り込んで items を返す。
+
+    read-only スキル (memory.write: false) では memory への書き込みが拒否されるため、
+    その場合はマージ結果だけ返して memory は更新しない (次の write 可能スキルで永続化される)。
+    """
+    workspace = (input.get("sources") or {}).get("workspace")
+    now_iso = (input.get("trigger", {}) or {}).get("time") or datetime.now().isoformat()
+    now_dt = _parse_iso(now_iso)
+
+    if not workspace:
+        return purge_old_done(list((await ctx.memory.get("items")) or []), now_dt)
+
+    path = todos_path(workspace)
+    file_content = _read_file(path)
+    mem_items = list((await ctx.memory.get("items")) or [])
+
+    if not file_content.strip():
+        # ファイルが無いか空 → memory が真実。初回保存のため後段で flush される。
+        return purge_old_done(mem_items, now_dt)
+
+    file_items = parse_todos_md(file_content)
+    merged = merge_obsidian_into_memory(mem_items, file_items, now_iso)
+    merged = purge_old_done(merged, now_dt)
+    try:
+        await ctx.memory.set("items", merged)
+    except Exception as exc:
+        # read-only スキルでの書き込み拒否は想定内。それ以外もブロックしない。
+        try:
+            ctx.log.info(f"todo sync: memory write skipped ({exc})")
+        except Exception:
+            pass
+    return merged
+
+
+async def flush_todos(ctx, input: Dict[str, Any], items: List[Dict[str, Any]]) -> Optional[str]:
+    """items を todos.md にフルダンプする。書き込み先パスを返す (workspaceが取れなければ None)。"""
+    workspace = (input.get("sources") or {}).get("workspace")
+    if not workspace:
+        return None
+    path = todos_path(workspace)
+    _write_atomic(path, format_todos_md(items))
+    return path
+
+
+async def sync_and_get(ctx, input: Dict[str, Any]) -> Tuple[List[Dict[str, Any]], List[Dict[str, Any]]]:
+    """sync_todos の薄いラッパー。同期後の items と「同期前の memory items」を返す。"""
+    mem_items_before = list((await ctx.memory.get("items")) or [])
+    merged = await sync_todos(ctx, input)
+    return merged, mem_items_before