cli-memory-os 0.1.0__py3-none-any.whl

cli_memory_os-0.1.0.dist-info/METADATA

@@ -0,0 +1,231 @@
+Metadata-Version: 2.4
+Name: cli-memory-os
+Version: 0.1.0
+Summary: CLI-based Personal Knowledge Operating System
+Author-email: Anirudh T <anirudh200584@gmail.com>
+License-Expression: MIT
+Keywords: RAG,Knowledge-Graph,Vector-Search,Personal-Assistant,LLM,Composio
+Classifier: Programming Language :: Python :: 3 :: Only
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Operating System :: OS Independent
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Requires-Python: >=3.12
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: composio==0.13.1
+Requires-Dist: composio-langchain==0.13.1
+Requires-Dist: langchain==1.3.9
+Requires-Dist: langchain-groq==1.1.3
+Requires-Dist: python-dotenv==1.2.2
+Requires-Dist: qdrant-client==1.18.0
+Requires-Dist: neo4j==6.2.0
+Requires-Dist: sentence-transformers==5.6.0
+Provides-Extra: dev
+Requires-Dist: pytest>=8.0; extra == "dev"
+Dynamic: license-file
+
+# Memory‑OS 🧠
+
+[![PyPI version](https://img.shields.io/pypi/v/memory-os.svg)](https://pypi.org/project/memory-os/)
+[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
+
+**Memory‑OS** is a local Personal Knowledge Operating System that syncs, indexes, and retrieves information across your GitHub repositories, emails, and Notion workspaces. It runs a unified interactive CLI, exposing hybrid keyword + semantic search and natural language QA powered by RAG, local embeddings, and a knowledge graph.
+
+---
+
+## 🏗️ Architecture
+
+Memory-OS is built as a modular architecture consisting of ingestion, databases, scoring ranking engines, and a terminal user loop:
+
+```mermaid
+graph TD
+    %% Ingestion
+    subgraph Ingestion [1. Ingestion Layer]
+        GH[GitHub Repos & Docs]
+        GM[Gmail Inbox Messages]
+        NT[Notion Page Contents]
+        CP[Composio Integration Platform]
+        GH --> CP
+        GM --> CP
+        NT --> CP
+    end
+
+    %% Storage & Indexing
+    subgraph Storage [2. Storage & Indexing Layer]
+        DB[(SQLite: workspace.db)]
+        QD[(Qdrant: Qdrant Server)]
+        N4J[(Neo4j Graph Database)]
+        SQL_G[(SQLite Graph Fallback)]
+        
+        CP -->|Insert Metadata & Docs| DB
+        DB -->|Text Chunks| CH[Chunking Core]
+        CH -->|Local Embeddings| EM[SentenceTransformer]
+        EM -->|Vectors| QD
+        
+        DB -->|Graph Construction| N4J
+        DB -->|Graph Construction| SQL_G
+    end
+
+    %% Retrieval & RAG
+    subgraph Retrieval [3. Retrieval & RAG Layer]
+        HS[Hybrid Search Router]
+        QD -->|Cosine Similarity| HS
+        DB -->|Keyword Matching| HS
+        N4J -->|Graph Lookups| HS
+        SQL_G -->|Graph Fallback Lookups| HS
+        
+        HR[Hybrid Ranking Scoring]
+        HS --> HR
+        
+        RAG[RAG Context Builder]
+        HR -->|Merged Context| RAG
+        
+        LLM[Groq LLM Pipeline]
+        RAG -->|Prompt Assembly| LLM
+    end
+
+    %% User Interaction
+    subgraph User [4. Interface Layer]
+        CLI[main.py: CLI Command Loop]
+        CLI -->|Sync/Rebuild| Ingestion
+        CLI -->|Search/Ask Queries| Retrieval
+        LLM -->|Formatted Answer| CLI
+    end
+```
+
+---
+
+## 🗄️ Database Technology Rationale
+
+Memory-OS adopts a **multi-model storage engine strategy**, selecting each technology to excel at its designated retrieve-and-rank role:
+
+| Database | Selection Rationale |
+| :--- | :--- |
+| **SQLite (`workspace.db`)** | Chosen for lightweight structured storage. It holds raw documents, chunk segments, email metadata, and repository statistics, providing ACID compliance and ultra-fast exact keyword searches. |
+| **Qdrant** | Chosen as a high-performance vector database optimized for storing and executing cosine similarity search queries on $384$-dimensional dense vector embeddings generated by Sentence-Transformers. |
+| **Neo4j / Fallback SQLite** | Neo4j is utilized as a native graph database to map complex developer relationships (e.g. `Repository-[USES]->Technology` or `Email-[SENT_BY]->User`). If Neo4j is unreachable, it seamlessly falls back to a relational SQLite graph schema, preserving search functionality offline. |
+
+---
+
+## 🗄️ Workspace Structure
+
+Memory-OS manages directories and configuration under the user's home folder (`~/.memory-os/`):
+```
+~/.memory-os/
+├── config.toml                     # Global TOML settings configuration
+├── active_profile                  # Stores name of the currently active profile
+└── workspaces/
+    ├── default/                    # Default workspace profile directory
+    │   ├── workspace.db            # SQLite relational database
+    │   ├── qdrant/                 # Qdrant local bind-mounted storage folder
+    │   ├── neo4j/                  # Neo4j local bind-mounted storage folder
+    │   ├── logs/                   # Log folder containing memory_os.log
+    │   └── cache/                  # Chunker cache folder
+    └── personal/                   # Personal workspace profile directory
+```
+
+---
+
+## 📦 Setup & Installation
+
+Ensure you have **Python >= 3.12** and **Docker + Docker Compose** installed.
+
+### 1. Install via pip
+You can install Memory-OS directly as a package:
+```bash
+pip install .
+```
+This registers the CLI entry point executable `memory-os` on your path.
+
+### 2. Run the Initialization Wizard
+Kick off the interactive wizard to verify system dependencies, configure API keys, spin up containers, and pre-warm model weights:
+```bash
+memory-os init
+```
+
+---
+
+## 🚀 CLI Commands Reference
+
+Memory-OS exposes a comprehensive CLI for administration:
+
+### Core Daemon Lifecycle
+- **`memory-os start`**: Spins up Neo4j and Qdrant database services in the background using Docker Compose.
+- **`memory-os stop`**: Stops the database services while retaining data directories intact.
+
+### Operations & Ingestion
+- **`memory-os sync [--source SOURCE] [--rebuild]`**: Triggers incremental data imports from registered sources (GitHub, Gmail, Notion). Add `--rebuild` for full vector/graph resets.
+- **`memory-os ask <question>`**: Runs natural language queries against the RAG retrieval pipeline.
+- **`memory-os graph <repo>`**: Visualizes the relationships of an indexed repository in the terminal knowledge graph.
+
+### Diagnostics & Monitoring
+- **`memory-os doctor`**: Analyzes connection validation health across all endpoints and prints actionable troubleshooting tips on failure.
+- **`memory-os monitor`**: Displays aggregated data latencies (indexing speed, search rates, LLM times) by parsing system log traces.
+- **`memory-os benchmark`**: Performs query speed runs on keyword, semantic, hybrid searches, and RAG pipelines.
+- **`memory-os logs [--tail N]`**: Tails the running logs of Memory-OS (rotates at 5MB, up to 3 backups).
+
+### Configuration Management
+- **`memory-os config show`**: Displays the active key-value configuration block.
+- **`memory-os config get <key>`**: Fetches a nested key value (e.g. `groq.model`).
+- **`memory-os config set <key> <value>`**: Sets a nested key value with type validation checks.
+- **`memory-os config reset`**: Prompts and reverts all configurations to factory defaults.
+
+### Workspace Profile Profiles
+- **`memory-os workspace list`**: Lists all profiles (* marks active).
+- **`memory-os workspace create <name>`**: Allocates a new workspace folder tree.
+- **`memory-os workspace switch <name>`**: Switches the active profile context.
+- **`memory-os workspace delete <name>`**: Wipes profile folder directories.
+- **`memory-os workspace info`**: Displays detailed record metrics (nodes, vectors, sizes) for the active profile.
+
+### Portability (Export / Import)
+- **`memory-os export <backup-zip>`**: Compresses database schemas, configurations, and vector indices into a versioned zip package.
+- **`memory-os import <backup-zip>`**: Overwrites the active workspace profile using files from an export package after validating versions and model compatibility.
+
+---
+
+## 🔌 Plugin System Architecture
+
+Memory-OS features a structured connector registry. Every connector implements `BaseConnector` (`connectors/base.py`) and is registered using the `@register` decorator (`connectors/registry.py`):
+
+```python
+from connectors.base import BaseConnector
+from connectors.registry import register
+
+@register
+class SlackConnector(BaseConnector):
+    name = "Slack"
+    slug = "slack"
+
+    def authenticate(self) -> bool:
+        # Check OAuth or API status
+        return True
+
+    def sync(self) -> dict:
+        # Fetch channels and messages
+        return {"synced": 42}
+
+    def health(self) -> tuple[bool, str]:
+        return True, "Connected"
+```
+
+To list registered plugins:
+```bash
+memory-os plugins
+```
+
+---
+
+## 🛠️ Troubleshooting
+
+- **Database Offline / Port conflicts**: If Neo4j (ports 7474/7687) or Qdrant (port 6333) fails to start, modify port configurations:
+  ```bash
+  memory-os config set neo4j.port_http 7475
+  memory-os config set qdrant.port 6334
+  memory-os start
+  ```
+- **Failing Diagnostics**: Run `memory-os doctor` to inspect status. It provides detailed actionable tips to address common environment issues.
+
+---
+
+## 📜 License
+This project is licensed under the **MIT License**.

cli_memory_os-0.1.0.dist-info/RECORD

@@ -0,0 +1,50 @@
+cli/__init__.py,sha256=QHJaTQVcqGsvBTXZQN2GFSjZLYQImJg5Xwqj2DzR5IA,14
+cli/main.py,sha256=95s8VAuSmReoXvQvetPHBgGv4OGu7tCByC5mE1oHsRc,19853
+cli/parser.py,sha256=aZXjqL9MA25RvgPQ70J_-O2axO1yex4Chu9FBFczH1g,8384
+cli/commands/__init__.py,sha256=S8cCOAW7jWWQwD6sHjvbDtITsX2pWDZT8-R1mHwArFE,23
+cli/commands/benchmark.py,sha256=Wk7PZzcAlRVlBiaiZ8mOOkfIbIT1-Rzy7Db99Ucq6yI,5785
+cli/commands/config_cmd.py,sha256=nwft5p2hM-2uIVxEr-uhTYObW4wcqAhP9WS7uo9XjjI,1874
+cli/commands/doctor.py,sha256=8_KgoP3WDsHu3JUNgXJHotuZnl13inoh1zgpYxPLgLc,2773
+cli/commands/export.py,sha256=iI_10jGe5pqYSN17vtSpjxyq4hwnYgnkbLqCxJriFrs,3992
+cli/commands/import_cmd.py,sha256=MDNvDtVPkWx3gcDttDlzqaQ-XOM1AnPEF2ltvteM738,5883
+cli/commands/init.py,sha256=ApL8OuQ0cmNgRJlXuIQu7gNWjyv-gz2td-uY2KiIMFA,8376
+cli/commands/logs.py,sha256=XZKt5yMtqA0zb9oejSsOezjJkSgvf7XKvUWyo0NuWNw,1310
+cli/commands/monitor.py,sha256=JI9-3EkGpS1YSKdbt9l1OevuqvEciHuaF6wA_dsrPNE,2633
+cli/commands/plugins.py,sha256=fAGpM3EqltunByjdUENEz3BFjUO9yzay_8cSYbeturk,1270
+cli/commands/start.py,sha256=GBhsd7oQbCcDkXNnvkLJ9QSStFgrr-Dxnk9kp41MUT8,715
+cli/commands/status.py,sha256=T-HlH5Y8P-KD8HadAeW9FM4BaDQJXlc-llsSKPUrtw0,3224
+cli/commands/stop.py,sha256=sG8tspAux9vRTTCSMHTDP1oquvzxqR-OnSt-dejimyE,490
+cli/commands/version.py,sha256=4kfZiATehobqeJB0yWn8aQ7AVrjiXYxOh-CnNEVuNQ8,672
+cli/commands/workspace.py,sha256=zd_SGNY4iLbQUPCWaxVIGQaCJ6TcrldBQBiQjGm3-bg,5828
+cli_memory_os-0.1.0.dist-info/licenses/LICENSE,sha256=GpOhGcWM40QPUZUgla7eWQSmtxX6aorZzm6sRIAYHH8,1074
+connectors/__init__.py,sha256=AXFbXzb1TrpJykApKqN6WarHxwtDm5ZtW_CT1xiSsG4,21
+connectors/base.py,sha256=wtqDPMkrLJrsUARhrAiZIghE-He0_yz-DuCoAg2s3mw,934
+connectors/github.py,sha256=wFtiPjGguSMxCCg1T1dOGhDfjB2A9M2Ig4MbYz086WA,11009
+connectors/gmail.py,sha256=hLXmHapgGSdDcwHsmNTp9bQyKytPEODQMiXyGG59LWQ,3903
+connectors/notion.py,sha256=eS-T6XGPbN10eabU_OYJ7dvszSS0Rl1TtY2BC_gKpwE,5580
+connectors/registry.py,sha256=v9IbztU8AvcEkiti4hKNTrdCv2p3XKqkJE3DGtWH_Js,1763
+core/__init__.py,sha256=XSEHCVZFjVWh0MiJPA2hhHR_XNL6lhR6WMhtc4nUhgw,15
+core/chunker.py,sha256=2xeCNxSskJI-qQq_v69ZxaxXei1bI3uFIQWcWQ5Og5g,5695
+core/context_builder.py,sha256=EpCiHWsVE7rE5kVDETiAx_lEW8BHo8IDm82Mq2eQEfQ,18940
+core/embedder.py,sha256=_ISGc9Zhlh2iGdejySkraet3HAZY5Xppd1U-00AY7lA,1330
+core/llm.py,sha256=kNMsJALKNcYNvPX3llB3FJy-wz5saspuPJWcCQYRjuk,11897
+core/vector_store.py,sha256=IOv98uqJzItoxGtjUhg-Yq7Hf6kkJyvTqpZs0ln5V_c,24380
+infrastructure/__init__.py,sha256=JVrwf4YJ8d8Oz9tTNuUn3qR5-sDT2C0zPwELBVZ4akY,25
+infrastructure/compose.py,sha256=lRDYuvycZPLs0_6jEa93EQUhM3CFAlBeT_Y8rTnuHHg,4152
+infrastructure/config.py,sha256=XoCJCaeK07FPPgH0A6976Yi2N4M9fr9LCYIelZK3LKw,8617
+infrastructure/docker.py,sha256=GAHs3neBn9RT-LOaxkO4RxNPg-r7-b179KpfPAcBBB4,1796
+infrastructure/health.py,sha256=eBsMjgI2V6p4ii-imMWRrwrJxOzXa-Hphz2AGle44EM,11039
+infrastructure/observability.py,sha256=d46wMjU9afY2ql6z0MGrSHTCcMZ3kRoE5U_BFy9dHi0,5451
+infrastructure/workspace.py,sha256=5u5KWNCR6beFZTelJmjAF2PDeLuHjFRx_gou_SxNwc0,5025
+models/__init__.py,sha256=H8_hNLjdE649el_5XPoWR54vBs0IYM2_GG_Fv6bUZ7A,17
+models/memory.py,sha256=uNrCYU-DyFI44J-p4_K8ZshmmzG7OAQrWWgEm-tUdp4,1112
+storage/__init__.py,sha256=c3L5t0o9t2EU138qN0DQV5FEObaMBT20QJv7XIAifMU,18
+storage/db.py,sha256=lRau0SGcizSmT_KKVozbV81ZqZkob20X6IkMpJUEEIo,18030
+storage/graph.py,sha256=4ekFcyvnIt8grVXaEOlKX-KHWtJ7bghRiV3gadae404,14421
+storage/schema.sql,sha256=DyF6j04MUiAktOrYElA6vt918VdKyFGlznu6ZurkYY8,1244
+storage/tech_detector.py,sha256=HRmEiXAEZVl2mUKQFAlWp3sHcVQKQDIVZFVoOawzFEU,4166
+cli_memory_os-0.1.0.dist-info/METADATA,sha256=1br7XgYQVcqqM-UCa3FUjT5nWBF9a31E53vo2LTqgd0,9483
+cli_memory_os-0.1.0.dist-info/WHEEL,sha256=K260EYznzXsJYBQGqmI8VTxEdiZYNvDZwW9cBh9-_MA,91
+cli_memory_os-0.1.0.dist-info/entry_points.txt,sha256=QRmguBsVJwGhUUNQQTPRtScf_q3BbConmsh-f9EPZIo,54
+cli_memory_os-0.1.0.dist-info/top_level.txt,sha256=dejPIyF3Ll6dTZuSWMjn3Fgs3TY2T4wRF7RIJmSEzC4,50
+cli_memory_os-0.1.0.dist-info/RECORD,,

cli_memory_os-0.1.0.dist-info/WHEEL

@@ -0,0 +1,5 @@
+Wheel-Version: 1.0
+Generator: setuptools (83.0.0)
+Root-Is-Purelib: true
+Tag: py3-none-any
+

cli_memory_os-0.1.0.dist-info/entry_points.txt

@@ -0,0 +1,2 @@
+[console_scripts]
+memory-os = cli.main:cli_entrypoint

cli_memory_os-0.1.0.dist-info/licenses/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Memory-OS Authors
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

cli_memory_os-0.1.0.dist-info/top_level.txt

@@ -0,0 +1,6 @@
+cli
+connectors
+core
+infrastructure
+models
+storage

connectors/__init__.py

@@ -0,0 +1 @@
+# connectors package

connectors/base.py

@@ -0,0 +1,39 @@
+"""
+Connector plugin interface.
+
+All connectors must subclass BaseConnector and implement
+authenticate(), sync(), and health() methods.
+"""
+
+from abc import ABC, abstractmethod
+
+
+class BaseConnector(ABC):
+    """Interface that all Memory-OS connectors must implement."""
+
+    name: str = ""
+    slug: str = ""
+
+    @abstractmethod
+    def authenticate(self) -> bool:
+        """Check if authentication is active for this connector.
+
+        Returns True if the connector is authenticated and ready to sync.
+        """
+        ...
+
+    @abstractmethod
+    def sync(self) -> dict:
+        """Run the sync process for this connector.
+
+        Returns a summary dict with keys like 'synced', 'skipped', 'errors'.
+        """
+        ...
+
+    @abstractmethod
+    def health(self) -> tuple[bool, str]:
+        """Check the health/connectivity status of this connector.
+
+        Returns (is_healthy, detail_string).
+        """
+        ...

connectors/github.py

@@ -0,0 +1,273 @@
+import base64
+from datetime import datetime
+from composio import Composio
+from models.memory import Repository, RepositoryDocument
+from storage.db import (
+    insert_repository,
+    insert_repository_document,
+    get_repo_count,
+    get_repository_document_count,
+    get_repository_details
+)
+
+def decode_github_content(content_str: str, encoding: str = "base64") -> str:
+    if not content_str:
+        return ""
+    cleaned = content_str.replace("\n", "").replace("\r", "").strip()
+    try:
+        decoded_bytes = base64.b64decode(cleaned)
+        return decoded_bytes.decode("utf-8", errors="ignore")
+    except Exception:
+        return content_str
+
+def extract_metadata(data: dict):
+    repo_name = data.get("name") or ""
+    description = data.get("description") or ""
+    language = data.get("language") or "N/A"
+    visibility = data.get("visibility") or "public"
+    
+    stars = data.get("stargazers_count")
+    if stars is None:
+        stars = data.get("stars") or 0
+        
+    forks = data.get("forks_count")
+    if forks is None:
+        forks = data.get("forks") or 0
+        
+    open_issues = data.get("open_issues_count")
+    if open_issues is None:
+        open_issues = data.get("open_issues") or 0
+        
+    default_branch = data.get("default_branch") or "main"
+    updated_at = data.get("updated_at") or ""
+    url = data.get("html_url") or data.get("url") or ""
+    
+    return repo_name, description, language, visibility, stars, forks, open_issues, default_branch, updated_at, url
+
+import os
+import sys
+
+def sync_github():
+    try:
+        try:
+            sys.stdout.reconfigure(encoding='utf-8')
+        except Exception:
+            pass
+            
+        c = Composio()
+        user_id = os.getenv("COMPOSIO_USER_ID", "user_123")
+        s = c.create(user_id=user_id)
+        
+        # Verify connection
+        toolkits_info = s.toolkits()
+        github_tk = next((t for t in toolkits_info.items if t.slug == "github"), None)
+        if not github_tk or not (github_tk.connection and github_tk.connection.is_active):
+            print("GitHub connection not active.")
+            return
+
+        print("Syncing GitHub...\n")
+        
+        # Fetch repositories
+        resp = s.execute(tool_slug="github_list_repositories_for_the_authenticated_user", arguments={})
+        if resp.error or not resp.data:
+            print("No repositories found.")
+            return
+
+        resp_data = resp.data
+        if isinstance(resp_data, dict) and "response_data" in resp_data:
+            resp_data = resp_data["response_data"]
+
+        repos = []
+        if isinstance(resp_data, list):
+            repos = resp_data
+        elif isinstance(resp_data, dict):
+            repos = resp_data.get("repositories") or resp_data.get("items") or []
+
+        if not isinstance(repos, list) or not repos:
+            print("No repositories found.")
+            return
+
+        print(f"Found {len(repos)} repositories\n")
+        
+        for repo in repos:
+            if not isinstance(repo, dict):
+                continue
+            repo_name = repo.get("name")
+            if not repo_name:
+                continue
+
+            # Incremental sync check
+            existing = get_repository_details(repo_name)
+            if existing:
+                existing_updated_at = existing.get("updated_at") or ""
+                repo_updated_at = repo.get("updated_at") or ""
+                if existing_updated_at and repo_updated_at and existing_updated_at[:19] == repo_updated_at[:19]:
+                    if existing.get("files"):
+                        print(f"Repository {repo_name} is up-to-date. Skipping sync.")
+                        continue
+                
+            full_name = repo.get("full_name", "")
+            owner = None
+            if repo.get("owner") and isinstance(repo.get("owner"), dict):
+                owner = repo.get("owner", {}).get("login")
+            if not owner and "/" in full_name:
+                owner = full_name.split("/")[0]
+            if not owner:
+                continue
+
+            # Fetch detailed metadata
+            try:
+                resp_meta = s.execute(
+                    tool_slug="github_get_a_repository",
+                    arguments={"owner": owner, "repo": repo_name}
+                )
+                if resp_meta and not resp_meta.error and resp_meta.data:
+                    meta_data = resp_meta.data
+                    if "response_data" in meta_data and isinstance(meta_data["response_data"], dict):
+                        meta_data = meta_data["response_data"]
+                else:
+                    meta_data = repo
+            except Exception:
+                meta_data = repo
+
+            # Extract & Save Repository Metadata
+            repo_name, description, language, visibility, stars, forks, open_issues, default_branch, updated_at, url = extract_metadata(meta_data)
+            db_repo = Repository(
+                repo_name=repo_name,
+                description=description,
+                language=language,
+                visibility=visibility,
+                stars=stars,
+                forks=forks,
+                open_issues=open_issues,
+                default_branch=default_branch,
+                updated_at=updated_at,
+                url=url
+            )
+            insert_repository(db_repo)
+
+            stored_files = {
+                "README.md": False,
+                "package.json": False,
+                "requirements.txt": False
+            }
+            
+            # Fetch README
+            readme_stored = False
+            synced_at_str = datetime.now().isoformat()
+            try:
+                resp_readme = s.execute(
+                    tool_slug="github_get_a_repository_readme",
+                    arguments={"owner": owner, "repo": repo_name}
+                )
+                if resp_readme and not resp_readme.error and resp_readme.data:
+                    readme_data = resp_readme.data
+                    if "response_data" in readme_data and isinstance(readme_data["response_data"], dict):
+                        readme_data = readme_data["response_data"]
+                    if "content" in readme_data and isinstance(readme_data["content"], dict):
+                        readme_data = readme_data["content"]
+                    
+                    raw_content = readme_data.get("content") or ""
+                    encoding = readme_data.get("encoding") or "base64"
+                    decoded_readme = decode_github_content(raw_content, encoding)
+                    if decoded_readme.strip():
+                        doc = RepositoryDocument(
+                            repo_name=repo_name,
+                            file_name="README.md",
+                            content=decoded_readme,
+                            source="github_get_a_repository_readme",
+                            synced_at=synced_at_str
+                        )
+                        insert_repository_document(doc)
+                        stored_files["README.md"] = True
+                        readme_stored = True
+            except Exception:
+                pass
+
+            # Fetch specific configuration files
+            files_to_check = ["README.md", "package.json", "requirements.txt", "pyproject.toml", "docker-compose.yml", "Dockerfile"]
+            for file_path in files_to_check:
+                if file_path == "README.md" and readme_stored:
+                    continue
+                
+                try:
+                    resp_file = s.execute(
+                        tool_slug="github_get_repository_content",
+                        arguments={"owner": owner, "repo": repo_name, "path": file_path}
+                    )
+                    if resp_file and not resp_file.error and resp_file.data:
+                        file_data = resp_file.data
+                        if "response_data" in file_data and isinstance(file_data["response_data"], dict):
+                            file_data = file_data["response_data"]
+                        if "content" in file_data and isinstance(file_data["content"], dict):
+                            file_data = file_data["content"]
+                        
+                        raw_content = file_data.get("content")
+                        if raw_content:
+                            encoding = file_data.get("encoding") or "base64"
+                            decoded_content = decode_github_content(raw_content, encoding)
+                            if decoded_content.strip():
+                                doc = RepositoryDocument(
+                                    repo_name=repo_name,
+                                    file_name=file_path,
+                                    content=decoded_content,
+                                    source="github_get_repository_content",
+                                    synced_at=synced_at_str
+                                )
+                                insert_repository_document(doc)
+                                if file_path in stored_files:
+                                    stored_files[file_path] = True
+                except Exception:
+                    pass
+
+            # Print repository sync details
+            print("--------------------------------------------------")
+            print(f"Repository: {repo_name}")
+            print(f"Language: {language}")
+            print(f"Stars: {stars}")
+            print(f"Forks: {forks}")
+            print(f"README: {'✓' if stored_files['README.md'] else '✗'}")
+            print(f"package.json: {'✓' if stored_files['package.json'] else '✗'}")
+            print(f"requirements.txt: {'✓' if stored_files['requirements.txt'] else '✗'}")
+            print("--------------------------------------------------")
+            print()
+
+        # Print final summary stats
+        total_repos = get_repo_count()
+        total_docs = get_repository_document_count()
+        print("GitHub Sync Complete")
+        print(f"Repositories Stored: {total_repos}")
+        print(f"Documents Stored: {total_docs}")
+
+    except Exception as e:
+        print(f"Error during GitHub sync: {e}")
+
+
+from connectors.base import BaseConnector
+from connectors.registry import register
+
+@register
+class GitHubConnector(BaseConnector):
+    name = "GitHub"
+    slug = "github"
+
+    def authenticate(self) -> bool:
+        try:
+            c = Composio()
+            user_id = os.getenv("COMPOSIO_USER_ID", "user_123")
+            s = c.create(user_id=user_id)
+            toolkits_info = s.toolkits()
+            tk = next((t for t in toolkits_info.items if t.slug == "github"), None)
+            return bool(tk and tk.connection and tk.connection.is_active)
+        except Exception:
+            return False
+
+    def sync(self) -> dict:
+        sync_github()
+        return {"status": "success"}
+
+    def health(self) -> tuple[bool, str]:
+        if self.authenticate():
+            return True, "Connected"
+        return False, "Not connected"
+