basic-memory 0.15.1__tar.gz → 0.15.2__tar.gz

{basic_memory-0.15.1 → basic_memory-0.15.2}/CHANGELOG.md

@@ -1,5 +1,49 @@
 # CHANGELOG
 
+## v0.15.2 (2025-10-14)
+
+### Features
+
+- **#356**: Add WebDAV upload command for cloud projects
+  ([`5258f45`](https://github.com/basicmachines-co/basic-memory/commit/5258f457))
+  - New `bm cloud upload` command for uploading local files/directories to cloud projects
+  - WebDAV-based file transfer with automatic directory creation
+  - Support for `.gitignore` and `.bmignore` pattern filtering
+  - Automatic project creation with `--create-project` flag
+  - Optional post-upload sync with `--sync` flag (enabled by default)
+  - Human-readable file size reporting (bytes, KB, MB)
+  - Comprehensive test coverage (28 unit tests)
+
+### Migration Guide
+
+No manual migration required. Upgrade with:
+
+```bash
+# Update via uv
+uv tool upgrade basic-memory
+
+# Or install fresh
+uv tool install basic-memory
+```
+
+**What's New:**
+- Upload local files to cloud projects with `bm cloud upload`
+- Streamlined cloud project creation and management
+- Better file filtering with gitignore integration
+
+### Installation
+
+```bash
+# Latest stable release
+uv tool install basic-memory
+
+# Update existing installation
+uv tool upgrade basic-memory
+
+# Docker
+docker pull ghcr.io/basicmachines-co/basic-memory:v0.15.2
+```
+
 ## v0.15.1 (2025-10-13)
 
 ### Performance Improvements
@@ -1728,4 +1772,4 @@ Co-authored-by: phernandez <phernandez@basicmachines.co>
 ### Chores
 
 - Remove basic-foundation src ref in pyproject.toml
-  ([`29fce8b`](https://github.com/basicmachines-co/basic-memory/commit/29fce8b0b922d54d7799bf2534107ee6cfb961b8))
+  ([`29fce8b`](https://github.com/basicmachines-co/basic-memory/commit/29fce8b0b922d54d7799bf2534107ee6cfb961b8))

{basic_memory-0.15.1 → basic_memory-0.15.2}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: basic-memory
-Version: 0.15.1
+Version: 0.15.2
 Summary: Local-first knowledge management combining Zettelkasten with knowledge graphs
 Project-URL: Homepage, https://github.com/basicmachines-co/basic-memory
 Project-URL: Repository, https://github.com/basicmachines-co/basic-memory

{basic_memory-0.15.1 → basic_memory-0.15.2}/docs/cloud-cli.md

@@ -7,6 +7,7 @@ The Basic Memory Cloud CLI provides seamless integration between local and cloud
 The cloud CLI enables you to:
 - **Toggle cloud mode** with `bm cloud login` / `bm cloud logout`
 - **Use regular commands in cloud mode**: `bm project`, `bm sync`, `bm tool` all work with cloud
+- **Upload local files** directly to cloud projects via `bm cloud upload`
 - **Bidirectional sync** with rclone bisync (recommended for most users)
 - **Direct file access** via rclone mount (alternative workflow)
 - **Integrity verification** with `bm cloud check`
@@ -160,6 +161,69 @@ bm project list
 
 This Dropbox-like workflow means you don't need to manually coordinate projects between local and cloud.
 
+### Uploading Local Files
+
+You can directly upload local files or directories to cloud projects using `bm cloud upload`. This is useful for:
+- Migrating existing local projects to the cloud
+- Quickly uploading specific files or directories
+- One-time bulk uploads without setting up sync
+
+**Basic Usage:**
+
+```bash
+# Upload a directory to existing project
+bm cloud upload ~/my-notes --project research
+
+# Upload a single file
+bm cloud upload important-doc.md --project research
+```
+
+**Create Project On-the-Fly:**
+
+If the target project doesn't exist yet, use `--create-project`:
+
+```bash
+# Upload and create project in one step
+bm cloud upload ~/local-project --project new-research --create-project
+```
+
+**Skip Automatic Sync:**
+
+By default, the command syncs the project after upload to index the files. To skip this:
+
+```bash
+# Upload without triggering sync
+bm cloud upload ~/bulk-data --project archives --no-sync
+```
+
+**File Filtering:**
+
+The upload command respects `.bmignore` and `.gitignore` patterns, automatically excluding:
+- Hidden files (`.git`, `.DS_Store`)
+- Build artifacts (`node_modules`, `__pycache__`)
+- Database files (`*.db`, `*.db-wal`)
+- Environment files (`.env`)
+
+To customize what gets uploaded, edit `~/.basic-memory/.bmignore`.
+
+**Complete Example:**
+
+```bash
+# 1. Login to cloud
+bm cloud login
+
+# 2. Upload local project (creates project if needed)
+bm cloud upload ~/Documents/research-notes --project research --create-project
+
+# 3. Verify upload
+bm project list
+```
+
+**Notes:**
+- Files are uploaded directly via WebDAV (no sync setup required)
+- Uploads are immediate and don't require bisync or mount
+- Use this for migration or one-time uploads; use `bm sync` for ongoing synchronization
+
 ## File Synchronization
 
 ### The `bm sync` Command (Cloud Mode Aware)
@@ -628,6 +692,15 @@ bm cloud check                   # Full integrity check
 bm cloud check --one-way         # Faster one-way check
 ```
 
+### File Upload
+
+```bash
+# Upload files/directories to cloud projects
+bm cloud upload <path> --project <name>              # Upload to existing project
+bm cloud upload <path> -p <name> --create-project    # Upload and create project
+bm cloud upload <path> -p <name> --no-sync           # Upload without syncing
+```
+
 ### Direct File Access (Mount)
 
 ```bash

{basic_memory-0.15.1 → basic_memory-0.15.2}/pyproject.toml

@@ -34,7 +34,7 @@ dependencies = [
     "pyjwt>=2.10.1",
     "python-dotenv>=1.1.0",
     "pytest-aio>=1.9.0",
-    "aiofiles>=24.1.0",  # Async file I/O
+    "aiofiles>=24.1.0", # Async file I/O
 ]
 
 

{basic_memory-0.15.1 → basic_memory-0.15.2}/src/basic_memory/__init__.py

@@ -1,7 +1,7 @@
 """basic-memory - Local-first knowledge management combining Zettelkasten with knowledge graphs"""
 
 # Package version - updated by release automation
-__version__ = "0.15.1"
+__version__ = "0.15.2"
 
 # API version for FastAPI - independent of package version
 __api_version__ = "v0"

{basic_memory-0.15.1 → basic_memory-0.15.2}/src/basic_memory/cli/commands/cloud/__init__.py

@@ -2,4 +2,5 @@
 
 # Import all commands to register them with typer
 from basic_memory.cli.commands.cloud.core_commands import *  # noqa: F401,F403
-from basic_memory.cli.commands.cloud.api_client import get_authenticated_headers  # noqa: F401
+from basic_memory.cli.commands.cloud.api_client import get_authenticated_headers, get_cloud_config  # noqa: F401
+from basic_memory.cli.commands.cloud.upload_command import *  # noqa: F401,F403

{basic_memory-0.15.1 → basic_memory-0.15.2}/src/basic_memory/cli/commands/cloud/bisync_commands.py

@@ -12,6 +12,10 @@ from rich.console import Console
 from rich.table import Table
 
 from basic_memory.cli.commands.cloud.api_client import CloudAPIError, make_api_request
+from basic_memory.cli.commands.cloud.cloud_utils import (
+    create_cloud_project,
+    fetch_cloud_projects,
+)
 from basic_memory.cli.commands.cloud.rclone_config import (
     add_tenant_to_rclone_config,
 )
@@ -21,11 +25,7 @@ from basic_memory.ignore_utils import get_bmignore_path, create_default_bmignore
 from basic_memory.schemas.cloud import (
     TenantMountInfo,
     MountCredentials,
-    CloudProjectList,
-    CloudProjectCreateRequest,
-    CloudProjectCreateResponse,
 )
-from basic_memory.utils import generate_permalink
 
 console = Console()
 
@@ -110,24 +110,6 @@ async def generate_mount_credentials(tenant_id: str) -> MountCredentials:
         raise BisyncError(f"Failed to generate credentials: {e}") from e
 
 
-async def fetch_cloud_projects() -> CloudProjectList:
-    """Fetch list of projects from cloud API.
-
-    Returns:
-        CloudProjectList with projects from cloud
-    """
-    try:
-        config_manager = ConfigManager()
-        config = config_manager.config
-        host_url = config.cloud_host.rstrip("/")
-
-        response = await make_api_request(method="GET", url=f"{host_url}/proxy/projects/projects")
-
-        return CloudProjectList.model_validate(response.json())
-    except Exception as e:
-        raise BisyncError(f"Failed to fetch cloud projects: {e}") from e
-
-
 def scan_local_directories(sync_dir: Path) -> list[str]:
     """Scan local sync directory for project folders.
 
@@ -148,41 +130,6 @@ def scan_local_directories(sync_dir: Path) -> list[str]:
     return directories
 
 
-async def create_cloud_project(project_name: str) -> CloudProjectCreateResponse:
-    """Create a new project on cloud.
-
-    Args:
-        project_name: Name of project to create
-
-    Returns:
-        CloudProjectCreateResponse with project details from API
-    """
-    try:
-        config_manager = ConfigManager()
-        config = config_manager.config
-        host_url = config.cloud_host.rstrip("/")
-
-        # Use generate_permalink to ensure consistent naming
-        project_path = generate_permalink(project_name)
-
-        project_data = CloudProjectCreateRequest(
-            name=project_name,
-            path=project_path,
-            set_default=False,
-        )
-
-        response = await make_api_request(
-            method="POST",
-            url=f"{host_url}/proxy/projects/projects",
-            headers={"Content-Type": "application/json"},
-            json_data=project_data.model_dump(),
-        )
-
-        return CloudProjectCreateResponse.model_validate(response.json())
-    except Exception as e:
-        raise BisyncError(f"Failed to create cloud project '{project_name}': {e}") from e
-
-
 def get_bisync_state_path(tenant_id: str) -> Path:
     """Get path to bisync state directory."""
     return Path.home() / ".basic-memory" / "bisync-state" / tenant_id

basic_memory-0.15.2/src/basic_memory/cli/commands/cloud/cloud_utils.py

@@ -0,0 +1,100 @@
+"""Shared utilities for cloud operations."""
+
+from basic_memory.cli.commands.cloud.api_client import make_api_request
+from basic_memory.config import ConfigManager
+from basic_memory.schemas.cloud import (
+    CloudProjectList,
+    CloudProjectCreateRequest,
+    CloudProjectCreateResponse,
+)
+from basic_memory.utils import generate_permalink
+
+
+class CloudUtilsError(Exception):
+    """Exception raised for cloud utility errors."""
+
+    pass
+
+
+async def fetch_cloud_projects() -> CloudProjectList:
+    """Fetch list of projects from cloud API.
+
+    Returns:
+        CloudProjectList with projects from cloud
+    """
+    try:
+        config_manager = ConfigManager()
+        config = config_manager.config
+        host_url = config.cloud_host.rstrip("/")
+
+        response = await make_api_request(method="GET", url=f"{host_url}/proxy/projects/projects")
+
+        return CloudProjectList.model_validate(response.json())
+    except Exception as e:
+        raise CloudUtilsError(f"Failed to fetch cloud projects: {e}") from e
+
+
+async def create_cloud_project(project_name: str) -> CloudProjectCreateResponse:
+    """Create a new project on cloud.
+
+    Args:
+        project_name: Name of project to create
+
+    Returns:
+        CloudProjectCreateResponse with project details from API
+    """
+    try:
+        config_manager = ConfigManager()
+        config = config_manager.config
+        host_url = config.cloud_host.rstrip("/")
+
+        # Use generate_permalink to ensure consistent naming
+        project_path = generate_permalink(project_name)
+
+        project_data = CloudProjectCreateRequest(
+            name=project_name,
+            path=project_path,
+            set_default=False,
+        )
+
+        response = await make_api_request(
+            method="POST",
+            url=f"{host_url}/proxy/projects/projects",
+            headers={"Content-Type": "application/json"},
+            json_data=project_data.model_dump(),
+        )
+
+        return CloudProjectCreateResponse.model_validate(response.json())
+    except Exception as e:
+        raise CloudUtilsError(f"Failed to create cloud project '{project_name}': {e}") from e
+
+
+async def sync_project(project_name: str) -> None:
+    """Trigger sync for a specific project on cloud.
+
+    Args:
+        project_name: Name of project to sync
+    """
+    try:
+        from basic_memory.cli.commands.command_utils import run_sync
+
+        await run_sync(project=project_name)
+    except Exception as e:
+        raise CloudUtilsError(f"Failed to sync project '{project_name}': {e}") from e
+
+
+async def project_exists(project_name: str) -> bool:
+    """Check if a project exists on cloud.
+
+    Args:
+        project_name: Name of project to check
+
+    Returns:
+        True if project exists, False otherwise
+    """
+    try:
+        projects = await fetch_cloud_projects()
+        project_names = {p.name for p in projects.projects}
+        return project_name in project_names
+    except Exception:
+        return False

basic_memory-0.15.2/src/basic_memory/cli/commands/cloud/upload.py

@@ -0,0 +1,128 @@
+"""WebDAV upload functionality for basic-memory projects."""
+
+import os
+from pathlib import Path
+
+import aiofiles
+import httpx
+
+from basic_memory.ignore_utils import load_gitignore_patterns, should_ignore_path
+from basic_memory.mcp.async_client import get_client
+from basic_memory.mcp.tools.utils import call_put
+
+
+async def upload_path(local_path: Path, project_name: str) -> bool:
+    """
+    Upload a file or directory to cloud project via WebDAV.
+
+    Args:
+        local_path: Path to local file or directory
+        project_name: Name of cloud project (destination)
+
+    Returns:
+        True if upload succeeded, False otherwise
+    """
+    try:
+        # Resolve path
+        local_path = local_path.resolve()
+
+        # Check if path exists
+        if not local_path.exists():
+            print(f"Error: Path does not exist: {local_path}")
+            return False
+
+        # Get files to upload
+        if local_path.is_file():
+            files_to_upload = [(local_path, local_path.name)]
+        else:
+            files_to_upload = _get_files_to_upload(local_path)
+
+        if not files_to_upload:
+            print("No files found to upload")
+            return True
+
+        print(f"Found {len(files_to_upload)} file(s) to upload")
+
+        # Upload files using httpx
+        total_bytes = 0
+
+        async with get_client() as client:
+            for i, (file_path, relative_path) in enumerate(files_to_upload, 1):
+                # Build remote path: /webdav/{project_name}/{relative_path}
+                remote_path = f"/webdav/{project_name}/{relative_path}"
+                print(f"Uploading {relative_path} ({i}/{len(files_to_upload)})")
+
+                # Read file content asynchronously
+                async with aiofiles.open(file_path, "rb") as f:
+                    content = await f.read()
+
+                # Upload via HTTP PUT to WebDAV endpoint
+                response = await call_put(client, remote_path, content=content)
+                response.raise_for_status()
+
+                total_bytes += file_path.stat().st_size
+
+        # Format size based on magnitude
+        if total_bytes < 1024:
+            size_str = f"{total_bytes} bytes"
+        elif total_bytes < 1024 * 1024:
+            size_str = f"{total_bytes / 1024:.1f} KB"
+        else:
+            size_str = f"{total_bytes / (1024 * 1024):.1f} MB"
+
+        print(f"✓ Upload complete: {len(files_to_upload)} file(s) ({size_str})")
+        return True
+
+    except httpx.HTTPStatusError as e:
+        print(f"Upload failed: HTTP {e.response.status_code} - {e.response.text}")
+        return False
+    except Exception as e:
+        print(f"Upload failed: {e}")
+        return False
+
+
+def _get_files_to_upload(directory: Path) -> list[tuple[Path, str]]:
+    """
+    Get list of files to upload from directory.
+
+    Uses .bmignore and .gitignore patterns for filtering.
+
+    Args:
+        directory: Directory to scan
+
+    Returns:
+        List of (absolute_path, relative_path) tuples
+    """
+    files = []
+
+    # Load ignore patterns from .bmignore and .gitignore
+    ignore_patterns = load_gitignore_patterns(directory)
+
+    # Walk through directory
+    for root, dirs, filenames in os.walk(directory):
+        root_path = Path(root)
+
+        # Filter directories based on ignore patterns
+        filtered_dirs = []
+        for d in dirs:
+            dir_path = root_path / d
+            if not should_ignore_path(dir_path, directory, ignore_patterns):
+                filtered_dirs.append(d)
+        dirs[:] = filtered_dirs
+
+        # Process files
+        for filename in filenames:
+            file_path = root_path / filename
+
+            # Check if file should be ignored
+            if should_ignore_path(file_path, directory, ignore_patterns):
+                continue
+
+            # Calculate relative path for remote
+            rel_path = file_path.relative_to(directory)
+            # Use forward slashes for WebDAV paths
+            remote_path = str(rel_path).replace("\\", "/")
+
+            files.append((file_path, remote_path))
+
+    return files

basic_memory-0.15.2/src/basic_memory/cli/commands/cloud/upload_command.py

@@ -0,0 +1,93 @@
+"""Upload CLI commands for basic-memory projects."""
+
+import asyncio
+from pathlib import Path
+
+import typer
+from rich.console import Console
+
+from basic_memory.cli.app import cloud_app
+from basic_memory.cli.commands.cloud.cloud_utils import (
+    create_cloud_project,
+    project_exists,
+    sync_project,
+)
+from basic_memory.cli.commands.cloud.upload import upload_path
+
+console = Console()
+
+
+@cloud_app.command("upload")
+def upload(
+    path: Path = typer.Argument(
+        ...,
+        help="Path to local file or directory to upload",
+        exists=True,
+        readable=True,
+        resolve_path=True,
+    ),
+    project: str = typer.Option(
+        ...,
+        "--project",
+        "-p",
+        help="Cloud project name (destination)",
+    ),
+    create_project: bool = typer.Option(
+        False,
+        "--create-project",
+        "-c",
+        help="Create project if it doesn't exist",
+    ),
+    sync: bool = typer.Option(
+        True,
+        "--sync/--no-sync",
+        help="Sync project after upload (default: true)",
+    ),
+) -> None:
+    """Upload local files or directories to cloud project via WebDAV.
+
+    Examples:
+      bm cloud upload ~/my-notes --project research
+      bm cloud upload notes.md --project research --create-project
+      bm cloud upload ~/docs --project work --no-sync
+    """
+
+    async def _upload():
+        # Check if project exists
+        if not await project_exists(project):
+            if create_project:
+                console.print(f"[blue]Creating cloud project '{project}'...[/blue]")
+                try:
+                    await create_cloud_project(project)
+                    console.print(f"[green]✓ Created project '{project}'[/green]")
+                except Exception as e:
+                    console.print(f"[red]Failed to create project: {e}[/red]")
+                    raise typer.Exit(1)
+            else:
+                console.print(
+                    f"[red]Project '{project}' does not exist.[/red]\n"
+                    f"[yellow]Options:[/yellow]\n"
+                    f"  1. Create it first: bm project add {project}\n"
+                    f"  2. Use --create-project flag to create automatically"
+                )
+                raise typer.Exit(1)
+
+        # Perform upload
+        console.print(f"[blue]Uploading {path} to project '{project}'...[/blue]")
+        success = await upload_path(path, project)
+        if not success:
+            console.print("[red]Upload failed[/red]")
+            raise typer.Exit(1)
+
+        console.print(f"[green]✅ Successfully uploaded to '{project}'[/green]")
+
+        # Sync project if requested
+        if sync:
+            console.print(f"[blue]Syncing project '{project}'...[/blue]")
+            try:
+                await sync_project(project)
+            except Exception as e:
+                console.print(f"[yellow]Warning: Sync failed: {e}[/yellow]")
+                console.print("[dim]Files uploaded but may not be indexed yet[/dim]")
+
+    asyncio.run(_upload())