PyPI - content-core - Versions diffs - 1.3.1__tar.gz → 1.4.0__tar.gz - Mend

content-core 1.3.1tar.gz → 1.4.0tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Potentially problematic release.

This version of content-core might be problematic. Click here for more details.

Files changed (97) hide show

content_core-1.4.0/.claude/sessions/OSS-216/architecture.md ADDED Viewed

@@ -0,0 +1,195 @@
+# OSS-216: Remove libmagic Dependency - Architecture
+## High-Level System Overview
+### Current State (Before)
+```
+File Input → magic.from_file() → MIME Type → Content Router → Processor
+                     ↑
+                libmagic (C library)
+```
+### Target State (After)
+```
+File Input → file_detector.detect() → MIME Type → Content Router → Processor
+                     ↑
+              Pure Python Detection
+```
+## Affected Components
+### 1. `/src/content_core/content/identification/__init__.py`
+- **Current**: Single function `get_file_type()` using `magic.from_file()`
+- **Change**: Replace with new detection module
+- **Dependencies**: None (isolated module)
+### 2. `/src/content_core/content/extraction/graph.py`
+- **Current**: `file_type()` function using `magic.from_file()` at line 62
+- **Change**: Replace with new detection function call
+- **Dependencies**: Routes to various processors based on MIME type
+### 3. `/pyproject.toml`
+- **Current**: Dependencies on `python-magic>=0.4.27` and `python-magic-bin==0.4.14`
+- **Change**: Remove both dependencies
+## New Component Design
+### File Detection Module (`/src/content_core/content/identification/file_detector.py`)
+```python
+class FileDetector:
+    """Pure Python file type detection using magic bytes and content analysis."""
+    def __init__(self):
+        self.signatures = self._load_signatures()
+        self.text_patterns = self._load_text_patterns()
+    async def detect(self, file_path: str) -> str:
+        """Main detection method returning MIME type."""
+        # 1. Read first 512 bytes
+        # 2. Check binary signatures
+        # 3. If no match, analyze as text
+        # 4. Fallback to extension mapping
+        # 5. Raise UnsupportedTypeException if all fail
+# Backward compatibility function
+async def get_file_type(file_path: str) -> str:
+    """Legacy function for compatibility."""
+    detector = FileDetector()
+    return await detector.detect(file_path)
+```
+### Signature Mappings
+```python
+BINARY_SIGNATURES = {
+    # PDFs
+    b'%PDF': 'application/pdf',
+    # Office formats (ZIP-based)
+    b'PK\x03\x04': 'application/zip',  # Will need content analysis
+    # Images
+    b'\xff\xd8\xff': 'image/jpeg',
+    b'\x89PNG\r\n\x1a\n': 'image/png',
+    b'GIF87a': 'image/gif',
+    b'GIF89a': 'image/gif',
+    b'II*\x00': 'image/tiff',
+    b'MM\x00*': 'image/tiff',
+    # Audio/Video
+    b'ID3': 'audio/mpeg',
+    b'\xff\xfb': 'audio/mpeg',
+    b'RIFF': 'audio/wav',  # Also video/avi
+    b'\x00\x00\x00\x14ftypM4A': 'audio/mp4',
+    b'\x00\x00\x00\x18ftypmp4': 'video/mp4',
+    b'\x00\x00\x00\x14ftypisom': 'video/mp4',
+    # EPUB
+    b'PK\x03\x04': 'application/epub+zip',  # Will need content analysis
+}
+# For ZIP-based formats, check internal structure
+ZIP_CONTENT_PATTERNS = {
+    'word/': 'application/vnd.openxmlformats-officedocument.wordprocessingml.document',
+    'xl/': 'application/vnd.openxmlformats-officedocument.spreadsheetml.sheet',
+    'ppt/': 'application/vnd.openxmlformats-officedocument.presentationml.presentation',
+    'META-INF/container.xml': 'application/epub+zip',
+}
+# Text-based format detection
+TEXT_PATTERNS = {
+    '<!DOCTYPE html': 'text/html',
+    '<html': 'text/html',
+    '<?xml': 'text/xml',
+    '{"': 'application/json',
+    '[{': 'application/json',
+    '---\n': 'text/yaml',
+    '#': 'text/markdown',  # Weak, needs more context
+}
+# Extension fallback mapping
+EXTENSION_MAPPING = {
+    '.pdf': 'application/pdf',
+    '.txt': 'text/plain',
+    '.md': 'text/plain',  # Current behavior
+    '.html': 'text/html',
+    '.json': 'application/json',
+    '.csv': 'text/csv',
+    '.mp4': 'video/mp4',
+    '.mp3': 'audio/mpeg',
+    '.wav': 'audio/wav',
+    '.docx': 'application/vnd.openxmlformats-officedocument.wordprocessingml.document',
+    '.xlsx': 'application/vnd.openxmlformats-officedocument.spreadsheetml.sheet',
+    '.pptx': 'application/vnd.openxmlformats-officedocument.presentationml.presentation',
+    '.epub': 'application/epub+zip',
+}
+```
+## Implementation Strategy
+### Phase 1: Create Detection Module
+1. Implement `FileDetector` class with all detection logic
+2. Handle ZIP-based formats by checking internal structure
+3. Implement robust text format detection
+4. Add comprehensive logging for debugging
+### Phase 2: Integration
+1. Update `get_file_type()` to use new detector
+2. Update `file_type()` in graph.py
+3. Ensure all MIME type strings match expected values
+### Phase 3: Cleanup
+1. Remove magic imports
+2. Update pyproject.toml dependencies
+3. Run tests to ensure compatibility
+## Patterns & Best Practices
+### Error Handling
+- Maintain existing `UnsupportedTypeException` behavior
+- Add specific error messages for debugging
+- Log detection attempts for troubleshooting
+### Async Pattern
+- Keep async interface for consistency
+- Use `aiofiles` if needed for async file reading
+### Extensibility
+- Design for easy addition of new signatures
+- Consider configuration file for custom mappings
+## External Dependencies
+- **None** - Pure Python implementation
+- Uses only standard library: `os`, `pathlib`, `zipfile`
+## Trade-offs & Alternatives
+### Trade-offs
+1. **Performance**: Slightly slower than libmagic C library, but acceptable per requirements
+2. **Accuracy**: May have edge cases libmagic handles better, but covers all current use cases
+3. **Maintenance**: More code to maintain, but removes deployment complexity
+### Alternatives Considered
+1. **python-magic-bin fork**: Still has binary dependencies
+2. **filetype library**: Pure Python but limited format support
+3. **Custom C extension**: Defeats purpose of removing binary dependencies
+## Negative Consequences
+1. **Potential edge cases**: Some obscure file formats might not be detected correctly
+2. **Maintenance burden**: Need to update signatures for new formats
+3. **Slightly larger codebase**: Adding ~200 lines of detection code
+## Files to Edit/Create
+### Create:
+1. `/src/content_core/content/identification/file_detector.py` - Main detection logic
+### Edit:
+1. `/src/content_core/content/identification/__init__.py` - Update to use new detector
+2. `/src/content_core/content/extraction/graph.py` - Replace magic.from_file() call
+3. `/pyproject.toml` - Remove python-magic dependencies
+### No Changes Needed:
+- All processor files (they only check MIME types, don't detect them)
+- Test files (will continue to work with same MIME types)

content_core-1.4.0/.claude/sessions/OSS-216/context.md ADDED Viewed

@@ -0,0 +1,54 @@
+# OSS-216: Remove libmagic Dependency - Context
+## Why This Is Being Built
+- **Deployment Friction**: libmagic requires OS-level installation which creates deployment problems
+- **Cross-Platform Issues**: Binary dependency causes installation problems across Windows, macOS, and Linux
+- **Simplification**: Removing system dependencies makes the package easier to install and use
+- **Maintain Functionality**: Need to keep intelligent file detection without external dependencies
+## Expected Outcome
+Replace libmagic with a pure Python implementation that:
+- Detects file types using magic bytes/file signatures (first 512 bytes)
+- Maintains the current routing behavior to appropriate content processors
+- Works across all platforms without OS-level dependencies
+- Keeps the same error handling (UnsupportedTypeException for unsupported types)
+## Implementation Approach
+1. **File Signature Detection System**:
+   - Build comprehensive mapping of file signatures to MIME types
+   - Read first 512 bytes to identify format by magic bytes
+   - Special handling for Office formats (DOCX, XLSX, PPTX) which are ZIP-based
+   - Content structure analysis for text formats (HTML, JSON, XML)
+2. **Detection Priority** (as discussed):
+   - Primary: File signature/magic bytes detection
+   - Secondary: Content analysis for text formats
+   - Tertiary: File extension as final fallback
+   - If file extension and content disagree, prioritize content analysis
+3. **Replace Current Usage**:
+   - Remove imports of `magic` library
+   - Replace `magic.from_file()` calls in:
+     - `/src/content_core/content/identification/__init__.py`
+     - `/src/content_core/content/extraction/graph.py`
+   - Remove dependencies from `pyproject.toml`
+## Testing Approach
+- Comprehensive testing will be handled later
+- Focus on maintaining existing functionality
+- Ensure all currently supported file types continue to work
+## Dependencies
+No new dependencies - implementation should be pure Python using only standard library.
+## Constraints
+- 512 bytes buffer is sufficient (no need for deep ZIP inspection)
+- Performance is not a concern (load is small)
+- Maintain current error behavior (raise UnsupportedTypeException)
+- MIME type strings can be adjusted as long as routing works correctly

content_core-1.4.0/.claude/sessions/OSS-216/plan.md ADDED Viewed

@@ -0,0 +1,195 @@
+# OSS-216: Remove libmagic Dependency
+If you are working on this feature, make sure to update this plan.md file as you go.
+## PHASE 1: Create Pure Python File Detection Module [Completed ✅]
+Build the core file detection system to replace libmagic with pure Python implementation.
+### Create file_detector.py with basic structure [Completed ✅]
+Create `/src/content_core/content/identification/file_detector.py` with:
+- FileDetector class skeleton
+- Basic signature mappings for binary formats (PDF, images)
+- Simple detect() method that reads first 512 bytes
+- Raise UnsupportedTypeException for unknown types
+### Implement binary format detection [Completed ✅]
+Add detection for binary formats:
+- PDF files (magic bytes: `%PDF`)
+- Common image formats (JPEG, PNG, GIF, TIFF, BMP)
+- Audio formats (MP3, WAV, M4A)
+- Video formats (MP4, AVI, MOV)
+- Test each format with sample files
+### Implement ZIP-based format detection [Completed ✅]
+Handle Office and EPUB formats that use ZIP containers:
+- Detect ZIP magic bytes (`PK\x03\x04`)
+- Use zipfile module to inspect internal structure
+- Differentiate DOCX (word/), XLSX (xl/), PPTX (ppt/), EPUB (META-INF/container.xml)
+- Handle corrupted or password-protected ZIP files gracefully
+### Comments:
+- Focus on accurate detection over performance
+- Ensure all MIME types match exactly what libmagic returns
+- **Implementation notes from Phase 1:**
+  - Added comprehensive binary signatures with ordered checking (longer signatures first)
+  - Implemented generic ftyp box detection for MP4/MOV files for better compatibility
+  - Added FLAC audio format support
+  - Special RIFF handling differentiates between WAV and AVI
+  - Text detection requires minimum content length to avoid false positives
+  - All core file types tested and working correctly
+## PHASE 2: Text Format Detection and Fallbacks [Completed ✅]
+Implement text-based format detection and extension fallback mechanism.
+### Add text format detection [Completed ✅]
+Implement content analysis for text formats:
+- HTML detection (DOCTYPE, <html tags)
+- XML detection (<?xml declaration)
+- JSON detection (starts with { or [)
+- YAML detection (--- header)
+- Markdown detection (combine multiple indicators)
+- CSV detection (analyze structure)
+- Plain text as default for unrecognized text
+### Implement extension fallback system [Completed ✅]
+Create comprehensive extension mapping:
+- Map common file extensions to MIME types
+- Use as last resort when content detection fails
+- Log when falling back to extension
+- Maintain compatibility with current behavior
+### Add detection method priority logic [Completed ✅]
+Implement the agreed priority order:
+1. Binary signature detection (most reliable)
+2. Content analysis for text formats
+3. File extension as final fallback
+- Add logging at each detection stage
+- Return appropriate MIME type or raise exception
+### Comments:
+- Text detection needs to be careful to avoid false positives
+- Extension fallback ensures graceful degradation
+- **Implementation notes from Phase 2:**
+  - Enhanced JSON detection with pattern matching and keyword checking
+  - Improved YAML detection to avoid conflicts with Markdown
+  - Added sophisticated Markdown scoring system (headers, lists, links, etc.)
+  - Extended extension mapping to cover more file types (70+ extensions)
+  - Fixed YAML/Markdown detection priority to avoid false positives
+  - Added minimum content requirements for text detection
+  - All text formats tested with edge cases
+## PHASE 3: Integration with Existing Code [Completed ✅]
+Replace libmagic usage throughout the codebase.
+### Update identification module [Completed ✅]
+Modify `/src/content_core/content/identification/__init__.py`:
+- Import FileDetector
+- Replace `magic.from_file()` call in `get_file_type()`
+- Maintain async interface
+- Remove magic import
+### Update graph.py file type detection [Completed ✅]
+Modify `/src/content_core/content/extraction/graph.py`:
+- Replace `magic.from_file()` at line 62
+- Import get_file_type from identification module
+- Remove direct magic import
+- Ensure error handling remains consistent
+### Test integration thoroughly [Completed ✅]
+Verify all extraction paths work:
+- Test each supported file type through full pipeline
+- Verify correct processor routing
+- Check error messages for unsupported types
+- Ensure no regression in functionality
+### Comments:
+- Must maintain exact same external behavior
+- All existing code depending on MIME types should work unchanged
+- **Implementation notes from Phase 3:**
+  - Successfully replaced all libmagic usage with FileDetector
+  - Integration was seamless - no changes needed to downstream processors
+  - All file types correctly detected and routed to appropriate processors
+  - Tested with PDF, DOCX, MP4, MP3, JSON, HTML, CSV, text files
+  - Only test failure was unrelated (OpenAI API issue for MP3 transcription)
+  - MIME types match exactly what libmagic returned
+## PHASE 4: Cleanup and Final Validation [In Progress 🔄]
+Remove dependencies and ensure production readiness.
+### Remove libmagic from dependencies [Completed ✅]
+Update `/pyproject.toml`:
+- Remove `python-magic>=0.4.27`
+- Remove `python-magic-bin==0.4.14` for Windows
+- Update lock file with `uv sync`
+- Verify clean installation works
+**Implementation notes:**
+- Successfully removed both python-magic dependencies from pyproject.toml
+- Lock file updated with `uv sync`
+- 2 packages uninstalled: python-magic and python-magic-bin
+### Add comprehensive test suite [Not Started ⏳]
+Create thorough tests:
+- Unit tests for FileDetector methods
+- Integration tests for full extraction pipeline
+- Edge cases (empty files, malformed files)
+- Cross-platform compatibility tests
+- Performance benchmarks
+### Documentation and release preparation [Not Started ⏳]
+Final preparations:
+- Update README if it mentions libmagic
+- Add docstrings to all new code
+- Update CHANGELOG
+- Test installation on fresh environment
+- Run full test suite: `make test`
+- Build package: `uv build`
+### Comments:
+- This is a breaking change for anyone depending on libmagic behavior
+- Consider adding migration guide if needed
+## Key Technical Details
+**Critical MIME Types** (must match exactly):
+- `application/pdf` - PDF files
+- `application/epub+zip` - EPUB files
+- `application/vnd.openxmlformats-officedocument.wordprocessingml.document` - DOCX
+- `application/vnd.openxmlformats-officedocument.spreadsheetml.sheet` - XLSX
+- `application/vnd.openxmlformats-officedocument.presentationml.presentation` - PPTX
+- `text/plain` - Text and Markdown files
+- `text/html` - HTML files
+- `text/csv` - CSV files
+- `application/json` - JSON files
+- `image/*` - Various image formats
+- `video/*` - Video files (prefix matching)
+- `audio/*` - Audio files (prefix matching)
+**Implementation Constraints**:
+- 512-byte buffer is sufficient (no deep file inspection needed)
+- Performance is not critical (small load expected)
+- Must raise `UnsupportedTypeException` for unknown types
+- Maintain async interface for consistency
+- Pure Python only (no C extensions)
+**Risk Mitigation**:
+- Extensive testing before removing libmagic
+- Keep detection logic modular for easy updates
+- Log detection decisions for debugging
+- Consider feature flag for rollback if needed

{content_core-1.3.1 → content_core-1.4.0}/.gitignore RENAMED Viewed

@@ -27,4 +27,4 @@ CLAUDE.md
 node_modules/
 **/notebooks/private
-.claude/
+claude-logs

content_core-1.4.0/CHANGELOG.md ADDED Viewed

@@ -0,0 +1,31 @@
+# Changelog
+All notable changes to Content Core will be documented in this file.
+The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
+and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
+## [Unreleased]
+### Added
+- Pure Python file type detection via the new `FileDetector` class
+- Comprehensive file signature detection for 25+ file formats
+- Smart detection for ZIP-based formats (DOCX, XLSX, PPTX, EPUB)
+### Changed
+- File type detection now uses pure Python implementation instead of libmagic
+- Improved cross-platform compatibility - no system dependencies required
+### Removed
+- Dependency on `python-magic` and `python-magic-bin`
+- System requirement for libmagic library
+### Technical Details
+- Replaced libmagic dependency with custom `FileDetector` implementation
+- File detection based on binary signatures and content analysis
+- Maintains same API surface - no breaking changes for users
+- Significantly simplified installation process across all platforms
+## Previous Releases
+For releases prior to this changelog, please see the [GitHub releases page](https://github.com/lfnovo/content-core/releases).

{content_core-1.3.1 → content_core-1.4.0}/PKG-INFO RENAMED Viewed

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: content-core
-Version: 1.3.1
+Version: 1.4.0
 Summary: Extract what matters from any media source. Available as Python Library, macOS Service, CLI and MCP Server
 Author-email: LUIS NOVO <lfnovo@gmail.com>
 License-File: LICENSE
@@ -24,8 +24,6 @@ Requires-Dist: pillow>=10.4.0
 Requires-Dist: pymupdf>=1.25.5
 Requires-Dist: python-docx>=1.1.2
 Requires-Dist: python-dotenv>=1.1.0
-Requires-Dist: python-magic-bin==0.4.14; sys_platform == 'win32'
-Requires-Dist: python-magic>=0.4.27
 Requires-Dist: python-pptx>=1.0.2
 Requires-Dist: pytubefix>=9.1.1
 Requires-Dist: readability-lxml>=0.8.4.1
@@ -38,6 +36,14 @@ Description-Content-Type: text/markdown
 # Content Core
 [![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
+[![PyPI version](https://badge.fury.io/py/content-core.svg)](https://badge.fury.io/py/content-core)
+[![Downloads](https://pepy.tech/badge/content-core)](https://pepy.tech/project/content-core)
+[![Downloads](https://pepy.tech/badge/content-core/month)](https://pepy.tech/project/content-core)
+[![GitHub stars](https://img.shields.io/github/stars/lfnovo/content-core?style=social)](https://github.com/lfnovo/content-core)
+[![GitHub forks](https://img.shields.io/github/forks/lfnovo/content-core?style=social)](https://github.com/lfnovo/content-core)
+[![GitHub issues](https://img.shields.io/github/issues/lfnovo/content-core)](https://github.com/lfnovo/content-core/issues)
+[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)
+[![Ruff](https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/astral-sh/ruff/main/assets/badge/v2.json)](https://github.com/astral-sh/ruff)
 **Content Core** is a powerful, AI-powered content extraction and processing platform that transforms any source into clean, structured content. Extract text from websites, transcribe videos, process documents, and generate AI summaries—all through a unified interface with multiple integration options.
@@ -103,12 +109,13 @@ summary = await cc.summarize_content(result, context="explain to a child")
 *   **⚡ Zero-Install Options:** Use `uvx` for instant access without installation
 *   **🧠 AI-Powered Processing:** LLM integration for content cleaning and summarization
 *   **🔄 Asynchronous:** Built with `asyncio` for efficient processing
+*   **🐍 Pure Python Implementation:** No system dependencies required - simplified installation across all platforms
 ## Getting Started
 ### Installation
-Install Content Core using `pip`:
+Install Content Core using `pip` - **no system dependencies required!**
 ```bash
 # Basic installation (PyMuPDF + BeautifulSoup/Jina extraction)
@@ -124,6 +131,8 @@ pip install content-core
 pip install content-core[docling]
 ```
+> **Note:** Unlike many content extraction tools, Content Core uses pure Python implementations and doesn't require system libraries like libmagic. This ensures consistent, hassle-free installation across Windows, macOS, and Linux.
 Alternatively, if you’re developing locally:
 ```bash
@@ -264,6 +273,10 @@ For more information on how to use the Content Core library, including details o
 Content Core includes a Model Context Protocol (MCP) server that enables seamless integration with Claude Desktop and other MCP-compatible applications. The MCP server exposes Content Core's powerful extraction capabilities through a standardized protocol.
+<a href="https://glama.ai/mcp/servers/@lfnovo/content-core">
+  <img width="380" height="200" src="https://glama.ai/mcp/servers/@lfnovo/content-core/badge" />
+</a>
 ### Quick Setup with Claude Desktop
 ```bash

{content_core-1.3.1 → content_core-1.4.0}/README.md RENAMED Viewed

@@ -1,6 +1,14 @@
 # Content Core
 [![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
+[![PyPI version](https://badge.fury.io/py/content-core.svg)](https://badge.fury.io/py/content-core)
+[![Downloads](https://pepy.tech/badge/content-core)](https://pepy.tech/project/content-core)
+[![Downloads](https://pepy.tech/badge/content-core/month)](https://pepy.tech/project/content-core)
+[![GitHub stars](https://img.shields.io/github/stars/lfnovo/content-core?style=social)](https://github.com/lfnovo/content-core)
+[![GitHub forks](https://img.shields.io/github/forks/lfnovo/content-core?style=social)](https://github.com/lfnovo/content-core)
+[![GitHub issues](https://img.shields.io/github/issues/lfnovo/content-core)](https://github.com/lfnovo/content-core/issues)
+[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)
+[![Ruff](https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/astral-sh/ruff/main/assets/badge/v2.json)](https://github.com/astral-sh/ruff)
 **Content Core** is a powerful, AI-powered content extraction and processing platform that transforms any source into clean, structured content. Extract text from websites, transcribe videos, process documents, and generate AI summaries—all through a unified interface with multiple integration options.
@@ -66,12 +74,13 @@ summary = await cc.summarize_content(result, context="explain to a child")
 *   **⚡ Zero-Install Options:** Use `uvx` for instant access without installation
 *   **🧠 AI-Powered Processing:** LLM integration for content cleaning and summarization
 *   **🔄 Asynchronous:** Built with `asyncio` for efficient processing
+*   **🐍 Pure Python Implementation:** No system dependencies required - simplified installation across all platforms
 ## Getting Started
 ### Installation
-Install Content Core using `pip`:
+Install Content Core using `pip` - **no system dependencies required!**
 ```bash
 # Basic installation (PyMuPDF + BeautifulSoup/Jina extraction)
@@ -87,6 +96,8 @@ pip install content-core
 pip install content-core[docling]
 ```
+> **Note:** Unlike many content extraction tools, Content Core uses pure Python implementations and doesn't require system libraries like libmagic. This ensures consistent, hassle-free installation across Windows, macOS, and Linux.
 Alternatively, if you’re developing locally:
 ```bash
@@ -227,6 +238,10 @@ For more information on how to use the Content Core library, including details o
 Content Core includes a Model Context Protocol (MCP) server that enables seamless integration with Claude Desktop and other MCP-compatible applications. The MCP server exposes Content Core's powerful extraction capabilities through a standardized protocol.
+<a href="https://glama.ai/mcp/servers/@lfnovo/content-core">
+  <img width="380" height="200" src="https://glama.ai/mcp/servers/@lfnovo/content-core/badge" />
+</a>
 ### Quick Setup with Claude Desktop
 ```bash

{content_core-1.3.1 → content_core-1.4.0}/docs/usage.md RENAMED Viewed

@@ -247,6 +247,40 @@ Enable OCR enhancement for:
 **Note**: The quality improvements (better character rendering, table detection) work automatically without requiring OCR or additional setup.
+## File Type Detection
+Content Core uses a pure Python implementation for file type detection, eliminating the need for system dependencies like libmagic. This ensures consistent behavior across all platforms (Windows, macOS, Linux).
+### How It Works
+The `FileDetector` class uses:
+- **Binary signature matching** for formats like PDF, images, audio, and video files
+- **Content analysis** for text-based formats (HTML, XML, JSON, YAML, CSV, Markdown)
+- **ZIP structure detection** for modern document formats (DOCX, XLSX, PPTX, EPUB)
+### Supported Formats
+Content Core automatically detects and returns appropriate MIME types for:
+- **Documents**: PDF, DOCX, XLSX, PPTX, ODT, ODS, ODP, RTF, EPUB
+- **Images**: JPEG, PNG, GIF, BMP, WEBP, SVG, TIFF, ICO
+- **Media**: MP4, AVI, MKV, MOV, MP3, WAV, OGG, FLAC, M4A
+- **Text**: HTML, XML, JSON, YAML, CSV, Markdown, Plain text
+- **Archives**: ZIP, TAR, GZ, BZ2, XZ
+### Implementation Details
+File detection is performed automatically when you call `extract_content()`. The detection:
+- Reads only the necessary bytes (typically first 8KB) for performance
+- Works regardless of file extension - detection is based on content
+- Falls back to `text/plain` for unrecognized text files
+- Returns `application/octet-stream` for binary files that don't match known signatures
+This pure Python approach means:
+- No installation headaches on different platforms
+- Consistent behavior in all environments (local, Docker, serverless)
+- Easy debugging and customization if needed
+- No binary dependencies or system library conflicts
 ## Support
 If you have questions or encounter issues while using the library, open an issue in the repository or contact the support team.

{content_core-1.3.1 → content_core-1.4.0}/pyproject.toml RENAMED Viewed

@@ -1,6 +1,6 @@
 [project]
 name = "content-core"
-version = "1.3.1"
+version = "1.4.0"
 description = "Extract what matters from any media source. Available as Python Library, macOS Service, CLI and MCP Server"
 readme = "README.md"
 homepage = "https://github.com/lfnovo/content-core"
@@ -20,7 +20,6 @@ dependencies = [
     "pymupdf>=1.25.5",
     "python-docx>=1.1.2",
     "python-dotenv>=1.1.0",
-    "python-magic>=0.4.27",
     "python-pptx>=1.0.2",
     "youtube-transcript-api>=1.0.3",
     "langgraph>=0.3.29",
@@ -32,7 +31,6 @@ dependencies = [
     "firecrawl-py>=2.7.0",
     "pillow>=10.4.0",
     "asciidoc>=10.2.1",
-    "python-magic-bin==0.4.14; sys_platform == 'win32'",
     "pytubefix>=9.1.1",
     "fastmcp>=2.10.0",
 ]

content-core 1.3.1__tar.gz → 1.4.0__tar.gz

Potentially problematic release.

content-core 1.3.1tar.gz → 1.4.0tar.gz