puremagic 2.0.0b4__tar.gz → 2.0.2__tar.gz

{puremagic-2.0.0b4 → puremagic-2.0.2}/.coveragerc

@@ -7,7 +7,7 @@ omit =
     */venv/*
     */.*/*
     */*.egg-info/*
-    */.mypy_cache/*
+    */.ty/*
     */.pytest_cache/*
 exclude_lines =
     command_line_entry

{puremagic-2.0.0b4 → puremagic-2.0.2}/.github/workflows/pythonpublish.yml

@@ -18,7 +18,7 @@ jobs:
     - name: Set up Python
       uses: actions/setup-python@v5
       with:
-        python-version: '3.12'
+        python-version: '3.14'
 
     - name: Install the latest version of uv and activate the environment
       uses: astral-sh/setup-uv@v6

{puremagic-2.0.0b4 → puremagic-2.0.2}/.github/workflows/tests.yml

@@ -16,12 +16,12 @@ jobs:
       fail-fast: false
       matrix:
         os: [ubuntu-latest]
-        python-version: ["3.12", "3.13", "3.14-dev"]
+        python-version: ["3.12", "3.13", "3.14"]
         include:
           - os: macos-latest
-            python-version: '3.13'
+            python-version: '3.14'
           - os: windows-latest
-            python-version: '3.13'
+            python-version: '3.14'
     runs-on: ${{ matrix.os }}
     steps:
     - uses: actions/checkout@v4
@@ -41,6 +41,9 @@ jobs:
     - name: Verify Code with Ruff
       run: uv run ruff check
 
+    - name: Type check with ty
+      run: uv run ty check
+
     - name: Test with pytest
       run: uv run pytest --cov=puremagic test/
 

{puremagic-2.0.0b4 → puremagic-2.0.2}/.gitignore

@@ -124,10 +124,8 @@ venv.bak/
 # mkdocs documentation
 /site
 
-# mypy
-.mypy_cache/
-.dmypy.json
-dmypy.json
+# ty
+.ty/
 
 # Pyre type checker
 .pyre/
@@ -143,3 +141,7 @@ media
 static
 
 .idea/
+
+# Ignore VS Code related files and folders
+.vscode
+*.code-workspace

{puremagic-2.0.0b4 → puremagic-2.0.2}/.pre-commit-config.yaml

@@ -1,6 +1,6 @@
 repos:
 -   repo: https://github.com/pre-commit/pre-commit-hooks
-    rev: v5.0.0
+    rev: v6.0.0
     hooks:
     # Identify invalid files
     - id: check-ast
@@ -35,7 +35,7 @@ repos:
 
 -   repo: https://github.com/astral-sh/ruff-pre-commit
     # Ruff version.
-    rev: v0.12.2
+    rev: v0.15.5
     hooks:
       # Run the linter.
       - id: ruff-check
@@ -43,17 +43,21 @@ repos:
       # Run the formatter.
       - id: ruff-format
 
--   repo: https://github.com/pre-commit/mirrors-mypy
-    rev: 'v1.16.1'
+-   repo: local
     hooks:
-    - id: mypy
+    - id: ty
+      name: ty
+      entry: uv run ty check
+      language: system
+      types: [python]
+      pass_filenames: false
 
 -   repo: https://github.com/tox-dev/pyproject-fmt
-    rev: v2.6.0
+    rev: v2.16.2
     hooks:
       - id: pyproject-fmt
 
 -   repo: https://github.com/abravalheri/validate-pyproject
-    rev: v0.24.1
+    rev: v0.25
     hooks:
       - id: validate-pyproject

{puremagic-2.0.0b4 → puremagic-2.0.2}/CHANGELOG.md

@@ -1,10 +1,22 @@
 Changelog
 =========
 
+Version 2.0.2
+-------------
+
+- Fixing #137 passing non-existent filename to from_string()/from_stream() no longer raises FileNotFoundError (thanks to denisw)
+
+Version 2.0.1
+-------------
+
+- Fixing #126 Python scanner false positives — now uses AST node walking instead of regex to verify real Python constructs (thanks to ahobson)
+- Fixing #134 UTF-16 LE BOM (FF FE) no longer misidentified as .mp1 audio, added UTF-16 BOM detection to text scanner (thanks to tomazfs)
+- Fixing #135 from_string(), from_stream(), magic_string(), and magic_stream() now perform deep scan when filename is provided (thanks to denisw)
+
 Version 2.0.0
 -------------
 
-- Adding deep scan for improved accuracy #102 #94 #70 #69 #12 #3
+- Adding deep scan for improved accuracy #102 #94 #85 #70 #69 #12 #3
 - Changing to full semantic versioning to be able to denote bugfixes vs minor features
 - Changing to use uv instead of requirements
 - Removing support for python 3.7, 3.8, 3.9, 3.10 and 3.11 please stick to 1.x release chain to support older versions

{puremagic-2.0.0b4 → puremagic-2.0.2}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: puremagic
-Version: 2.0.0b4
+Version: 2.0.2
 Summary: Pure python implementation of magic file detection
 Author-email: Chris Griffith <chris@cdgriffith.com>
 License-Expression: MIT
@@ -13,6 +13,7 @@ Classifier: Programming Language :: Python
 Classifier: Programming Language :: Python :: 3 :: Only
 Classifier: Programming Language :: Python :: 3.12
 Classifier: Programming Language :: Python :: 3.13
+Classifier: Programming Language :: Python :: 3.14
 Classifier: Programming Language :: Python :: Implementation :: PyPy
 Classifier: Topic :: Utilities
 Requires-Python: >=3.12
@@ -25,18 +26,22 @@ puremagic
 =========
 
 puremagic is a pure python module that will identify a file based off
-it's magic numbers.
+its magic numbers. It has zero runtime dependencies and serves as a
+lightweight, cross-platform alternative to python-magic/libmagic.
 
 It is designed to be minimalistic and inherently cross platform
-compatible. It is also designed to be a stand in for python-magic, it
-incorporates the functions from\_file(filename[, mime]) and
-from\_string(string[, mime]) however the magic\_file() and
-magic\_string() are more powerful and will also display confidence and
+compatible. It is also designed to be a stand in for python-magic. It
+implements the functions :code:`from_file(filename[, mime])` and
+:code:`from_string(string[, mime])` however the :code:`magic_file()` and
+:code:`magic_string()` are more powerful and will also display confidence and
 duplicate matches.
 
-It does NOT try to match files off non-magic string. In other words it
-will not search for a string within a certain window of bytes like
-others might.
+Starting with version 2.0, puremagic includes a **deep scan** system
+that performs content-aware analysis beyond simple magic number matching.
+This improves accuracy for formats like Office documents, text files,
+CSV, MP3, Python source, JSON, HDF5, email, and many scientific formats.
+Deep scan is enabled by default and can be disabled by setting the
+environment variable :code:`PUREMAGIC_DEEPSCAN=0`.
 
 Advantages over using a wrapper for 'file' or 'libmagic':
 
@@ -58,11 +63,11 @@ Compatibility
 
 -  Python 3.12+
 
-For use with with 3.7 use the 1.x branch.
+For use with Python 3.7–3.11, use the 1.x release chain.
 
 Using github ci to run continuous integration tests on listed platforms.
 
-Install from pypy
+Install from PyPI
 -----------------
 
 .. code:: bash
@@ -75,16 +80,6 @@ On linux environments, you may want to be clear you are using python3
 
         $ python3 -m pip install puremagic
 
-
-Install from source
--------------------
-
-In either a virtualenv or globally, simply run:
-
-.. code:: bash
-
-        $ python setup.py install
-
 Usage
 -----
 
@@ -128,6 +123,35 @@ If you already have a file open, or raw byte string, you could also use:
         # [PureMagicWithConfidence(byte_match=b'ftypisom', offset=4, extension='.mp4', mime_type='video/mp4', name='MPEG-4 video', confidence=0.8),
         #  PureMagicWithConfidence(byte_match=b'iso2avc1mp4', offset=20, extension='.mp4', mime_type='video/mp4', name='MP4 Video', confidence=0.8)]
 
+Deep Scan
+---------
+
+Deep scan performs content-aware analysis when magic number matching
+alone is not enough. It is enabled by default and runs automatically
+as part of the normal identification pipeline.
+
+The following format-specific scanners are included:
+
+-  **ZIP** — Distinguishes Office formats (xlsx/docx/pptx), OpenDocument
+   (odt/ods/odp), and their macro-enabled variants by inspecting ZIP internals
+-  **MPEG Audio** — Parses MP3/MPEG audio frames to validate and identify audio files
+-  **Text** — Detects text encodings, line endings (CRLF/LF/CR), CSV files
+   with automatic delimiter detection, and email messages (.eml)
+-  **Python** — Validates Python source via :code:`ast.parse()` and keyword analysis
+-  **PDF** — Format-specific PDF validation
+-  **JSON** — JSON format validation
+-  **HDF5** — Identifies HDF5 subtypes used in scientific computing (AnnData,
+   Loom, Cooler, BIOM v2, mz5, and more)
+-  **Audio** — Identifies HCOM and SNDR audio formats
+-  **Dynamic text checks** — Recognizes many scientific and bioinformatics text
+   formats including VCF, SAM, GFF, PLY, VTK, and others
+
+To disable deep scan, set the environment variable:
+
+.. code:: bash
+
+        $ export PUREMAGIC_DEEPSCAN=0
+
 Script
 ------
 
@@ -137,6 +161,14 @@ Script
 
         $ python -m puremagic [options] filename <filename2>...
 
+*Options*
+
+-  :code:`-m, --mime` — Return the MIME type instead of file extension
+-  :code:`-v, --verbose` — Print verbose output with all possible matches
+-  :code:`--version` — Show program version
+
+Directories can be passed as arguments; all files within will be scanned.
+
 *Examples*
 
 .. code:: bash
@@ -148,19 +180,21 @@ Script
         'test/resources/images/test.gif' : image/gif
         'test/resources/audio/test.mp3' : audio/mpeg
 
-imghdr replacement
-------------------
-
-If you are looking for a replacement for the standard library's depreciated imghdr, you can use `puremagic.what()`
-
-.. code:: python
-
-        import puremagic
+Upgrading from 1.x
+-------------------
 
-        filename = "test/resources/images/test.gif"
+Version 2.0 includes the following breaking changes:
 
-        ext = puremagic.what(filename)
-        # 'gif'
+-  **Python 3.12+ required** — Python 3.7–3.11 are no longer supported.
+   Use the 1.x release chain for older Python versions.
+-  **Removed** :code:`puremagic.what()` — The :code:`imghdr` drop-in replacement
+   has been removed. Use :code:`puremagic.from_file()` instead.
+-  **Removed** :code:`magic_header_array`, :code:`magic_footer_array`, and
+   :code:`multi_part_dict` from the public API.
+-  **Removed** :code:`setup.py` — The project now uses :code:`pyproject.toml`
+   exclusively.
+-  Internal functions have been renamed from private (e.g. :code:`_magic_data`)
+   to public (e.g. :code:`magic_data`).
 
 FAQ
 ---
@@ -190,4 +224,4 @@ https://cgit.freedesktop.org/xdg/shared-mime-info/
 License
 -------
 
-MIT Licenced, see LICENSE, Copyright (c) 2013-2025 Chris Griffith
+MIT Licenced, see LICENSE, Copyright (c) 2013-2026 Chris Griffith

{puremagic-2.0.0b4 → puremagic-2.0.2}/README.rst

@@ -3,18 +3,22 @@ puremagic
 =========
 
 puremagic is a pure python module that will identify a file based off
-it's magic numbers.
+its magic numbers. It has zero runtime dependencies and serves as a
+lightweight, cross-platform alternative to python-magic/libmagic.
 
 It is designed to be minimalistic and inherently cross platform
-compatible. It is also designed to be a stand in for python-magic, it
-incorporates the functions from\_file(filename[, mime]) and
-from\_string(string[, mime]) however the magic\_file() and
-magic\_string() are more powerful and will also display confidence and
+compatible. It is also designed to be a stand in for python-magic. It
+implements the functions :code:`from_file(filename[, mime])` and
+:code:`from_string(string[, mime])` however the :code:`magic_file()` and
+:code:`magic_string()` are more powerful and will also display confidence and
 duplicate matches.
 
-It does NOT try to match files off non-magic string. In other words it
-will not search for a string within a certain window of bytes like
-others might.
+Starting with version 2.0, puremagic includes a **deep scan** system
+that performs content-aware analysis beyond simple magic number matching.
+This improves accuracy for formats like Office documents, text files,
+CSV, MP3, Python source, JSON, HDF5, email, and many scientific formats.
+Deep scan is enabled by default and can be disabled by setting the
+environment variable :code:`PUREMAGIC_DEEPSCAN=0`.
 
 Advantages over using a wrapper for 'file' or 'libmagic':
 
@@ -36,11 +40,11 @@ Compatibility
 
 -  Python 3.12+
 
-For use with with 3.7 use the 1.x branch.
+For use with Python 3.7–3.11, use the 1.x release chain.
 
 Using github ci to run continuous integration tests on listed platforms.
 
-Install from pypy
+Install from PyPI
 -----------------
 
 .. code:: bash
@@ -53,16 +57,6 @@ On linux environments, you may want to be clear you are using python3
 
         $ python3 -m pip install puremagic
 
-
-Install from source
--------------------
-
-In either a virtualenv or globally, simply run:
-
-.. code:: bash
-
-        $ python setup.py install
-
 Usage
 -----
 
@@ -106,6 +100,35 @@ If you already have a file open, or raw byte string, you could also use:
         # [PureMagicWithConfidence(byte_match=b'ftypisom', offset=4, extension='.mp4', mime_type='video/mp4', name='MPEG-4 video', confidence=0.8),
         #  PureMagicWithConfidence(byte_match=b'iso2avc1mp4', offset=20, extension='.mp4', mime_type='video/mp4', name='MP4 Video', confidence=0.8)]
 
+Deep Scan
+---------
+
+Deep scan performs content-aware analysis when magic number matching
+alone is not enough. It is enabled by default and runs automatically
+as part of the normal identification pipeline.
+
+The following format-specific scanners are included:
+
+-  **ZIP** — Distinguishes Office formats (xlsx/docx/pptx), OpenDocument
+   (odt/ods/odp), and their macro-enabled variants by inspecting ZIP internals
+-  **MPEG Audio** — Parses MP3/MPEG audio frames to validate and identify audio files
+-  **Text** — Detects text encodings, line endings (CRLF/LF/CR), CSV files
+   with automatic delimiter detection, and email messages (.eml)
+-  **Python** — Validates Python source via :code:`ast.parse()` and keyword analysis
+-  **PDF** — Format-specific PDF validation
+-  **JSON** — JSON format validation
+-  **HDF5** — Identifies HDF5 subtypes used in scientific computing (AnnData,
+   Loom, Cooler, BIOM v2, mz5, and more)
+-  **Audio** — Identifies HCOM and SNDR audio formats
+-  **Dynamic text checks** — Recognizes many scientific and bioinformatics text
+   formats including VCF, SAM, GFF, PLY, VTK, and others
+
+To disable deep scan, set the environment variable:
+
+.. code:: bash
+
+        $ export PUREMAGIC_DEEPSCAN=0
+
 Script
 ------
 
@@ -115,6 +138,14 @@ Script
 
         $ python -m puremagic [options] filename <filename2>...
 
+*Options*
+
+-  :code:`-m, --mime` — Return the MIME type instead of file extension
+-  :code:`-v, --verbose` — Print verbose output with all possible matches
+-  :code:`--version` — Show program version
+
+Directories can be passed as arguments; all files within will be scanned.
+
 *Examples*
 
 .. code:: bash
@@ -126,19 +157,21 @@ Script
         'test/resources/images/test.gif' : image/gif
         'test/resources/audio/test.mp3' : audio/mpeg
 
-imghdr replacement
-------------------
-
-If you are looking for a replacement for the standard library's depreciated imghdr, you can use `puremagic.what()`
-
-.. code:: python
-
-        import puremagic
+Upgrading from 1.x
+-------------------
 
-        filename = "test/resources/images/test.gif"
+Version 2.0 includes the following breaking changes:
 
-        ext = puremagic.what(filename)
-        # 'gif'
+-  **Python 3.12+ required** — Python 3.7–3.11 are no longer supported.
+   Use the 1.x release chain for older Python versions.
+-  **Removed** :code:`puremagic.what()` — The :code:`imghdr` drop-in replacement
+   has been removed. Use :code:`puremagic.from_file()` instead.
+-  **Removed** :code:`magic_header_array`, :code:`magic_footer_array`, and
+   :code:`multi_part_dict` from the public API.
+-  **Removed** :code:`setup.py` — The project now uses :code:`pyproject.toml`
+   exclusively.
+-  Internal functions have been renamed from private (e.g. :code:`_magic_data`)
+   to public (e.g. :code:`magic_data`).
 
 FAQ
 ---
@@ -168,4 +201,4 @@ https://cgit.freedesktop.org/xdg/shared-mime-info/
 License
 -------
 
-MIT Licenced, see LICENSE, Copyright (c) 2013-2025 Chris Griffith
+MIT Licenced, see LICENSE, Copyright (c) 2013-2026 Chris Griffith