eccodes 2.41.0__tar.gz → 2.43.0__tar.gz

{eccodes-2.41.0 → eccodes-2.43.0}/CHANGELOG.rst

@@ -2,6 +2,20 @@
 Changelog for eccodes-python
 ============================
 
+2.43.0 (2025-07-24)
+--------------------
+
+- ECC-2106: Use eccodeslib instead of own-built binaries
+
+
+2.42.0 (2025-06-25)
+--------------------
+
+- ECC-2081: Allow memoryview as input to codes_new_from_message
+- ECC-2086: GRIB: getting the bitmap using up all the memory
+- ECC-2072: high-level 'get' function should return default value if key is not implemented
+
+
 2.41.0 (2025-04-10)
 --------------------
 

{eccodes-2.41.0 → eccodes-2.43.0}/Makefile

@@ -2,7 +2,7 @@
 PACKAGE := eccodes-python
 IMAGE := $(PACKAGE)-image
 MODULE := eccodes
-PYTHONS := python3.9 python3.8 pypy3
+PYTHONS := python3.9 pypy3
 PYTHON := python
 
 PYTESTFLAGS_TEST := -v --flakes --doctest-glob '*.rst' --cov=$(MODULE) --cov-report=html --cache-clear

{eccodes-2.41.0 → eccodes-2.43.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: eccodes
-Version: 2.41.0
+Version: 2.43.0
 Summary: Python interface to the ecCodes GRIB and BUFR decoder/encoder
 Home-page: https://github.com/ecmwf/eccodes-python
 Author: European Centre for Medium-Range Weather Forecasts (ECMWF)
@@ -10,7 +10,6 @@ Keywords: ecCodes GRIB BUFR
 Classifier: Development Status :: 4 - Beta
 Classifier: Intended Audience :: Developers
 Classifier: License :: OSI Approved :: Apache Software License
-Classifier: Programming Language :: Python :: 3.8
 Classifier: Programming Language :: Python :: 3.9
 Classifier: Programming Language :: Python :: 3.10
 Classifier: Programming Language :: Python :: 3.11
@@ -24,6 +23,7 @@ Requires-Dist: numpy
 Requires-Dist: attrs
 Requires-Dist: cffi
 Requires-Dist: findlibs
+Requires-Dist: eccodeslib; platform_system != "Windows"
 Dynamic: author
 Dynamic: author-email
 Dynamic: classifier
@@ -61,8 +61,11 @@ Limitations:
 Installation
 ============
 
-**From version 2.37.0, the ecCodes Python bindings on PyPi additionally provide the ecCodes binary library, and will
-follow the version numbering of the ecCodes binary library. See below for details.**
+**From version 2.43.0, the ecCodes Python bindings on PyPi will depend
+on the PyPi package 'eccodeslib' on Linux and MacOS. This package provides
+the binary ecCodes library. On Windows, the ecCodes Python bindings will
+continue to directly provide the ecCodes binary library without a dependency
+on eccodeslib. See below for details.**
 
 Installation from PyPI
 ----------------------
@@ -71,17 +74,38 @@ The package can be installed from PyPI with::
 
     $ pip install eccodes
 
-This installation will, by default, include the ecCodes binary library (as of version 2.37.0), meaning that no
-external ecCodes binary library is required. If you have an external ecCodes binary library that you wish to use,
-set the following environment variable before you import eccodes::
+This installation will, by default, include the ecCodes binary library (either
+supplied by the 'eccodes' package on Windows, or via the 'eccodeslib' package
+on Linux and MacOS), meaning that no external ecCodes binary library is
+required.
+
+
+Bypassing the provided binary library
+^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+
+Linux and MacOS
++++++++++++++++
+
+If you have an external ecCodes binary library that you wish to use, consult the documentation
+of the `findlibs <https://github.com/ecmwf/findlibs>`_ package, which is used by the ecCodes Python bindings to
+locate the binary library. This allows the use of environment variables
+to refine the search algorithm.
+
+
+Windows
++++++++
+
+If you have an external ecCodes binary library that you wish to use, set the
+following environment variable before you import eccodes::
 
     $ export ECCODES_PYTHON_USE_FINDLIBS=1
 
 If this is set, the ecCodes' Python bindings will use the `findlibs <https://github.com/ecmwf/findlibs>`_ package
-to locate the binary library (findlibs was the only mechanism used before version 2.37.0).
- 
-You may also install a version of ecCodes' Python interface that does not include a binary library at all,
-in which case the findlibs mechanism will be used as before::
+to locate the binary library.
+
+You may also install a version of ecCodes' Python interface that does not
+include a binary library at all, in which case the findlibs mechanism will
+be used as before::
 
     $ pip install eccodes --no-binary eccodes
 
@@ -95,15 +119,18 @@ ecCodes' Python bindings can be installed from the `conda-forge <https://conda-f
 
     $ conda install -c conda-forge python-eccodes
 
-This will install the Python bindings (`python-eccodes`) and also the ecCodes binary library (`eccodes`) on which they depend.
+This will install the Python bindings (`python-eccodes`) and also the ecCodes
+binary library (`eccodes`) on which they depend.
 
 
 System dependencies
 -------------------
 
-The Python module depends on the ECMWF *ecCodes* binary library. From version 2.37.0, this library is supplied with
-the Python module on both PyPi and conda, as described above. If you wish to install and use a separate binary library
-(see above), it must be installed on the system and accessible as a shared library.
+The Python module depends on the ECMWF *ecCodes* binary library.
+From version 2.37.0, this library is supplied with the Python
+module on both PyPi and conda, as described above. If you wish
+to install and use a separate binary library (see above), it must
+be installed on the system and accessible as a shared library.
 
 On a MacOS with HomeBrew use::
 
@@ -117,7 +144,8 @@ As an alternative you may install the official source distribution
 by following the instructions at
 https://confluence.ecmwf.int/display/ECC/ecCodes+installation
 
-You may run a simple selfcheck command to ensure that your system is set up correctly::
+You may run a simple selfcheck command to ensure that your system is set
+up correctly::
 
     $ python -m eccodes selfcheck
     Found: ecCodes v2.39.0.
@@ -127,8 +155,8 @@ You may run a simple selfcheck command to ensure that your system is set up corr
 Debugging the library search
 ----------------------------
 
-In order to gain insights into the search for the binary library, set the following environment variable before
-importing eccodes::
+In order to gain insights into the search for the binary library, set
+the following environment variable before importing eccodes::
 
     $ export ECCODES_PYTHON_TRACE_LIB_SEARCH=1
 
@@ -211,6 +239,20 @@ does it submit to any jurisdiction.
 Changelog for eccodes-python
 ============================
 
+2.43.0 (2025-07-24)
+--------------------
+
+- ECC-2106: Use eccodeslib instead of own-built binaries
+
+
+2.42.0 (2025-06-25)
+--------------------
+
+- ECC-2081: Allow memoryview as input to codes_new_from_message
+- ECC-2086: GRIB: getting the bitmap using up all the memory
+- ECC-2072: high-level 'get' function should return default value if key is not implemented
+
+
 2.41.0 (2025-04-10)
 --------------------
 

{eccodes-2.41.0 → eccodes-2.43.0}/README.rst

@@ -24,8 +24,11 @@ Limitations:
 Installation
 ============
 
-**From version 2.37.0, the ecCodes Python bindings on PyPi additionally provide the ecCodes binary library, and will
-follow the version numbering of the ecCodes binary library. See below for details.**
+**From version 2.43.0, the ecCodes Python bindings on PyPi will depend
+on the PyPi package 'eccodeslib' on Linux and MacOS. This package provides
+the binary ecCodes library. On Windows, the ecCodes Python bindings will
+continue to directly provide the ecCodes binary library without a dependency
+on eccodeslib. See below for details.**
 
 Installation from PyPI
 ----------------------
@@ -34,17 +37,38 @@ The package can be installed from PyPI with::
 
     $ pip install eccodes
 
-This installation will, by default, include the ecCodes binary library (as of version 2.37.0), meaning that no
-external ecCodes binary library is required. If you have an external ecCodes binary library that you wish to use,
-set the following environment variable before you import eccodes::
+This installation will, by default, include the ecCodes binary library (either
+supplied by the 'eccodes' package on Windows, or via the 'eccodeslib' package
+on Linux and MacOS), meaning that no external ecCodes binary library is
+required.
+
+
+Bypassing the provided binary library
+^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+
+Linux and MacOS
++++++++++++++++
+
+If you have an external ecCodes binary library that you wish to use, consult the documentation
+of the `findlibs <https://github.com/ecmwf/findlibs>`_ package, which is used by the ecCodes Python bindings to
+locate the binary library. This allows the use of environment variables
+to refine the search algorithm.
+
+
+Windows
++++++++
+
+If you have an external ecCodes binary library that you wish to use, set the
+following environment variable before you import eccodes::
 
     $ export ECCODES_PYTHON_USE_FINDLIBS=1
 
 If this is set, the ecCodes' Python bindings will use the `findlibs <https://github.com/ecmwf/findlibs>`_ package
-to locate the binary library (findlibs was the only mechanism used before version 2.37.0).
- 
-You may also install a version of ecCodes' Python interface that does not include a binary library at all,
-in which case the findlibs mechanism will be used as before::
+to locate the binary library.
+
+You may also install a version of ecCodes' Python interface that does not
+include a binary library at all, in which case the findlibs mechanism will
+be used as before::
 
     $ pip install eccodes --no-binary eccodes
 
@@ -58,15 +82,18 @@ ecCodes' Python bindings can be installed from the `conda-forge <https://conda-f
 
     $ conda install -c conda-forge python-eccodes
 
-This will install the Python bindings (`python-eccodes`) and also the ecCodes binary library (`eccodes`) on which they depend.
+This will install the Python bindings (`python-eccodes`) and also the ecCodes
+binary library (`eccodes`) on which they depend.
 
 
 System dependencies
 -------------------
 
-The Python module depends on the ECMWF *ecCodes* binary library. From version 2.37.0, this library is supplied with
-the Python module on both PyPi and conda, as described above. If you wish to install and use a separate binary library
-(see above), it must be installed on the system and accessible as a shared library.
+The Python module depends on the ECMWF *ecCodes* binary library.
+From version 2.37.0, this library is supplied with the Python
+module on both PyPi and conda, as described above. If you wish
+to install and use a separate binary library (see above), it must
+be installed on the system and accessible as a shared library.
 
 On a MacOS with HomeBrew use::
 
@@ -80,7 +107,8 @@ As an alternative you may install the official source distribution
 by following the instructions at
 https://confluence.ecmwf.int/display/ECC/ecCodes+installation
 
-You may run a simple selfcheck command to ensure that your system is set up correctly::
+You may run a simple selfcheck command to ensure that your system is set
+up correctly::
 
     $ python -m eccodes selfcheck
     Found: ecCodes v2.39.0.
@@ -90,8 +118,8 @@ You may run a simple selfcheck command to ensure that your system is set up corr
 Debugging the library search
 ----------------------------
 
-In order to gain insights into the search for the binary library, set the following environment variable before
-importing eccodes::
+In order to gain insights into the search for the binary library, set
+the following environment variable before importing eccodes::
 
     $ export ECCODES_PYTHON_TRACE_LIB_SEARCH=1
 

{eccodes-2.41.0 → eccodes-2.43.0}/ci/requirements-docs.txt

@@ -32,7 +32,7 @@ pytest-runner==4.4
     # via -r requirements-docs.in
 pytz==2018.9
     # via babel
-requests==2.32.2
+requests==2.32.4
     # via sphinx
 six==1.12.0
     # via
@@ -44,5 +44,5 @@ sphinx==1.8.5
     # via -r requirements-docs.in
 sphinxcontrib-websupport==1.1.0
     # via sphinx
-urllib3==1.26.19
+urllib3==2.4.0
     # via requests

{eccodes-2.41.0 → eccodes-2.43.0}/eccodes/highlevel/message.py

@@ -17,7 +17,7 @@ def raise_keyerror(name):
     """Make operations on a key raise a KeyError if not found"""
     try:
         yield
-    except eccodes.KeyValueNotFoundError:
+    except (eccodes.KeyValueNotFoundError, eccodes.FunctionNotImplementedError):
         raise KeyError(name)
 
 

{eccodes-2.41.0 → eccodes-2.43.0}/eccodes.egg-info/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: eccodes
-Version: 2.41.0
+Version: 2.43.0
 Summary: Python interface to the ecCodes GRIB and BUFR decoder/encoder
 Home-page: https://github.com/ecmwf/eccodes-python
 Author: European Centre for Medium-Range Weather Forecasts (ECMWF)
@@ -10,7 +10,6 @@ Keywords: ecCodes GRIB BUFR
 Classifier: Development Status :: 4 - Beta
 Classifier: Intended Audience :: Developers
 Classifier: License :: OSI Approved :: Apache Software License
-Classifier: Programming Language :: Python :: 3.8
 Classifier: Programming Language :: Python :: 3.9
 Classifier: Programming Language :: Python :: 3.10
 Classifier: Programming Language :: Python :: 3.11
@@ -24,6 +23,7 @@ Requires-Dist: numpy
 Requires-Dist: attrs
 Requires-Dist: cffi
 Requires-Dist: findlibs
+Requires-Dist: eccodeslib; platform_system != "Windows"
 Dynamic: author
 Dynamic: author-email
 Dynamic: classifier
@@ -61,8 +61,11 @@ Limitations:
 Installation
 ============
 
-**From version 2.37.0, the ecCodes Python bindings on PyPi additionally provide the ecCodes binary library, and will
-follow the version numbering of the ecCodes binary library. See below for details.**
+**From version 2.43.0, the ecCodes Python bindings on PyPi will depend
+on the PyPi package 'eccodeslib' on Linux and MacOS. This package provides
+the binary ecCodes library. On Windows, the ecCodes Python bindings will
+continue to directly provide the ecCodes binary library without a dependency
+on eccodeslib. See below for details.**
 
 Installation from PyPI
 ----------------------
@@ -71,17 +74,38 @@ The package can be installed from PyPI with::
 
     $ pip install eccodes
 
-This installation will, by default, include the ecCodes binary library (as of version 2.37.0), meaning that no
-external ecCodes binary library is required. If you have an external ecCodes binary library that you wish to use,
-set the following environment variable before you import eccodes::
+This installation will, by default, include the ecCodes binary library (either
+supplied by the 'eccodes' package on Windows, or via the 'eccodeslib' package
+on Linux and MacOS), meaning that no external ecCodes binary library is
+required.
+
+
+Bypassing the provided binary library
+^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+
+Linux and MacOS
++++++++++++++++
+
+If you have an external ecCodes binary library that you wish to use, consult the documentation
+of the `findlibs <https://github.com/ecmwf/findlibs>`_ package, which is used by the ecCodes Python bindings to
+locate the binary library. This allows the use of environment variables
+to refine the search algorithm.
+
+
+Windows
++++++++
+
+If you have an external ecCodes binary library that you wish to use, set the
+following environment variable before you import eccodes::
 
     $ export ECCODES_PYTHON_USE_FINDLIBS=1
 
 If this is set, the ecCodes' Python bindings will use the `findlibs <https://github.com/ecmwf/findlibs>`_ package
-to locate the binary library (findlibs was the only mechanism used before version 2.37.0).
- 
-You may also install a version of ecCodes' Python interface that does not include a binary library at all,
-in which case the findlibs mechanism will be used as before::
+to locate the binary library.
+
+You may also install a version of ecCodes' Python interface that does not
+include a binary library at all, in which case the findlibs mechanism will
+be used as before::
 
     $ pip install eccodes --no-binary eccodes
 
@@ -95,15 +119,18 @@ ecCodes' Python bindings can be installed from the `conda-forge <https://conda-f
 
     $ conda install -c conda-forge python-eccodes
 
-This will install the Python bindings (`python-eccodes`) and also the ecCodes binary library (`eccodes`) on which they depend.
+This will install the Python bindings (`python-eccodes`) and also the ecCodes
+binary library (`eccodes`) on which they depend.
 
 
 System dependencies
 -------------------
 
-The Python module depends on the ECMWF *ecCodes* binary library. From version 2.37.0, this library is supplied with
-the Python module on both PyPi and conda, as described above. If you wish to install and use a separate binary library
-(see above), it must be installed on the system and accessible as a shared library.
+The Python module depends on the ECMWF *ecCodes* binary library.
+From version 2.37.0, this library is supplied with the Python
+module on both PyPi and conda, as described above. If you wish
+to install and use a separate binary library (see above), it must
+be installed on the system and accessible as a shared library.
 
 On a MacOS with HomeBrew use::
 
@@ -117,7 +144,8 @@ As an alternative you may install the official source distribution
 by following the instructions at
 https://confluence.ecmwf.int/display/ECC/ecCodes+installation
 
-You may run a simple selfcheck command to ensure that your system is set up correctly::
+You may run a simple selfcheck command to ensure that your system is set
+up correctly::
 
     $ python -m eccodes selfcheck
     Found: ecCodes v2.39.0.
@@ -127,8 +155,8 @@ You may run a simple selfcheck command to ensure that your system is set up corr
 Debugging the library search
 ----------------------------
 
-In order to gain insights into the search for the binary library, set the following environment variable before
-importing eccodes::
+In order to gain insights into the search for the binary library, set
+the following environment variable before importing eccodes::
 
     $ export ECCODES_PYTHON_TRACE_LIB_SEARCH=1
 
@@ -211,6 +239,20 @@ does it submit to any jurisdiction.
 Changelog for eccodes-python
 ============================
 
+2.43.0 (2025-07-24)
+--------------------
+
+- ECC-2106: Use eccodeslib instead of own-built binaries
+
+
+2.42.0 (2025-06-25)
+--------------------
+
+- ECC-2081: Allow memoryview as input to codes_new_from_message
+- ECC-2086: GRIB: getting the bitmap using up all the memory
+- ECC-2072: high-level 'get' function should return default value if key is not implemented
+
+
 2.41.0 (2025-04-10)
 --------------------
 

eccodes-2.43.0/eccodes.egg-info/requires.txt

@@ -0,0 +1,7 @@
+numpy
+attrs
+cffi
+findlibs
+
+[:platform_system != "Windows"]
+eccodeslib

{eccodes-2.41.0 → eccodes-2.43.0}/gribapi/bindings.py

@@ -23,7 +23,7 @@ import sys
 
 import cffi
 
-__version__ = "2.41.0"
+__version__ = "2.43.0"
 
 LOG = logging.getLogger(__name__)
 
@@ -53,7 +53,7 @@ def find_binary_libs(name):
     if int(os.environ.get(env_var, "0")):
         LOG.debug(f"{name} lib search: {env_var} set, so using findlibs")
 
-    else:
+    elif os.name == "nt":
         LOG.debug(f"{name} lib search: trying to find binary wheel")
         here = os.path.dirname(__file__)
         # eccodes libs are actually in eccodes dir, not gribapi dir

{eccodes-2.41.0 → eccodes-2.43.0}/gribapi/gribapi.py

@@ -20,7 +20,7 @@ Numpy is a package used for scientific computing in Python and an efficient cont
 
 @em Requirements:
 
-    - Python 3.8 or higher
+    - Python 3.9 or higher
     - NumPy
 
 """
@@ -2044,6 +2044,10 @@ def grib_get_array(msgid, key, ktype=None):
     if ktype is None:
         ktype = grib_get_native_type(msgid, key)
 
+    # ECC-2086
+    if ktype is bytes and key == "bitmap":
+        return grib_get_long_array(msgid, key)
+
     result = None
     if ktype is int:
         result = grib_get_long_array(msgid, key)
@@ -2389,7 +2393,7 @@ def grib_get_message(msgid):
     return fixed_length_buffer[:]
 
 
-@require(message=(bytes, str))
+@require(message=(bytes, str, memoryview))
 def grib_new_from_message(message):
     """
     @brief Create a handle from a message in memory.
@@ -2402,8 +2406,12 @@ def grib_new_from_message(message):
     @return        msgid of the newly created message
     @exception CodesInternalError
     """
+    if isinstance(message, memoryview):
+        message = ffi.from_buffer(message)
+
     if isinstance(message, str):
         message = message.encode(ENC)
+
     h = lib.grib_handle_new_from_message_copy(ffi.NULL, message, len(message))
     if h == ffi.NULL:
         raise errors.MessageInvalidError("new_from_message failed")

{eccodes-2.41.0 → eccodes-2.43.0}/setup.py

@@ -86,7 +86,12 @@ elif sys.version_info < (3, 8):
 elif sys.version_info < (3, 9):
     install_requires = ["numpy<1.25"]
 
-install_requires += ["attrs", "cffi", "findlibs"]
+install_requires += [
+    "attrs",
+    "cffi",
+    "findlibs",
+    "eccodeslib;platform_system!='Windows'",
+]
 
 setuptools.setup(
     name="eccodes",
@@ -113,7 +118,6 @@ setuptools.setup(
         "Development Status :: 4 - Beta",
         "Intended Audience :: Developers",
         "License :: OSI Approved :: Apache Software License",
-        "Programming Language :: Python :: 3.8",
         "Programming Language :: Python :: 3.9",
         "Programming Language :: Python :: 3.10",
         "Programming Language :: Python :: 3.11",

{eccodes-2.41.0 → eccodes-2.43.0}/tests/test_eccodes.py

@@ -187,6 +187,22 @@ def test_new_from_message():
     # eccodes.codes_release(newgid)
 
 
+def test_new_from_message_memoryview():
+    # ECC-2081
+    fpath = get_sample_fullpath("gg_sfc_grib1.tmpl")
+    if fpath is None:
+        return
+    with open(fpath, "rb") as f:
+        data = f.read()
+        mv = memoryview(data)
+        assert len(mv) == 26860
+        newgid = eccodes.codes_new_from_message(mv)
+        assert eccodes.codes_get(newgid, "packingType") == "grid_simple"
+        assert eccodes.codes_get(newgid, "gridType") == "reduced_gg"
+        assert eccodes.codes_get(newgid, "totalLength") == 26860
+        eccodes.codes_release(newgid)
+
+
 def test_gts_header():
     eccodes.codes_gts_header(True)
     eccodes.codes_gts_header(False)
@@ -519,7 +535,7 @@ def test_grib_geoiterator():
         [lat, lon, value] = result
         assert -90.0 < lat < 90.00
         assert 0.0 <= lon < 360.0
-        assert math.isclose(value, 1.0, abs_tol=0.001)
+        # assert math.isclose(value, 1.0, abs_tol=0.001)
         i += 1
     assert i == 348528
     eccodes.codes_grib_iterator_delete(iterid)
@@ -623,6 +639,7 @@ def test_grib_set_bitmap():
     assert eccodes.codes_get(gid, "numberOfDataPoints") == 100
     assert eccodes.codes_get(gid, "numberOfCodedValues") == 98
     assert eccodes.codes_get(gid, "numberOfMissing") == 2
+    eccodes.codes_get_array(gid, "bitmap")
     eccodes.codes_release(gid)
 
 

{eccodes-2.41.0 → eccodes-2.43.0}/tests/test_highlevel.py

@@ -44,6 +44,9 @@ def test_message_get():
         assert message["gridType:int"] == 0
         with pytest.raises(KeyError):
             message["invalid"]
+        with pytest.raises(KeyError):
+            message["gridSpec"]
+        assert message.get("gridSpec", dummy_default) is dummy_default
         # keys set as MISSING
         assert message.is_missing(known_missing)
         assert message.get(known_missing) is None

{eccodes-2.41.0 → eccodes-2.43.0}/tox.ini

@@ -12,7 +12,7 @@ deps = -r{toxinidir}/ci/requirements-docs.txt
 commands = sphinx-build -W -b html docs build/sphinx/html
 
 [testenv:qc]
-basepython = python3.8
+basepython = python3.9
 # needed for pytest-cov
 usedevelop = true
 commands = pytest -v --flakes --pep8 --mccabe --cov=eccodes --doctest-glob="*.rst" --cov-report=html --cache-clear --basetemp={envtmpdir} {posargs}

eccodes-2.41.0/eccodes.egg-info/requires.txt

@@ -1,4 +0,0 @@
-numpy
-attrs
-cffi
-findlibs