lsst-daf-butler 30.0.1rc1__tar.gz → 30.2025.5000__tar.gz

{lsst_daf_butler-30.0.1rc1/python/lsst_daf_butler.egg-info → lsst_daf_butler-30.2025.5000}/PKG-INFO

@@ -1,11 +1,10 @@
 Metadata-Version: 2.4
 Name: lsst-daf-butler
-Version: 30.0.1rc1
+Version: 30.2025.5000
 Summary: An abstraction layer for reading and writing astronomical data to datastores.
 Author-email: Rubin Observatory Data Management <dm-admin@lists.lsst.org>
 License-Expression: BSD-3-Clause OR GPL-3.0-or-later
 Project-URL: Homepage, https://github.com/lsst/daf_butler
-Project-URL: Source, https://github.com/lsst/daf_butler
 Keywords: lsst
 Classifier: Intended Audience :: Science/Research
 Classifier: Operating System :: OS Independent
@@ -43,7 +42,7 @@ Provides-Extra: test
 Requires-Dist: pytest>=3.2; extra == "test"
 Requires-Dist: numpy>=1.17; extra == "test"
 Requires-Dist: matplotlib>=3.0.3; extra == "test"
-Requires-Dist: pandas<3.0,>=1.0; extra == "test"
+Requires-Dist: pandas>=1.0; extra == "test"
 Provides-Extra: s3
 Requires-Dist: lsst-resources[s3]; extra == "s3"
 Provides-Extra: https

{lsst_daf_butler-30.0.1rc1 → lsst_daf_butler-30.2025.5000}/doc/lsst.daf.butler/CHANGES.rst

@@ -1,141 +1,3 @@
-Butler v30.0.1 (2026-02-02)
-===========================
-
-API Changes
------------
-
-- * Added ``ZipIndex.from_open_zip()`` method to allow the index to be read from a previously opened zip file.
-  * Added ``skip_existing`` parameter to ``Butler.ingest_zip`` to allow the command to ignore any previously ingested datasets. (`DM-52925 <https://rubinobs.atlassian.net/browse/DM-52925>`_)
-
-
-Bug Fixes
----------
-
-- Fixed a bug that caused datastore checksums to be read back in as UUIDs, which would then break task execution with the ``QuantumBackedButler``. (`DM-53631 <https://rubinobs.atlassian.net/browse/DM-53631>`_)
-
-
-Other Changes and Additions
----------------------------
-
-- Added metrics recording to ``Butler.ingest_zip()``. (`DM-52925 <https://rubinobs.atlassian.net/browse/DM-52925>`_)
-
-
-Butler v30.0.0 (2026-01-15)
-===========================
-
-New Features
-------------
-
-- Modified ``ButlerMDC`` to preserve metadata for exceptions that are raised in a context but handled outside it.
-  This lets exceptions be logged by high-level handlers the same way they would have been if the problem were logged immediately. (`DM-42272 <https://rubinobs.atlassian.net/browse/DM-42272>`_)
-- Added a new method ``Butler.query_all_datasets()``, which can be used to query for datasets of multiple types more efficiently than looping over ``query_datasets()``. (`DM-47563 <https://rubinobs.atlassian.net/browse/DM-47563>`_)
-- Added a new registry configuration option ``temporary_tables: False`` to disable the use of temporary tables by the database backend. (`DM-51125 <https://rubinobs.atlassian.net/browse/DM-51125>`_)
-- Added support to the query language to allow sky regions to be specified directly in an ADQL-like way. This includes ``CIRCLE``, ``BOX``, ``POLYGON``, and ``REGION``. (`DM-51454 <https://rubinobs.atlassian.net/browse/DM-51454>`_)
-- ``Butler.transfer_dimension_records_from`` now accepts ``DataCoordinate`` instances in addition to ``DatasetRef`` instances to specify the dimension records to be transferred. (`DM-51681 <https://rubinobs.atlassian.net/browse/DM-51681>`_)
-- ``Butler.ingest()`` now has an optional ``skip_existing`` parameter that makes it ignore datasets that already exist in the repository instead of raising an error.  This makes it easier for applications to retry ingests. (`DM-52179 <https://rubinobs.atlassian.net/browse/DM-52179>`_)
-- Added glob-style matching to column names in parquet tables, when specified via the ``columns`` parameter. (`DM-52515 <https://rubinobs.atlassian.net/browse/DM-52515>`_)
-- Added a new ``--remove-from-parents`` flag for the ``remove-collections`` CLI to allow removal of collections that are still referenced from chained collections. (`DM-52782 <https://rubinobs.atlassian.net/browse/DM-52782>`_)
-- We now build the Butler server Docker container for both arm64 and amd64. (`DM-52819 <https://rubinobs.atlassian.net/browse/DM-52819>`_)
-- Made ``ButlerLogRecords`` extensible.
-
-  This changes the ``ButlerLogRecords`` file format (the old format can still be
-  read) to allow arbitrary JSON data to be serialized with the log records.
-
-  The ``ButlerLogRecords`` class has been modified to inherit from
-  ``collections.abc.MutableSequence`` instead of `pydantic.RootModel`, which means
-  Pydantic methods can no longer be called on it directly (in particular, use
-  ``to_json_data`` to serialize instead of ``model_dump_json``). (`DM-53019 <https://rubinobs.atlassian.net/browse/DM-53019>`_)
-- The ``id`` parameter to ``Butler.get_dataset`` now accepts hexadecimal strings, in addition to UUID instances.
-  A new method ``Butler.get_many_datasets()`` allows the efficient lookup of multiple ``DatasetRef`` by dataset UUID. (`DM-53176 <https://rubinobs.atlassian.net/browse/DM-53176>`_)
-- Added ``Butler.close()``, a context manager implementation for ``Butler``, and ``QuantumBackedButler.close()``.  These can be used to ensure that database connections are closed deterministically, rather than waiting for mark-and-sweep garbage collection. (`DM-53233 <https://rubinobs.atlassian.net/browse/DM-53233>`_)
-- ``LabeledButlerFactory`` now has a ``writeable`` constructor option to allow writeable Butlers to be instantiated.
-  ``LabeledButlerFactory`` can now be used as a context manager to control the lifetime of its database connections. (`DM-53739 <https://rubinobs.atlassian.net/browse/DM-53739>`_)
-
-Bug Fixes
----------
-
-- Fixed a few server-side exceptions that should have been sent to ``RemoteButler`` clients as meaningful exceptions, but instead were triggering an HTTP 500 Internal Server Error. (`DM-51314 <https://rubinobs.atlassian.net/browse/DM-51314>`_)
-- Deferred loading storage class definitions when deserializing datastore records.
-
-  This prevents storage class lookup errors when loading quantum graphs, when the storage class definitions are defined somewhere other than the defaults in ``daf_butler`` (such as a repository root). (`DM-51381 <https://rubinobs.atlassian.net/browse/DM-51381>`_)
-- When exporting ``visit`` dimension records, ``Butler.export()`` now includes ``populated_by: visit`` records like ``visit_definition``/``visit_system_membership``, and the associated ``exposure`` records. (`DM-51681 <https://rubinobs.atlassian.net/browse/DM-51681>`_)
-- Fixed a bug introduced in July 2024 in collection query methods that specify ``flatten_chains=True`` with name patterns.
-
-  The bug resulted in not returning all children names for a chain collection that matches the pattern, only child names that also match the pattern were returned. (`DM-51819 <https://rubinobs.atlassian.net/browse/DM-51819>`_)
-- ``Butler.ingest()`` now checks for conflicting datastore records before ingesting files, reducing the likelihood of an issue where existing files are overwritten/deleted by an ingest that fails due to conflicting datasets. (`DM-52179 <https://rubinobs.atlassian.net/browse/DM-52179>`_)
-- Query generation will no longer throw ``sqlalchemy.exc.ArgumentError`` when attempting to use a dataset calibration timespan constraint for a dataset search without any calibration collections. (`DM-52398 <https://rubinobs.atlassian.net/browse/DM-52398>`_)
-- Changed the conceptual timespan associated with ``RUN`` and ``TAGGED`` collections from `None` / ``NULL`` to an unbounded timespan.
-
-  This fixes the behavior of temporal joins in quantum graph builds, where prior to this change a ``RUN`` or ``TAGGED`` collection earlier in the search path would be silently ignored in favor of a later ``CALIBRATION`` collection.
-  It also changes the value of timespan columns for these collection types via the ``Query.general`` interface.
-  The behavior of ``queryDatasetAssociations`` has *not* been changed for backwards-compatibility; it continues to return ``timespan=None`` for non-``CALIBRATION``` collections. (`DM-52895 <https://rubinobs.atlassian.net/browse/DM-52895>`_)
-- The unit tests will no longer fail due to file descriptor exhaustion.
-  All `ResourceWarning` messages in the unit test suite have been fixed.
-  Butler instances are now garbage-collected immediately when they are no longer referenced, although their database connections still might not be released until mark-and-sweep garbage collection runs. (`DM-53233 <https://rubinobs.atlassian.net/browse/DM-53233>`_)
-- Fixed compatibility of the unit test suite with pytest v9. (`DM-53266 <https://rubinobs.atlassian.net/browse/DM-53266>`_)
-- Storage classes are no longer loaded implicitly when using ``Butler.registry.queryDatasets()``.
-  A warning about the ``datasetType`` parameter being deprecated is no longer issued when calling ``Butler.registry.queryDatasetAssociations``. (`DM-53342 <https://rubinobs.atlassian.net/browse/DM-53342>`_)
-- ``FileDatastore.export_records()`` will no longer fail with ``sqlalchemy.exc.InternalError`` when given a large number of dataset IDs.
-  ``Butler.get_many_datasets()`` will no longer fail with ``sqlalchemy.exc.InternalError`` when given a large number of dataset IDs. (`DM-53610 <https://rubinobs.atlassian.net/browse/DM-53610>`_)
-
-
-Performance Enhancement
------------------------
-
-- Fewer database queries are now used when inserting/exporting datasets, in cases where the datasets do not have "expanded data ID" values known in advance. (`DM-51593 <https://rubinobs.atlassian.net/browse/DM-51593>`_)
-- ``Butler.transfer_from(transfer_dimensions = True)``, ``Butler.transfer_dimension_records_from()``, and ``butler transfer-datasets`` are now significantly faster. (`DM-51681 <https://rubinobs.atlassian.net/browse/DM-51681>`_)
-- New dataset UUIDs are now generated using UUIDv7 instead of UUIDv4, to improve Postgres insert performance. (`DM-52719 <https://rubinobs.atlassian.net/browse/DM-52719>`_)
-- Removed unnecessary directory existence checks when writing files to the datastore.
-  We no longer create zero-byte files to represent "directories" when writing files to an S3 datastore. (`DM-53580 <https://rubinobs.atlassian.net/browse/DM-53580>`_)
-
-
-Other Changes and Additions
----------------------------
-
-- Updated the storage class definitions for scarlet lite models to be Zip archives that can be accessed as single blends. (`DM-49537 <https://rubinobs.atlassian.net/browse/DM-49537>`_)
-- Made some registry test data available to downstream packages via `importlib.resources`. (`DM-51363 <https://rubinobs.atlassian.net/browse/DM-51363>`_)
-- Added support for ``obs_publisher_did`` value in ObsCore config file. (`DM-51383 <https://rubinobs.atlassian.net/browse/DM-51383>`_)
-- * Modified ``ObsCore`` records to place "exposure" in any visit fields if there is an exposure but no visit defined.
-    This required the addition of a new method to the ``RecordFactory`` which can be subclassed by other plugins.
-  * Added ability to hard code the ``s_xel1`` and ``s_xel2`` ObsCore fields per dataset type. (`DM-51495 <https://rubinobs.atlassian.net/browse/DM-51495>`_)
-- Added ``PhotozModel`` as an alternate name for the ``PZModel`` storage class. (`DM-51660 <https://rubinobs.atlassian.net/browse/DM-51660>`_)
-- Drop incomplete support for case-insensitive handling of identifiers in query expressions.
-
-  Some code in the query generation system was trying to allow dimension names to be case-insensitive, but was actually just inadvertently requiring all dimension names to be defined as lowercase.
-  Our Python-flavored user base probably expects case-sensitive dimension and dataset type names anyway.
-
-  Constants (e.g., ``AND`` or ``OVERLAPS``) in the query system are still case insensitive. (`DM-52339 <https://rubinobs.atlassian.net/browse/DM-52339>`_)
-- ``Butler.registry.queryDatasets``, ``Butler.registry.queryDataIds``, and ``Butler.registry.queryDimensionRecords`` have been re-implemented using the same query framework backing ``Butler.query()`` and the various ``Butler.query_*()`` methods.  Though the ``Butler.registry.*`` methods are not yet deprecated, users are encouraged to begin migrating to the equivalent ``Butler.query_*`` functions.  The new implementation comes with a number of minor behavior changes:
-  - We no longer raise an exception if governor dimension values in a query constraint are not known to the registry.  Instead, we return no results.
-  - Result rows are now deduplicated.
-  - ``findFirst`` searches are now supported in calibration collections. (`DM-52397 <https://rubinobs.atlassian.net/browse/DM-52397>`_)
-- ``Butler.find_dataset()`` / ``Butler.registry.findDataset()`` have been re-implemented using the same query framework backing ``Butler.query()``. These methods now always return ``DatasetRef`` instances with ``dataId.hasFull() = True``. (`DM-52398 <https://rubinobs.atlassian.net/browse/DM-52398>`_)
-- For EUPS users we now set the ``ARROW_DEFAULT_MEMORY_POOL`` environment variable to ``jemalloc``.
-  This works around a memory leak reported in https://github.com/apache/arrow/issues/45882 for pyarrow v18 and newer. (`DM-52412 <https://rubinobs.atlassian.net/browse/DM-52412>`_)
-- Added a new ``Datastore`` API for retrieving the datastore records for datasets that might not have been written yet.
-  There is also a related API added to ``QuantumBackedButler``. (`DM-52653 <https://rubinobs.atlassian.net/browse/DM-52653>`_)
-- Rewrote the default compression write recipes to match the new interfaces for FITS compression in ``afw`` and ``obs_base``. (`DM-52879 <https://rubinobs.atlassian.net/browse/DM-52879>`_)
-- Added new options to ``DatasetProvenance`` to prevent excessive numbers of input datasets being recorded in file metadata.
-  The limit for parquet datasets was set to 2,000 inputs. (`DM-53326 <https://rubinobs.atlassian.net/browse/DM-53326>`_)
-- Added ``lossy16`` compression recipe to replace ``lossyBasic`` (`DM-53420 <https://rubinobs.atlassian.net/browse/DM-53420>`_)
-- Added a storage class and formatter declaration for the ``ProvenanceQuantumGraph`` class.
-
-  Allowed a ``ButlerLogRecords`` container to be passed to the log handler at construction. (`DM-53622 <https://rubinobs.atlassian.net/browse/DM-53622>`_)
-- Added metrics recording for ``butler.ingest``. (`DM-53679 <https://rubinobs.atlassian.net/browse/DM-53679>`_)
-- Added Butler storage class definitions for ``GuiderROI`` ``VignettingCorrection`` class (`OSW-1064 <https://rubinobs.atlassian.net/browse/OSW-1064>`_)
-
-An API Removal or Deprecation
------------------------------
-
-- ``daf_butler`` no longer depends on the ``daf_relation`` library.
-  ``daf_relation``-related internal classes are no longer exported from the top-level module.
-  Butler query expression classes have moved from ``lsst.daf.butler.registry.queries`` to ``lsst.daf.butler.queries``. (`DM-52345 <https://rubinobs.atlassian.net/browse/DM-52345>`_)
-- Removed deprecated ``DatasetQueryResults.materialize()`` method.
-  Removed deprecated ``offset`` parameter from the ``limit`` method in the ``DataCoordinateQueryResults``, ``DatasetQueryResults``, and ``DimensionRecordQueryResults`` classes.
-  Removed the deprecated feature where HTM and HEALPix spatial dimensions like ``htm11`` or ``healpix10`` could be used in data ID constraints passed to queries. The exception is ``htm7``, which will continue to work.  Users should instead use region ``OVERLAPS`` constraints in query ``where`` expressions.
-  Removed support for ``<`` and ``>`` operators in ``Butler.registry.query*()`` ``where`` strings for comparisons of ``Timespan`` vs ``Timespan``, or ``Timespan`` vs ``Time``.  Instead, use ``timespan.begin < ts`` or ``timespan.end > ts`` to explicitly indicate which timespan bound you are comparing with. (`DM-52397 <https://rubinobs.atlassian.net/browse/DM-52397>`_)
-
-
 Butler v29.1.0 (2025-06-13)
 ===========================
 

{lsst_daf_butler-30.0.1rc1 → lsst_daf_butler-30.2025.5000}/doc/lsst.daf.butler/writing-subcommands.rst

@@ -62,8 +62,8 @@ Example of a command or subcommand definition:
     if __name__ == "__main__":
         git()
 
-This creates a command that is called by ``main``, which has a subcommand ``pull``.
-It automatically has a ``--help`` option:
+This creates a command that is called by `main`, which has a subcommand `pull`.
+It automatically has a `--help` option:
 
 .. code-block:: text
 
@@ -75,7 +75,7 @@ It automatically has a ``--help`` option:
     Options:
       --help  Show this message and exit.
 
-And ``pull`` can be called as a subcommand:
+And `pull` can be called as a subcommand:
 
 .. code-block:: text
 
@@ -98,7 +98,7 @@ For example, the function
     def register_instrument():
         ...
 
-Becomes a subcommand of ``butler`` called ``register-instrument``.
+Becomes a subcommand of `butler` called ``register-instrument``.
 
 Butler Subcommands
 ~~~~~~~~~~~~~~~~~~

{lsst_daf_butler-30.0.1rc1 → lsst_daf_butler-30.2025.5000}/pyproject.toml

@@ -39,7 +39,6 @@ dependencies = [
 dynamic = ["version"]
 [project.urls]
 "Homepage" = "https://github.com/lsst/daf_butler"
-"Source" = "https://github.com/lsst/daf_butler"
 
 [project.optional-dependencies]
 postgres = ["psycopg2"]
@@ -57,7 +56,7 @@ test = [
     "pytest >= 3.2",
     "numpy >= 1.17",
     "matplotlib >= 3.0.3",
-    "pandas >= 1.0, < 3.0",
+    "pandas >= 1.0",
 ]
 # Also expose the optional dependencies of lsst-resources as optional
 # dependencies of lsst-daf-butler.  lsst-daf-butler itself doesn't care what
@@ -234,7 +233,6 @@ checks = [
     "RT01",  # Unfortunately our @property trigger this.
     "RT02",  # Does not want named return value. DM style says we do.
     "SS05",  # pydocstyle is better at finding infinitive verb.
-    "RT03",  # Temporarily disable for sphinx empty returns.
 ]
 exclude = [
     "^test_.*",  # Do not test docstrings in test code.

{lsst_daf_butler-30.0.1rc1 → lsst_daf_butler-30.2025.5000}/python/lsst/daf/butler/_butler.py

@@ -138,10 +138,7 @@ class Butler(LimitedButler):  # numpydoc ignore=PR02
     without_datastore : `bool`, optional
         If `True` do not attach a datastore to this butler. Any attempts
         to use a datastore will fail.
-    metrics : `ButlerMetrics` or `None`
-        External metrics object to be used for tracking butler usage. If `None`
-        a new metrics object is created.
-    **kwargs : `typing.Any`
+    **kwargs : `Any`
         Additional keyword arguments passed to a constructor of actual butler
         class.
 
@@ -243,7 +240,7 @@ class Butler(LimitedButler):  # numpydoc ignore=PR02
             to use a datastore will fail.
         metrics : `ButlerMetrics` or `None`, optional
             Metrics object to record butler usage statistics.
-        **kwargs : `typing.Any`
+        **kwargs : `Any`
             Default data ID key-value pairs.  These may only identify
             "governor" dimensions like ``instrument`` and ``skymap``.
 
@@ -1393,10 +1390,6 @@ class Butler(LimitedButler):  # numpydoc ignore=PR02
             raised if any datasets with the same dataset ID already exist
             in the datastore.
 
-        Returns
-        -------
-        None
-
         Raises
         ------
         TypeError
@@ -1436,7 +1429,6 @@ class Butler(LimitedButler):  # numpydoc ignore=PR02
         *,
         transfer_dimensions: bool = False,
         dry_run: bool = False,
-        skip_existing: bool = False,
     ) -> None:
         """Ingest a Zip file into this butler.
 
@@ -1455,14 +1447,6 @@ class Butler(LimitedButler):  # numpydoc ignore=PR02
             If `True` the ingest will be processed without any modifications
             made to the target butler and as if the target butler did not
             have any of the datasets.
-        skip_existing : `bool`, optional
-            If `True`, a zip will not be ingested if the dataset entries listed
-            in the index with the same dataset ID already exists in the butler.
-            If `False` (the default), a `ConflictingDefinitionError` will be
-            raised if any datasets with the same dataset ID already exist
-            in the repository. If, somehow, some datasets are known to the
-            butler and some are not, this is currently treated as an error
-            rather than attempting to do a partial ingest.
 
         Notes
         -----
@@ -1582,7 +1566,7 @@ class Butler(LimitedButler):  # numpydoc ignore=PR02
 
     @abstractmethod
     def transfer_dimension_records_from(
-        self, source_butler: LimitedButler | Butler, source_refs: Iterable[DatasetRef | DataCoordinate]
+        self, source_butler: LimitedButler | Butler, source_refs: Iterable[DatasetRef]
     ) -> None:
         """Transfer dimension records to this Butler from another Butler.
 
@@ -1594,9 +1578,10 @@ class Butler(LimitedButler):  # numpydoc ignore=PR02
             `Butler` whose registry will be used to expand data IDs. If the
             source refs contain coordinates that are used to populate other
             records then this will also need to be a full `Butler`.
-        source_refs : iterable of `DatasetRef` or `DataCoordinate`
-            Datasets or data IDs defined in the source butler whose dimension
-            records should be transferred to this butler.
+        source_refs : iterable of `DatasetRef`
+            Datasets defined in the source butler whose dimension records
+            should be transferred to this butler. In most circumstances.
+            transfer is faster if the dataset refs are expanded.
         """
         raise NotImplementedError()
 
@@ -2040,7 +2025,7 @@ class Butler(LimitedButler):  # numpydoc ignore=PR02
 
         Returns
         -------
-        records : `list` [`DimensionRecord`]
+        records : `list`[`DimensionRecord`]
             Dimension records matching the given query parameters.
 
         Raises
@@ -2242,7 +2227,3 @@ class Butler(LimitedButler):  # numpydoc ignore=PR02
     @abstractmethod
     def close(self) -> None:
         raise NotImplementedError()
-
-    @abstractmethod
-    def _expand_data_ids(self, data_ids: Iterable[DataCoordinate]) -> list[DataCoordinate]:
-        raise NotImplementedError()

{lsst_daf_butler-30.0.1rc1 → lsst_daf_butler-30.2025.5000}/python/lsst/daf/butler/_butler_collections.py

@@ -360,10 +360,10 @@ class ButlerCollections(ABC, Sequence):
         name : `str`
             The name of the collection of interest.
         include_parents : `bool`, optional
-            If `True` any parents of this collection will be included.
+           If `True` any parents of this collection will be included.
         include_summary : `bool`, optional
-            If `True` dataset type names and governor dimensions of datasets
-            stored in this collection will be included in the result.
+           If `True` dataset type names and governor dimensions of datasets
+           stored in this collection will be included in the result.
 
         Returns
         -------
@@ -464,7 +464,7 @@ class ButlerCollections(ABC, Sequence):
 
         Returns
         -------
-        filtered : `~collections.abc.Mapping` [`str`, `list` [`str`]]
+        filtered : `~collections.abc.Mapping` [`str`, `list`[`str`]]
             Mapping of the dataset type name to its corresponding list of
             collection names.
         """

{lsst_daf_butler-30.0.1rc1 → lsst_daf_butler-30.2025.5000}/python/lsst/daf/butler/_butler_metrics.py

@@ -27,19 +27,14 @@
 
 from __future__ import annotations
 
-__all__ = ["ButlerMetrics"]
-
 from collections.abc import Callable, Iterator
 from contextlib import contextmanager
-from typing import Concatenate, ParamSpec
 
 from pydantic import BaseModel
 
 from lsst.utils.logging import LsstLoggers
 from lsst.utils.timer import time_this
 
-P = ParamSpec("P")
-
 
 class ButlerMetrics(BaseModel):
     """Metrics collected during Butler operations."""
@@ -50,26 +45,18 @@ class ButlerMetrics(BaseModel):
     time_in_get: float = 0.0
     """Wall-clock time, in seconds, spent in get()."""
 
-    time_in_ingest: float = 0.0
-    """Wall-clock time, in seconds, spent in ingest()."""
-
     n_get: int = 0
     """Number of datasets retrieved with get()."""
 
     n_put: int = 0
     """Number of datasets stored with put()."""
 
-    n_ingest: int = 0
-    """Number of datasets ingested."""
-
     def reset(self) -> None:
         """Reset all metrics."""
         self.time_in_put = 0.0
         self.time_in_get = 0.0
-        self.time_in_ingest = 0.0
         self.n_get = 0
         self.n_put = 0
-        self.n_ingest = 0
 
     def increment_get(self, duration: float) -> None:
         """Increment time for get().
@@ -93,31 +80,13 @@ class ButlerMetrics(BaseModel):
         self.time_in_put += duration
         self.n_put += 1
 
-    def increment_ingest(self, duration: float, n_datasets: int) -> None:
-        """Increment time and datasets for ingest().
-
-        Parameters
-        ----------
-        duration : `float`
-            Duration to add to the ingest() statistics.
-        n_datasets : `int`
-            Number of datasets to be ingested for this call.
-        """
-        self.time_in_ingest += duration
-        self.n_ingest += n_datasets
-
     @contextmanager
     def _timer(
-        self,
-        handler: Callable[Concatenate[float, P], None],
-        log: LsstLoggers | None = None,
-        msg: str | None = None,
-        *args: P.args,
-        **kwargs: P.kwargs,
+        self, handler: Callable[[float], None], log: LsstLoggers | None = None, msg: str | None = None
     ) -> Iterator[None]:
         with time_this(log=log, msg=msg) as timer:
             yield
-        handler(timer.duration, *args, **kwargs)
+        handler(timer.duration)
 
     @contextmanager
     def instrument_get(self, log: LsstLoggers | None = None, msg: str | None = None) -> Iterator[None]:
@@ -146,21 +115,3 @@ class ButlerMetrics(BaseModel):
         """
         with self._timer(self.increment_put, log=log, msg=msg):
             yield
-
-    @contextmanager
-    def instrument_ingest(
-        self, n_datasets: int, log: LsstLoggers | None = None, msg: str | None = None
-    ) -> Iterator[None]:
-        """Run code and increment ingest statistics.
-
-        Parameters
-        ----------
-        n_datasets : `int`
-            Number of datasets being ingested.
-        log : `logging.Logger` or `None`
-            Logger to use for any timing information.
-        msg : `str` or `None`
-            Any message to be included in log output.
-        """
-        with self._timer(self.increment_ingest, n_datasets=n_datasets, log=log, msg=msg):
-            yield

{lsst_daf_butler-30.0.1rc1 → lsst_daf_butler-30.2025.5000}/python/lsst/daf/butler/_dataset_provenance.py

@@ -267,7 +267,7 @@ class DatasetProvenance(pydantic.BaseModel):
         use_upper : `bool` or `None`
             If `True` use upper case for provenance keys, if `False` use lower
             case, if `None` match the case of the prefix.
-        *keys : `tuple` of `str` | `int`
+        keys : `tuple` of `str` | `int`
             Components of key to combine with prefix and separator.
 
         Returns

{lsst_daf_butler-30.0.1rc1 → lsst_daf_butler-30.2025.5000}/python/lsst/daf/butler/_dataset_ref.py

@@ -479,7 +479,7 @@ class DatasetRef:
 
         Parameters
         ----------
-        simple : `dict` of [`str`, `typing.Any`]
+        simple : `dict` of [`str`, `Any`]
             The value returned by `to_simple()`.
         universe : `DimensionUniverse`
             The special graph of all known dimensions.

{lsst_daf_butler-30.0.1rc1 → lsst_daf_butler-30.2025.5000}/python/lsst/daf/butler/_exceptions.py

@@ -196,8 +196,8 @@ class ValidationError(RuntimeError):
 
 
 class EmptyQueryResultError(Exception):
-    """Exception raised when query methods return an empty result and
-    ``explain`` flag is set.
+    """Exception raised when query methods return an empty result and `explain`
+    flag is set.
 
     Parameters
     ----------

{lsst_daf_butler-30.0.1rc1 → lsst_daf_butler-30.2025.5000}/python/lsst/daf/butler/_file_dataset.py

@@ -129,8 +129,7 @@ class FileDataset:
         ----------
         dataset : `SerializedFileDataset`
             Object to deserialize.
-        dataset_type_loader : `~collections.abc.Callable` \
-              [[ `str` ], `DatasetType` ]
+        dataset_type_loader : `Callable` [[ `str` ], `DatasetType` ]
             Function that takes a string dataset type name as its
             only parameter, and returns an instance of `DatasetType`.
             Used to deserialize the `DatasetRef` instances contained

{lsst_daf_butler-30.0.1rc1 → lsst_daf_butler-30.2025.5000}/python/lsst/daf/butler/_formatter.py

@@ -54,7 +54,6 @@ from ._config import Config
 from ._config_support import LookupKey, processLookupConfigs
 from ._file_descriptor import FileDescriptor
 from ._location import Location
-from ._rubin.temporary_for_ingest import TemporaryForIngest
 from .dimensions import DataCoordinate, DimensionUniverse
 from .mapping_factory import MappingFactory
 
@@ -910,10 +909,6 @@ class FormatterV2:
         provenance : `DatasetProvenance` | `None`, optional
             Provenance to attach to the file being written.
 
-        Returns
-        -------
-        None
-
         Raises
         ------
         FormatterNotImplementedError
@@ -1036,7 +1031,15 @@ class FormatterV2:
         """
         cache_manager = self._ensure_cache(cache_manager)
 
-        with TemporaryForIngest.make_path(uri) as temporary_uri:
+        # Always write to a temporary even if
+        # using a local file system -- that gives us atomic writes.
+        # If a process is killed as the file is being written we do not
+        # want it to remain in the correct place but in corrupt state.
+        # For local files write to the output directory not temporary dir.
+        prefix = uri.dirname() if uri.isLocal else None
+        if prefix is not None:
+            prefix.mkdir()
+        with ResourcePath.temporary_uri(suffix=uri.getExtension(), prefix=prefix) as temporary_uri:
             # Need to configure the formatter to write to a different
             # location and that needs us to overwrite internals
             log.debug("Writing dataset to temporary location at %s", temporary_uri)
@@ -1141,10 +1144,6 @@ class FormatterV2:
         location : `Location`
             Location from which to extract a file extension.
 
-        Returns
-        -------
-        None
-
         Raises
         ------
         ValueError
@@ -1591,10 +1590,6 @@ class Formatter(metaclass=ABCMeta):
         location : `Location`
             Location from which to extract a file extension.
 
-        Returns
-        -------
-        None
-
         Raises
         ------
         NotImplementedError

{lsst_daf_butler-30.0.1rc1 → lsst_daf_butler-30.2025.5000}/python/lsst/daf/butler/_labeled_butler_factory.py

@@ -30,9 +30,7 @@ from __future__ import annotations
 __all__ = ("LabeledButlerFactory", "LabeledButlerFactoryProtocol")
 
 from collections.abc import Mapping
-from contextlib import AbstractContextManager
-from logging import getLogger
-from typing import Any, Literal, Protocol, Self
+from typing import Protocol
 
 from lsst.resources import ResourcePathExpression
 
@@ -42,8 +40,6 @@ from ._butler_repo_index import ButlerRepoIndex
 from ._utilities.named_locks import NamedLocks
 from ._utilities.thread_safe_cache import ThreadSafeCache
 
-_LOG = getLogger(__name__)
-
 
 class LabeledButlerFactoryProtocol(Protocol):
     """Callable to retrieve a butler from a label."""
@@ -51,7 +47,7 @@ class LabeledButlerFactoryProtocol(Protocol):
     def __call__(self, label: str) -> Butler: ...
 
 
-class LabeledButlerFactory(AbstractContextManager):
+class LabeledButlerFactory:
     """Factory for efficiently instantiating Butler instances from the
     repository index file.  This is intended for use from long-lived services
     that want to instantiate a separate Butler instance for each end user
@@ -64,9 +60,6 @@ class LabeledButlerFactory(AbstractContextManager):
         files.  If not provided, defaults to the global repository index
         configured by the ``DAF_BUTLER_REPOSITORY_INDEX`` environment variable
         --  see `ButlerRepoIndex`.
-    writeable : `bool`, optional
-        If `True`, Butler instances created by this factory will be writeable.
-        If `False` (the default), instances will be read-only.
 
     Notes
     -----
@@ -83,12 +76,11 @@ class LabeledButlerFactory(AbstractContextManager):
     safely be used by separate threads.
     """
 
-    def __init__(self, repositories: Mapping[str, str] | None = None, writeable: bool = False) -> None:
+    def __init__(self, repositories: Mapping[str, str] | None = None) -> None:
         if repositories is None:
             self._repositories = None
         else:
             self._repositories = dict(repositories)
-        self._writeable = writeable
 
         self._factories = ThreadSafeCache[str, _ButlerFactory]()
         self._initialization_locks = NamedLocks()
@@ -96,16 +88,6 @@ class LabeledButlerFactory(AbstractContextManager):
         # This may be overridden by unit tests.
         self._preload_unsafe_direct_butler_caches = True
 
-    def __enter__(self) -> Self:
-        return self
-
-    def __exit__(self, exc_type: Any, exc_val: Any, exc_tb: Any) -> Literal[False]:
-        try:
-            self.close()
-        except Exception:
-            _LOG.exception("An exception occurred during LabeledButlerFactory.close()")
-        return False
-
     def bind(self, access_token: str | None) -> LabeledButlerFactoryProtocol:
         """Create a callable factory function for generating Butler instances
         with out needing to specify access tokans again.
@@ -127,7 +109,7 @@ class LabeledButlerFactory(AbstractContextManager):
 
         return create
 
-    def create_butler(self, label: str, *, access_token: str | None = None) -> Butler:
+    def create_butler(self, *, label: str, access_token: str | None) -> Butler:
         """Create a Butler instance.
 
         Parameters
@@ -136,7 +118,7 @@ class LabeledButlerFactory(AbstractContextManager):
             Label of the repository to instantiate, from the ``repositories``
             parameter to the `LabeledButlerFactory` constructor or the global
             repository index file.
-        access_token : `str` | `None`, optional
+        access_token : `str` | `None`
             Gafaelfawr access token used to authenticate to a Butler server.
             This is required for any repositories configured to use
             `RemoteButler`.  If you only use `DirectButler`, this may be
@@ -185,9 +167,7 @@ class LabeledButlerFactory(AbstractContextManager):
 
         match butler_type:
             case ButlerType.DIRECT:
-                return _DirectButlerFactory(
-                    config, self._preload_unsafe_direct_butler_caches, self._writeable
-                )
+                return _DirectButlerFactory(config, self._preload_unsafe_direct_butler_caches)
             case ButlerType.REMOTE:
                 return _RemoteButlerFactory(config)
             case _:
@@ -209,12 +189,12 @@ class _ButlerFactory(Protocol):
 
 
 class _DirectButlerFactory(_ButlerFactory):
-    def __init__(self, config: ButlerConfig, preload_unsafe_caches: bool, writeable: bool) -> None:
+    def __init__(self, config: ButlerConfig, preload_unsafe_caches: bool) -> None:
         import lsst.daf.butler.direct_butler
 
         # Create a 'template' Butler that will be cloned when callers request
         # an instance.
-        self._butler = Butler.from_config(config, writeable=writeable)
+        self._butler = Butler.from_config(config)
         assert isinstance(self._butler, lsst.daf.butler.direct_butler.DirectButler)
 
         # Load caches so that data is available in cloned instances without