sqlite-utils 4.0a0__tar.gz → 4.0rc1__tar.gz

{sqlite_utils-4.0a0/sqlite_utils.egg-info → sqlite_utils-4.0rc1}/PKG-INFO

@@ -1,68 +1,35 @@
 Metadata-Version: 2.4
 Name: sqlite-utils
-Version: 4.0a0
+Version: 4.0rc1
 Summary: CLI tool and Python library for manipulating SQLite databases
-Home-page: https://github.com/simonw/sqlite-utils
 Author: Simon Willison
-License: Apache License, Version 2.0
+License-Expression: Apache-2.0
+Project-URL: Homepage, https://github.com/simonw/sqlite-utils
 Project-URL: Documentation, https://sqlite-utils.datasette.io/en/stable/
 Project-URL: Changelog, https://sqlite-utils.datasette.io/en/stable/changelog.html
-Project-URL: Source code, https://github.com/simonw/sqlite-utils
 Project-URL: Issues, https://github.com/simonw/sqlite-utils/issues
 Project-URL: CI, https://github.com/simonw/sqlite-utils/actions
 Classifier: Development Status :: 5 - Production/Stable
 Classifier: Intended Audience :: Developers
-Classifier: Intended Audience :: Science/Research
 Classifier: Intended Audience :: End Users/Desktop
-Classifier: Topic :: Database
-Classifier: License :: OSI Approved :: Apache Software License
-Classifier: Programming Language :: Python :: 3.9
+Classifier: Intended Audience :: Science/Research
 Classifier: Programming Language :: Python :: 3.10
 Classifier: Programming Language :: Python :: 3.11
 Classifier: Programming Language :: Python :: 3.12
 Classifier: Programming Language :: Python :: 3.13
-Requires-Python: >=3.9
+Classifier: Programming Language :: Python :: 3.14
+Classifier: Topic :: Database
+Requires-Python: >=3.10
 Description-Content-Type: text/markdown
 License-File: LICENSE
-Requires-Dist: sqlite-fts4
-Requires-Dist: click
+Requires-Dist: click>=8.3.1
 Requires-Dist: click-default-group>=1.2.3
-Requires-Dist: tabulate
-Requires-Dist: python-dateutil
 Requires-Dist: pluggy
-Provides-Extra: test
-Requires-Dist: pytest; extra == "test"
-Requires-Dist: black>=24.1.1; extra == "test"
-Requires-Dist: hypothesis; extra == "test"
-Requires-Dist: cogapp; extra == "test"
-Provides-Extra: docs
-Requires-Dist: furo; extra == "docs"
-Requires-Dist: sphinx-autobuild; extra == "docs"
-Requires-Dist: codespell; extra == "docs"
-Requires-Dist: sphinx-copybutton; extra == "docs"
-Requires-Dist: beanbag-docutils>=2.0; extra == "docs"
-Requires-Dist: pygments-csv-lexer; extra == "docs"
-Provides-Extra: mypy
-Requires-Dist: mypy; extra == "mypy"
-Requires-Dist: types-click; extra == "mypy"
-Requires-Dist: types-tabulate; extra == "mypy"
-Requires-Dist: types-python-dateutil; extra == "mypy"
-Requires-Dist: types-pluggy; extra == "mypy"
-Requires-Dist: data-science-types; extra == "mypy"
-Provides-Extra: flake8
-Requires-Dist: flake8; extra == "flake8"
-Dynamic: author
-Dynamic: classifier
-Dynamic: description
-Dynamic: description-content-type
-Dynamic: home-page
-Dynamic: license
+Requires-Dist: python-dateutil
+Requires-Dist: sqlite-fts4
+Requires-Dist: tabulate
+Requires-Dist: pip
 Dynamic: license-file
-Dynamic: project-url
-Dynamic: provides-extra
-Dynamic: requires-dist
-Dynamic: requires-python
-Dynamic: summary
 
 # sqlite-utils
 

{sqlite_utils-4.0a0 → sqlite_utils-4.0rc1}/docs/changelog.rst

@@ -4,6 +4,47 @@
  Changelog
 ===========
 
+.. _v4_0rc1:
+
+4.0rc1 (2026-06-21)
+-------------------
+
+- New :ref:`database migrations system <migrations>`, incorporating functionality that was previously provided by the separate `sqlite-migrate <https://github.com/simonw/sqlite-migrate>`__ plugin. Define migration sets using the new :class:`sqlite_utils.Migrations` class and apply them using the ``sqlite-utils migrate`` command or the :ref:`migrations Python API <migrations_python>`. (:issue:`752`)
+- New ``db.atomic()`` :ref:`context manager providing nested transaction support <python_api_atomic>` using SQLite transactions and savepoints. Internal multi-step operations such as ``table.transform()`` now use this mechanism to avoid unexpectedly committing an existing transaction. (:issue:`755`)
+- ``Database`` objects can now be :ref:`used as context managers <python_api_close>`, automatically closing the connection when the ``with`` block exits. The CLI also now closes database and file handles more reliably, resolving a number of ``ResourceWarning`` warnings. (:issue:`692`)
+- The ``sqlite-utils convert`` command can now accept a direct callable reference such as ``r.parsedate`` or ``json.loads --import json`` as the conversion code, as an alternative to calling it explicitly with ``r.parsedate(value)``. (:issue:`686`)
+- Fixed a bug where CSV or TSV files with only a header row could crash ``sqlite-utils insert`` and ``sqlite-utils memory`` when type detection was enabled. Thanks, `Rami Abdelrazzaq <https://github.com/RamiNoodle733>`__. (:issue:`702`, `#707 <https://github.com/simonw/sqlite-utils/pull/707>`__)
+- Fixed a bug where installed plugins could be loaded while running the test suite, despite the test-mode safeguard that disables plugin loading. Thanks, `Rami Abdelrazzaq <https://github.com/RamiNoodle733>`__. (:issue:`713`, `#719 <https://github.com/simonw/sqlite-utils/pull/719>`__)
+- ``table.detect_fts()`` now recognizes legacy FTS virtual tables that quote the ``content=`` table name using square brackets, allowing ``table.enable_fts(..., replace=True)`` to replace them correctly. (:issue:`694`)
+- Now depends on Click 8.3.1 or later, removing compatibility workarounds for Click's ``Sentinel`` default values. (:issue:`666`)
+- Improved type annotations throughout the package, with ``ty`` now run in CI. (:issue:`697`)
+- Development tooling now uses ``uv`` dependency groups, with separate ``dev`` and ``docs`` groups. (:issue:`691`)
+- The test suite now runs against Python 3.15-dev. (:issue:`738`)
+
+.. _v3_39:
+
+3.39 (2025-11-24)
+-----------------
+
+- Fixed a bug with ``sqlite-utils install`` when the tool had been installed using ``uv``. (:issue:`687`)
+- The ``--functions`` argument now optionally accepts a path to a Python file as an alternative to a string full of code, and can be specified multiple times - see :ref:`cli_query_functions`. (:issue:`659`)
+- ``sqlite-utils`` now requires Python 3.10 or higher.
+
+.. _v4_0a1:
+
+4.0a1 (2025-11-23)
+------------------
+
+- **Breaking change**: The ``db.table(table_name)`` method now only works with tables. To access a SQL view use ``db.view(view_name)`` instead. (:issue:`657`)
+- The ``table.insert_all()`` and ``table.upsert_all()`` methods can now accept an iterator of lists or tuples as an alternative to dictionaries. The first item should be a list/tuple of column names. See :ref:`python_api_insert_lists` for details. (:issue:`672`)
+- **Breaking change**: The default floating point column type has been changed from ``FLOAT`` to ``REAL``, which is the correct SQLite type for floating point values. This affects auto-detected columns when inserting data. (:issue:`645`)
+- Now uses ``pyproject.toml`` in place of ``setup.py`` for packaging. (:issue:`675`)
+- Tables in the Python API now do a much better job of remembering the primary key and other schema details from when they were first created. (:issue:`655`)
+- **Breaking change**: The ``table.convert()`` and ``sqlite-utils convert`` mechanisms no longer skip values that evaluate to ``False``. Previously the ``--skip-false`` option was needed, this has been removed. (:issue:`542`)
+- **Breaking change**: Tables created by this library now wrap table and column names in ``"double-quotes"`` in the schema. Previously they would use ``[square-braces]``. (:issue:`677`)
+- The ``--functions`` CLI argument now accepts a path to a Python file in addition to accepting a string full of Python code. It can also now be specified multiple times. (:issue:`659`)
+- **Breaking change:** Type detection is now the default behavior for the ``insert`` and ``upsert`` CLI commands when importing CSV or TSV data. Previously all columns were treated as ``TEXT`` unless the ``--detect-types`` flag was passed. Use the new ``--no-detect-types`` flag to restore the old behavior. The ``SQLITE_UTILS_DETECT_TYPES`` environment variable has been removed. (:issue:`679`)
+
 .. _v4_0a0:
 
 4.0a0 (2025-05-08)
@@ -158,7 +199,7 @@ This release introduces a new :ref:`plugin system <plugins>`. Read more about th
 - Conversion functions passed to :ref:`table.convert(...) <python_api_convert>` can now return lists or dictionaries, which will be inserted into the database as JSON strings. (:issue:`495`)
 - ``sqlite-utils install`` and ``sqlite-utils uninstall`` commands for installing packages into the same virtual environment as ``sqlite-utils``, :ref:`described here <cli_install>`. (:issue:`483`)
 - New :ref:`sqlite_utils.utils.flatten() <reference_utils_flatten>` utility function. (:issue:`500`)
-- Documentation on :ref:`using Just <contributing_just>` to run tests, linters and build documentation. 
+- Documentation on :ref:`using Just <contributing_just>` to run tests, linters and build documentation.
 - Documentation now covers the :ref:`release_process` for this package.
 
 .. _v3_29:

{sqlite_utils-4.0a0 → sqlite_utils-4.0rc1}/docs/cli-reference.rst

@@ -20,7 +20,7 @@ This page lists the ``--help`` for every ``sqlite-utils`` CLI sub-command.
         "query", "memory", "insert", "upsert", "bulk", "search", "transform", "extract",
         "schema", "insert-files", "analyze-tables", "convert", "tables", "views", "rows",
         "triggers", "indexes", "create-database", "create-table", "create-index",
-        "enable-fts", "populate-fts", "rebuild-fts", "disable-fts"
+        "migrate", "enable-fts", "populate-fts", "rebuild-fts", "disable-fts"
     ]
     refs = {
         "query": "cli_query",
@@ -49,6 +49,7 @@ This page lists the ``--help`` for every ``sqlite-utils`` CLI sub-command.
         "enable-wal": "cli_wal",
         "enable-counts": "cli_enable_counts",
         "bulk": "cli_bulk",
+        "migrate": "cli_migrate",
         "create-database": "cli_create_database",
         "create-table": "cli_create_table",
         "drop-table": "cli_drop_table",
@@ -117,21 +118,21 @@ See :ref:`cli_query`.
       --tsv                       Output TSV
       --no-headers                Omit CSV headers
       -t, --table                 Output as a formatted table
-      --fmt TEXT                  Table format - one of asciidoc, double_grid,
-                                  double_outline, fancy_grid, fancy_outline, github,
-                                  grid, heavy_grid, heavy_outline, html, jira,
-                                  latex, latex_booktabs, latex_longtable, latex_raw,
-                                  mediawiki, mixed_grid, mixed_outline, moinmoin,
-                                  orgtbl, outline, pipe, plain, presto, pretty,
-                                  psql, rounded_grid, rounded_outline, rst, simple,
-                                  simple_grid, simple_outline, textile, tsv,
-                                  unsafehtml, youtrack
+      --fmt TEXT                  Table format - one of asciidoc, colon_grid,
+                                  double_grid, double_outline, fancy_grid,
+                                  fancy_outline, github, grid, heavy_grid,
+                                  heavy_outline, html, jira, latex, latex_booktabs,
+                                  latex_longtable, latex_raw, mediawiki, mixed_grid,
+                                  mixed_outline, moinmoin, orgtbl, outline, pipe,
+                                  plain, presto, pretty, psql, rounded_grid,
+                                  rounded_outline, rst, simple, simple_grid,
+                                  simple_outline, textile, tsv, unsafehtml, youtrack
       --json-cols                 Detect JSON cols and output them as JSON, not
                                   escaped strings
       -r, --raw                   Raw output, first column of first row
       --raw-lines                 Raw output, first column of each row
       -p, --param <TEXT TEXT>...  Named :parameters for SQL query
-      --functions TEXT            Python code defining one or more custom SQL
+      --functions TEXT            Python code or file path defining custom SQL
                                   functions
       --load-extension TEXT       Path to SQLite extension, with optional
                                   :entrypoint
@@ -174,7 +175,7 @@ See :ref:`cli_memory`.
           sqlite-utils memory animals.csv --schema
 
     Options:
-      --functions TEXT            Python code defining one or more custom SQL
+      --functions TEXT            Python code or file path defining custom SQL
                                   functions
       --attach <TEXT FILE>...     Additional databases to attach - specify alias and
                                   filepath
@@ -186,15 +187,15 @@ See :ref:`cli_memory`.
       --tsv                       Output TSV
       --no-headers                Omit CSV headers
       -t, --table                 Output as a formatted table
-      --fmt TEXT                  Table format - one of asciidoc, double_grid,
-                                  double_outline, fancy_grid, fancy_outline, github,
-                                  grid, heavy_grid, heavy_outline, html, jira,
-                                  latex, latex_booktabs, latex_longtable, latex_raw,
-                                  mediawiki, mixed_grid, mixed_outline, moinmoin,
-                                  orgtbl, outline, pipe, plain, presto, pretty,
-                                  psql, rounded_grid, rounded_outline, rst, simple,
-                                  simple_grid, simple_outline, textile, tsv,
-                                  unsafehtml, youtrack
+      --fmt TEXT                  Table format - one of asciidoc, colon_grid,
+                                  double_grid, double_outline, fancy_grid,
+                                  fancy_outline, github, grid, heavy_grid,
+                                  heavy_outline, html, jira, latex, latex_booktabs,
+                                  latex_longtable, latex_raw, mediawiki, mixed_grid,
+                                  mixed_outline, moinmoin, orgtbl, outline, pipe,
+                                  plain, presto, pretty, psql, rounded_grid,
+                                  rounded_outline, rst, simple, simple_grid,
+                                  simple_outline, textile, tsv, unsafehtml, youtrack
       --json-cols                 Detect JSON cols and output them as JSON, not
                                   escaped strings
       -r, --raw                   Raw output, first column of first row
@@ -285,7 +286,8 @@ See :ref:`cli_inserting_data`, :ref:`cli_insert_csv_tsv`, :ref:`cli_insert_unstr
       --alter                   Alter existing table to add any missing columns
       --not-null TEXT           Columns that should be created as NOT NULL
       --default <TEXT TEXT>...  Default value that should be set for a column
-      -d, --detect-types        Detect types for columns in CSV/TSV data
+      -d, --detect-types        Detect types for columns in CSV/TSV data (default)
+      --no-detect-types         Treat all CSV/TSV columns as TEXT
       --analyze                 Run ANALYZE at the end of this operation
       --load-extension TEXT     Path to SQLite extension, with optional :entrypoint
       --silent                  Do not show progress bar
@@ -342,7 +344,8 @@ See :ref:`cli_upsert`.
       --alter                   Alter existing table to add any missing columns
       --not-null TEXT           Columns that should be created as NOT NULL
       --default <TEXT TEXT>...  Default value that should be set for a column
-      -d, --detect-types        Detect types for columns in CSV/TSV data
+      -d, --detect-types        Detect types for columns in CSV/TSV data (default)
+      --no-detect-types         Treat all CSV/TSV columns as TEXT
       --analyze                 Run ANALYZE at the end of this operation
       --load-extension TEXT     Path to SQLite extension, with optional :entrypoint
       --silent                  Do not show progress bar
@@ -374,7 +377,7 @@ See :ref:`cli_bulk`.
 
     Options:
       --batch-size INTEGER   Commit every X records
-      --functions TEXT       Python code defining one or more custom SQL functions
+      --functions TEXT       Python code or file path defining custom SQL functions
       --flatten              Flatten nested JSON objects, so {"a": {"b": 1}} becomes
                              {"a_b": 1}
       --nl                   Expect newline-delimited JSON
@@ -423,14 +426,15 @@ See :ref:`cli_search`.
       --tsv                  Output TSV
       --no-headers           Omit CSV headers
       -t, --table            Output as a formatted table
-      --fmt TEXT             Table format - one of asciidoc, double_grid,
-                             double_outline, fancy_grid, fancy_outline, github,
-                             grid, heavy_grid, heavy_outline, html, jira, latex,
-                             latex_booktabs, latex_longtable, latex_raw, mediawiki,
-                             mixed_grid, mixed_outline, moinmoin, orgtbl, outline,
-                             pipe, plain, presto, pretty, psql, rounded_grid,
-                             rounded_outline, rst, simple, simple_grid,
-                             simple_outline, textile, tsv, unsafehtml, youtrack
+      --fmt TEXT             Table format - one of asciidoc, colon_grid,
+                             double_grid, double_outline, fancy_grid, fancy_outline,
+                             github, grid, heavy_grid, heavy_outline, html, jira,
+                             latex, latex_booktabs, latex_longtable, latex_raw,
+                             mediawiki, mixed_grid, mixed_outline, moinmoin, orgtbl,
+                             outline, pipe, plain, presto, pretty, psql,
+                             rounded_grid, rounded_outline, rst, simple,
+                             simple_grid, simple_outline, textile, tsv, unsafehtml,
+                             youtrack
       --json-cols            Detect JSON cols and output them as JSON, not escaped
                              strings
       --load-extension TEXT  Path to SQLite extension, with optional :entrypoint
@@ -457,8 +461,8 @@ See :ref:`cli_transform_table`.
               --rename column2 column_renamed
 
     Options:
-      --type <TEXT CHOICE>...         Change column type to INTEGER, TEXT, FLOAT or
-                                      BLOB
+      --type <TEXT CHOICE>...         Change column type to INTEGER, TEXT, FLOAT,
+                                      REAL or BLOB
       --drop TEXT                     Drop this column
       --rename <TEXT TEXT>...         Rename this column to X
       -o, --column-order TEXT         Reorder columns
@@ -613,11 +617,13 @@ See :ref:`cli_convert`.
 
       The following common operations are available as recipe functions:
 
-      r.jsonsplit(value, delimiter=',', type=<class 'str'>)
+      r.jsonsplit(value: 'str', delimiter: 'str' = ',', type: 'Callable[[str],
+      object]' = <class 'str'>) -> 'str'
 
       Convert a string like a,b,c into a JSON array ["a", "b", "c"]
 
-      r.parsedate(value, dayfirst=False, yearfirst=False, errors=None)
+      r.parsedate(value: 'str', dayfirst: 'bool' = False, yearfirst: 'bool' = False,
+      errors: 'Optional[object]' = None) -> 'Optional[str]'
 
       Parse a date and convert it to ISO date format: yyyy-mm-dd
   
@@ -626,7 +632,8 @@ See :ref:`cli_convert`.
       - errors=r.IGNORE to ignore values that cannot be parsed
       - errors=r.SET_NULL to set values that cannot be parsed to null
 
-      r.parsedatetime(value, dayfirst=False, yearfirst=False, errors=None)
+      r.parsedatetime(value: 'str', dayfirst: 'bool' = False, yearfirst: 'bool' =
+      False, errors: 'Optional[object]' = None) -> 'Optional[str]'
 
       Parse a datetime and convert it to ISO datetime format: yyyy-mm-ddTHH:MM:SS
   
@@ -653,7 +660,6 @@ See :ref:`cli_convert`.
       --output-type [integer|float|blob|text]
                                       Column type to use for the output column
       --drop                          Drop original column afterwards
-      --no-skip-false                 Don't skip falsey values
       -s, --silent                    Don't show a progress bar
       --pdb                           Open pdb debugger on first error
       -h, --help                      Show this message and exit.
@@ -686,14 +692,15 @@ See :ref:`cli_tables`.
       --tsv                  Output TSV
       --no-headers           Omit CSV headers
       -t, --table            Output as a formatted table
-      --fmt TEXT             Table format - one of asciidoc, double_grid,
-                             double_outline, fancy_grid, fancy_outline, github,
-                             grid, heavy_grid, heavy_outline, html, jira, latex,
-                             latex_booktabs, latex_longtable, latex_raw, mediawiki,
-                             mixed_grid, mixed_outline, moinmoin, orgtbl, outline,
-                             pipe, plain, presto, pretty, psql, rounded_grid,
-                             rounded_outline, rst, simple, simple_grid,
-                             simple_outline, textile, tsv, unsafehtml, youtrack
+      --fmt TEXT             Table format - one of asciidoc, colon_grid,
+                             double_grid, double_outline, fancy_grid, fancy_outline,
+                             github, grid, heavy_grid, heavy_outline, html, jira,
+                             latex, latex_booktabs, latex_longtable, latex_raw,
+                             mediawiki, mixed_grid, mixed_outline, moinmoin, orgtbl,
+                             outline, pipe, plain, presto, pretty, psql,
+                             rounded_grid, rounded_outline, rst, simple,
+                             simple_grid, simple_outline, textile, tsv, unsafehtml,
+                             youtrack
       --json-cols            Detect JSON cols and output them as JSON, not escaped
                              strings
       --columns              Include list of columns for each table
@@ -727,14 +734,15 @@ See :ref:`cli_views`.
       --tsv                  Output TSV
       --no-headers           Omit CSV headers
       -t, --table            Output as a formatted table
-      --fmt TEXT             Table format - one of asciidoc, double_grid,
-                             double_outline, fancy_grid, fancy_outline, github,
-                             grid, heavy_grid, heavy_outline, html, jira, latex,
-                             latex_booktabs, latex_longtable, latex_raw, mediawiki,
-                             mixed_grid, mixed_outline, moinmoin, orgtbl, outline,
-                             pipe, plain, presto, pretty, psql, rounded_grid,
-                             rounded_outline, rst, simple, simple_grid,
-                             simple_outline, textile, tsv, unsafehtml, youtrack
+      --fmt TEXT             Table format - one of asciidoc, colon_grid,
+                             double_grid, double_outline, fancy_grid, fancy_outline,
+                             github, grid, heavy_grid, heavy_outline, html, jira,
+                             latex, latex_booktabs, latex_longtable, latex_raw,
+                             mediawiki, mixed_grid, mixed_outline, moinmoin, orgtbl,
+                             outline, pipe, plain, presto, pretty, psql,
+                             rounded_grid, rounded_outline, rst, simple,
+                             simple_grid, simple_outline, textile, tsv, unsafehtml,
+                             youtrack
       --json-cols            Detect JSON cols and output them as JSON, not escaped
                              strings
       --columns              Include list of columns for each view
@@ -773,15 +781,15 @@ See :ref:`cli_rows`.
       --tsv                       Output TSV
       --no-headers                Omit CSV headers
       -t, --table                 Output as a formatted table
-      --fmt TEXT                  Table format - one of asciidoc, double_grid,
-                                  double_outline, fancy_grid, fancy_outline, github,
-                                  grid, heavy_grid, heavy_outline, html, jira,
-                                  latex, latex_booktabs, latex_longtable, latex_raw,
-                                  mediawiki, mixed_grid, mixed_outline, moinmoin,
-                                  orgtbl, outline, pipe, plain, presto, pretty,
-                                  psql, rounded_grid, rounded_outline, rst, simple,
-                                  simple_grid, simple_outline, textile, tsv,
-                                  unsafehtml, youtrack
+      --fmt TEXT                  Table format - one of asciidoc, colon_grid,
+                                  double_grid, double_outline, fancy_grid,
+                                  fancy_outline, github, grid, heavy_grid,
+                                  heavy_outline, html, jira, latex, latex_booktabs,
+                                  latex_longtable, latex_raw, mediawiki, mixed_grid,
+                                  mixed_outline, moinmoin, orgtbl, outline, pipe,
+                                  plain, presto, pretty, psql, rounded_grid,
+                                  rounded_outline, rst, simple, simple_grid,
+                                  simple_outline, textile, tsv, unsafehtml, youtrack
       --json-cols                 Detect JSON cols and output them as JSON, not
                                   escaped strings
       --load-extension TEXT       Path to SQLite extension, with optional
@@ -813,14 +821,15 @@ See :ref:`cli_triggers`.
       --tsv                  Output TSV
       --no-headers           Omit CSV headers
       -t, --table            Output as a formatted table
-      --fmt TEXT             Table format - one of asciidoc, double_grid,
-                             double_outline, fancy_grid, fancy_outline, github,
-                             grid, heavy_grid, heavy_outline, html, jira, latex,
-                             latex_booktabs, latex_longtable, latex_raw, mediawiki,
-                             mixed_grid, mixed_outline, moinmoin, orgtbl, outline,
-                             pipe, plain, presto, pretty, psql, rounded_grid,
-                             rounded_outline, rst, simple, simple_grid,
-                             simple_outline, textile, tsv, unsafehtml, youtrack
+      --fmt TEXT             Table format - one of asciidoc, colon_grid,
+                             double_grid, double_outline, fancy_grid, fancy_outline,
+                             github, grid, heavy_grid, heavy_outline, html, jira,
+                             latex, latex_booktabs, latex_longtable, latex_raw,
+                             mediawiki, mixed_grid, mixed_outline, moinmoin, orgtbl,
+                             outline, pipe, plain, presto, pretty, psql,
+                             rounded_grid, rounded_outline, rst, simple,
+                             simple_grid, simple_outline, textile, tsv, unsafehtml,
+                             youtrack
       --json-cols            Detect JSON cols and output them as JSON, not escaped
                              strings
       --load-extension TEXT  Path to SQLite extension, with optional :entrypoint
@@ -852,14 +861,15 @@ See :ref:`cli_indexes`.
       --tsv                  Output TSV
       --no-headers           Omit CSV headers
       -t, --table            Output as a formatted table
-      --fmt TEXT             Table format - one of asciidoc, double_grid,
-                             double_outline, fancy_grid, fancy_outline, github,
-                             grid, heavy_grid, heavy_outline, html, jira, latex,
-                             latex_booktabs, latex_longtable, latex_raw, mediawiki,
-                             mixed_grid, mixed_outline, moinmoin, orgtbl, outline,
-                             pipe, plain, presto, pretty, psql, rounded_grid,
-                             rounded_outline, rst, simple, simple_grid,
-                             simple_outline, textile, tsv, unsafehtml, youtrack
+      --fmt TEXT             Table format - one of asciidoc, colon_grid,
+                             double_grid, double_outline, fancy_grid, fancy_outline,
+                             github, grid, heavy_grid, heavy_outline, html, jira,
+                             latex, latex_booktabs, latex_longtable, latex_raw,
+                             mediawiki, mixed_grid, mixed_outline, moinmoin, orgtbl,
+                             outline, pipe, plain, presto, pretty, psql,
+                             rounded_grid, rounded_outline, rst, simple,
+                             simple_grid, simple_outline, textile, tsv, unsafehtml,
+                             youtrack
       --json-cols            Detect JSON cols and output them as JSON, not escaped
                              strings
       --load-extension TEXT  Path to SQLite extension, with optional :entrypoint
@@ -956,6 +966,44 @@ See :ref:`cli_create_index`.
       -h, --help                 Show this message and exit.
 
 
+.. _cli_ref_migrate:
+
+migrate
+=======
+
+See :ref:`cli_migrate`.
+
+::
+
+    Usage: sqlite-utils migrate [OPTIONS] DB_PATH [MIGRATIONS]...
+
+      Apply pending database migrations.
+
+      Usage:
+
+          sqlite-utils migrate database.db
+
+      This will find the migrations.py file in the current directory or
+      subdirectories and apply any pending migrations.
+
+      Or pass paths to one or more migrations.py files directly:
+
+          sqlite-utils migrate database.db path/to/migrations.py
+
+      Pass --list to see a list of applied and pending migrations without applying
+      them.
+
+      Use --stop-before migration_set:name to stop before a migration. This option
+      can be used multiple times.
+
+    Options:
+      --stop-before TEXT  Stop before applying this migration. Use set:name to
+                          target a migration set.
+      --list              List migrations without running them
+      -v, --verbose       Show verbose output
+      -h, --help          Show this message and exit.
+
+
 .. _cli_ref_enable_fts:
 
 enable-fts
@@ -1143,7 +1191,7 @@ See :ref:`cli_add_column`.
 ::
 
     Usage: sqlite-utils add-column [OPTIONS] PATH TABLE COL_NAME
-                          [[integer|int|float|text|str|blob|bytes]]
+                          [[integer|int|float|real|text|str|blob|bytes]]
 
       Add a column to the specified table
 
@@ -1479,7 +1527,7 @@ See :ref:`cli_spatialite`.
       paths. To load it from a specific path, use --load-extension.
 
     Options:
-      -t, --type [POINT|LINESTRING|POLYGON|MULTIPOINT|MULTILINESTRING|MULTIPOLYGON|GEOMETRYCOLLECTION|GEOMETRY]
+      -t, --type [point|linestring|polygon|multipoint|multilinestring|multipolygon|geometrycollection|geometry]
                                       Specify a geometry type for this column.
                                       [default: GEOMETRY]
       --srid INTEGER                  Spatial Reference ID. See