exwiw 0.9.15 → 0.9.17

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 471697b8003fdbb3178382139b96d1954e4610691e1086d1336169cc5f26e572
-  data.tar.gz: afd836794750c8ebd6b137f0067b386e8558a43b0c05f29df461e4e565257d11
+  metadata.gz: b4e2f7c1a407de6ba1787a074b477f15c2d52844db280ab3b46a7ea0ff53307d
+  data.tar.gz: eb16c182003ff444a9dcb0c50bdeb01b0d0c64d030e3a604cea97b4391eb9749
 SHA512:
-  metadata.gz: 9be9e481528119cacda6da2cd7be4379803c8be4fc03c49e9361d07f578f7e70ea6b5dab6c639c2acde2d63ec23933ba8e40e6ac60cddd2063db56ff7876aafe
-  data.tar.gz: 5e40c552665e7a4b24e4729c8b4e6abb5d0dcefd52b61baf42e747a93b46e6268c09db53f70b4f45b60d63e451bb0a4588a3968b1bef02181e2544c7d8c3c1b0
+  metadata.gz: 05b71a92ba8a702f8651812bf38b1eef09c65ff4d39c020e571ad8b9f999ffc6ee003dbd16db933355337fc4e497092f3a0272c885ebc401300b353a83bdf412
+  data.tar.gz: 26fcf8c9aa7047ca99a2a89d259be9c894ea3d8a072f0fe2fd5e3387a24e4206a3187f7a4bb921b0482669804997d1138db7239f9a80e10de5f8b1b8116b3cd1

data/CHANGELOG.md

@@ -2,6 +2,18 @@
 
 ## [Unreleased]
 
+## [0.9.17] - 2026-08-03
+
+### Fixed
+
+- **mysql: `insert-000-schema.sql` no longer carries the source server's `DEFINER=` clauses, so a restore into MySQL 8.2+ / 8.4 succeeds without the `SET_ANY_DEFINER` privilege.** `mysqldump` stamps every view and trigger with the account that owns it on the source (e.g. `/*!50013 DEFINER=user@host SQL SECURITY DEFINER */`). From MySQL 8.2, creating a stored object owned by another account needs `SET_ANY_DEFINER` — a privilege managed MySQL (RDS / Cloud SQL) does not grant — so the restore aborted, and a definer account absent on the target left an orphan object that broke later `CREATE USER` / `DROP USER`. A new `DdlPostprocessor.strip_definer_clauses` pass removes the clause (only from the version-gated comment `mysqldump` wraps it in, so a literal `DEFINER=` inside a trigger body or column `COMMENT` is untouched), so each object is created owned by the restoring account — MySQL's default when the clause is omitted. `SQL SECURITY DEFINER` / `INVOKER` is preserved as written; postgresql/sqlite are unaffected. Output for a database with no views or triggers is byte-identical. Note: a schema containing views or triggers is still not *re*-appliable (`--skip-add-drop-table` suppresses the `DROP` that would make it so) — tracked separately.
+
+## [0.9.16] - 2026-07-31
+
+### Fixed
+
+- **MongoDB: a collection whose genuine (target-reachable) parents captured no ids now matches nothing instead of falling back to reference-parent constraints.** When the dump target legitimately owns no rows in a scoping chain (e.g. a just-created tenant with no rows in the anchor collection), the previous strict-AND fallback over reference parents — master data dumped in full — degenerated into a near-full-collection query: at best dumping cross-scope rows, at worst timing out or exceeding the BSON size limit on a large collection. Collections with no genuine parent at all (reachable only via reference data) keep the historical fallback.
+
 ## [0.9.15] - 2026-07-31
 
 ### Fixed

data/README.md

@@ -106,7 +106,7 @@ The output dir is emptied before each export so it never mixes files from a prev
 idx means the order of the dump. bigger idx might depend on smaller idx,
 so you should import the dump in order.
 
-`insert-000-schema.sql` is generated by shelling out to the database client tools (`mysqldump` for `mysql`, `pg_dump` for `postgresql`, and the sqlite3 driver for `sqlite`), so the corresponding client must be available on PATH when running exwiw. For `mysql`, set `EXWIW_MYSQLDUMP` to point at a specific `mysqldump` binary when the one on PATH is incompatible with the server (e.g. a MySQL 9.x `mysqldump` cannot load `mysql_native_password` against a server still using that auth plugin — `EXWIW_MYSQLDUMP=/path/to/mysql@8.0/bin/mysqldump`). The output is post-processed to make it idempotent: `CREATE TABLE IF NOT EXISTS`, `CREATE INDEX IF NOT EXISTS` (where the engine supports it), and PostgreSQL's `ALTER TABLE ... ADD CONSTRAINT` statements are wrapped in `DO $$ ... EXCEPTION WHEN duplicate_object`.
+`insert-000-schema.sql` is generated by shelling out to the database client tools (`mysqldump` for `mysql`, `pg_dump` for `postgresql`, and the sqlite3 driver for `sqlite`), so the corresponding client must be available on PATH when running exwiw. For `mysql`, set `EXWIW_MYSQLDUMP` to point at a specific `mysqldump` binary when the one on PATH is incompatible with the server (e.g. a MySQL 9.x `mysqldump` cannot load `mysql_native_password` against a server still using that auth plugin — `EXWIW_MYSQLDUMP=/path/to/mysql@8.0/bin/mysqldump`). The output is post-processed to make it idempotent: `CREATE TABLE IF NOT EXISTS`, `CREATE INDEX IF NOT EXISTS` (where the engine supports it), and PostgreSQL's `ALTER TABLE ... ADD CONSTRAINT` statements are wrapped in `DO $$ ... EXCEPTION WHEN duplicate_object`. For `mysql`, the source server's `DEFINER=user@host` stamp on views and triggers is stripped too, so restoring into a managed MySQL instance (which usually can't grant the privilege to recreate someone else's `DEFINER`) does not fail.
 
 you need to delete the records before importing the dump,
 `delete-{idx}-{table_name}.sql` will help you to do that.

data/lib/exwiw/adapter/mongodb_adapter.rb

@@ -476,9 +476,13 @@ module Exwiw
       #   has a genuine parent to anchor on, reference-parent constraints are
       #   dropped entirely.
       #
-      # When NO genuine parent produced ids, the collection is not reachable from
-      # the dump target; fall back to the historical strict-AND of whatever
-      # constraints exist (bounded, preserves prior behavior).
+      # - When the collection DECLARES a genuine parent but none captured any id
+      #   (the dump target legitimately owns no such rows — e.g. a tenant created
+      #   moments ago), it matches nothing: reference-parent constraints do not
+      #   narrow to the target, so falling back to them degenerates into a
+      #   near-full-collection query. Only a collection with NO genuine parent at
+      #   all (reachable only via reference data) keeps the historical strict-AND
+      #   fallback.
       #
       # A belongs_to whose parent produced no ids contributes no constraint: either
       # the parent matched nothing, or it is not dumped here (e.g. an embedded
@@ -520,6 +524,16 @@ module Exwiw
           target << [relation.foreign_key, values]
         end
 
+        if genuine_clauses.empty? && reference_clauses.any? && config.belongs_tos.any? { |r| genuine.include?(r.table_name) }
+          @logger.warn(
+            "  Collection '#{config.name}' is scoped by genuine parent(s) that captured no ids " \
+            "for this dump target; constraining it to match no rows instead of falling back to " \
+            "reference-parent constraints (which do not narrow to the target and can devolve " \
+            "into a full-collection scan)."
+          )
+          return { config.primary_key => { "$in" => [] } }
+        end
+
         filter =
           if genuine_clauses.any?
             anchor_index = (0...genuine_clauses.size).min_by { |i| genuine_clauses[i][1].size }

data/lib/exwiw/adapter/mysql_adapter.rb

@@ -136,7 +136,8 @@ module Exwiw
           raise "mysqldump failed (exit #{status.exitstatus}): #{stderr}"
         end
 
-        idempotent = DdlPostprocessor.add_if_not_exists_to_create_table(stdout)
+        idempotent = DdlPostprocessor.strip_definer_clauses(stdout)
+        idempotent = DdlPostprocessor.add_if_not_exists_to_create_table(idempotent)
 
         File.open(output_path, 'w') do |file|
           file.puts("-- Auto-generated by exwiw via mysqldump. Idempotent CREATE TABLE statements for mysql.")

data/lib/exwiw/ddl_postprocessor.rb

@@ -64,6 +64,44 @@ module Exwiw
       sql.gsub(/^[ \t]*CREATE\s+(?:OR\s+REPLACE\s+)?(?:CONSTRAINT\s+)?TRIGGER\b[^;]*;\r?\n?/i, "")
     end
 
+    # A user@host pair as mysqldump writes it. Each side is independently a
+    # backtick-quoted identifier (doubled backticks escape), a single- or
+    # double-quoted string, or a bare word (`root@localhost`). A definer may
+    # also be CURRENT_USER / CURRENT_USER(), which has no @host.
+    DEFINER_ACCOUNT_PART =
+      /(?:`(?:[^`]|``)*`|'(?:[^']|'')*'|"(?:[^"]|"")*"|[A-Za-z0-9_$.%\-]+)/.freeze
+
+    DEFINER_CLAUSE =
+      /DEFINER[ \t]*=[ \t]*
+       (?:CURRENT_USER(?:[ \t]*\([ \t]*\))?
+         |#{DEFINER_ACCOUNT_PART}(?:@#{DEFINER_ACCOUNT_PART})?)/xi.freeze
+
+    # mysqldump wraps every view/trigger/routine/event DEFINER in a versioned
+    # comment, e.g. `/*!50013 DEFINER=`u`@`h` SQL SECURITY DEFINER */` or the
+    # trigger form `/*!50017 DEFINER=`u`@`h`*/`. From MySQL 8.2, creating a
+    # stored object owned by another account needs SET_ANY_DEFINER, which
+    # managed MySQL (RDS / Cloud SQL) does not grant, and a nonexistent
+    # definer leaves an orphan object that later breaks CREATE USER / DROP
+    # USER. Omitting the clause defaults the definer to CURRENT_USER (the
+    # restoring account), sidestepping both.
+    #
+    # Anchoring on the versioned comment, rather than gsubbing DEFINER=
+    # anywhere, keeps this from touching a literal "DEFINER=" inside a
+    # trigger body string or a column COMMENT. SQL SECURITY DEFINER|INVOKER
+    # is preserved — it governs runtime privileges, not who the definer is.
+    DEFINER_COMMENT_RE =
+      %r{/\*!(?<ver>\d{5})[ \t]+#{DEFINER_CLAUSE}[ \t]*
+         (?<rest>(?:(?!\*/).)*?)[ \t]*\*/(?<trail>[ \t]*)}xi.freeze
+
+    def strip_definer_clauses(sql)
+      sql.gsub(DEFINER_COMMENT_RE) do
+        m = Regexp.last_match
+        # Drop the comment whole if DEFINER was its only content (trigger
+        # form); otherwise keep the surviving content (e.g. SQL SECURITY).
+        m[:rest].empty? ? "" : "/*!#{m[:ver]} #{m[:rest]} */#{m[:trail]}"
+      end
+    end
+
     # A bare `CREATE TYPE ... AS ENUM (...)` (as a full-database pg_dump emits,
     # unlike a `--table` dump, which omits enum types) is not idempotent: a
     # second restore raises `duplicate_object`. Wrap each in a DO block that

data/lib/exwiw/version.rb

@@ -1,5 +1,5 @@
 # frozen_string_literal: true
 
 module Exwiw
-  VERSION = "0.9.15"
+  VERSION = "0.9.17"
 end

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: exwiw
 version: !ruby/object:Gem::Version
-  version: 0.9.15
+  version: 0.9.17
 platform: ruby
 authors:
 - Shia