@pgpmjs/export 0.1.0

package/LICENSE

@@ -0,0 +1,23 @@
+The MIT License (MIT)
+
+Copyright (c) 2025 Dan Lynch <pyramation@gmail.com>
+Copyright (c) 2025 Constructive <developers@constructive.io>
+Copyright (c) 2020-present, Interweb, Inc.
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/README.md

@@ -0,0 +1,86 @@
+# @pgpmjs/export
+
+<p align="center" width="100%">
+  <img height="250" src="https://raw.githubusercontent.com/constructive-io/constructive/refs/heads/main/assets/outline-logo.svg" />
+</p>
+
+<p align="center" width="100%">
+  <a href="https://github.com/constructive-io/constructive/actions/workflows/run-tests.yaml">
+    <img height="20" src="https://github.com/constructive-io/constructive/actions/workflows/run-tests.yaml/badge.svg" />
+  </a>
+   <a href="https://github.com/constructive-io/constructive/blob/main/LICENSE"><img height="20" src="https://img.shields.io/badge/license-MIT-blue.svg"/></a>
+   <a href="https://www.npmjs.com/package/@pgpmjs/export"><img height="20" src="https://img.shields.io/github/package-json/v/constructive-io/constructive?filename=pgpm%2Fexport%2Fpackage.json"/></a>
+</p>
+
+Export tools for extracting database migrations from existing PostgreSQL databases. Supports both direct SQL queries and GraphQL-based data fetching.
+
+## Features
+
+- **SQL Export** — Extract migrations directly from a PostgreSQL database via `pg` queries
+- **GraphQL Export** — Extract migrations via a PostGraphile GraphQL endpoint
+- **Cross-flow parity** — Both flows produce identical output for the same source data
+- **Metadata export** — Export metaschema, services, and module metadata tables
+
+## Usage
+
+```typescript
+import { exportMigrations, exportGraphQL, GraphQLClient } from '@pgpmjs/export';
+```
+
+---
+
+## Education and Tutorials
+
+ 1. 🚀 [Quickstart: Getting Up and Running](https://constructive.io/learn/quickstart)
+Get started with modular databases in minutes. Install prerequisites and deploy your first module.
+
+ 2. 📦 [Modular PostgreSQL Development with Database Packages](https://constructive.io/learn/modular-postgres)
+Learn to organize PostgreSQL projects with pgpm workspaces and reusable database modules.
+
+ 3. ✏️ [Authoring Database Changes](https://constructive.io/learn/authoring-database-changes)
+Master the workflow for adding, organizing, and managing database changes with pgpm.
+
+ 4. 🧪 [End-to-End PostgreSQL Testing with TypeScript](https://constructive.io/learn/e2e-postgres-testing)
+Master end-to-end PostgreSQL testing with ephemeral databases, RLS testing, and CI/CD automation.
+
+ 5. ⚡ [Supabase Testing](https://constructive.io/learn/supabase)
+Use TypeScript-first tools to test Supabase projects with realistic RLS, policies, and auth contexts.
+
+ 6. 💧 [Drizzle ORM Testing](https://constructive.io/learn/drizzle-testing)
+Run full-stack tests with Drizzle ORM, including database setup, teardown, and RLS enforcement.
+
+ 7. 🔧 [Troubleshooting](https://constructive.io/learn/troubleshooting)
+Common issues and solutions for pgpm, PostgreSQL, and testing.
+
+## Related Constructive Tooling
+
+### 📦 Package Management
+
+* [pgpm](https://github.com/constructive-io/constructive/tree/main/pgpm/pgpm): **🖥️ PostgreSQL Package Manager** for modular Postgres development. Works with database workspaces, scaffolding, migrations, seeding, and installing database packages.
+
+### 🧪 Testing
+
+* [pgsql-test](https://github.com/constructive-io/constructive/tree/main/postgres/pgsql-test): **📊 Isolated testing environments** with per-test transaction rollbacks—ideal for integration tests, complex migrations, and RLS simulation.
+* [pgsql-seed](https://github.com/constructive-io/constructive/tree/main/postgres/pgsql-seed): **🌱 PostgreSQL seeding utilities** for CSV, JSON, SQL data loading, and pgpm deployment.
+* [supabase-test](https://github.com/constructive-io/constructive/tree/main/postgres/supabase-test): **🧪 Supabase-native test harness** preconfigured for the local Supabase stack—per-test rollbacks, JWT/role context helpers, and CI/GitHub Actions ready.
+* [graphile-test](https://github.com/constructive-io/constructive/tree/main/graphile/graphile-test): **🔐 Authentication mocking** for Graphile-focused test helpers and emulating row-level security contexts.
+* [pg-query-context](https://github.com/constructive-io/constructive/tree/main/postgres/pg-query-context): **🔒 Session context injection** to add session-local context (e.g., `SET LOCAL`) into queries—ideal for setting `role`, `jwt.claims`, and other session settings.
+
+### 🧠 Parsing & AST
+
+* [pgsql-parser](https://www.npmjs.com/package/pgsql-parser): **🔄 SQL conversion engine** that interprets and converts PostgreSQL syntax.
+* [libpg-query-node](https://www.npmjs.com/package/libpg-query): **🌉 Node.js bindings** for `libpg_query`, converting SQL into parse trees.
+* [pg-proto-parser](https://www.npmjs.com/package/pg-proto-parser): **📦 Protobuf parser** for parsing PostgreSQL Protocol Buffers definitions to generate TypeScript interfaces, utility functions, and JSON mappings for enums.
+* [@pgsql/enums](https://www.npmjs.com/package/@pgsql/enums): **🏷️ TypeScript enums** for PostgreSQL AST for safe and ergonomic parsing logic.
+* [@pgsql/types](https://www.npmjs.com/package/@pgsql/types): **📝 Type definitions** for PostgreSQL AST nodes in TypeScript.
+* [@pgsql/utils](https://www.npmjs.com/package/@pgsql/utils): **🛠️ AST utilities** for constructing and transforming PostgreSQL syntax trees.
+
+## Credits
+
+**🛠 Built by the [Constructive](https://constructive.io) team — creators of modular Postgres tooling for secure, composable backends. If you like our work, contribute on [GitHub](https://github.com/constructive-io).**
+
+## Disclaimer
+
+AS DESCRIBED IN THE LICENSES, THE SOFTWARE IS PROVIDED "AS IS", AT YOUR OWN RISK, AND WITHOUT WARRANTIES OF ANY KIND.
+
+No developer or entity involved in creating this software will be liable for any claims or damages whatsoever associated with your use, inability to use, or your interaction with other users of the code, including any direct, indirect, incidental, special, exemplary, punitive or consequential damages, or loss of profits, cryptocurrencies, tokens, or anything else of value.

package/esm/export-graphql-meta.js

@@ -0,0 +1,151 @@
+/**
+ * GraphQL equivalent of export-meta.ts.
+ *
+ * Fetches metadata from metaschema_public, services_public, and metaschema_modules_public
+ * via GraphQL queries instead of direct SQL, then uses the same csv-to-pg Parser to
+ * generate SQL INSERT statements.
+ */
+import { Parser } from 'csv-to-pg';
+import { META_TABLE_CONFIG } from './export-utils';
+import { buildFieldsFragment, getGraphQLQueryName, graphqlRowToPostgresRow, intervalToPostgres } from './graphql-naming';
+/**
+ * Fetch metadata via GraphQL and generate SQL INSERT statements.
+ * This is the GraphQL equivalent of exportMeta() in export-meta.ts.
+ */
+export const exportGraphQLMeta = async ({ client, database_id }) => {
+    const sql = {};
+    const queryAndParse = async (key) => {
+        const tableConfig = META_TABLE_CONFIG[key];
+        if (!tableConfig)
+            return;
+        const pgFieldNames = Object.keys(tableConfig.fields);
+        const graphqlFieldsFragment = buildFieldsFragment(pgFieldNames, tableConfig.fields);
+        const graphqlQueryName = getGraphQLQueryName(tableConfig.table);
+        // The 'database' table is fetched by id, not by database_id
+        const condition = key === 'database'
+            ? { id: database_id }
+            : { databaseId: database_id };
+        try {
+            const rows = await client.fetchAllNodes(graphqlQueryName, graphqlFieldsFragment, condition);
+            if (rows.length > 0) {
+                // Convert camelCase GraphQL keys back to snake_case for the Parser
+                // Also convert interval objects back to Postgres interval strings
+                const pgRows = rows.map(row => {
+                    const pgRow = graphqlRowToPostgresRow(row);
+                    // Convert any interval fields from {seconds, minutes, ...} objects to strings
+                    for (const [fieldName, fieldType] of Object.entries(tableConfig.fields)) {
+                        if (fieldType === 'interval' && pgRow[fieldName] && typeof pgRow[fieldName] === 'object') {
+                            pgRow[fieldName] = intervalToPostgres(pgRow[fieldName]);
+                        }
+                    }
+                    return pgRow;
+                });
+                // Filter fields to only those that exist in the returned data
+                // This mirrors the dynamic field building in the SQL version
+                const returnedKeys = new Set();
+                for (const row of pgRows) {
+                    for (const k of Object.keys(row)) {
+                        returnedKeys.add(k);
+                    }
+                }
+                const dynamicFields = {};
+                for (const [fieldName, fieldType] of Object.entries(tableConfig.fields)) {
+                    if (returnedKeys.has(fieldName)) {
+                        dynamicFields[fieldName] = fieldType;
+                    }
+                }
+                if (Object.keys(dynamicFields).length === 0)
+                    return;
+                const parser = new Parser({
+                    schema: tableConfig.schema,
+                    table: tableConfig.table,
+                    conflictDoNothing: tableConfig.conflictDoNothing,
+                    fields: dynamicFields
+                });
+                const parsed = await parser.parse(pgRows);
+                if (parsed) {
+                    sql[key] = parsed;
+                }
+            }
+        }
+        catch (err) {
+            // If the GraphQL query fails (e.g. table not exposed), skip silently
+            // similar to how the SQL version handles 42P01 (undefined_table)
+            const message = err instanceof Error ? err.message : String(err);
+            if (message.includes('Cannot query field') ||
+                message.includes('is not defined by type') ||
+                message.includes('Unknown field') ||
+                (message.includes('Field') && message.includes('not found'))) {
+                // Field/table not available in the GraphQL schema — skip
+                return;
+            }
+            throw err;
+        }
+    };
+    // Batch queries by schema group — independent HTTP requests run in parallel
+    // within each group for significant speedup over sequential awaits.
+    // metaschema_public tables
+    await Promise.all([
+        queryAndParse('database'),
+        queryAndParse('database_extension'),
+        queryAndParse('schema'),
+        queryAndParse('table'),
+        queryAndParse('field'),
+        queryAndParse('policy'),
+        queryAndParse('index'),
+        queryAndParse('trigger'),
+        queryAndParse('trigger_function'),
+        queryAndParse('rls_function'),
+        queryAndParse('foreign_key_constraint'),
+        queryAndParse('primary_key_constraint'),
+        queryAndParse('unique_constraint'),
+        queryAndParse('check_constraint'),
+        queryAndParse('full_text_search'),
+        queryAndParse('schema_grant'),
+        queryAndParse('table_grant'),
+        queryAndParse('default_privilege')
+    ]);
+    // services_public tables
+    await Promise.all([
+        queryAndParse('domains'),
+        queryAndParse('sites'),
+        queryAndParse('apis'),
+        queryAndParse('apps'),
+        queryAndParse('site_modules'),
+        queryAndParse('site_themes'),
+        queryAndParse('site_metadata'),
+        queryAndParse('api_modules'),
+        queryAndParse('api_extensions'),
+        queryAndParse('api_schemas')
+    ]);
+    // metaschema_modules_public tables
+    await Promise.all([
+        queryAndParse('rls_module'),
+        queryAndParse('user_auth_module'),
+        queryAndParse('memberships_module'),
+        queryAndParse('permissions_module'),
+        queryAndParse('limits_module'),
+        queryAndParse('levels_module'),
+        queryAndParse('users_module'),
+        queryAndParse('hierarchy_module'),
+        queryAndParse('membership_types_module'),
+        queryAndParse('invites_module'),
+        queryAndParse('emails_module'),
+        queryAndParse('sessions_module'),
+        queryAndParse('secrets_module'),
+        queryAndParse('profiles_module'),
+        queryAndParse('encrypted_secrets_module'),
+        queryAndParse('connected_accounts_module'),
+        queryAndParse('phone_numbers_module'),
+        queryAndParse('crypto_addresses_module'),
+        queryAndParse('crypto_auth_module'),
+        queryAndParse('field_module'),
+        queryAndParse('table_module'),
+        queryAndParse('table_template_module'),
+        queryAndParse('secure_table_provision'),
+        queryAndParse('uuid_module'),
+        queryAndParse('default_ids_module'),
+        queryAndParse('denormalized_table_field')
+    ]);
+    return sql;
+};

package/esm/export-graphql.js

@@ -0,0 +1,176 @@
+import { writePgpmFiles, writePgpmPlan } from '@pgpmjs/core';
+import { createClient } from '@pgpmjs/migrate-client';
+import { GraphQLClient } from './graphql-client';
+import { exportGraphQLMeta } from './export-graphql-meta';
+import { graphqlRowToPostgresRow } from './graphql-naming';
+import { DB_REQUIRED_EXTENSIONS, SERVICE_REQUIRED_EXTENSIONS, META_COMMON_HEADER, META_COMMON_FOOTER, META_TABLE_ORDER, detectMissingModules, installMissingModules, makeReplacer, preparePackage, normalizeOutdir } from './export-utils';
+export const exportGraphQL = async ({ project, metaEndpoint, migrateEndpoint, token, headers, migrateHeaders, databaseId, databaseName, schema_names, schemas, author, outdir, extensionName, extensionDesc, metaExtensionName, metaExtensionDesc, prompter, argv, repoName, username, serviceOutdir, skipSchemaRenaming = false }) => {
+    const normalizedOutdir = normalizeOutdir(outdir);
+    const svcOutdir = normalizeOutdir(serviceOutdir || outdir);
+    const name = extensionName;
+    const schemasForReplacement = skipSchemaRenaming
+        ? []
+        : schemas.filter((schema) => schema_names.includes(schema.schema_name));
+    const { replacer } = makeReplacer({
+        schemas: schemasForReplacement,
+        name
+    });
+    // =========================================================================
+    // 1. Fetch sql_actions via @pgpmjs/migrate-client ORM (db_migrate endpoint)
+    // =========================================================================
+    let sqlActionRows = [];
+    if (migrateEndpoint) {
+        console.log(`Fetching sql_actions from ${migrateEndpoint}...`);
+        const db = createClient({
+            endpoint: migrateEndpoint,
+            headers: {
+                ...(token ? { Authorization: `Bearer ${token}` } : {}),
+                ...migrateHeaders
+            }
+        });
+        try {
+            // Paginate through all sql_actions for this database using the ORM.
+            // The ORM generates `where: SqlActionFilter` which uses the filter plugin's
+            // `equalTo` operator — the correct approach for Constructive's PostGraphile APIs.
+            let hasNextPage = true;
+            let afterCursor;
+            const PAGE_SIZE = 100;
+            while (hasNextPage) {
+                const result = await db.sqlAction.findMany({
+                    select: {
+                        id: true,
+                        databaseId: true,
+                        name: true,
+                        deploy: true,
+                        revert: true,
+                        verify: true,
+                        content: true,
+                        deps: true,
+                        action: true,
+                        actionId: true,
+                        actorId: true,
+                        payload: true
+                    },
+                    where: {
+                        databaseId: { equalTo: databaseId }
+                    },
+                    orderBy: ['ID_ASC'],
+                    first: PAGE_SIZE,
+                    ...(afterCursor ? { after: afterCursor } : {})
+                }).unwrap();
+                const connection = result.sqlActions;
+                for (const node of connection.nodes) {
+                    sqlActionRows.push(graphqlRowToPostgresRow(node));
+                }
+                hasNextPage = connection.pageInfo?.hasNextPage ?? false;
+                afterCursor = connection.pageInfo?.endCursor ?? undefined;
+            }
+            console.log(`  Found ${sqlActionRows.length} sql_actions`);
+        }
+        catch (err) {
+            console.warn(`  Warning: Could not fetch sql_actions: ${err instanceof Error ? err.message : err}`);
+        }
+    }
+    else {
+        console.log('No migrate endpoint provided, skipping sql_actions export.');
+    }
+    const opts = {
+        name,
+        replacer,
+        outdir: normalizedOutdir,
+        author
+    };
+    const dbExtensionDesc = extensionDesc || `${name} database schema for ${databaseName}`;
+    if (sqlActionRows.length > 0) {
+        const dbMissingResult = await detectMissingModules(project, [...DB_REQUIRED_EXTENSIONS], prompter, argv);
+        const dbModuleDir = await preparePackage({
+            project,
+            author,
+            outdir: normalizedOutdir,
+            name,
+            description: dbExtensionDesc,
+            extensions: [...DB_REQUIRED_EXTENSIONS],
+            prompter,
+            repoName,
+            username
+        });
+        if (dbMissingResult.shouldInstall) {
+            await installMissingModules(dbModuleDir, dbMissingResult.missingModules);
+        }
+        writePgpmPlan(sqlActionRows, opts);
+        writePgpmFiles(sqlActionRows, opts);
+    }
+    else {
+        console.log('No sql_actions found. Skipping database module export.');
+    }
+    // =========================================================================
+    // 2. Fetch meta/services data via GraphQL
+    // =========================================================================
+    console.log(`Fetching metadata from ${metaEndpoint}...`);
+    const metaClient = new GraphQLClient({ endpoint: metaEndpoint, token, headers });
+    const metaResult = await exportGraphQLMeta({
+        client: metaClient,
+        database_id: databaseId
+    });
+    const metaTableCount = Object.keys(metaResult).length;
+    console.log(`  Fetched ${metaTableCount} meta tables with data`);
+    if (metaTableCount > 0) {
+        const metaDesc = metaExtensionDesc || `${metaExtensionName} service utilities for managing domains, APIs, and services`;
+        const svcMissingResult = await detectMissingModules(project, [...SERVICE_REQUIRED_EXTENSIONS], prompter, argv);
+        const svcModuleDir = await preparePackage({
+            project,
+            author,
+            outdir: svcOutdir,
+            name: metaExtensionName,
+            description: metaDesc,
+            extensions: [...SERVICE_REQUIRED_EXTENSIONS],
+            prompter,
+            repoName,
+            username
+        });
+        if (svcMissingResult.shouldInstall) {
+            await installMissingModules(svcModuleDir, svcMissingResult.missingModules);
+        }
+        const metaSchemasForReplacement = skipSchemaRenaming
+            ? []
+            : schemas.filter((schema) => schema_names.includes(schema.schema_name));
+        const metaReplacer = makeReplacer({
+            schemas: metaSchemasForReplacement,
+            name: metaExtensionName,
+            // Use extensionName for schema prefix — the services metadata references
+            // schemas owned by the application package (e.g. agent_db_auth_public),
+            // not the services package (agent_db_services_auth_public)
+            schemaPrefix: name
+        });
+        const metaPackage = [];
+        const tablesWithContent = [];
+        for (const tableName of META_TABLE_ORDER) {
+            const tableSql = metaResult[tableName];
+            if (tableSql) {
+                const replacedSql = metaReplacer.replacer(tableSql);
+                const deps = tableName === 'database'
+                    ? []
+                    : tablesWithContent.length > 0
+                        ? [`migrate/${tablesWithContent[tablesWithContent.length - 1]}`]
+                        : [];
+                metaPackage.push({
+                    deps,
+                    deploy: `migrate/${tableName}`,
+                    content: `${META_COMMON_HEADER}
+
+${replacedSql}
+
+${META_COMMON_FOOTER}
+`
+                });
+                tablesWithContent.push(tableName);
+            }
+        }
+        opts.replacer = metaReplacer.replacer;
+        opts.name = metaExtensionName;
+        opts.outdir = svcOutdir;
+        writePgpmPlan(metaPackage, opts);
+        writePgpmFiles(metaPackage, opts);
+    }
+    console.log('GraphQL export complete.');
+};

package/esm/export-meta.js

@@ -0,0 +1,162 @@
+import { Parser } from 'csv-to-pg';
+import { getPgPool } from 'pg-cache';
+import { META_TABLE_CONFIG } from './export-utils';
+/**
+ * Query actual columns from information_schema for a given table.
+ * Returns a map of column_name -> udt_name (PostgreSQL type).
+ */
+const getTableColumns = async (pool, schemaName, tableName) => {
+    const result = await pool.query(`
+    SELECT column_name, udt_name
+    FROM information_schema.columns
+    WHERE table_schema = $1 AND table_name = $2
+    ORDER BY ordinal_position
+  `, [schemaName, tableName]);
+    const columns = new Map();
+    for (const row of result.rows) {
+        columns.set(row.column_name, row.udt_name);
+    }
+    return columns;
+};
+/**
+ * Build dynamic fields config by intersecting the hardcoded config with actual database columns.
+ * - Only includes columns that exist in the database
+ * - Preserves special type hints from config (image, upload, url) for columns that exist
+ * - Infers types from PostgreSQL for columns not in config
+ */
+const buildDynamicFields = async (pool, tableConfig) => {
+    const actualColumns = await getTableColumns(pool, tableConfig.schema, tableConfig.table);
+    if (actualColumns.size === 0) {
+        // Table doesn't exist, return empty fields
+        return {};
+    }
+    const dynamicFields = {};
+    // For each column in the hardcoded config, check if it exists in the database
+    for (const [fieldName, fieldType] of Object.entries(tableConfig.fields)) {
+        if (actualColumns.has(fieldName)) {
+            // Column exists - use the config's type hint (preserves special types like 'image', 'upload', 'url')
+            dynamicFields[fieldName] = fieldType;
+        }
+        // If column doesn't exist in database, skip it (this fixes the bug)
+    }
+    return dynamicFields;
+};
+export const exportMeta = async ({ opts, dbname, database_id }) => {
+    const pool = getPgPool({
+        ...opts.pg,
+        database: dbname
+    });
+    const sql = {};
+    // Cache for dynamically built parsers
+    const parsers = {};
+    // Build parser dynamically by querying actual columns from the database
+    const getParser = async (key) => {
+        if (parsers[key]) {
+            return parsers[key];
+        }
+        const tableConfig = META_TABLE_CONFIG[key];
+        if (!tableConfig) {
+            return null;
+        }
+        // Build fields dynamically based on actual database columns
+        const dynamicFields = await buildDynamicFields(pool, tableConfig);
+        if (Object.keys(dynamicFields).length === 0) {
+            // No columns found (table doesn't exist or no matching columns)
+            return null;
+        }
+        const parser = new Parser({
+            schema: tableConfig.schema,
+            table: tableConfig.table,
+            conflictDoNothing: tableConfig.conflictDoNothing,
+            fields: dynamicFields
+        });
+        parsers[key] = parser;
+        return parser;
+    };
+    const queryAndParse = async (key, query) => {
+        try {
+            const parser = await getParser(key);
+            if (!parser) {
+                return;
+            }
+            const result = await pool.query(query, [database_id]);
+            if (result.rows.length) {
+                const parsed = await parser.parse(result.rows);
+                if (parsed) {
+                    sql[key] = parsed;
+                }
+            }
+        }
+        catch (err) {
+            const pgError = err;
+            if (pgError.code === '42P01') {
+                return;
+            }
+            throw err;
+        }
+    };
+    // =============================================================================
+    // metaschema_public tables
+    // =============================================================================
+    await queryAndParse('database', `SELECT * FROM metaschema_public.database WHERE id = $1 ORDER BY id`);
+    await queryAndParse('database_extension', `SELECT * FROM metaschema_public.database_extension WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('schema', `SELECT * FROM metaschema_public.schema WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('table', `SELECT * FROM metaschema_public.table WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('field', `SELECT * FROM metaschema_public.field WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('policy', `SELECT * FROM metaschema_public.policy WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('index', `SELECT * FROM metaschema_public.index WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('trigger', `SELECT * FROM metaschema_public.trigger WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('trigger_function', `SELECT * FROM metaschema_public.trigger_function WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('rls_function', `SELECT * FROM metaschema_public.rls_function WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('foreign_key_constraint', `SELECT * FROM metaschema_public.foreign_key_constraint WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('primary_key_constraint', `SELECT * FROM metaschema_public.primary_key_constraint WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('unique_constraint', `SELECT * FROM metaschema_public.unique_constraint WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('check_constraint', `SELECT * FROM metaschema_public.check_constraint WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('full_text_search', `SELECT * FROM metaschema_public.full_text_search WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('schema_grant', `SELECT * FROM metaschema_public.schema_grant WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('table_grant', `SELECT * FROM metaschema_public.table_grant WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('default_privilege', `SELECT * FROM metaschema_public.default_privilege WHERE database_id = $1 ORDER BY id`);
+    // =============================================================================
+    // services_public tables
+    // =============================================================================
+    await queryAndParse('domains', `SELECT * FROM services_public.domains WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('sites', `SELECT * FROM services_public.sites WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('apis', `SELECT * FROM services_public.apis WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('apps', `SELECT * FROM services_public.apps WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('site_modules', `SELECT * FROM services_public.site_modules WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('site_themes', `SELECT * FROM services_public.site_themes WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('site_metadata', `SELECT * FROM services_public.site_metadata WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('api_modules', `SELECT * FROM services_public.api_modules WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('api_extensions', `SELECT * FROM services_public.api_extensions WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('api_schemas', `SELECT * FROM services_public.api_schemas WHERE database_id = $1 ORDER BY id`);
+    // =============================================================================
+    // metaschema_modules_public tables
+    // =============================================================================
+    await queryAndParse('rls_module', `SELECT * FROM metaschema_modules_public.rls_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('user_auth_module', `SELECT * FROM metaschema_modules_public.user_auth_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('memberships_module', `SELECT * FROM metaschema_modules_public.memberships_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('permissions_module', `SELECT * FROM metaschema_modules_public.permissions_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('limits_module', `SELECT * FROM metaschema_modules_public.limits_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('levels_module', `SELECT * FROM metaschema_modules_public.levels_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('users_module', `SELECT * FROM metaschema_modules_public.users_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('hierarchy_module', `SELECT * FROM metaschema_modules_public.hierarchy_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('membership_types_module', `SELECT * FROM metaschema_modules_public.membership_types_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('invites_module', `SELECT * FROM metaschema_modules_public.invites_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('emails_module', `SELECT * FROM metaschema_modules_public.emails_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('sessions_module', `SELECT * FROM metaschema_modules_public.sessions_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('secrets_module', `SELECT * FROM metaschema_modules_public.secrets_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('profiles_module', `SELECT * FROM metaschema_modules_public.profiles_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('encrypted_secrets_module', `SELECT * FROM metaschema_modules_public.encrypted_secrets_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('connected_accounts_module', `SELECT * FROM metaschema_modules_public.connected_accounts_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('phone_numbers_module', `SELECT * FROM metaschema_modules_public.phone_numbers_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('crypto_addresses_module', `SELECT * FROM metaschema_modules_public.crypto_addresses_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('crypto_auth_module', `SELECT * FROM metaschema_modules_public.crypto_auth_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('field_module', `SELECT * FROM metaschema_modules_public.field_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('table_module', `SELECT * FROM metaschema_modules_public.table_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('table_template_module', `SELECT * FROM metaschema_modules_public.table_template_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('secure_table_provision', `SELECT * FROM metaschema_modules_public.secure_table_provision WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('uuid_module', `SELECT * FROM metaschema_modules_public.uuid_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('default_ids_module', `SELECT * FROM metaschema_modules_public.default_ids_module WHERE database_id = $1 ORDER BY id`);
+    await queryAndParse('denormalized_table_field', `SELECT * FROM metaschema_modules_public.denormalized_table_field WHERE database_id = $1 ORDER BY id`);
+    return sql;
+};