@helloao/cli 0.0.5 → 0.0.6

package/README.md

@@ -1,126 +1,125 @@
-## Hello AO CLI
-
-A Command Line Interface (CLI) that makes it easy to generate and manage your own [Free Use Bible API](https://bible.helloao.org/).
-
-Additionally, it includes many functions and utilities that can make working with commonly formatted Bible data much easier.
-
-### Features
-
--   Supports [USFM](https://ubsicap.github.io/usfm/), [USX](https://ubsicap.github.io/usx/), and Codex (A JSON format).
--   Download over 1000 Bible translations from [fetch.bible](https://fetch.bible/).
--   Import Bible translations into a SQLite database.
--   Upload to S3, a zip file, or a local directory.
-
-### Usage
-
-```
-Usage: helloao [options] [command]
-
-A CLI for managing a Free Use Bible API.
-
-Options:
-  -V, --version                                         output the version number
-  -h, --help                                            display help for command
-
-Commands:
-  init [options] [path]                                 Initialize a new Bible API DB.
-  import-translation [options] <dir> [dirs...]          Imports a translation from the given directory into the database.
-  import-translations [options] <dir>                   Imports all translations from the given directory into the database.
-  generate-translation-files [options] <input> <dir>    Generates API files from the given input translation.
-  generate-translations-files [options] <input> <dir>   Generates API files from the given input translations.
-  upload-api-files [options] <dest>                     Uploads API files to the specified destination. For S3, use the format s3://bucket-name/path/to/folder.
-  fetch-translations [options] <dir> [translations...]  Fetches the specified translations from fetch.bible and places them in the given directory.
-  fetch-audio [options] <dir> [translations...]         Fetches the specified audio translations and places them in the given directory.
-                                                        Translations should be in the format "translationId/audioId". e.g. "BSB/gilbert"
-  fetch-bible-metadata <dir>                            Fetches the Theographic bible metadata and places it in the given directory.
-  help [command]                                        display help for command
-```
-
-The `@helloao/cli` package can also be used as a library.
-
-The library exports a variety of actions, utilities, and supporting classes designed to assist with generating and managing a Free Use Bible API.
-
-There are 6 main exports:
-
-- `actions` - This export contains function versions of the CLI commands. They make it easy to call a CLI command from a script.
-- `db` - This export contains functions that make working with a database easier. It supports operations like importing translations into a database, inserting chapters, verses, etc. and getting an updated database instance from a path.
-- `downloads` - This export contains functions that make downloading files easier.
-- `files` - This export contains functions that make working with files easier. It has functions to load files from a translation, discover translation metadata from the filesystem, and classes that support uploading API files to the local file system or to a zip archive.
-- `uploads` - This export contains functions that make it easy to upload an API to a destination like S3, the local filesystem, or a zip archive.
-- `s3` - This export contains a class that can upload files to S3.
-
-
-Here are some common operations that you might want to perform:
-
-#### Get a SQL Database
-
-```typescript
-import { db } from '@helloao/cli';
-
-const pathToDb = './bible-database.db';
-const database = await db.getDb(pathToDb);
-
-// do work on the database
-
-// Close it when you are done.
-database.close();
-```
-
-#### Import a translation into a database from a directory
-
-```typescript
-import { db } from '@helloao/cli';
-
-const pathToDb = './bible-database.db';
-const database = await db.getDb(pathToDb);
-
-// Get a DOMParser for parsing USX.
-// On Node.js, you may have to import jsdom or linkedom.
-const parser = new DOMParser();
-
-const pathToTranslation = './path/to/translation';
-
-// Whether to overwrite files that already exist in the database.
-// The system will automatically determine the hashes of the input files and overwrite changed files if needed, so this is only needed
-// when you know that they need to be overwritten.
-const overwrite = false;
-await db.importTranslations(database, pathToTranslation, parser, overwrite);
-```
-
-#### Generate an API from a translation
-
-```typescript
-import { files, uploads } from '@helloao/cli';
-import { generation } from '@helloao/tools';
-import { toAsyncIterable } from '@helloao/tools/parser/iterators';
-
-const translationPath = './path/to/translation';
-const translationFiles = await files.loadTranslationFiles(translationPath);
-
-// Used to parse XML
-const domParser = new DOMParser();
-
-// Generate a dataset from the files
-// Datasets organize all the files and their content
-// by translation, book, chapter, and verse
-const dataset = generation.dataset.generateDataset(files, parser);
-
-// You can optionally specifiy a prefix that should be added to all API
-// links
-const pathPrefix = '';
-
-// Generate an API representation from the files
-// This adds links between chapters and additional metadata.
-const api = generation.api.generateApiForDataset(dataset, {
-  pathPrefix
-});
-
-// Generate output files from the API representation.
-// This will give us a list of files and file paths that represent
-// the entire API.
-const outputFiles = generation.api.generateFilesForApi(api);
-
-// Optionally upload files by using:
-// const dest = 's3://my-bucket';
-// await uploads.serializeAndUploadDatasets(dest, toAsyncIterable(outputFiles));
-```
+## Hello AO CLI
+
+A Command Line Interface (CLI) that makes it easy to generate and manage your own [Free Use Bible API](https://bible.helloao.org/).
+
+Additionally, it includes many functions and utilities that can make working with commonly formatted Bible data much easier.
+
+### Features
+
+-   Supports [USFM](https://ubsicap.github.io/usfm/), [USX](https://ubsicap.github.io/usx/), and Codex (A JSON format).
+-   Download over 1000 Bible translations from [fetch.bible](https://fetch.bible/).
+-   Import Bible translations into a SQLite database.
+-   Upload to S3, a zip file, or a local directory.
+
+### Usage
+
+```
+Usage: helloao [options] [command]
+
+A CLI for managing a Free Use Bible API.
+
+Options:
+  -V, --version                                         output the version number
+  -h, --help                                            display help for command
+
+Commands:
+  init [options] [path]                                 Initialize a new Bible API DB.
+  import-translation [options] <dir> [dirs...]          Imports a translation from the given directory into the database.
+  import-translations [options] <dir>                   Imports all translations from the given directory into the database.
+  generate-translation-files [options] <input> <dir>    Generates API files from the given input translation.
+  generate-translations-files [options] <input> <dir>   Generates API files from the given input translations.
+  upload-api-files [options] <dest>                     Uploads API files to the specified destination. For S3, use the format s3://bucket-name/path/to/folder.
+  fetch-translations [options] <dir> [translations...]  Fetches the specified translations from fetch.bible and places them in the given directory.
+  fetch-audio [options] <dir> [translations...]         Fetches the specified audio translations and places them in the given directory.
+                                                        Translations should be in the format "translationId/audioId". e.g. "BSB/gilbert"
+  fetch-bible-metadata <dir>                            Fetches the Theographic bible metadata and places it in the given directory.
+  help [command]                                        display help for command
+```
+
+The `@helloao/cli` package can also be used as a library.
+
+The library exports a variety of actions, utilities, and supporting classes designed to assist with generating and managing a Free Use Bible API.
+
+There are 6 main exports:
+
+-   `actions` - This export contains function versions of the CLI commands. They make it easy to call a CLI command from a script.
+-   `db` - This export contains functions that make working with a database easier. It supports operations like importing translations into a database, inserting chapters, verses, etc. and getting an updated database instance from a path.
+-   `downloads` - This export contains functions that make downloading files easier.
+-   `files` - This export contains functions that make working with files easier. It has functions to load files from a translation, discover translation metadata from the filesystem, and classes that support uploading API files to the local file system or to a zip archive.
+-   `uploads` - This export contains functions that make it easy to upload an API to a destination like S3, the local filesystem, or a zip archive.
+-   `s3` - This export contains a class that can upload files to S3.
+
+Here are some common operations that you might want to perform:
+
+#### Get a SQL Database
+
+```typescript
+import { db } from '@helloao/cli';
+
+const pathToDb = './bible-database.db';
+const database = await db.getDb(pathToDb);
+
+// do work on the database
+
+// Close it when you are done.
+database.close();
+```
+
+#### Import a translation into a database from a directory
+
+```typescript
+import { db } from '@helloao/cli';
+
+const pathToDb = './bible-database.db';
+const database = await db.getDb(pathToDb);
+
+// Get a DOMParser for parsing USX.
+// On Node.js, you may have to import jsdom or linkedom.
+const parser = new DOMParser();
+
+const pathToTranslation = './path/to/translation';
+
+// Whether to overwrite files that already exist in the database.
+// The system will automatically determine the hashes of the input files and overwrite changed files if needed, so this is only needed
+// when you know that they need to be overwritten.
+const overwrite = false;
+await db.importTranslations(database, pathToTranslation, parser, overwrite);
+```
+
+#### Generate an API from a translation
+
+```typescript
+import { files, uploads } from '@helloao/cli';
+import { generation } from '@helloao/tools';
+import { toAsyncIterable } from '@helloao/tools/parser/iterators';
+
+const translationPath = './path/to/translation';
+const translationFiles = await files.loadTranslationFiles(translationPath);
+
+// Used to parse XML
+const domParser = new DOMParser();
+
+// Generate a dataset from the files
+// Datasets organize all the files and their content
+// by translation, book, chapter, and verse
+const dataset = generation.dataset.generateDataset(files, parser);
+
+// You can optionally specifiy a prefix that should be added to all API
+// links
+const pathPrefix = '';
+
+// Generate an API representation from the files
+// This adds links between chapters and additional metadata.
+const api = generation.api.generateApiForDataset(dataset, {
+    pathPrefix,
+});
+
+// Generate output files from the API representation.
+// This will give us a list of files and file paths that represent
+// the entire API.
+const outputFiles = generation.api.generateFilesForApi(api);
+
+// Optionally upload files by using:
+// const dest = 's3://my-bucket';
+// await uploads.serializeAndUploadDatasets(dest, toAsyncIterable(outputFiles));
+```

package/actions.d.ts

@@ -1,3 +1,4 @@
+import { UploadApiFromDatabaseOptions, UploadApiOptions } from './uploads';
 export interface InitDbOptions {
     /**
      * The path to the source database to copy the schema from.
@@ -54,4 +55,67 @@ export declare function fetchTranslations(dir: string, translations?: string[],
  * @param options The options.
  */
 export declare function fetchAudio(dir: string, translations: string[], options?: FetchTranslationsOptions): Promise<void>;
+/**
+ * Generates the translation files directly from the translations stored in the given input directory.
+ * @param input The input directory that the translations are stored in.
+ * @param dest The destination to upload the API files to.
+ * @param options The options for the generation.
+ */
+export declare function generateTranslationsFiles(input: string, dest: string, options: UploadApiFromDatabaseOptions): Promise<void>;
+/**
+ * Generates the translation files directly from the translation stored in the given input directory.
+ * @param input The input directory that the translation is stored in.
+ * @param dest The destination to upload the API files to.
+ * @param options The options for the generation.
+ */
+export declare function generateTranslationFiles(input: string, dest: string, options: UploadApiOptions): Promise<void>;
+/**
+ * The options for uploading the test translations.
+ */
+export interface UploadTestTranslationOptions extends UploadApiOptions {
+    /**
+     * The s3 URL to upload the translations to.
+     * Defaults to "s3://ao-bible-api-public-uploads"
+     */
+    s3Url?: string;
+}
+export interface UploadTestTranslationResult {
+    /**
+     * The S3 URL where the translations were uploaded to.
+     */
+    uploadS3Url: string;
+    /**
+     * The HTTP URL that the version can be accessed at.
+     */
+    url: string;
+    /**
+     * The URL that the available translations can be accessed at.
+     */
+    availableTranslationsUrl: string;
+    /**
+     * The version that was uploaded.
+     * This is a SHA-256 hash of the input files.
+     */
+    version: string;
+}
+/**
+ * Generates the API files directly from the translations stored in the given input directory and
+ * uploads them to the HelloAO test s3 bucket.
+ *
+ * Requires access to the HelloAO test s3 bucket. Email hello@helloao.org for access.
+ *
+ * @param input The input directory that the translations are stored in.
+ * @param options The options to use for the upload.
+ */
+export declare function uploadTestTranslations(input: string, options: UploadTestTranslationOptions): Promise<UploadTestTranslationResult>;
+/**
+ * Generates the API files directly from the given translation and
+ * uploads them to the HelloAO test s3 bucket.
+ *
+ * Requires access to the HelloAO test s3 bucket. Email hello@helloao.org for access.
+ *
+ * @param input The input directory that the translations are stored in.
+ * @param options The options to use for the upload.
+ */
+export declare function uploadTestTranslation(input: string, options: UploadTestTranslationOptions): Promise<UploadTestTranslationResult>;
 //# sourceMappingURL=actions.d.ts.map

package/actions.js

@@ -31,6 +31,10 @@ exports.importTranslation = importTranslation;
 exports.importTranslations = importTranslations;
 exports.fetchTranslations = fetchTranslations;
 exports.fetchAudio = fetchAudio;
+exports.generateTranslationsFiles = generateTranslationsFiles;
+exports.generateTranslationFiles = generateTranslationFiles;
+exports.uploadTestTranslations = uploadTestTranslations;
+exports.uploadTestTranslation = uploadTestTranslation;
 const node_path_1 = __importStar(require("node:path"));
 const database = __importStar(require("./db"));
 const better_sqlite3_1 = __importDefault(require("better-sqlite3"));
@@ -42,6 +46,11 @@ const fs_extra_1 = require("fs-extra");
 const audio_1 = require("@helloao/tools/generation/audio");
 const book_order_1 = require("@helloao/tools/generation/book-order");
 const downloads_1 = require("./downloads");
+const iterators_1 = require("@helloao/tools/parser/iterators");
+const files_1 = require("./files");
+const dataset_1 = require("@helloao/tools/generation/dataset");
+const uploads_1 = require("./uploads");
+const s3_1 = require("./s3");
 /**
  * Initializes a new Bible API DB.
  * @param dbPath The path to the database. If null or empty, then the "bible-api.db" will be used from the current working directory.
@@ -56,47 +65,49 @@ async function initDb(dbPath, options) {
             console.log('Copying schema from source DB...');
             if (options.language) {
                 console.log('Copying only the following languages:', options.language);
-                const languages = `(${options.language.map((l) => `'${l}'`).join(', ')})`;
-                db.exec(`
-                    ATTACH DATABASE "${sourcePath}" AS source;
-
-                    CREATE TABLE "_prisma_migrations" AS SELECT * FROM source._prisma_migrations;
-                    
-                    CREATE TABLE "Translation" AS SELECT * FROM source.Translation
-                    WHERE language IN ${languages};
-
-                    CREATE TABLE "Book" AS SELECT * FROM source.Book
-                    INNER JOIN source.Translation ON source.Translation.id = source.Book.translationId
-                    WHERE source.Translation.language IN ${languages};
-
-                    CREATE TABLE "Chapter" AS SELECT * FROM source.Chapter
-                    INNER JOIN source.Translation ON source.Translation.id = source.Chapter.translationId
-                    WHERE source.Translation.language IN ${languages};
-
-                    CREATE TABLE "ChapterVerse" AS SELECT * FROM source.ChapterVerse
-                    INNER JOIN source.Translation ON source.Translation.id = source.ChapterVerse.translationId
-                    WHERE source.Translation.language IN ${languages};
-
-                    CREATE TABLE "ChapterFootnote" AS SELECT * FROM source.ChapterFootnote
-                    INNER JOIN source.Translation ON source.Translation.id = source.ChapterFootnote.translationId
-                    WHERE source.Translation.language IN ${languages};
-
-                    CREATE TABLE "ChapterAudioUrl" AS SELECT * FROM source.ChapterAudioUrl
-                    INNER JOIN source.Translation ON source.Translation.id = source.ChapterAudioUrl.translationId
-                    WHERE source.Translation.language IN ${languages};
+                const languages = `(${options.language
+                    .map((l) => `'${l}'`)
+                    .join(', ')})`;
+                db.exec(`
+                    ATTACH DATABASE "${sourcePath}" AS source;
+
+                    CREATE TABLE "_prisma_migrations" AS SELECT * FROM source._prisma_migrations;
+                    
+                    CREATE TABLE "Translation" AS SELECT * FROM source.Translation
+                    WHERE language IN ${languages};
+
+                    CREATE TABLE "Book" AS SELECT * FROM source.Book
+                    INNER JOIN source.Translation ON source.Translation.id = source.Book.translationId
+                    WHERE source.Translation.language IN ${languages};
+
+                    CREATE TABLE "Chapter" AS SELECT * FROM source.Chapter
+                    INNER JOIN source.Translation ON source.Translation.id = source.Chapter.translationId
+                    WHERE source.Translation.language IN ${languages};
+
+                    CREATE TABLE "ChapterVerse" AS SELECT * FROM source.ChapterVerse
+                    INNER JOIN source.Translation ON source.Translation.id = source.ChapterVerse.translationId
+                    WHERE source.Translation.language IN ${languages};
+
+                    CREATE TABLE "ChapterFootnote" AS SELECT * FROM source.ChapterFootnote
+                    INNER JOIN source.Translation ON source.Translation.id = source.ChapterFootnote.translationId
+                    WHERE source.Translation.language IN ${languages};
+
+                    CREATE TABLE "ChapterAudioUrl" AS SELECT * FROM source.ChapterAudioUrl
+                    INNER JOIN source.Translation ON source.Translation.id = source.ChapterAudioUrl.translationId
+                    WHERE source.Translation.language IN ${languages};
                 `);
             }
             else {
-                db.exec(`
-                    ATTACH DATABASE "${sourcePath}" AS source;
-
-                    CREATE TABLE "_prisma_migrations" AS SELECT * FROM source._prisma_migrations;
-                    CREATE TABLE "Translation" AS SELECT * FROM source.Translation;
-                    CREATE TABLE "Book" AS SELECT * FROM source.Book;
-                    CREATE TABLE "Chapter" AS SELECT * FROM source.Chapter;
-                    CREATE TABLE "ChapterVerse" AS SELECT * FROM source.ChapterVerse;
-                    CREATE TABLE "ChapterFootnote" AS SELECT * FROM source.ChapterFootnote;
-                    CREATE TABLE "ChapterAudioUrl" AS SELECT * FROM source.ChapterAudioUrl;
+                db.exec(`
+                    ATTACH DATABASE "${sourcePath}" AS source;
+
+                    CREATE TABLE "_prisma_migrations" AS SELECT * FROM source._prisma_migrations;
+                    CREATE TABLE "Translation" AS SELECT * FROM source.Translation;
+                    CREATE TABLE "Book" AS SELECT * FROM source.Book;
+                    CREATE TABLE "Chapter" AS SELECT * FROM source.Chapter;
+                    CREATE TABLE "ChapterVerse" AS SELECT * FROM source.ChapterVerse;
+                    CREATE TABLE "ChapterFootnote" AS SELECT * FROM source.ChapterFootnote;
+                    CREATE TABLE "ChapterAudioUrl" AS SELECT * FROM source.ChapterAudioUrl;
                 `);
             }
             console.log('Done.');
@@ -142,7 +153,7 @@ async function importTranslations(dir, options) {
     const db = await database.getDbFromDir(process.cwd());
     try {
         const files = await (0, promises_1.readdir)(dir);
-        const translationDirs = files.map(f => node_path_1.default.resolve(dir, f));
+        const translationDirs = files.map((f) => node_path_1.default.resolve(dir, f));
         console.log(`Importing ${translationDirs.length} translations`);
         await database.importTranslations(db, translationDirs, parser, !!options.overwrite);
     }
@@ -164,7 +175,9 @@ async function fetchTranslations(dir, translations, options = {}) {
     const collection = await client.fetch_collection();
     const collectionTranslations = collection.get_translations();
     console.log(`Discovered ${collectionTranslations.length} translations`);
-    const filtered = translations && translations.length <= 0 ? collectionTranslations : collectionTranslations.filter(t => translationsSet.has(t.id));
+    const filtered = translations && translations.length <= 0
+        ? collectionTranslations
+        : collectionTranslations.filter((t) => translationsSet.has(t.id));
     let batches = [];
     while (filtered.length > 0) {
         batches.push(filtered.splice(0, 10));
@@ -187,7 +200,8 @@ async function fetchTranslations(dir, translations, options = {}) {
             };
             const books = await Promise.all(collection.get_books(t.id).map(async (b) => {
                 const name = `${b.id}.usx`;
-                if (!options.all && await (0, fs_extra_1.exists)(node_path_1.default.resolve(dir, translation.id, name))) {
+                if (!options.all &&
+                    (await (0, fs_extra_1.exists)(node_path_1.default.resolve(dir, translation.id, name)))) {
                     return null;
                 }
                 const content = await collection.fetch_book(t.id, b.id, 'usx');
@@ -196,7 +210,7 @@ async function fetchTranslations(dir, translations, options = {}) {
                     fileType: 'usx',
                     content: contentString,
                     metadata: {
-                        translation
+                        translation,
                     },
                     name,
                 };
@@ -252,7 +266,7 @@ async function fetchAudio(dir, translations, options = {}) {
                 const [translationId, reader] = translation.split('/');
                 const name = `${chapter}.${reader}${ext}`;
                 const fullPath = node_path_1.default.resolve(dir, 'audio', translationId, bookId, name);
-                if (!options.all && await (0, fs_extra_1.exists)(fullPath)) {
+                if (!options.all && (await (0, fs_extra_1.exists)(fullPath))) {
                     continue;
                 }
                 await (0, downloads_1.downloadFile)(url, fullPath);
@@ -260,3 +274,105 @@ async function fetchAudio(dir, translations, options = {}) {
         }
     }
 }
+/**
+ * Generates the translation files directly from the translations stored in the given input directory.
+ * @param input The input directory that the translations are stored in.
+ * @param dest The destination to upload the API files to.
+ * @param options The options for the generation.
+ */
+async function generateTranslationsFiles(input, dest, options) {
+    const parser = new linkedom_1.DOMParser();
+    globalThis.DOMParser = linkedom_1.DOMParser;
+    globalThis.Element = linkedom_1.Element;
+    globalThis.Node = linkedom_1.Node;
+    const dirs = await (0, promises_1.readdir)(node_path_1.default.resolve(input));
+    const batchSize = typeof options.batchSize === 'number'
+        ? options.batchSize
+        : parseInt(options.batchSize);
+    for (let b of (0, iterators_1.batch)(dirs, batchSize)) {
+        const files = await (0, files_1.loadTranslationsFiles)(b);
+        const dataset = (0, dataset_1.generateDataset)(files, parser);
+        await (0, uploads_1.serializeAndUploadDatasets)(dest, (0, iterators_1.toAsyncIterable)([dataset]), options);
+    }
+}
+/**
+ * Generates the translation files directly from the translation stored in the given input directory.
+ * @param input The input directory that the translation is stored in.
+ * @param dest The destination to upload the API files to.
+ * @param options The options for the generation.
+ */
+async function generateTranslationFiles(input, dest, options) {
+    const parser = new linkedom_1.DOMParser();
+    globalThis.DOMParser = linkedom_1.DOMParser;
+    globalThis.Element = linkedom_1.Element;
+    globalThis.Node = linkedom_1.Node;
+    const files = await (0, files_1.loadTranslationFiles)(node_path_1.default.resolve(input));
+    const dataset = (0, dataset_1.generateDataset)(files, parser);
+    await (0, uploads_1.serializeAndUploadDatasets)(dest, (0, iterators_1.toAsyncIterable)([dataset]), options);
+}
+/**
+ * Generates the API files directly from the translations stored in the given input directory and
+ * uploads them to the HelloAO test s3 bucket.
+ *
+ * Requires access to the HelloAO test s3 bucket. Email hello@helloao.org for access.
+ *
+ * @param input The input directory that the translations are stored in.
+ * @param options The options to use for the upload.
+ */
+async function uploadTestTranslations(input, options) {
+    const parser = new linkedom_1.DOMParser();
+    globalThis.DOMParser = linkedom_1.DOMParser;
+    globalThis.Element = linkedom_1.Element;
+    globalThis.Node = linkedom_1.Node;
+    const dirs = await (0, promises_1.readdir)(node_path_1.default.resolve(input));
+    const files = await (0, files_1.loadTranslationsFiles)(dirs);
+    const hash = (0, files_1.hashInputFiles)(files);
+    const dataset = (0, dataset_1.generateDataset)(files, parser);
+    const url = options.s3Url || 's3://ao-bible-api-public-uploads';
+    await (0, uploads_1.serializeAndUploadDatasets)(url, (0, iterators_1.toAsyncIterable)([dataset]), {
+        ...options,
+        pathPrefix: `/${hash}`,
+    });
+    const urls = getUrls(url);
+    return {
+        ...urls,
+        version: hash,
+        availableTranslationsUrl: `${urls.url}/${hash}/api/available_translations.json`,
+    };
+}
+/**
+ * Generates the API files directly from the given translation and
+ * uploads them to the HelloAO test s3 bucket.
+ *
+ * Requires access to the HelloAO test s3 bucket. Email hello@helloao.org for access.
+ *
+ * @param input The input directory that the translations are stored in.
+ * @param options The options to use for the upload.
+ */
+async function uploadTestTranslation(input, options) {
+    const parser = new linkedom_1.DOMParser();
+    globalThis.DOMParser = linkedom_1.DOMParser;
+    globalThis.Element = linkedom_1.Element;
+    globalThis.Node = linkedom_1.Node;
+    const files = await (0, files_1.loadTranslationFiles)(node_path_1.default.resolve(input));
+    const hash = (0, files_1.hashInputFiles)(files);
+    const dataset = (0, dataset_1.generateDataset)(files, parser);
+    const url = options.s3Url || 's3://ao-bible-api-public-uploads';
+    await (0, uploads_1.serializeAndUploadDatasets)(url, (0, iterators_1.toAsyncIterable)([dataset]), {
+        ...options,
+        pathPrefix: `/${hash}`,
+    });
+    const urls = getUrls(url);
+    return {
+        ...urls,
+        version: hash,
+        availableTranslationsUrl: `${urls.url}/${hash}/api/available_translations.json`,
+    };
+}
+function getUrls(dest) {
+    const url = (0, s3_1.getHttpUrl)(dest);
+    return {
+        uploadS3Url: dest,
+        url: url,
+    };
+}