hazo_files 2.0.1 → 3.0.0

package/CHANGE_LOG.md

@@ -5,6 +5,45 @@ All notable changes to this project will be documented in this file.
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## 3.0.0 — 2026-05-29
+
+### Breaking changes (Wave 2 standardisation)
+
+- **Required peer dep:** `hazo_core ^1.0.0`. Provides `HazoError` hierarchy, structured logger, and `withContext()` correlation propagation.
+- **Cross-hazo peer-dep major bumps:** `hazo_connect ^3.0.0` (was `^2.7.3`), `hazo_llm_api ^2.0.0` (was `^1.3.0`). Consumers using these alongside `hazo_files` must upgrade them together.
+- **Error API surface:** the 12 `HazoFilesError` subclasses (`FileNotFoundError`, `FileTooLargeError`, etc.) now extend `HazoError` from `hazo_core` and carry `HAZO_FILES_*` codes. Catch sites that used `instanceof HazoFilesError` continue to work; catch sites that matched `error.message` text should switch to `.code`.
+
+### Internal changes
+
+- Default logger resolves to `createLogger('hazo_files')` from `hazo_core` (delegates to `hazo_logs`).
+- Google Drive adapter outbound API calls and `LLMExtractionService` provider calls use `fetchWithRequestId()` so `x-request-id` propagates.
+- `TrackedFileManager` operations run inside `withContext({ correlationId })` per call so DB writes and storage writes share the same correlation ID.
+
+### Migration
+
+1. `npm install hazo_core@^1.0.0`.
+2. Upgrade `hazo_connect` to `^3.0.0` and `hazo_llm_api` to `^2.0.0` if you depend on them.
+3. No public API method signatures changed — `FileManager` and `TrackedFileManager` methods keep their existing call shape.
+
+## 2.1.1 — 2026-05-24
+
+**Docs + housekeeping** — no API changes.
+
+- README: added documentation for `NamingTemplate`, `writeWithCollisionRetry`, and the pure `addRef`/`removeRef`/`countRefs` helpers introduced in 2.1.0.
+- `.gitignore`: untracked test-app runtime artifacts (`data/`, `logs/`, `tsconfig.tsbuildinfo`, `*.tgz`).
+
+## 2.1.0 — 2026-05-24
+
+**Additive** — no breaking changes from 2.0.x.
+
+- `NamingTemplate` DSL with formatters (`slug`, `pad:N`, `upper`, `lower`, `truncate:N`, `date:FMT`). 200-char cap; sanitises `/\:*?"<>|` → `_`; throws on missing variable; dotted-path resolution. Formatters `pad` and `truncate` throw on missing/NaN arg; `date` throws on empty value.
+- `writeWithCollisionRetry` helper with 999-attempt cap; throws `StorageCollisionExhausted`. Renders the `{index}` variable per attempt.
+- Reference tracking helpers: `addRef` / `removeRef` / `countRefs` over `{ file_refs, ref_count }`. Idempotent on same `ref_id`; soft-tombstone via `removed_at`.
+
+### Migration from 2.0.x
+
+No required changes. Existing imports continue to work. Use the new helpers to compute filenames and track usage references.
+
 ## 2.0.1 (2026-05-23)
 
 ### Added

package/README.md

@@ -1564,6 +1564,117 @@ import type {
 } from 'hazo_files';
 ```
 
+### Pure Reference Helpers (v2.1.0)
+
+Functional helpers for manipulating `{ file_refs, ref_count }` objects without a database. Useful for in-memory state management or building your own persistence layer.
+
+```typescript
+import { addRef, removeRef, countRefs } from 'hazo_files';
+import type { FileWithRefs, FileRef } from 'hazo_files';
+
+// addRef — idempotent on same ref_id; returns updated object
+const updated = addRef(file, {
+  ref_id: 'ref-123',
+  ref_type: 'form_field',
+  ref_source: 'form-abc',
+  created_at: new Date().toISOString(),
+});
+// updated.ref_count === countRefs(updated)
+
+// removeRef — soft-tombstones by setting removed_at; returns updated object
+const released = removeRef(file, 'ref-123', new Date().toISOString());
+// released.ref_count decremented; original ref_id still present with removed_at set
+
+// countRefs — count active (non-tombstoned) references
+const active = countRefs(file); // number
+```
+
+These helpers are **pure functions** — they never write to a database. Pair them with `TrackedFileManager.addRef` / `removeRef` when you need DB persistence.
+
+## Naming Templates (v2.1.0)
+
+`NamingTemplate` is a lightweight DSL for generating filenames and folder paths from string templates with variable substitution and pipe formatters.
+
+### Basic Usage
+
+```typescript
+import { NamingTemplate } from 'hazo_files';
+
+const name = NamingTemplate.render(
+  '{client_name|slug}_{date|date:YYYY-MM-DD}_{index|pad:3}.pdf',
+  { client_name: 'Acme Corp', date: '2026-05-24T00:00:00Z', index: 7 }
+);
+// → "acme-corp_2026-05-24_007.pdf"
+```
+
+### Template Syntax
+
+- **`{variable}`** — substitutes `variable` from the vars object
+- **`{variable|formatter}`** — applies a formatter after substitution
+- **`{variable|formatter:arg}`** — formatter with argument
+- **`{obj.nested.key}`** — dotted-path resolution into nested objects
+- Output is capped at **200 characters**; `/\:*?"<>|` are sanitised to `_`
+
+### Formatters
+
+| Formatter | Example | Description |
+|---|---|---|
+| `slug` | `{name\|slug}` | Lowercase, replace non-alphanumeric with `-`, strip leading/trailing `-` |
+| `upper` | `{code\|upper}` | Uppercase |
+| `lower` | `{code\|lower}` | Lowercase |
+| `pad:N` | `{index\|pad:3}` | Zero-pad to N digits (7 → `007`) |
+| `truncate:N` | `{title\|truncate:20}` | Trim to N characters |
+| `date:FMT` | `{ts\|date:YYYY-MM-DD}` | Format ISO date string; tokens: `YYYY`, `MM`, `DD`, `HH`, `mm`, `ss` |
+
+### Error Conditions
+
+- Missing variable → throws `Error: missing variable: <name>`
+- `pad` / `truncate` without numeric arg → throws
+- `date` formatter on empty/invalid value → throws
+- Unknown formatter → throws
+
+## Collision-Safe Writes (v2.1.0)
+
+`writeWithCollisionRetry` writes a file to any `FileStorageProvider`, automatically incrementing an `{index}` variable in the template until a free path is found.
+
+### Usage
+
+```typescript
+import { writeWithCollisionRetry, StorageCollisionExhausted } from 'hazo_files';
+
+try {
+  const result = await writeWithCollisionRetry({
+    provider,          // FileStorageProvider
+    template: '{client|slug}_{date|date:YYYY-MM-DD}_{index|pad:3}.pdf',
+    vars: { client: 'Acme Corp', date: new Date().toISOString() },
+    body: pdfBuffer,
+    path_prefix: 'uploads/forms',   // optional — prepended to rendered name
+    max_attempts: 999,              // optional, default 999
+    put_opts: { metadata: { ... } } // optional extra PutOpts (ifNotExists always set)
+  });
+
+  console.log(result.logical_path);
+  // → "uploads/forms/acme-corp_2026-05-24_001.pdf"
+  //   (or _002, _003, … if earlier slots were taken)
+} catch (err) {
+  if (err instanceof StorageCollisionExhausted) {
+    // All 999 attempts collided
+    console.error(`Could not write after ${err.attempts} attempts`);
+  }
+  throw err;
+}
+```
+
+### How It Works
+
+1. Renders the template with `{ ...vars, index: 1 }` for the first attempt
+2. Calls `provider.put(path, body, { ifNotExists: true })`
+3. If the file exists, increments `index` and retries
+4. Returns `PutResult & { logical_path: string }` on the first successful write
+5. Throws `StorageCollisionExhausted` if all attempts are exhausted
+
+The `{index}` variable is **automatically injected** — you don't need to supply it in `vars`.
+
 ## File Change Detection
 
 Detect file content changes using fast xxHash hashing.

package/config/hazo_files_config.ini.sample

@@ -42,3 +42,14 @@ root_path =
 ; Comma-separated list of supported date format tokens for naming rules
 ; Available: YYYY, YY, MM, M, DD, D, MMM, MMMM, YYYY-MM-DD, YYYY-MMM-DD, DD-MM-YYYY, MM-DD-YYYY
 date_formats = YYYY,YY,MM,M,DD,D,MMM,MMMM,YYYY-MM-DD,YYYY-MMM-DD,DD-MM-YYYY,MM-DD-YYYY
+
+[log.overrides]
+; Override log levels per namespace. Format: namespace = TRACE|DEBUG|INFO|WARN|ERROR
+; Example:
+; hazo_files.metadata = DEBUG
+; hazo_files.naming = WARN
+
+[env]
+; Set HAZO_ENV to control which overlay config file is loaded
+; e.g. HAZO_ENV=production loads hazo_files_config.production.ini as an overlay
+; hazo_env = production

package/dist/background-upload/index.js

@@ -57,6 +57,7 @@ var TypedEventEmitter = class {
 };
 
 // src/background_upload/core/job.ts
+var import_hazo_core = require("hazo_core");
 var Job = class {
   constructor(init) {
     this.status = "queued";
@@ -64,7 +65,7 @@ var Job = class {
     this.error = null;
     this.confirmation_payload = null;
     this.confirmation_resolve = null;
-    this.job_id = crypto.randomUUID();
+    this.job_id = (0, import_hazo_core.generateRequestId)().slice(4);
     this.batch_id = init.batch_id;
     this.created_at = Date.now();
     this.updated_at = this.created_at;
@@ -183,6 +184,7 @@ var PipelineExecutor = class {
 };
 
 // src/background_upload/core/upload-manager.ts
+var import_hazo_core2 = require("hazo_core");
 var UploadManager = class {
   constructor(config) {
     this.jobs = /* @__PURE__ */ new Map();
@@ -204,7 +206,7 @@ var UploadManager = class {
   }
   submit_batch(options) {
     if (this.destroyed) throw new Error("UploadManager is destroyed");
-    const batch_id = crypto.randomUUID();
+    const batch_id = (0, import_hazo_core2.generateRequestId)().slice(4);
     const job_ids = [];
     const pipeline_steps = options.pipeline_steps ?? this.config.default_pipeline_steps;
     for (const file of options.files) {

package/dist/background-upload/index.mjs

@@ -28,6 +28,7 @@ var TypedEventEmitter = class {
 };
 
 // src/background_upload/core/job.ts
+import { generateRequestId } from "hazo_core";
 var Job = class {
   constructor(init) {
     this.status = "queued";
@@ -35,7 +36,7 @@ var Job = class {
     this.error = null;
     this.confirmation_payload = null;
     this.confirmation_resolve = null;
-    this.job_id = crypto.randomUUID();
+    this.job_id = generateRequestId().slice(4);
     this.batch_id = init.batch_id;
     this.created_at = Date.now();
     this.updated_at = this.created_at;
@@ -154,6 +155,7 @@ var PipelineExecutor = class {
 };
 
 // src/background_upload/core/upload-manager.ts
+import { generateRequestId as generateRequestId2 } from "hazo_core";
 var UploadManager = class {
   constructor(config) {
     this.jobs = /* @__PURE__ */ new Map();
@@ -175,7 +177,7 @@ var UploadManager = class {
   }
   submit_batch(options) {
     if (this.destroyed) throw new Error("UploadManager is destroyed");
-    const batch_id = crypto.randomUUID();
+    const batch_id = generateRequestId2().slice(4);
     const job_ids = [];
     const pipeline_steps = options.pipeline_steps ?? this.config.default_pipeline_steps;
     for (const file of options.files) {

package/dist/background-upload/react/index.js

@@ -41,7 +41,11 @@ module.exports = __toCommonJS(index_exports);
 // src/background_upload/react/provider.tsx
 var import_react3 = require("react");
 
+// src/background_upload/core/upload-manager.ts
+var import_hazo_core2 = require("hazo_core");
+
 // src/background_upload/core/job.ts
+var import_hazo_core = require("hazo_core");
 var Job = class {
   constructor(init) {
     this.status = "queued";
@@ -49,7 +53,7 @@ var Job = class {
     this.error = null;
     this.confirmation_payload = null;
     this.confirmation_resolve = null;
-    this.job_id = crypto.randomUUID();
+    this.job_id = (0, import_hazo_core.generateRequestId)().slice(4);
     this.batch_id = init.batch_id;
     this.created_at = Date.now();
     this.updated_at = this.created_at;
@@ -218,7 +222,7 @@ var UploadManager = class {
   }
   submit_batch(options) {
     if (this.destroyed) throw new Error("UploadManager is destroyed");
-    const batch_id = crypto.randomUUID();
+    const batch_id = (0, import_hazo_core2.generateRequestId)().slice(4);
     const job_ids = [];
     const pipeline_steps = options.pipeline_steps ?? this.config.default_pipeline_steps;
     for (const file of options.files) {

package/dist/background-upload/react/index.mjs

@@ -1,7 +1,11 @@
 // src/background_upload/react/provider.tsx
 import { useRef, useEffect as useEffect2 } from "react";
 
+// src/background_upload/core/upload-manager.ts
+import { generateRequestId as generateRequestId2 } from "hazo_core";
+
 // src/background_upload/core/job.ts
+import { generateRequestId } from "hazo_core";
 var Job = class {
   constructor(init) {
     this.status = "queued";
@@ -9,7 +13,7 @@ var Job = class {
     this.error = null;
     this.confirmation_payload = null;
     this.confirmation_resolve = null;
-    this.job_id = crypto.randomUUID();
+    this.job_id = generateRequestId().slice(4);
     this.batch_id = init.batch_id;
     this.created_at = Date.now();
     this.updated_at = this.created_at;
@@ -178,7 +182,7 @@ var UploadManager = class {
   }
   submit_batch(options) {
     if (this.destroyed) throw new Error("UploadManager is destroyed");
-    const batch_id = crypto.randomUUID();
+    const batch_id = generateRequestId2().slice(4);
     const job_ids = [];
     const pipeline_steps = options.pipeline_steps ?? this.config.default_pipeline_steps;
     for (const file of options.files) {

package/dist/index.d.mts

@@ -1,3 +1,6 @@
+import { HazoAuthError, HazoConfigError, HazoConflictError, HazoNotFoundError, HazoValidationError, HazoExternalError } from 'hazo_core';
+export { HazoError as HazoFilesError } from 'hazo_core';
+import { Readable } from 'node:stream';
 import { OAuth2Client } from 'google-auth-library';
 
 /**
@@ -396,7 +399,7 @@ type FileRefVisibility = 'public' | 'private' | 'internal';
  * A reference from an entity to a file.
  * Multiple entities can reference the same file.
  */
-interface FileRef {
+interface FileRef$1 {
     /** Unique ID for this reference */
     ref_id: string;
     /** Type of entity referencing the file (e.g., 'form_field', 'chat_message') */
@@ -480,7 +483,7 @@ interface FileWithStatus {
     /** Full metadata record (V2) */
     record: FileMetadataRecordV2;
     /** Parsed file references */
-    refs: FileRef[];
+    refs: FileRef$1[];
     /** Whether the file has zero references */
     is_orphaned: boolean;
 }
@@ -878,7 +881,7 @@ declare class FileMetadataService {
     /**
      * Get all references for a file
      */
-    getRefs(fileId: string): Promise<FileRef[] | null>;
+    getRefs(fileId: string): Promise<FileRef$1[] | null>;
     /**
      * Get a file with its status and parsed refs
      */
@@ -2870,46 +2873,43 @@ declare function registerModule(provider: StorageProvider, factory: ModuleFactor
 
 /**
  * Custom error classes for hazo_files
+ * All errors extend the appropriate hazo_core subclass.
  */
-declare class HazoFilesError extends Error {
-    code: string;
-    details?: Record<string, unknown> | undefined;
-    constructor(message: string, code: string, details?: Record<string, unknown> | undefined);
-}
-declare class FileNotFoundError extends HazoFilesError {
+
+declare class FileNotFoundError extends HazoNotFoundError {
     constructor(path: string);
 }
-declare class DirectoryNotFoundError extends HazoFilesError {
+declare class DirectoryNotFoundError extends HazoNotFoundError {
     constructor(path: string);
 }
-declare class FileExistsError extends HazoFilesError {
+declare class FileExistsError extends HazoConflictError {
     constructor(path: string);
 }
-declare class DirectoryExistsError extends HazoFilesError {
+declare class DirectoryExistsError extends HazoConflictError {
     constructor(path: string);
 }
-declare class DirectoryNotEmptyError extends HazoFilesError {
+declare class DirectoryNotEmptyError extends HazoConflictError {
     constructor(path: string);
 }
-declare class PermissionDeniedError extends HazoFilesError {
+declare class PermissionDeniedError extends HazoAuthError {
     constructor(path: string, operation: string);
 }
-declare class InvalidPathError extends HazoFilesError {
+declare class InvalidPathError extends HazoValidationError {
     constructor(path: string, reason: string);
 }
-declare class FileTooLargeError extends HazoFilesError {
+declare class FileTooLargeError extends HazoValidationError {
     constructor(path: string, size: number, maxSize: number);
 }
-declare class InvalidExtensionError extends HazoFilesError {
+declare class InvalidExtensionError extends HazoValidationError {
     constructor(path: string, extension: string, allowedExtensions: string[]);
 }
-declare class AuthenticationError extends HazoFilesError {
+declare class AuthenticationError extends HazoAuthError {
     constructor(provider: string, message: string);
 }
-declare class ConfigurationError extends HazoFilesError {
+declare class ConfigurationError extends HazoConfigError {
     constructor(message: string);
 }
-declare class OperationError extends HazoFilesError {
+declare class OperationError extends HazoExternalError {
     constructor(operation: string, message: string, details?: Record<string, unknown>);
 }
 
@@ -3256,24 +3256,24 @@ declare function generateRefId(): string;
  * Parse a JSON string into FileRef array.
  * Returns empty array on invalid input.
  */
-declare function parseFileRefs(json: string | null | undefined): FileRef[];
+declare function parseFileRefs(json: string | null | undefined): FileRef$1[];
 /**
  * Serialize FileRef array to JSON string
  */
-declare function stringifyFileRefs(refs: FileRef[]): string;
+declare function stringifyFileRefs(refs: FileRef$1[]): string;
 /**
  * Create a FileRef from AddRefOptions
  */
-declare function createFileRef(options: AddRefOptions): FileRef;
+declare function createFileRef(options: AddRefOptions): FileRef$1;
 /**
  * Remove a ref by ref_id (immutable)
  */
-declare function removeRefFromArray(refs: FileRef[], refId: string): FileRef[];
+declare function removeRefFromArray(refs: FileRef$1[], refId: string): FileRef$1[];
 /**
  * Remove refs matching criteria from array (immutable).
  * All specified criteria fields must match (AND semantics).
  */
-declare function removeRefsByCriteriaFromArray(refs: FileRef[], criteria: Omit<RemoveRefsCriteria, 'file_id' | 'scope_id'>): FileRef[];
+declare function removeRefsByCriteriaFromArray(refs: FileRef$1[], criteria: Omit<RemoveRefsCriteria, 'file_id' | 'scope_id'>): FileRef$1[];
 /**
  * Safely cast a FileMetadataRecord to FileMetadataRecordV2.
  * Missing V2 fields are defaulted.
@@ -3284,4 +3284,90 @@ declare function toV2Record(record: FileMetadataRecord): FileMetadataRecordV2;
  */
 declare function buildFileWithStatus(record: FileMetadataRecord): FileWithStatus;
 
-export { ALL_SYSTEM_VARIABLES, type AddExtractionOptions, type AddRefOptions, type AuthCallbacks, AuthenticationError, type CleanupOrphanedOptions, ConfigurationError, type ContentTagConfig, type CreateFolderOptions, type CrudServiceLike, DEFAULT_DATE_FORMATS, type DatabaseSchemaDefinition, type DatabaseTrackingConfig, DirectoryExistsError, DirectoryNotEmptyError, DirectoryNotFoundError, type DownloadOptions, DropboxAuth, type DropboxAuthCallbacks, type DropboxAuthConfig, type DropboxConfig, DropboxModule, type DropboxTokenData, type ExtractionData, type ExtractionOptions, type ExtractionResult, type FileBrowserState, type FileDataStructure, FileExistsError, type FileInfo, type FileItem, FileManager, type FileManagerOptions, type FileMetadataInput, type FileMetadataRecord, type FileMetadataRecordV2, FileMetadataService, type FileMetadataServiceOptions, type FileMetadataUpdate, FileNotFoundError, type FileRef, type FileRefVisibility, type FileStatus, type FileSystemItem, FileTooLargeError, type FileWithStatus, type FindOrphanedOptions, type FolderItem, type GeneratedNameResult, type GoogleAuthConfig, GoogleDriveAuth, type GoogleDriveConfig, GoogleDriveModule, HAZO_FILES_DEFAULT_TABLE_NAME, HAZO_FILES_MIGRATION_V2, HAZO_FILES_MIGRATION_V3, HAZO_FILES_NAMING_DEFAULT_TABLE_NAME, HAZO_FILES_NAMING_TABLE_SCHEMA, HAZO_FILES_TABLE_SCHEMA, type HazoFilesColumnDefinitions, type HazoFilesConfig, HazoFilesError, type HazoFilesMigrationV2, type HazoFilesMigrationV3, type HazoFilesNamingColumnDefinitions, type HazoFilesNamingTableSchema, type HazoFilesTableSchema, type HazoLLMInstance, InvalidExtensionError, InvalidPathError, LLMExtractionService, type LLMFactory, type LLMFactoryConfig, type LLMProvider, type ListNamingConventionsOptions, type ListOptions, type LocalStorageConfig, LocalStorageModule, type MetadataLogger, type MigrationExecutor, type MigrationSchemaDefinition, type MoveOptions, type NameGenerationOptions, type NamingConventionInput, type NamingConventionRecord, NamingConventionService, type NamingConventionServiceOptions, type NamingConventionType, type NamingConventionUpdate, type NamingRuleConfiguratorProps, type NamingRuleHistoryEntry, type NamingRuleSchema, type NamingVariable, OperationError, type OperationResult, type ParsedNamingConvention, type PatternSegment, PermissionDeniedError, type ProgressCallback, type RemoveExtractionOptions, type RemoveRefsCriteria, type RenameOptions, SYSTEM_COUNTER_VARIABLES, SYSTEM_DATE_VARIABLES, SYSTEM_FILE_VARIABLES, type StorageModule, type StorageProvider, type TokenData, TrackedFileManager, type TrackedFileManagerFullOptions, type TrackedFileManagerOptions, type TrackedUploadOptions, type TreeNode, type UploadExtractOptions, type UploadExtractResult, UploadExtractService, type UploadOptions, type UploadWithRefOptions, type UseNamingRuleActions, type UseNamingRuleReturn, type UseNamingRuleState, type VariableCategory, addExtractionToFileData, backfillV2Defaults, buildFileWithStatus, clearExtractions, clonePattern, computeFileHash, computeFileHashFromStream, computeFileHashSync, computeFileInfo, createAndInitializeModule, createDropboxAuth, createDropboxModule, createEmptyFileDataStructure, createEmptyNamingRuleSchema, createFileItem, createFileManager, createFileMetadataService, createFileRef, createFolderItem, createGoogleDriveAuth, createGoogleDriveModule, createInitializedFileManager, createInitializedTrackedFileManager, createLLMExtractionService, createLiteralSegment, createLocalModule, createModule, createNamingConventionService, createTrackedFileManager, createUploadExtractService, createVariableSegment, deepMerge, errorResult, filterItems, formatBytes, formatCounter, formatDateToken, generateExtractionId, generateId, generatePreviewName, generateRefId, generateSampleConfig, generateSegmentId, getBaseName, getBreadcrumbs, getDirName, getExtension, getExtensionFromMime, getExtractionById, getExtractionCount, getExtractions, getFileCategory, getFileMetadataValues, getMergedData, getMigrationForTable, getMigrationV3ForTable, getMimeType, getNameWithoutExtension, getNamingSchemaForTable, getParentPath, getPathSegments, getRegisteredProviders, getRelativePath, getSchemaForTable, getSystemVariablePreviewValues, hasExtension, hasExtractionStructure, hasFileContentChanged, hashesEqual, hazo_files_generate_file_name, hazo_files_generate_folder_name, isAudio, isChildPath, isCounterVariable, isDateVariable, isDocument, isFile, isFileMetadataVariable, isFolder, isImage, isPreviewable, isProviderRegistered, isText, isVideo, joinPath, loadConfig, loadConfigAsync, migrateToV2, migrateToV3, normalizePath, parseConfig, parseFileData, parseFileRefs, parsePatternString, patternToString, recalculateMergedData, registerModule, removeExtractionById, removeExtractionByIndex, removeRefFromArray, removeRefsByCriteriaFromArray, sanitizeFilename, saveConfig, sortItems, stringifyFileData, stringifyFileRefs, successResult, toV2Record, updateExtractionById, validateExtractionData, validateFileDataStructure, validateNamingRuleSchema, validatePath };
+declare class NamingTemplate {
+    static render(template: string, vars: Record<string, unknown>): string;
+}
+
+type StoragePath = string;
+interface PutOpts {
+    /** Reject if the target path already exists (atomic). */
+    ifNotExists?: boolean;
+    /** Hint for content-type; provider may sniff if absent. */
+    contentType?: string;
+    /** Free-form key/value metadata persisted with the file when supported. */
+    metadata?: Record<string, string>;
+}
+interface PutResult {
+    /** Provider tag — `"app_file_server"`, `"gdrive"`, `"in_memory"`. */
+    provider: string;
+    /** Provider-native identifier (path for app-server; file ID for GDrive). */
+    native_id: string;
+    /** Size in bytes of the persisted body. */
+    size: number;
+}
+interface SignedUrlOpts {
+    /** Seconds the URL is valid for. */
+    ttl_seconds?: number;
+    /** Suggested download filename (Content-Disposition). */
+    filename_hint?: string;
+}
+interface ProbeResult {
+    ok: boolean;
+    /** Machine-readable error tag when ok=false. */
+    error?: "drive_not_shared" | "write_denied" | "invalid_id" | "transient" | "config_missing";
+    /** Free-form detail for logging. */
+    message?: string;
+}
+/**
+ * Storage provider abstraction. Every method MUST be idempotent at the
+ * data-content level — re-invoking put with identical body is allowed.
+ *
+ * Paths are logical; providers translate to native identifiers internally.
+ */
+interface FileStorageProvider {
+    put(path: StoragePath, body: Buffer | Readable, opts?: PutOpts): Promise<PutResult>;
+    get(path: StoragePath): Promise<Buffer | Readable>;
+    delete(path: StoragePath): Promise<void>;
+    exists(path: StoragePath): Promise<boolean>;
+    getSignedUrl(path: StoragePath, opts?: SignedUrlOpts): Promise<string>;
+    /** Used by validation cron + onboarding step 2. */
+    probe(): Promise<ProbeResult>;
+}
+
+interface WriteWithCollisionOpts {
+    provider: FileStorageProvider;
+    template: string;
+    vars: Record<string, unknown>;
+    body: Buffer;
+    /** Prefix to mount the rendered filename under, e.g. `"folders/abc123"`. */
+    path_prefix?: string;
+    /** Max attempts. Default 999. */
+    max_attempts?: number;
+    /** Extra opts passed to provider.put (ifNotExists is always forced true). */
+    put_opts?: Omit<PutOpts, "ifNotExists">;
+}
+declare function writeWithCollisionRetry(opts: WriteWithCollisionOpts): Promise<PutResult & {
+    logical_path: string;
+}>;
+
+interface FileRef {
+    ref_id: string;
+    ref_type: string;
+    ref_source: string;
+    form_id?: string;
+    field_id?: string;
+    message_id?: string;
+    document_id?: string;
+    created_at: string;
+    removed_at?: string;
+}
+interface FileWithRefs {
+    file_refs: FileRef[];
+    ref_count: number;
+}
+
+declare function addRef<T extends FileWithRefs>(file: T, ref: FileRef): T;
+declare function removeRef<T extends FileWithRefs>(file: T, ref_id: string, removed_at: string): T;
+declare function countRefs(file: Pick<FileWithRefs, "file_refs">): number;
+
+export { ALL_SYSTEM_VARIABLES, type AddExtractionOptions, type AddRefOptions, type AuthCallbacks, AuthenticationError, type CleanupOrphanedOptions, ConfigurationError, type ContentTagConfig, type CreateFolderOptions, type CrudServiceLike, DEFAULT_DATE_FORMATS, type DatabaseSchemaDefinition, type DatabaseTrackingConfig, DirectoryExistsError, DirectoryNotEmptyError, DirectoryNotFoundError, type DownloadOptions, DropboxAuth, type DropboxAuthCallbacks, type DropboxAuthConfig, type DropboxConfig, DropboxModule, type DropboxTokenData, type ExtractionData, type ExtractionOptions, type ExtractionResult, type FileBrowserState, type FileDataStructure, FileExistsError, type FileInfo, type FileItem, FileManager, type FileManagerOptions, type FileMetadataInput, type FileMetadataRecord, type FileMetadataRecordV2, FileMetadataService, type FileMetadataServiceOptions, type FileMetadataUpdate, FileNotFoundError, type FileRef$1 as FileRef, type FileRefVisibility, type FileStatus, type FileSystemItem, FileTooLargeError, type FileWithRefs, type FileWithStatus, type FindOrphanedOptions, type FolderItem, type GeneratedNameResult, type GoogleAuthConfig, GoogleDriveAuth, type GoogleDriveConfig, GoogleDriveModule, HAZO_FILES_DEFAULT_TABLE_NAME, HAZO_FILES_MIGRATION_V2, HAZO_FILES_MIGRATION_V3, HAZO_FILES_NAMING_DEFAULT_TABLE_NAME, HAZO_FILES_NAMING_TABLE_SCHEMA, HAZO_FILES_TABLE_SCHEMA, type HazoFilesColumnDefinitions, type HazoFilesConfig, type HazoFilesMigrationV2, type HazoFilesMigrationV3, type HazoFilesNamingColumnDefinitions, type HazoFilesNamingTableSchema, type HazoFilesTableSchema, type HazoLLMInstance, InvalidExtensionError, InvalidPathError, LLMExtractionService, type LLMFactory, type LLMFactoryConfig, type LLMProvider, type ListNamingConventionsOptions, type ListOptions, type LocalStorageConfig, LocalStorageModule, type MetadataLogger, type MigrationExecutor, type MigrationSchemaDefinition, type MoveOptions, type NameGenerationOptions, type NamingConventionInput, type NamingConventionRecord, NamingConventionService, type NamingConventionServiceOptions, type NamingConventionType, type NamingConventionUpdate, type NamingRuleConfiguratorProps, type NamingRuleHistoryEntry, type NamingRuleSchema, NamingTemplate, type NamingVariable, OperationError, type OperationResult, type ParsedNamingConvention, type PatternSegment, PermissionDeniedError, type ProgressCallback, type RemoveExtractionOptions, type RemoveRefsCriteria, type RenameOptions, SYSTEM_COUNTER_VARIABLES, SYSTEM_DATE_VARIABLES, SYSTEM_FILE_VARIABLES, type StorageModule, type StorageProvider, type TokenData, TrackedFileManager, type TrackedFileManagerFullOptions, type TrackedFileManagerOptions, type TrackedUploadOptions, type TreeNode, type UploadExtractOptions, type UploadExtractResult, UploadExtractService, type UploadOptions, type UploadWithRefOptions, type UseNamingRuleActions, type UseNamingRuleReturn, type UseNamingRuleState, type VariableCategory, type WriteWithCollisionOpts, addExtractionToFileData, addRef, backfillV2Defaults, buildFileWithStatus, clearExtractions, clonePattern, computeFileHash, computeFileHashFromStream, computeFileHashSync, computeFileInfo, countRefs, createAndInitializeModule, createDropboxAuth, createDropboxModule, createEmptyFileDataStructure, createEmptyNamingRuleSchema, createFileItem, createFileManager, createFileMetadataService, createFileRef, createFolderItem, createGoogleDriveAuth, createGoogleDriveModule, createInitializedFileManager, createInitializedTrackedFileManager, createLLMExtractionService, createLiteralSegment, createLocalModule, createModule, createNamingConventionService, createTrackedFileManager, createUploadExtractService, createVariableSegment, deepMerge, errorResult, filterItems, formatBytes, formatCounter, formatDateToken, generateExtractionId, generateId, generatePreviewName, generateRefId, generateSampleConfig, generateSegmentId, getBaseName, getBreadcrumbs, getDirName, getExtension, getExtensionFromMime, getExtractionById, getExtractionCount, getExtractions, getFileCategory, getFileMetadataValues, getMergedData, getMigrationForTable, getMigrationV3ForTable, getMimeType, getNameWithoutExtension, getNamingSchemaForTable, getParentPath, getPathSegments, getRegisteredProviders, getRelativePath, getSchemaForTable, getSystemVariablePreviewValues, hasExtension, hasExtractionStructure, hasFileContentChanged, hashesEqual, hazo_files_generate_file_name, hazo_files_generate_folder_name, isAudio, isChildPath, isCounterVariable, isDateVariable, isDocument, isFile, isFileMetadataVariable, isFolder, isImage, isPreviewable, isProviderRegistered, isText, isVideo, joinPath, loadConfig, loadConfigAsync, migrateToV2, migrateToV3, normalizePath, parseConfig, parseFileData, parseFileRefs, parsePatternString, patternToString, recalculateMergedData, registerModule, removeExtractionById, removeExtractionByIndex, removeRef, removeRefFromArray, removeRefsByCriteriaFromArray, sanitizeFilename, saveConfig, sortItems, stringifyFileData, stringifyFileRefs, successResult, toV2Record, updateExtractionById, validateExtractionData, validateFileDataStructure, validateNamingRuleSchema, validatePath, writeWithCollisionRetry };