@jrmc/adonis-etl 1.0.0-alpha.1 → 1.0.0-alpha.3

package/README.md

@@ -1 +1,200 @@
-# adonis-etl
+# @jrmc/adonis-etl
+
+[![npm version](https://badge.fury.io/js/%40jrmc%2Fadonis-etl.svg)](https://badge.fury.io/js/%40jrmc%2Fadonis-etl)
+[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
+
+AdonisJS ETL skaffold commands package - Generate ETL (Extract, Transform, Load) components for your AdonisJS applications.
+
+## Features
+
+- 🚀 **Interactive CLI** - Guided command to create ETL components
+- 📦 **Component Generation** - Generate Source, Transform, and Destination classes
+- 🎯 **Smart Naming** - Automatic class naming based on your ETL process
+- 🔧 **TypeScript Ready** - Full TypeScript support with proper interfaces
+- 📁 **Organized Structure** - Files are created in proper directories (`app/etl/`)
+
+## Installation
+
+```bash
+node ace add @jrmc/adonis-etl
+```
+
+### Custom Directory Configuration
+
+You can customize the directory where ETL files are generated by adding a `directories` configuration to your `adonisrc.ts`:
+
+```typescript
+// adonisrc.ts
+export default defineConfig({
+  directories: {
+    etl: 'etl', // Custom path for ETL files
+  },
+  // ... other configurations
+})
+```
+
+If not specified, files will be generated in the default `app/etl/` directory.
+
+## Usage
+
+### Generate ETL Components
+
+Run the interactive command to create your ETL components:
+
+```bash
+node ace make:etl my-process
+```
+
+The command will guide you through:
+
+1. **Selecting components** - Choose which ETL components to create:
+   - Source (data extraction)
+   - Transform (data transformation)
+   - Destination (data loading)
+
+2. **Defining source type** - Specify your data source (e.g., `database`, `api`, `file`)
+
+3. **Defining destination type** - Specify your data destination (e.g., `database`, `api`, `file`)
+
+### Example
+
+```bash
+$ node ace make:etl import-product
+
+? Which ETL components do you want to create? › 
+❯◉ Source
+ ◉ Transform  
+ ◉ Destination
+
+? What is the source type? (e.g., database, api, file) › csv
+? What is the destination type? (e.g., database, api, file) › db
+
+✅ ETL files created successfully for: import-product
+```
+
+This will create (with default configuration):
+
+- `app/etl/sources/import_product_csv_source.ts`
+- `app/etl/transforms/import_product_csv_to_db_transform.ts`
+- `app/etl/destinations/import_product_db_destination.ts`
+
+Or with custom directory configuration (`directories.etl: 'Opsone/jerem'`):
+
+- `Opsone/jerem/sources/import_product_csv_source.ts`
+- `Opsone/jerem/transforms/import_product_csv_to_db_transform.ts`
+- `Opsone/jerem/destinations/import_product_db_destination.ts`
+
+## Generated Files
+
+### Source Component
+
+```typescript
+import { Source } from '@jrmc/adonis-etl'
+
+export default class ImportProductCsvSource implements Source {
+  async *each() {
+    // Implement your data extraction logic here
+  }
+}
+```
+
+### Transform Component
+
+```typescript
+import { Transform } from '@jrmc/adonis-etl'
+
+export default class ImportProductCsvToDbTransform implements Transform {
+  async process(row: unknown) {
+    // Implement your data transformation logic here
+    return row
+  }
+}
+```
+
+### Destination Component
+
+```typescript
+import { Destination } from '@jrmc/adonis-etl'
+
+export default class ImportProductDbDestination implements Destination {
+  async write(row: unknown) {
+    // Implement your data loading logic here
+  }
+}
+```
+
+## Dependencies
+
+This package requires:
+- `@jrmc/etl` - The core ETL library
+- AdonisJS 6.x
+- Node.js 22.17.0+
+
+## File Structure
+
+Generated files are organized in the following structure:
+
+**Default structure:**
+```
+app/
+└── etl/
+    ├── sources/
+    │   └── your_source_files.ts
+    ├── transforms/
+    │   └── your_transform_files.ts
+    └── destinations/
+        └── your_destination_files.ts
+```
+
+**Custom structure (with `directories.etl: 'src/module/etl'`):**
+```
+src/
+└── module/
+    └── etl/
+        ├── sources/
+        │   └── your_source_files.ts
+        ├── transforms/
+        │   └── your_transform_files.ts
+        └── destinations/
+            └── your_destination_files.ts
+```
+
+## Naming Convention
+
+The generated class names follow this pattern:
+
+- **Source**: `{process_name}_{source_type}_source`
+- **Transform**: `{process_name}_{source_type}_to_{destination_type}_transform`
+- **Destination**: `{process_name}_{destination_type}_destination`
+
+All names are automatically converted to snake_case for file names and PascalCase for class names.
+
+**Example**: For process `import-product` with source `csv` and destination `db`:
+- File: `import_product_csv_source.ts` → Class: `ImportProductCsvSource`
+- File: `import_product_csv_to_db_transform.ts` → Class: `ImportProductCsvToDbTransform`
+- File: `import_product_db_destination.ts` → Class: `ImportProductDbDestination`
+
+## Contributing
+
+Contributions are welcome! Please feel free to submit a Pull Request.
+
+## License
+
+This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.
+
+## Author
+
+**Jeremy Chaufourier**
+- Email: jeremy@chaufourier.fr
+- GitHub: [@batosai](https://github.com/batosai)
+
+## Changelog
+
+### 1.0.0-alpha.1
+- Initial release
+- Interactive ETL component generation
+- Support for Source, Transform, and Destination components
+- TypeScript support
+
+### 1.0.0-alpha.2
+- Custom directory configuration support via `directories.etl` in adonisrc.ts

package/build/stubs/make/etl/destinations/main.ts.stub

@@ -1,7 +1,7 @@
 {{#var resourceFileName = string(className).snakeCase().ext('.ts').toString()}}
 {{{
   exports({
-    to: app.makePath('app/etl/destinations', resourceFileName)
+    to: app.makePath(app.rcFile.directories['etl'] || 'app/etl/', 'destinations', resourceFileName)
   })
 }}}
 import { Destination } from '@jrmc/adonis-etl'

package/build/stubs/make/etl/sources/main.ts.stub

@@ -1,7 +1,7 @@
 {{#var resourceFileName = string(className).snakeCase().ext('.ts').toString()}}
 {{{
   exports({
-    to: app.makePath('app/etl/sources', resourceFileName)
+    to: app.makePath(app.rcFile.directories['etl'] || 'app/etl/', 'sources', resourceFileName)
   })
 }}}
 import { Source } from '@jrmc/adonis-etl'

package/build/stubs/make/etl/transforms/main.ts.stub

@@ -1,7 +1,7 @@
 {{#var resourceFileName = string(className).snakeCase().ext('.ts').toString()}}
 {{{
   exports({
-    to: app.makePath('app/etl/transforms', resourceFileName)
+    to: app.makePath(app.rcFile.directories['etl'] || 'app/etl/', 'transforms', resourceFileName)
   })
 }}}
 import { Transform } from '@jrmc/adonis-etl'

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@jrmc/adonis-etl",
-  "version": "1.0.0-alpha.1",
+  "version": "1.0.0-alpha.3",
   "keywords": [
     "adonisjs",
     "etl",
@@ -9,7 +9,7 @@
   ],
   "author": "Jeremy Chaufourier jeremy@chaufourier.fr",
   "license": "MIT",
-  "description": "AdonisJS ETL commands package",
+  "description": "AdonisJS ETL skaffold commands package - Generate ETL (Extract, Transform, Load) components for your AdonisJS applications.",
   "type": "module",
   "main": "build/index.js",
   "repository": {