talend-task 0.1.0__tar.gz

talend_task-0.1.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Corey Goldberg
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

talend_task-0.1.0/PKG-INFO

@@ -0,0 +1,146 @@
+Metadata-Version: 2.4
+Name: talend_task
+Version: 0.1.0
+Summary: CLI for running ETL jobs (tasks) remotely via Talend Cloud API
+Author: Corey Goldberg
+Maintainer: Corey Goldberg
+License-Expression: MIT
+Project-URL: homepage, https://github.com/cgoldberg/talend_task
+Project-URL: source, https://github.com/cgoldberg/talend_task
+Project-URL: download, https://pypi.org/project/talend_task
+Keywords: talend,etl,database,api
+Classifier: Environment :: Console
+Classifier: Programming Language :: Python
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Programming Language :: Python :: 3.14
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: python-dotenv==1.2.2
+Requires-Dist: requests==2.33.1
+Requires-Dist: rich==15.0.0
+Dynamic: license-file
+
+# talend-task
+
+## CLI for running ETL jobs (tasks) remotely via Talend Cloud API
+
+- Copyright (c) 2026 [Corey Goldberg](https://github.com/cgoldberg)
+
+<table>
+  <tr>
+    <td>Development</td>
+    <td>
+      <a href="https://github.com/cgoldberg/talend-task">
+        GitHub
+      </a>
+    </td>
+  </tr>
+  <tr>
+    <td>License</td>
+    <td>
+      <a href="https://raw.githubusercontent.com/cgoldberg/talend-task/refs/heads/master/LICENSE">
+        MIT
+      </a>
+    </td>
+  </tr>
+  <tr>
+    <td>Releases</td>
+    <td>
+      <a href="https://pypi.org/project/talend-task">
+        PyPI
+      </a>
+    </td>
+  </tr>
+  <tr>
+    <td>Supported Python Versions</td>
+    <td>
+      3.10+
+    </td>
+  </tr>
+</table>
+
+----
+
+## About:
+
+`talend-task` is a Python CLI tool for remotely running
+[Talend](https://talend.com) ETL jobs (tasks).
+
+You can specify a job to run by its name (using the `--job` argument)
+or it will list all available jobs and let you select which one to run.
+
+----
+
+## Installation:
+
+#### Install from [PyPI](https://pypi.org/project/talend-task):
+
+```
+pip install talend-task
+```
+
+----
+
+## Configuration:
+
+You need to configure an Access Token (generated in
+[Talend Management Console](https://help.qlik.com/talend/management-console-user-guide))
+and the API endpoint URL you will connect to (i.e.
+`https://api.<region>.talend.com`).
+
+These are setup using the `API_URL` and `ACCESS_TOKEN` environment variables:
+
+```
+$ export API_URL=<endpoint URL>
+$ export ACCESS_TOKEN=<access token>
+```
+
+You can also set this in an `.env` file in the current directory.
+
+For example:
+
+```
+API_URL=https://api.us-west.cloud.talend.com
+ACCESS_TOKEN=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
+```
+
+----
+
+## CLI Options:
+
+```
+$ talend_task --help
+usage: talend_task [-h] [--wait] [--job JOB]
+
+options:
+  -h, --help  show this help message and exit
+  --wait      wait for task to complete and show status
+  --job JOB   Talend ETL task name
+```
+
+----
+
+## Usage Examples:
+
+Launch the CLI to select a job to run:
+
+```
+talend_task
+```
+
+Run a job named "MyJob":
+
+```
+talend_task --job MyJob
+```
+
+Run a job named "MyJob" and wait (poll) until the job completes:
+
+```
+talend_task --wait --job MyJob
+```

talend_task-0.1.0/README.md

@@ -0,0 +1,119 @@
+# talend-task
+
+## CLI for running ETL jobs (tasks) remotely via Talend Cloud API
+
+- Copyright (c) 2026 [Corey Goldberg](https://github.com/cgoldberg)
+
+<table>
+  <tr>
+    <td>Development</td>
+    <td>
+      <a href="https://github.com/cgoldberg/talend-task">
+        GitHub
+      </a>
+    </td>
+  </tr>
+  <tr>
+    <td>License</td>
+    <td>
+      <a href="https://raw.githubusercontent.com/cgoldberg/talend-task/refs/heads/master/LICENSE">
+        MIT
+      </a>
+    </td>
+  </tr>
+  <tr>
+    <td>Releases</td>
+    <td>
+      <a href="https://pypi.org/project/talend-task">
+        PyPI
+      </a>
+    </td>
+  </tr>
+  <tr>
+    <td>Supported Python Versions</td>
+    <td>
+      3.10+
+    </td>
+  </tr>
+</table>
+
+----
+
+## About:
+
+`talend-task` is a Python CLI tool for remotely running
+[Talend](https://talend.com) ETL jobs (tasks).
+
+You can specify a job to run by its name (using the `--job` argument)
+or it will list all available jobs and let you select which one to run.
+
+----
+
+## Installation:
+
+#### Install from [PyPI](https://pypi.org/project/talend-task):
+
+```
+pip install talend-task
+```
+
+----
+
+## Configuration:
+
+You need to configure an Access Token (generated in
+[Talend Management Console](https://help.qlik.com/talend/management-console-user-guide))
+and the API endpoint URL you will connect to (i.e.
+`https://api.<region>.talend.com`).
+
+These are setup using the `API_URL` and `ACCESS_TOKEN` environment variables:
+
+```
+$ export API_URL=<endpoint URL>
+$ export ACCESS_TOKEN=<access token>
+```
+
+You can also set this in an `.env` file in the current directory.
+
+For example:
+
+```
+API_URL=https://api.us-west.cloud.talend.com
+ACCESS_TOKEN=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
+```
+
+----
+
+## CLI Options:
+
+```
+$ talend_task --help
+usage: talend_task [-h] [--wait] [--job JOB]
+
+options:
+  -h, --help  show this help message and exit
+  --wait      wait for task to complete and show status
+  --job JOB   Talend ETL task name
+```
+
+----
+
+## Usage Examples:
+
+Launch the CLI to select a job to run:
+
+```
+talend_task
+```
+
+Run a job named "MyJob":
+
+```
+talend_task --job MyJob
+```
+
+Run a job named "MyJob" and wait (poll) until the job completes:
+
+```
+talend_task --wait --job MyJob
+```

talend_task-0.1.0/pyproject.toml

@@ -0,0 +1,67 @@
+[build-system]
+requires = ["setuptools"]
+build-backend = "setuptools.build_meta"
+
+[project]
+name = "talend_task"
+version = "0.1.0"
+description = "CLI for running ETL jobs (tasks) remotely via Talend Cloud API"
+license = "MIT"
+license-files = ["LICENSE"]
+authors = [{name = "Corey Goldberg"}]
+maintainers = [{name = "Corey Goldberg"}]
+readme = "README.md"
+requires-python = ">=3.10"
+keywords = ["talend", "etl", "database", "api"]
+classifiers = [
+    "Environment :: Console",
+    "Programming Language :: Python",
+    "Programming Language :: Python :: 3",
+    "Programming Language :: Python :: 3.10",
+    "Programming Language :: Python :: 3.11",
+    "Programming Language :: Python :: 3.12",
+    "Programming Language :: Python :: 3.13",
+    "Programming Language :: Python :: 3.14",
+]
+dependencies = [
+    "python-dotenv==1.2.2",
+    "requests==2.33.1",
+    "rich==15.0.0",
+]
+
+[project.scripts]
+talend_task = "talend_task:main"
+
+[project.urls]
+homepage = "https://github.com/cgoldberg/talend_task"
+source = "https://github.com/cgoldberg/talend_task"
+download = "https://pypi.org/project/talend_task"
+
+[dependency-groups]
+lint = [
+    "black",
+    "ruff",
+]
+validate = [
+    "packaging",
+    "validate-pyproject",
+]
+
+[tool.black]
+line-length = 88
+target-version = ["py310"]
+
+[tool.ruff]
+line-length = 88
+respect-gitignore = true
+target-version = "py310"
+
+[tool.ruff.lint]
+select = [
+    "E", "F", "I", "PT", "RUF", "TID", "W"
+]
+fixable = ["ALL"]
+
+[tool.ruff.format]
+docstring-code-line-length = 88
+docstring-code-format = true

talend_task-0.1.0/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+

talend_task-0.1.0/talend_task.egg-info/PKG-INFO

@@ -0,0 +1,146 @@
+Metadata-Version: 2.4
+Name: talend_task
+Version: 0.1.0
+Summary: CLI for running ETL jobs (tasks) remotely via Talend Cloud API
+Author: Corey Goldberg
+Maintainer: Corey Goldberg
+License-Expression: MIT
+Project-URL: homepage, https://github.com/cgoldberg/talend_task
+Project-URL: source, https://github.com/cgoldberg/talend_task
+Project-URL: download, https://pypi.org/project/talend_task
+Keywords: talend,etl,database,api
+Classifier: Environment :: Console
+Classifier: Programming Language :: Python
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Programming Language :: Python :: 3.14
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: python-dotenv==1.2.2
+Requires-Dist: requests==2.33.1
+Requires-Dist: rich==15.0.0
+Dynamic: license-file
+
+# talend-task
+
+## CLI for running ETL jobs (tasks) remotely via Talend Cloud API
+
+- Copyright (c) 2026 [Corey Goldberg](https://github.com/cgoldberg)
+
+<table>
+  <tr>
+    <td>Development</td>
+    <td>
+      <a href="https://github.com/cgoldberg/talend-task">
+        GitHub
+      </a>
+    </td>
+  </tr>
+  <tr>
+    <td>License</td>
+    <td>
+      <a href="https://raw.githubusercontent.com/cgoldberg/talend-task/refs/heads/master/LICENSE">
+        MIT
+      </a>
+    </td>
+  </tr>
+  <tr>
+    <td>Releases</td>
+    <td>
+      <a href="https://pypi.org/project/talend-task">
+        PyPI
+      </a>
+    </td>
+  </tr>
+  <tr>
+    <td>Supported Python Versions</td>
+    <td>
+      3.10+
+    </td>
+  </tr>
+</table>
+
+----
+
+## About:
+
+`talend-task` is a Python CLI tool for remotely running
+[Talend](https://talend.com) ETL jobs (tasks).
+
+You can specify a job to run by its name (using the `--job` argument)
+or it will list all available jobs and let you select which one to run.
+
+----
+
+## Installation:
+
+#### Install from [PyPI](https://pypi.org/project/talend-task):
+
+```
+pip install talend-task
+```
+
+----
+
+## Configuration:
+
+You need to configure an Access Token (generated in
+[Talend Management Console](https://help.qlik.com/talend/management-console-user-guide))
+and the API endpoint URL you will connect to (i.e.
+`https://api.<region>.talend.com`).
+
+These are setup using the `API_URL` and `ACCESS_TOKEN` environment variables:
+
+```
+$ export API_URL=<endpoint URL>
+$ export ACCESS_TOKEN=<access token>
+```
+
+You can also set this in an `.env` file in the current directory.
+
+For example:
+
+```
+API_URL=https://api.us-west.cloud.talend.com
+ACCESS_TOKEN=XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
+```
+
+----
+
+## CLI Options:
+
+```
+$ talend_task --help
+usage: talend_task [-h] [--wait] [--job JOB]
+
+options:
+  -h, --help  show this help message and exit
+  --wait      wait for task to complete and show status
+  --job JOB   Talend ETL task name
+```
+
+----
+
+## Usage Examples:
+
+Launch the CLI to select a job to run:
+
+```
+talend_task
+```
+
+Run a job named "MyJob":
+
+```
+talend_task --job MyJob
+```
+
+Run a job named "MyJob" and wait (poll) until the job completes:
+
+```
+talend_task --wait --job MyJob
+```

talend_task-0.1.0/talend_task.egg-info/SOURCES.txt

@@ -0,0 +1,10 @@
+LICENSE
+README.md
+pyproject.toml
+talend_task.py
+talend_task.egg-info/PKG-INFO
+talend_task.egg-info/SOURCES.txt
+talend_task.egg-info/dependency_links.txt
+talend_task.egg-info/entry_points.txt
+talend_task.egg-info/requires.txt
+talend_task.egg-info/top_level.txt

talend_task-0.1.0/talend_task.egg-info/dependency_links.txt

@@ -0,0 +1 @@
+

talend_task-0.1.0/talend_task.egg-info/entry_points.txt

@@ -0,0 +1,2 @@
+[console_scripts]
+talend_task = talend_task:main

talend_task-0.1.0/talend_task.egg-info/requires.txt

@@ -0,0 +1,3 @@
+python-dotenv==1.2.2
+requests==2.33.1
+rich==15.0.0

talend_task-0.1.0/talend_task.egg-info/top_level.txt

@@ -0,0 +1 @@
+talend_task

talend_task-0.1.0/talend_task.py

@@ -0,0 +1,166 @@
+#!/usr/bin/env python
+#
+# Copyright (c) 2026 Corey Goldberg
+# License: MIT
+
+
+"""CLI for running ETL jobs (tasks) remotely via Talend Cloud API."""
+
+import argparse
+import logging
+import os
+import sys
+import time
+from datetime import datetime
+from urllib.parse import urljoin
+
+import requests
+from dotenv import load_dotenv
+from rich.progress import Progress, TimeElapsedColumn
+
+logging.basicConfig(level=logging.INFO, format="%(message)s")
+logger = logging.getLogger(__name__)
+
+
+load_dotenv()
+try:
+    ACCESS_TOKEN = os.environ["ACCESS_TOKEN"]
+    API_URL = os.environ["API_URL"]
+except KeyError as e:
+    logger.error(f"fatal: .env file or environment variables must be set. Missing: {e}")
+    sys.exit(1)
+
+
+BASE_URL = urljoin(API_URL, "processing")
+
+
+def _convert_time(seconds):
+    mins, secs = divmod(seconds, 60)
+    hours, mins = divmod(mins, 60)
+    return f"{hours:02.0f}:{mins:02.0f}:{secs:02.0f}"
+
+
+def _send_request(url, payload=None):
+    headers = {
+        "Authorization": f"Bearer {ACCESS_TOKEN}",
+        "Content-Type": "application/json",
+    }
+    if payload:
+        response = requests.post(url, headers=headers, json=payload)
+    else:
+        response = requests.get(url, headers=headers)
+    response.raise_for_status()
+    return response.json()
+
+
+def get_jobs():
+    url = f"{BASE_URL}/executables/tasks"
+    result = _send_request(url)
+    jobs = [(item["name"], item["executable"]) for item in result["items"]]
+    return jobs
+
+
+def run_talend_job(job_id):
+    url = f"{BASE_URL}/executions"
+    payload = {"executable": job_id}
+    result = _send_request(url, payload)
+    exec_id = result["executionId"]
+    return exec_id
+
+
+def get_execution_status(execution_id):
+    url = f"{BASE_URL}/executions/{execution_id}"
+    result = _send_request(url)
+    status = result["status"]
+    return status
+
+
+def run_console(job_id):
+    exec_id = run_talend_job(job_id)
+    columns = (*Progress.get_default_columns(), TimeElapsedColumn())
+    with Progress(*columns, transient=True) as progress:
+        task = progress.add_task("twiddling thumbs ", total=None)
+        while True:
+            status = get_execution_status(exec_id)
+            if status not in ("dispatching", "executing"):
+                return status
+            else:
+                time.sleep(5)
+            progress.advance(task)
+
+
+def run_unnatended(job_id):
+    exec_id = run_talend_job(job_id)
+    while True:
+        status = get_execution_status(exec_id)
+        logger.info(
+            f"status: {status} ({datetime.now().strftime('%Y-%m-%d %H:%M:%S')})"
+        )
+        if status not in ("dispatching", "executing"):
+            return status
+        else:
+            time.sleep(10)
+
+
+def main():
+    parser = argparse.ArgumentParser()
+    parser.add_argument(
+        "--wait",
+        action="store_true",
+        help="wait for task to complete and show status",
+    )
+    parser.add_argument(
+        "--job",
+        help="Talend ETL task name",
+    )
+    args = parser.parse_args()
+    job_name = args.job
+    wait_enabled = args.wait
+    jobs = get_jobs()
+    if job_name:
+        if job_name not in (job[0] for job in jobs):
+            sys.exit(f"Invalid ETL job: {job_name}")
+        job_id = next(job[1] for job in jobs if job[0] == job_name)
+        logger.info(f"\nExecuting job: '{job_name}' ....")
+        if wait_enabled:
+            start = time.time()
+            status = run_unnatended(job_id)
+            stop = time.time()
+            elapsed = _convert_time(stop - start)
+            logger.info(f"\nExecution of job '{job_name}' finished")
+            logger.info(f"status: '{status}' (time: {elapsed})")
+        else:
+            run_talend_job(job_id)
+    else:
+        try:
+            logger.info("\nAvailable ETL Jobs:")
+            logger.info("-------------------")
+            for num, job in enumerate(jobs, 1):
+                logger.info(f"{num}) {job[0]}")
+            job_number = input("\nSelect a job number to run: ")
+            try:
+                job_number = int(job_number)
+                if job_number > len(jobs):
+                    raise ValueError()
+            except ValueError:
+                raise ValueError("Invalid job number!")
+            job_name, job_id = jobs[job_number - 1]
+            logger.info(f"\nExecuting job: {job_name} ({job_id})\n")
+            if wait_enabled:
+                start = time.time()
+                status = run_console(job_id)
+                stop = time.time()
+                elapsed = _convert_time(stop - start)
+                logger.info(
+                    f"\nExecution finished with status: '{status}' (time: {elapsed})"
+                )
+                input("\nPress <Enter> to exit...")
+            else:
+                run_talend_job(job_id)
+        except (ValueError, KeyboardInterrupt) as e:
+            input(f"\n{e}\nPress <Enter> to exit...")
+            sys.exit()
+
+
+if __name__ == "__main__":
+    main()