rrq 0.7.1__tar.gz → 0.8.1__tar.gz

rrq-0.8.1/AGENTS.md

@@ -0,0 +1,32 @@
+# RRQ
+
+Redis-based async job queue library for Python.
+
+See @tests/CLAUDE.md for testing guidelines.
+
+## Commands
+```bash
+uv run pytest                     # Run tests
+uv run pytest --maxfail=1         # Debug failing tests
+uv run ruff format && uv run ruff check --fix   # Format and lint (run before commits)
+uv run ty check                   # Type check (must pass before commits)
+uv add <package>                  # Add dependency
+```
+
+## Code Style
+- Python 3.11+, double quotes, 88 char lines
+- Type hints on all functions, Pydantic V2 for validation
+- `snake_case` functions, `PascalCase` classes
+- Import order: stdlib → third-party → local
+- Early returns, `match/case` for complex conditionals
+- No blocking I/O in async contexts
+
+## Code References
+Use VS Code clickable format: `rrq/queue.py:45` or `rrq/worker.py:120-135`
+
+## Rules
+- Never commit broken tests
+- Use `uv` for all Python operations
+- Follow existing patterns in codebase
+- No sensitive data in logs
+- Ask before large cross-domain changes

rrq-0.8.1/CLAUDE.md

@@ -0,0 +1,32 @@
+# RRQ
+
+Redis-based async job queue library for Python.
+
+See @tests/CLAUDE.md for testing guidelines.
+
+## Commands
+```bash
+uv run pytest                     # Run tests
+uv run pytest --maxfail=1         # Debug failing tests
+uv run ruff format && uv run ruff check --fix   # Format and lint (run before commits)
+uv run ty check                   # Type check (must pass before commits)
+uv add <package>                  # Add dependency
+```
+
+## Code Style
+- Python 3.11+, double quotes, 88 char lines
+- Type hints on all functions, Pydantic V2 for validation
+- `snake_case` functions, `PascalCase` classes
+- Import order: stdlib → third-party → local
+- Early returns, `match/case` for complex conditionals
+- No blocking I/O in async contexts
+
+## Code References
+Use VS Code clickable format: `rrq/queue.py:45` or `rrq/worker.py:120-135`
+
+## Rules
+- Never commit broken tests
+- Use `uv` for all Python operations
+- Follow existing patterns in codebase
+- No sensitive data in logs
+- Ask before large cross-domain changes

{rrq-0.7.1 → rrq-0.8.1}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: rrq
-Version: 0.7.1
+Version: 0.8.1
 Summary: RRQ is a Python library for creating reliable job queues using Redis and asyncio
 Project-URL: Homepage, https://github.com/getresq/rrq
 Project-URL: Bug Tracker, https://github.com/getresq/rrq/issues
@@ -26,23 +26,30 @@ Provides-Extra: dev
 Requires-Dist: pytest-asyncio>=1.0.0; extra == 'dev'
 Requires-Dist: pytest-cov>=6.0.0; extra == 'dev'
 Requires-Dist: pytest>=8.3.5; extra == 'dev'
+Requires-Dist: ruff==0.14.9; extra == 'dev'
+Requires-Dist: ty==0.0.1-alpha.26; extra == 'dev'
 Description-Content-Type: text/markdown
 
 # RRQ: Reliable Redis Queue
 
 RRQ is a Python library for creating reliable job queues using Redis and `asyncio`, inspired by [ARQ (Async Redis Queue)](https://github.com/samuelcolvin/arq). It focuses on providing at-least-once job processing semantics with features like automatic retries, job timeouts, dead-letter queues, and graceful worker shutdown.
 
-## 🆕 What's New in v0.7.0
+## 🆕 What's New in v0.8.1
+
+- **Distributed Tracing**: One-line integrations for Datadog, OpenTelemetry, and Logfire
+- **Trace Context Propagation**: Automatic trace context from producer to worker
+- **Prometheus & StatsD Exporters**: New metrics exporters for monitoring
+
+## What's New in v0.7
 
 - **Comprehensive CLI Tools**: 15+ new commands for monitoring, debugging, and management
 - **Real-time Monitoring Dashboard**: Interactive dashboard with `rrq monitor`
 - **Enhanced DLQ Management**: Sophisticated filtering and requeuing capabilities
-- **Python 3.10 Support**: Expanded compatibility from Python 3.11+ to 3.10+
 - **Bug Fixes**: Critical fix for unique job enqueue failures with proper deferral
 
 ## Requirements
 
-- Python 3.10 or higher
+- Python 3.11 or higher
 - Redis 5.0 or higher
 - asyncio-compatible environment
 
@@ -144,6 +151,8 @@ this purpose.
 
 ```python
 # worker_script.py
+import asyncio
+
 from rrq.worker import RRQWorker
 from config import rrq_settings # Import your settings
 from main_setup import job_registry # Import your registry
@@ -153,7 +162,7 @@ worker = RRQWorker(settings=rrq_settings, job_registry=job_registry)
 
 # Run the worker (blocking)
 if __name__ == "__main__":
-    worker.run()
+    asyncio.run(worker.run())
 ```
 
 You can run multiple instances of `worker_script.py` for concurrent processing.
@@ -433,6 +442,41 @@ RRQ can be configured in several ways, with the following precedence:
 
 **Important Note on `job_registry`**: The `job_registry` attribute in your `RRQSettings` object is **critical** for RRQ to function. It must be an instance of `JobRegistry` and is used to register job handlers. Without a properly configured `job_registry`, workers will not know how to process jobs, and most operations will fail. Ensure it is set in your settings object to map job names to their respective handler functions.
 
+## Telemetry (Datadog / OTEL / Logfire)
+
+RRQ supports optional distributed tracing for enqueue and job execution. Enable the
+integration in both the producer and worker processes to get end-to-end traces
+across the Redis queue.
+
+### Datadog (ddtrace)
+
+```python
+from rrq.integrations.ddtrace import enable as enable_rrq_ddtrace
+
+enable_rrq_ddtrace(service="myapp-rrq")
+```
+
+This only instruments RRQ spans + propagation; it does **not** call
+`ddtrace.patch_all()`. Configure `ddtrace` in your app as you already do.
+
+### Logfire
+
+```python
+import logfire
+from rrq.integrations.logfire import enable as enable_rrq_logfire
+
+logfire.configure(service_name="myapp-rrq")
+enable_rrq_logfire(service_name="myapp-rrq")
+```
+
+### OpenTelemetry (generic)
+
+```python
+from rrq.integrations.otel import enable as enable_rrq_otel
+
+enable_rrq_otel(service_name="myapp-rrq")
+```
+
 ### Comprehensive CLI Command System
 - **New modular CLI architecture** with dedicated command modules for better organization
 - **Enhanced monitoring capabilities** with real-time dashboards and beautiful table output

{rrq-0.7.1 → rrq-0.8.1}/README.md

@@ -2,17 +2,22 @@
 
 RRQ is a Python library for creating reliable job queues using Redis and `asyncio`, inspired by [ARQ (Async Redis Queue)](https://github.com/samuelcolvin/arq). It focuses on providing at-least-once job processing semantics with features like automatic retries, job timeouts, dead-letter queues, and graceful worker shutdown.
 
-## 🆕 What's New in v0.7.0
+## 🆕 What's New in v0.8.1
+
+- **Distributed Tracing**: One-line integrations for Datadog, OpenTelemetry, and Logfire
+- **Trace Context Propagation**: Automatic trace context from producer to worker
+- **Prometheus & StatsD Exporters**: New metrics exporters for monitoring
+
+## What's New in v0.7
 
 - **Comprehensive CLI Tools**: 15+ new commands for monitoring, debugging, and management
 - **Real-time Monitoring Dashboard**: Interactive dashboard with `rrq monitor`
 - **Enhanced DLQ Management**: Sophisticated filtering and requeuing capabilities
-- **Python 3.10 Support**: Expanded compatibility from Python 3.11+ to 3.10+
 - **Bug Fixes**: Critical fix for unique job enqueue failures with proper deferral
 
 ## Requirements
 
-- Python 3.10 or higher
+- Python 3.11 or higher
 - Redis 5.0 or higher
 - asyncio-compatible environment
 
@@ -114,6 +119,8 @@ this purpose.
 
 ```python
 # worker_script.py
+import asyncio
+
 from rrq.worker import RRQWorker
 from config import rrq_settings # Import your settings
 from main_setup import job_registry # Import your registry
@@ -123,7 +130,7 @@ worker = RRQWorker(settings=rrq_settings, job_registry=job_registry)
 
 # Run the worker (blocking)
 if __name__ == "__main__":
-    worker.run()
+    asyncio.run(worker.run())
 ```
 
 You can run multiple instances of `worker_script.py` for concurrent processing.
@@ -403,6 +410,41 @@ RRQ can be configured in several ways, with the following precedence:
 
 **Important Note on `job_registry`**: The `job_registry` attribute in your `RRQSettings` object is **critical** for RRQ to function. It must be an instance of `JobRegistry` and is used to register job handlers. Without a properly configured `job_registry`, workers will not know how to process jobs, and most operations will fail. Ensure it is set in your settings object to map job names to their respective handler functions.
 
+## Telemetry (Datadog / OTEL / Logfire)
+
+RRQ supports optional distributed tracing for enqueue and job execution. Enable the
+integration in both the producer and worker processes to get end-to-end traces
+across the Redis queue.
+
+### Datadog (ddtrace)
+
+```python
+from rrq.integrations.ddtrace import enable as enable_rrq_ddtrace
+
+enable_rrq_ddtrace(service="myapp-rrq")
+```
+
+This only instruments RRQ spans + propagation; it does **not** call
+`ddtrace.patch_all()`. Configure `ddtrace` in your app as you already do.
+
+### Logfire
+
+```python
+import logfire
+from rrq.integrations.logfire import enable as enable_rrq_logfire
+
+logfire.configure(service_name="myapp-rrq")
+enable_rrq_logfire(service_name="myapp-rrq")
+```
+
+### OpenTelemetry (generic)
+
+```python
+from rrq.integrations.otel import enable as enable_rrq_otel
+
+enable_rrq_otel(service_name="myapp-rrq")
+```
+
 ### Comprehensive CLI Command System
 - **New modular CLI architecture** with dedicated command modules for better organization
 - **Enhanced monitoring capabilities** with real-time dashboards and beautiful table output

{rrq-0.7.1 → rrq-0.8.1}/example/rrq_example.py

@@ -163,18 +163,18 @@ async def main():
         _queue_name="high_priority",  # Example custom queue
     )
 
-    if all([job1, job2, job3, job4, job5]):
-        logger.info("Jobs enqueued successfully.")
-        logger.info(f"  - Job 1 (Success): {job1.id}")
-        logger.info(f"  - Job 2 (Failure): {job2.id}")
-        logger.info(f"  - Job 3 (Retry): {job3.id}")
-        logger.info(f"  - Job 4 (Deferred): {job4.id}")
-        logger.info(f"  - Job 5 (CustomQ): {job5.id}")
-    else:
+    if job1 is None or job2 is None or job3 is None or job4 is None or job5 is None:
         logger.error("Some jobs failed to enqueue.")
         await client.close()
         return
 
+    logger.info("Jobs enqueued successfully.")
+    logger.info(f"  - Job 1 (Success): {job1.id}")
+    logger.info(f"  - Job 2 (Failure): {job2.id}")
+    logger.info(f"  - Job 3 (Retry): {job3.id}")
+    logger.info(f"  - Job 4 (Deferred): {job4.id}")
+    logger.info(f"  - Job 5 (CustomQ): {job5.id}")
+
     await client.close()  # Close client connection if no longer needed
 
     # 5. Worker Setup
@@ -247,17 +247,12 @@ async def main():
 
 async def run_worker_async(worker: RRQWorker):
     """Helper function to run the worker's main loop asynchronously."""
-    # We don't use worker.run() here because it's synchronous.
-    # Instead, we directly await the async _run_loop method.
     try:
-        await worker._run_loop()
+        await worker.run()
     except Exception as e:
         logger.error(
-            f"Worker {worker.worker_id} _run_loop exited with error: {e}", exc_info=True
+            f"Worker {worker.worker_id} run exited with error: {e}", exc_info=True
         )
-    finally:
-        # Ensure resources are closed even if _run_loop fails unexpectedly
-        await worker._close_resources()
 
 
 if __name__ == "__main__":

{rrq-0.7.1 → rrq-0.8.1}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "hatchling.build"
 
 [project]
 name = "rrq"
-version = "0.7.1"
+version = "0.8.1"
 authors = [{ name = "Mazdak Rezvani", email = "mazdak@me.com" }]
 description = "RRQ is a Python library for creating reliable job queues using Redis and asyncio"
 readme = "README.md"
@@ -31,7 +31,13 @@ dependencies = [
 ]
 
 [project.optional-dependencies]
-dev = ["pytest>=8.3.5", "pytest-asyncio>=1.0.0", "pytest-cov>=6.0.0"]
+dev = [
+    "pytest>=8.3.5",
+    "pytest-asyncio>=1.0.0",
+    "pytest-cov>=6.0.0",
+    "ruff==0.14.9",
+    "ty==0.0.1-alpha.26",
+]
 
 [project.urls]
 "Homepage" = "https://github.com/getresq/rrq"
@@ -43,9 +49,3 @@ rrq = "rrq.cli:rrq"
 [tool.pytest.ini_options]
 asyncio_mode = "strict"
 asyncio_default_fixture_loop_scope = "function"
-
-[tool.pyrefly]
-python_interpreter = ".venv/bin/python"
-
-[dependency-groups]
-dev = []

{rrq-0.7.1 → rrq-0.8.1}/rrq/cli.py

@@ -502,7 +502,8 @@ def _run_single_worker(
     """Helper function to run a single RRQ worker instance."""
     rrq_settings = _load_app_settings(settings_object_path)
 
-    if not rrq_settings.job_registry:
+    job_registry = rrq_settings.job_registry
+    if job_registry is None:
         click.echo(
             click.style(
                 "ERROR: No 'job_registry'. You must provide a JobRegistry instance in settings.",
@@ -511,15 +512,16 @@ def _run_single_worker(
             err=True,
         )
         sys.exit(1)
+    assert job_registry is not None
 
     logger.debug(
-        f"Registered handlers (from effective registry): {rrq_settings.job_registry.get_registered_functions()}"
+        f"Registered handlers (from effective registry): {job_registry.get_registered_functions()}"
     )
     logger.debug(f"Effective RRQ settings for worker: {rrq_settings}")
 
     worker_instance = RRQWorker(
         settings=rrq_settings,
-        job_registry=rrq_settings.job_registry,
+        job_registry=job_registry,
         queues=queues_arg,
         burst=burst,
     )

{rrq-0.7.1 → rrq-0.8.1}/rrq/cli_commands/base.py

@@ -63,7 +63,10 @@ def auto_discover_commands(package_path: str) -> list[type[BaseCommand]]:
     # Get the package module
     try:
         package = importlib.import_module(package_path)
-        package_dir = os.path.dirname(package.__file__)
+        package_file = package.__file__
+        if package_file is None:
+            return commands
+        package_dir = os.path.dirname(package_file)
     except ImportError:
         # Return empty list for non-existent packages
         return commands

{rrq-0.7.1 → rrq-0.8.1}/rrq/cli_commands/commands/debug.py

@@ -452,7 +452,7 @@ class DebugCommands(AsyncCommand):
                 console.print(f"Delay: {delay}s")
 
         finally:
-            await client.aclose()
+            await client.close()
 
     async def _clear_data(
         self, settings_object_path: str, confirm: bool, pattern: str
@@ -548,4 +548,4 @@ class DebugCommands(AsyncCommand):
             console.print(f"\nStress test complete: {total_jobs} jobs submitted")
 
         finally:
-            await client.aclose()
+            await client.close()