prizm-airflow-plugin 0.1.0__tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (12) hide show
  1. prizm_airflow_plugin-0.1.0/PKG-INFO +65 -0
  2. prizm_airflow_plugin-0.1.0/README.md +43 -0
  3. prizm_airflow_plugin-0.1.0/prizm_airflow_plugin/__init__.py +1 -0
  4. prizm_airflow_plugin-0.1.0/prizm_airflow_plugin/plugin.py +1269 -0
  5. prizm_airflow_plugin-0.1.0/prizm_airflow_plugin.egg-info/PKG-INFO +65 -0
  6. prizm_airflow_plugin-0.1.0/prizm_airflow_plugin.egg-info/SOURCES.txt +10 -0
  7. prizm_airflow_plugin-0.1.0/prizm_airflow_plugin.egg-info/dependency_links.txt +1 -0
  8. prizm_airflow_plugin-0.1.0/prizm_airflow_plugin.egg-info/entry_points.txt +2 -0
  9. prizm_airflow_plugin-0.1.0/prizm_airflow_plugin.egg-info/requires.txt +1 -0
  10. prizm_airflow_plugin-0.1.0/prizm_airflow_plugin.egg-info/top_level.txt +1 -0
  11. prizm_airflow_plugin-0.1.0/pyproject.toml +44 -0
  12. prizm_airflow_plugin-0.1.0/setup.cfg +4 -0
prizm_airflow_plugin-0.1.0/PKG-INFO ADDED
@@ -0,0 +1,65 @@
1
+ Metadata-Version: 2.4
2
+ Name: prizm-airflow-plugin
3
+ Version: 0.1.0
4
+ Summary: Airflow plugin that pushes DAG run metadata to Prizm on DAG run success/failure
5
+ Author-email: Prizm Team <team@prizm.com>
6
+ Maintainer-email: Prizm Team <team@prizm.com>
7
+ License-Expression: MIT
8
+ Project-URL: Homepage, https://github.com/prizm/prizm-common
9
+ Project-URL: Repository, https://github.com/prizm/prizm-common.git
10
+ Keywords: prizm,airflow,plugin,data-lineage,observability
11
+ Classifier: Development Status :: 3 - Alpha
12
+ Classifier: Framework :: Apache Airflow
13
+ Classifier: Intended Audience :: Developers
14
+ Classifier: Programming Language :: Python :: 3
15
+ Classifier: Programming Language :: Python :: 3.9
16
+ Classifier: Programming Language :: Python :: 3.10
17
+ Classifier: Programming Language :: Python :: 3.11
18
+ Classifier: Programming Language :: Python :: 3.12
19
+ Requires-Python: >=3.9
20
+ Description-Content-Type: text/markdown
21
+ Requires-Dist: requests>=2.31.0
22
+
23
+ # Prizm Airflow Plugin
24
+
25
+ Airflow plugin that registers a DAG run listener and pushes DAG run, task and
26
+ lineage metadata to Prizm when a DAG run succeeds or fails.
27
+
28
+ ## Install
29
+
30
+ Install into the same environment as the Airflow scheduler (and workers):
31
+
32
+ ```bash
33
+ pip install prizm-airflow-plugin
34
+ ```
35
+
36
+ Restart the scheduler. Airflow discovers the plugin via the `airflow.plugins`
37
+ entry point; no file needs to be copied into `$AIRFLOW_HOME/plugins`.
38
+ `apache-airflow` is not installed by this package. Remove any previously
39
+ copied `prizm_airflow_plugin.py` from `$AIRFLOW_HOME/plugins` to avoid loading
40
+ it twice.
41
+
42
+ ## Configuration (Admin -> Variables)
43
+
44
+ | Variable | Description |
45
+ |---|---|
46
+ | `prizm_url` | Prizm base URL (plugin appends `/api/v1/schedule/airflow/plugin`) |
47
+ | `prizm_api_token` | Prizm API access token (`prizm_plugin_token` is a deprecated alias) |
48
+ | `prizm_connection_name` | Must match the Prizm source connection name |
49
+ | `prizm_allowed_dags` | Optional comma-separated globs, e.g. `dag_*` |
50
+ | `prizm_excluded_dags` | Optional comma-separated globs |
51
+ | `prizm_extract_source_code` | Optional, default `true`; set `false` to skip sending DAG source |
52
+ | `prizm_include_full_log` | Optional, default `false`; `true` sends the full log of failed tasks |
53
+
54
+ ## Build and publish
55
+
56
+ ```bash
57
+ make build
58
+ python -m twine upload dist/*
59
+ ```
60
+
61
+ Or use the manual "Publish to PyPI" GitHub workflow with `prizm-airflow-plugin`.
62
+
63
+ ## License
64
+
65
+ MIT License
prizm_airflow_plugin-0.1.0/README.md ADDED
@@ -0,0 +1,43 @@
1
+ # Prizm Airflow Plugin
2
+
3
+ Airflow plugin that registers a DAG run listener and pushes DAG run, task and
4
+ lineage metadata to Prizm when a DAG run succeeds or fails.
5
+
6
+ ## Install
7
+
8
+ Install into the same environment as the Airflow scheduler (and workers):
9
+
10
+ ```bash
11
+ pip install prizm-airflow-plugin
12
+ ```
13
+
14
+ Restart the scheduler. Airflow discovers the plugin via the `airflow.plugins`
15
+ entry point; no file needs to be copied into `$AIRFLOW_HOME/plugins`.
16
+ `apache-airflow` is not installed by this package. Remove any previously
17
+ copied `prizm_airflow_plugin.py` from `$AIRFLOW_HOME/plugins` to avoid loading
18
+ it twice.
19
+
20
+ ## Configuration (Admin -> Variables)
21
+
22
+ | Variable | Description |
23
+ |---|---|
24
+ | `prizm_url` | Prizm base URL (plugin appends `/api/v1/schedule/airflow/plugin`) |
25
+ | `prizm_api_token` | Prizm API access token (`prizm_plugin_token` is a deprecated alias) |
26
+ | `prizm_connection_name` | Must match the Prizm source connection name |
27
+ | `prizm_allowed_dags` | Optional comma-separated globs, e.g. `dag_*` |
28
+ | `prizm_excluded_dags` | Optional comma-separated globs |
29
+ | `prizm_extract_source_code` | Optional, default `true`; set `false` to skip sending DAG source |
30
+ | `prizm_include_full_log` | Optional, default `false`; `true` sends the full log of failed tasks |
31
+
32
+ ## Build and publish
33
+
34
+ ```bash
35
+ make build
36
+ python -m twine upload dist/*
37
+ ```
38
+
39
+ Or use the manual "Publish to PyPI" GitHub workflow with `prizm-airflow-plugin`.
40
+
41
+ ## License
42
+
43
+ MIT License
prizm_airflow_plugin-0.1.0/prizm_airflow_plugin/__init__.py ADDED
@@ -0,0 +1 @@
1
+ """Prizm Airflow plugin. Airflow discovers it via the ``airflow.plugins`` entry point."""