PyPI - dataops-testgen - Versions diffs - 5.32.2__tar.gz → 5.33.2__tar.gz - Mend

dataops-testgen 5.32.2tar.gz → 5.33.2tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Files changed (721) hide show

dataops-testgen-5.33.2/PKG-INFO ADDED Viewed

@@ -0,0 +1,169 @@
+Metadata-Version: 2.1
+Name: dataops-testgen
+Version: 5.33.2
+Summary: DataKitchen's Data Quality DataOps TestGen
+Author-email: "DataKitchen, Inc." <info@datakitchen.io>
+Maintainer-email: "DataKitchen, Inc." <info@datakitchen.io>
+Project-URL: Source Code, https://github.com/DataKitchen/dataops-testgen
+Project-URL: Bug Tracker, https://github.com/DataKitchen/dataops-testgen/issues
+Project-URL: Documentation, https://docs.datakitchen.io/testgen/what-is-testgen/
+Project-URL: Release Notes, https://docs.datakitchen.io/testgen/release-notes/
+Project-URL: Slack, https://data-observability-slack.datakitchen.io/join
+Project-URL: Homepage, https://example.com
+Keywords: dataops,data,quality,testing,database,profiling
+Classifier: License :: OSI Approved :: Apache Software License
+Classifier: Development Status :: 5 - Production/Stable
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: System :: Monitoring
+Requires-Python: >=3.11
+Description-Content-Type: text/markdown
+License-File: LICENSE
+License-File: NOTICE
+Requires-Dist: PyYAML==6.0.3
+Requires-Dist: click==8.3.1
+Requires-Dist: sqlalchemy==2.0.48
+Requires-Dist: databricks-sql-connector==4.2.5
+Requires-Dist: databricks-sqlalchemy==2.0.9
+Requires-Dist: databricks-sdk>=0.20.0
+Requires-Dist: snowflake-sqlalchemy==1.9.0
+Requires-Dist: sqlalchemy-bigquery==1.16.0
+Requires-Dist: oracledb==3.4.0
+Requires-Dist: hdbcli==2.25.31
+Requires-Dist: sqlalchemy-hana==4.4.0
+Requires-Dist: pyodbc==5.2.0
+Requires-Dist: psycopg2-binary==2.9.11
+Requires-Dist: pycryptodome==3.21
+Requires-Dist: prettytable==3.7.0
+Requires-Dist: requests_extensions==1.1.3
+Requires-Dist: numpy==2.1.3
+Requires-Dist: pandas==2.2.3
+Requires-Dist: streamlit==1.55.0
+Requires-Dist: streamlit-extras==0.3.0
+Requires-Dist: streamlit-aggrid==0.3.4.post3
+Requires-Dist: plotly_express==0.4.1
+Requires-Dist: streamlit-authenticator==0.2.3
+Requires-Dist: streamlit-javascript==0.1.5
+Requires-Dist: progress==1.6
+Requires-Dist: beautifulsoup4==4.12.3
+Requires-Dist: trino==0.327.0
+Requires-Dist: xlsxwriter==3.2.0
+Requires-Dist: psutil==5.9.8
+Requires-Dist: concurrent_log_handler==0.9.25
+Requires-Dist: cryptography==46.0.6
+Requires-Dist: validators==0.33.0
+Requires-Dist: reportlab==4.2.2
+Requires-Dist: cron-converter==1.2.1
+Requires-Dist: cron-descriptor==2.0.5
+Requires-Dist: pybars3==0.9.7
+Requires-Dist: azure-identity==1.25.1
+Requires-Dist: statsmodels==0.14.6
+Requires-Dist: holidays~=0.89
+Requires-Dist: pyarrow==21.0.0
+Requires-Dist: matplotlib==3.9.2
+Requires-Dist: scipy==1.14.1
+Requires-Dist: jinja2==3.1.6
+Requires-Dist: pillow==12.2.0
+Requires-Dist: protobuf==6.33.5
+Requires-Dist: mcp[cli]==1.26.0
+Requires-Dist: uvicorn==0.41.0
+Requires-Dist: PyJWT==2.12.0
+Requires-Dist: bcrypt==5.0.0
+Requires-Dist: authlib~=1.6.6
+Requires-Dist: fastapi==0.135.1
+Provides-Extra: standalone
+Requires-Dist: pixeltable-pgserver>=0.5.1; extra == "standalone"
+Provides-Extra: dev
+Requires-Dist: invoke==2.2.0; extra == "dev"
+Requires-Dist: ruff==0.4.1; extra == "dev"
+Requires-Dist: mypy==1.9.0; extra == "dev"
+Requires-Dist: pre-commit==3.6.2; extra == "dev"
+Requires-Dist: types-PyYAML==6.0.12.20240311; extra == "dev"
+Requires-Dist: types-setuptools==69.2.0.20240317; extra == "dev"
+Requires-Dist: semver==3.0.2; extra == "dev"
+Requires-Dist: pytest==8.1.1; extra == "dev"
+Requires-Dist: pytest-cov==4.1.0; extra == "dev"
+Requires-Dist: tomli==2.0.1; extra == "dev"
+Provides-Extra: release
+Requires-Dist: build==1.2.1; extra == "release"
+Requires-Dist: bumpver==2023.1129; extra == "release"
+Requires-Dist: twine==5.1.1; extra == "release"
+# DataOps Data Quality TestGen
+![apache 2.0 license Badge](https://img.shields.io/badge/License%20-%20Apache%202.0%20-%20blue) ![PRs Badge](https://img.shields.io/badge/PRs%20-%20Welcome%20-%20green) [![Latest Version](https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fhub.docker.com%2Fv2%2Frepositories%2Fdatakitchen%2Fdataops-testgen%2Ftags%2F&query=results%5B0%5D.name&label=latest%20version&color=06A04A)](https://hub.docker.com/r/datakitchen/dataops-testgen) [![Docker Pulls](https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fhub.docker.com%2Fv2%2Frepositories%2Fdatakitchen%2Fdataops-testgen%2F&query=pull_count&style=flat&label=docker%20pulls&color=06A04A)](https://hub.docker.com/r/datakitchen/dataops-testgen) [![Documentation](https://img.shields.io/badge/docs-On%20datakitchen.io-06A04A?style=flat)](https://docs.datakitchen.io/testgen/what-is-testgen/) [![Static Badge](https://img.shields.io/badge/Slack-Join%20Discussion-blue?style=flat&logo=slack)](https://data-observability-slack.datakitchen.io/join)
+*<p style="text-align: center;">DataOps Data Quality TestGen, or "TestGen" for short, can help you find data issues so you can alert your users and notify your suppliers. It does this by delivering simple, fast data quality test generation and execution by data profiling, new dataset screening and hygiene review, algorithmic generation of data quality validation tests, ongoing production testing of new data refreshes, and continuous anomaly monitoring of datasets. TestGen is part of DataKitchen's Open Source Data Observability.</p>*
+## Documentation
+[DataOps TestGen Overview](https://datakitchen.io/dataops-testgen-product/)
+[DataOps TestGen Documentation](https://docs.datakitchen.io/testgen/what-is-testgen/)
+## Features
+[Interactive Product Tour](https://datakitchen.storylane.io/share/byag8vimd5tn)
+What does DataKitchen's DataOps Data Quality TestGen do? It helps you understand and <b>find data issues in new data</b>.
+<p align="center">
+<img alt="DatKitchen Open Source Data Quality TestGen Features - New Data" src="https://datakitchen.io/wp-content/uploads/2024/07/Screenshot-2024-07-23-at-2.22.57 PM.png" width="70%">
+</p>
+It constantly <b>watches your data for data quality anomalies</b> and lets you drill into problems.
+<br></br>
+<p align="center">
+<img alt="DataKitchen Open Source Data Quality TestGen Features - Data Ingestion and Quality Testing" src="https://datakitchen.io/wp-content/uploads/2024/07/Screenshot-2024-07-23-at-2.23.07 PM.png" width="70%">
+</p>
+A <b>single place to manage Data Quality</b> across data sets, locations, and teams.
+<br></br>
+<p align="center">
+<img alt="DataKitchen Open Source Data Quality TestGen Features - Single Place" src="https://datakitchen.io/wp-content/uploads/2024/07/Screenshot-dataops-testgen-centralize.png" width="70%">
+</p>
+## Installation
+The [dk-installer](https://github.com/DataKitchen/data-observability-installer/?tab=readme-ov-file#install-the-testgen-application) program installs TestGen in either Docker or pip mode. For complete instructions, see the documentation:
+* [Install on Mac/Linux](https://docs.datakitchen.io/testgen/get-started/install-on-mac-linux/)
+* [Install on Windows](https://docs.datakitchen.io/testgen/get-started/install-on-windows/)
+## What Next?
+### Getting started guide
+We recommend you start by going through the [Data Observability Overview Demo](https://docs.datakitchen.io/tutorials/quickstart-demo/).
+### Support
+For support requests, [join the Data Observability Slack](https://data-observability-slack.datakitchen.io/join) 👋 and post on the `#support` channel.
+### Connect to your database
+Follow [these instructions](https://docs.datakitchen.io/testgen/connect-your-database/) to improve the quality of data in your database.
+### Community
+Talk and learn with other data practitioners who are building with DataKitchen. Share knowledge, get help, and contribute to our open-source project.
+Join our community here:
+* 👋 [Join us on Slack](https://data-observability-slack.datakitchen.io/join), this is also how you get support (see above)
+* 🌟 [Star us on GitHub](https://github.com/DataKitchen/data-observability-installer)
+* 🐦 [Follow us on Twitter](https://twitter.com/i/flow/login?redirect_after_login=%2Fdatakitchen_io)
+* 🕴️ [Follow us on LinkedIn](https://www.linkedin.com/company/datakitchen)
+* 📺 [Get Free DataOps Fundamentals Certification](https://info.datakitchen.io/training-certification-dataops-fundamentals)
+* 📚 [Read our blog posts](https://datakitchen.io/blog/)
+* 🗃 [Sign The DataOps Manifesto](https://DataOpsManifesto.org)
+* 🗃 [Sign The Data Journey Manifesto](https://DataJourneyManifesto.org)
+### Contributing
+For details on contributing or running the project for development, check out our [contributing guide](CONTRIBUTING.md).
+### License
+DataKitchen's DataOps Data Quality TestGen is Apache 2.0 licensed.

dataops-testgen-5.33.2/README.md ADDED Viewed

@@ -0,0 +1,76 @@
+# DataOps Data Quality TestGen
+![apache 2.0 license Badge](https://img.shields.io/badge/License%20-%20Apache%202.0%20-%20blue) ![PRs Badge](https://img.shields.io/badge/PRs%20-%20Welcome%20-%20green) [![Latest Version](https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fhub.docker.com%2Fv2%2Frepositories%2Fdatakitchen%2Fdataops-testgen%2Ftags%2F&query=results%5B0%5D.name&label=latest%20version&color=06A04A)](https://hub.docker.com/r/datakitchen/dataops-testgen) [![Docker Pulls](https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fhub.docker.com%2Fv2%2Frepositories%2Fdatakitchen%2Fdataops-testgen%2F&query=pull_count&style=flat&label=docker%20pulls&color=06A04A)](https://hub.docker.com/r/datakitchen/dataops-testgen) [![Documentation](https://img.shields.io/badge/docs-On%20datakitchen.io-06A04A?style=flat)](https://docs.datakitchen.io/testgen/what-is-testgen/) [![Static Badge](https://img.shields.io/badge/Slack-Join%20Discussion-blue?style=flat&logo=slack)](https://data-observability-slack.datakitchen.io/join)
+*<p style="text-align: center;">DataOps Data Quality TestGen, or "TestGen" for short, can help you find data issues so you can alert your users and notify your suppliers. It does this by delivering simple, fast data quality test generation and execution by data profiling, new dataset screening and hygiene review, algorithmic generation of data quality validation tests, ongoing production testing of new data refreshes, and continuous anomaly monitoring of datasets. TestGen is part of DataKitchen's Open Source Data Observability.</p>*
+## Documentation
+[DataOps TestGen Overview](https://datakitchen.io/dataops-testgen-product/)
+[DataOps TestGen Documentation](https://docs.datakitchen.io/testgen/what-is-testgen/)
+## Features
+[Interactive Product Tour](https://datakitchen.storylane.io/share/byag8vimd5tn)
+What does DataKitchen's DataOps Data Quality TestGen do? It helps you understand and <b>find data issues in new data</b>.
+<p align="center">
+<img alt="DatKitchen Open Source Data Quality TestGen Features - New Data" src="https://datakitchen.io/wp-content/uploads/2024/07/Screenshot-2024-07-23-at-2.22.57 PM.png" width="70%">
+</p>
+It constantly <b>watches your data for data quality anomalies</b> and lets you drill into problems.
+<br></br>
+<p align="center">
+<img alt="DataKitchen Open Source Data Quality TestGen Features - Data Ingestion and Quality Testing" src="https://datakitchen.io/wp-content/uploads/2024/07/Screenshot-2024-07-23-at-2.23.07 PM.png" width="70%">
+</p>
+A <b>single place to manage Data Quality</b> across data sets, locations, and teams.
+<br></br>
+<p align="center">
+<img alt="DataKitchen Open Source Data Quality TestGen Features - Single Place" src="https://datakitchen.io/wp-content/uploads/2024/07/Screenshot-dataops-testgen-centralize.png" width="70%">
+</p>
+## Installation
+The [dk-installer](https://github.com/DataKitchen/data-observability-installer/?tab=readme-ov-file#install-the-testgen-application) program installs TestGen in either Docker or pip mode. For complete instructions, see the documentation:
+* [Install on Mac/Linux](https://docs.datakitchen.io/testgen/get-started/install-on-mac-linux/)
+* [Install on Windows](https://docs.datakitchen.io/testgen/get-started/install-on-windows/)
+## What Next?
+### Getting started guide
+We recommend you start by going through the [Data Observability Overview Demo](https://docs.datakitchen.io/tutorials/quickstart-demo/).
+### Support
+For support requests, [join the Data Observability Slack](https://data-observability-slack.datakitchen.io/join) 👋 and post on the `#support` channel.
+### Connect to your database
+Follow [these instructions](https://docs.datakitchen.io/testgen/connect-your-database/) to improve the quality of data in your database.
+### Community
+Talk and learn with other data practitioners who are building with DataKitchen. Share knowledge, get help, and contribute to our open-source project.
+Join our community here:
+* 👋 [Join us on Slack](https://data-observability-slack.datakitchen.io/join), this is also how you get support (see above)
+* 🌟 [Star us on GitHub](https://github.com/DataKitchen/data-observability-installer)
+* 🐦 [Follow us on Twitter](https://twitter.com/i/flow/login?redirect_after_login=%2Fdatakitchen_io)
+* 🕴️ [Follow us on LinkedIn](https://www.linkedin.com/company/datakitchen)
+* 📺 [Get Free DataOps Fundamentals Certification](https://info.datakitchen.io/training-certification-dataops-fundamentals)
+* 📚 [Read our blog posts](https://datakitchen.io/blog/)
+* 🗃 [Sign The DataOps Manifesto](https://DataOpsManifesto.org)
+* 🗃 [Sign The Data Journey Manifesto](https://DataJourneyManifesto.org)
+### Contributing
+For details on contributing or running the project for development, check out our [contributing guide](CONTRIBUTING.md).
+### License
+DataKitchen's DataOps Data Quality TestGen is Apache 2.0 licensed.

dataops-testgen-5.33.2/dataops_testgen.egg-info/PKG-INFO ADDED Viewed

@@ -0,0 +1,169 @@
+Metadata-Version: 2.1
+Name: dataops-testgen
+Version: 5.33.2
+Summary: DataKitchen's Data Quality DataOps TestGen
+Author-email: "DataKitchen, Inc." <info@datakitchen.io>
+Maintainer-email: "DataKitchen, Inc." <info@datakitchen.io>
+Project-URL: Source Code, https://github.com/DataKitchen/dataops-testgen
+Project-URL: Bug Tracker, https://github.com/DataKitchen/dataops-testgen/issues
+Project-URL: Documentation, https://docs.datakitchen.io/testgen/what-is-testgen/
+Project-URL: Release Notes, https://docs.datakitchen.io/testgen/release-notes/
+Project-URL: Slack, https://data-observability-slack.datakitchen.io/join
+Project-URL: Homepage, https://example.com
+Keywords: dataops,data,quality,testing,database,profiling
+Classifier: License :: OSI Approved :: Apache Software License
+Classifier: Development Status :: 5 - Production/Stable
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: System :: Monitoring
+Requires-Python: >=3.11
+Description-Content-Type: text/markdown
+License-File: LICENSE
+License-File: NOTICE
+Requires-Dist: PyYAML==6.0.3
+Requires-Dist: click==8.3.1
+Requires-Dist: sqlalchemy==2.0.48
+Requires-Dist: databricks-sql-connector==4.2.5
+Requires-Dist: databricks-sqlalchemy==2.0.9
+Requires-Dist: databricks-sdk>=0.20.0
+Requires-Dist: snowflake-sqlalchemy==1.9.0
+Requires-Dist: sqlalchemy-bigquery==1.16.0
+Requires-Dist: oracledb==3.4.0
+Requires-Dist: hdbcli==2.25.31
+Requires-Dist: sqlalchemy-hana==4.4.0
+Requires-Dist: pyodbc==5.2.0
+Requires-Dist: psycopg2-binary==2.9.11
+Requires-Dist: pycryptodome==3.21
+Requires-Dist: prettytable==3.7.0
+Requires-Dist: requests_extensions==1.1.3
+Requires-Dist: numpy==2.1.3
+Requires-Dist: pandas==2.2.3
+Requires-Dist: streamlit==1.55.0
+Requires-Dist: streamlit-extras==0.3.0
+Requires-Dist: streamlit-aggrid==0.3.4.post3
+Requires-Dist: plotly_express==0.4.1
+Requires-Dist: streamlit-authenticator==0.2.3
+Requires-Dist: streamlit-javascript==0.1.5
+Requires-Dist: progress==1.6
+Requires-Dist: beautifulsoup4==4.12.3
+Requires-Dist: trino==0.327.0
+Requires-Dist: xlsxwriter==3.2.0
+Requires-Dist: psutil==5.9.8
+Requires-Dist: concurrent_log_handler==0.9.25
+Requires-Dist: cryptography==46.0.6
+Requires-Dist: validators==0.33.0
+Requires-Dist: reportlab==4.2.2
+Requires-Dist: cron-converter==1.2.1
+Requires-Dist: cron-descriptor==2.0.5
+Requires-Dist: pybars3==0.9.7
+Requires-Dist: azure-identity==1.25.1
+Requires-Dist: statsmodels==0.14.6
+Requires-Dist: holidays~=0.89
+Requires-Dist: pyarrow==21.0.0
+Requires-Dist: matplotlib==3.9.2
+Requires-Dist: scipy==1.14.1
+Requires-Dist: jinja2==3.1.6
+Requires-Dist: pillow==12.2.0
+Requires-Dist: protobuf==6.33.5
+Requires-Dist: mcp[cli]==1.26.0
+Requires-Dist: uvicorn==0.41.0
+Requires-Dist: PyJWT==2.12.0
+Requires-Dist: bcrypt==5.0.0
+Requires-Dist: authlib~=1.6.6
+Requires-Dist: fastapi==0.135.1
+Provides-Extra: standalone
+Requires-Dist: pixeltable-pgserver>=0.5.1; extra == "standalone"
+Provides-Extra: dev
+Requires-Dist: invoke==2.2.0; extra == "dev"
+Requires-Dist: ruff==0.4.1; extra == "dev"
+Requires-Dist: mypy==1.9.0; extra == "dev"
+Requires-Dist: pre-commit==3.6.2; extra == "dev"
+Requires-Dist: types-PyYAML==6.0.12.20240311; extra == "dev"
+Requires-Dist: types-setuptools==69.2.0.20240317; extra == "dev"
+Requires-Dist: semver==3.0.2; extra == "dev"
+Requires-Dist: pytest==8.1.1; extra == "dev"
+Requires-Dist: pytest-cov==4.1.0; extra == "dev"
+Requires-Dist: tomli==2.0.1; extra == "dev"
+Provides-Extra: release
+Requires-Dist: build==1.2.1; extra == "release"
+Requires-Dist: bumpver==2023.1129; extra == "release"
+Requires-Dist: twine==5.1.1; extra == "release"
+# DataOps Data Quality TestGen
+![apache 2.0 license Badge](https://img.shields.io/badge/License%20-%20Apache%202.0%20-%20blue) ![PRs Badge](https://img.shields.io/badge/PRs%20-%20Welcome%20-%20green) [![Latest Version](https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fhub.docker.com%2Fv2%2Frepositories%2Fdatakitchen%2Fdataops-testgen%2Ftags%2F&query=results%5B0%5D.name&label=latest%20version&color=06A04A)](https://hub.docker.com/r/datakitchen/dataops-testgen) [![Docker Pulls](https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fhub.docker.com%2Fv2%2Frepositories%2Fdatakitchen%2Fdataops-testgen%2F&query=pull_count&style=flat&label=docker%20pulls&color=06A04A)](https://hub.docker.com/r/datakitchen/dataops-testgen) [![Documentation](https://img.shields.io/badge/docs-On%20datakitchen.io-06A04A?style=flat)](https://docs.datakitchen.io/testgen/what-is-testgen/) [![Static Badge](https://img.shields.io/badge/Slack-Join%20Discussion-blue?style=flat&logo=slack)](https://data-observability-slack.datakitchen.io/join)
+*<p style="text-align: center;">DataOps Data Quality TestGen, or "TestGen" for short, can help you find data issues so you can alert your users and notify your suppliers. It does this by delivering simple, fast data quality test generation and execution by data profiling, new dataset screening and hygiene review, algorithmic generation of data quality validation tests, ongoing production testing of new data refreshes, and continuous anomaly monitoring of datasets. TestGen is part of DataKitchen's Open Source Data Observability.</p>*
+## Documentation
+[DataOps TestGen Overview](https://datakitchen.io/dataops-testgen-product/)
+[DataOps TestGen Documentation](https://docs.datakitchen.io/testgen/what-is-testgen/)
+## Features
+[Interactive Product Tour](https://datakitchen.storylane.io/share/byag8vimd5tn)
+What does DataKitchen's DataOps Data Quality TestGen do? It helps you understand and <b>find data issues in new data</b>.
+<p align="center">
+<img alt="DatKitchen Open Source Data Quality TestGen Features - New Data" src="https://datakitchen.io/wp-content/uploads/2024/07/Screenshot-2024-07-23-at-2.22.57 PM.png" width="70%">
+</p>
+It constantly <b>watches your data for data quality anomalies</b> and lets you drill into problems.
+<br></br>
+<p align="center">
+<img alt="DataKitchen Open Source Data Quality TestGen Features - Data Ingestion and Quality Testing" src="https://datakitchen.io/wp-content/uploads/2024/07/Screenshot-2024-07-23-at-2.23.07 PM.png" width="70%">
+</p>
+A <b>single place to manage Data Quality</b> across data sets, locations, and teams.
+<br></br>
+<p align="center">
+<img alt="DataKitchen Open Source Data Quality TestGen Features - Single Place" src="https://datakitchen.io/wp-content/uploads/2024/07/Screenshot-dataops-testgen-centralize.png" width="70%">
+</p>
+## Installation
+The [dk-installer](https://github.com/DataKitchen/data-observability-installer/?tab=readme-ov-file#install-the-testgen-application) program installs TestGen in either Docker or pip mode. For complete instructions, see the documentation:
+* [Install on Mac/Linux](https://docs.datakitchen.io/testgen/get-started/install-on-mac-linux/)
+* [Install on Windows](https://docs.datakitchen.io/testgen/get-started/install-on-windows/)
+## What Next?
+### Getting started guide
+We recommend you start by going through the [Data Observability Overview Demo](https://docs.datakitchen.io/tutorials/quickstart-demo/).
+### Support
+For support requests, [join the Data Observability Slack](https://data-observability-slack.datakitchen.io/join) 👋 and post on the `#support` channel.
+### Connect to your database
+Follow [these instructions](https://docs.datakitchen.io/testgen/connect-your-database/) to improve the quality of data in your database.
+### Community
+Talk and learn with other data practitioners who are building with DataKitchen. Share knowledge, get help, and contribute to our open-source project.
+Join our community here:
+* 👋 [Join us on Slack](https://data-observability-slack.datakitchen.io/join), this is also how you get support (see above)
+* 🌟 [Star us on GitHub](https://github.com/DataKitchen/data-observability-installer)
+* 🐦 [Follow us on Twitter](https://twitter.com/i/flow/login?redirect_after_login=%2Fdatakitchen_io)
+* 🕴️ [Follow us on LinkedIn](https://www.linkedin.com/company/datakitchen)
+* 📺 [Get Free DataOps Fundamentals Certification](https://info.datakitchen.io/training-certification-dataops-fundamentals)
+* 📚 [Read our blog posts](https://datakitchen.io/blog/)
+* 🗃 [Sign The DataOps Manifesto](https://DataOpsManifesto.org)
+* 🗃 [Sign The Data Journey Manifesto](https://DataJourneyManifesto.org)
+### Contributing
+For details on contributing or running the project for development, check out our [contributing guide](CONTRIBUTING.md).
+### License
+DataKitchen's DataOps Data Quality TestGen is Apache 2.0 licensed.

{dataops-testgen-5.32.2 → dataops-testgen-5.33.2}/dataops_testgen.egg-info/SOURCES.txt RENAMED Viewed

@@ -61,6 +61,7 @@ testgen/common/date_service.py
 testgen/common/display_service.py
 testgen/common/docker_service.py
 testgen/common/encrypt.py
+testgen/common/enums.py
 testgen/common/freshness_service.py
 testgen/common/job_context.py
 testgen/common/logs.py
@@ -128,6 +129,7 @@ testgen/mcp/tools/__init__.py
 testgen/mcp/tools/common.py
 testgen/mcp/tools/discovery.py
 testgen/mcp/tools/execution.py
+testgen/mcp/tools/hygiene_issues.py
 testgen/mcp/tools/markdown.py
 testgen/mcp/tools/profiling.py
 testgen/mcp/tools/reference.py

{dataops-testgen-5.32.2 → dataops-testgen-5.33.2}/pyproject.toml RENAMED Viewed

@@ -8,7 +8,7 @@ build-backend = "setuptools.build_meta"
 [project]
 name = "dataops-testgen"
-version = "5.32.2"
+version = "5.33.2"
 description = "DataKitchen's Data Quality DataOps TestGen"
 authors = [
     { "name" = "DataKitchen, Inc.", "email" = "info@datakitchen.io" },

{dataops-testgen-5.32.2 → dataops-testgen-5.33.2}/testgen/__main__.py RENAMED Viewed

@@ -1,3 +1,40 @@
+# Silence streamlit's "missing ScriptRunContext" / "No runtime found" /
+# "Session state does not function" warnings, which fire whenever streamlit-
+# decorated code runs outside an active script run (our CLI, scheduler, server,
+# and any import that touches @st.cache_data). Must run before the first
+# streamlit-using import, so it sits at the top of the module.
+#
+# We replace ``set_log_level`` itself, after seeding it to "error". Streamlit's
+# own ``_update_logger`` callback fires on config parse and would otherwise
+# downgrade us back to "info"; the cap floors any later call at ERROR.
+def _silence_streamlit_logs() -> None:
+    import logging as _logging
+    try:
+        from streamlit import logger as _st_logger
+    except ImportError:
+        return
+    _original = _st_logger.set_log_level
+    _original("error")
+    def _capped(level):
+        if isinstance(level, str):
+            try:
+                level_num = getattr(_logging, level.upper())
+            except AttributeError:
+                _original(level)
+                return
+        else:
+            level_num = level
+        _original(max(level_num, _logging.ERROR))
+    _st_logger.set_log_level = _capped
+_silence_streamlit_logs()
 import base64
 import importlib
 import logging
@@ -60,6 +97,7 @@ from testgen.common.models.test_suite import TestSuite
 from testgen.common.notifications.base import smtp_configured
 from testgen.common.standalone_postgres import (
     STANDALONE_URI_ENV_VAR,
+    ensure_standalone_setup,
     get_server_uri,
     is_standalone_mode,
 )
@@ -79,12 +117,41 @@ VERSION_DATA = version_service.get_version()
 CHILDREN_POLL_INTERVAL = 10
+def _subprocess_spawn_kwargs() -> dict:
+    """Spawn flags that let the parent send a *catchable* shutdown signal to a child.
+    On POSIX, ``start_new_session`` puts the child in its own session so the
+    console SIGINT only hits the parent. On Windows, ``CREATE_NEW_PROCESS_GROUP``
+    is required so the parent can deliver ``CTRL_BREAK_EVENT`` to the child —
+    without it, the only options are ``terminate()`` (uncatchable) or relying on
+    the console-wide Ctrl+C broadcast (racy).
+    """
+    if sys.platform == "win32":
+        return {"creationflags": subprocess.CREATE_NEW_PROCESS_GROUP}
+    return {"start_new_session": True}
+def _install_shutdown_handler(handler) -> None:
+    """Register *handler* for SIGINT, SIGTERM, and (on Windows) SIGBREAK.
+    Windows children spawned with ``CREATE_NEW_PROCESS_GROUP`` receive
+    ``CTRL_BREAK_EVENT`` (delivered as SIGBREAK) instead of console Ctrl+C —
+    treat it the same as SIGTERM so atexit hooks run and pgserver's PID list
+    stays clean.
+    """
+    signal.signal(signal.SIGINT, handler)
+    signal.signal(signal.SIGTERM, handler)
+    if sigbreak := getattr(signal, "SIGBREAK", None):
+        signal.signal(sigbreak, handler)
 def _forward_signal_to_child(child: subprocess.Popen, signum: int) -> None:
-    # On POSIX, forward the signal verbatim. On Windows, subprocess.send_signal
-    # rejects everything except SIGTERM / CTRL_C_EVENT / CTRL_BREAK_EVENT, so
-    # fall back to terminate() — equivalent to TerminateProcess().
+    # POSIX: forward the signal verbatim. Windows: send CTRL_BREAK_EVENT so the
+    # child's atexit hooks run (it deregisters from pgserver's PID list, lets
+    # streamlit/uvicorn shut down their event loops, etc.). The child must have
+    # been spawned with CREATE_NEW_PROCESS_GROUP — see _subprocess_spawn_kwargs.
     if sys.platform == "win32":
-        child.terminate()
+        child.send_signal(signal.CTRL_BREAK_EVENT)
     else:
         child.send_signal(signum)
@@ -132,7 +199,14 @@ class CliGroup(click.Group):
 @click.pass_context
 def cli(ctx: Context, verbose: bool):
     if is_standalone_mode():
-        start_standalone_postgres()
+        # Children spawned by `run-app all` (and the Streamlit subprocess) inherit the
+        # parent's pgserver URI. They must NOT call get_server() themselves — each call
+        # registers the calling PID in pgserver's on-disk handle list, and any PID left
+        # over after a hard kill prevents the parent from actually stopping postgres.
+        if inherited_uri := os.environ.get(STANDALONE_URI_ENV_VAR):
+            ensure_standalone_setup(inherited_uri)
+        else:
+            start_standalone_postgres()
     if verbose:
         configure_logging(level=logging.DEBUG)
@@ -566,7 +640,7 @@ def setup_standalone(username: str, password: str):
     # Persist caller-supplied runtime overrides (ports, TLS) so they apply to
     # subsequent `testgen run-app` invocations.
-    persisted_env_vars = ("TG_UI_PORT", "TG_API_PORT", "SSL_CERT_FILE", "SSL_KEY_FILE")
+    persisted_env_vars = ("TG_UI_PORT", "TG_API_PORT", "TESTGEN_LOG_FILE_PATH", "SSL_CERT_FILE", "SSL_KEY_FILE")
     persisted_lines = [f"{name}={os.environ[name]}" for name in persisted_env_vars if os.environ.get(name)]
     if persisted_lines:
         config_lines.extend(["", "# Runtime overrides from installer", *persisted_lines])
@@ -574,6 +648,13 @@ def setup_standalone(username: str, password: str):
     config_path.write_text("\n".join(config_lines) + "\n")
     click.echo(f"Config written to {config_path}")
+    # `getenv` resolves env vars before config.env, so a pre-existing
+    # TESTGEN_USERNAME / TESTGEN_PASSWORD in the shell would override the
+    # CLI-supplied values and get seeded into the DB. Force the CLI args
+    # to win for the rest of this process.
+    os.environ["TESTGEN_USERNAME"] = username
+    os.environ["TESTGEN_PASSWORD"] = password
     # Reload settings — the module was already evaluated at import time
     # before the config file existed.  Reloading re-reads the new file
     # and re-evaluates all module-level variables.
@@ -880,14 +961,16 @@ def run_ui():
     app_file = os.path.join(os.path.dirname(os.path.abspath(__file__)), "ui/app.py")
     # In standalone mode, pass the pgserver URI to the Streamlit subprocess
-    # so it can connect without acquiring the pgserver file lock.
+    # so it can connect without acquiring the pgserver file lock. When this
+    # process is itself a child of `run-app all`, the URI is already in the
+    # inherited environment — fall back to that so Streamlit still gets it.
     child_env = {**os.environ, "TG_JOB_SOURCE": "UI"}
     if is_standalone_mode():
-        server_uri = get_server_uri()
+        server_uri = get_server_uri() or os.environ.get(STANDALONE_URI_ENV_VAR)
         if server_uri:
-            child_env = {**os.environ, "TG_JOB_SOURCE": "UI", STANDALONE_URI_ENV_VAR: server_uri}
+            child_env[STANDALONE_URI_ENV_VAR] = server_uri
-    process= subprocess.Popen(
+    process = subprocess.Popen(
         [
             sys.executable,
             "-m",
@@ -895,6 +978,7 @@ def run_ui():
             "run",
             app_file,
             "--browser.gatherUsageStats=false",
+            f"--logger.level={'debug' if settings.IS_DEBUG else 'error'}",
             "--client.showErrorDetails=none",
             "--client.toolbarMode=minimal",
             "--server.enableStaticServing=true",
@@ -905,12 +989,12 @@ def run_ui():
             f"{'--debug' if settings.IS_DEBUG else ''}",
         ],
         env=child_env,
+        **_subprocess_spawn_kwargs(),
     )
     def term_ui(signum, _):
         LOG.info(f"Sending termination signal {signum} to Testgen UI")
         _forward_signal_to_child(process, signum)
-    signal.signal(signal.SIGINT, term_ui)
-    signal.signal(signal.SIGTERM, term_ui)
+    _install_shutdown_handler(term_ui)
     status_code = process.wait()
     LOG.log(logging.ERROR if status_code != 0 else logging.INFO, f"Testgen UI exited with status code {status_code}")
@@ -935,8 +1019,15 @@ def run_app(module):
             run_server()
         case "all":
+            child_env = os.environ.copy()
+            if is_standalone_mode() and (server_uri := get_server_uri()):
+                child_env[STANDALONE_URI_ENV_VAR] = server_uri
             children = [
-                subprocess.Popen([sys.executable, "-m", "testgen", "run-app", m], start_new_session=True)
+                subprocess.Popen(
+                    [sys.executable, "-m", "testgen", "run-app", m],
+                    env=child_env,
+                    **_subprocess_spawn_kwargs(),
+                )
                 for m in APP_MODULES
             ]
@@ -944,8 +1035,7 @@ def run_app(module):
                 for child in children:
                     _forward_signal_to_child(child, signum)
-            signal.signal(signal.SIGINT, term_children)
-            signal.signal(signal.SIGTERM, term_children)
+            _install_shutdown_handler(term_children)
             terminating = False
             while children:
@@ -954,7 +1044,10 @@ def run_app(module):
                 except subprocess.TimeoutExpired:
                     pass
-                for child in children:
+                # Iterate a snapshot — `children.remove(child)` inside a live iteration
+                # would skip the next element and could leave a sibling un-reaped during
+                # the simultaneous-exit case we're explicitly hardening for here.
+                for child in list(children):
                     if child.poll() is not None:
                         children.remove(child)
                         if not terminating:

dataops-testgen 5.32.2__tar.gz → 5.33.2__tar.gz

dataops-testgen 5.32.2tar.gz → 5.33.2tar.gz