dataspoof-mlpilot 2.2.0__tar.gz → 2.3.0__tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (329) hide show
  1. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/.github/workflows/CI.yml +44 -1
  2. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/CHANGELOG.md +65 -1
  3. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/CONTRIBUTING.md +2 -2
  4. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/Cargo.lock +1 -1
  5. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/Cargo.toml +1 -1
  6. dataspoof_mlpilot-2.3.0/LICENSE +21 -0
  7. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/PKG-INFO +144 -14
  8. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/README.md +137 -8
  9. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/SECURITY.md +2 -2
  10. dataspoof_mlpilot-2.3.0/docs/api/README.md +36 -0
  11. dataspoof_mlpilot-2.3.0/docs/api/anomaly.md +69 -0
  12. dataspoof_mlpilot-2.3.0/docs/api/automl.md +437 -0
  13. dataspoof_mlpilot-2.3.0/docs/api/causal.md +112 -0
  14. dataspoof_mlpilot-2.3.0/docs/api/cleaning.md +911 -0
  15. dataspoof_mlpilot-2.3.0/docs/api/compression.md +125 -0
  16. dataspoof_mlpilot-2.3.0/docs/api/core.md +459 -0
  17. dataspoof_mlpilot-2.3.0/docs/api/deploy.md +642 -0
  18. dataspoof_mlpilot-2.3.0/docs/api/environments.md +223 -0
  19. dataspoof_mlpilot-2.3.0/docs/api/evaluation.md +625 -0
  20. dataspoof_mlpilot-2.3.0/docs/api/feature_store.md +142 -0
  21. dataspoof_mlpilot-2.3.0/docs/api/features.md +389 -0
  22. dataspoof_mlpilot-2.3.0/docs/api/forecast.md +126 -0
  23. dataspoof_mlpilot-2.3.0/docs/api/hub.md +621 -0
  24. dataspoof_mlpilot-2.3.0/docs/api/ingestion.md +589 -0
  25. dataspoof_mlpilot-2.3.0/docs/api/insights.md +161 -0
  26. dataspoof_mlpilot-2.3.0/docs/api/integrations.md +855 -0
  27. dataspoof_mlpilot-2.3.0/docs/api/lineage.md +186 -0
  28. dataspoof_mlpilot-2.3.0/docs/api/media.md +344 -0
  29. dataspoof_mlpilot-2.3.0/docs/api/model_security.md +232 -0
  30. dataspoof_mlpilot-2.3.0/docs/api/monitoring.md +746 -0
  31. dataspoof_mlpilot-2.3.0/docs/api/operations.md +334 -0
  32. dataspoof_mlpilot-2.3.0/docs/api/orchestration.md +420 -0
  33. dataspoof_mlpilot-2.3.0/docs/api/quality.md +781 -0
  34. dataspoof_mlpilot-2.3.0/docs/api/registry.md +471 -0
  35. dataspoof_mlpilot-2.3.0/docs/api/scale.md +83 -0
  36. dataspoof_mlpilot-2.3.0/docs/api/secrets_security.md +171 -0
  37. dataspoof_mlpilot-2.3.0/docs/api/splitting.md +120 -0
  38. dataspoof_mlpilot-2.3.0/docs/api/stats.md +195 -0
  39. dataspoof_mlpilot-2.3.0/docs/api/versioning.md +180 -0
  40. dataspoof_mlpilot-2.3.0/docs/api/vision.md +491 -0
  41. dataspoof_mlpilot-2.3.0/docs/enterprise-gap-audit.md +233 -0
  42. dataspoof_mlpilot-2.3.0/docs/guide/enterprise-operations.md +246 -0
  43. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/installation.md +2 -2
  44. dataspoof_mlpilot-2.3.0/docs/reference/model_privacy.md +3 -0
  45. dataspoof_mlpilot-2.3.0/docs/reference/operations.md +11 -0
  46. dataspoof_mlpilot-2.3.0/docs/reference/orchestration.md +9 -0
  47. dataspoof_mlpilot-2.3.0/examples/enterprise_walkthrough.ipynb +1325 -0
  48. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/examples/titanic_walkthrough.ipynb +1 -1
  49. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mkdocs.yml +11 -3
  50. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/__init__.py +3 -0
  51. dataspoof_mlpilot-2.3.0/mlpilot/backup.py +217 -0
  52. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/cleaners.py +5 -0
  53. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/deploy/cli.py +121 -1
  54. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/deploy/server.py +100 -6
  55. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/deploy/wsgi.py +59 -53
  56. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/hub/app.py +854 -700
  57. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/hub/db.py +49 -1
  58. dataspoof_mlpilot-2.3.0/mlpilot/labeling.py +229 -0
  59. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/lineage.py +1 -1
  60. dataspoof_mlpilot-2.3.0/mlpilot/model_privacy.py +132 -0
  61. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/monitoring/__init__.py +6 -1
  62. dataspoof_mlpilot-2.3.0/mlpilot/monitoring/incidents.py +265 -0
  63. dataspoof_mlpilot-2.3.0/mlpilot/orchestration/__init__.py +30 -0
  64. dataspoof_mlpilot-2.3.0/mlpilot/orchestration/engine.py +477 -0
  65. dataspoof_mlpilot-2.3.0/mlpilot/orchestration/goal.py +240 -0
  66. dataspoof_mlpilot-2.3.0/mlpilot/orchestration/tools.py +413 -0
  67. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/quality/__init__.py +29 -25
  68. dataspoof_mlpilot-2.3.0/mlpilot/quality/observability.py +303 -0
  69. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/registry/__init__.py +16 -15
  70. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/registry/_store.py +3 -0
  71. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/registry/models.py +356 -280
  72. dataspoof_mlpilot-2.3.0/mlpilot/supply_chain.py +260 -0
  73. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/pyproject.toml +7 -6
  74. dataspoof_mlpilot-2.3.0/scripts/gen_api_ref.py +283 -0
  75. dataspoof_mlpilot-2.3.0/tests/test_backup.py +90 -0
  76. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_cleaners.py +9 -0
  77. dataspoof_mlpilot-2.3.0/tests/test_fault_injection.py +124 -0
  78. dataspoof_mlpilot-2.3.0/tests/test_hub_tenancy.py +111 -0
  79. dataspoof_mlpilot-2.3.0/tests/test_incidents.py +85 -0
  80. dataspoof_mlpilot-2.3.0/tests/test_labeling.py +67 -0
  81. dataspoof_mlpilot-2.3.0/tests/test_model_governance.py +59 -0
  82. dataspoof_mlpilot-2.3.0/tests/test_model_privacy.py +49 -0
  83. dataspoof_mlpilot-2.3.0/tests/test_observability.py +80 -0
  84. dataspoof_mlpilot-2.3.0/tests/test_orchestration.py +205 -0
  85. dataspoof_mlpilot-2.3.0/tests/test_serving_hardening.py +78 -0
  86. dataspoof_mlpilot-2.3.0/tests/test_supply_chain.py +77 -0
  87. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/.dockerignore +0 -0
  88. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/.github/workflows/docs.yml +0 -0
  89. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/.gitignore +0 -0
  90. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/BUILD.md +0 -0
  91. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/helm/mlpilot-hub/Chart.yaml +0 -0
  92. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/helm/mlpilot-hub/templates/_helpers.tpl +0 -0
  93. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/helm/mlpilot-hub/templates/deployment.yaml +0 -0
  94. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/helm/mlpilot-hub/templates/ingress.yaml +0 -0
  95. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/helm/mlpilot-hub/templates/pdb.yaml +0 -0
  96. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/helm/mlpilot-hub/templates/pvc.yaml +0 -0
  97. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/helm/mlpilot-hub/templates/secret.yaml +0 -0
  98. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/helm/mlpilot-hub/templates/service.yaml +0 -0
  99. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/helm/mlpilot-hub/templates/serviceaccount.yaml +0 -0
  100. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/helm/mlpilot-hub/values.yaml +0 -0
  101. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/hub/Dockerfile +0 -0
  102. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/hub/docker-compose.yml +0 -0
  103. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/monitoring/docker-compose.yml +0 -0
  104. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/monitoring/grafana/dashboards/mlpilot-model.json +0 -0
  105. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/monitoring/grafana/provisioning/dashboards/mlpilot.yml +0 -0
  106. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/monitoring/grafana/provisioning/datasources/prometheus.yml +0 -0
  107. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/monitoring/prometheus/alerts.yml +0 -0
  108. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/monitoring/prometheus/alerts_test.yml +0 -0
  109. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/monitoring/prometheus/prometheus.yml +0 -0
  110. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/opa/policies/mlpilot/authz.rego +0 -0
  111. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/opa/policies/mlpilot/config/data.json +0 -0
  112. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/opa/policies/mlpilot/policy_test.rego +0 -0
  113. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/opa/policies/mlpilot/promotion.rego +0 -0
  114. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/terraform/aws/main.tf +0 -0
  115. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/terraform/aws/outputs.tf +0 -0
  116. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/terraform/aws/variables.tf +0 -0
  117. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/terraform/aws-ecs/main.tf +0 -0
  118. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/terraform/aws-ecs/outputs.tf +0 -0
  119. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/terraform/aws-ecs/variables.tf +0 -0
  120. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/terraform/aws-sagemaker/main.tf +0 -0
  121. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/terraform/aws-sagemaker/outputs.tf +0 -0
  122. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/deploy/terraform/aws-sagemaker/variables.tf +0 -0
  123. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/architecture.md +0 -0
  124. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/assets/workflow.svg +0 -0
  125. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/changelog.md +0 -0
  126. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/contributing.md +0 -0
  127. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/anomaly.md +0 -0
  128. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/automl.md +0 -0
  129. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/aws.md +0 -0
  130. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/causal.md +0 -0
  131. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/cleaning.md +0 -0
  132. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/deployment.md +0 -0
  133. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/environments-cicd.md +0 -0
  134. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/evaluation.md +0 -0
  135. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/feature-store.md +0 -0
  136. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/features.md +0 -0
  137. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/forecasting.md +0 -0
  138. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/hub.md +0 -0
  139. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/ingestion.md +0 -0
  140. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/insights.md +0 -0
  141. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/integrations.md +0 -0
  142. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/lineage.md +0 -0
  143. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/media.md +0 -0
  144. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/model-security.md +0 -0
  145. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/monitoring.md +0 -0
  146. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/observability.md +0 -0
  147. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/quality.md +0 -0
  148. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/quantization.md +0 -0
  149. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/registry.md +0 -0
  150. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/secrets-policy.md +0 -0
  151. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/splitting.md +0 -0
  152. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/stats.md +0 -0
  153. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/versioning.md +0 -0
  154. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/guide/vision.md +0 -0
  155. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/index.md +0 -0
  156. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/policies.md +0 -0
  157. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/anomaly.md +0 -0
  158. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/automl.md +0 -0
  159. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/causal.md +0 -0
  160. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/cicd.md +0 -0
  161. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/cleaners.md +0 -0
  162. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/compression.md +0 -0
  163. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/core.md +0 -0
  164. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/deploy.md +0 -0
  165. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/environments.md +0 -0
  166. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/evaluation.md +0 -0
  167. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/feature_store.md +0 -0
  168. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/features.md +0 -0
  169. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/forecast.md +0 -0
  170. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/hub.md +0 -0
  171. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/ingestion.md +0 -0
  172. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/insights.md +0 -0
  173. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/integrations.md +0 -0
  174. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/lineage.md +0 -0
  175. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/media.md +0 -0
  176. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/monitoring.md +0 -0
  177. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/poisoning.md +0 -0
  178. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/quality.md +0 -0
  179. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/registry.md +0 -0
  180. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/robustness.md +0 -0
  181. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/scale.md +0 -0
  182. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/secretstore.md +0 -0
  183. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/security.md +0 -0
  184. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/splitting.md +0 -0
  185. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/stats.md +0 -0
  186. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/reference/versioning.md +0 -0
  187. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/security.md +0 -0
  188. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/docs/workflow.md +0 -0
  189. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/_compat.py +0 -0
  190. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/_detect.py +0 -0
  191. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/_rustcore.pyi +0 -0
  192. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/anomaly.py +0 -0
  193. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/automl/__init__.py +0 -0
  194. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/automl/_persist.py +0 -0
  195. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/automl/automl.py +0 -0
  196. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/automl/cluster.py +0 -0
  197. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/automl/frame.py +0 -0
  198. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/automl/models.py +0 -0
  199. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/automl/tasks.py +0 -0
  200. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/causal.py +0 -0
  201. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/cicd.py +0 -0
  202. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/cleaning.py +0 -0
  203. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/compression.py +0 -0
  204. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/core/__init__.py +0 -0
  205. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/core/pipeline.py +0 -0
  206. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/core/registry.py +0 -0
  207. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/core/step.py +0 -0
  208. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/deploy/__init__.py +0 -0
  209. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/deploy/__main__.py +0 -0
  210. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/deploy/_names.py +0 -0
  211. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/deploy/asgi.py +0 -0
  212. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/deploy/aws.py +0 -0
  213. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/deploy/export.py +0 -0
  214. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/deploy/quantize.py +0 -0
  215. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/deploy/scoring.py +0 -0
  216. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/environments.py +0 -0
  217. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/evaluation/__init__.py +0 -0
  218. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/evaluation/_slicing.py +0 -0
  219. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/evaluation/adapter.py +0 -0
  220. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/evaluation/card.py +0 -0
  221. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/evaluation/errors.py +0 -0
  222. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/evaluation/explain.py +0 -0
  223. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/evaluation/fairness.py +0 -0
  224. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/evaluation/metrics.py +0 -0
  225. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/feature_store.py +0 -0
  226. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/features/__init__.py +0 -0
  227. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/features/dates.py +0 -0
  228. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/features/defaults.py +0 -0
  229. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/features/encoding.py +0 -0
  230. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/features/generators.py +0 -0
  231. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/features/leakage.py +0 -0
  232. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/features/selection.py +0 -0
  233. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/features/text.py +0 -0
  234. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/forecast.py +0 -0
  235. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/hub/__init__.py +0 -0
  236. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/hub/client.py +0 -0
  237. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/hub/policy.py +0 -0
  238. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/hub/security.py +0 -0
  239. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/hub/storage.py +0 -0
  240. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/hub/ui.html +0 -0
  241. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/hub/ui.js +0 -0
  242. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/ingestion/__init__.py +0 -0
  243. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/ingestion/_util.py +0 -0
  244. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/ingestion/api.py +0 -0
  245. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/ingestion/core.py +0 -0
  246. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/ingestion/files.py +0 -0
  247. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/ingestion/incremental.py +0 -0
  248. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/ingestion/schema.py +0 -0
  249. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/ingestion/sql.py +0 -0
  250. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/ingestion/warehouse.py +0 -0
  251. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/insights/__init__.py +0 -0
  252. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/insights/finder.py +0 -0
  253. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/insights/narrate.py +0 -0
  254. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/insights/report.py +0 -0
  255. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/integrations/__init__.py +0 -0
  256. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/integrations/airflow.py +0 -0
  257. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/integrations/aws_glue.py +0 -0
  258. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/integrations/azure_data_factory.py +0 -0
  259. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/integrations/dagster.py +0 -0
  260. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/integrations/dvc.py +0 -0
  261. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/integrations/evidently.py +0 -0
  262. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/integrations/feast.py +0 -0
  263. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/integrations/kafka.py +0 -0
  264. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/integrations/mlflow.py +0 -0
  265. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/integrations/prefect.py +0 -0
  266. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/integrations/tasks.py +0 -0
  267. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/media/__init__.py +0 -0
  268. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/media/audio.py +0 -0
  269. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/media/benchmark.py +0 -0
  270. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/media/conditions.py +0 -0
  271. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/media/faces.py +0 -0
  272. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/media/image.py +0 -0
  273. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/media/plates.py +0 -0
  274. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/monitoring/drift.py +0 -0
  275. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/monitoring/estimate.py +0 -0
  276. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/monitoring/monitor.py +0 -0
  277. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/monitoring/ops.py +0 -0
  278. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/poisoning.py +0 -0
  279. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/py.typed +0 -0
  280. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/quality/checks.py +0 -0
  281. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/quality/contracts.py +0 -0
  282. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/quality/pipeline_steps.py +0 -0
  283. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/quality/profile.py +0 -0
  284. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/quality/schema.py +0 -0
  285. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/registry/tracking.py +0 -0
  286. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/robustness.py +0 -0
  287. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/scale.py +0 -0
  288. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/secretstore.py +0 -0
  289. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/security.py +0 -0
  290. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/splitting.py +0 -0
  291. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/stats.py +0 -0
  292. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/steps.py +0 -0
  293. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/mlpilot/versioning.py +0 -0
  294. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/src/clean.rs +0 -0
  295. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/src/lib.rs +0 -0
  296. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/src/stats.rs +0 -0
  297. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/src/text.rs +0 -0
  298. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/assets/astronaut.jpg +0 -0
  299. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/assets/coffee.jpg +0 -0
  300. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_advanced.py +0 -0
  301. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_automl.py +0 -0
  302. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_aws_deploy.py +0 -0
  303. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_cicd.py +0 -0
  304. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_core.py +0 -0
  305. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_data_versions_and_feature_store.py +0 -0
  306. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_deploy.py +0 -0
  307. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_docker_stacks.py +0 -0
  308. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_environments.py +0 -0
  309. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_evaluation.py +0 -0
  310. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_features.py +0 -0
  311. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_hub.py +0 -0
  312. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_ingestion.py +0 -0
  313. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_insights.py +0 -0
  314. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_label_free_monitoring.py +0 -0
  315. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_lineage_and_catalogs.py +0 -0
  316. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_media.py +0 -0
  317. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_model_security.py +0 -0
  318. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_monitoring.py +0 -0
  319. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_ops.py +0 -0
  320. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_quality.py +0 -0
  321. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_quantization.py +0 -0
  322. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_real_integrations.py +0 -0
  323. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_registry.py +0 -0
  324. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_rename_compat.py +0 -0
  325. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_secretstore.py +0 -0
  326. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_serving_feedback_reload.py +0 -0
  327. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_splitting.py +0 -0
  328. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_stats.py +0 -0
  329. {dataspoof_mlpilot-2.2.0 → dataspoof_mlpilot-2.3.0}/tests/test_vision.py +0 -0
@@ -153,6 +153,49 @@ jobs:
153
153
  cargo generate-lockfile
154
154
  cargo audit
155
155
 
156
+ certify:
157
+ name: release certification
158
+ # Evidence that the production guarantees hold on the built package: the autonomous engine end
159
+ # to end, model-file scanning, disaster-recovery drill, fault injection, tenancy isolation, SBOM.
160
+ runs-on: ubuntu-latest
161
+ env:
162
+ AC_OFFLINE: "1"
163
+ steps:
164
+ - uses: actions/checkout@v4
165
+ - uses: actions/setup-python@v5
166
+ with:
167
+ python-version: "3.12"
168
+ cache: pip
169
+ - uses: dtolnay/rust-toolchain@stable
170
+ - uses: Swatinem/rust-cache@v2
171
+ - name: Install the package
172
+ run: python -m pip install ".[test,server,signing]"
173
+ - name: Production-guarantee test suites
174
+ run: |
175
+ mkdir _cert && cp -r tests _cert/ && cd _cert
176
+ python -m pytest -q -p no:cacheprovider -o pythonpath= tests/test_orchestration.py \
177
+ tests/test_fault_injection.py tests/test_backup.py tests/test_supply_chain.py \
178
+ tests/test_serving_hardening.py tests/test_hub_tenancy.py tests/test_incidents.py \
179
+ tests/test_model_governance.py tests/test_model_privacy.py tests/test_observability.py
180
+ - name: Live certification run
181
+ run: |
182
+ mkdir -p evidence && cd evidence
183
+ python -c "import numpy as np, polars as pl; r=np.random.default_rng(0); x=r.normal(size=(800,3)); pl.DataFrame({'a':x[:,0],'b':x[:,1],'c':x[:,2],'y':(x[:,0]+r.normal(0,.7,800)>0).astype(int)}).write_csv('data.csv')"
184
+ mlpilot run --text "predict y from data.csv with AUC above 0.7, latency below 500 ms; deploy to staging" \
185
+ --no-llm --name cert --out runs/cert --by ci
186
+ mlpilot scan-model runs/cert/artifacts/model
187
+ mlpilot dr-drill --source runs=runs/cert --source registry=registry --workdir dr --rto-limit 120
188
+ mlpilot sbom --out sbom.mlpilot.cdx.json
189
+ cp runs/cert/report.md certification-report.md
190
+ - uses: actions/upload-artifact@v4
191
+ with:
192
+ name: certification-evidence
193
+ path: |
194
+ evidence/certification-report.md
195
+ evidence/sbom.mlpilot.cdx.json
196
+ evidence/runs/cert/manifest.json
197
+ evidence/runs/cert/events.jsonl
198
+
156
199
  linux:
157
200
  runs-on: ubuntu-latest
158
201
  strategy:
@@ -236,7 +279,7 @@ jobs:
236
279
  name: Release to PyPI
237
280
  runs-on: ubuntu-latest
238
281
  if: startsWith(github.ref, 'refs/tags/v')
239
- needs: [test, core-only, typecheck, security, linux, windows, macos, sdist]
282
+ needs: [test, core-only, typecheck, security, certify, linux, windows, macos, sdist]
240
283
  environment:
241
284
  name: pypi
242
285
  url: https://pypi.org/project/dataspoof-mlpilot/
@@ -1,7 +1,71 @@
1
1
  # Changelog
2
2
 
3
3
  All notable changes are listed here. The project follows [Semantic Versioning](https://semver.org/)
4
- (see the [versioning policy](https://dataspoof.github.io/dataspoof-data-cleaning/policies/)).
4
+ (see the [versioning policy](https://dataspoof.github.io/dataspoof-mlpilot/policies/)).
5
+
6
+ ## [2.3.0] — 2026-11-22
7
+
8
+ ### Added: the autonomous execution engine
9
+ - **`mlpilot.orchestration`:** a goal is a YAML file or a sentence, drafted by rules plus
10
+ optional Claude and always validated.
11
+ - The engine plans it into a typed workflow of registered tools only. Steps: ingest →
12
+ quality / contract → leak-checked split → poisoning check → AutoML → evaluation against the
13
+ goal → latency and size limits → SHAP → fairness → robustness → privacy → model-file scan →
14
+ model card → register → promote → monitor baseline.
15
+ - Runs can be resumed: each step's inputs are hashed, so only changed steps re-run.
16
+ - Promotion waits for four-eyes approvals tied to the exact inputs.
17
+ - Gates stop a run and are never retried away; unexpected errors are retried.
18
+ - Each run records cost per step with a budget stop, an append-only event log, a
19
+ reproducibility manifest and a report.
20
+ - A killed run is taken over and resumed.
21
+ - **Cost-aware AutoML:** with latency or size limits, the engine searches for the best model
22
+ that meets them.
23
+ - **CLI:** `mlpilot plan`, `run`, `approve`, `status`.
24
+
25
+ ### Added: enterprise operations
26
+ - **Data observability and reconciliation** (`quality.DataMonitor`, `quality.reconcile`):
27
+ - freshness, volume, schema, nulls and distribution over time, with SLAs;
28
+ - source-to-destination checks of keys, changed rows, sums and schema.
29
+ - **Incident management** (`monitoring.diagnose`, `IncidentLog`):
30
+ - root causes: upstream data, infrastructure, bad release, concept drift, covariate shift;
31
+ - playbooks where low-risk actions run automatically and high-risk actions (rollback) need
32
+ approval;
33
+ - an incident closes only after a healthy verification.
34
+ - **Backups and disaster recovery** (`mlpilot.backup`, `mlpilot backup | restore | dr-drill`):
35
+ - checksummed archives, consistent snapshots of live SQLite databases;
36
+ - restores that are verified first and refuse path traversal;
37
+ - drills that measure RTO and RPO, plus retention.
38
+ - **Supply chain** (`mlpilot.supply_chain`, `mlpilot scan-model | sbom`):
39
+ - malicious pickle and joblib detection without executing anything, and ONNX checks;
40
+ - CycloneDX 1.5 SBOM.
41
+ - **Serving:** per-client rate limits (`rate_limit=`, `AC_RATE_LIMIT`; `429` with
42
+ `Retry-After`), and request validation against the model's input schema (`validate=`,
43
+ `AC_VALIDATE`).
44
+ - **Model governance:**
45
+ - `ModelRegistry.set_risk()`: unacceptable models are blocked; high-risk ones need two
46
+ approvers and a current review;
47
+ - `retire()`: archives every version and points to the replacement.
48
+ - **Active learning** (`mlpilot.labeling`): uncertainty and diversity selection, a labeling
49
+ queue with votes and agreement, and a simulation against random labeling.
50
+ - **Privacy attacks** (`mlpilot.model_privacy`):
51
+ - membership inference and model extraction tests;
52
+ - an engine gate, `max_membership_auc`.
53
+ - **Hub multi-tenancy:**
54
+ - organisations with quotas (workspaces, model versions, storage, runs per day);
55
+ - cross-tenant membership refused;
56
+ - usage metered per tenant and day;
57
+ - existing databases migrated in place.
58
+ - **CI:** a `certify` job that every release requires. It runs the production-guarantee
59
+ suites and a live sequence (autonomous run, model scan, DR drill, SBOM) and uploads the
60
+ evidence.
61
+ - **Docs:**
62
+ - [Autonomous engine & operations guide](docs/guide/enterprise-operations.md);
63
+ - [enterprise gap audit](docs/enterprise-gap-audit.md);
64
+ - the GitHub-readable API reference is now generated by `scripts/gen_api_ref.py`.
65
+
66
+ ### Fixed
67
+ - `AutoML` on a pure free-text dataset: the cleaning step dropped the text column as an ID
68
+ (every review is unique). Text columns are now kept and embedded.
5
69
 
6
70
  ## [2.2.0] — 2026-11-12
7
71
 
@@ -6,8 +6,8 @@ Thanks for helping! The basics:
6
6
 
7
7
  ```bash
8
8
  # needs the Rust toolchain: https://rustup.rs
9
- git clone https://github.com/DataSpoof/dataspoof-data-cleaning.git
10
- cd dataspoof-data-cleaning
9
+ git clone https://github.com/DataSpoof/dataspoof-mlpilot.git
10
+ cd dataspoof-mlpilot
11
11
  python -m venv .venv && source .venv/bin/activate # Windows: .venv\Scripts\activate
12
12
  pip install maturin
13
13
  maturin develop --release --extras dev # builds the Rust extension in place
@@ -98,7 +98,7 @@ dependencies = [
98
98
 
99
99
  [[package]]
100
100
  name = "mlpilot-rustcore"
101
- version = "2.2.0"
101
+ version = "2.3.0"
102
102
  dependencies = [
103
103
  "once_cell",
104
104
  "pyo3",
@@ -1,6 +1,6 @@
1
1
  [package]
2
2
  name = "mlpilot-rustcore"
3
- version = "2.2.0"
3
+ version = "2.3.0"
4
4
  edition = "2021"
5
5
  description = "Rust compute backend for the MLPilot Python library"
6
6
  license = "MIT"
@@ -0,0 +1,21 @@
1
+ MIT License
2
+
3
+ Copyright (c) 2026 DataSpoof
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining a copy
6
+ of this software and associated documentation files (the "Software"), to deal
7
+ in the Software without restriction, including without limitation the rights
8
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
+ copies of the Software, and to permit persons to whom the Software is
10
+ furnished to do so, subject to the following conditions:
11
+
12
+ The above copyright notice and this permission notice shall be included in all
13
+ copies or substantial portions of the Software.
14
+
15
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21
+ SOFTWARE.
@@ -1,6 +1,6 @@
1
1
  Metadata-Version: 2.4
2
2
  Name: dataspoof-mlpilot
3
- Version: 2.2.0
3
+ Version: 2.3.0
4
4
  Classifier: Programming Language :: Python :: 3
5
5
  Classifier: Programming Language :: Rust
6
6
  Classifier: License :: OSI Approved :: MIT License
@@ -107,23 +107,24 @@ Provides-Extra: sql
107
107
  Provides-Extra: test
108
108
  Provides-Extra: text
109
109
  Provides-Extra: vision
110
+ License-File: LICENSE
110
111
  Summary: MLPilot (formerly AutomatedCleaning): automated data science, from raw data to monitored production models, with a Rust engine
111
112
  Keywords: mlops,automl,data cleaning,data quality,feature engineering,model monitoring,polars
112
113
  Author-email: Abhishek Kumar Singh <dataspoof007@gmail.com>
113
114
  License: MIT
114
115
  Requires-Python: >=3.11
115
116
  Description-Content-Type: text/markdown; charset=UTF-8; variant=GFM
116
- Project-URL: Changelog, https://github.com/DataSpoof/dataspoof-data-cleaning/blob/main/CHANGELOG.md
117
- Project-URL: Documentation, https://dataspoof.github.io/dataspoof-data-cleaning/
118
- Project-URL: Homepage, https://github.com/DataSpoof/dataspoof-data-cleaning
119
- Project-URL: Issues, https://github.com/DataSpoof/dataspoof-data-cleaning/issues
120
- Project-URL: Repository, https://github.com/DataSpoof/dataspoof-data-cleaning
117
+ Project-URL: Changelog, https://github.com/DataSpoof/dataspoof-mlpilot/blob/main/CHANGELOG.md
118
+ Project-URL: Documentation, https://dataspoof.github.io/dataspoof-mlpilot/
119
+ Project-URL: Homepage, https://github.com/DataSpoof/dataspoof-mlpilot
120
+ Project-URL: Issues, https://github.com/DataSpoof/dataspoof-mlpilot/issues
121
+ Project-URL: Repository, https://github.com/DataSpoof/dataspoof-mlpilot
121
122
 
122
123
  <a id="top"></a>
123
124
 
124
125
  <div align="center">
125
126
 
126
- ![DataSpoof MLPilot](https://raw.githubusercontent.com/DataSpoof/dataspoof-data-cleaning/main/images/DataSpoof%20MLPilot%20Neon%20Banner.png)
127
+ ![DataSpoof MLPilot](https://raw.githubusercontent.com/DataSpoof/dataspoof-mlpilot/main/images/DataSpoof%20MLPilot%20Neon%20Banner.png)
127
128
 
128
129
  # MLPilot
129
130
 
@@ -133,11 +134,13 @@ Project-URL: Repository, https://github.com/DataSpoof/dataspoof-data-cleaning
133
134
  [![Python 3.11+](https://img.shields.io/badge/python-3.11%2B-3776AB?logo=python&logoColor=white)](https://www.python.org/)
134
135
  [![Rust engine](https://img.shields.io/badge/engine-Rust-B7410E?logo=rust&logoColor=white)](https://www.rust-lang.org/)
135
136
  [![Polars](https://img.shields.io/badge/dataframes-Polars-CD792C?logo=polars&logoColor=white)](https://pola.rs/)
136
- [![Tests](https://img.shields.io/badge/tests-298%20passing-2ea44f)](#%EF%B8%8F-building--contributing)
137
+ [![Tests](https://img.shields.io/badge/tests-372%20passing-2ea44f)](#%EF%B8%8F-building--contributing)
137
138
  [![License: MIT](https://img.shields.io/badge/license-MIT-2ea44f)](#-license)
138
139
 
140
+ **[What's new](#-whats-new-in-230)** ·
139
141
  **[Install](#-installation)** ·
140
142
  **[Quick start](#-quick-start)** ·
143
+ **[Docs](#-documentation)** ·
141
144
  **[Modules](#-the-platform-at-a-glance)** ·
142
145
  **[Contents](#-contents)** ·
143
146
  **[Why Rust?](#-why-rust--python)**
@@ -153,6 +156,40 @@ handles the heavy computation, and every stage shares one `fit` / `transform` /
153
156
 
154
157
  > **AutomatedCleaning is now MLPilot.** Install `dataspoof-mlpilot` and `import mlpilot`. Existing code and saved models keep working: see [Moving from AutomatedCleaning](#moving-from-automatedcleaning).
155
158
 
159
+ ## ✨ What's new in 2.3.0
160
+
161
+ - **Autonomous execution engine** ([guide](docs/guide/enterprise-operations.md)):
162
+ - describe the goal in YAML or plain English;
163
+ - MLPilot plans and runs the gated workflow, waits for approvals, resumes after crashes, and
164
+ records every step's log and cost;
165
+ - cost-aware AutoML finds the best model within your latency and size limits.
166
+ - **Enterprise operations:**
167
+ - data observability and reconciliation;
168
+ - incident diagnosis with playbooks;
169
+ - backups and DR drills;
170
+ - model-file scanning and SBOMs;
171
+ - rate limits and request validation;
172
+ - model risk levels and retirement;
173
+ - active learning;
174
+ - privacy-attack tests;
175
+ - Hub tenants with quotas.
176
+ - **Walkthrough:** [examples/enterprise_walkthrough.ipynb](examples/enterprise_walkthrough.ipynb).
177
+
178
+ ### Earlier in 2.2.0
179
+
180
+ - **Images taken in hard conditions** ([guide](docs/guide/vision.md)):
181
+ - detect, simulate and remove fog, rain, snow, low light, glare, blur, noise and JPEG damage;
182
+ - faces partly covered by hair, masks or sunglasses: measured, simulated for training, blurred
183
+ for privacy;
184
+ - licence-plate detection and reading, in bad weather too;
185
+ - a robustness benchmark that scores any image model per condition.
186
+ - **Quantization** ([guide](docs/guide/quantization.md)):
187
+ - int8 / fp16 ONNX models, measured on your data before you ship them;
188
+ - quantized embeddings;
189
+ - smaller column types that keep every value;
190
+ - a quantization release gate.
191
+ - Full list: [CHANGELOG](CHANGELOG.md).
192
+
156
193
  ## ⚡ Quick start
157
194
 
158
195
  ```bash
@@ -219,6 +256,8 @@ and builds an EDA dashboard.
219
256
  | 🧾 | **Lineage & catalogs** | `lineage`, `integrations` | OpenLineage events (Marquez, DataHub…), AWS Glue Data Catalog, Glue jobs and Azure Data Factory runs. |
220
257
  | ☁️ | **Deploy on AWS** | `deploy.aws` | ECR push, blue/green SageMaker endpoints, Terraform for SageMaker and ECS Fargate. |
221
258
  | 🔌 | **Integrations & scale** | `integrations`, `scale` | MLflow, DVC, Feast, Airflow, Prefect, Dagster, Kafka; Spark, Ray and Dask scoring; SQL pushdown into the warehouse. |
259
+ | 🧠 | **Autonomous engine** | `orchestration` | A goal in YAML or plain English becomes a gated, resumable workflow: data checks → AutoML within latency and size limits → fairness, robustness, privacy and security gates → approval → registry → monitoring. Every step logged and costed. |
260
+ | 🏭 | **Enterprise operations** | `backup`, `labeling`, `supply_chain`, `model_privacy` | Data observability and reconciliation, incident diagnosis with playbooks, backups and DR drills, model-file scanning and SBOMs, active learning, privacy-attack tests, risk classification and retirement, Hub tenants with quotas. |
222
261
 
223
262
  ```
224
263
  ingest ─▶ clean ─▶ profile & quality ─▶ features ─▶ AutoML ─▶ evaluate & explain
@@ -246,7 +285,7 @@ and builds an EDA dashboard.
246
285
 
247
286
  ## 🗺️ How it all fits together
248
287
 
249
- <p align="center"><img src="https://raw.githubusercontent.com/DataSpoof/dataspoof-data-cleaning/main/docs/assets/workflow.svg" alt="MLPilot workflow: data in, build and validate, release through isolated dev, QA and prod registries, and operate with feedback, monitoring and a retraining loop. Five gates can stop a run." width="100%"></p>
288
+ <p align="center"><img src="https://raw.githubusercontent.com/DataSpoof/dataspoof-mlpilot/main/docs/assets/workflow.svg" alt="MLPilot workflow: data in, build and validate, release through isolated dev, QA and prod registries, and operate with feedback, monitoring and a retraining loop. Five gates can stop a run." width="100%"></p>
250
289
 
251
290
  Read lane 1 left to right, lane 2 right to left, and so on: the flow snakes down the page.
252
291
 
@@ -302,12 +341,30 @@ Read lane 1 left to right, lane 2 right to left, and so on: the flow snakes down
302
341
  25. [Lineage & catalogs](#-25--lineage--catalogs)
303
342
  26. [Deploy on AWS](#%EF%B8%8F-26--deploy-on-aws)
304
343
 
305
- Also: [Installation](#-installation) · [Why Rust + Python?](#-why-rust--python) ·
344
+ 27. [Quantization & compression](#%EF%B8%8F-27--quantization--compression)
345
+ 28. [Autonomous engine & enterprise operations](#-28--autonomous-engine--enterprise-operations)
346
+
347
+ Also: [Installation](#-installation) · [Documentation](#-documentation) · [Why Rust + Python?](#-why-rust--python) ·
306
348
  [Requirements](#-requirements) · [Building & contributing](#%EF%B8%8F-building--contributing) ·
307
349
  [License](#-license)
308
350
 
309
351
  ---
310
352
 
353
+ ## 📖 Documentation
354
+
355
+ | | |
356
+ |---|---|
357
+ | 🚀 [Installation](docs/installation.md) | extras, platforms, moving from AutomatedCleaning |
358
+ | 📘 User guide | [Ingestion & connectors](docs/guide/ingestion.md) · [Data cleaning](docs/guide/cleaning.md) · [Profiling & data quality](docs/guide/quality.md) · [Data splitting](docs/guide/splitting.md) · [Feature engineering](docs/guide/features.md) · [Feature store](docs/guide/feature-store.md) · [Data versioning](docs/guide/versioning.md) · [Statistical testing](docs/guide/stats.md) · [AutoML](docs/guide/automl.md) · [Evaluation & explainability](docs/guide/evaluation.md) · [Model security](docs/guide/model-security.md) · [Tracking & registry](docs/guide/registry.md) · [Environments & CI/CD](docs/guide/environments-cicd.md) · [Deployment](docs/guide/deployment.md) · [Deploy on AWS](docs/guide/aws.md) · [Quantization & compression](docs/guide/quantization.md) · [Autonomous engine & operations](docs/guide/enterprise-operations.md) · [Monitoring](docs/guide/monitoring.md) · [Observability](docs/guide/observability.md) · [Insights & reporting](docs/guide/insights.md) · [Hub (platform server)](docs/guide/hub.md) · [Secrets & policy](docs/guide/secrets-policy.md) · [Lineage & catalogs](docs/guide/lineage.md) · [Forecasting](docs/guide/forecasting.md) · [Causal & uplift](docs/guide/causal.md) · [Anomaly detection](docs/guide/anomaly.md) · [Image & audio data](docs/guide/media.md) · [Weather, faces & plates](docs/guide/vision.md) · [Integrations & scale](docs/guide/integrations.md) |
359
+ | 🔎 [API reference](docs/api/README.md) | every public class and function, generated from the source |
360
+ | 📓 [Titanic walkthrough](examples/titanic_walkthrough.ipynb) · [Enterprise walkthrough](examples/enterprise_walkthrough.ipynb) | every stage, end to end, on one dataset; the autonomous engine and every operations feature |
361
+ | 🧭 [Workflow](docs/workflow.md) · [Architecture](docs/architecture.md) | how the stages connect; the Python frontend and the Rust engine |
362
+ | 📝 [Changelog](CHANGELOG.md) · [Policies](docs/policies.md) · [Security](SECURITY.md) · [Enterprise gap audit](docs/enterprise-gap-audit.md) | releases, versioning and support, reporting vulnerabilities, what is built and what is left |
363
+
364
+ <p align="right"><a href="#top">back to top ↑</a></p>
365
+
366
+ ---
367
+
311
368
  ## 📦 Installation
312
369
 
313
370
  ```bash
@@ -391,8 +448,8 @@ Update these if you deployed them from 2.0.0.
391
448
 
392
449
  ```bash
393
450
  pip install maturin # needs Rust: https://rustup.rs
394
- git clone https://github.com/DataSpoof/dataspoof-data-cleaning.git
395
- cd dataspoof-data-cleaning
451
+ git clone https://github.com/DataSpoof/dataspoof-mlpilot.git
452
+ cd dataspoof-mlpilot
396
453
  pip install . # or: maturin develop --release (in a virtualenv)
397
454
  ```
398
455
 
@@ -1754,6 +1811,77 @@ Manager, a deployment circuit breaker with rollback, and CPU plus request-count
1754
1811
 
1755
1812
  ---
1756
1813
 
1814
+ ## ⚖️ 27 · Quantization & compression
1815
+
1816
+ ```python
1817
+ rep = ac.quantize_model(model, test, out="build/quantized") # int8 + fp16 ONNX variants, measured
1818
+ print(rep.summary()) # size, speed, metric change, agreement
1819
+ ac.export_model(model, "build/onnx", "onnx", quantize="int8")
1820
+ ac.TextEmbeddings(columns=["review"], dtype="int8") # 8x smaller embeddings
1821
+ small, report = ac.optimize_dtypes(df) # smaller column types, same values
1822
+ ```
1823
+
1824
+ - **Models:**
1825
+ - int8 weights make files about 3–4× smaller, fp16 about 2×.
1826
+ - Each variant is scored on your held-out data, and the report recommends the smallest one
1827
+ within your limits. A `quantization` gate in `gates.yml` can enforce those limits in CI.
1828
+ - It works on neural networks: AutoML's opt-in `mlp` model and your own ONNX models. Tree,
1829
+ linear and k-NN models are reported as having nothing to quantize.
1830
+ - **Embeddings:** float32, float16 or int8 (per-dimension scale learned on training data).
1831
+ - **Tables:**
1832
+ - `optimize_dtypes` and the `OptimizeDtypes` step shrink integers by range and turn
1833
+ repetitive text into categories.
1834
+ - Floats become Float32 only when every value survives the round trip, so prices stay exact
1835
+ and large balances keep their cents.
1836
+
1837
+ Details and measurements: [quantization guide](docs/guide/quantization.md).
1838
+
1839
+ <p align="right"><a href="#top">back to top ↑</a></p>
1840
+
1841
+ ---
1842
+
1843
+ ## 🧠 28 · Autonomous engine & enterprise operations
1844
+
1845
+ ```python
1846
+ from mlpilot import orchestration as orc
1847
+
1848
+ goal = orc.goal_from_text("Predict churned from customers.csv with AUC above 0.85, latency below 50 ms; "
1849
+ "check fairness across gender; deploy to production")
1850
+ res = orc.run(goal, "runs/churn") # gated, resumable; stops for the production approval
1851
+ orc.approve("runs/churn", "promote", by="priya") # four-eyes: never the requester
1852
+ orc.resume("runs/churn")
1853
+ ```
1854
+
1855
+ ```bash
1856
+ mlpilot run --text "predict churned from customers.csv with AUC above 0.85" --out runs/churn
1857
+ mlpilot scan-model models/churn # code that would run on load? exit 1
1858
+ mlpilot backup --source registry=registry --sqlite hub=hub.db --out backups
1859
+ mlpilot dr-drill --source registry=registry --workdir dr --rto-limit 120
1860
+ mlpilot sbom --out sbom.cdx.json
1861
+ ```
1862
+
1863
+ - **The engine:**
1864
+ - plans only with registered tools, and the LLM only drafts goals;
1865
+ - gates are deterministic and promotions need other people;
1866
+ - each step's inputs are hashed, so re-runs are cheap and killed runs resume;
1867
+ - every step's log, cost and reproducibility record lands in the run directory.
1868
+ - **Operations:**
1869
+ - data observability (`DataMonitor`) and reconciliation;
1870
+ - incident diagnosis and playbooks (`monitoring.diagnose`, `IncidentLog`);
1871
+ - backups and DR drills;
1872
+ - per-client rate limits and request validation;
1873
+ - model risk levels and retirement;
1874
+ - active learning;
1875
+ - membership-inference and model-extraction tests;
1876
+ - Hub tenants with quotas and metering.
1877
+
1878
+ Details: [Autonomous engine & operations guide](docs/guide/enterprise-operations.md) ·
1879
+ [enterprise gap audit](docs/enterprise-gap-audit.md) (what is built, what is still missing).
1880
+
1881
+ <p align="right"><a href="#top">back to top ↑</a></p>
1882
+
1883
+ ---
1884
+
1757
1885
  ## 🦀 Why Rust + Python?
1758
1886
 
1759
1887
  The library is a **hybrid**: a friendly Python API on top, a fast Rust engine underneath.
@@ -1808,7 +1936,7 @@ path, with the GIL released so it scales across cores.
1808
1936
  ## 🛠️ Building & contributing
1809
1937
 
1810
1938
  The project uses **maturin** as its build backend (`pyproject.toml`). See
1811
- [BUILD.md](https://github.com/DataSpoof/dataspoof-data-cleaning/blob/main/BUILD.md) for the full architecture and build/publish guide.
1939
+ [BUILD.md](https://github.com/DataSpoof/dataspoof-mlpilot/blob/main/BUILD.md) for the full architecture and build/publish guide.
1812
1940
 
1813
1941
  ```
1814
1942
  Cargo.toml # Rust crate config
@@ -1828,9 +1956,11 @@ mlpilot/
1828
1956
  automl/ # AutoML + AutoCluster
1829
1957
  evaluation/ # metrics, SHAP, error analysis, fairness, model cards
1830
1958
  registry/ # experiment tracking + model registry
1831
- deploy/ # scoring, REST API, export, Docker, CLI
1959
+ deploy/ # scoring, REST API, export, quantization, Docker, CLI
1832
1960
  monitoring/ # drift, alerts, retraining
1833
1961
  insights/ # findings, executive reports, LLM narratives
1962
+ media/ # images & audio; weather conditions, faces, licence plates, robustness benchmark
1963
+ compression.py # value-preserving column types, quantized vectors
1834
1964
  tests/ # pytest suite
1835
1965
  ```
1836
1966