py-serverless-kit 0.6.0__tar.gz → 0.7.0__tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (321) hide show
  1. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/CHANGELOG.md +14 -0
  2. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/PKG-INFO +3 -1
  3. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/README.md +2 -0
  4. py_serverless_kit-0.7.0/docs/resources.md +373 -0
  5. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/docs/scenarios.md +68 -1
  6. py_serverless_kit-0.7.0/examples/19-custom-drivers/README.md +60 -0
  7. py_serverless_kit-0.7.0/examples/19-custom-drivers/app/backends.py +180 -0
  8. py_serverless_kit-0.7.0/examples/19-custom-drivers/app/handlers.py +44 -0
  9. py_serverless_kit-0.7.0/examples/19-custom-drivers/app/kafka_queue.py +97 -0
  10. py_serverless_kit-0.7.0/examples/19-custom-drivers/app/rabbitmq_queue.py +114 -0
  11. py_serverless_kit-0.7.0/examples/19-custom-drivers/pskit.yml +82 -0
  12. py_serverless_kit-0.7.0/examples/19-custom-drivers/requirements.txt +2 -0
  13. py_serverless_kit-0.7.0/examples/20-onprem-external-clouds/README.md +64 -0
  14. py_serverless_kit-0.7.0/examples/20-onprem-external-clouds/app/handlers.py +32 -0
  15. py_serverless_kit-0.7.0/examples/20-onprem-external-clouds/pskit.yml +134 -0
  16. py_serverless_kit-0.7.0/examples/20-onprem-external-clouds/requirements.txt +1 -0
  17. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/README.md +2 -0
  18. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/_version.py +1 -1
  19. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/providers/onprem.py +178 -23
  20. py_serverless_kit-0.7.0/src/py_serverless_kit/runtime/drivers/__init__.py +322 -0
  21. py_serverless_kit-0.7.0/src/py_serverless_kit/runtime/drivers/_aws.py +92 -0
  22. py_serverless_kit-0.7.0/src/py_serverless_kit/runtime/drivers/_http.py +68 -0
  23. py_serverless_kit-0.7.0/src/py_serverless_kit/runtime/drivers/azure.py +301 -0
  24. py_serverless_kit-0.7.0/src/py_serverless_kit/runtime/drivers/cloudflare.py +117 -0
  25. py_serverless_kit-0.7.0/src/py_serverless_kit/runtime/drivers/gcp.py +310 -0
  26. py_serverless_kit-0.7.0/src/py_serverless_kit/runtime/drivers/mns.py +207 -0
  27. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/drivers/s3.py +12 -64
  28. py_serverless_kit-0.7.0/src/py_serverless_kit/runtime/drivers/sqs.py +208 -0
  29. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/onprem_host.py +8 -3
  30. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/providers/test_onprem.py +458 -329
  31. py_serverless_kit-0.7.0/tests/runtime/__init__.py +0 -0
  32. py_serverless_kit-0.7.0/tests/runtime/test_drivers_cloud.py +798 -0
  33. py_serverless_kit-0.7.0/tests/runtime/test_drivers_custom_host.py +179 -0
  34. py_serverless_kit-0.7.0/tests/runtime/test_drivers_docs_example.py +100 -0
  35. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/test_examples.py +71 -1
  36. py_serverless_kit-0.7.0/tests/workflows/__init__.py +0 -0
  37. py_serverless_kit-0.6.0/docs/resources.md +0 -201
  38. py_serverless_kit-0.6.0/src/py_serverless_kit/runtime/drivers/__init__.py +0 -96
  39. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/.gitignore +0 -0
  40. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/CONTRIBUTING.md +0 -0
  41. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/LICENSE +0 -0
  42. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/App.tsx +0 -0
  43. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/api.ts +0 -0
  44. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/components/Badge.tsx +0 -0
  45. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/components/Card.tsx +0 -0
  46. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/components/CopyButton.tsx +0 -0
  47. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/components/DataTable.tsx +0 -0
  48. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/components/Drawer.tsx +0 -0
  49. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/components/Feedback.tsx +0 -0
  50. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/components/Inputs.tsx +0 -0
  51. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/components/JsonView.tsx +0 -0
  52. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/components/Link.tsx +0 -0
  53. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/components/LogViewer.tsx +0 -0
  54. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/components/Pagination.tsx +0 -0
  55. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/components/Tabs.tsx +0 -0
  56. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/components/Timeline.tsx +0 -0
  57. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/format.ts +0 -0
  58. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/hooks.ts +0 -0
  59. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/main.tsx +0 -0
  60. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/styles.css +0 -0
  61. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/types.ts +0 -0
  62. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/views/DeploymentView.tsx +0 -0
  63. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/views/ExecutionsTab.tsx +0 -0
  64. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/views/FunctionsTab.tsx +0 -0
  65. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/views/MiscTabs.tsx +0 -0
  66. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/views/Overview.tsx +0 -0
  67. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/views/StartDialog.tsx +0 -0
  68. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/dashboard-ui/src/views/WorkflowsTab.tsx +0 -0
  69. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/deploy_docs/CONTRIBUTING.md +0 -0
  70. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/docs/README.md +0 -0
  71. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/docs/architecture.md +0 -0
  72. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/docs/cli.md +0 -0
  73. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/docs/configuration.md +0 -0
  74. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/docs/dashboard.md +0 -0
  75. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/docs/events.md +0 -0
  76. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/docs/getting-started.md +0 -0
  77. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/docs/handlers.md +0 -0
  78. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/docs/local-development.md +0 -0
  79. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/docs/migrating-from-aws.md +0 -0
  80. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/docs/providers.md +0 -0
  81. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/docs/troubleshooting.md +0 -0
  82. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/docs/workflow-executions.md +0 -0
  83. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/docs/workflows.md +0 -0
  84. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/01-hello-http/README.md +0 -0
  85. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/01-hello-http/app/__init__.py +0 -0
  86. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/01-hello-http/app/handlers.py +0 -0
  87. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/01-hello-http/pskit.yml +0 -0
  88. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/01-hello-http/requirements.txt +0 -0
  89. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/02-rest-api/README.md +0 -0
  90. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/02-rest-api/app/__init__.py +0 -0
  91. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/02-rest-api/app/handlers.py +0 -0
  92. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/02-rest-api/app/store.py +0 -0
  93. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/02-rest-api/pskit.yml +0 -0
  94. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/02-rest-api/requirements.txt +0 -0
  95. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/03-scheduled-jobs/README.md +0 -0
  96. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/03-scheduled-jobs/app/__init__.py +0 -0
  97. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/03-scheduled-jobs/app/jobs.py +0 -0
  98. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/03-scheduled-jobs/pskit.yml +0 -0
  99. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/03-scheduled-jobs/requirements.txt +0 -0
  100. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/04-queue-worker/README.md +0 -0
  101. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/04-queue-worker/app/__init__.py +0 -0
  102. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/04-queue-worker/app/worker.py +0 -0
  103. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/04-queue-worker/pskit.yml +0 -0
  104. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/04-queue-worker/requirements.txt +0 -0
  105. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/05-storage-events/README.md +0 -0
  106. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/05-storage-events/app/__init__.py +0 -0
  107. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/05-storage-events/app/files.py +0 -0
  108. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/05-storage-events/pskit.yml +0 -0
  109. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/05-storage-events/requirements.txt +0 -0
  110. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/06-pubsub-topic/README.md +0 -0
  111. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/06-pubsub-topic/app/__init__.py +0 -0
  112. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/06-pubsub-topic/app/subscribers.py +0 -0
  113. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/06-pubsub-topic/pskit.yml +0 -0
  114. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/06-pubsub-topic/requirements.txt +0 -0
  115. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/07-workflow-orders/README.md +0 -0
  116. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/07-workflow-orders/app/__init__.py +0 -0
  117. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/07-workflow-orders/app/orders.py +0 -0
  118. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/07-workflow-orders/events/b2b.json +0 -0
  119. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/07-workflow-orders/events/declined.json +0 -0
  120. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/07-workflow-orders/events/happy.json +0 -0
  121. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/07-workflow-orders/pskit.yml +0 -0
  122. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/07-workflow-orders/requirements.txt +0 -0
  123. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/08-multi-cloud/README.md +0 -0
  124. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/08-multi-cloud/app/__init__.py +0 -0
  125. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/08-multi-cloud/app/handlers.py +0 -0
  126. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/08-multi-cloud/pskit.aws.yml +0 -0
  127. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/08-multi-cloud/pskit.azure.yml +0 -0
  128. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/08-multi-cloud/pskit.gcp.yml +0 -0
  129. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/08-multi-cloud/pskit.yml +0 -0
  130. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/08-multi-cloud/requirements.txt +0 -0
  131. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/09-function-invoke/README.md +0 -0
  132. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/09-function-invoke/app/__init__.py +0 -0
  133. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/09-function-invoke/app/quotes.py +0 -0
  134. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/09-function-invoke/pskit.yml +0 -0
  135. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/09-function-invoke/requirements.txt +0 -0
  136. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/10-stages-and-config/.env.example +0 -0
  137. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/10-stages-and-config/README.md +0 -0
  138. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/10-stages-and-config/app/__init__.py +0 -0
  139. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/10-stages-and-config/app/handlers.py +0 -0
  140. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/10-stages-and-config/app/settings.py +0 -0
  141. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/10-stages-and-config/config/limits.json +0 -0
  142. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/10-stages-and-config/pskit.yml +0 -0
  143. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/10-stages-and-config/requirements.txt +0 -0
  144. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/11-custom-terraform/README.md +0 -0
  145. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/11-custom-terraform/app/__init__.py +0 -0
  146. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/11-custom-terraform/app/handlers.py +0 -0
  147. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/11-custom-terraform/app/repository.py +0 -0
  148. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/11-custom-terraform/pskit.yml +0 -0
  149. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/11-custom-terraform/requirements.txt +0 -0
  150. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/11-custom-terraform/scripts/smoke_test.py +0 -0
  151. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/11-custom-terraform/tests/test_orders.py +0 -0
  152. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/12-async-and-context/README.md +0 -0
  153. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/12-async-and-context/app/__init__.py +0 -0
  154. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/12-async-and-context/app/handlers.py +0 -0
  155. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/12-async-and-context/pskit.yml +0 -0
  156. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/12-async-and-context/requirements.txt +0 -0
  157. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/13-migrate-from-aws-lambda/README.md +0 -0
  158. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/13-migrate-from-aws-lambda/after/app/__init__.py +0 -0
  159. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/13-migrate-from-aws-lambda/after/app/orders.py +0 -0
  160. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/13-migrate-from-aws-lambda/after/pskit.yml +0 -0
  161. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/13-migrate-from-aws-lambda/after/requirements.txt +0 -0
  162. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/13-migrate-from-aws-lambda/before/lambda_function.py +0 -0
  163. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/13-migrate-from-aws-lambda/before/state_machine.asl.json +0 -0
  164. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/13-migrate-from-aws-lambda/before/template.yaml +0 -0
  165. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/14-testing/README.md +0 -0
  166. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/14-testing/app/__init__.py +0 -0
  167. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/14-testing/app/handlers.py +0 -0
  168. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/14-testing/ci.github-workflow.yml +0 -0
  169. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/14-testing/pskit.yml +0 -0
  170. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/14-testing/requirements.txt +0 -0
  171. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/14-testing/tests/conftest.py +0 -0
  172. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/14-testing/tests/test_handlers.py +0 -0
  173. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/14-testing/tests/test_workflow.py +0 -0
  174. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/15-ci-cd-deploy/README.md +0 -0
  175. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/15-ci-cd-deploy/app/__init__.py +0 -0
  176. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/15-ci-cd-deploy/app/handlers.py +0 -0
  177. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/15-ci-cd-deploy/deploy.github-workflow.yml +0 -0
  178. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/15-ci-cd-deploy/pskit.yml +0 -0
  179. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/15-ci-cd-deploy/requirements.txt +0 -0
  180. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/16-on-premises/README.md +0 -0
  181. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/16-on-premises/app/__init__.py +0 -0
  182. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/16-on-premises/app/handlers.py +0 -0
  183. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/16-on-premises/pskit.yml +0 -0
  184. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/16-on-premises/requirements.txt +0 -0
  185. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/17-on-premises-remote/README.md +0 -0
  186. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/17-on-premises-remote/app/__init__.py +0 -0
  187. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/17-on-premises-remote/app/handlers.py +0 -0
  188. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/17-on-premises-remote/pskit.yml +0 -0
  189. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/17-on-premises-remote/requirements.txt +0 -0
  190. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/18-resources/README.md +0 -0
  191. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/18-resources/app/__init__.py +0 -0
  192. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/18-resources/app/handlers.py +0 -0
  193. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/18-resources/pskit.yml +0 -0
  194. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/examples/18-resources/requirements.txt +0 -0
  195. {py_serverless_kit-0.6.0/src/py_serverless_kit/cli → py_serverless_kit-0.7.0/examples/19-custom-drivers/app}/__init__.py +0 -0
  196. {py_serverless_kit-0.6.0/src/py_serverless_kit/core → py_serverless_kit-0.7.0/examples/20-onprem-external-clouds/app}/__init__.py +0 -0
  197. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/pyproject.toml +0 -0
  198. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/__init__.py +0 -0
  199. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/__main__.py +0 -0
  200. {py_serverless_kit-0.6.0/tests → py_serverless_kit-0.7.0/src/py_serverless_kit/cli}/__init__.py +0 -0
  201. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/cli/main.py +0 -0
  202. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/cli/templates.py +0 -0
  203. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/config/__init__.py +0 -0
  204. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/config/loader.py +0 -0
  205. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/config/schema.py +0 -0
  206. {py_serverless_kit-0.6.0/tests/config → py_serverless_kit-0.7.0/src/py_serverless_kit/core}/__init__.py +0 -0
  207. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/core/deployer.py +0 -0
  208. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/core/describe.py +0 -0
  209. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/core/executions.py +0 -0
  210. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/core/onprem_control.py +0 -0
  211. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/core/project.py +0 -0
  212. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/dashboard/__init__.py +0 -0
  213. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/dashboard/generator.py +0 -0
  214. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/dashboard/server.py +0 -0
  215. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/dashboard/template.html +0 -0
  216. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/local/__init__.py +0 -0
  217. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/local/runner.py +0 -0
  218. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/local/server.py +0 -0
  219. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/packaging/__init__.py +0 -0
  220. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/packaging/builder.py +0 -0
  221. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/providers/__init__.py +0 -0
  222. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/providers/alibaba.py +0 -0
  223. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/providers/aws.py +0 -0
  224. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/providers/azure.py +0 -0
  225. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/providers/base.py +0 -0
  226. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/providers/cloudflare.py +0 -0
  227. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/providers/digitalocean.py +0 -0
  228. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/providers/gcp.py +0 -0
  229. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/providers/huawei.py +0 -0
  230. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/providers/ibm.py +0 -0
  231. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/providers/onprem_remote.py +0 -0
  232. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/providers/onprem_spec.py +0 -0
  233. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/providers/oracle.py +0 -0
  234. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/providers/registry.py +0 -0
  235. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/providers/schedule.py +0 -0
  236. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/providers/tencent.py +0 -0
  237. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/providers/terraform_doc.py +0 -0
  238. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/__init__.py +0 -0
  239. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/adapters/__init__.py +0 -0
  240. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/adapters/_httpfn.py +0 -0
  241. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/adapters/alibaba.py +0 -0
  242. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/adapters/aws.py +0 -0
  243. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/adapters/azure.py +0 -0
  244. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/adapters/base.py +0 -0
  245. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/adapters/cloudflare.py +0 -0
  246. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/adapters/digitalocean.py +0 -0
  247. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/adapters/gcp.py +0 -0
  248. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/adapters/huawei.py +0 -0
  249. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/adapters/ibm.py +0 -0
  250. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/adapters/onprem.py +0 -0
  251. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/adapters/oracle.py +0 -0
  252. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/adapters/tencent.py +0 -0
  253. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/batch.py +0 -0
  254. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/context.py +0 -0
  255. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/cron.py +0 -0
  256. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/dispatch.py +0 -0
  257. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/drivers/redis.py +0 -0
  258. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/errors.py +0 -0
  259. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/event.py +0 -0
  260. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/executions.py +0 -0
  261. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/hostlog.py +0 -0
  262. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/invoke.py +0 -0
  263. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/log.py +0 -0
  264. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/manifest.py +0 -0
  265. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/resources.py +0 -0
  266. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/response.py +0 -0
  267. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/routing.py +0 -0
  268. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/runtime/workflow.py +0 -0
  269. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/terraform/__init__.py +0 -0
  270. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/terraform/runner.py +0 -0
  271. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/workflows/__init__.py +0 -0
  272. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/workflows/asl.py +0 -0
  273. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/src/py_serverless_kit/workflows/gcp.py +0 -0
  274. {py_serverless_kit-0.6.0/tests/local → py_serverless_kit-0.7.0/tests}/__init__.py +0 -0
  275. {py_serverless_kit-0.6.0/tests/providers → py_serverless_kit-0.7.0/tests/config}/__init__.py +0 -0
  276. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/config/test_loader.py +0 -0
  277. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/config/test_schema.py +0 -0
  278. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/conftest.py +0 -0
  279. {py_serverless_kit-0.6.0/tests/runtime → py_serverless_kit-0.7.0/tests/local}/__init__.py +0 -0
  280. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/local/test_server.py +0 -0
  281. {py_serverless_kit-0.6.0/tests/workflows → py_serverless_kit-0.7.0/tests/providers}/__init__.py +0 -0
  282. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/providers/test_alibaba.py +0 -0
  283. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/providers/test_aws.py +0 -0
  284. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/providers/test_azure.py +0 -0
  285. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/providers/test_cloudflare.py +0 -0
  286. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/providers/test_digitalocean.py +0 -0
  287. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/providers/test_gcp.py +0 -0
  288. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/providers/test_huawei.py +0 -0
  289. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/providers/test_ibm.py +0 -0
  290. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/providers/test_onprem_remote.py +0 -0
  291. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/providers/test_oracle.py +0 -0
  292. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/providers/test_resources.py +0 -0
  293. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/providers/test_schedule.py +0 -0
  294. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/providers/test_tencent.py +0 -0
  295. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_adapter_alibaba.py +0 -0
  296. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_adapter_aws.py +0 -0
  297. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_adapter_azure.py +0 -0
  298. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_adapter_cloudflare.py +0 -0
  299. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_adapter_digitalocean.py +0 -0
  300. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_adapter_gcp.py +0 -0
  301. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_adapter_huawei.py +0 -0
  302. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_adapter_ibm.py +0 -0
  303. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_adapter_onprem.py +0 -0
  304. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_adapter_oracle.py +0 -0
  305. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_adapter_tencent.py +0 -0
  306. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_cron.py +0 -0
  307. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_dispatch.py +0 -0
  308. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_drivers.py +0 -0
  309. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_executions.py +0 -0
  310. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_hostlog.py +0 -0
  311. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_models.py +0 -0
  312. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_onprem_host.py +0 -0
  313. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_onprem_host_drivers.py +0 -0
  314. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_resources.py +0 -0
  315. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/runtime/test_workflow_engine.py +0 -0
  316. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/test_cli.py +0 -0
  317. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/test_dashboard.py +0 -0
  318. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/test_dashboard_server.py +0 -0
  319. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/test_executions_backends.py +0 -0
  320. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/test_packaging.py +0 -0
  321. {py_serverless_kit-0.6.0 → py_serverless_kit-0.7.0}/tests/workflows/test_compilers.py +0 -0
@@ -6,6 +6,20 @@ All notable changes to this project are documented here. The format follows [Kee
6
6
 
7
7
  ## [Unreleased]
8
8
 
9
+ ## [0.7.0] - 2026-10-21
10
+
11
+ ### Added
12
+ - On-premises drivers that watch queues and buckets in other providers: `sqs` (AWS, JSON protocol + SigV4), `azure_queue` and `azure_blob` (Shared Key, SAS or connection string; Azurite), `pubsub` (pull subscription) and `gcs` (access token, `token_command` or the metadata server; emulators), `mns` (Alibaba Cloud) and `cloudflare_queue` (HTTP pull consumer). Leases use each service's own visibility timeout, so delivery stays at-least-once. See the provider matrix in `docs/resources.md`.
13
+ - S3 storage presets `aws`, `oss`, `cos`, `obs`, `oci`, `ibm_cos`, `spaces`, `r2` and `minio` (or `driver: s3` + `provider:`). `s3` without `endpoint` now targets AWS (virtual-host style), and credentials fall back to the `AWS_*` environment variables.
14
+ - `custom` queue and storage drivers: `class: package.module:ClassName` from your app, constructed with the remaining options. Import errors, constructor errors and missing methods are reported with the class name. `docs/resources.md` has a RabbitMQ example (AMQP with manual acks).
15
+ - Any on-prem driver parameter can be written as `<name>_env: VARIABLE`, read from the host's environment at start, so secrets stay out of `pskit_host.json` and Terraform state.
16
+ - `examples/19-custom-drivers`: runnable `custom` drivers (`SqliteQueue` with visibility timeout, receive counts and a dead-letter table; `FolderStorage` for local/NFS/SMB folders) plus RabbitMQ (pika) and Kafka (kafka-python) templates, all at-least-once.
17
+ - `examples/20-onprem-external-clouds`: one on-prem host consuming SQS, Azure Storage Queue, Pub/Sub, MNS and Cloudflare Queues and watching S3, Azure Blob, GCS, R2 and MinIO, with every secret read through `*_env`.
18
+
19
+ ### Fixed
20
+ - The on-premises host makes the app importable before building its queue/storage drivers, so a `custom` driver class from the app loads at start.
21
+ - The on-premises host sets `PSKIT_ONPREM_ROOT` before building its drivers, so relative paths in driver options resolve against the host directory.
22
+
9
23
  ## [0.6.0] - 2026-10-21
10
24
 
11
25
  ### Added
@@ -1,6 +1,6 @@
1
1
  Metadata-Version: 2.5
2
2
  Name: py-serverless-kit
3
- Version: 0.6.0
3
+ Version: 0.7.0
4
4
  Summary: Write a Python serverless function once and deploy it to AWS, Azure, GCP, 7 more clouds, or an on-premises host with one YAML file, powered by Terraform.
5
5
  Project-URL: Homepage, https://github.com/ak9347128658/serverless_kit
6
6
  Project-URL: Documentation, https://github.com/ak9347128658/serverless_kit/tree/main/docs
@@ -270,6 +270,8 @@ Eighteen runnable examples live in [`examples/`](https://github.com/ak9347128658
270
270
  | [16-on-premises](https://github.com/ak9347128658/serverless_kit/tree/main/examples/16-on-premises) | HTTP, schedule, queue, storage, topic and a workflow on one machine |
271
271
  | [17-on-premises-remote](https://github.com/ak9347128658/serverless_kit/tree/main/examples/17-on-premises-remote) | SSH/SCP or Docker onto a server |
272
272
  | [18-resources](https://github.com/ak9347128658/serverless_kit/tree/main/examples/18-resources) | Managed and external resources, bindings, Redis/MinIO on premises |
273
+ | [19-custom-drivers](https://github.com/ak9347128658/serverless_kit/tree/main/examples/19-custom-drivers) | Your own on-prem queue/storage driver class; RabbitMQ and Kafka templates |
274
+ | [20-onprem-external-clouds](https://github.com/ak9347128658/serverless_kit/tree/main/examples/20-onprem-external-clouds) | On-prem host watching queues and buckets in AWS, Azure, GCP, Alibaba, Cloudflare and MinIO |
273
275
  | [09-function-invoke](https://github.com/ak9347128658/serverless_kit/tree/main/examples/09-function-invoke) | Function-to-function `invoke()` |
274
276
  | [10-stages-and-config](https://github.com/ak9347128658/serverless_kit/tree/main/examples/10-stages-and-config) | Stages, variables, secrets |
275
277
  | [11-custom-terraform](https://github.com/ak9347128658/serverless_kit/tree/main/examples/11-custom-terraform) | `terraform.extra`, `${tf:...}`, remote state, hooks |
@@ -224,6 +224,8 @@ Eighteen runnable examples live in [`examples/`](https://github.com/ak9347128658
224
224
  | [16-on-premises](https://github.com/ak9347128658/serverless_kit/tree/main/examples/16-on-premises) | HTTP, schedule, queue, storage, topic and a workflow on one machine |
225
225
  | [17-on-premises-remote](https://github.com/ak9347128658/serverless_kit/tree/main/examples/17-on-premises-remote) | SSH/SCP or Docker onto a server |
226
226
  | [18-resources](https://github.com/ak9347128658/serverless_kit/tree/main/examples/18-resources) | Managed and external resources, bindings, Redis/MinIO on premises |
227
+ | [19-custom-drivers](https://github.com/ak9347128658/serverless_kit/tree/main/examples/19-custom-drivers) | Your own on-prem queue/storage driver class; RabbitMQ and Kafka templates |
228
+ | [20-onprem-external-clouds](https://github.com/ak9347128658/serverless_kit/tree/main/examples/20-onprem-external-clouds) | On-prem host watching queues and buckets in AWS, Azure, GCP, Alibaba, Cloudflare and MinIO |
227
229
  | [09-function-invoke](https://github.com/ak9347128658/serverless_kit/tree/main/examples/09-function-invoke) | Function-to-function `invoke()` |
228
230
  | [10-stages-and-config](https://github.com/ak9347128658/serverless_kit/tree/main/examples/10-stages-and-config) | Stages, variables, secrets |
229
231
  | [11-custom-terraform](https://github.com/ak9347128658/serverless_kit/tree/main/examples/11-custom-terraform) | `terraform.extra`, `${tf:...}`, remote state, hooks |
@@ -0,0 +1,373 @@
1
+ # Resources (storage, queues, topics, databases, any service)
2
+
3
+ `resources:` names the services your functions use: buckets, queues, topics, databases, caches, or anything else. pskit either **creates** them (managed) or **attaches** ones that already exist (external), then hands each function its connection details in environment variables. Handlers read them with `resource("name")`, so the code does not change between clouds.
4
+
5
+ ```yaml
6
+ resources:
7
+ uploads: # managed bucket: pskit creates it
8
+ type: storage
9
+ name: acme-uploads-1234
10
+ jobs: # managed queue, consumed below
11
+ type: queue
12
+ billing-events: # an existing SNS topic in another stack
13
+ type: topic
14
+ external: true
15
+ connection:
16
+ arn: arn:aws:sns:us-east-1:123456789012:billing-events
17
+ orders-db: # a database pskit never touches
18
+ type: database
19
+ external: true
20
+ connection:
21
+ host: ${env:ORDERS_DB_HOST, localhost}
22
+ port: 5432
23
+ database: orders
24
+ password_env: ORDERS_DB_PASSWORD # the NAME of a secret variable, not the secret
25
+ functions: [api, worker]
26
+
27
+ functions:
28
+ api:
29
+ handler: app.handlers.api
30
+ events: [{http: POST /orders}]
31
+ worker:
32
+ handler: app.handlers.work
33
+ events:
34
+ - queue: {resource: jobs, batch_size: 5}
35
+ ```
36
+
37
+ ```python
38
+ from py_serverless_kit import resource
39
+
40
+ def api(event, ctx):
41
+ uploads = resource("uploads")
42
+ db = resource("orders-db")
43
+ password = ctx.env[db["password_env"]]
44
+ return {"bucket": uploads.native_name, "db": f'{db["host"]}:{db["port"]}'}
45
+ ```
46
+
47
+ Full example: [`examples/18-resources`](../examples/18-resources).
48
+
49
+ ## Fields
50
+
51
+ | Key | Default | Notes |
52
+ |---|---|---|
53
+ | `type` | — | required: `storage`, `queue`, `topic`, `database`, `cache` or `custom` |
54
+ | `external` | `false` | `true`: the service already exists or runs outside pskit. pskit never creates, changes or destroys it |
55
+ | `name` | resource key | native name of the bucket / queue / topic. Without `name`, the last `:` segment of `connection.arn` is used, then the key. Managed names are prefixed by the provider exactly like event names |
56
+ | `connection` | `{}` | values handed to handlers. Keys start with a letter and use letters, digits or `_`. Values must be scalars (strings, numbers, booleans; booleans become `true`/`false`). `type`, `name` and `external` are reserved. Keys must be unique ignoring case |
57
+ | `functions` | all user functions | functions that receive the binding. Without it, every function you wrote gets it, but generated `<workflow>-orchestrator` functions don't. List an orchestrator explicitly if it needs one |
58
+ | `options` | `{}` | provider-specific, for example the on-premises `driver` or AWS queue settings (below) |
59
+
60
+ Resource keys follow function-name rules and must stay distinct after `my-key` → `MY_KEY` conversion.
61
+
62
+ `database`, `cache` and `custom` must be `external: true`. pskit only passes their connection details along.
63
+
64
+ ## Using a resource from an event
65
+
66
+ `queue`, `storage` and `topic` events accept `resource:` instead of `name` / `bucket`:
67
+
68
+ ```yaml
69
+ events:
70
+ - queue: {resource: jobs, batch_size: 10, dead_letter: jobs-dlq}
71
+ - storage: {resource: uploads, prefix: in/, events: [created]}
72
+ - topic: {resource: billing-events, filter: {kind: [paid]}}
73
+ ```
74
+
75
+ The event then behaves exactly like `name: <native name>` plus `existing: <external>`, so every provider supports it. Validation fails if the resource doesn't exist, has a different `type`, or the event also sets a different `name`/`bucket`.
76
+
77
+ ## What handlers receive
78
+
79
+ For each resource bound to a function:
80
+
81
+ ```
82
+ PSKIT_RESOURCES=uploads,jobs
83
+ PSKIT_RESOURCE_UPLOADS_TYPE=storage
84
+ PSKIT_RESOURCE_UPLOADS_NAME=acme-uploads-1234 # resolved native name
85
+ PSKIT_RESOURCE_UPLOADS_EXTERNAL=false
86
+ PSKIT_RESOURCE_UPLOADS_<KEY>=... # one per connection entry
87
+ PSKIT_RESOURCE_UPLOADS_ARN / _URL / _ID=... # when the provider knows them
88
+ ```
89
+
90
+ `<KEY>` is the key with every non-alphanumeric character replaced by `_`, in upper case (`orders-db` → `ORDERS_DB`). A `connection` entry wins over a provider value with the same name.
91
+
92
+ | Provider | Values added |
93
+ |---|---|
94
+ | aws | `ARN` for storage, queue and topic. Queues also get `URL`. External resources bound by name are looked up with a Terraform data source. With `connection.arn`, that ARN is used as-is |
95
+ | gcp | `ID` for managed queues and topics (the Pub/Sub topic id) |
96
+ | others | only `TYPE`, `NAME`, `EXTERNAL` and your `connection` values |
97
+
98
+ `pskit invoke` and `pskit dev` inject the same variables locally.
99
+
100
+ ### Runtime API
101
+
102
+ ```python
103
+ from py_serverless_kit import resource, resources, Resource
104
+
105
+ jobs = resource("jobs") # KeyError listing the bound names if it isn't bound here
106
+ jobs.name # "jobs" (the key)
107
+ jobs.type # "queue"
108
+ jobs.native_name # e.g. "orders-dev-jobs"
109
+ jobs.external # False
110
+ jobs.connection # {"region": "...", ...}: keys in lower case
111
+ jobs.get("region", "us-east-1") # case-insensitive, with a default
112
+ jobs["region"] # KeyError when missing
113
+ jobs.arn, jobs.url, jobs.id # shortcuts for get("arn") / get("url") / get("id")
114
+
115
+ resources() # {"jobs": Resource(...), ...} for the current function
116
+ ```
117
+
118
+ pskit does not ship a portable "send to queue" helper for the clouds: use the cloud SDK (`boto3`, `google-cloud-pubsub`, `azure-storage-queue`, ...) with the binding values. On premises, `py_serverless_kit.runtime.onprem_host.submit_queue/submit_topic/put_object/delete_object` publish through the host and honour the drivers below.
119
+
120
+ ## Provider support
121
+
122
+ | | Managed, used by an event | Managed, no event (standalone) | External | database / cache / custom |
123
+ |---|---|---|---|---|
124
+ | aws | yes | yes (S3 bucket, SQS queue, SNS topic) | yes | yes (env only) |
125
+ | gcp | yes | yes (bucket; Pub/Sub topic for queue and topic) | yes | yes |
126
+ | azure | yes | yes (storage container, storage queue, Service Bus topic) | yes | yes |
127
+ | onprem | yes | yes (builtin directories, created on first use) | yes, with [drivers](#on-premises-drivers) | yes |
128
+ | alibaba, tencent, huawei, oracle, ibm, digitalocean, cloudflare | yes, where the event type is supported | validation error: create it outside pskit and set `external: true` | yes | yes |
129
+
130
+ On AWS, standalone managed queues take their settings from the first event that uses the resource, otherwise from `options`: `fifo`, `visibility_timeout`, `dead_letter`, `max_receive`.
131
+
132
+ On Azure, app settings belong to the whole Function App, so every function there sees every binding.
133
+
134
+ ### AWS IAM
135
+
136
+ Each role pskit creates gets a `pskit-resources` policy for the storage, queue and topic resources bound to its functions:
137
+
138
+ | Type | Actions |
139
+ |---|---|
140
+ | storage | `s3:GetObject`, `s3:PutObject`, `s3:DeleteObject`, `s3:ListBucket` (bucket and `/*`) |
141
+ | queue | `sqs:SendMessage`, `ReceiveMessage`, `DeleteMessage`, `ChangeMessageVisibility`, `GetQueueAttributes`, `GetQueueUrl` |
142
+ | topic | `sns:Publish` |
143
+
144
+ If you bring your own role (`iam.role`), pskit can't change it. The plan prints a warning, and granting access is up to you. Narrow the grant by listing `functions:` on the resource.
145
+
146
+ ## On-premises drivers
147
+
148
+ The host normally keeps queues, buckets and topics in directories (`builtin`). A resource can point at a queue or bucket that lives in another provider or in a service you already run. The host then **watches** it: queues are polled and leased, buckets are listed and diffed every `poll_seconds`, and each message or object change triggers the function like any local event.
149
+
150
+ Set `options.driver` (a string, or a mapping with `use` plus parameters). `connection.driver` works too. Parameters are read from the driver mapping, then `options`, then `connection`.
151
+
152
+ **Secrets.** Any parameter can be given as `<name>_env: VARIABLE` instead of `<name>: value`. The host reads `VARIABLE` from its own environment when it starts, so the secret never lands in Terraform state or `pskit_host.json`. A variable that isn't set stops the host with an error naming it. `${env:...}`, by contrast, is resolved on the machine running `pskit deploy` and *is* written into the files.
153
+
154
+ **Emulators and private endpoints.** Every HTTP driver accepts `endpoint: http(s)://...` (LocalStack, Azurite, the Pub/Sub emulator, fake-gcs-server, a VPC endpoint).
155
+
156
+ ### Provider matrix
157
+
158
+ | Provider | Storage driver | Queue driver |
159
+ |---|---|---|
160
+ | AWS | `s3` (or `aws`) | `sqs` |
161
+ | Azure | `azure_blob` | `azure_queue` |
162
+ | Google Cloud | `gcs` | `pubsub` (pull subscription) |
163
+ | Alibaba Cloud | `oss` | `mns` |
164
+ | Tencent Cloud | `cos` | `custom` (TDMQ) |
165
+ | Huawei Cloud | `obs` | `custom` (DMS for RabbitMQ / Kafka) |
166
+ | Oracle Cloud | `oci` | `custom` (OCI Queue signs requests with RSA keys, which the standard library can't do) |
167
+ | IBM Cloud | `ibm_cos` | `custom` (IBM MQ, Event Streams / Kafka) |
168
+ | DigitalOcean | `spaces` | no queue service: `redis` (Managed Redis / Valkey) or `custom` |
169
+ | Cloudflare | `r2` | `cloudflare_queue` |
170
+ | Self-hosted | `minio`, `s3` with `endpoint`, `directory` | `redis`, `directory`, `custom` (RabbitMQ, Kafka, NATS, ...) |
171
+
172
+ Topics only support `builtin` and `directory`.
173
+
174
+ ### Queue drivers
175
+
176
+ | Driver | Parameters (`*` = required) |
177
+ |---|---|
178
+ | `redis` | `url`* (`redis://[user:pass@]host:6379/0`, `rediss://`), `key` (default: native name) |
179
+ | `sqs` | `queue_url`*, or `account_id`* + `region`* (+ `name`, default native name). `access_key` + `secret_key` (+ `session_token`); without them `AWS_ACCESS_KEY_ID` / `AWS_SECRET_ACCESS_KEY` / `AWS_SESSION_TOKEN` on the host. `region` (default: from the URL), `wait_seconds` (long poll, 0-20, default 0), `message_group_id` (`.fifo` queues, default `pskit`), `endpoint` |
180
+ | `azure_queue` | `connection_string`*, or `account`* / `endpoint`* with `account_key`* or `sas_token`*. `queue` (default: native name), `message_encoding` (`base64` default, like the Azure SDKs, or `text`). `UseDevelopmentStorage=true` targets Azurite |
181
+ | `pubsub` | `subscription`* (default: native name; `projects/<p>/subscriptions/<s>` or a short name with `project`), `topic` (needed only to publish), auth: `access_token`, `token_command` (e.g. `[gcloud, auth, print-access-token]`, cached 45 min) or the GCE/GKE metadata server. `endpoint` + `emulator: true`, or `PUBSUB_EMULATOR_HOST` on the host, for the emulator. `return_immediately` (default `true`) |
182
+ | `mns` | `endpoint`*, or `account_id`* + `region`* (`https://<account_id>.mns.<region>.aliyuncs.com`). `access_key`*, `secret_key`*, `queue` (default: native name), `wait_seconds` (0-30), `message_encoding` (`base64` default, like the MNS SDKs, or `text`) |
183
+ | `cloudflare_queue` | `account_id`*, `queue_id`*, `api_token`* (the queue needs an HTTP pull consumer; token with Queues read/write), `endpoint` |
184
+ | `custom` | `class`* (`package.module:ClassName` in your app); every other parameter is passed to the constructor as a keyword argument |
185
+
186
+ How each one leases messages, so a crashed host never loses one (at-least-once):
187
+
188
+ - **sqs, azure_queue, mns, cloudflare_queue, pubsub**: the service's own visibility timeout / lease / ack deadline is set to the event's `visibility_timeout`. A failed message is made visible again at once; one that has failed `max_receive` times goes to `dead_letter` and is deleted. `receives` comes from the service (`ApproximateReceiveCount`, `DequeueCount`, `attempts`, `deliveryAttempt`); Pub/Sub without a dead-letter policy doesn't report attempts, so the host counts them itself (reset on restart).
189
+ - **redis**: see the layout below.
190
+ - Azure Storage Queue, MNS and Cloudflare Queues messages have no attributes; attributes given to `submit` are dropped.
191
+ - Queue depth (`/__pskit/stats`, the dashboard) is `null` for Pub/Sub, Cloudflare Queues and custom classes without `depth()`.
192
+
193
+ **Redis layout.** A message is a JSON envelope `{id, body, attributes, receives, enqueued_at}` in the list `<key>` (`LPUSH`). Claiming moves it with `RPOPLPUSH` to `<key>:processing` and records the claim time in the hash `<key>:claims`. Delivered messages are removed. Failed ones go back to `<key>` until `max_receive`, then to `dead_letter`, which is another driver queue of that name or a builtin queue. Every few seconds the host requeues claims older than `visibility_timeout`, plus any message in `processing` that has no claim. Plain strings that another producer `LPUSH`es onto `<key>` are accepted and delivered as the record body.
194
+
195
+ ### Storage drivers
196
+
197
+ | Driver | Parameters (`*` = required) |
198
+ |---|---|
199
+ | `s3` | `bucket` (default: native name), `access_key` + `secret_key` (both or neither; neither = the `AWS_*` variables, then anonymous), `session_token`, `prefix`, `region`, `path_style`. With `endpoint` (MinIO, Ceph, ...) requests go there path-style. Without one they go to AWS: `https://s3.<region>.amazonaws.com`, virtual-host style. `provider:` picks a preset below |
200
+ | `aws`, `oss`, `cos`, `obs`, `oci`, `ibm_cos`, `spaces`, `r2`, `minio` | the same parameters; the preset fills in the endpoint, addressing style and signing region (also usable as `driver: s3` + `provider: <name>`) |
201
+ | `azure_blob` | auth as `azure_queue`, `container` (default: native name), `prefix` |
202
+ | `gcs` | auth as `pubsub`, `bucket` (default: native name), `prefix`, `endpoint` (default `https://storage.googleapis.com`; fake-gcs-server via `endpoint` + `emulator: true`, or `STORAGE_EMULATOR_HOST`) |
203
+ | `custom` | `class`*, keyword arguments as for queues |
204
+
205
+ | Preset | Endpoint | Style | Extra required | Notes |
206
+ |---|---|---|---|---|
207
+ | `aws` | `https://s3.<region>.amazonaws.com` | virtual-host | | `region` defaults to `us-east-1` |
208
+ | `oss` | `https://oss-<region>.aliyuncs.com` | virtual-host | `region` (`cn-hangzhou`) | OSS's S3-compatible API with SigV4. If OSS rejects the signature, set `signing_region` to the region form it expects |
209
+ | `cos` | `https://cos.<region>.myqcloud.com` | virtual-host | `region` (`ap-guangzhou`) | the bucket name includes `-<APPID>` |
210
+ | `obs` | `https://obs.<region>.myhuaweicloud.com` | virtual-host | `region` (`cn-north-4`) | OBS's S3-compatible API; confirm SigV4 is accepted in your region |
211
+ | `oci` | `https://<namespace>.compat.objectstorage.<region>.oraclecloud.com` | path | `region`, `namespace` | Customer Secret Keys as `access_key` / `secret_key` |
212
+ | `ibm_cos` | `https://s3.<region>.cloud-object-storage.appdomain.cloud` | path | `region` (`us-south`) | HMAC credentials, not an API key |
213
+ | `spaces` | `https://<region>.digitaloceanspaces.com` | virtual-host | `region` (`nyc3`) | |
214
+ | `r2` | `https://<account_id>.r2.cloudflarestorage.com` | path | `account_id` | signing region `auto` |
215
+ | `minio` | your `endpoint` | path | `endpoint` | |
216
+
217
+ `endpoint`, `path_style` and `signing_region` override any preset. The drivers are tested against local fakes of each documented API, not against the live services; try a new provider with a test bucket first.
218
+
219
+ Every storage driver lists the bucket (all pages) on each poll. A new or changed ETag emits `created`, a missing key emits `deleted`. Objects present at first start are recorded and not emitted. `prefix` limits the host to keys below it and is stripped from `record.key`. On a large bucket, always set `prefix`.
220
+
221
+ ### Examples
222
+
223
+ ```yaml
224
+ providers:
225
+ onprem:
226
+ resources:
227
+ jobs: # an SQS queue in AWS, watched from your data centre
228
+ external: true
229
+ options:
230
+ driver: sqs
231
+ queue_url: https://sqs.eu-west-1.amazonaws.com/123456789012/jobs
232
+ access_key_env: AWS_ACCESS_KEY_ID_JOBS
233
+ secret_key_env: AWS_SECRET_ACCESS_KEY_JOBS
234
+ wait_seconds: 10
235
+ uploads: # an Azure Blob container
236
+ external: true
237
+ options:
238
+ driver: azure_blob
239
+ connection_string_env: AZURE_STORAGE_CONNECTION_STRING
240
+ container: uploads
241
+ prefix: incoming/
242
+ events: # a Pub/Sub subscription
243
+ external: true
244
+ options:
245
+ driver: pubsub
246
+ project: my-project
247
+ subscription: orders-onprem
248
+ token_command: [gcloud, auth, print-access-token]
249
+ media: # Cloudflare R2
250
+ external: true
251
+ options: {driver: r2, account_id: 0123abcd, access_key_env: R2_KEY, secret_key_env: R2_SECRET}
252
+ ```
253
+
254
+ ### Custom drivers
255
+
256
+ `custom` loads a class from your app, so any broker works: RabbitMQ, Kafka, NATS, IBM MQ, Tencent TDMQ, Huawei DMS, OCI Queue. Put its client library in `requirements.txt`; pskit itself doesn't import it.
257
+
258
+ Working examples: [`examples/19-custom-drivers`](../examples/19-custom-drivers) has a runnable SQLite queue (with a dead-letter table) and folder storage, plus RabbitMQ and Kafka templates. [`examples/20-onprem-external-clouds`](../examples/20-onprem-external-clouds) wires every built-in cloud driver into one host.
259
+
260
+ ```yaml
261
+ resources:
262
+ orders:
263
+ type: queue
264
+ external: true
265
+ options:
266
+ driver: custom
267
+ class: app.backends:RabbitQueue
268
+ url_env: RABBITMQ_URL # -> RabbitQueue(url=os.environ["RABBITMQ_URL"], queue="orders")
269
+ queue: orders
270
+ ```
271
+
272
+ A queue class needs `submit(body, attributes) -> id`, `claim(batch, visibility, now) -> [message]` and `settle(claimed, failed_ids, max_receive, dead_letter, now)`; `depth()` and `recover(now, visibility)` are optional. A message is a dict with `id`, `body`, `attributes`, `receives`, `enqueued_at`, plus any private `_` keys you need in `settle`. A storage class needs `scan() -> {key: (etag, size)}`, `put`, `get` and `delete -> bool`. Import errors, constructor errors and missing methods stop the host with a message naming the class.
273
+
274
+ **Why RabbitMQ is `custom`.** The management HTTP API (`POST /api/queues/<vhost>/<queue>/get`) settles a message as it is read: `ack_requeue_false` removes it before the handler runs (lost if the handler fails), and `ack_requeue_true` puts it straight back (delivered again while still being processed, and it can't be acknowledged later). Neither is a lease, so pskit doesn't ship a lossy driver. AMQP with manual acks, as below, is at-least-once: unacknowledged messages return to the queue when the connection closes.
275
+
276
+ ```python
277
+ # app/backends.py (requirements.txt: pika)
278
+ import threading
279
+ import uuid
280
+
281
+ import pika
282
+
283
+
284
+ class RabbitQueue:
285
+ def __init__(self, url, queue):
286
+ self.params = pika.URLParameters(url)
287
+ self.queue = queue
288
+ self.lock = threading.Lock() # pika connections are not thread-safe
289
+ self.channel = None
290
+
291
+ def _ch(self):
292
+ if self.channel is None or self.channel.is_closed:
293
+ self.channel = pika.BlockingConnection(self.params).channel()
294
+ self.channel.queue_declare(queue=self.queue, durable=True)
295
+ return self.channel
296
+
297
+ def submit(self, body, attributes):
298
+ message_id = uuid.uuid4().hex
299
+ props = pika.BasicProperties(message_id=message_id, headers=attributes or None, delivery_mode=2)
300
+ with self.lock:
301
+ self._ch().basic_publish(exchange="", routing_key=self.queue, body=body.encode(), properties=props)
302
+ return message_id
303
+
304
+ def claim(self, batch, visibility, now):
305
+ out = []
306
+ with self.lock:
307
+ ch = self._ch()
308
+ for _ in range(batch):
309
+ method, props, body = ch.basic_get(queue=self.queue, auto_ack=False)
310
+ if method is None:
311
+ break
312
+ headers = dict(props.headers or {})
313
+ # Quorum queues count deliveries; classic queues only flag a redelivery.
314
+ receives = int(headers.get("x-delivery-count", 0)) + 1 if "x-delivery-count" in headers else (
315
+ 2 if method.redelivered else 1
316
+ )
317
+ out.append({
318
+ "id": props.message_id or str(method.delivery_tag),
319
+ "body": body.decode("utf-8"),
320
+ "attributes": headers,
321
+ "receives": receives,
322
+ "enqueued_at": now,
323
+ "_tag": method.delivery_tag,
324
+ })
325
+ return out
326
+
327
+ def settle(self, claimed, failed_ids, max_receive, dead_letter, now):
328
+ with self.lock:
329
+ ch = self._ch()
330
+ for msg in claimed:
331
+ if msg["id"] not in failed_ids:
332
+ ch.basic_ack(delivery_tag=msg["_tag"])
333
+ elif dead_letter is not None and msg["receives"] >= max_receive:
334
+ dead_letter.submit(msg["body"], msg["attributes"])
335
+ ch.basic_ack(delivery_tag=msg["_tag"])
336
+ else:
337
+ ch.basic_nack(delivery_tag=msg["_tag"], requeue=True)
338
+
339
+ def depth(self):
340
+ with self.lock:
341
+ return self._ch().queue_declare(queue=self.queue, passive=True).method.message_count
342
+ ```
343
+
344
+ A connection drop between `claim` and `settle` makes the stored delivery tags invalid; the messages are redelivered by RabbitMQ and `settle` fails once (logged as a host note).
345
+
346
+ An endpoint that can't be reached shows up as a host note (`/__pskit/health`, `pskit logs --source host`). The host keeps serving other triggers and retries on the next poll.
347
+
348
+ `pskit validate` rejects a driver that isn't allowed for the type, missing required parameters, one of a key pair without the other, a non-http(s) `endpoint`, and a malformed `class`.
349
+
350
+ ## Secrets
351
+
352
+ Connection values become environment variables. They're stored in Terraform state and, on premises, in `.pskit/onprem-<stage>/onprem_app/pskit_host.json`. Treat both as sensitive, or keep secrets out of them:
353
+
354
+ - Put the **name** of a secret variable in `connection` (`password_env: ORDERS_DB_PASSWORD`) and read the secret at run time (`ctx.env[db["password_env"]]`) from the platform's secret store or function environment.
355
+ - `${env:...}` resolves on the machine that runs `pskit deploy`, so the value is written into state. Use it knowingly, typically for on-prem driver credentials.
356
+
357
+ `pskit info --json` and the dashboard list connection **key names** only, never values.
358
+
359
+ ## Troubleshooting
360
+
361
+ | Message | Fix |
362
+ |---|---|
363
+ | `pskit does not create `database` resources; set `external: true`` | database / cache / custom are always external |
364
+ | `function 'x' uses unknown resource 'y'` | add `y` under `resources:` or fix the key |
365
+ | `function 'x' has a queue event on resource 'y', which is a storage` | the resource `type` must match the event kind |
366
+ | `set either `name` or `resource` on the queue event, not both` | drop the event's `name` / `bucket` |
367
+ | `managed queue resources that no event uses are not supported on X yet` | create it outside pskit, set `external: true` and `name` |
368
+ | `resource 'x' is not bound to this function` (runtime) | add the function to the resource's `functions:` list, or remove the list |
369
+ | `the redis driver needs url: redis://host:6379/0` | set `options.url` (or `connection.url`) |
370
+ | `environment variable X (option secret_key_env ...) is not set on the host` | export `X` where the on-prem host runs (systemd unit, Docker `-e`, shell) |
371
+ | `custom driver (queue jobs): cannot import 'app.backends'` | the module must be in the bundle (`package.source`); its dependencies in `requirements.txt` |
372
+ | `custom driver ...: X does not implement claim, settle` | add the missing methods; `depth` and `recover` are optional |
373
+ | `sqs: request failed (400): ... QueueDoesNotExist` | check `queue_url` / `region` and that the credentials can see the queue |
@@ -8,6 +8,7 @@ Pick what you're building. Each guide has the `pskit.yml` you need, the commands
8
8
  | process jobs from a queue pskit creates | [B](#b-queue-worker-with-a-managed-queue) |
9
9
  | consume a queue or bucket that already exists | [C](#c-attach-an-existing-queue-or-bucket) |
10
10
  | run on my own server with Redis and MinIO | [D](#d-on-premises-with-redis-and-minio) |
11
+ | run on my own server but consume queues / buckets in AWS, Azure, GCP or another cloud | [K](#k-on-premises-watching-queues-and-buckets-in-other-clouds) |
11
12
  | give functions a database or any other service | [E](#e-attach-a-database-or-custom-service) |
12
13
  | orchestrate steps and track each run | [F](#f-workflows-start-get-the-execution-id-watch-it) |
13
14
  | run jobs on a schedule | [G](#g-scheduled-jobs) |
@@ -192,7 +193,7 @@ mc cp a.mp4 local/uploads/incoming/a.mp4
192
193
  pskit logs -f # see both handlers run
193
194
  ```
194
195
 
195
- **Verify:** `pskit logs --source invocation` shows `queue -> ok` and `storage -> ok`. If Redis or MinIO is unreachable, `pskit logs --source host` shows a note and the host keeps running. These credentials end up in `pskit_host.json` and Terraform state: keep `.pskit/` private ([secrets](resources.md#secrets)).
196
+ **Verify:** `pskit logs --source invocation` shows `queue -> ok` and `storage -> ok`. If Redis or MinIO is unreachable, `pskit logs --source host` shows a note and the host keeps running. `${env:...}` values end up in `pskit_host.json` and Terraform state. To keep them out, write `password_env: REDIS_PASSWORD`-style parameters instead (`access_key_env`, `secret_key_env`, ...) and export the variables where the host runs ([secrets](resources.md#on-premises-drivers)).
196
197
 
197
198
  ## E. Attach a database or custom service
198
199
 
@@ -371,3 +372,69 @@ def test_worker():
371
372
  ```
372
373
 
373
374
  `.env` is loaded by `pskit dev` and `pskit invoke`. Resource bindings are injected locally too, so `resource("jobs")` works in tests. More: [local-development.md](local-development.md), [`examples/14-testing`](../examples/14-testing).
375
+
376
+ ## K. On premises, watching queues and buckets in other clouds
377
+
378
+ The functions run on your server; the messages and files stay where they are. The host polls each external queue and bucket and triggers the function for every message or object change.
379
+
380
+ Complete projects: [`examples/20-onprem-external-clouds`](../examples/20-onprem-external-clouds) (every built-in cloud driver) and [`examples/19-custom-drivers`](../examples/19-custom-drivers) (your own driver class for RabbitMQ, Kafka or anything else).
381
+
382
+ ```yaml
383
+ service: hybrid
384
+ provider:
385
+ name: onprem
386
+ options: {host: 0.0.0.0, port: 8080, admin_token: "${env:PSKIT_ADMIN_TOKEN}"}
387
+ resources:
388
+ orders: # AWS SQS
389
+ type: queue
390
+ external: true
391
+ options:
392
+ driver: sqs
393
+ queue_url: https://sqs.eu-west-1.amazonaws.com/123456789012/orders
394
+ access_key_env: AWS_ACCESS_KEY_ID
395
+ secret_key_env: AWS_SECRET_ACCESS_KEY
396
+ wait_seconds: 10
397
+ invoices: # Azure Blob container
398
+ type: storage
399
+ external: true
400
+ options:
401
+ driver: azure_blob
402
+ connection_string_env: AZURE_STORAGE_CONNECTION_STRING
403
+ container: invoices
404
+ prefix: incoming/
405
+ events: # Google Pub/Sub pull subscription
406
+ type: queue
407
+ external: true
408
+ options:
409
+ driver: pubsub
410
+ project: my-project
411
+ subscription: events-onprem
412
+ token_command: [gcloud, auth, print-access-token]
413
+ archive: # Alibaba OSS bucket
414
+ type: storage
415
+ external: true
416
+ name: archive-bucket
417
+ options: {driver: oss, region: cn-hangzhou, access_key_env: OSS_KEY, secret_key_env: OSS_SECRET}
418
+ functions:
419
+ process-order:
420
+ handler: app.orders.process
421
+ events: [{queue: {resource: orders, batch_size: 10, max_receive: 5, dead_letter: orders-dlq}}]
422
+ on-invoice:
423
+ handler: app.invoices.on_upload
424
+ events: [{storage: {resource: invoices, events: [created]}}]
425
+ on-event:
426
+ handler: app.events.handle
427
+ events: [{queue: {resource: events}}]
428
+ on-archive:
429
+ handler: app.archive.on_change
430
+ events: [{storage: {resource: archive, events: [created, deleted]}}]
431
+ ```
432
+
433
+ 1. Export the variables on the machine that runs the host (systemd `Environment=`, Docker `-e`, or the shell for `method: local`). They are read when the host starts and never written to disk by pskit.
434
+ 2. `pskit validate` checks each driver's required parameters and key pairs.
435
+ 3. `pskit deploy`, then send a test message from the cloud side: `aws sqs send-message --queue-url ... --message-body '{"id": 1}'`, upload a blob, `gcloud pubsub topics publish ...`.
436
+ 4. `pskit logs -f --source invocation` shows each handler run; `pskit logs --source host` shows connection or permission problems.
437
+
438
+ **Verify:** `GET /__pskit/stats` (and the dashboard) reports the SQS backlog under `queues`; Pub/Sub has no backlog API, so `events` is `null`. A message that keeps failing moves to `orders-dlq` (a builtin queue here) after `max_receive` deliveries.
439
+
440
+ Other providers: `mns` (Alibaba) and `cloudflare_queue` for queues; `cos`, `obs`, `oci`, `ibm_cos`, `spaces`, `r2`, `minio` for storage. For RabbitMQ, Kafka, IBM MQ, OCI Queue and the rest, write a small `custom` driver class. See the [provider matrix](resources.md#provider-matrix) and the [custom driver example](resources.md#custom-drivers).
@@ -0,0 +1,60 @@
1
+ # 19 · Custom on-premises drivers
2
+
3
+ When the queue or storage you already run has no built-in driver, write a small
4
+ class and point a resource at it. The on-prem host still does the rest: polling,
5
+ batching, `BatchResult` retries, dead-lettering, logs, stats and the dashboard.
6
+
7
+ | Resource | Class | Backed by |
8
+ | --- | --- | --- |
9
+ | `jobs` | `app.backends:SqliteQueue` | one SQLite file, table `jobs` |
10
+ | `jobs-dlq` | `app.backends:SqliteQueue` | the same file, table `jobs_dlq` |
11
+ | `inbox` | `app.backends:FolderStorage` | a folder (works for NFS / SMB shares) |
12
+
13
+ `app/rabbitmq_queue.py` (pika) and `app/kafka_queue.py` (kafka-python) are
14
+ templates for brokers that need a client library. Both deliver at least once.
15
+
16
+ ## The contract
17
+
18
+ ```yaml
19
+ resources:
20
+ jobs:
21
+ type: queue # or storage
22
+ external: true
23
+ options:
24
+ driver: custom
25
+ class: app.backends:SqliteQueue # "<module>:<Class>", importable from the app
26
+ path: data/queues.sqlite3 # every other option -> constructor kwargs
27
+ password_env: QUEUE_PASSWORD # `<name>_env` -> read from the host's env as `password`
28
+ ```
29
+
30
+ A **queue** class implements:
31
+
32
+ | Method | Called | Must |
33
+ | --- | --- | --- |
34
+ | `submit(body, attributes) -> id` | `submit_queue()`, `POST /__pskit/queues/<name>`, dead-lettering | store one message |
35
+ | `claim(batch, visibility, now) -> [msg]` | every poll | reserve up to `batch` messages for `visibility` seconds; each `msg` has `id`, `body`, `attributes`, `receives`, `enqueued_at` (+ private `_keys` you need later) |
36
+ | `settle(claimed, failed_ids, max_receive, dead_letter, now)` | after the handler | delete successes; make failures visible again; when `receives + 1 >= max_receive` and `dead_letter` is given, `dead_letter.submit(...)` then delete |
37
+ | `depth() -> int` | stats / dashboard | messages waiting, or `-1` if unknown |
38
+ | `recover(now, visibility)` | every few seconds | release reservations a crash left behind (no-op if the broker does it) |
39
+
40
+ A **storage** class implements `scan() -> {key: (etag, size)}`, `put(key, data)`,
41
+ `get(key) -> bytes` and `delete(key) -> bool`. The host diffs consecutive scans to
42
+ fire `created` / `deleted`, so `etag` must change whenever the content changes.
43
+
44
+ Rules of thumb:
45
+
46
+ - Never lose a message: delete only in `settle`, never in `claim`.
47
+ - Raise on connection errors. The host logs a warning and tries again on the next poll.
48
+ - `submit` may be called from HTTP threads at the same time as `claim`/`settle` on the poller, so guard shared clients.
49
+
50
+ ## Try it
51
+
52
+ ```bash
53
+ pskit validate
54
+ pskit deploy # starts the host on 127.0.0.1:8091
55
+ curl -X POST localhost:8091/jobs -H 'content-type: application/json' -d '{"task": "resize"}'
56
+ curl -X POST localhost:8091/jobs -H 'content-type: application/json' -d '{"task": "explode"}' # retried 3x, then dead-lettered
57
+ echo hello > .pskit/onprem-dev/onprem_app/data/inbox/hello.txt # fires on-file
58
+ pskit logs -f # job done / job failed / dead letter / file event
59
+ pskit dashboard --serve # Logs tab + queue depths
60
+ ```