data-syncmaster 0.1.5__tar.gz → 0.2.1__tar.gz

{data_syncmaster-0.1.5 → data_syncmaster-0.2.1}/LICENSE.txt

@@ -1,4 +1,4 @@
-Copyright 2023-2024 MTS (Mobile Telesystems).  All rights reserved.
+Copyright 2023-2025 MTS PJSC.  All rights reserved.
 
                                  Apache License
                            Version 2.0, January 2004

{data_syncmaster-0.1.5 → data_syncmaster-0.2.1}/PKG-INFO

@@ -1,9 +1,9 @@
-Metadata-Version: 2.1
+Metadata-Version: 2.3
 Name: data-syncmaster
-Version: 0.1.5
+Version: 0.2.1
 Summary: Syncmaster REST API + Worker
 License: Apache-2.0
-Keywords: Syncmaster,REST,API,Worker,Replication
+Keywords: Syncmaster,REST,API,Worker,Spark,Transfer,ETL
 Author: DataOps.ETL
 Author-email: onetools@mts.ru
 Requires-Python: >=3.11,<4.0
@@ -17,29 +17,38 @@ Classifier: Operating System :: OS Independent
 Classifier: Programming Language :: Python :: 3
 Classifier: Programming Language :: Python :: 3.11
 Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
 Classifier: Programming Language :: Python :: 3 :: Only
-Classifier: Programming Language :: Python :: 3.10
-Classifier: Programming Language :: Python :: 3.7
-Classifier: Programming Language :: Python :: 3.8
-Classifier: Programming Language :: Python :: 3.9
 Classifier: Topic :: Software Development :: Libraries
 Classifier: Topic :: Software Development :: Libraries :: Python Modules
 Classifier: Typing :: Typed
-Provides-Extra: backend
+Provides-Extra: scheduler
+Provides-Extra: server
 Provides-Extra: worker
-Requires-Dist: alembic (>=1.11.1,<2.0.0) ; extra == "backend"
-Requires-Dist: asyncpg (>=0.29.0,<0.30.0) ; extra == "backend"
-Requires-Dist: celery (>=5.3.3,<6.0.0) ; extra == "backend" or extra == "worker"
-Requires-Dist: fastapi (>=0.110.0,<0.111.0) ; extra == "backend"
-Requires-Dist: onetl[spark] (>=0.10.2,<0.11.0) ; extra == "worker"
-Requires-Dist: psycopg2-binary (>=2.9.7,<3.0.0) ; extra == "worker"
-Requires-Dist: pydantic (>=2.7.0,<3.0.0)
-Requires-Dist: pydantic-settings (>=2.2.1,<3.0.0) ; extra == "backend" or extra == "worker"
-Requires-Dist: python-jose[cryptography] (>=3.3.0,<4.0.0) ; extra == "backend"
-Requires-Dist: python-multipart (>=0.0.9,<0.0.10) ; extra == "backend"
-Requires-Dist: sqlalchemy (>=2.0.18,<3.0.0) ; extra == "backend" or extra == "worker"
-Requires-Dist: sqlalchemy-utils (>=0.41.1,<0.42.0) ; extra == "backend" or extra == "worker"
-Requires-Dist: uvicorn (>=0.29.0,<0.30.0) ; extra == "backend"
+Requires-Dist: alembic (>=1.15.2,<2.0.0) ; extra == "server"
+Requires-Dist: apscheduler (>=3.11.0,<4.0.0) ; extra == "scheduler"
+Requires-Dist: asgi-correlation-id (>=4.3.4,<5.0.0) ; extra == "server" or extra == "worker"
+Requires-Dist: asyncpg (>=0.30.0,<0.31.0) ; extra == "server" or extra == "scheduler"
+Requires-Dist: celery (>=5.5.0,<6.0.0) ; extra == "server" or extra == "worker" or extra == "scheduler"
+Requires-Dist: coloredlogs ; extra == "server" or extra == "worker" or extra == "scheduler"
+Requires-Dist: fastapi (>=0.115.12,<0.116.0) ; extra == "server"
+Requires-Dist: horizon-hwm-store (>=1.1.2,<2.0.0) ; extra == "worker"
+Requires-Dist: itsdangerous (>=2.2.0,<3.0.0) ; extra == "server"
+Requires-Dist: jinja2 (>=3.1.6,<4.0.0) ; extra == "server" or extra == "worker"
+Requires-Dist: onetl[all] (>=0.13.4,<0.14.0) ; extra == "worker"
+Requires-Dist: psycopg2-binary (>=2.9.10,<3.0.0) ; extra == "server" or extra == "worker"
+Requires-Dist: pydantic (>=2.11.1,<3.0.0)
+Requires-Dist: pydantic-settings (>=2.8.1,<3.0.0) ; extra == "server" or extra == "worker" or extra == "scheduler"
+Requires-Dist: pyjwt (>=2.10.1,<3.0.0) ; extra == "server"
+Requires-Dist: python-json-logger ; extra == "server" or extra == "worker" or extra == "scheduler"
+Requires-Dist: python-keycloak (>=5.3.1,<6.0.0) ; extra == "server"
+Requires-Dist: python-multipart (>=0.0.20,<0.0.21) ; extra == "server"
+Requires-Dist: pyyaml ; extra == "server" or extra == "worker" or extra == "scheduler"
+Requires-Dist: sqlalchemy (>=2.0.40,<3.0.0) ; extra == "server" or extra == "worker" or extra == "scheduler"
+Requires-Dist: sqlalchemy-utils (>=0.41.2,<0.42.0) ; extra == "server" or extra == "worker" or extra == "scheduler"
+Requires-Dist: starlette-exporter (>=0.23.0,<0.24.0) ; extra == "server"
+Requires-Dist: uuid6 (>=2024.7.10,<2025.0.0) ; extra == "server" or extra == "worker"
+Requires-Dist: uvicorn (>=0.34.0,<0.35.0) ; extra == "server"
 Project-URL: CI/CD, https://github.com/MobileTeleSystems/syncmaster/actions
 Project-URL: Documentation, https://syncmaster.readthedocs.io
 Project-URL: Homepage, https://github.com/MobileTeleSystems/syncmaster
@@ -47,25 +56,24 @@ Project-URL: Source, https://github.com/MobileTeleSystems/syncmaster
 Project-URL: Tracker, https://github.com/MobileTeleSystems/syncmaster/issues
 Description-Content-Type: text/x-rst
 
-.. title
+.. _readme:
 
-==========
-SyncMaster
-==========
+Data.SyncMaster
+===============
 
-|Repo Status| |PyPI| |PyPI License| |PyPI Python Version| |Docker image| |Documentation|
-|Build Status| |Coverage|  |pre-commit.ci|
+|Repo Status| |Docker image| |PyPI| |PyPI License| |PyPI Python Version| |Documentation|
+|Build Status| |Coverage| |pre-commit.ci|
 
-.. |Repo Status| image:: https://www.repostatus.org/badges/latest/active.svg
-    :target: https://github.com/MobileTeleSystems/syncmaster
+.. |Repo Status| image:: https://www.repostatus.org/badges/latest/wip.svg
+    :target: https://www.repostatus.org/#wip
+.. |Docker image| image:: https://img.shields.io/docker/v/mtsrus/syncmaster-server?sort=semver&label=docker
+    :target: https://hub.docker.com/r/mtsrus/syncmaster-server
 .. |PyPI| image:: https://img.shields.io/pypi/v/data-syncmaster
     :target: https://pypi.org/project/data-syncmaster/
 .. |PyPI License| image:: https://img.shields.io/pypi/l/data-syncmaster.svg
     :target: https://github.com/MobileTeleSystems/syncmaster/blob/develop/LICENSE.txt
 .. |PyPI Python Version| image:: https://img.shields.io/pypi/pyversions/data-syncmaster.svg
     :target: https://badge.fury.io/py/data-syncmaster
-.. |Docker image| image:: https://img.shields.io/docker/v/mtsrus/syncmaster-backend?sort=semver&label=docker
-    :target: https://hub.docker.com/r/mtsrus/syncmaster-backend
 .. |Documentation| image:: https://readthedocs.org/projects/syncmaster/badge/?version=stable
     :target: https://syncmaster.readthedocs.io
 .. |Build Status| image:: https://github.com/MobileTeleSystems/syncmaster/workflows/Run%20All%20Tests/badge.svg
@@ -76,22 +84,29 @@ SyncMaster
     :target: https://results.pre-commit.ci/latest/github/MobileTeleSystems/syncmaster/develop
 
 
-What is Syncmaster?
--------------------
+What is Data.SyncMaster?
+------------------------
 
-Syncmaster is as low-code ETL tool for transfering data between databases and file systems.
+Data.SyncMaster is as low-code ETL tool for transfering data between databases and file systems.
 List of currently supported connections:
 
 * Apache Hive
+* Clickhouse
 * Postgres
 * Oracle
+* MSSQL
+* MySQL
 * HDFS
 * S3
+* FTP
+* FTPS
+* SFTP
+* Samba
+* WebDAV
 
-Current SyncMaster implementation provides following components:
+Based on `onETL <https://onetl.readthedocs.io/>`_ and `Apache Spark <https://spark.apache.org/>`_.
 
-* REST API
-* Celery Worker
+**Note**: service is under active development, and is not ready to use.
 
 Goals
 -----
@@ -104,7 +119,6 @@ Non-goals
 ---------
 
 * This is not a backup system
-* This is not a CDC solution
 * Only batch, no streaming
 
 .. documentation
@@ -113,3 +127,4 @@ Documentation
 -------------
 
 See https://syncmaster.readthedocs.io
+

{data_syncmaster-0.1.5 → data_syncmaster-0.2.1}/README.rst

@@ -1,22 +1,21 @@
-.. title
+.. _readme:
 
-==========
-SyncMaster
-==========
+Data.SyncMaster
+===============
 
-|Repo Status| |PyPI| |PyPI License| |PyPI Python Version| |Docker image| |Documentation|
-|Build Status| |Coverage|  |pre-commit.ci|
+|Repo Status| |Docker image| |PyPI| |PyPI License| |PyPI Python Version| |Documentation|
+|Build Status| |Coverage| |pre-commit.ci|
 
-.. |Repo Status| image:: https://www.repostatus.org/badges/latest/active.svg
-    :target: https://github.com/MobileTeleSystems/syncmaster
+.. |Repo Status| image:: https://www.repostatus.org/badges/latest/wip.svg
+    :target: https://www.repostatus.org/#wip
+.. |Docker image| image:: https://img.shields.io/docker/v/mtsrus/syncmaster-server?sort=semver&label=docker
+    :target: https://hub.docker.com/r/mtsrus/syncmaster-server
 .. |PyPI| image:: https://img.shields.io/pypi/v/data-syncmaster
     :target: https://pypi.org/project/data-syncmaster/
 .. |PyPI License| image:: https://img.shields.io/pypi/l/data-syncmaster.svg
     :target: https://github.com/MobileTeleSystems/syncmaster/blob/develop/LICENSE.txt
 .. |PyPI Python Version| image:: https://img.shields.io/pypi/pyversions/data-syncmaster.svg
     :target: https://badge.fury.io/py/data-syncmaster
-.. |Docker image| image:: https://img.shields.io/docker/v/mtsrus/syncmaster-backend?sort=semver&label=docker
-    :target: https://hub.docker.com/r/mtsrus/syncmaster-backend
 .. |Documentation| image:: https://readthedocs.org/projects/syncmaster/badge/?version=stable
     :target: https://syncmaster.readthedocs.io
 .. |Build Status| image:: https://github.com/MobileTeleSystems/syncmaster/workflows/Run%20All%20Tests/badge.svg
@@ -27,22 +26,29 @@ SyncMaster
     :target: https://results.pre-commit.ci/latest/github/MobileTeleSystems/syncmaster/develop
 
 
-What is Syncmaster?
--------------------
+What is Data.SyncMaster?
+------------------------
 
-Syncmaster is as low-code ETL tool for transfering data between databases and file systems.
+Data.SyncMaster is as low-code ETL tool for transfering data between databases and file systems.
 List of currently supported connections:
 
 * Apache Hive
+* Clickhouse
 * Postgres
 * Oracle
+* MSSQL
+* MySQL
 * HDFS
 * S3
+* FTP
+* FTPS
+* SFTP
+* Samba
+* WebDAV
 
-Current SyncMaster implementation provides following components:
+Based on `onETL <https://onetl.readthedocs.io/>`_ and `Apache Spark <https://spark.apache.org/>`_.
 
-* REST API
-* Celery Worker
+**Note**: service is under active development, and is not ready to use.
 
 Goals
 -----
@@ -55,7 +61,6 @@ Non-goals
 ---------
 
 * This is not a backup system
-* This is not a CDC solution
 * Only batch, no streaming
 
 .. documentation
@@ -63,4 +68,4 @@ Non-goals
 Documentation
 -------------
 
-See https://syncmaster.readthedocs.io
+See https://syncmaster.readthedocs.io