mage-ai 0.9.76__py3-none-any.whl → 0.9.78__py3-none-any.whl

mage_ai/tests/streaming/sources/test_kafka.py

@@ -33,7 +33,7 @@ class KafkaTests(TestCase):
             api_version='0.10.2',
             auto_offset_reset='latest',
             max_partition_fetch_bytes=1048576,
-            enable_auto_commit=True,
+            enable_auto_commit=False,
         )
 
     def test_init_client_with_topics(self):
@@ -56,7 +56,7 @@ class KafkaTests(TestCase):
             api_version='0.10.2',
             auto_offset_reset='latest',
             max_partition_fetch_bytes=1048576,
-            enable_auto_commit=True,
+            enable_auto_commit=False,
         )
 
     def test_init_client_with_missing_topic_or_topics(self):

{mage_ai-0.9.76.dist-info → mage_ai-0.9.78.dist-info}/METADATA

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: mage-ai
-Version: 0.9.76
+Version: 0.9.78
 Summary: Mage is a tool for building and deploying data pipelines.
 Home-page: https://github.com/mage-ai/mage-ai
 Author: Mage
@@ -12,6 +12,7 @@ Requires-Python: >=3.9
 Description-Content-Type: text/markdown
 License-File: LICENSE
 Requires-Dist: cachetools
+Requires-Dist: click<8.2.0
 Requires-Dist: Faker==4.14.0
 Requires-Dist: GitPython==3.1.41
 Requires-Dist: Jinja2==3.1.3
@@ -41,7 +42,8 @@ Requires-Dist: memory_profiler
 Requires-Dist: newrelic==8.8.0
 Requires-Dist: numpy>=1.22.0
 Requires-Dist: pandas>=1.3.0
-Requires-Dist: polars<0.19.2,>=0.18.0
+Requires-Dist: paramiko==3.5.1
+Requires-Dist: polars==1.29.0
 Requires-Dist: protobuf>=4.25.0
 Requires-Dist: psutil==5.9.8
 Requires-Dist: pyairtable>=2.3.3
@@ -229,165 +231,128 @@ Dynamic: requires-dist
 Dynamic: requires-python
 Dynamic: summary
 
-<div align="left">
-  <h1>Mage AI</h1>
+# Mage OSS
 
-  <p>Give your data team magical powers.</p>
-
-<a href="https://mage.ai"><img alt="Mage AI GitHub repo stars" src="https://img.shields.io/github/stars/mage-ai/mage-ai?style=for-the-badge&logo=github&labelColor=000000&logoColor=FFFFFF&label=stars&color=0500ff" /></a>
-<a href="https://hub.docker.com/r/mageai/mageai"><img alt="Mage AI Docker downloads" src="https://img.shields.io/docker/pulls/mageai/mageai?style=for-the-badge&logo=docker&labelColor=000000&logoColor=FFFFFF&label=pulls&color=6A35FF" /></a>
-<a href="https://github.com/mage-ai/mage-ai/blob/master/LICENSE"><img alt="Mage AI license" src="https://img.shields.io/github/license/mage-ai/mage-ai?style=for-the-badge&logo=codeigniter&labelColor=000000&logoColor=FFFFFF&label=license&color=FFCC19" /></a>
-<a href="https://www.mage.ai/chat"><img alt="Join the Mage AI community" src="https://img.shields.io/badge/Join%20the%20community-black.svg?style=for-the-badge&logo=lightning&labelColor=000000&logoColor=FFFFFF&label=&color=DD55FF&logoWidth=20" /></a>
-
-</div>
+### Build modern data pipelines locally — fast, visual, and production-ready.
 
 <br />
 
-<a href="https://cloud.mage.ai/sign-up">
-  <picture>
-    <source media="(prefers-color-scheme: dark)" srcset="https://github.com/mage-ai/assets/blob/main/oss/hero.png?raw=true">
-    <img alt="Mage AI hero" src="https://github.com/mage-ai/assets/blob/main/oss/hero.png?raw=true" />
-  </picture>
-</a>
+Mage OSS is a self-hosted development environment designed to help teams create production-grade data pipelines with confidence.
 
-<br />
-<br />
+Ideal for automating ETL tasks, architecting data flow, or orchestrating transformations — all in a fast, notebook-style interface powered by modular code.
 
-Mage is a hybrid framework for transforming and integrating data. It combines the best of both worlds: the flexibility of notebooks with the rigor of modular code.
+When it’s time to scale, [Mage Pro](https://mage.ai) — our core platform — unlocks enterprise orchestration, collaboration, and AI-powered workflows.
 
 <br />
 
-- Extract and synchronize data from 3rd party sources.
-- Transform data with real-time and batch pipelines using Python, SQL, and R.
-- Load data into your data warehouse or data lake using our pre-built connectors.
-- Run, monitor, and orchestrate thousands of pipelines without losing sleep.
+[![GitHub Stars](https://img.shields.io/github/stars/mage-ai/mage-ai?style=for-the-badge&labelColor=000000&color=1C1C1C)](https://github.com/mage-ai/mage-ai/stargazers)
+[![Docker Pulls](https://img.shields.io/docker/pulls/mageai/mageai?style=for-the-badge&labelColor=000000&color=1C1C1C)](https://hub.docker.com/r/mageai/mageai)
+[![Slack Community](https://img.shields.io/badge/Join%20the%20community-black.svg?style=for-the-badge&logo=lightning&labelColor=000000&color=1C1C1C)](https://www.mage.ai/chat)
+[![License](https://img.shields.io/github/license/mage-ai/mage-ai?style=for-the-badge&labelColor=000000&color=1C1C1C)](https://github.com/mage-ai/mage-ai/blob/master/LICENSE)
 
 <br />
 
-Plus hundreds of enterprise-class features, infrastructure innovations, and magical surprises.
+## What you can do with Mage OSS
 
-<h1></h1>
+- Build pipelines locally with Python, SQL, or R in a modular notebook-style UI
 
-#### Available in two spellbinding versions
+- Run jobs manually or on a schedule (cron supported)
 
-<br />
+- Connect to databases, APIs, and cloud storage with prebuilt connectors
 
-<table style="width: 100%; border: none;" cellspacing="0" cellpadding="0" border="0">
-  <tr>
-    <td rowspan="2">
-      <a href="https://cloud.mage.ai/sign-up">
-        <img alt="Mage Pro" width="124" align="left" src="https://github.com/mage-ai/assets/blob/main/oss/card-pro.png?raw=true" />
-      </a>
-      <b>For teams.</b> Fully managed platform
-      for integrating and transforming data.
-    </td>
-    <td rowspan="2">
-      <a href="https://github.com/mage-ai/mage-ai?tab=readme-ov-file#its-magic">
-        <img alt="Mage OSS" width="124" align="left" src="https://github.com/mage-ai/assets/blob/main/oss/card-oss.png?raw=true" />
-      </a>
-      <b>Self-hosted.</b> System to build, run, and
-      manage data pipelines.
-    </td>
-  </tr>
-</table>
+- Debug visually with logs, live previews, and step-by-step execution
 
-<br />
+- Set up quickly with Docker, pip, or conda — no cloud account required
 
-<a href="https://cloud.mage.ai/sign-up">
-  <img alt="Try out Mage Pro" src="https://img.shields.io/badge/try%20it%20out%20now-black.svg?style=for-the-badge&logo=artifacthub&labelColor=6A35FF&logoColor=FFFFFF&label=mage%20pro&color=6A35FF">
-</a>
+- Your go-to workspace for local pipeline development — fully in your control.
+  
+<img width="100%" alt="mage" src="https://github.com/user-attachments/assets/75992872-20a6-4120-8bf0-9c22a3d66450" />
 
-<br />
-<br />
 
-<div align="left">
+<br /><br />
 
-# It’s magic.
+## Start local. Scale when you're ready.
 
-<p align="left">
-  For documentation on getting started, how to develop, and how to deploy to production check out the live
-  <br />
-  <a
-    href="https://docs.mage.ai?source=github"
-    target="_blank"
-  ><b>Developer documentation portal</b></a>.
-</p>
+Use Mage OSS to build and run pipelines on your machine. When you're ready for advanced tooling, performance, and AI-assisted productivity, Mage Pro is just one click away.
+
+[**Try Mage Pro free →**](https://mage.ai)
 
 <br />
 
-## 🏃‍♀️ Install
+### Quickstart
 
-The recommended way to install the latest version of Mage is through Docker with the following command:
+Install using Docker (recommended):
 
 ```bash
 docker pull mageai/mageai:latest
 ```
 
-You can also install Mage using pip or conda, though this may cause dependency issues without the proper environment.
+Or with pip:
 
 ```bash
 pip install mage-ai
 ```
+
+Or with conda:
+
 ```bash
 conda install -c conda-forge mage-ai
 ```
 
-Looking for help? The _fastest_ way to get started is by checking out our documentation [here](https://docs.mage.ai/getting-started/setup).
-
-Looking for quick examples? Open a [demo](https://demo.mage.ai/) project right in your browser or check out our [guides](https://docs.mage.ai/guides/overview).
+Full setup guide and docs: [docs.mage.ai](https://docs.mage.ai)
 
-## 🎮 Demo
+<br />
 
-### Live demo
+## Core Features
 
-Build and run a data pipeline with our <b>[demo app](https://demo.mage.ai/)</b>.
+| Feature | Description |
+| :- | :- |
+| Modular pipelines | Build pipelines block-by-block using Python, SQL, or R |
+| Notebook UI | Interactive editor for writing and documenting logic |
+| Data integrations | Prebuilt connectors to databases, APIs, and cloud storage |
+| Scheduling | Trigger pipelines manually or on a schedule |
+| Visual debugging | Step-by-step logs, data previews, and error handling |
+| dbt support | Build and run dbt models directly inside Mage |
 
-> WARNING
->
-> The live demo is public to everyone, please don’t save anything sensitive (e.g. passwords, secrets, etc).
-### Demo video (5 min)
+<br />
 
-[![Mage quick start demo](https://github.com/mage-ai/assets/blob/main/overview/overview-video.png?raw=True)](https://youtu.be/GswOdShLGmg)
+## Example Use Cases
 
-<sub><i>Click the image to play video</i></sub>
+- Move data from Google Sheets to Snowflake with a Python transform
+- Schedule a daily SQL pipeline to clean and aggregate product data
+- Develop dbt models in a visual notebook-style interface
+- Run simple ETL/ELT jobs locally with full transparency
 
 <br />
 
-## 🔮 [Features](https://docs.mage.ai/about/features)
+## Documentation
 
-|   |   |   |
-| --- | --- | --- |
-| 🎶 | <b>[Orchestration](https://docs.mage.ai/design/data-pipeline-management)</b> | Schedule and manage data pipelines with observability. |
-| 📓 | <b>[Notebook](https://docs.mage.ai/about/features#notebook-for-building-data-pipelines)</b> | Interactive Python, SQL, & R editor for coding data pipelines. |
-| 🏗️ | <b>[Data integrations](https://docs.mage.ai/data-integrations/overview)</b> | Synchronize data from 3rd party sources to your internal destinations. |
-| 🚰 | <b>[Streaming pipelines](https://docs.mage.ai/guides/streaming-pipeline)</b> | Ingest and transform real-time data. |
-| ❎ | <b>[dbt](https://docs.mage.ai/dbt/overview)</b> | Build, run, and manage your dbt models with Mage. |
+Looking for how-to guides, examples, or advanced configuration?
 
-<br />
+Explore our full documentation at [docs.mage.ai](https://docs.mage.ai).
 
-<b>A sample data pipeline defined across 3 files ➝</b>
 
 <br />
 
-1. Load data ➝
-    ```python
-    @data_loader
-    def load_csv_from_file() -> pl.DataFrame:
-        return pl.read_csv('default_repo/titanic.csv')
-    ```
-1. Transform data ➝
-    ```python
-    @transformer
-    def select_columns_from_df(df: pl.DataFrame, *args) -> pl.DataFrame:
-        return df[['Age', 'Fare', 'Survived']]
-    ```
-1. Export data ➝
-    ```python
-    @data_exporter
-    def export_titanic_data_to_disk(df: pl.DataFrame) -> None:
-        df.to_csv('default_repo/titanic_transformed.csv')
-    ```
+## Contributing
+
+We welcome contributions of all kinds — bug fixes, docs, new features, or community examples.
+
+Start with our [contributing guide](https://docs.mage.ai/contributing/overview), check out open issues, or suggest improvements.
 
 <br />
 
-[<img alt="Water mage casting spell" height="300" src="https://github.com/mage-ai/assets/blob/main/mage-water-charging-up.svg?raw=True" />](https://www.mage.ai/)
+## Ready to scale? Mage Pro has you covered.
+
+Mage Pro is a powered-up platform built for teams.
+It adds everything you need for production pipelines, at scale.
+
+- Magical AI-assisted development and debugging
+- Multi-environment orchestration
+- Role-based access control
+- Real-time monitoring & alerts
+- Powerful CI/CD & version control
+- Powerful enterprise features
+- Available fully managed, hybrid, or on-premises
+
+[**Try Mage Pro free →**](https://mage.ai)