ai-data-science-team 0.0.0.9009__tar.gz → 0.0.0.9010__tar.gz

{ai_data_science_team-0.0.0.9009/ai_data_science_team.egg-info → ai_data_science_team-0.0.0.9010}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.2
 Name: ai-data-science-team
-Version: 0.0.0.9009
+Version: 0.0.0.9010
 Summary: Build and run an AI-powered data science team.
 Home-page: https://github.com/business-science/ai-data-science-team
 Author: Matt Dancho
@@ -27,10 +27,13 @@ Requires-Dist: plotly
 Requires-Dist: streamlit
 Requires-Dist: scikit-learn
 Requires-Dist: xgboost
-Provides-Extra: machine-learning-agent
-Requires-Dist: h2o; extra == "machine-learning-agent"
+Requires-Dist: psutil
+Provides-Extra: machine-learning
+Requires-Dist: h2o; extra == "machine-learning"
+Requires-Dist: mlflow; extra == "machine-learning"
 Provides-Extra: all
 Requires-Dist: h2o; extra == "all"
+Requires-Dist: mlflow; extra == "all"
 Dynamic: author
 Dynamic: author-email
 Dynamic: classifier
@@ -45,7 +48,7 @@ Dynamic: summary
 <div align="center">
   <a href="https://github.com/business-science/ai-data-science-team">
     <picture>
-      <img src="/img/ai_data_science_team_logo.jpg" alt="AI Data Science Team" width="400">
+      <img src="/img/ai_data_science_team_logo_small.jpg" alt="AI Data Science Team" width="400">
   </picture>
   </a>
 </div>
@@ -86,8 +89,11 @@ The AI Data Science Team of Copilots includes Agents that specialize data cleani
   - [Generative AI for Data Scientists Workshop](#generative-ai-for-data-scientists-workshop)
   - [Data Science Agents](#data-science-agents)
     - [NEW: Multi-Agents](#new-multi-agents)
-    - [Coming Soon: Data Science Apps](#coming-soon-data-science-apps)
+    - [Data Science Apps](#data-science-apps)
+    - [Apps Available Now](#apps-available-now)
+      - [🔥 Agentic Applications](#-agentic-applications)
     - [Agents Available Now](#agents-available-now)
+      - [🔥🔥 NEW! Machine Learning Agents](#-new-machine-learning-agents)
       - [Data Science Agents](#data-science-agents-1)
       - [Multi-Agents](#multi-agents)
     - [Agents Coming Soon](#agents-coming-soon)
@@ -124,32 +130,44 @@ This is the internals of the SQL Data Analyst Agent that connects to SQL databas
 
 ![Business Intelligence SQL Agent](/img/multi_agent_sql_data_visualization.jpg)
 
-### Coming Soon: Data Science Apps
+### Data Science Apps
 
 This is a top secret project I'm working on. It's a multi-agent data science app that performs time series forecasting.
 
-![Multi-Agent Data Science App](/img/ai_powered_apps.jpg)
+![Multi-Agent Data Science App](/img/ai_powered_apps.jpg) 
+
+### Apps Available Now
+
+[See all available apps here](/apps)
+
+#### 🔥 Agentic Applications
+
+1. **SQL Database Agent App:** Connects any SQL Database, generates SQL queries from natural language, and returns data as a downloadable table. [See Application](/apps/sql-database-agent-app/)
 
 ### Agents Available Now
 
+#### 🔥🔥 NEW! Machine Learning Agents
+
+1. **🔥 H2O Machine Learning Agent:** Builds and logs 100's of high-performance machine learning models. [See Example](https://github.com/business-science/ai-data-science-team/blob/master/examples/ml_agents/h2o_machine_learning_agent.ipynb)
+2. **🔥 MLflow Tools Agent (MLOps):** This agent has 11+ tools for managing models, ML projects, and making production ML predictions with MLflow. [See Example](https://github.com/business-science/ai-data-science-team/blob/master/examples/ml_agents/mlflow_tools_agent.ipynb)
+
 #### Data Science Agents
 
-1. **Data Wrangling Agent:** Merges, Joins, Preps and Wrangles data into a format that is ready for data analysis.
-2. **Data Visualization Agent:** Creates visualizations to help you understand your data. Returns JSON serializable plotly visualizations.
-3. **Data Cleaning Agent:** Performs Data Preparation steps including handling missing values, outliers, and data type conversions.
-4. **Feature Engineering Agent:** Converts the prepared data into ML-ready data. Adds features to increase predictive accuracy of ML models.
-5. **SQL Database Agent:** Connects to SQL databases to pull data into the data science environment. Creates pipelines to automate data extraction. Performs Joins, Aggregations, and other SQL Query operations.
+1. **Data Wrangling Agent:** Merges, Joins, Preps and Wrangles data into a format that is ready for data analysis. [See Example](https://github.com/business-science/ai-data-science-team/blob/master/examples/data_wrangling_agent.ipynb)
+2. **Data Visualization Agent:** Creates visualizations to help you understand your data. Returns JSON serializable plotly visualizations. [See Example](https://github.com/business-science/ai-data-science-team/blob/master/examples/data_visualization_agent.ipynb)
+3. **Data Cleaning Agent:** Performs Data Preparation steps including handling missing values, outliers, and data type conversions. [See Example](https://github.com/business-science/ai-data-science-team/blob/master/examples/data_cleaning_agent.ipynb)
+4. **Feature Engineering Agent:** Converts the prepared data into ML-ready data. Adds features to increase predictive accuracy of ML models. [See Example](https://github.com/business-science/ai-data-science-team/blob/master/examples/feature_engineering_agent.ipynb)
+5. **SQL Database Agent:** Connects to SQL databases to pull data into the data science environment. Creates pipelines to automate data extraction. Performs Joins, Aggregations, and other SQL Query operations. [See Example](https://github.com/business-science/ai-data-science-team/blob/master/examples/sql_database_agent.ipynb)
 
 #### Multi-Agents
 
-1. **SQL Data Analyst Agent:** Connects to SQL databases to pull data into the data science environment. Creates pipelines to automate data extraction. Performs Joins, Aggregations, and other SQL Query operations. Includes a Data Visualization Agent that creates visualizations to help you understand your data.
+1. **SQL Data Analyst Agent:** Connects to SQL databases to pull data into the data science environment. Creates pipelines to automate data extraction. Performs Joins, Aggregations, and other SQL Query operations. Includes a Data Visualization Agent that creates visualizations to help you understand your data. [See Example](https://github.com/business-science/ai-data-science-team/blob/master/examples/multiagents/sql_data_analyst.ipynb)
 
 ### Agents Coming Soon
 
 1. **Data Analyst:** Analyzes data structure, creates exploratory visualizations, and performs correlation analysis to identify relationships.
-2. **Machine Learning Agent:** Builds and logs the machine learning models.
-3. **Interpretability Agent:** Performs Interpretable ML to explain why the model returned predictions including which features were the most important to the model.
-4. **Supervisor:** Forms task list. Moderates sub-agents. Returns completed assignment. 
+2. **Interpretability Agent:** Performs Interpretable ML to explain why the model returned predictions including which features were the most important to the model.
+3. **Supervisor:** Forms task list. Moderates sub-agents. Returns completed assignment. 
 
 ## Disclaimer
 

{ai_data_science_team-0.0.0.9009 → ai_data_science_team-0.0.0.9010}/README.md

@@ -1,7 +1,7 @@
 <div align="center">
   <a href="https://github.com/business-science/ai-data-science-team">
     <picture>
-      <img src="/img/ai_data_science_team_logo.jpg" alt="AI Data Science Team" width="400">
+      <img src="/img/ai_data_science_team_logo_small.jpg" alt="AI Data Science Team" width="400">
   </picture>
   </a>
 </div>
@@ -42,8 +42,11 @@ The AI Data Science Team of Copilots includes Agents that specialize data cleani
   - [Generative AI for Data Scientists Workshop](#generative-ai-for-data-scientists-workshop)
   - [Data Science Agents](#data-science-agents)
     - [NEW: Multi-Agents](#new-multi-agents)
-    - [Coming Soon: Data Science Apps](#coming-soon-data-science-apps)
+    - [Data Science Apps](#data-science-apps)
+    - [Apps Available Now](#apps-available-now)
+      - [🔥 Agentic Applications](#-agentic-applications)
     - [Agents Available Now](#agents-available-now)
+      - [🔥🔥 NEW! Machine Learning Agents](#-new-machine-learning-agents)
       - [Data Science Agents](#data-science-agents-1)
       - [Multi-Agents](#multi-agents)
     - [Agents Coming Soon](#agents-coming-soon)
@@ -80,32 +83,44 @@ This is the internals of the SQL Data Analyst Agent that connects to SQL databas
 
 ![Business Intelligence SQL Agent](/img/multi_agent_sql_data_visualization.jpg)
 
-### Coming Soon: Data Science Apps
+### Data Science Apps
 
 This is a top secret project I'm working on. It's a multi-agent data science app that performs time series forecasting.
 
-![Multi-Agent Data Science App](/img/ai_powered_apps.jpg)
+![Multi-Agent Data Science App](/img/ai_powered_apps.jpg) 
+
+### Apps Available Now
+
+[See all available apps here](/apps)
+
+#### 🔥 Agentic Applications
+
+1. **SQL Database Agent App:** Connects any SQL Database, generates SQL queries from natural language, and returns data as a downloadable table. [See Application](/apps/sql-database-agent-app/)
 
 ### Agents Available Now
 
+#### 🔥🔥 NEW! Machine Learning Agents
+
+1. **🔥 H2O Machine Learning Agent:** Builds and logs 100's of high-performance machine learning models. [See Example](https://github.com/business-science/ai-data-science-team/blob/master/examples/ml_agents/h2o_machine_learning_agent.ipynb)
+2. **🔥 MLflow Tools Agent (MLOps):** This agent has 11+ tools for managing models, ML projects, and making production ML predictions with MLflow. [See Example](https://github.com/business-science/ai-data-science-team/blob/master/examples/ml_agents/mlflow_tools_agent.ipynb)
+
 #### Data Science Agents
 
-1. **Data Wrangling Agent:** Merges, Joins, Preps and Wrangles data into a format that is ready for data analysis.
-2. **Data Visualization Agent:** Creates visualizations to help you understand your data. Returns JSON serializable plotly visualizations.
-3. **Data Cleaning Agent:** Performs Data Preparation steps including handling missing values, outliers, and data type conversions.
-4. **Feature Engineering Agent:** Converts the prepared data into ML-ready data. Adds features to increase predictive accuracy of ML models.
-5. **SQL Database Agent:** Connects to SQL databases to pull data into the data science environment. Creates pipelines to automate data extraction. Performs Joins, Aggregations, and other SQL Query operations.
+1. **Data Wrangling Agent:** Merges, Joins, Preps and Wrangles data into a format that is ready for data analysis. [See Example](https://github.com/business-science/ai-data-science-team/blob/master/examples/data_wrangling_agent.ipynb)
+2. **Data Visualization Agent:** Creates visualizations to help you understand your data. Returns JSON serializable plotly visualizations. [See Example](https://github.com/business-science/ai-data-science-team/blob/master/examples/data_visualization_agent.ipynb)
+3. **Data Cleaning Agent:** Performs Data Preparation steps including handling missing values, outliers, and data type conversions. [See Example](https://github.com/business-science/ai-data-science-team/blob/master/examples/data_cleaning_agent.ipynb)
+4. **Feature Engineering Agent:** Converts the prepared data into ML-ready data. Adds features to increase predictive accuracy of ML models. [See Example](https://github.com/business-science/ai-data-science-team/blob/master/examples/feature_engineering_agent.ipynb)
+5. **SQL Database Agent:** Connects to SQL databases to pull data into the data science environment. Creates pipelines to automate data extraction. Performs Joins, Aggregations, and other SQL Query operations. [See Example](https://github.com/business-science/ai-data-science-team/blob/master/examples/sql_database_agent.ipynb)
 
 #### Multi-Agents
 
-1. **SQL Data Analyst Agent:** Connects to SQL databases to pull data into the data science environment. Creates pipelines to automate data extraction. Performs Joins, Aggregations, and other SQL Query operations. Includes a Data Visualization Agent that creates visualizations to help you understand your data.
+1. **SQL Data Analyst Agent:** Connects to SQL databases to pull data into the data science environment. Creates pipelines to automate data extraction. Performs Joins, Aggregations, and other SQL Query operations. Includes a Data Visualization Agent that creates visualizations to help you understand your data. [See Example](https://github.com/business-science/ai-data-science-team/blob/master/examples/multiagents/sql_data_analyst.ipynb)
 
 ### Agents Coming Soon
 
 1. **Data Analyst:** Analyzes data structure, creates exploratory visualizations, and performs correlation analysis to identify relationships.
-2. **Machine Learning Agent:** Builds and logs the machine learning models.
-3. **Interpretability Agent:** Performs Interpretable ML to explain why the model returned predictions including which features were the most important to the model.
-4. **Supervisor:** Forms task list. Moderates sub-agents. Returns completed assignment. 
+2. **Interpretability Agent:** Performs Interpretable ML to explain why the model returned predictions including which features were the most important to the model.
+3. **Supervisor:** Forms task list. Moderates sub-agents. Returns completed assignment. 
 
 ## Disclaimer
 

ai_data_science_team-0.0.0.9010/ai_data_science_team/_version.py

@@ -0,0 +1 @@
+__version__ = "0.0.0.9010"

{ai_data_science_team-0.0.0.9009 → ai_data_science_team-0.0.0.9010}/ai_data_science_team/agents/data_cleaning_agent.py

@@ -27,16 +27,16 @@ from ai_data_science_team.templates import(
     create_coding_agent_graph,
     BaseAgent,
 )
-from ai_data_science_team.tools.parsers import PythonOutputParser
-from ai_data_science_team.tools.regex import (
+from ai_data_science_team.parsers.parsers import PythonOutputParser
+from ai_data_science_team.utils.regex import (
     relocate_imports_inside_function, 
     add_comments_to_top, 
     format_agent_name, 
     format_recommended_steps, 
     get_generic_summary,
 )
-from ai_data_science_team.tools.metadata import get_dataframe_summary
-from ai_data_science_team.tools.logging import log_ai_function
+from ai_data_science_team.tools.dataframe import get_dataframe_summary
+from ai_data_science_team.utils.logging import log_ai_function
 
 # Setup
 AGENT_NAME = "data_cleaning_agent"
@@ -183,7 +183,7 @@ class DataCleaningAgent(BaseAgent):
         self.response=None
         return make_data_cleaning_agent(**self._params)
 
-    def ainvoke_agent(self, data_raw: pd.DataFrame, user_instructions: str=None, max_retries:int=3, retry_count:int=0, **kwargs):
+    async def ainvoke_agent(self, data_raw: pd.DataFrame, user_instructions: str=None, max_retries:int=3, retry_count:int=0, **kwargs):
         """
         Asynchronously invokes the agent. The response is stored in the response attribute.
 
@@ -204,7 +204,7 @@ class DataCleaningAgent(BaseAgent):
         --------
             None. The response is stored in the response attribute.
         """
-        response = self._compiled_graph.ainvoke({
+        response = await self._compiled_graph.ainvoke({
             "user_instructions": user_instructions,
             "data_raw": data_raw.to_dict(),
             "max_retries": max_retries,

ai_data_science_team-0.0.0.9010/ai_data_science_team/agents/data_loader_tools_agent.py

@@ -0,0 +1,69 @@
+
+
+
+from typing import Any, Optional, Annotated, Sequence, List, Dict
+import operator
+
+import pandas as pd
+import os
+
+from IPython.display import Markdown
+
+from langchain_core.messages import BaseMessage, AIMessage
+
+from langgraph.prebuilt import create_react_agent, ToolNode
+from langgraph.prebuilt.chat_agent_executor import AgentState
+from langgraph.graph import START, END, StateGraph
+
+from ai_data_science_team.templates import BaseAgent
+from ai_data_science_team.utils.regex import format_agent_name
+from ai_data_science_team.tools.data_loader import (
+    load_directory,
+    load_file,
+    list_directory_contents,
+    list_directory_recursive,
+    get_file_info,
+    search_files_by_pattern,
+)
+
+AGENT_NAME = "data_loader_tools_agent"
+
+tools = [
+    load_directory,
+    load_file,
+    list_directory_contents,
+    list_directory_recursive,
+    get_file_info,
+    search_files_by_pattern,
+]
+
+
+
+def make_data_loader_tools_agent(
+    model: Any,
+    directory: Optional[str] = os.getcwd(),
+):
+    """
+    Creates a Data Loader Agent that can interact with data loading tools.
+    
+    Parameters:
+    ----------
+    model : langchain.llms.base.LLM
+        The language model used to generate the tool calling agent.
+    directory : str, optional
+        The directory to search for files. Defaults to the current working directory.
+    
+    Returns:
+    --------
+    Data Loader Agent
+        An agent that can interact with data loading tools.
+    """
+    
+    class GraphState(AgentState):
+        internal_messages: Annotated[Sequence[BaseMessage], operator.add]
+        directory: str
+        user_instructions: str
+        data_artifacts: dict
+    
+    pass
+

{ai_data_science_team-0.0.0.9009 → ai_data_science_team-0.0.0.9010}/ai_data_science_team/agents/data_visualization_agent.py

@@ -10,7 +10,6 @@ from typing import TypedDict, Annotated, Sequence, Literal
 import operator
 
 from langchain.prompts import PromptTemplate
-from langchain_core.output_parsers import StrOutputParser
 from langchain_core.messages import BaseMessage
 
 from langgraph.types import Command
@@ -30,16 +29,16 @@ from ai_data_science_team.templates import(
     create_coding_agent_graph,
     BaseAgent,
 )
-from ai_data_science_team.tools.parsers import PythonOutputParser
-from ai_data_science_team.tools.regex import (
+from ai_data_science_team.parsers.parsers import PythonOutputParser
+from ai_data_science_team.utils.regex import (
     relocate_imports_inside_function, 
     add_comments_to_top, 
     format_agent_name, 
     format_recommended_steps, 
     get_generic_summary,
 )
-from ai_data_science_team.tools.metadata import get_dataframe_summary
-from ai_data_science_team.tools.logging import log_ai_function
+from ai_data_science_team.tools.dataframe import get_dataframe_summary
+from ai_data_science_team.utils.logging import log_ai_function
 from ai_data_science_team.utils.plotly import plotly_from_dict
 
 # Setup
@@ -197,7 +196,7 @@ class DataVisualizationAgent(BaseAgent):
         # Rebuild the compiled graph
         self._compiled_graph = self._make_compiled_graph()
 
-    def ainvoke_agent(self, data_raw: pd.DataFrame, user_instructions: str=None, max_retries:int=3, retry_count:int=0, **kwargs):
+    async def ainvoke_agent(self, data_raw: pd.DataFrame, user_instructions: str=None, max_retries:int=3, retry_count:int=0, **kwargs):
         """
         Asynchronously invokes the agent to generate a visualization. 
         The response is stored in the 'response' attribute.
@@ -219,7 +218,7 @@ class DataVisualizationAgent(BaseAgent):
         -------
         None
         """
-        response = self._compiled_graph.ainvoke({
+        response = await self._compiled_graph.ainvoke({
             "user_instructions": user_instructions,
             "data_raw": data_raw.to_dict(),
             "max_retries": max_retries,

{ai_data_science_team-0.0.0.9009 → ai_data_science_team-0.0.0.9010}/ai_data_science_team/agents/data_wrangling_agent.py

@@ -24,16 +24,16 @@ from ai_data_science_team.templates import(
     create_coding_agent_graph,
     BaseAgent,
 )
-from ai_data_science_team.tools.parsers import PythonOutputParser
-from ai_data_science_team.tools.regex import (
+from ai_data_science_team.parsers.parsers import PythonOutputParser
+from ai_data_science_team.utils.regex import (
     relocate_imports_inside_function, 
     add_comments_to_top, 
     format_agent_name, 
     format_recommended_steps, 
     get_generic_summary,
 )
-from ai_data_science_team.tools.metadata import get_dataframe_summary
-from ai_data_science_team.tools.logging import log_ai_function
+from ai_data_science_team.tools.dataframe import get_dataframe_summary
+from ai_data_science_team.utils.logging import log_ai_function
 
 # Setup Logging Path
 AGENT_NAME = "data_wrangling_agent"
@@ -213,7 +213,7 @@ class DataWranglingAgent(BaseAgent):
             self._params[k] = v
         self._compiled_graph = self._make_compiled_graph()
 
-    def ainvoke_agent(
+    async def ainvoke_agent(
         self,
         data_raw: Union[pd.DataFrame, dict, list],
         user_instructions: str=None,
@@ -245,7 +245,7 @@ class DataWranglingAgent(BaseAgent):
         None
         """
         data_input = self._convert_data_input(data_raw)
-        response = self._compiled_graph.ainvoke({
+        response = await self._compiled_graph.ainvoke({
             "user_instructions": user_instructions,
             "data_raw": data_input,
             "max_retries": max_retries,

{ai_data_science_team-0.0.0.9009 → ai_data_science_team-0.0.0.9010}/ai_data_science_team/agents/feature_engineering_agent.py

@@ -27,16 +27,16 @@ from ai_data_science_team.templates import(
     create_coding_agent_graph,
     BaseAgent,
 )
-from ai_data_science_team.tools.parsers import PythonOutputParser
-from ai_data_science_team.tools.regex import (
+from ai_data_science_team.parsers.parsers import PythonOutputParser
+from ai_data_science_team.utils.regex import (
     relocate_imports_inside_function, 
     add_comments_to_top, 
     format_agent_name, 
     format_recommended_steps, 
     get_generic_summary,
 )
-from ai_data_science_team.tools.metadata import get_dataframe_summary
-from ai_data_science_team.tools.logging import log_ai_function
+from ai_data_science_team.tools.dataframe import get_dataframe_summary
+from ai_data_science_team.utils.logging import log_ai_function
 
 # Setup
 AGENT_NAME = "feature_engineering_agent"
@@ -203,7 +203,7 @@ class FeatureEngineeringAgent(BaseAgent):
             self._params[k] = v
         self._compiled_graph = self._make_compiled_graph()
 
-    def ainvoke_agent(
+    async def ainvoke_agent(
         self, 
         data_raw: pd.DataFrame, 
         user_instructions: str=None, 
@@ -235,7 +235,7 @@ class FeatureEngineeringAgent(BaseAgent):
         -------
         None
         """
-        response = self._compiled_graph.ainvoke({
+        response = await self._compiled_graph.ainvoke({
             "user_instructions": user_instructions,
             "data_raw": data_raw.to_dict(),
             "target_variable": target_variable,

{ai_data_science_team-0.0.0.9009 → ai_data_science_team-0.0.0.9010}/ai_data_science_team/agents/sql_database_agent.py

@@ -25,15 +25,15 @@ from ai_data_science_team.templates import(
     create_coding_agent_graph,
     BaseAgent,
 )
-from ai_data_science_team.tools.parsers import SQLOutputParser  
-from ai_data_science_team.tools.regex import (
+from ai_data_science_team.parsers.parsers import SQLOutputParser  
+from ai_data_science_team.utils.regex import (
     add_comments_to_top, 
     format_agent_name, 
     format_recommended_steps, 
     get_generic_summary,
 )
-from ai_data_science_team.tools.metadata import get_database_metadata
-from ai_data_science_team.tools.logging import log_ai_function
+from ai_data_science_team.tools.sql import get_database_metadata
+from ai_data_science_team.utils.logging import log_ai_function
 
 # Setup
 AGENT_NAME = "sql_database_agent"
@@ -193,7 +193,7 @@ class SQLDatabaseAgent(BaseAgent):
             self._params[k] = v
         self._compiled_graph = self._make_compiled_graph()
 
-    def ainvoke_agent(self, user_instructions: str=None, max_retries=3, retry_count=0, **kwargs):
+    async def ainvoke_agent(self, user_instructions: str=None, max_retries=3, retry_count=0, **kwargs):
         """
         Asynchronously runs the SQL Database Agent based on user instructions.
 
@@ -212,7 +212,7 @@ class SQLDatabaseAgent(BaseAgent):
         -------
         None
         """
-        response = self._compiled_graph.ainvoke({
+        response = await self._compiled_graph.ainvoke({
             "user_instructions": user_instructions,
             "max_retries": max_retries,
             "retry_count": retry_count

ai_data_science_team-0.0.0.9010/ai_data_science_team/ml_agents/__init__.py

@@ -0,0 +1,2 @@
+from ai_data_science_team.ml_agents.h2o_ml_agent import make_h2o_ml_agent, H2OMLAgent
+from ai_data_science_team.ml_agents.mlflow_tools_agent import make_mlflow_tools_agent, MLflowToolsAgent