ag2 0.4b1__tar.gz → 0.4.1__tar.gz

{ag2-0.4b1/ag2.egg-info → ag2-0.4.1}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: ag2
-Version: 0.4b1
+Version: 0.4.1
 Summary: A programming framework for agentic AI
 Home-page: https://github.com/ag2ai/ag2
 Author: Chi Wang & Qingyun Wu
@@ -46,6 +46,7 @@ License-File: NOTICE.md
 
 <a name="readme-top"></a>
 
+![Pypi Downloads](https://img.shields.io/pypi/dm/pyautogen?label=PyPI%20downloads)
 [![PyPI version](https://badge.fury.io/py/autogen.svg)](https://badge.fury.io/py/autogen)
 [![Build](https://github.com/ag2ai/ag2/actions/workflows/python-package.yml/badge.svg)](https://github.com/ag2ai/ag2/actions/workflows/python-package.yml)
 ![Python Version](https://img.shields.io/badge/3.8%20%7C%203.9%20%7C%203.10%20%7C%203.11%20%7C%203.12-blue)
@@ -62,9 +63,12 @@ License-File: NOTICE.md
     <br>
 </p> -->
 
-> [!IMPORTANT]
+> **:tada: IMPORTANT**
 >
-> :fire: :tada: Nov 11, 2024: We are evolving AutoGen into AG2! A new organization [ag2ai](https://github.com/ag2ai) is created to host the development of AG2 and related projects with open governance. We invite collaborators from all organizations and individuals to join the development.
+> :fire: :tada: **Nov 11, 2024:** We are evolving AutoGen into **AG2**!
+> A new organization [AG2ai](https://github.com/ag2ai) is created to host the development of AG2 and related projects with open governance. Check [AG2's new look](https://ag2.ai/).
+>
+> We invite collaborators from all organizations and individuals to join the development.
 
 
 :fire: :tada: AG2 is available via `ag2` (or its alias  `autogen` or  `pyautogen`)  on PyPI! Starting with version 0.3.2, you can now install AG2 using:
@@ -137,8 +141,7 @@ AG2 (formerly AutoGen) is an open-source programming framework for building AI a
 The project is currently maintained by a [dynamic group of volunteers](MAINTAINERS.md) from several organizations. Contact project administrators Chi Wang and Qingyun Wu via [support@ag2.ai](mailto:support@ag2.ai) if you are interested in becoming a maintainer.
 
 
-![AutoGen Overview](./website/static/img/autogen_agentchat.png)
-
+![AutoGen Overview](https://media.githubusercontent.com/media/ag2ai/ag2/refs/heads/main/website/static/img/autogen_agentchat.png)
 
 
 <p align="right" style="font-size: 14px; color: #555; margin-top: 20px;">
@@ -238,7 +241,7 @@ python test/twoagent.py
 After the repo is cloned.
 The figure below shows an example conversation flow with AG2.
 
-![Agent Chat Example](./website/static/img/chat_example.png)
+![Agent Chat Example](https://media.githubusercontent.com/media/ag2ai/ag2/refs/heads/main/website/static/img/chat_example.png)
 
 
 Alternatively, the [sample code](https://github.com/ag2ai/build-with-ag2/blob/main/samples/simple_chat.py) here allows a user to chat with an AG2 agent in ChatGPT style.

{ag2-0.4b1 → ag2-0.4.1}/README.md

@@ -1,5 +1,6 @@
 <a name="readme-top"></a>
 
+![Pypi Downloads](https://img.shields.io/pypi/dm/pyautogen?label=PyPI%20downloads)
 [![PyPI version](https://badge.fury.io/py/autogen.svg)](https://badge.fury.io/py/autogen)
 [![Build](https://github.com/ag2ai/ag2/actions/workflows/python-package.yml/badge.svg)](https://github.com/ag2ai/ag2/actions/workflows/python-package.yml)
 ![Python Version](https://img.shields.io/badge/3.8%20%7C%203.9%20%7C%203.10%20%7C%203.11%20%7C%203.12-blue)
@@ -16,9 +17,12 @@
     <br>
 </p> -->
 
-> [!IMPORTANT]
+> **:tada: IMPORTANT**
 >
-> :fire: :tada: Nov 11, 2024: We are evolving AutoGen into AG2! A new organization [ag2ai](https://github.com/ag2ai) is created to host the development of AG2 and related projects with open governance. We invite collaborators from all organizations and individuals to join the development.
+> :fire: :tada: **Nov 11, 2024:** We are evolving AutoGen into **AG2**!
+> A new organization [AG2ai](https://github.com/ag2ai) is created to host the development of AG2 and related projects with open governance. Check [AG2's new look](https://ag2.ai/).
+>
+> We invite collaborators from all organizations and individuals to join the development.
 
 
 :fire: :tada: AG2 is available via `ag2` (or its alias  `autogen` or  `pyautogen`)  on PyPI! Starting with version 0.3.2, you can now install AG2 using:
@@ -91,8 +95,7 @@ AG2 (formerly AutoGen) is an open-source programming framework for building AI a
 The project is currently maintained by a [dynamic group of volunteers](MAINTAINERS.md) from several organizations. Contact project administrators Chi Wang and Qingyun Wu via [support@ag2.ai](mailto:support@ag2.ai) if you are interested in becoming a maintainer.
 
 
-![AutoGen Overview](./website/static/img/autogen_agentchat.png)
-
+![AutoGen Overview](https://media.githubusercontent.com/media/ag2ai/ag2/refs/heads/main/website/static/img/autogen_agentchat.png)
 
 
 <p align="right" style="font-size: 14px; color: #555; margin-top: 20px;">
@@ -192,7 +195,7 @@ python test/twoagent.py
 After the repo is cloned.
 The figure below shows an example conversation flow with AG2.
 
-![Agent Chat Example](./website/static/img/chat_example.png)
+![Agent Chat Example](https://media.githubusercontent.com/media/ag2ai/ag2/refs/heads/main/website/static/img/chat_example.png)
 
 
 Alternatively, the [sample code](https://github.com/ag2ai/build-with-ag2/blob/main/samples/simple_chat.py) here allows a user to chat with an AG2 agent in ChatGPT style.

{ag2-0.4b1 → ag2-0.4.1/ag2.egg-info}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: ag2
-Version: 0.4b1
+Version: 0.4.1
 Summary: A programming framework for agentic AI
 Home-page: https://github.com/ag2ai/ag2
 Author: Chi Wang & Qingyun Wu
@@ -46,6 +46,7 @@ License-File: NOTICE.md
 
 <a name="readme-top"></a>
 
+![Pypi Downloads](https://img.shields.io/pypi/dm/pyautogen?label=PyPI%20downloads)
 [![PyPI version](https://badge.fury.io/py/autogen.svg)](https://badge.fury.io/py/autogen)
 [![Build](https://github.com/ag2ai/ag2/actions/workflows/python-package.yml/badge.svg)](https://github.com/ag2ai/ag2/actions/workflows/python-package.yml)
 ![Python Version](https://img.shields.io/badge/3.8%20%7C%203.9%20%7C%203.10%20%7C%203.11%20%7C%203.12-blue)
@@ -62,9 +63,12 @@ License-File: NOTICE.md
     <br>
 </p> -->
 
-> [!IMPORTANT]
+> **:tada: IMPORTANT**
 >
-> :fire: :tada: Nov 11, 2024: We are evolving AutoGen into AG2! A new organization [ag2ai](https://github.com/ag2ai) is created to host the development of AG2 and related projects with open governance. We invite collaborators from all organizations and individuals to join the development.
+> :fire: :tada: **Nov 11, 2024:** We are evolving AutoGen into **AG2**!
+> A new organization [AG2ai](https://github.com/ag2ai) is created to host the development of AG2 and related projects with open governance. Check [AG2's new look](https://ag2.ai/).
+>
+> We invite collaborators from all organizations and individuals to join the development.
 
 
 :fire: :tada: AG2 is available via `ag2` (or its alias  `autogen` or  `pyautogen`)  on PyPI! Starting with version 0.3.2, you can now install AG2 using:
@@ -137,8 +141,7 @@ AG2 (formerly AutoGen) is an open-source programming framework for building AI a
 The project is currently maintained by a [dynamic group of volunteers](MAINTAINERS.md) from several organizations. Contact project administrators Chi Wang and Qingyun Wu via [support@ag2.ai](mailto:support@ag2.ai) if you are interested in becoming a maintainer.
 
 
-![AutoGen Overview](./website/static/img/autogen_agentchat.png)
-
+![AutoGen Overview](https://media.githubusercontent.com/media/ag2ai/ag2/refs/heads/main/website/static/img/autogen_agentchat.png)
 
 
 <p align="right" style="font-size: 14px; color: #555; margin-top: 20px;">
@@ -238,7 +241,7 @@ python test/twoagent.py
 After the repo is cloned.
 The figure below shows an example conversation flow with AG2.
 
-![Agent Chat Example](./website/static/img/chat_example.png)
+![Agent Chat Example](https://media.githubusercontent.com/media/ag2ai/ag2/refs/heads/main/website/static/img/chat_example.png)
 
 
 Alternatively, the [sample code](https://github.com/ag2ai/build-with-ag2/blob/main/samples/simple_chat.py) here allows a user to chat with an AG2 agent in ChatGPT style.

{ag2-0.4b1 → ag2-0.4.1}/ag2.egg-info/SOURCES.txt

@@ -48,6 +48,12 @@ autogen/agentchat/contrib/swarm_agent.py
 autogen/agentchat/contrib/text_analyzer_agent.py
 autogen/agentchat/contrib/tool_retriever.py
 autogen/agentchat/contrib/web_surfer.py
+autogen/agentchat/contrib/agent_eval/agent_eval.py
+autogen/agentchat/contrib/agent_eval/criterion.py
+autogen/agentchat/contrib/agent_eval/critic_agent.py
+autogen/agentchat/contrib/agent_eval/quantifier_agent.py
+autogen/agentchat/contrib/agent_eval/subcritic_agent.py
+autogen/agentchat/contrib/agent_eval/task.py
 autogen/agentchat/contrib/capabilities/__init__.py
 autogen/agentchat/contrib/capabilities/agent_capability.py
 autogen/agentchat/contrib/capabilities/generate_images.py
@@ -57,9 +63,46 @@ autogen/agentchat/contrib/capabilities/transform_messages.py
 autogen/agentchat/contrib/capabilities/transforms.py
 autogen/agentchat/contrib/capabilities/transforms_util.py
 autogen/agentchat/contrib/capabilities/vision_capability.py
+autogen/agentchat/contrib/captainagent/tools/__init__.py
+autogen/agentchat/contrib/captainagent/tools/requirements.txt
+autogen/agentchat/contrib/captainagent/tools/tool_description.tsv
+autogen/agentchat/contrib/captainagent/tools/data_analysis/calculate_correlation.py
+autogen/agentchat/contrib/captainagent/tools/data_analysis/calculate_skewness_and_kurtosis.py
+autogen/agentchat/contrib/captainagent/tools/data_analysis/detect_outlier_iqr.py
+autogen/agentchat/contrib/captainagent/tools/data_analysis/detect_outlier_zscore.py
+autogen/agentchat/contrib/captainagent/tools/data_analysis/explore_csv.py
+autogen/agentchat/contrib/captainagent/tools/data_analysis/shapiro_wilk_test.py
+autogen/agentchat/contrib/captainagent/tools/information_retrieval/arxiv_download.py
+autogen/agentchat/contrib/captainagent/tools/information_retrieval/arxiv_search.py
+autogen/agentchat/contrib/captainagent/tools/information_retrieval/extract_pdf_image.py
+autogen/agentchat/contrib/captainagent/tools/information_retrieval/extract_pdf_text.py
+autogen/agentchat/contrib/captainagent/tools/information_retrieval/get_wikipedia_text.py
+autogen/agentchat/contrib/captainagent/tools/information_retrieval/get_youtube_caption.py
+autogen/agentchat/contrib/captainagent/tools/information_retrieval/image_qa.py
+autogen/agentchat/contrib/captainagent/tools/information_retrieval/optical_character_recognition.py
+autogen/agentchat/contrib/captainagent/tools/information_retrieval/perform_web_search.py
+autogen/agentchat/contrib/captainagent/tools/information_retrieval/scrape_wikipedia_tables.py
+autogen/agentchat/contrib/captainagent/tools/information_retrieval/transcribe_audio_file.py
+autogen/agentchat/contrib/captainagent/tools/information_retrieval/youtube_download.py
+autogen/agentchat/contrib/captainagent/tools/math/calculate_circle_area_from_diameter.py
+autogen/agentchat/contrib/captainagent/tools/math/calculate_day_of_the_week.py
+autogen/agentchat/contrib/captainagent/tools/math/calculate_fraction_sum.py
+autogen/agentchat/contrib/captainagent/tools/math/calculate_matrix_power.py
+autogen/agentchat/contrib/captainagent/tools/math/calculate_reflected_point.py
+autogen/agentchat/contrib/captainagent/tools/math/complex_numbers_product.py
+autogen/agentchat/contrib/captainagent/tools/math/compute_currency_conversion.py
+autogen/agentchat/contrib/captainagent/tools/math/count_distinct_permutations.py
+autogen/agentchat/contrib/captainagent/tools/math/evaluate_expression.py
+autogen/agentchat/contrib/captainagent/tools/math/find_continuity_point.py
+autogen/agentchat/contrib/captainagent/tools/math/fraction_to_mixed_numbers.py
+autogen/agentchat/contrib/captainagent/tools/math/modular_inverse_sum.py
+autogen/agentchat/contrib/captainagent/tools/math/simplify_mixed_numbers.py
+autogen/agentchat/contrib/captainagent/tools/math/sum_of_digit_factorials.py
+autogen/agentchat/contrib/captainagent/tools/math/sum_of_primes_below.py
 autogen/agentchat/contrib/graph_rag/__init__.py
 autogen/agentchat/contrib/graph_rag/document.py
 autogen/agentchat/contrib/graph_rag/falkor_graph_query_engine.py
+autogen/agentchat/contrib/graph_rag/falkor_graph_rag_capability.py
 autogen/agentchat/contrib/graph_rag/graph_query_engine.py
 autogen/agentchat/contrib/graph_rag/graph_rag_capability.py
 autogen/agentchat/contrib/vectordb/__init__.py

{ag2-0.4b1 → ag2-0.4.1}/ag2.egg-info/requires.txt

@@ -20,7 +20,7 @@ anthropic>=0.23.1
 [autobuild]
 chromadb
 huggingface-hub
-pysqlite3
+pysqlite3-binary
 sentence-transformers
 
 [bedrock]
@@ -32,7 +32,8 @@ flaml[blendsearch]
 [captainagent]
 chromadb
 huggingface-hub
-pysqlite3
+pandas
+pysqlite3-binary
 sentence-transformers
 
 [cerebras]
@@ -56,7 +57,7 @@ matplotlib
 networkx
 
 [graph_rag_falkor_db]
-graphrag_sdk
+graphrag_sdk==0.3.3
 
 [groq]
 groq>=0.9.0

{ag2-0.4b1 → ag2-0.4.1}/autogen/agentchat/contrib/agent_builder.py

@@ -117,6 +117,7 @@ Suggest no more than {max_agents} experts with their name according to the follo
 # Task requirement
 - Expert's name should follow the format: [skill]_Expert.
 - Only reply the names of the experts, separated by ",".
+- If coding skills are required, they should be limited to Python and Shell.
 For example: Python_Expert, Math_Expert, ... """
 
     AGENT_SYS_MSG_PROMPT = """# Your goal

ag2-0.4.1/autogen/agentchat/contrib/agent_eval/agent_eval.py

@@ -0,0 +1,107 @@
+# Copyright (c) 2023 - 2024, Owners of https://github.com/ag2ai
+#
+# SPDX-License-Identifier: Apache-2.0
+#
+# Portions derived from  https://github.com/microsoft/autogen are under the MIT License.
+# SPDX-License-Identifier: MIT
+from typing import Dict, List, Literal, Optional, Union
+
+import autogen
+from autogen.agentchat.contrib.agent_eval.criterion import Criterion
+from autogen.agentchat.contrib.agent_eval.critic_agent import CriticAgent
+from autogen.agentchat.contrib.agent_eval.quantifier_agent import QuantifierAgent
+from autogen.agentchat.contrib.agent_eval.subcritic_agent import SubCriticAgent
+from autogen.agentchat.contrib.agent_eval.task import Task
+
+
+def generate_criteria(
+    llm_config: Optional[Union[Dict, Literal[False]]] = None,
+    task: Task = None,
+    additional_instructions: str = "",
+    max_round=2,
+    use_subcritic: bool = False,
+):
+    """
+    Creates a list of criteria for evaluating the utility of a given task.
+    Args:
+        llm_config (dict or bool): llm inference configuration.
+        task (Task): The task to evaluate.
+        additional_instructions (str): Additional instructions for the criteria agent.
+        max_round (int): The maximum number of rounds to run the conversation.
+        use_subcritic (bool): Whether to use the subcritic agent to generate subcriteria.
+    Returns:
+        list: A list of Criterion objects for evaluating the utility of the given task.
+    """
+    critic = CriticAgent(
+        system_message=CriticAgent.DEFAULT_SYSTEM_MESSAGE + "\n" + additional_instructions,
+        llm_config=llm_config,
+    )
+
+    critic_user = autogen.UserProxyAgent(
+        name="critic_user",
+        max_consecutive_auto_reply=0,  # terminate without auto-reply
+        human_input_mode="NEVER",
+        code_execution_config={"use_docker": False},
+    )
+
+    agents = [critic_user, critic]
+
+    if use_subcritic:
+        subcritic = SubCriticAgent(
+            llm_config=llm_config,
+        )
+        agents.append(subcritic)
+
+    groupchat = autogen.GroupChat(
+        agents=agents, messages=[], max_round=max_round, speaker_selection_method="round_robin"
+    )
+    critic_manager = autogen.GroupChatManager(groupchat=groupchat, llm_config=llm_config)
+
+    critic_user.initiate_chat(critic_manager, message=task.get_sys_message())
+    criteria = critic_user.last_message()
+    content = criteria["content"]
+    # need to strip out any extra code around the returned json
+    content = content[content.find("[") : content.rfind("]") + 1]
+    criteria = Criterion.parse_json_str(content)
+    return criteria
+
+
+def quantify_criteria(
+    llm_config: Optional[Union[Dict, Literal[False]]] = None,
+    criteria: List[Criterion] = None,
+    task: Task = None,
+    test_case: str = "",
+    ground_truth: str = "",
+):
+    """
+    Quantifies the performance of a system using the provided criteria.
+    Args:
+        llm_config (dict or bool): llm inference configuration.
+        criteria ([Criterion]): A list of criteria for evaluating the utility of a given task.
+        task (Task): The task to evaluate.
+        test_case (str): The test case to evaluate.
+        ground_truth (str): The ground truth for the test case.
+    Returns:
+        dict: A dictionary where the keys are the criteria and the values are the assessed performance based on accepted values for each criteria.
+    """
+    quantifier = QuantifierAgent(
+        llm_config=llm_config,
+    )
+
+    quantifier_user = autogen.UserProxyAgent(
+        name="quantifier_user",
+        max_consecutive_auto_reply=0,  # terminate without auto-reply
+        human_input_mode="NEVER",
+        code_execution_config={"use_docker": False},
+    )
+
+    quantifier_user.initiate_chat(  # noqa: F841
+        quantifier,
+        message=task.get_sys_message()
+        + "Evaluation dictionary: "
+        + Criterion.write_json(criteria)
+        + "actual test case to evaluate: "
+        + test_case,
+    )
+    quantified_results = quantifier_user.last_message()
+    return {"actual_success": ground_truth, "estimated_performance": quantified_results["content"]}

ag2-0.4.1/autogen/agentchat/contrib/agent_eval/criterion.py

@@ -0,0 +1,47 @@
+# Copyright (c) 2023 - 2024, Owners of https://github.com/ag2ai
+#
+# SPDX-License-Identifier: Apache-2.0
+#
+# Portions derived from  https://github.com/microsoft/autogen are under the MIT License.
+# SPDX-License-Identifier: MIT
+from __future__ import annotations
+
+import json
+from typing import List
+
+import pydantic_core
+from pydantic import BaseModel
+from pydantic.json import pydantic_encoder
+
+
+class Criterion(BaseModel):
+    """
+    A class that represents a criterion for agent evaluation.
+    """
+
+    name: str
+    description: str
+    accepted_values: List[str]
+    sub_criteria: List[Criterion] = list()
+
+    @staticmethod
+    def parse_json_str(criteria: str):
+        """
+        Create a list of Criterion objects from a json string.
+        Args:
+            criteria (str): Json string that represents the criteria
+        returns:
+            [Criterion]: A list of Criterion objects that represents the json criteria information.
+        """
+        return [Criterion(**crit) for crit in json.loads(criteria)]
+
+    @staticmethod
+    def write_json(criteria):
+        """
+        Create a json string from a list of Criterion objects.
+        Args:
+            criteria ([Criterion]): A list of Criterion objects.
+        Returns:
+            str: A json string that represents the list of Criterion objects.
+        """
+        return json.dumps([crit.model_dump() for crit in criteria], indent=2)

ag2-0.4.1/autogen/agentchat/contrib/agent_eval/critic_agent.py

@@ -0,0 +1,47 @@
+# Copyright (c) 2023 - 2024, Owners of https://github.com/ag2ai
+#
+# SPDX-License-Identifier: Apache-2.0
+#
+# Portions derived from  https://github.com/microsoft/autogen are under the MIT License.
+# SPDX-License-Identifier: MIT
+from typing import Optional
+
+from autogen.agentchat.conversable_agent import ConversableAgent
+
+
+class CriticAgent(ConversableAgent):
+    """
+    An agent for creating list of criteria for evaluating the utility of a given task.
+    """
+
+    DEFAULT_SYSTEM_MESSAGE = """You are a helpful assistant. You suggest criteria for evaluating different tasks. They should be distinguishable, quantifiable and not redundant.
+    Convert the evaluation criteria into a list where each item is a criteria which consists of the following dictionary as follows
+    {"name": name of the criterion, "description": criteria description , "accepted_values": possible accepted inputs for this key}
+    Make sure "accepted_values" include the acceptable inputs for each key that are fine-grained and preferably multi-graded levels and "description" includes the criterion description.
+    Output just the criteria string you have created, no code.
+    """
+
+    DEFAULT_DESCRIPTION = "An AI agent for creating list criteria for evaluating the utility of a given task."
+
+    def __init__(
+        self,
+        name="critic",
+        system_message: Optional[str] = DEFAULT_SYSTEM_MESSAGE,
+        description: Optional[str] = DEFAULT_DESCRIPTION,
+        **kwargs,
+    ):
+        """
+        Args:
+            name (str): agent name.
+            system_message (str): system message for the ChatCompletion inference.
+                Please override this attribute if you want to reprogram the agent.
+            description (str): The description of the agent.
+            **kwargs (dict): Please refer to other kwargs in
+                [ConversableAgent](../../conversable_agent#__init__).
+        """
+        super().__init__(
+            name=name,
+            system_message=system_message,
+            description=description,
+            **kwargs,
+        )

ag2-0.4.1/autogen/agentchat/contrib/agent_eval/quantifier_agent.py

@@ -0,0 +1,42 @@
+# Copyright (c) 2023 - 2024, Owners of https://github.com/ag2ai
+#
+# SPDX-License-Identifier: Apache-2.0
+#
+# Portions derived from  https://github.com/microsoft/autogen are under the MIT License.
+# SPDX-License-Identifier: MIT
+from typing import Optional
+
+from autogen.agentchat.conversable_agent import ConversableAgent
+
+
+class QuantifierAgent(ConversableAgent):
+    """
+    An agent for quantifying the performance of a system using the provided criteria.
+    """
+
+    DEFAULT_SYSTEM_MESSAGE = """"You are a helpful assistant. You quantify the output of different tasks based on the given criteria.
+    The criterion is given in a json list format where each element is a distinct criteria.
+    The each element is a dictionary as follows {"name": name of the criterion, "description": criteria description , "accepted_values": possible accepted inputs for this key}
+    You are going to quantify each of the crieria for a given task based on the task description.
+    Return a dictionary where the keys are the criteria and the values are the assessed performance based on accepted values for each criteria.
+    Return only the dictionary, no code."""
+
+    DEFAULT_DESCRIPTION = "An AI agent for quantifing the performance of a system using the provided criteria."
+
+    def __init__(
+        self,
+        name="quantifier",
+        system_message: Optional[str] = DEFAULT_SYSTEM_MESSAGE,
+        description: Optional[str] = DEFAULT_DESCRIPTION,
+        **kwargs,
+    ):
+        """
+        Args:
+            name (str): agent name.
+            system_message (str): system message for the ChatCompletion inference.
+                Please override this attribute if you want to reprogram the agent.
+            description (str): The description of the agent.
+            **kwargs (dict): Please refer to other kwargs in
+                [ConversableAgent](../../conversable_agent#__init__).
+        """
+        super().__init__(name=name, system_message=system_message, description=description, **kwargs)

ag2-0.4.1/autogen/agentchat/contrib/agent_eval/subcritic_agent.py

@@ -0,0 +1,48 @@
+# Copyright (c) 2023 - 2024, Owners of https://github.com/ag2ai
+#
+# SPDX-License-Identifier: Apache-2.0
+#
+# Portions derived from  https://github.com/microsoft/autogen are under the MIT License.
+# SPDX-License-Identifier: MIT
+from typing import Optional
+
+from autogen.agentchat.conversable_agent import ConversableAgent
+
+
+class SubCriticAgent(ConversableAgent):
+    """
+    An agent for creating subcriteria from a given list of criteria for evaluating the utility of a given task.
+    """
+
+    DEFAULT_SYSTEM_MESSAGE = """You are a helpful assistant to the critic agent. You suggest sub criteria for evaluating different tasks based on the criteria provided by the critic agent (if you feel it is needed).
+        They should be distinguishable, quantifiable, and related to the overall theme of the critic's provided criteria.
+        You operate by taking in the description of the criteria. You then create a new key called sub criteria where you provide the sub criteria for the given criteria.
+        The value of the sub_criteria is a dictionary where the keys are the subcriteria and each value is as follows {"description": sub criteria description , "accepted_values": possible accepted inputs for this key}
+        Do this for each criteria provided by the critic (removing the criteria's accepted values). "accepted_values" include the acceptable inputs for each key that are fine-grained and preferably multi-graded levels. "description" includes the criterion description.
+        Once you have created the sub criteria for the given criteria, you return the json (make sure to include the contents of the critic's dictionary in the final dictionary as well).
+        Make sure to return a valid json and no code"""
+
+    DEFAULT_DESCRIPTION = "An AI agent for creating subcriteria from a given list of criteria."
+
+    def __init__(
+        self,
+        name="subcritic",
+        system_message: Optional[str] = DEFAULT_SYSTEM_MESSAGE,
+        description: Optional[str] = DEFAULT_DESCRIPTION,
+        **kwargs,
+    ):
+        """
+        Args:
+            name (str): agent name.
+            system_message (str): system message for the ChatCompletion inference.
+                Please override this attribute if you want to reprogram the agent.
+            description (str): The description of the agent.
+            **kwargs (dict): Please refer to other kwargs in
+                [ConversableAgent](../../conversable_agent#__init__).
+        """
+        super().__init__(
+            name=name,
+            system_message=system_message,
+            description=description,
+            **kwargs,
+        )

ag2-0.4.1/autogen/agentchat/contrib/agent_eval/task.py

@@ -0,0 +1,43 @@
+# Copyright (c) 2023 - 2024, Owners of https://github.com/ag2ai
+#
+# SPDX-License-Identifier: Apache-2.0
+#
+# Portions derived from  https://github.com/microsoft/autogen are under the MIT License.
+# SPDX-License-Identifier: MIT
+import json
+
+from pydantic import BaseModel
+
+
+class Task(BaseModel):
+    """
+    Class representing a task for agent completion, includes example agent execution for criteria generation.
+    """
+
+    name: str
+    description: str
+    successful_response: str
+    failed_response: str
+
+    def get_sys_message(self):
+        return f"""Task: {self.name}.
+        Task description: {self.description}
+        Task successful example: {self.successful_response}
+        Task failed example: {self.failed_response}
+        """
+
+    @staticmethod
+    def parse_json_str(task: str):
+        """
+        Create a Task object from a json object.
+        Args:
+            json_data (dict): A dictionary that represents the task.
+        Returns:
+            Task: A Task object that represents the json task information.
+        """
+        json_data = json.loads(task)
+        name = json_data.get("name")
+        description = json_data.get("description")
+        successful_response = json_data.get("successful_response")
+        failed_response = json_data.get("failed_response")
+        return Task(name, description, successful_response, failed_response)

ag2-0.4.1/autogen/agentchat/contrib/captainagent/tools/data_analysis/calculate_correlation.py

@@ -0,0 +1,41 @@
+# Copyright (c) 2023 - 2024, Owners of https://github.com/ag2ai
+#
+# SPDX-License-Identifier: Apache-2.0
+def calculate_correlation(csv_path: str, column1: str, column2: str, method: str = "pearson") -> float:
+    """
+    Calculate the correlation between two columns in a CSV file.
+
+    Args:
+    csv_path (str): The path to the CSV file.
+    column1 (str): The name of the first column.
+    column2 (str): The name of the second column.
+    method (str or callable, optional): The method used to calculate the correlation.
+        - 'pearson' (default): Pearson correlation coefficient.
+        - 'kendall': Kendall Tau correlation coefficient.
+        - 'spearman': Spearman rank correlation coefficient.
+        - callable: A custom correlation function that takes two arrays and returns a scalar.
+
+    Returns:
+    float: The correlation coefficient between the two columns.
+    """
+    import pandas as pd
+
+    # Read the CSV file into a pandas DataFrame
+    df = pd.read_csv(csv_path)
+
+    # Select the specified columns
+    selected_columns = df[[column1, column2]]
+
+    # Calculate the correlation based on the specified method
+    if method == "pearson":
+        correlation = selected_columns.corr().iloc[0, 1]
+    elif method == "kendall":
+        correlation = selected_columns.corr(method="kendall").iloc[0, 1]
+    elif method == "spearman":
+        correlation = selected_columns.corr(method="spearman").iloc[0, 1]
+    elif callable(method):
+        correlation = selected_columns.corr(method=method).iloc[0, 1]
+    else:
+        raise ValueError("Invalid correlation method. Please choose 'pearson', 'kendall', 'spearman', or a callable.")
+
+    return correlation

ag2-0.4.1/autogen/agentchat/contrib/captainagent/tools/data_analysis/calculate_skewness_and_kurtosis.py

@@ -0,0 +1,29 @@
+# Copyright (c) 2023 - 2024, Owners of https://github.com/ag2ai
+#
+# SPDX-License-Identifier: Apache-2.0
+def calculate_skewness_and_kurtosis(csv_file: str, column_name: str) -> tuple:
+    """
+    Calculate the skewness and kurtosis of a specified column in a CSV file. The kurtosis is calculated using the Fisher definition.
+    The two metrics are computed using scipy.stats functions.
+
+    Args:
+    csv_file (str): The path to the CSV file.
+    column_name (str): The name of the column to calculate skewness and kurtosis for.
+
+    Returns:
+    tuple: (skewness, kurtosis)
+    """
+    import pandas as pd
+    from scipy.stats import kurtosis, skew
+
+    # Read the CSV file into a pandas DataFrame
+    df = pd.read_csv(csv_file)
+
+    # Extract the specified column
+    column = df[column_name]
+
+    # Calculate the skewness and kurtosis
+    skewness = skew(column)
+    kurt = kurtosis(column)
+
+    return skewness, kurt