monocle-apptrace 0.3.0b7__tar.gz → 0.3.1b1__tar.gz

monocle_apptrace-0.3.1b1/CHANGELOG.md

@@ -0,0 +1,83 @@
+## Version 0.3.1b1 (2024-04-14)
+
+- Add MetaModel for Anthropic SDK ([#159](https://github.com/monocle2ai/monocle/pull/159))
+- Add openAI response for openAI and AzureOpenAI ([#158](https://github.com/monocle2ai/monocle/pull/158))
+- Update retrieval span for Boto Client ([#157](https://github.com/monocle2ai/monocle/pull/157))
+- Resolve token threshold error ([#156](https://github.com/monocle2ai/monocle/pull/156))
+- Update Inference Span ([#155](https://github.com/monocle2ai/monocle/pull/155))
+
+## Version 0.3.0 (2024-12-10)
+
+- Fixed issue with passing context in async case ([#150](https://github.com/monocle2ai/monocle/pull/150))
+- Added lambda processor ([#148](https://github.com/monocle2ai/monocle/pull/148))
+- Setup package level init scripts to make the monocle import simpler ([#147](https://github.com/monocle2ai/monocle/pull/147))
+- Boto attributes and test cleanup ([#146](https://github.com/monocle2ai/monocle/pull/146))
+- Openai workflow ([#142](https://github.com/monocle2ai/monocle/pull/142))
+- Add input/output for openai embedding ([#141](https://github.com/monocle2ai/monocle/pull/141))
+- Async method and scope fix ([#140](https://github.com/monocle2ai/monocle/pull/140))
+- Bug fix for helper langchain and langgraph ([#137](https://github.com/monocle2ai/monocle/pull/137))
+- Package main script to run any app with monocle instrumentation ([#132](https://github.com/monocle2ai/monocle/pull/132))
+- Add openai api metamodel ([#131](https://github.com/monocle2ai/monocle/pull/131))
+- Support notion of scopes to group traces/snaps into logical constructs ([#130](https://github.com/monocle2ai/monocle/pull/130))
+- Add Llamaindex ReAct agent ([#127](https://github.com/monocle2ai/monocle/pull/127))
+- Langhcain input fix and s3 exporter prefix support ([#126](https://github.com/monocle2ai/monocle/pull/126))
+- Use standard AWS credential envs ([#123](https://github.com/monocle2ai/monocle/pull/123))
+- Check additional attributes for Azure OpenAI model and consolidate common method in utils ([#122](https://github.com/monocle2ai/monocle/pull/122))
+- Bug fix for accessor ([#121](https://github.com/monocle2ai/monocle/pull/121))
+- Bug fix for empty response ([#120](https://github.com/monocle2ai/monocle/pull/120))
+- Bug fix for inference endpoint ([#119](https://github.com/monocle2ai/monocle/pull/119))
+- Opendal exporter for S3 and Blob ([#117](https://github.com/monocle2ai/monocle/pull/117))
+- Handle specific ModuleNotFoundError exceptions gracefully ([#115](https://github.com/monocle2ai/monocle/pull/115))
+- Adding support for console and memory exporter to list of monocle exporters ([#113](https://github.com/monocle2ai/monocle/pull/113))
+- Add trace id propogation for constant trace id and from request ([#111](https://github.com/monocle2ai/monocle/pull/111))
+- Restructure of monoocle code for easy extensibility ([#109](https://github.com/monocle2ai/monocle/pull/109))
+- S3 update filename prefix ([#98](https://github.com/monocle2ai/monocle/pull/98))
+- Update inference span for botocore sagemaker ([#93](https://github.com/monocle2ai/monocle/pull/93))
+- Capturing inference output and token metadata for bedrock ([#82](https://github.com/monocle2ai/monocle/pull/82))
+- Add dev dependency for Mistral AI integration ([#81](https://github.com/monocle2ai/monocle/pull/81))
+- Add VectorStore deployment URL capture support ([#80](https://github.com/monocle2ai/monocle/pull/80))  
+- Clean up cloud exporter implementation ([#79](https://github.com/monocle2ai/monocle/pull/79))
+- Capture inference span input/output events attributes ([#77](https://github.com/monocle2ai/monocle/pull/77))
+- Add release automation workflows ([#76](https://github.com/monocle2ai/monocle/pull/76))
+- Fix gaps in Monocle SDK implementation ([#72](https://github.com/monocle2ai/monocle/pull/72))  
+- Add kwargs and return value handling in Accessor ([#71](https://github.com/monocle2ai/monocle/pull/71))
+- Update workflow name formatting ([#69](https://github.com/monocle2ai/monocle/pull/69))
+- Implement Haystack metamodel support ([#68](https://github.com/monocle2ai/monocle/pull/68))
+
+## Version 0.2.0 (2024-12-05)
+
+## 0.2.0 (Oct 22, 2024)
+
+- Ndjson format for S3 and Blob exporters ([#61](https://github.com/monocle2ai/monocle/pull/61))
+- Set monocle exporter from env setting ([#60](https://github.com/monocle2ai/monocle/pull/60))
+- Update workflow name and type with new format ([#59](https://github.com/monocle2ai/monocle/pull/59))
+- Updated async and custom output processor testcase for metamodel([#58](https://github.com/monocle2ai/monocle/pull/58))
+- Build okahu exporter and added test cases for okahu exporte ([#56](https://github.com/monocle2ai/monocle/pull/56))
+- Handle exception in span wrappers([#52](https://github.com/monocle2ai/monocle/pull/52))
+- Metamodel entity changes ([#51](https://github.com/monocle2ai/monocle/pull/51)), ([#54](https://github.com/monocle2ai/monocle/pull/54))
+- Error handling for llm_endpoint and tags ([#50](https://github.com/monocle2ai/monocle/pull/50))
+- Context_output for vector store retriever ([#48](https://github.com/monocle2ai/monocle/pull/48))
+- Direct exporter - AWS S3 ([#42](https://github.com/monocle2ai/monocle/pull/42))
+- Direct Exporter - Blob store ([#41](https://github.com/monocle2ai/monocle/pull/41))
+- Initial metamodel definition ([#39](https://github.com/monocle2ai/monocle/pull/39))
+- Improvement in vectorstore traces ([#38](https://github.com/monocle2ai/monocle/pull/38))
+- Update key for session context field in attributes ([#34](https://github.com/monocle2ai/monocle/pull/34))
+
+
+## 0.1.0 (Aug 27, 2024)
+
+- Fixed LlamaIndex tracing bugs ([#32](https://github.com/monocle2ai/monocle/pull/32))
+- Added support to add AWS cloud infra attributes ([#29](https://github.com/monocle2ai/monocle/pull/29))
+- Added support to add Azure cloud infra attributes ([#23](https://github.com/monocle2ai/monocle/pull/23))
+- Added support for adding provider name in LLM span in traces ([#22](https://github.com/monocle2ai/monocle/pull/22))
+- Added a default file span exporter ([#21](https://github.com/monocle2ai/monocle/pull/21))
+- Moved input and output context and prompts from attributes to events ([#15](https://github.com/monocle2ai/monocle/pull/15))
+
+
+
+
+
+
+## 0.0.1 (Jul 17, 2024)
+
+- First monocle release

{monocle_apptrace-0.3.0b7 → monocle_apptrace-0.3.1b1}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: monocle_apptrace
-Version: 0.3.0b7
+Version: 0.3.1b1
 Summary: package with monocle genAI tracing
 Project-URL: Homepage, https://github.com/monocle2ai/monocle
 Project-URL: Issues, https://github.com/monocle2ai/monocle/issues
@@ -20,6 +20,7 @@ Requires-Dist: boto3==1.35.19; extra == 'aws'
 Provides-Extra: azure
 Requires-Dist: azure-storage-blob==12.22.0; extra == 'azure'
 Provides-Extra: dev
+Requires-Dist: anthropic==0.49.0; extra == 'dev'
 Requires-Dist: azure-storage-blob==12.22.0; extra == 'dev'
 Requires-Dist: boto3==1.34.131; extra == 'dev'
 Requires-Dist: chromadb==0.4.22; extra == 'dev'

{monocle_apptrace-0.3.0b7 → monocle_apptrace-0.3.1b1}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "hatchling.build"
 
 [project]
 name = "monocle_apptrace"
-version = "0.3.0b7"
+version = "0.3.1b1"
 authors = []
 description = "package with monocle genAI tracing"
 readme = "README.md"
@@ -72,7 +72,8 @@ dev = [
   'flask',
   'opentelemetry-instrumentation-flask',
   'langgraph==0.2.68',
-  'opendal==0.45.14'
+  'opendal==0.45.14',
+  'anthropic==0.49.0',
 ]
 
 azure = [

{monocle_apptrace-0.3.0b7 → monocle_apptrace-0.3.1b1}/src/monocle_apptrace/instrumentation/common/constants.py

@@ -13,6 +13,7 @@ GITHUB_CODESPACE_IDENTIFIER_ENV_NAME = "GITHUB_REPOSITORY"
 
 # Azure naming reference can be found here
 # https://learn.microsoft.com/en-us/azure/cloud-adoption-framework/ready/azure-best-practices/resource-abbreviations
+# https://docs.aws.amazon.com/resource-explorer/latest/userguide/supported-resource-types.html#services-lookoutmetrics
 AZURE_FUNCTION_NAME = "azure.func"
 AZURE_APP_SERVICE_NAME = "azure.asp"
 AZURE_ML_SERVICE_NAME = "azure.mlw"
@@ -48,6 +49,8 @@ llm_type_map = {
     "sagemakerllm": "aws_sagemaker",
     "chatbedrock": "aws_bedrock",
     "openaigenerator": "openai",
+    "bedrockruntime":"aws_bedrock",
+    "sagemakerruntime":"aws_sagemaker",
 }
 
 MONOCLE_INSTRUMENTOR = "monocle_apptrace"

{monocle_apptrace-0.3.0b7 → monocle_apptrace-0.3.1b1}/src/monocle_apptrace/instrumentation/common/wrapper_method.py

@@ -15,6 +15,8 @@ from monocle_apptrace.instrumentation.metamodel.flask.methods import (FLASK_METH
 from monocle_apptrace.instrumentation.metamodel.flask._helper import FlaskSpanHandler
 from monocle_apptrace.instrumentation.metamodel.requests.methods import (REQUESTS_METHODS, )
 from monocle_apptrace.instrumentation.metamodel.requests._helper import RequestSpanHandler
+from monocle_apptrace.instrumentation.metamodel.teamsai.methods import (TEAMAI_METHODS, )
+from monocle_apptrace.instrumentation.metamodel.anthropic.methods import (ANTHROPIC_METHODS, )
 
 class WrapperMethod:
     def __init__(
@@ -61,7 +63,7 @@ class WrapperMethod:
     def get_span_handler(self) -> SpanHandler:
         return self.span_handler()
 
-DEFAULT_METHODS_LIST = LANGCHAIN_METHODS + LLAMAINDEX_METHODS + HAYSTACK_METHODS + BOTOCORE_METHODS + FLASK_METHODS + REQUESTS_METHODS + LANGGRAPH_METHODS + OPENAI_METHODS
+DEFAULT_METHODS_LIST = LANGCHAIN_METHODS + LLAMAINDEX_METHODS + HAYSTACK_METHODS + BOTOCORE_METHODS + FLASK_METHODS + REQUESTS_METHODS + LANGGRAPH_METHODS + OPENAI_METHODS + TEAMAI_METHODS + ANTHROPIC_METHODS
 
 MONOCLE_SPAN_HANDLERS: Dict[str, SpanHandler] = {
     "default": SpanHandler(),

monocle_apptrace-0.3.1b1/src/monocle_apptrace/instrumentation/metamodel/anthropic/_helper.py

@@ -0,0 +1,64 @@
+"""
+This module provides utility functions for extracting system, user,
+and assistant messages from various input formats.
+"""
+
+import logging
+from monocle_apptrace.instrumentation.common.utils import (
+    Option,
+    get_keys_as_tuple,
+    get_nested_value,
+    try_option,
+)
+
+
+logger = logging.getLogger(__name__)
+
+def extract_provider_name(instance):
+    provider_url: Option[str] = try_option(getattr, instance._client.base_url, 'host')
+    return provider_url.unwrap_or(None)
+
+def extract_inference_endpoint(instance):
+    inference_endpoint: Option[str] = try_option(getattr, instance._client, 'base_url').map(str)
+    if inference_endpoint.is_none() and "meta" in instance.client.__dict__:
+        inference_endpoint = try_option(getattr, instance.client.meta, 'endpoint_url').map(str)
+
+    return inference_endpoint.unwrap_or(extract_provider_name(instance))
+
+def extract_messages(kwargs):
+    """Extract system and user messages"""
+    try:
+        messages = []
+        if 'messages' in kwargs and len(kwargs['messages']) >0:
+            for msg in kwargs['messages']:
+                if msg.get('content') and msg.get('role'):
+                    messages.append({msg['role']: msg['content']})
+
+        return [str(message) for message in messages]
+    except Exception as e:
+        logger.warning("Warning: Error occurred in extract_messages: %s", str(e))
+        return []
+
+
+def extract_assistant_message(response):
+    try:
+        if response is not None and hasattr(response,"content") and len(response.content) >0:
+            if hasattr(response.content[0],"text"):
+                return response.content[0].text
+    except (IndexError, AttributeError) as e:
+        logger.warning("Warning: Error occurred in extract_assistant_message: %s", str(e))
+        return None
+
+def update_span_from_llm_response(response):
+    meta_dict = {}
+    if response is not None and hasattr(response, "usage"):
+        if hasattr(response, "usage") and response.usage is not None:
+            token_usage = response.usage
+        else:
+            response_metadata = response.response_metadata
+            token_usage = response_metadata.get("token_usage")
+        if token_usage is not None:
+            meta_dict.update({"completion_tokens": getattr(response.usage, "output_tokens", 0)})
+            meta_dict.update({"prompt_tokens": getattr(response.usage, "input_tokens", 0)})
+            meta_dict.update({"total_tokens": getattr(response.usage, "input_tokens", 0)+getattr(response.usage, "output_tokens", 0)})
+    return meta_dict

monocle_apptrace-0.3.1b1/src/monocle_apptrace/instrumentation/metamodel/anthropic/entities/inference.py

@@ -0,0 +1,72 @@
+from monocle_apptrace.instrumentation.metamodel.anthropic import (
+    _helper,
+)
+from monocle_apptrace.instrumentation.common.utils import resolve_from_alias, get_llm_type
+
+INFERENCE = {
+    "type": "inference",
+    "attributes": [
+        [
+            {
+                "_comment": "provider type ,name , deployment , inference_endpoint",
+                "attribute": "type",
+                "accessor": lambda arguments: 'inference.' + (get_llm_type(arguments['instance']) or 'generic')
+
+            },
+            {
+                "attribute": "provider_name",
+                "accessor": lambda arguments: _helper.extract_provider_name(arguments['instance'])
+            },
+            {
+                "attribute": "deployment",
+                "accessor": lambda arguments: resolve_from_alias(arguments['instance'].__dict__, ['engine', 'azure_deployment', 'deployment_name', 'deployment_id', 'deployment'])
+            },
+            {
+                "attribute": "inference_endpoint",
+                "accessor": lambda arguments: resolve_from_alias(arguments['instance'].__dict__, ['azure_endpoint', 'api_base', 'endpoint']) or _helper.extract_inference_endpoint(arguments['instance'])
+            }
+        ],
+        [
+            {
+                "_comment": "LLM Model",
+                "attribute": "name",
+                "accessor": lambda arguments: resolve_from_alias(arguments['kwargs'], ['model', 'model_name', 'endpoint_name', 'deployment_name'])
+            },
+            {
+                "attribute": "type",
+                "accessor": lambda arguments: 'model.llm.' + resolve_from_alias(arguments['kwargs'], ['model', 'model_name', 'endpoint_name', 'deployment_name'])
+            }
+        ]
+    ],
+    "events": [
+        {"name": "data.input",
+         "attributes": [
+
+             {
+                 "_comment": "this is instruction and user query to LLM",
+                 "attribute": "input",
+                 "accessor": lambda arguments: _helper.extract_messages(arguments['kwargs'])
+             }
+         ]
+         },
+        {
+            "name": "data.output",
+            "attributes": [
+                {
+                    "_comment": "this is result from LLM",
+                    "attribute": "response",
+                    "accessor": lambda arguments: _helper.extract_assistant_message(arguments['result'])
+                }
+            ]
+        },
+        {
+            "name": "metadata",
+            "attributes": [
+                {
+                    "_comment": "this is metadata usage from LLM",
+                    "accessor": lambda arguments: _helper.update_span_from_llm_response(arguments['result'])
+                }
+            ]
+        }
+    ]
+}

monocle_apptrace-0.3.1b1/src/monocle_apptrace/instrumentation/metamodel/anthropic/methods.py

@@ -0,0 +1,22 @@
+from monocle_apptrace.instrumentation.common.wrapper import atask_wrapper, task_wrapper
+from monocle_apptrace.instrumentation.metamodel.anthropic.entities.inference import (
+    INFERENCE,
+)
+
+ANTHROPIC_METHODS = [
+    {
+        "package": "anthropic.resources.messages.messages",
+        "object": "Messages",
+        "method": "create",
+        "wrapper_method": task_wrapper,
+        "output_processor": INFERENCE
+    },
+    {
+        "package": "anthropic.resources.messages.messages",
+        "object": "AsyncMessages",
+        "method": "create",
+        "wrapper_method": atask_wrapper,
+        "output_processor": INFERENCE
+    },
+
+]

{monocle_apptrace-0.3.0b7 → monocle_apptrace-0.3.1b1}/src/monocle_apptrace/instrumentation/metamodel/botocore/entities/inference.py

@@ -1,7 +1,7 @@
 from monocle_apptrace.instrumentation.metamodel.botocore import (
     _helper,
 )
-
+from monocle_apptrace.instrumentation.common.utils import get_llm_type
 INFERENCE = {
     "type": "inference",
     "attributes": [
@@ -9,7 +9,7 @@ INFERENCE = {
             {
                 "_comment": "provider type  , inference_endpoint",
                 "attribute": "type",
-                "accessor": lambda arguments: 'inference.aws_sagemaker'
+                "accessor": lambda arguments: 'inference.'+(get_llm_type(arguments['instance']) or 'generic')
             },
             {
                 "attribute": "inference_endpoint",

{monocle_apptrace-0.3.0b7 → monocle_apptrace-0.3.1b1}/src/monocle_apptrace/instrumentation/metamodel/botocore/handlers/botocore_span_handler.py

@@ -23,4 +23,4 @@ class BotoCoreSpanHandler(SpanHandler):
     def post_tracing(self, to_wrap, wrapped, instance, args, kwargs, return_value):
         self._botocore_processor(to_wrap=to_wrap, wrapped=wrapped, instance=instance, return_value=return_value, args=args,
                                  kwargs=kwargs)
-        return super().pre_tracing(to_wrap, wrapped, instance, args, kwargs)
+        return super().post_tracing(to_wrap, wrapped, instance, args, kwargs,return_value)

{monocle_apptrace-0.3.0b7 → monocle_apptrace-0.3.1b1}/src/monocle_apptrace/instrumentation/metamodel/openai/_helper.py

@@ -19,6 +19,10 @@ def extract_messages(kwargs):
     """Extract system and user messages"""
     try:
         messages = []
+        if 'instructions' in kwargs:
+            messages.append({'instructions': kwargs.get('instructions', {})})
+        if 'input' in kwargs:
+            messages.append({'input': kwargs.get('input', {})})
         if 'messages' in kwargs and len(kwargs['messages']) >0:
             for msg in kwargs['messages']:
                 if msg.get('content') and msg.get('role'):
@@ -32,6 +36,8 @@ def extract_messages(kwargs):
 
 def extract_assistant_message(response):
     try:
+        if hasattr(response,"output_text") and len(response.output_text):
+            return response.output_text
         if response is not None and hasattr(response,"choices") and len(response.choices) >0:
             if hasattr(response.choices[0],"message"):
                 return response.choices[0].message.content
@@ -85,10 +91,9 @@ def update_span_from_llm_response(response):
             response_metadata = response.response_metadata
             token_usage = response_metadata.get("token_usage")
         if token_usage is not None:
-            meta_dict.update(
-                {"completion_tokens": getattr(response.usage, "completion_tokens", None)})
-            meta_dict.update({"prompt_tokens": getattr(response.usage, "prompt_tokens", None)})
-            meta_dict.update({"total_tokens": getattr(response.usage, "total_tokens", None)})
+            meta_dict.update({"completion_tokens": getattr(token_usage,"completion_tokens",None) or getattr(token_usage,"output_tokens",None)})
+            meta_dict.update({"prompt_tokens": getattr(token_usage, "prompt_tokens", None) or getattr(token_usage, "input_tokens", None)})
+            meta_dict.update({"total_tokens": getattr(token_usage,"total_tokens")})
     return meta_dict
 
 def extract_vector_input(vector_input: dict):

{monocle_apptrace-0.3.0b7 → monocle_apptrace-0.3.1b1}/src/monocle_apptrace/instrumentation/metamodel/openai/methods.py

@@ -40,6 +40,22 @@ OPENAI_METHODS = [
         "span_name": "openai_embeddings",
         "span_handler": "non_framework_handler",
         "output_processor": RETRIEVAL
+    },
+    {
+        "package": "openai.resources.responses",
+        "object": "Responses",
+        "method": "create",
+        "wrapper_method": task_wrapper,
+        "span_handler": "non_framework_handler",
+        "output_processor": INFERENCE
+    },
+    {
+        "package": "openai.resources.responses",
+        "object": "AsyncResponses",
+        "method": "create",
+        "wrapper_method": atask_wrapper,
+        "span_handler": "non_framework_handler",
+        "output_processor": INFERENCE
     }
 
 ]

monocle_apptrace-0.3.1b1/src/monocle_apptrace/instrumentation/metamodel/teamsai/_helper.py

@@ -0,0 +1,58 @@
+from monocle_apptrace.instrumentation.common.utils import MonocleSpanException
+def capture_input(arguments):
+    """
+    Captures the input from Teams AI state.
+    Args:
+        arguments (dict): Arguments containing state and context information
+    Returns:
+        str: The input message or error message
+    """
+    try:
+        # Get the memory object from kwargs
+        kwargs = arguments.get("kwargs", {})
+
+        # If memory exists, try to get the input from temp
+        if "memory" in kwargs:
+            memory = kwargs["memory"]
+            # Check if it's a TurnState object
+            if hasattr(memory, "get"):
+                # Use proper TurnState.get() method
+                temp = memory.get("temp")
+                if temp and hasattr(temp, "get"):
+                    input_value = temp.get("input")
+                    if input_value:
+                        return str(input_value)
+
+        # Try alternative path through context if memory path fails
+        context = kwargs.get("context")
+        if hasattr(context, "activity") and hasattr(context.activity, "text"):
+            return str(context.activity.text)
+
+        return "No input found in memory or context"
+    except Exception as e:
+        print(f"Debug - Arguments structure: {str(arguments)}")
+        print(f"Debug - kwargs: {str(kwargs)}")
+        if "memory" in kwargs:
+            print(f"Debug - memory type: {type(kwargs['memory'])}")
+        return f"Error capturing input: {str(e)}"
+
+def capture_prompt_info(arguments):
+    """Captures prompt information from ActionPlanner state"""
+    try:
+        kwargs = arguments.get("kwargs", {})
+        prompt = kwargs.get("prompt")
+
+        if isinstance(prompt, str):
+            return prompt
+        elif hasattr(prompt, "name"):
+            return prompt.name
+
+        return "No prompt information found"
+    except Exception as e:
+        return f"Error capturing prompt: {str(e)}"
+
+def status_check(arguments):
+    if hasattr(arguments["result"], "error") and arguments["result"].error is not None:
+        error_msg:str = arguments["result"].error
+        error_code:str = arguments["result"].status if hasattr(arguments["result"], "status") else "unknown"
+        raise MonocleSpanException(f"Error: {error_code} - {error_msg}")

monocle_apptrace-0.3.1b1/src/monocle_apptrace/instrumentation/metamodel/teamsai/entities/inference/actionplanner_output_processor.py

@@ -0,0 +1,80 @@
+from monocle_apptrace.instrumentation.metamodel.teamsai import (
+    _helper,
+)
+ACTIONPLANNER_OUTPUT_PROCESSOR = {
+    "type": "inference",
+    "attributes": [
+        [
+            {
+                "_comment": "planner type and configuration",
+                "attribute": "type",
+                "accessor": lambda arguments: "teams.planner"
+            },
+            {
+                "attribute": "planner_type",
+                "accessor": lambda arguments: "ActionPlanner"
+            },
+            {
+                "attribute": "max_repair_attempts",
+                "accessor": lambda arguments: arguments["instance"]._options.max_repair_attempts if hasattr(arguments["instance"], "_options") else 3
+            }
+        ],
+        [
+            {
+                "_comment": "model configuration",
+                "attribute": "model",
+                "accessor": lambda arguments: arguments["instance"]._options.model.__class__.__name__ if hasattr(arguments["instance"], "_options") else "unknown"
+            },
+            {
+                "attribute": "tokenizer",
+                "accessor": lambda arguments: arguments["instance"]._options.tokenizer.__class__.__name__ if hasattr(arguments["instance"], "_options") else "GPTTokenizer"
+            }
+        ]
+    ],
+    "events": [
+        {
+            "name": "data.input",
+            "_comment": "input configuration to ActionPlanner",
+            "attributes": [
+                {
+                    "attribute": "prompt_name",
+                    "accessor": _helper.capture_prompt_info
+                },
+                {
+                    "attribute": "validator",
+                    "accessor": lambda arguments: arguments["kwargs"].get("validator").__class__.__name__ if arguments.get("kwargs", {}).get("validator") else "DefaultResponseValidator"
+                },
+                {
+                    "attribute": "memory_type",
+                    "accessor": lambda arguments: arguments["kwargs"].get("memory").__class__.__name__ if arguments.get("kwargs", {}).get("memory") else "unknown"
+                }
+            ]
+        },
+        {
+            "name": "data.output",
+            "_comment": "output from ActionPlanner",
+            "attributes": [
+                {
+                    "attribute": "status",
+                    "accessor": lambda arguments: _helper.status_check(arguments)
+                },
+                {
+                    "attribute": "response",
+                    "accessor": lambda arguments: arguments["result"].message.content if hasattr(arguments["result"], "message") else str(arguments["result"])
+                }
+            ]
+        },
+        {
+            "name": "metadata",
+            "attributes": [
+                {
+                    "_comment": "execution metadata",
+                    "accessor": lambda arguments: {
+                        "latency_ms": arguments.get("latency_ms"),
+                        "feedback_enabled": arguments["instance"]._enable_feedback_loop if hasattr(arguments["instance"], "_enable_feedback_loop") else False
+                    }
+                }
+            ]
+        }
+    ]
+}

monocle_apptrace-0.3.1b1/src/monocle_apptrace/instrumentation/metamodel/teamsai/entities/inference/teamsai_output_processor.py

@@ -0,0 +1,70 @@
+from monocle_apptrace.instrumentation.metamodel.teamsai import (
+    _helper,
+)
+TEAMAI_OUTPUT_PROCESSOR = {
+    "type": "inference",
+    "attributes": [
+        [
+            {
+                "_comment": "provider type, name, deployment",
+                "attribute": "type",
+                "accessor": lambda arguments: "teams.openai"
+            },
+            {
+                "attribute": "provider_name",
+                "accessor": lambda arguments: "Microsoft Teams AI"
+            },
+            {
+                "attribute": "deployment",
+                "accessor": lambda arguments: arguments["instance"]._options.default_model if hasattr(arguments["instance"], "_options") else "unknown"
+            }
+        ],
+        [
+            {
+                "_comment": "LLM Model",
+                "attribute": "name",
+                "accessor": lambda arguments: arguments["instance"]._options.default_model if hasattr(arguments["instance"], "_options") else "unknown"
+            },
+            {
+                "attribute": "is_streaming",
+                "accessor": lambda arguments: arguments["instance"]._options.stream if hasattr(arguments["instance"], "_options") else False
+            }
+        ]
+    ],
+    "events": [
+        {
+            "name": "data.input",
+            "_comment": "input to Teams AI",
+            "attributes": [
+                {
+                    "attribute": "input",
+                    "accessor": _helper.capture_input
+                }
+            ]
+        },
+        {
+            "name": "data.output",
+            "_comment": "output from Teams AI",
+            "attributes": [
+                {
+                    "attribute": "response",
+                    "accessor": lambda arguments: arguments["result"].message.content if hasattr(arguments["result"], "message") else str(arguments["result"])
+                }
+            ]
+        },
+        {
+            "name": "metadata",
+            "attributes": [
+                {
+                    "_comment": "metadata from Teams AI response",
+                    "accessor": lambda arguments: {
+                        "prompt_tokens": arguments["result"].get("usage", {}).get("prompt_tokens", 0),
+                        "completion_tokens": arguments["result"].get("usage", {}).get("completion_tokens", 0),
+                        "total_tokens": arguments["result"].get("usage", {}).get("total_tokens", 0),
+                        "latency_ms": arguments.get("latency_ms")
+                    }
+                }
+            ]
+        }
+    ]
+}

monocle_apptrace-0.3.1b1/src/monocle_apptrace/instrumentation/metamodel/teamsai/methods.py

@@ -0,0 +1,26 @@
+from monocle_apptrace.instrumentation.common.wrapper import atask_wrapper, task_wrapper
+from monocle_apptrace.instrumentation.metamodel.teamsai.entities.inference.teamsai_output_processor import (
+    TEAMAI_OUTPUT_PROCESSOR,
+)
+from monocle_apptrace.instrumentation.metamodel.teamsai.entities.inference.actionplanner_output_processor import (
+    ACTIONPLANNER_OUTPUT_PROCESSOR,
+)
+
+TEAMAI_METHODS =[
+    {
+        "package": "teams.ai.models.openai_model",
+        "object": "OpenAIModel",
+        "method": "complete_prompt",
+        "span_name": "teamsai.workflow",
+        "wrapper_method": atask_wrapper,
+        "output_processor": TEAMAI_OUTPUT_PROCESSOR
+    },
+    {
+        "package": "teams.ai.planners.action_planner",
+        "object": "ActionPlanner",
+        "method": "complete_prompt",
+        "span_name": "teamsai.workflow",
+        "wrapper_method": atask_wrapper,
+        "output_processor": ACTIONPLANNER_OUTPUT_PROCESSOR
+    }
+]

monocle_apptrace-0.3.0b7/CHANGELOG.md

@@ -1,49 +0,0 @@
-## Version 0.3.0b7 (2024-12-10)
-
-- Add dev dependency for Mistral AI integration ([#81](https://github.com/monocle2ai/monocle/pull/81))
-- Add VectorStore deployment URL capture support ([#80](https://github.com/monocle2ai/monocle/pull/80))  
-- Clean up cloud exporter implementation ([#79](https://github.com/monocle2ai/monocle/pull/79))
-- Capture inference span input/output events attributes ([#77](https://github.com/monocle2ai/monocle/pull/77))
-- Add release automation workflows ([#76](https://github.com/monocle2ai/monocle/pull/76))
-- Fix gaps in Monocle SDK implementation ([#72](https://github.com/monocle2ai/monocle/pull/72))  
-- Add kwargs and return value handling in Accessor ([#71](https://github.com/monocle2ai/monocle/pull/71))
-- Update workflow name formatting ([#69](https://github.com/monocle2ai/monocle/pull/69))
-- Implement Haystack metamodel support ([#68](https://github.com/monocle2ai/monocle/pull/68))
-
-## Version 0.2.0 (2024-12-05)
-
-## 0.2.0 (Oct 22, 2024)
-
-- Ndjson format for S3 and Blob exporters ([#61](https://github.com/monocle2ai/monocle/pull/61))
-- Set monocle exporter from env setting ([#60](https://github.com/monocle2ai/monocle/pull/60))
-- Update workflow name and type with new format ([#59](https://github.com/monocle2ai/monocle/pull/59))
-- Updated async and custom output processor testcase for metamodel([#58](https://github.com/monocle2ai/monocle/pull/58))
-- Build okahu exporter and added test cases for okahu exporte ([#56](https://github.com/monocle2ai/monocle/pull/56))
-- Handle exception in span wrappers([#52](https://github.com/monocle2ai/monocle/pull/52))
-- Metamodel entity changes ([#51](https://github.com/monocle2ai/monocle/pull/51)), ([#54](https://github.com/monocle2ai/monocle/pull/54))
-- Error handling for llm_endpoint and tags ([#50](https://github.com/monocle2ai/monocle/pull/50))
-- Context_output for vector store retriever ([#48](https://github.com/monocle2ai/monocle/pull/48))
-- Direct exporter - AWS S3 ([#42](https://github.com/monocle2ai/monocle/pull/42))
-- Direct Exporter - Blob store ([#41](https://github.com/monocle2ai/monocle/pull/41))
-- Initial metamodel definition ([#39](https://github.com/monocle2ai/monocle/pull/39))
-- Improvement in vectorstore traces ([#38](https://github.com/monocle2ai/monocle/pull/38))
-- Update key for session context field in attributes ([#34](https://github.com/monocle2ai/monocle/pull/34))
-
-
-## 0.1.0 (Aug 27, 2024)
-
-- Fixed LlamaIndex tracing bugs ([#32](https://github.com/monocle2ai/monocle/pull/32))
-- Added support to add AWS cloud infra attributes ([#29](https://github.com/monocle2ai/monocle/pull/29))
-- Added support to add Azure cloud infra attributes ([#23](https://github.com/monocle2ai/monocle/pull/23))
-- Added support for adding provider name in LLM span in traces ([#22](https://github.com/monocle2ai/monocle/pull/22))
-- Added a default file span exporter ([#21](https://github.com/monocle2ai/monocle/pull/21))
-- Moved input and output context and prompts from attributes to events ([#15](https://github.com/monocle2ai/monocle/pull/15))
-
-
-
-
-
-
-## 0.0.1 (Jul 17, 2024)
-
-- First monocle release