PyPI - openlit - Versions diffs - 1.10.0__tar.gz → 1.12.0__tar.gz - Mend

openlit 1.10.0tar.gz → 1.12.0tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Files changed (53) hide show

{openlit-1.10.0 → openlit-1.12.0}/PKG-INFO RENAMED Viewed

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: openlit
-Version: 1.10.0
+Version: 1.12.0
 Summary: OpenTelemetry-native Auto instrumentation library for monitoring LLM Applications, facilitating the integration of observability into your GenAI-driven projects
 Home-page: https://github.com/openlit/openlit/tree/main/openlit/python
 Keywords: OpenTelemetry,otel,otlp,llm,tracing,openai,anthropic,claude,cohere,llm monitoring,observability,monitoring,gpt,Generative AI,chatGPT
@@ -51,26 +51,28 @@ This project adheres to the [Semantic Conventions](https://github.com/open-telem
 ## Auto Instrumentation Capabilities
-| LLMs                                                     | Vector DBs                                   | Frameworks                                   |
-|----------------------------------------------------------|----------------------------------------------|----------------------------------------------|
-| [✅ OpenAI](https://docs.openlit.io/latest/integrations/openai)               | [✅ ChromaDB](https://docs.openlit.io/latest/integrations/chromadb)       | [✅ Langchain](https://docs.openlit.io/latest/integrations/langchain)     |
-| [✅ Ollama](https://docs.openlit.io/latest/integrations/ollama)               | [✅ Pinecone](https://docs.openlit.io/latest/integrations/pinecone)       | [✅ LiteLLM](https://docs.openlit.io/latest/integrations/litellm)         |
-| [✅ Anthropic](https://docs.openlit.io/latest/integrations/anthropic)         | [✅ Qdrant](https://docs.openlit.io/latest/integrations/qdrant)           | [✅ LlamaIndex](https://docs.openlit.io/latest/integrations/llama-index)  |
-| [✅ Cohere](https://docs.openlit.io/latest/integrations/cohere)               | [✅ Milvus](https://docs.openlit.io/latest/integrations/milvus)           | [✅ Haystack](https://docs.openlit.io/latest/integrations/haystack)       |
-| [✅ Mistral](https://docs.openlit.io/latest/integrations/mistral)             |                                                                          |
-| [✅ Azure OpenAI](https://docs.openlit.io/latest/integrations/azure-openai)   |                                                                          |
+| LLMs                                                            | Vector DBs                                   | Frameworks                                   |
+|-----------------------------------------------------------------|----------------------------------------------|----------------------------------------------|
+| [✅ OpenAI](https://docs.openlit.io/latest/integrations/openai)              | [✅ ChromaDB](https://docs.openlit.io/latest/integrations/chromadb)       | [✅ Langchain](https://docs.openlit.io/latest/integrations/langchain)     |
+| [✅ Ollama](https://docs.openlit.io/latest/integrations/ollama)              | [✅ Pinecone](https://docs.openlit.io/latest/integrations/pinecone)       | [✅ LiteLLM](https://docs.openlit.io/latest/integrations/litellm)         |
+| [✅ Anthropic](https://docs.openlit.io/latest/integrations/anthropic)        | [✅ Qdrant](https://docs.openlit.io/latest/integrations/qdrant)           | [✅ LlamaIndex](https://docs.openlit.io/latest/integrations/llama-index)  |
+| [✅ GPT4All](https://docs.openlit.io/latest/integrations/gpt4all)            | [✅ Milvus](https://docs.openlit.io/latest/integrations/milvus)           | [✅ Haystack](https://docs.openlit.io/latest/integrations/haystack)       |
+| [✅ Cohere](https://docs.openlit.io/latest/integrations/cohere)              |                                                                          | [✅ EmbedChain](https://docs.openlit.io/latest/integrations/embedchain)   |
+| [✅ Mistral](https://docs.openlit.io/latest/integrations/mistral)            |                                                                          |
+| [✅ Azure OpenAI](https://docs.openlit.io/latest/integrations/azure-openai)  |                                                                          |
 | [✅ HuggingFace Transformers](https://docs.openlit.io/latest/integrations/huggingface) |                                                                          |
-| [✅ Amazon Bedrock](https://docs.openlit.io/latest/integrations/bedrock)         |                                                                          |
+| [✅ Amazon Bedrock](https://docs.openlit.io/latest/integrations/bedrock)     |                                                                          |
 | [✅ Vertex AI](https://docs.openlit.io/latest/integrations/vertexai)         |                                                                          |
-| [✅ Groq](https://docs.openlit.io/latest/integrations/groq)                   |                                                                          |
+| [✅ Groq](https://docs.openlit.io/latest/integrations/groq)                  |
 ## Supported Destinations
 - [✅ OpenTelemetry Collector](https://docs.openlit.io/latest/connections/otelcol)
 - [✅ Prometheus + Tempo](https://docs.openlit.io/latest/connections/prometheus-tempo)
 - [✅ Prometheus + Jaeger](https://docs.openlit.io/latest/connections/prometheus-jaeger)
 - [✅ Grafana Cloud](https://docs.openlit.io/latest/connections/grafanacloud)
-- [✅ DataDog](https://docs.openlit.io/latest/connections/datadog)
 - [✅ New Relic](https://docs.openlit.io/latest/connections/new-relic)
+- [✅ Elastic](https://docs.openlit.io/latest/connections/elastic)
+- [✅ DataDog](https://docs.openlit.io/latest/connections/datadog)
 - [✅ SigNoz](https://docs.openlit.io/latest/connections/signoz)
 - [✅ Dynatrace](https://docs.openlit.io/latest/connections/dynatrace)
 - [✅ OpenObserve](https://docs.openlit.io/latest/connections/openobserve)

{openlit-1.10.0 → openlit-1.12.0}/README.md RENAMED Viewed

@@ -26,26 +26,28 @@ This project adheres to the [Semantic Conventions](https://github.com/open-telem
 ## Auto Instrumentation Capabilities
-| LLMs                                                     | Vector DBs                                   | Frameworks                                   |
-|----------------------------------------------------------|----------------------------------------------|----------------------------------------------|
-| [✅ OpenAI](https://docs.openlit.io/latest/integrations/openai)               | [✅ ChromaDB](https://docs.openlit.io/latest/integrations/chromadb)       | [✅ Langchain](https://docs.openlit.io/latest/integrations/langchain)     |
-| [✅ Ollama](https://docs.openlit.io/latest/integrations/ollama)               | [✅ Pinecone](https://docs.openlit.io/latest/integrations/pinecone)       | [✅ LiteLLM](https://docs.openlit.io/latest/integrations/litellm)         |
-| [✅ Anthropic](https://docs.openlit.io/latest/integrations/anthropic)         | [✅ Qdrant](https://docs.openlit.io/latest/integrations/qdrant)           | [✅ LlamaIndex](https://docs.openlit.io/latest/integrations/llama-index)  |
-| [✅ Cohere](https://docs.openlit.io/latest/integrations/cohere)               | [✅ Milvus](https://docs.openlit.io/latest/integrations/milvus)           | [✅ Haystack](https://docs.openlit.io/latest/integrations/haystack)       |
-| [✅ Mistral](https://docs.openlit.io/latest/integrations/mistral)             |                                                                          |
-| [✅ Azure OpenAI](https://docs.openlit.io/latest/integrations/azure-openai)   |                                                                          |
+| LLMs                                                            | Vector DBs                                   | Frameworks                                   |
+|-----------------------------------------------------------------|----------------------------------------------|----------------------------------------------|
+| [✅ OpenAI](https://docs.openlit.io/latest/integrations/openai)              | [✅ ChromaDB](https://docs.openlit.io/latest/integrations/chromadb)       | [✅ Langchain](https://docs.openlit.io/latest/integrations/langchain)     |
+| [✅ Ollama](https://docs.openlit.io/latest/integrations/ollama)              | [✅ Pinecone](https://docs.openlit.io/latest/integrations/pinecone)       | [✅ LiteLLM](https://docs.openlit.io/latest/integrations/litellm)         |
+| [✅ Anthropic](https://docs.openlit.io/latest/integrations/anthropic)        | [✅ Qdrant](https://docs.openlit.io/latest/integrations/qdrant)           | [✅ LlamaIndex](https://docs.openlit.io/latest/integrations/llama-index)  |
+| [✅ GPT4All](https://docs.openlit.io/latest/integrations/gpt4all)            | [✅ Milvus](https://docs.openlit.io/latest/integrations/milvus)           | [✅ Haystack](https://docs.openlit.io/latest/integrations/haystack)       |
+| [✅ Cohere](https://docs.openlit.io/latest/integrations/cohere)              |                                                                          | [✅ EmbedChain](https://docs.openlit.io/latest/integrations/embedchain)   |
+| [✅ Mistral](https://docs.openlit.io/latest/integrations/mistral)            |                                                                          |
+| [✅ Azure OpenAI](https://docs.openlit.io/latest/integrations/azure-openai)  |                                                                          |
 | [✅ HuggingFace Transformers](https://docs.openlit.io/latest/integrations/huggingface) |                                                                          |
-| [✅ Amazon Bedrock](https://docs.openlit.io/latest/integrations/bedrock)         |                                                                          |
+| [✅ Amazon Bedrock](https://docs.openlit.io/latest/integrations/bedrock)     |                                                                          |
 | [✅ Vertex AI](https://docs.openlit.io/latest/integrations/vertexai)         |                                                                          |
-| [✅ Groq](https://docs.openlit.io/latest/integrations/groq)                   |                                                                          |
+| [✅ Groq](https://docs.openlit.io/latest/integrations/groq)                  |
 ## Supported Destinations
 - [✅ OpenTelemetry Collector](https://docs.openlit.io/latest/connections/otelcol)
 - [✅ Prometheus + Tempo](https://docs.openlit.io/latest/connections/prometheus-tempo)
 - [✅ Prometheus + Jaeger](https://docs.openlit.io/latest/connections/prometheus-jaeger)
 - [✅ Grafana Cloud](https://docs.openlit.io/latest/connections/grafanacloud)
-- [✅ DataDog](https://docs.openlit.io/latest/connections/datadog)
 - [✅ New Relic](https://docs.openlit.io/latest/connections/new-relic)
+- [✅ Elastic](https://docs.openlit.io/latest/connections/elastic)
+- [✅ DataDog](https://docs.openlit.io/latest/connections/datadog)
 - [✅ SigNoz](https://docs.openlit.io/latest/connections/signoz)
 - [✅ Dynatrace](https://docs.openlit.io/latest/connections/dynatrace)
 - [✅ OpenObserve](https://docs.openlit.io/latest/connections/openobserve)

{openlit-1.10.0 → openlit-1.12.0}/pyproject.toml RENAMED Viewed

@@ -1,6 +1,6 @@
 [tool.poetry]
 name = "openlit"
-version = "1.10.0"
+version = "1.12.0"
 description = "OpenTelemetry-native Auto instrumentation library for monitoring LLM Applications, facilitating the integration of observability into your GenAI-driven projects"
 authors = ["OpenLIT"]
 repository = "https://github.com/openlit/openlit/tree/main/openlit/python"

{openlit-1.10.0 → openlit-1.12.0}/src/openlit/__init__.py RENAMED Viewed

@@ -21,6 +21,7 @@ from openlit.instrumentation.bedrock import BedrockInstrumentor
 from openlit.instrumentation.vertexai import VertexAIInstrumentor
 from openlit.instrumentation.groq import GroqInstrumentor
 from openlit.instrumentation.ollama import OllamaInstrumentor
+from openlit.instrumentation.gpt4all import GPT4AllInstrumentor
 from openlit.instrumentation.langchain import LangChainInstrumentor
 from openlit.instrumentation.llamaindex import LlamaIndexInstrumentor
 from openlit.instrumentation.haystack import HaystackInstrumentor
@@ -161,6 +162,7 @@ def init(environment="default", application_name="default", tracer=None, otlp_en
         "vertexai": "vertexai",
         "groq": "groq",
         "ollama": "ollama",
+        "gpt4all": "gpt4all",
         "langchain": "langchain",
         "llama_index": "llama_index",
         "haystack": "haystack",
@@ -216,6 +218,7 @@ def init(environment="default", application_name="default", tracer=None, otlp_en
             "vertexai": VertexAIInstrumentor(),
             "groq": GroqInstrumentor(),
             "ollama": OllamaInstrumentor(),
+            "gpt4all": GPT4AllInstrumentor(),
             "langchain": LangChainInstrumentor(),
             "llama_index": LlamaIndexInstrumentor(),
             "haystack": HaystackInstrumentor(),

openlit-1.12.0/src/openlit/instrumentation/gpt4all/__init__.py ADDED Viewed

@@ -0,0 +1,52 @@
+# pylint: disable=useless-return, bad-staticmethod-argument, disable=duplicate-code
+"""Initializer of Auto Instrumentation of GPT4All Functions"""
+from typing import Collection
+import importlib.metadata
+from opentelemetry.instrumentation.instrumentor import BaseInstrumentor
+from wrapt import wrap_function_wrapper
+from openlit.instrumentation.gpt4all.gpt4all import (
+    embed, generate
+)
+_instruments = ("gpt4all >= 2.6.0",)
+class GPT4AllInstrumentor(BaseInstrumentor):
+    """
+    An instrumentor for GPT4All's client library.
+    """
+    def instrumentation_dependencies(self) -> Collection[str]:
+        return _instruments
+    def _instrument(self, **kwargs):
+        application_name = kwargs.get("application_name", "default_application")
+        environment = kwargs.get("environment", "default_environment")
+        tracer = kwargs.get("tracer")
+        metrics = kwargs.get("metrics_dict")
+        pricing_info = kwargs.get("pricing_info", {})
+        trace_content = kwargs.get("trace_content", False)
+        disable_metrics = kwargs.get("disable_metrics")
+        version = importlib.metadata.version("gpt4all")
+        # generate
+        wrap_function_wrapper(
+            "gpt4all",
+            "GPT4All.generate",
+            generate("gpt4all.generate", version, environment, application_name,
+                  tracer, pricing_info, trace_content, metrics, disable_metrics),
+        )
+        # embed
+        wrap_function_wrapper(
+            "gpt4all",
+            "Embed4All.embed",
+            embed("gpt4all.embed", version, environment, application_name,
+                  tracer, pricing_info, trace_content, metrics, disable_metrics),
+        )
+    def _uninstrument(self, **kwargs):
+        # Proper uninstrumentation logic to revert patched methods
+        pass

openlit-1.12.0/src/openlit/instrumentation/gpt4all/gpt4all.py ADDED Viewed

@@ -0,0 +1,352 @@
+# pylint: disable=duplicate-code, broad-exception-caught, too-many-statements, unused-argument, possibly-used-before-assignment
+"""
+Module for monitoring GPT4All API calls.
+"""
+import logging
+from opentelemetry.trace import SpanKind, Status, StatusCode
+from opentelemetry.sdk.resources import TELEMETRY_SDK_NAME
+from openlit.__helpers import handle_exception, general_tokens
+from openlit.semcov import SemanticConvetion
+# Initialize logger for logging potential issues and operations
+logger = logging.getLogger(__name__)
+def generate(gen_ai_endpoint, version, environment, application_name,
+                     tracer, pricing_info, trace_content, metrics, disable_metrics):
+    """
+    Generates a telemetry wrapper for generate to collect metrics.
+    Args:
+        gen_ai_endpoint: Endpoint identifier for logging and tracing.
+        version: Version of the monitoring package.
+        environment: Deployment environment (e.g., production, staging).
+        application_name: Name of the application using the GPT4All API.
+        tracer: OpenTelemetry tracer for creating spans.
+        pricing_info: Information used for calculating the cost of GPT4All usage.
+        trace_content: Flag indicating whether to trace the actual content.
+    Returns:
+        A function that wraps the generate method to add telemetry.
+    """
+    def wrapper(wrapped, instance, args, kwargs):
+        """
+        Wraps the 'generate' API call to add telemetry.
+        This collects metrics such as execution time, cost, and token usage, and handles errors
+        gracefully, adding details to the trace for observability.
+        Args:
+            wrapped: The original 'generate' method to be wrapped.
+            instance: The instance of the class where the original method is defined.
+            args: Positional arguments for the 'generate' method.
+            kwargs: Keyword arguments for the 'generate' method.
+        Returns:
+            The response from the original 'generate' method.
+        """
+        # Check if streaming is enabled for the API call
+        streaming = kwargs.get("streaming", False)
+        # pylint: disable=no-else-return
+        if streaming:
+            # Special handling for streaming response to accommodate the nature of data flow
+            def stream_generator():
+                with tracer.start_as_current_span(gen_ai_endpoint, kind= SpanKind.CLIENT) as span:
+                    # Placeholder for aggregating streaming response
+                    llmresponse = ""
+                    # Loop through streaming events capturing relevant details
+                    for chunk in wrapped(*args, **kwargs):
+                        # Collect aggregated response from events
+                        llmresponse += chunk
+                        yield chunk
+                    # Handling exception ensure observability without disrupting operation
+                    try:
+                        # Calculate cost of the operation
+                        cost = 0
+                        # pylint: disable=line-too-long
+                        model = str(instance.model.model_path).rsplit('/', maxsplit=1)[-1] or "orca-mini-3b-gguf2-q4_0.gguf"
+                        prompt = kwargs.get("prompt") or args[0] or ""
+                        # Calculate cost of the operation
+                        cost = 0
+                        prompt_tokens = general_tokens(prompt)
+                        completion_tokens = general_tokens(llmresponse)
+                        total_tokens = prompt_tokens + completion_tokens
+                        # Set base span attribues
+                        span.set_attribute(TELEMETRY_SDK_NAME, "openlit")
+                        span.set_attribute(SemanticConvetion.GEN_AI_SYSTEM,
+                                            SemanticConvetion.GEN_AI_SYSTEM_GPT4ALL)
+                        span.set_attribute(SemanticConvetion.GEN_AI_TYPE,
+                                            SemanticConvetion.GEN_AI_TYPE_CHAT)
+                        span.set_attribute(SemanticConvetion.GEN_AI_ENDPOINT,
+                                            gen_ai_endpoint)
+                        span.set_attribute(SemanticConvetion.GEN_AI_ENVIRONMENT,
+                                            environment)
+                        span.set_attribute(SemanticConvetion.GEN_AI_APPLICATION_NAME,
+                                            application_name)
+                        span.set_attribute(SemanticConvetion.GEN_AI_REQUEST_MODEL,
+                                            model)
+                        span.set_attribute(SemanticConvetion.GEN_AI_REQUEST_TOP_K,
+                                            kwargs.get("top_k", 40))
+                        span.set_attribute(SemanticConvetion.GEN_AI_REQUEST_TOP_P,
+                                            kwargs.get("top_p", 0.4))
+                        span.set_attribute(SemanticConvetion.GEN_AI_REQUEST_MAX_TOKENS,
+                                            kwargs.get("max_tokens", 200))
+                        span.set_attribute(SemanticConvetion.GEN_AI_REQUEST_TEMPERATURE,
+                                            kwargs.get("temperature", 0.7))
+                        span.set_attribute(SemanticConvetion.GEN_AI_REQUEST_FREQUENCY_PENALTY,
+                                            kwargs.get("frequency_penalty", 1.18))
+                        span.set_attribute(SemanticConvetion.GEN_AI_REQUEST_IS_STREAM,
+                                            True)
+                        if trace_content:
+                            span.set_attribute(SemanticConvetion.GEN_AI_CONTENT_PROMPT,
+                                                prompt)
+                            span.set_attribute(SemanticConvetion.GEN_AI_CONTENT_COMPLETION,
+                                                llmresponse)
+                        span.set_attribute(SemanticConvetion.GEN_AI_USAGE_PROMPT_TOKENS,
+                                        prompt_tokens)
+                        span.set_attribute(SemanticConvetion.GEN_AI_USAGE_COMPLETION_TOKENS,
+                                            completion_tokens)
+                        span.set_attribute(SemanticConvetion.GEN_AI_USAGE_TOTAL_TOKENS,
+                                            total_tokens)
+                        span.set_attribute(SemanticConvetion.GEN_AI_USAGE_COST,
+                                            cost)
+                        span.set_status(Status(StatusCode.OK))
+                        if disable_metrics is False:
+                            attributes = {
+                                TELEMETRY_SDK_NAME:
+                                    "openlit",
+                                SemanticConvetion.GEN_AI_APPLICATION_NAME:
+                                    application_name,
+                                SemanticConvetion.GEN_AI_SYSTEM:
+                                    SemanticConvetion.GEN_AI_SYSTEM_GPT4ALL,
+                                SemanticConvetion.GEN_AI_ENVIRONMENT:
+                                    environment,
+                                SemanticConvetion.GEN_AI_TYPE:
+                                    SemanticConvetion.GEN_AI_TYPE_CHAT,
+                                SemanticConvetion.GEN_AI_REQUEST_MODEL:
+                                    model
+                            }
+                            metrics["genai_requests"].add(1, attributes)
+                            metrics["genai_total_tokens"].add(total_tokens, attributes)
+                            metrics["genai_completion_tokens"].add(completion_tokens, attributes)
+                            metrics["genai_prompt_tokens"].add(prompt_tokens, attributes)
+                            metrics["genai_cost"].record(cost, attributes)
+                    except Exception as e:
+                        handle_exception(span, e)
+                        logger.error("Error in trace creation: %s", e)
+            return stream_generator()
+        # Handling for non-streaming responses
+        else:
+            # pylint: disable=line-too-long
+            with tracer.start_as_current_span(gen_ai_endpoint, kind= SpanKind.CLIENT) as span:
+                response = wrapped(*args, **kwargs)
+                # pylint: disable=line-too-long
+                model = str(instance.model.model_path).rsplit('/', maxsplit=1)[-1] or "orca-mini-3b-gguf2-q4_0.gguf"
+                prompt = kwargs.get("prompt") or args[0] or ""
+                # Calculate cost of the operation
+                cost = 0
+                prompt_tokens = general_tokens(prompt)
+                completion_tokens = general_tokens(response)
+                total_tokens = prompt_tokens + completion_tokens
+                try:
+                    # Set base span attribues
+                    span.set_attribute(TELEMETRY_SDK_NAME, "openlit")
+                    span.set_attribute(SemanticConvetion.GEN_AI_SYSTEM,
+                                        SemanticConvetion.GEN_AI_SYSTEM_GPT4ALL)
+                    span.set_attribute(SemanticConvetion.GEN_AI_TYPE,
+                                        SemanticConvetion.GEN_AI_TYPE_CHAT)
+                    span.set_attribute(SemanticConvetion.GEN_AI_ENDPOINT,
+                                        gen_ai_endpoint)
+                    span.set_attribute(SemanticConvetion.GEN_AI_ENVIRONMENT,
+                                        environment)
+                    span.set_attribute(SemanticConvetion.GEN_AI_APPLICATION_NAME,
+                                        application_name)
+                    span.set_attribute(SemanticConvetion.GEN_AI_REQUEST_MODEL,
+                                        model)
+                    span.set_attribute(SemanticConvetion.GEN_AI_REQUEST_TOP_K,
+                                        kwargs.get("top_k", 40))
+                    span.set_attribute(SemanticConvetion.GEN_AI_REQUEST_TOP_P,
+                                        kwargs.get("top_p", 0.4))
+                    span.set_attribute(SemanticConvetion.GEN_AI_REQUEST_MAX_TOKENS,
+                                        kwargs.get("max_tokens", 200))
+                    span.set_attribute(SemanticConvetion.GEN_AI_REQUEST_TEMPERATURE,
+                                        kwargs.get("temperature", 0.7))
+                    span.set_attribute(SemanticConvetion.GEN_AI_REQUEST_FREQUENCY_PENALTY,
+                                        kwargs.get("frequency_penalty", 1.18))
+                    span.set_attribute(SemanticConvetion.GEN_AI_REQUEST_IS_STREAM,
+                                        False)
+                    if trace_content:
+                        span.set_attribute(SemanticConvetion.GEN_AI_CONTENT_PROMPT,
+                                            prompt)
+                        span.set_attribute(SemanticConvetion.GEN_AI_CONTENT_COMPLETION,
+                                            response)
+                    span.set_attribute(SemanticConvetion.GEN_AI_USAGE_PROMPT_TOKENS,
+                                        prompt_tokens)
+                    span.set_attribute(SemanticConvetion.GEN_AI_USAGE_COMPLETION_TOKENS,
+                                        completion_tokens)
+                    span.set_attribute(SemanticConvetion.GEN_AI_USAGE_TOTAL_TOKENS,
+                                        total_tokens)
+                    span.set_attribute(SemanticConvetion.GEN_AI_USAGE_COST,
+                                        cost)
+                    span.set_status(Status(StatusCode.OK))
+                    if disable_metrics is False:
+                        attributes = {
+                            TELEMETRY_SDK_NAME:
+                                "openlit",
+                            SemanticConvetion.GEN_AI_APPLICATION_NAME:
+                                application_name,
+                            SemanticConvetion.GEN_AI_SYSTEM:
+                                SemanticConvetion.GEN_AI_SYSTEM_GPT4ALL,
+                            SemanticConvetion.GEN_AI_ENVIRONMENT:
+                                environment,
+                            SemanticConvetion.GEN_AI_TYPE:
+                                SemanticConvetion.GEN_AI_TYPE_CHAT,
+                            SemanticConvetion.GEN_AI_REQUEST_MODEL:
+                                model
+                        }
+                        metrics["genai_requests"].add(1, attributes)
+                        metrics["genai_total_tokens"].add(total_tokens, attributes)
+                        metrics["genai_completion_tokens"].add(completion_tokens, attributes)
+                        metrics["genai_prompt_tokens"].add(prompt_tokens, attributes)
+                        metrics["genai_cost"].record(cost, attributes)
+                    # Return original response
+                    return response
+                except Exception as e:
+                    handle_exception(span, e)
+                    logger.error("Error in trace creation: %s", e)
+                    # Return original response
+                    return response
+    return wrapper
+def embed(gen_ai_endpoint, version, environment, application_name,
+               tracer, pricing_info, trace_content, metrics, disable_metrics):
+    """
+    Generates a telemetry wrapper for embeddings to collect metrics.
+    Args:
+        gen_ai_endpoint: Endpoint identifier for logging and tracing.
+        version: Version of the monitoring package.
+        environment: Deployment environment (e.g., production, staging).
+        application_name: Name of the application using the GPT4All API.
+        tracer: OpenTelemetry tracer for creating spans.
+        pricing_info: Information used for calculating the cost of GPT4All usage.
+        trace_content: Flag indicating whether to trace the actual content.
+    Returns:
+        A function that wraps the embeddings method to add telemetry.
+    """
+    def wrapper(wrapped, instance, args, kwargs):
+        """
+        Wraps the 'embeddings' API call to add telemetry.
+        This collects metrics such as execution time, cost, and token usage, and handles errors
+        gracefully, adding details to the trace for observability.
+        Args:
+            wrapped: The original 'embeddings' method to be wrapped.
+            instance: The instance of the class where the original method is defined.
+            args: Positional arguments for the 'embeddings' method.
+            kwargs: Keyword arguments for the 'embeddings' method.
+        Returns:
+            The response from the original 'embeddings' method.
+        """
+        with tracer.start_as_current_span(gen_ai_endpoint, kind= SpanKind.CLIENT) as span:
+            response = wrapped(*args, **kwargs)
+            try:
+                # pylint: disable=line-too-long
+                model = str(instance.gpt4all.model.model_path).rsplit('/', maxsplit=1)[-1] or "all-MiniLM-L6-v2.gguf2.f16.gguf"
+                prompt = kwargs.get("prompt") or args[0] or ""
+                # Calculate cost of the operation
+                cost = 0
+                prompt_tokens = general_tokens(prompt)
+                # Set Span attributes
+                span.set_attribute(TELEMETRY_SDK_NAME, "openlit")
+                span.set_attribute(SemanticConvetion.GEN_AI_SYSTEM,
+                                    SemanticConvetion.GEN_AI_SYSTEM_GPT4ALL)
+                span.set_attribute(SemanticConvetion.GEN_AI_TYPE,
+                                    SemanticConvetion.GEN_AI_TYPE_EMBEDDING)
+                span.set_attribute(SemanticConvetion.GEN_AI_ENDPOINT,
+                                    gen_ai_endpoint)
+                span.set_attribute(SemanticConvetion.GEN_AI_ENVIRONMENT,
+                                    environment)
+                span.set_attribute(SemanticConvetion.GEN_AI_APPLICATION_NAME,
+                                    application_name)
+                span.set_attribute(SemanticConvetion.GEN_AI_REQUEST_MODEL,
+                                    model)
+                span.set_attribute(SemanticConvetion.GEN_AI_USAGE_PROMPT_TOKENS,
+                                    prompt_tokens)
+                span.set_attribute(SemanticConvetion.GEN_AI_USAGE_TOTAL_TOKENS,
+                                    prompt_tokens)
+                span.set_attribute(SemanticConvetion.GEN_AI_USAGE_COST,
+                                    cost)
+                if trace_content:
+                    span.set_attribute(SemanticConvetion.GEN_AI_CONTENT_PROMPT,
+                                        prompt)
+                span.set_status(Status(StatusCode.OK))
+                if disable_metrics is False:
+                    attributes = {
+                        TELEMETRY_SDK_NAME:
+                            "openlit",
+                        SemanticConvetion.GEN_AI_APPLICATION_NAME:
+                            application_name,
+                        SemanticConvetion.GEN_AI_SYSTEM:
+                            SemanticConvetion.GEN_AI_SYSTEM_GPT4ALL,
+                        SemanticConvetion.GEN_AI_ENVIRONMENT:
+                            environment,
+                        SemanticConvetion.GEN_AI_TYPE:
+                            SemanticConvetion.GEN_AI_TYPE_EMBEDDING,
+                        SemanticConvetion.GEN_AI_REQUEST_MODEL:
+                            model
+                    }
+                    metrics["genai_requests"].add(1, attributes)
+                    metrics["genai_total_tokens"].add(prompt_tokens, attributes)
+                    metrics["genai_prompt_tokens"].add(prompt_tokens, attributes)
+                    metrics["genai_cost"].record(cost, attributes)
+                # Return original response
+                return response
+            except Exception as e:
+                handle_exception(span, e)
+                logger.error("Error in trace creation: %s", e)
+                # Return original response
+                return response
+    return wrapper

{openlit-1.10.0 → openlit-1.12.0}/src/openlit/instrumentation/groq/async_groq.py RENAMED Viewed

@@ -268,7 +268,7 @@ def async_chat(gen_ai_endpoint, version, environment, application_name,
                         else:
                             i = 0
                             while i < kwargs["n"] and trace_content is True:
-                                attribute_name = f"gen_ai.content.completion.{i}"
+                                attribute_name = f"gen_ai.completion.{i}"
                                 span.set_attribute(attribute_name,
                                                     response.choices[i].message.content)
                                 i += 1

{openlit-1.10.0 → openlit-1.12.0}/src/openlit/instrumentation/groq/groq.py RENAMED Viewed

@@ -268,7 +268,7 @@ def chat(gen_ai_endpoint, version, environment, application_name,
                         else:
                             i = 0
                             while i < kwargs["n"] and trace_content is True:
-                                attribute_name = f"gen_ai.content.completion.{i}"
+                                attribute_name = f"gen_ai.completion.{i}"
                                 span.set_attribute(attribute_name,
                                                     response.choices[i].message.content)
                                 i += 1

{openlit-1.10.0 → openlit-1.12.0}/src/openlit/instrumentation/openai/async_azure_openai.py RENAMED Viewed

@@ -269,7 +269,7 @@ def azure_async_chat_completions(gen_ai_endpoint, version, environment, applicat
                         else:
                             i = 0
                             while i < kwargs["n"] and trace_content is True:
-                                attribute_name = f"gen_ai.content.completion.{i}"
+                                attribute_name = f"gen_ai.completion.{i}"
                                 span.set_attribute(attribute_name,
                                                     response.choices[i].message.content)
                                 i += 1
@@ -550,7 +550,7 @@ def azure_async_completions(gen_ai_endpoint, version, environment, application_n
                         else:
                             i = 0
                             while i < kwargs["n"] and trace_content is True:
-                                attribute_name = f"gen_ai.content.completion.{i}"
+                                attribute_name = f"gen_ai.completion.{i}"
                                 span.set_attribute(attribute_name,
                                                     response.choices[i].text)
                                 i += 1

{openlit-1.10.0 → openlit-1.12.0}/src/openlit/instrumentation/openai/async_openai.py RENAMED Viewed

@@ -273,7 +273,7 @@ def async_chat_completions(gen_ai_endpoint, version, environment, application_na
                         else:
                             i = 0
                             while i < kwargs["n"] and trace_content is True:
-                                attribute_name = f"gen_ai.content.completion.{i}"
+                                attribute_name = f"gen_ai.completion.{i}"
                                 span.set_attribute(attribute_name,
                                                     response.choices[i].message.content)
                                 i += 1

{openlit-1.10.0 → openlit-1.12.0}/src/openlit/instrumentation/openai/azure_openai.py RENAMED Viewed

@@ -269,7 +269,7 @@ def azure_chat_completions(gen_ai_endpoint, version, environment, application_na
                         else:
                             i = 0
                             while i < kwargs["n"] and trace_content is True:
-                                attribute_name = f"gen_ai.content.completion.{i}"
+                                attribute_name = f"gen_ai.completion.{i}"
                                 span.set_attribute(attribute_name,
                                                     response.choices[i].message.content)
                                 i += 1
@@ -548,7 +548,7 @@ def azure_completions(gen_ai_endpoint, version, environment, application_name,
                         else:
                             i = 0
                             while i < kwargs["n"] and trace_content is True:
-                                attribute_name = f"gen_ai.content.completion.{i}"
+                                attribute_name = f"gen_ai.completion.{i}"
                                 span.set_attribute(attribute_name,
                                                     response.choices[i].text)
                                 i += 1

{openlit-1.10.0 → openlit-1.12.0}/src/openlit/instrumentation/openai/openai.py RENAMED Viewed

@@ -272,7 +272,7 @@ def chat_completions(gen_ai_endpoint, version, environment, application_name,
                         else:
                             i = 0
                             while i < kwargs["n"] and trace_content is True:
-                                attribute_name = f"gen_ai.content.completion.{i}"
+                                attribute_name = f"gen_ai.completion.{i}"
                                 span.set_attribute(attribute_name,
                                                     response.choices[i].message.content)
                                 i += 1

{openlit-1.10.0 → openlit-1.12.0}/src/openlit/instrumentation/transformers/transformers.py RENAMED Viewed

@@ -98,7 +98,7 @@ def text_wrap(gen_ai_endpoint, version, environment, application_name,
                 completion_tokens = 0
                 for completion in response:
                     if len(response) > 1:
-                        attribute_name = f"gen_ai.content.completion.{i}"
+                        attribute_name = f"gen_ai.completion.{i}"
                     else:
                         attribute_name = SemanticConvetion.GEN_AI_CONTENT_COMPLETION
                     if i == 0:

{openlit-1.10.0 → openlit-1.12.0}/src/openlit/semcov/__init__.py RENAMED Viewed

@@ -21,7 +21,7 @@ class SemanticConvetion:
     GEN_AI_SYSTEM = "gen_ai.system"
     GEN_AI_ENVIRONMENT = "gen_ai.environment"
     GEN_AI_APPLICATION_NAME = "gen_ai.application_name"
-    GEN_AI_TYPE = "gen_ai.type"
+    GEN_AI_TYPE = "gen_ai.operation.name"
     GEN_AI_HUB_OWNER = "gen_ai.hub.owner"
     GEN_AI_HUB_REPO = "gen_ai.hub.repo"
     GEN_AI_RETRIEVAL_SOURCE = "gen_ai.retrieval.source"
@@ -68,8 +68,8 @@ class SemanticConvetion:
     GEN_AI_RESPONSE_IMAGE_STYLE = "gen_ai.request.image_style"
     # GenAI Content
-    GEN_AI_CONTENT_PROMPT = "gen_ai.content.prompt"
-    GEN_AI_CONTENT_COMPLETION = "gen_ai.content.completion"
+    GEN_AI_CONTENT_PROMPT = "gen_ai.prompt"
+    GEN_AI_CONTENT_COMPLETION = "gen_ai.completion"
     GEN_AI_CONTENT_REVISED_PROMPT = "gen_ai.content.revised_prompt"
     # GenAI Evaluation Metrics
@@ -95,6 +95,7 @@ class SemanticConvetion:
     GEN_AI_SYSTEM_VERTEXAI = "vertexai"
     GEN_AI_SYSTEM_GROQ = "groq"
     GEN_AI_SYSTEM_OLLAMA = "ollama"
+    GEN_AI_SYSTEM_GPT4ALL = "gpt4all"
     GEN_AI_SYSTEM_LANGCHAIN = "langchain"
     GEN_AI_SYSTEM_LLAMAINDEX = "llama_index"
     GEN_AI_SYSTEM_HAYSTACK = "haystack"