agentops-accelerator 0.4.1__tar.gz → 0.4.2__tar.gz

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/AGENTS.md

@@ -472,7 +472,7 @@ Authentication rule (Windows-friendly):
 
 Recommended default behavior:
 - Keep Foundry cloud mode as the default for `name:version` agents
-- Install Azure runtime dependencies via the `[foundry]` extra
+- Install AgentOps normally; Foundry runtime dependencies are part of the default package
 - Keep Azure SDK imports inside functions (lazy) in `pipeline/` and `agent/`
 - Do not hardcode `api_version` in `get_openai_client()` — the SDK picks it
 

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/CHANGELOG.md

@@ -5,6 +5,22 @@ This format follows [Keep a Changelog](https://keepachangelog.com/) and adheres
 
 ## [Unreleased]
 
+## [0.4.2] - 2026-06-17
+
+### Fixed
+- **`agentops eval init` now works with both old and new `azure.ai.agents` azd
+  extensions.** Version 0.1.40 of the extension renamed the eval subcommand from
+  `azd ai agent eval init` to `azd ai agent eval generate`, which made
+  `agentops eval init` hard-fail with `Command "init" is deprecated, use 'azd ai
+  agent eval generate' instead`. AgentOps now invokes `generate` first and
+  transparently falls back to the legacy `init` subcommand when an older
+  extension does not recognise `generate`. The fallback only triggers on
+  subcommand-name/deprecation errors; genuine failures (authentication, project
+  endpoint, timeouts) are still surfaced immediately and unchanged. All
+  previously passed flags (`--project-endpoint`, `--agent`,
+  `--gen-instruction-file`, `--eval-model`, `--dataset`, `--evaluator`) and the
+  recipe discovery/persistence behaviour are preserved.
+
 ## [0.4.1] - 2026-06-15
 
 ### Changed

agentops_accelerator-0.4.2/PKG-INFO

@@ -0,0 +1,114 @@
+Metadata-Version: 2.4
+Name: agentops-accelerator
+Version: 0.4.2
+Summary: Release readiness gates and evidence for Microsoft Foundry agents
+License: MIT License
+        
+        Copyright (c) Microsoft Corporation.
+        
+        Permission is hereby granted, free of charge, to any person obtaining a copy
+        of this software and associated documentation files (the "Software"), to deal
+        in the Software without restriction, including without limitation the rights
+        to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+        copies of the Software, and to permit persons to whom the Software is
+        furnished to do so, subject to the following conditions:
+        
+        The above copyright notice and this permission notice shall be included in all
+        copies or substantial portions of the Software.
+        
+        THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+        IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+        FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+        AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+        LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+        OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+        SOFTWARE.
+        
+Requires-Python: >=3.11
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: typer<1.0,>=0.12
+Requires-Dist: pydantic<3,>=2
+Requires-Dist: ruamel.yaml<1.0,>=0.18
+Requires-Dist: azure-ai-projects<3.0,>=2.0.1
+Requires-Dist: azure-ai-evaluation<2.0,>=1.0
+Requires-Dist: azure-identity<2.0,>=1.17
+Requires-Dist: azure-monitor-opentelemetry<2.0,>=1.6
+Requires-Dist: pandas<4.0,>=2.0
+Provides-Extra: mcp
+Requires-Dist: mcp<2,>=1.0; extra == "mcp"
+Provides-Extra: agent
+Requires-Dist: fastapi<1.0,>=0.110; extra == "agent"
+Requires-Dist: uvicorn[standard]<1.0,>=0.30; extra == "agent"
+Requires-Dist: httpx<1.0,>=0.27; extra == "agent"
+Requires-Dist: cryptography>=42; extra == "agent"
+Requires-Dist: markdown<4.0,>=3.6; extra == "agent"
+Requires-Dist: azure-monitor-query<3.0,>=1.3; extra == "agent"
+Requires-Dist: azure-monitor-opentelemetry<2.0,>=1.6; extra == "agent"
+Requires-Dist: azure-identity<2.0,>=1.17; extra == "agent"
+Requires-Dist: azure-mgmt-cognitiveservices<15.0,>=13.5; extra == "agent"
+Requires-Dist: azure-mgmt-monitor<7.0,>=6.0; extra == "agent"
+Requires-Dist: azure-mgmt-authorization<5.0,>=4.0; extra == "agent"
+Dynamic: license-file
+
+<h1 align="center">AgentOps Accelerator</h1>
+
+<p align="center">
+<b>Evaluate. Ship. Observe. Own.</b>
+<br/>
+Continuous evaluation, safety testing, observability, and release readiness for Microsoft Foundry agents.
+</p>
+
+<p align="center">
+<a href="https://aka.ms/agentops-accelerator"><b>Documentation</b></a> |
+<a href="https://pypi.org/project/agentops-accelerator/">PyPI</a> |
+<a href="https://marketplace.visualstudio.com/items?itemName=AgentOpsAccelerator.agentops-accelerator">VS Code Extension</a> |
+<a href="https://github.com/Azure/agentops/releases/latest">Latest release</a>
+</p>
+
+<p align="center">
+<a href="https://pypi.org/project/agentops-accelerator/"><img alt="PyPI" src="https://img.shields.io/pypi/v/agentops-accelerator.svg?label=PyPI&color=blue"/></a>
+<a href="https://marketplace.visualstudio.com/items?itemName=AgentOpsAccelerator.agentops-accelerator"><img alt="VS Code Extension" src="https://img.shields.io/badge/VS%20Code-Extension-007ACC.svg?logo=visualstudiocode"/></a>
+<a href="https://github.com/Azure/agentops/actions/workflows/ci.yml"><img alt="CI" src="https://github.com/Azure/agentops/actions/workflows/ci.yml/badge.svg?branch=develop"/></a>
+<a href="https://github.com/Azure/agentops/actions/workflows/release.yml"><img alt="Release" src="https://github.com/Azure/agentops/actions/workflows/release.yml/badge.svg"/></a>
+<a href="https://github.com/Azure/agentops/blob/main/LICENSE"><img alt="License: MIT" src="https://img.shields.io/badge/License-MIT-green.svg"/></a>
+</p>
+
+AgentOps Accelerator helps Microsoft Foundry agent teams evaluate quality, prepare releases, monitor behavior, and stay accountable after launch. It gives you a practical starting point for agent operations, with Foundry integration as the default path and deeper setup guidance in the full docs.
+
+## Get started
+
+```powershell
+python -m pip install agentops-accelerator
+agentops init
+agentops eval analyze
+agentops eval run
+agentops doctor --evidence-pack
+```
+
+## What it helps you do
+
+Use AgentOps Accelerator when you need to:
+
+- Evaluate an agent before release
+- Compare changes across versions
+- Capture release evidence
+- Monitor agent quality and regressions
+- Give teams a repeatable way to own agent behavior in production
+
+The accelerator keeps the local workflow simple, then points you to the full
+docs when you are ready to configure pipelines, dashboards, and release
+practices.
+
+## Learn more
+
+For setup guides, tutorials, architecture, CI/CD guidance, Doctor checks, and
+evaluator reference, see:
+
+<p align="center">
+<a href="https://aka.ms/agentops-accelerator"><b>https://aka.ms/agentops-accelerator</b></a>
+</p>
+
+## Contributing
+
+See [CONTRIBUTING.md](CONTRIBUTING.md) for development, testing, and contribution guidance.

agentops_accelerator-0.4.2/README.md

@@ -0,0 +1,61 @@
+<h1 align="center">AgentOps Accelerator</h1>
+
+<p align="center">
+<b>Evaluate. Ship. Observe. Own.</b>
+<br/>
+Continuous evaluation, safety testing, observability, and release readiness for Microsoft Foundry agents.
+</p>
+
+<p align="center">
+<a href="https://aka.ms/agentops-accelerator"><b>Documentation</b></a> |
+<a href="https://pypi.org/project/agentops-accelerator/">PyPI</a> |
+<a href="https://marketplace.visualstudio.com/items?itemName=AgentOpsAccelerator.agentops-accelerator">VS Code Extension</a> |
+<a href="https://github.com/Azure/agentops/releases/latest">Latest release</a>
+</p>
+
+<p align="center">
+<a href="https://pypi.org/project/agentops-accelerator/"><img alt="PyPI" src="https://img.shields.io/pypi/v/agentops-accelerator.svg?label=PyPI&color=blue"/></a>
+<a href="https://marketplace.visualstudio.com/items?itemName=AgentOpsAccelerator.agentops-accelerator"><img alt="VS Code Extension" src="https://img.shields.io/badge/VS%20Code-Extension-007ACC.svg?logo=visualstudiocode"/></a>
+<a href="https://github.com/Azure/agentops/actions/workflows/ci.yml"><img alt="CI" src="https://github.com/Azure/agentops/actions/workflows/ci.yml/badge.svg?branch=develop"/></a>
+<a href="https://github.com/Azure/agentops/actions/workflows/release.yml"><img alt="Release" src="https://github.com/Azure/agentops/actions/workflows/release.yml/badge.svg"/></a>
+<a href="https://github.com/Azure/agentops/blob/main/LICENSE"><img alt="License: MIT" src="https://img.shields.io/badge/License-MIT-green.svg"/></a>
+</p>
+
+AgentOps Accelerator helps Microsoft Foundry agent teams evaluate quality, prepare releases, monitor behavior, and stay accountable after launch. It gives you a practical starting point for agent operations, with Foundry integration as the default path and deeper setup guidance in the full docs.
+
+## Get started
+
+```powershell
+python -m pip install agentops-accelerator
+agentops init
+agentops eval analyze
+agentops eval run
+agentops doctor --evidence-pack
+```
+
+## What it helps you do
+
+Use AgentOps Accelerator when you need to:
+
+- Evaluate an agent before release
+- Compare changes across versions
+- Capture release evidence
+- Monitor agent quality and regressions
+- Give teams a repeatable way to own agent behavior in production
+
+The accelerator keeps the local workflow simple, then points you to the full
+docs when you are ready to configure pipelines, dashboards, and release
+practices.
+
+## Learn more
+
+For setup guides, tutorials, architecture, CI/CD guidance, Doctor checks, and
+evaluator reference, see:
+
+<p align="center">
+<a href="https://aka.ms/agentops-accelerator"><b>https://aka.ms/agentops-accelerator</b></a>
+</p>
+
+## Contributing
+
+See [CONTRIBUTING.md](CONTRIBUTING.md) for development, testing, and contribution guidance.

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/plugins/agentops/README.md

@@ -46,7 +46,7 @@ skills from the extension/plugin.
 Run this from the repository where you want skills checked in:
 
 ```bash
-python -m pip install "agentops-accelerator[foundry] @ git+https://github.com/Azure/agentops.git@main"
+python -m pip install "agentops-accelerator @ git+https://github.com/Azure/agentops.git@main"
 agentops skills install --platform copilot --force
 ```
 

{agentops_accelerator-0.4.1/src/agentops/templates → agentops_accelerator-0.4.2/plugins/agentops}/skills/agentops-config/SKILL.md

@@ -17,7 +17,7 @@ then return here once there is a `name:version` or URL.
 
 ## Step 0 - Prerequisites
 
-1. `pip install "agentops-accelerator[foundry] @ git+https://github.com/Azure/agentops.git@main"` if `agentops` is missing.
+1. `pip install "agentops-accelerator @ git+https://github.com/Azure/agentops.git@main"` if `agentops` is missing.
 2. Run `agentops eval analyze` first. If it reports missing or ambiguous
    target/dataset/scenario signals, use this skill to adapt the config.
 3. If `agentops.yaml` does not exist, run `agentops init` first. The init

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/plugins/agentops/skills/agentops-eval/SKILL.md

@@ -15,7 +15,7 @@ with a `name:version` or URL.
 
 ## Step 0 - Setup
 
-1. Install if missing: `pip install "agentops-accelerator[foundry] @ git+https://github.com/Azure/agentops.git@main"`.
+1. Install if missing: `pip install "agentops-accelerator @ git+https://github.com/Azure/agentops.git@main"`.
 2. If `agentops.yaml` does not exist at the project root, run `agentops init`.
    The init wizard prompts (azd-style) for the Foundry project endpoint,
    agent reference, and dataset path, persists each answer to

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/pyproject.toml

@@ -13,17 +13,15 @@ dependencies = [
   "pydantic>=2,<3",
   "ruamel.yaml>=0.18,<1.0",
   "azure-ai-projects>=2.0.1,<3.0",
-]
-license = { file = "LICENSE" }
-
-[project.optional-dependencies]
-mcp = ["mcp>=1.0,<2"]
-foundry = [
   "azure-ai-evaluation>=1.0,<2.0",
   "azure-identity>=1.17,<2.0",
   "azure-monitor-opentelemetry>=1.6,<2.0",
   "pandas>=2.0,<4.0",
 ]
+license = { file = "LICENSE" }
+
+[project.optional-dependencies]
+mcp = ["mcp>=1.0,<2"]
 agent = [
   "fastapi>=0.110,<1.0",
   "uvicorn[standard]>=0.30,<1.0",

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/src/agentops/agent/checks/foundry_config.py

@@ -60,7 +60,7 @@ def _no_foundry_control_finding(diag: dict) -> Finding:
         recommendation=(
             "Set `sources.foundry_control.project_endpoint` (or the "
             "`AZURE_AI_FOUNDRY_PROJECT_ENDPOINT` env var) in "
-            "`.agentops/agent.yaml`, install the `[foundry]` extra, "
+            "`.agentops/agent.yaml`, install AgentOps, "
             "and grant the running identity at least `Reader` on the "
             "Foundry project. If this project does not use Foundry, "
             "set `sources.foundry_control.enabled: false` to opt out "

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/src/agentops/agent/sources/foundry_control.py

@@ -91,7 +91,7 @@ def collect_foundry_control(
         diagnostics["status"] = "skipped"
         diagnostics["reason"] = (
             "azure-ai-projects / azure-identity not installed "
-            "(install agentops-accelerator[foundry])"
+            "(install agentops-accelerator)"
         )
         log.info("azure-ai-projects unavailable: %s", exc)
         return FoundryControlPayload(diagnostics=diagnostics)

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/src/agentops/agent/sources/results_history.py

@@ -301,7 +301,7 @@ def _collect_foundry_eval_runs(
         diagnostics["status"] = "skipped"
         diagnostics["reason"] = (
             "azure-ai-projects / azure-identity not installed "
-            "(install agentops-accelerator[foundry])"
+            "(install agentops-accelerator)"
         )
         log.info("Foundry cloud eval history unavailable: %s", exc)
         return [], diagnostics

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/src/agentops/pipeline/prompt_deploy.py

@@ -338,7 +338,7 @@ def _project_client(endpoint: str) -> Any:
     except ImportError as exc:
         raise RuntimeError(
             "prompt-agent deployment requires azure-ai-projects and "
-            "azure-identity; install agentops-accelerator[foundry]"
+            "azure-identity; install agentops-accelerator"
         ) from exc
 
     credential = DefaultAzureCredential(

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/src/agentops/pipeline/runtime.py

@@ -153,7 +153,7 @@ def load_evaluator(preset: EvaluatorPreset) -> EvaluatorRuntime:
         raise RuntimeError(
             "Evaluators require the 'azure-ai-evaluation' package. "
             "Install the Foundry extra in this virtual environment. "
-            "Run: python -m pip install --upgrade 'agentops-accelerator[foundry]'"
+            "Run: python -m pip install agentops-accelerator"
         ) from exc
 
     cls = getattr(module, preset.class_name, None)

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/src/agentops/services/azd_eval_init.py

@@ -1,4 +1,10 @@
-"""Wrapper helpers for ``azd ai agent eval init``."""
+"""Wrapper helpers for ``azd ai agent eval`` recipe generation.
+
+The ``azure.ai.agents`` azd extension renamed this subcommand in 0.1.40:
+``azd ai agent eval init`` became ``azd ai agent eval generate``. These helpers
+prefer the new ``generate`` name and fall back to the legacy ``init`` name so
+AgentOps keeps working across extension versions.
+"""
 
 from __future__ import annotations
 
@@ -62,9 +68,11 @@ def run_azd_eval_init(
     force: bool = False,
     timeout_seconds: float = AZD_EVAL_TIMEOUT_SECONDS,
 ) -> AzdEvalInitResult:
-    """Run ``azd ai agent eval init`` and persist ``eval_recipe``.
+    """Run ``azd ai agent eval generate`` and persist ``eval_recipe``.
 
-    The azd command remains the source of truth for generating datasets,
+    Prefers the ``generate`` subcommand (azure.ai.agents >= 0.1.40) and falls
+    back to the legacy ``init`` subcommand on older extensions. The azd command
+    remains the source of truth for generating datasets,
     evaluators, and rubric assets. AgentOps only delegates the command, finds the
     generated recipe, and records the recipe path in ``agentops.yaml`` so future
     gates are deterministic.
@@ -95,17 +103,18 @@ def run_azd_eval_init(
             f"{AZD_EXTENSION_NAME}`), then rerun `agentops eval init`."
         )
 
-    command = ["azd", "--no-prompt", "ai", "agent", "eval", "init"]
+    base_command = ["azd", "--no-prompt", "ai", "agent", "eval"]
+    arguments: list[str] = []
     project_endpoint = _project_endpoint_from_config_or_env(resolved_config)
     if project_endpoint:
-        command.extend(["--project-endpoint", project_endpoint])
+        arguments.extend(["--project-endpoint", project_endpoint])
     agent_name = _agent_name_from_config(resolved_config)
     if agent_name:
-        command.extend(["--agent", agent_name])
+        arguments.extend(["--agent", agent_name])
     effective_dataset = dataset or _dataset_from_config(resolved_config)
     instruction_file = _prompt_file_from_config(resolved_config)
     if effective_dataset is None and instruction_file is not None:
-        command.extend(
+        arguments.extend(
             [
                 "--gen-instruction-file",
                 _command_path(instruction_file, workspace=root),
@@ -113,47 +122,29 @@ def run_azd_eval_init(
         )
     eval_model = _eval_model_from_config(resolved_config)
     if eval_model:
-        command.extend(["--eval-model", eval_model])
+        arguments.extend(["--eval-model", eval_model])
     if effective_dataset is not None:
         effective_dataset = _azd_dataset_from_agentops_dataset(
             effective_dataset,
             workspace=root,
         )
-        command.extend(
+        arguments.extend(
             ["--dataset", _command_path(effective_dataset, workspace=root)]
         )
         for evaluator in _azd_evaluators_from_config(resolved_config):
-            command.extend(["--evaluator", evaluator])
-
-    try:
-        completed = subprocess.run(
-            command,
-            cwd=str(root),
-            text=True,
-            encoding="utf-8",
-            errors="replace",
-            capture_output=True,
-            timeout=timeout_seconds,
-            check=False,
-        )
-    except FileNotFoundError as exc:
-        raise AzdBackendError(
-            "azd was not found on PATH. Install the Azure Developer CLI and the "
-            f"`{AZD_EXTENSION_NAME}` extension, then rerun `agentops eval init`."
-        ) from exc
-    except subprocess.TimeoutExpired as exc:
-        raise AzdBackendError(
-            f"{' '.join(command)} timed out after {timeout_seconds:g}s."
-        ) from exc
+            arguments.extend(["--evaluator", evaluator])
 
-    if completed.returncode != 0:
-        detail = completed.stderr.strip() or completed.stdout.strip() or f"exit code {completed.returncode}"
-        raise AzdBackendError(f"azd ai agent eval init failed: {detail}")
+    completed = _run_eval_subcommand(
+        base_command,
+        arguments,
+        cwd=root,
+        timeout_seconds=timeout_seconds,
+    )
 
     recipe = find_eval_yaml(root)
     if recipe is None:
         raise AzdBackendError(
-            "azd ai agent eval init completed, but AgentOps could not find the "
+            "azd ai agent eval completed, but AgentOps could not find the "
             "generated eval.yaml. Move it under the workspace root or src/<agent>/ "
             "and set `eval_recipe:` in agentops.yaml."
         )
@@ -175,6 +166,107 @@ def _find_recipe_if_unambiguous(workspace: Path) -> Optional[Path]:
         return None
 
 
+# azd renamed this subcommand in the ``azure.ai.agents`` extension 0.1.40:
+# ``init`` became ``generate``. Try the new name first and fall back to the
+# legacy name so AgentOps works whether the consumer has an old or new
+# extension installed.
+_EVAL_SUBCOMMANDS: tuple[str, ...] = ("generate", "init")
+
+
+def _eval_subcommand_unsupported(*outputs: str) -> bool:
+    """Return True when azd reports the eval subcommand name is unknown/deprecated.
+
+    Matches the azd/cobra-style messages emitted when an installed
+    ``azure.ai.agents`` extension does not recognise a subcommand name (older
+    extensions lack ``generate``) or reports the legacy ``init`` name as
+    deprecated (newer extensions). Centralised here so the fallback decision is
+    unit-testable and robust to minor wording changes.
+    """
+    haystack = " ".join(text.lower() for text in outputs if text)
+    return any(
+        phrase in haystack
+        for phrase in (
+            "unknown command",
+            "unrecognized",
+            "is not a valid",
+            "invalid command",
+            "is deprecated, use",
+        )
+    )
+
+
+def _azd_failure_detail(completed: "subprocess.CompletedProcess[str]") -> str:
+    return (
+        completed.stderr.strip()
+        or completed.stdout.strip()
+        or f"exit code {completed.returncode}"
+    )
+
+
+def _run_eval_subcommand(
+    base_command: list[str],
+    arguments: list[str],
+    *,
+    cwd: Path,
+    timeout_seconds: float,
+) -> "subprocess.CompletedProcess[str]":
+    """Run ``azd ai agent eval <subcommand>`` resiliently across extensions.
+
+    Prefers ``generate`` (azure.ai.agents >= 0.1.40) and falls back to the
+    legacy ``init`` subcommand when the installed extension does not recognise
+    ``generate``. A non-zero result that is not a subcommand-name problem (for
+    example an authentication or endpoint error) is surfaced immediately rather
+    than masked by the fallback, preserving the previous error behaviour.
+    """
+    last_completed: Optional["subprocess.CompletedProcess[str]"] = None
+    for subcommand in _EVAL_SUBCOMMANDS:
+        command = [*base_command, subcommand, *arguments]
+        try:
+            completed = subprocess.run(
+                command,
+                cwd=str(cwd),
+                text=True,
+                encoding="utf-8",
+                errors="replace",
+                capture_output=True,
+                timeout=timeout_seconds,
+                check=False,
+            )
+        except FileNotFoundError as exc:
+            raise AzdBackendError(
+                "azd was not found on PATH. Install the Azure Developer CLI and "
+                f"the `{AZD_EXTENSION_NAME}` extension, then rerun `agentops eval "
+                "init`."
+            ) from exc
+        except subprocess.TimeoutExpired as exc:
+            raise AzdBackendError(
+                f"{' '.join(command)} timed out after {timeout_seconds:g}s."
+            ) from exc
+
+        if completed.returncode == 0:
+            return completed
+
+        if _eval_subcommand_unsupported(completed.stderr, completed.stdout):
+            # This subcommand name is not supported (or is deprecated) by the
+            # installed extension. Remember it and try the next candidate.
+            last_completed = completed
+            continue
+
+        # A real failure (not a subcommand-name issue): surface it now.
+        raise AzdBackendError(
+            f"azd ai agent eval {subcommand} failed: {_azd_failure_detail(completed)}"
+        )
+
+    if last_completed is not None:
+        detail = _azd_failure_detail(last_completed)
+    else:  # pragma: no cover - _EVAL_SUBCOMMANDS is never empty
+        detail = (
+            "no azd eval subcommand (generate/init) was accepted by the "
+            f"installed `{AZD_EXTENSION_NAME}` extension"
+        )
+    raise AzdBackendError(f"azd ai agent eval failed: {detail}")
+
+
 def _dataset_from_config(config_path: Path) -> Optional[Path]:
     data = load_yaml(config_path)
     raw_dataset = data.get("dataset")

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/src/agentops/templates/pipelines/azuredevops/agentops-deploy-dev-azd.yml

@@ -74,7 +74,7 @@ __AILZ_PREFLIGHT_COMMAND__
               versionSpec: "3.11"
           - bash: |
               python -m pip install --upgrade pip
-              python -m pip install "agentops-accelerator[foundry]__AGENTOPS_INSTALL_SPEC__"
+              python -m pip install "agentops-accelerator__AGENTOPS_INSTALL_SPEC__"
             displayName: Install AgentOps Toolkit
 
 __EVAL_TASKS__

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/src/agentops/templates/pipelines/azuredevops/agentops-deploy-dev.yml

@@ -50,7 +50,7 @@ stages:
 
                 - bash: |
                     python -m pip install --upgrade pip
-                    python -m pip install "agentops-accelerator[foundry]__AGENTOPS_INSTALL_SPEC__"
+                    python -m pip install "agentops-accelerator__AGENTOPS_INSTALL_SPEC__"
                   displayName: Install AgentOps Toolkit
 
 __EVAL_TASKS__

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/src/agentops/templates/pipelines/azuredevops/agentops-deploy-prompt-agent.yml

@@ -48,7 +48,7 @@ stages:
               scriptLocation: inlineScript
               inlineScript: |
                 python -m pip install --upgrade pip
-                python -m pip install "agentops-accelerator[foundry]__AGENTOPS_INSTALL_SPEC__"
+                python -m pip install "agentops-accelerator__AGENTOPS_INSTALL_SPEC__"
                 python -m agentops.pipeline.prompt_deploy stage \
                   --config "$(AGENTOPS_CONFIG)" \
                   --environment "$(TARGET_ENVIRONMENT)" \

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/src/agentops/templates/pipelines/azuredevops/agentops-deploy-qa-azd.yml

@@ -74,7 +74,7 @@ __AILZ_PREFLIGHT_COMMAND__
               versionSpec: "3.11"
           - bash: |
               python -m pip install --upgrade pip
-              python -m pip install "agentops-accelerator[foundry]__AGENTOPS_INSTALL_SPEC__"
+              python -m pip install "agentops-accelerator__AGENTOPS_INSTALL_SPEC__"
             displayName: Install AgentOps Toolkit
 
 __EVAL_TASKS__

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/src/agentops/templates/pipelines/azuredevops/agentops-deploy-qa.yml

@@ -46,7 +46,7 @@ stages:
 
                 - bash: |
                     python -m pip install --upgrade pip
-                    python -m pip install "agentops-accelerator[foundry]__AGENTOPS_INSTALL_SPEC__"
+                    python -m pip install "agentops-accelerator__AGENTOPS_INSTALL_SPEC__"
                   displayName: Install AgentOps Toolkit
 
 __EVAL_TASKS__

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/src/agentops/templates/pipelines/azuredevops/agentops-pr-prompt-agent.yml

@@ -73,7 +73,7 @@ stages:
               scriptLocation: inlineScript
               inlineScript: |
                 python -m pip install --upgrade pip
-                python -m pip install "agentops-accelerator[foundry]__AGENTOPS_INSTALL_SPEC__"
+                python -m pip install "agentops-accelerator__AGENTOPS_INSTALL_SPEC__"
                 python -m agentops.pipeline.prompt_deploy stage \
                   --config "$(AGENTOPS_CONFIG)" \
                   --environment "$(TARGET_ENVIRONMENT)" \

{agentops_accelerator-0.4.1/plugins/agentops → agentops_accelerator-0.4.2/src/agentops/templates}/skills/agentops-config/SKILL.md

@@ -17,7 +17,7 @@ then return here once there is a `name:version` or URL.
 
 ## Step 0 - Prerequisites
 
-1. `pip install "agentops-accelerator[foundry] @ git+https://github.com/Azure/agentops.git@main"` if `agentops` is missing.
+1. `pip install "agentops-accelerator @ git+https://github.com/Azure/agentops.git@main"` if `agentops` is missing.
 2. Run `agentops eval analyze` first. If it reports missing or ambiguous
    target/dataset/scenario signals, use this skill to adapt the config.
 3. If `agentops.yaml` does not exist, run `agentops init` first. The init

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/src/agentops/templates/skills/agentops-eval/SKILL.md

@@ -15,7 +15,7 @@ with a `name:version` or URL.
 
 ## Step 0 - Setup
 
-1. Install if missing: `pip install "agentops-accelerator[foundry] @ git+https://github.com/Azure/agentops.git@main"`.
+1. Install if missing: `pip install "agentops-accelerator @ git+https://github.com/Azure/agentops.git@main"`.
 2. If `agentops.yaml` does not exist at the project root, run `agentops init`.
    The init wizard prompts (azd-style) for the Foundry project endpoint,
    agent reference, and dataset path, persists each answer to

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/src/agentops/templates/workflows/agentops-deploy-dev-azd.yml

@@ -114,7 +114,7 @@ __AILZ_PREFLIGHT_COMMAND__
 
       - name: Install AgentOps Toolkit
         run: |
-          uv pip install --system "agentops-accelerator[foundry]__AGENTOPS_INSTALL_SPEC__"
+          uv pip install --system "agentops-accelerator__AGENTOPS_INSTALL_SPEC__"
 
 __EVAL_STEPS__
 

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/src/agentops/templates/workflows/agentops-deploy-dev.yml

@@ -66,7 +66,7 @@ jobs:
 
       - name: Install AgentOps Toolkit
         run: |
-          uv pip install --system "agentops-accelerator[foundry]__AGENTOPS_INSTALL_SPEC__"
+          uv pip install --system "agentops-accelerator__AGENTOPS_INSTALL_SPEC__"
 
 __EVAL_STEPS__
 

{agentops_accelerator-0.4.1 → agentops_accelerator-0.4.2}/src/agentops/templates/workflows/agentops-deploy-prompt-agent.yml

@@ -117,7 +117,7 @@ jobs:
 
       - name: Install AgentOps Toolkit
         run: |
-          uv pip install --system "agentops-accelerator[foundry]__AGENTOPS_INSTALL_SPEC__"
+          uv pip install --system "agentops-accelerator__AGENTOPS_INSTALL_SPEC__"
 
 __EVAL_STEPS__