agentevals-cli 0.14.1__tar.gz → 0.15.1__tar.gz
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/PKG-INFO +2 -2
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/README.md +1 -1
- agentevals_cli-0.15.1/charts/agentevals/Chart.yaml +7 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/charts/agentevals/templates/NOTES.txt +19 -1
- agentevals_cli-0.15.1/charts/agentevals/templates/_helpers.tpl +166 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/charts/agentevals/templates/deployment.yaml +30 -5
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/charts/agentevals/templates/postgresql.yaml +3 -4
- agentevals_cli-0.15.1/charts/agentevals/templates/rbac-tokenreview.yaml +27 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/charts/agentevals/templates/service.yaml +2 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/charts/agentevals/values.yaml +42 -7
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/docs/grpc-api.md +66 -2
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/app.py +1 -1
- agentevals_cli-0.15.1/src/agentevals/api/rpc/auth.py +292 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/rpc/server.py +11 -3
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/cli.py +120 -15
- agentevals_cli-0.15.1/tests/api/test_grpc_auth.py +341 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_cli.py +130 -0
- agentevals_cli-0.14.1/charts/agentevals/Chart.yaml +0 -6
- agentevals_cli-0.14.1/charts/agentevals/templates/_helpers.tpl +0 -90
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/.claude/skills/eval/SKILL.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/.claude/skills/eval/evals/evals.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/.claude/skills/inspect/SKILL.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/.claude/skills/inspect/evals/evals.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/.dockerignore +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/.gitattributes +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/.github/ISSUE_TEMPLATE/bug_report.yml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/.github/ISSUE_TEMPLATE/config.yml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/.github/ISSUE_TEMPLATE/feature_request.yml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/.github/dependabot.yml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/.github/workflows/ci.yml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/.github/workflows/kagent-contract-policy.yml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/.github/workflows/kagent-contract.yml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/.github/workflows/publish-evaluator-sdk.yml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/.github/workflows/release.yml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/.gitignore +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/.mcp.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/CONTRIBUTING.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/DEVELOPMENT.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/Dockerfile +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/LICENSE +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/Makefile +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/charts/agentevals/templates/postgresql-secret.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/charts/agentevals/templates/rbac.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/charts/agentevals/templates/serviceaccount.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/docs/assets/logo-color-on-transparent.svg +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/docs/assets/logo-color.png +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/docs/assets/logo-dark-on-transparent.svg +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/docs/custom-evaluators.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/docs/eval-set-format.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/docs/opentelemetry-pipeline.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/docs/otel-compatibility.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/docs/run-history.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/README.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/custom_evaluators/eval_config.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/custom_evaluators/response_quality.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/custom_evaluators/tool_call_checker.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/custom_sink/README.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/custom_sink/agentevals_example_custom_sink/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/custom_sink/agentevals_example_custom_sink/sink.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/custom_sink/pyproject.toml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/dice_agent/README.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/dice_agent/agent.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/dice_agent/eval_set.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/dice_agent/main.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/dice_agent/test_streaming.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/kubernetes/README.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/kubernetes/agentevals-values.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/kubernetes/agents.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/kubernetes/otel-collector.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/langchain_agent/README.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/langchain_agent/agent.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/langchain_agent/eval_set.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/langchain_agent/main.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/langchain_agent/requirements.txt +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/langchain_agent/test_streaming.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/sdk_example/async_example.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/sdk_example/context_manager_example.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/sdk_example/decorator_example.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/sdk_example/requirements.txt +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/strands_agent/agent.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/strands_agent/eval_set.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/strands_agent/main.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/strands_agent/requirements.txt +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/zero-code-examples/adk/requirements.txt +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/zero-code-examples/adk/run.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/zero-code-examples/langchain/requirements.txt +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/zero-code-examples/langchain/run.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/zero-code-examples/ollama/requirements.txt +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/zero-code-examples/ollama/run.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/zero-code-examples/openai-agents/requirements.txt +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/zero-code-examples/openai-agents/run.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/zero-code-examples/pydantic-ai/requirements.txt +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/zero-code-examples/pydantic-ai/run.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/zero-code-examples/strands/requirements.txt +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/examples/zero-code-examples/strands/run.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/flake.lock +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/flake.nix +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/gen/go/README.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/gen/go/agentevals/api/v1alpha1/common.pb.go +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/gen/go/agentevals/api/v1alpha1/conversion.pb.go +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/gen/go/agentevals/api/v1alpha1/conversion_grpc.pb.go +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/gen/go/agentevals/api/v1alpha1/evaluation.pb.go +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/gen/go/agentevals/api/v1alpha1/evaluation_grpc.pb.go +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/gen/go/agentevals/api/v1alpha1/runs.pb.go +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/gen/go/agentevals/api/v1alpha1/runs_grpc.pb.go +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/gen/go/agentevals/api/v1alpha1/sessions.pb.go +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/gen/go/agentevals/api/v1alpha1/sessions_grpc.pb.go +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/gen/go/agentevals/api/v1alpha1/system.pb.go +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/gen/go/agentevals/api/v1alpha1/system_grpc.pb.go +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/gen/go/agentevals/api/v1alpha1/views.pb.go +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/gen/go/go.mod +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/gen/go/go.sum +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/packages/evaluator-sdk-py/README.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/packages/evaluator-sdk-py/pyproject.toml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/packages/evaluator-sdk-py/src/agentevals_evaluator_sdk/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/packages/evaluator-sdk-py/src/agentevals_evaluator_sdk/decorator.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/packages/evaluator-sdk-py/src/agentevals_evaluator_sdk/types.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/proto/agentevals/api/v1alpha1/common.proto +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/proto/agentevals/api/v1alpha1/conversion.proto +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/proto/agentevals/api/v1alpha1/evaluation.proto +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/proto/agentevals/api/v1alpha1/runs.proto +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/proto/agentevals/api/v1alpha1/sessions.proto +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/proto/agentevals/api/v1alpha1/system.proto +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/proto/agentevals/api/v1alpha1/views.proto +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/proto/buf.gen.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/proto/buf.lock +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/proto/buf.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/pyproject.toml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/samples/eval_set_helm.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/samples/evalset_helm_3_2026-02-23.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/samples/evalset_k8s_2026-02-20.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/samples/helm.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/samples/helm_2.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/samples/helm_3.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/samples/k8s.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/samples/tempo_export_with_batches.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/_protocol.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/_static/assets/index-BqibLiHO.css +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/_static/assets/index-vXShTu9I.js +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/_static/index.html +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/_static/logo.svg +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/_static/vite.svg +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/adk_bridge.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/debug_routes.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/dependencies.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/evaluation.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/models.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/otlp_app.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/otlp_grpc.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/otlp_http.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/otlp_processing.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/otlp_routes.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/redact.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/routes.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/rpc/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/rpc/convert.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/rpc/policy.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/rpc/services.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/runs_routes.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/streaming_routes.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/common_pb2.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/common_pb2.pyi +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/common_pb2_grpc.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/conversion_pb2.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/conversion_pb2.pyi +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/conversion_pb2_grpc.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/evaluation_pb2.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/evaluation_pb2.pyi +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/evaluation_pb2_grpc.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/runs_pb2.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/runs_pb2.pyi +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/runs_pb2_grpc.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/sessions_pb2.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/sessions_pb2.pyi +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/sessions_pb2_grpc.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/system_pb2.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/system_pb2.pyi +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/system_pb2_grpc.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/views_pb2.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/views_pb2.pyi +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/v1alpha1/views_pb2_grpc.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/api/views.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/builtin_metrics.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/config.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/custom_evaluators.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/eval_config_loader.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/evaluation_events.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/evaluator/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/evaluator/resolver.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/evaluator/sources.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/evaluator/templates.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/evaluator/venv.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/genai/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/genai/extract.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/genai/grouping.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/genai/matching.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/genai/messages.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/genai/model.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/genai/overlay.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/genai/routing.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/genai/semconv.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/judges.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/loader/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/loader/auto.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/loader/jaeger.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/loader/otlp.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/mcp_server.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/otel/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/otel/decode.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/otel/encode.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/otel/identity.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/otel/model.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/otel/sdk_export.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/otel/store.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/output.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/resolvers/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/resolvers/kubernetes.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/run/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/run/fetcher.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/run/result_builder.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/run/service.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/run/sinks.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/run/worker.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/runner.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/sdk.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/storage/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/storage/config.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/storage/models.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/storage/postgres/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/storage/postgres/migrations/000001_init.down.sql +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/storage/postgres/migrations/000001_init.up.sql +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/storage/postgres/migrations/000002_drop_openai_eval.down.sql +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/storage/postgres/migrations/000002_drop_openai_eval.up.sql +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/storage/postgres/migrator.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/storage/postgres/pool.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/storage/repos/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/storage/repos/memory.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/storage/repos/postgres.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/streaming/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/streaming/exports.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/streaming/manager.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/streaming/session.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/telemetry.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/trace_metrics.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/utils/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/src/agentevals/utils/log_buffer.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/api/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/api/test_api_tracing.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/api/test_evaluate_persistence.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/api/test_grpc_api.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/api/test_live_routes.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/api/test_redact.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/api/test_rpc_convert.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/api/test_runs_routes.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/api/test_views.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/README.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/check.sh +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/policy/agentevals.rego +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/registries/main-2cc3ffae/a2a.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/registries/main-2cc3ffae/imports.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/registries/main-2cc3ffae/kagent.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/registries/main-2cc3ffae/manifest.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/registries/main-2cc3ffae/signals.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/registries/pr3121-412ef54e/a2a.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/registries/pr3121-412ef54e/imports.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/registries/pr3121-412ef54e/kagent.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/registries/pr3121-412ef54e/manifest.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/registries/pr3121-412ef54e/signals.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/registries/v1.0.0-alpha9/a2a.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/registries/v1.0.0-alpha9/kagent.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/registries/v1.0.0-alpha9/manifest.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/registries/v1.0.0-alpha9/signals.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/test.sh +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/testdata/agentevals_contract_gone/manifest.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/testdata/agentevals_contract_gone/model.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/testdata/agentevals_contract_missing_attribute/manifest.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/testdata/agentevals_contract_missing_attribute/model.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/testdata/agentevals_contract_requirement_floor/manifest.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/testdata/agentevals_contract_requirement_floor/model.yaml +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/contract/kagent/weaver.sh +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/MANIFEST.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default/S1.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default/S1.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default/S2.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default/S2.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default/S3.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default/S3.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default/S4a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default/S4a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default/S4b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default/S4b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default/S5.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default/S5.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default/S6a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default/S6a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default/S6b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default/S6b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default_contrib/S1.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default_contrib/S1.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default_contrib/S2.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default_contrib/S2.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default_contrib/S3.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default_contrib/S3.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default_contrib/S4a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default_contrib/S4a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default_contrib/S4b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default_contrib/S4b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default_contrib/S5.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default_contrib/S5.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default_contrib/S6a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default_contrib/S6a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default_contrib/S6b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_default_contrib/S6b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable/S1.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable/S1.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable/S2.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable/S2.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable/S3.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable/S3.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable/S4a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable/S4a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable/S4b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable/S4b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable/S5.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable/S5.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable/S6a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable/S6a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable/S6b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable/S6b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S1.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S1.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S2.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S2.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S3.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S3.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S4a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S4a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S4b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S4b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S5.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S5.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S6a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S6a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S6b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S6b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_nolegacy/S1.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_nolegacy/S1.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_nolegacy/S2.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_nolegacy/S2.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_nolegacy/S3.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_nolegacy/S3.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_nolegacy/S4a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_nolegacy/S4a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_nolegacy/S4b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_nolegacy/S4b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_nolegacy/S5.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_nolegacy/S5.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_nolegacy/S6a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_nolegacy/S6a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_nolegacy/S6b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v1_nolegacy/S6b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_default/S1.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_default/S1.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_default/S2.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_default/S2.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_default/S3.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_default/S3.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_default/S4a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_default/S4a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_default/S4b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_default/S4b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_default/S5.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_default/S5.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_default/S6a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_default/S6a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_default/S6b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_default/S6b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only/S1.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only/S1.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only/S2.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only/S2.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only/S3.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only/S3.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only/S4a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only/S4a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only/S4b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only/S4b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only/S5.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only/S5.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only/S6a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only/S6a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only/S6b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only/S6b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S1.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S1.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S2.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S2.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S3.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S3.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S4a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S4a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S4b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S4b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S5.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S5.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S6a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S6a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S6b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S6b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_no_content/S1.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_no_content/S1.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_no_content/S2.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_no_content/S2.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_no_content/S3.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_no_content/S3.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_no_content/S4a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_no_content/S4a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_no_content/S4b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_no_content/S4b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_no_content/S5.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_no_content/S5.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_no_content/S6a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_no_content/S6a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_no_content/S6b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_no_content/S6b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_and_event/S1.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_and_event/S1.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_and_event/S2.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_and_event/S2.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_and_event/S3.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_and_event/S3.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_and_event/S4a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_and_event/S4a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_and_event/S4b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_and_event/S4b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_and_event/S5.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_and_event/S5.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_and_event/S6a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_and_event/S6a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_and_event/S6b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_and_event/S6b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only/S1.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only/S1.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only/S2.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only/S2.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only/S3.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only/S3.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only/S4a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only/S4a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only/S4b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only/S4b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only/S5.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only/S5.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only/S6a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only/S6a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only/S6b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only/S6b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S1.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S1.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S2.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S2.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S3.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S3.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S4a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S4a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S4b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S4b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S5.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S5.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S6a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S6a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S6b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S6b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S1.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S1.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S2.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S2.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S3.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S3.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S4a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S4a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S4b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S4b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S5.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S5.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S6a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S6a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S6b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S6b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_event_only/S1.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_event_only/S1.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_event_only/S2.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_event_only/S2.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_event_only/S3.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_event_only/S3.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_event_only/S4a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_event_only/S4a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_event_only/S4b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_event_only/S4b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_event_only/S5.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_event_only/S5.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_event_only/S6a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_event_only/S6a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_event_only/S6b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_event_only/S6b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_no_content/S1.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_no_content/S1.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_no_content/S2.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_no_content/S2.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_no_content/S3.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_no_content/S3.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_no_content/S4a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_no_content/S4a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_no_content/S4b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_no_content/S4b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_no_content/S5.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_no_content/S5.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_no_content/S6a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_no_content/S6a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_no_content/S6b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_no_content/S6b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only/S1.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only/S1.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only/S2.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only/S2.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only/S3.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only/S3.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only/S4a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only/S4a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only/S4b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only/S4b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only/S5.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only/S5.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only/S6a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only/S6a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only/S6b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only/S6b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S1.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S1.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S2.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S2.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S3.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S3.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S4a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S4a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S4b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S4b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S5.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S5.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S6a.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S6a.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S6b.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S6b.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/adk_cycle_poisons_batch.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/adk_cycle_poisons_batch.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/adk_go_main.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/adk_go_main.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/content_capture_off.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/content_capture_off.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/deprecated_aliases.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/deprecated_aliases.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/details_event_log_debug.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/details_event_log_debug.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/duplicate_span_ids.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/duplicate_span_ids.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/ext_eval_eventName.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/ext_eval_eventName.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/ext_eval_event_name_attr.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/ext_eval_event_name_attr.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/ext_eval_otel_event_name.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/ext_eval_otel_event_name.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/ext_eval_span_event.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/ext_eval_span_event.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/failed_inference_then_retry.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/failed_inference_then_retry.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/mcp_tool_call.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/mcp_tool_call.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/openai_agents_handoff.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/openai_agents_handoff.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/openai_v2_logs_no_span_id_ambiguous.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/openai_v2_logs_no_span_id_ambiguous.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/openai_v2_logs_no_span_id_single.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/openai_v2_logs_no_span_id_single.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/openai_v2_logs_span_id.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/openai_v2_logs_span_id.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/remote_parent_root.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/remote_parent_root.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/self_parent.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/self_parent.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/strands_span_events.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/strands_span_events.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/three_trace_conversation.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/three_trace_conversation.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/tool_error_no_error_type.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/tool_error_no_error_type.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/two_span_cycle.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/two_span_cycle.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/upstream_new_parts.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/upstream_new_parts.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/util_genai_openai_tool_loop.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/hand/util_genai_openai_tool_loop.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/README.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/adk_go_1turn.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/adk_go_1turn.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/adk_go_2turn.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/adk_go_2turn.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/claude_native_1turn_subagent.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/claude_native_1turn_subagent.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/claude_native_2turn.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/claude_native_2turn.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/claude_recipe_2turn.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/claude_recipe_2turn.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/samples/helm.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/samples/helm.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/samples/helm_2.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/samples/helm_2.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/samples/helm_3.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/samples/helm_3.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/samples/k8s.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/samples/k8s.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/samples/tempo_export_with_batches.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/fixtures/otlp/samples/tempo_export_with_batches.truth.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/genai/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/genai/test_continuations.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/genai/test_corpus.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/genai/test_failed_turns.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/genai/test_grouping.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/genai/test_legacy_chat.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/genai/test_resumed_turns.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/genai/test_tools.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/integration/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/integration/conftest.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/integration/test_evaluation_pipeline.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/integration/test_live_agents.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/integration/test_otlp_grpc_receiver.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/integration/test_session_grouping.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/integration/test_timing_stress.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/otel/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/otel/builders.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/otel/test_emit.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/otel/test_own_spans.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/otel/test_store.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/resolvers/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/resolvers/test_kubernetes.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/resolvers/test_registry.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/run/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/run/test_fetcher.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/run/test_result_builder.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/run/test_service.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/run/test_sinks.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/storage/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/storage/test_config.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/storage/test_memory_repos.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/storage/test_migrator.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/storage/test_models.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/storage/test_postgres_repos.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/streaming/__init__.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/streaming/test_live.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/streaming/test_session_export.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/streaming/test_watchers.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_adk_bridge.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_api.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_builtin_metrics.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_credential_injection.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_efficiency_metrics.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_eval_config_loader.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_invocation_owners.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_jaeger_loader.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_layering.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_loader_auto.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_mcp_server.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_otlp_http_protocol.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_otlp_loader.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_otlp_receiver.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_output.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_protocol.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_rubrics.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_runner.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_sdk.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/tests/test_trace_metrics.py +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/.gitignore +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/README.md +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/eslint.config.js +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/index.html +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/package-lock.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/package.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/public/logo.svg +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/public/vite.svg +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/App.css +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/App.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/api/client.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/assets/react.svg +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/annotation-queue/AnnotationDetailPanel.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/annotation-queue/AnnotationQueueView.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/annotation-queue/AnnotationTable.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/bug-report/BugReportModal.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/builder/BuilderHeader.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/builder/BuilderView.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/builder/EvalCaseCard.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/builder/EvalCasesList.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/builder/InvocationEditor.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/builder/JsonPreview.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/builder/MetadataEditor.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/builder/TraceUploadZone.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/builder/index.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/dashboard/DashboardView.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/dashboard/MetricScoreCard.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/dashboard/PerformanceCard.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/dashboard/PerformanceCharts.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/dashboard/SummaryStats.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/dashboard/TraceCard.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/dashboard/TraceTable.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/inspector/ComparisonPanel.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/inspector/DataSection.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/inspector/InspectorHeader.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/inspector/InspectorLayout.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/inspector/InspectorView.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/inspector/InvocationCard.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/inspector/InvocationSummaryPanel.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/inspector/MetricResultsSection.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/inspector/MetricsComparisonSection.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/inspector/PerformanceSection.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/inspector/ToolCallList.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/inspector/TrajectoryComparisonDetails.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/runs/PassRateTrendChart.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/runs/PerMetricTrendChart.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/runs/RunDetailView.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/runs/RunsHistoryTable.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/runs/RunsView.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/runs/runHistory.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/sidebar/Sidebar.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/streaming/LiveConversationPanel.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/streaming/LiveMessage.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/streaming/LiveStreamingView.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/streaming/SessionCard.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/streaming/SessionMetadata.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/upload/EvalSetEditorDrawer.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/upload/FileDropZone.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/upload/MetricSelector.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/upload/RawJsonPreview.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/upload/TraceEditorDrawer.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/upload/UploadView.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/components/welcome/WelcomeView.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/config.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/context/TraceContext.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/context/TraceProvider.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/agentevals/api/v1alpha1/common_pb.d.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/agentevals/api/v1alpha1/common_pb.js +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/agentevals/api/v1alpha1/conversion_pb.d.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/agentevals/api/v1alpha1/conversion_pb.js +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/agentevals/api/v1alpha1/evaluation_pb.d.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/agentevals/api/v1alpha1/evaluation_pb.js +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/agentevals/api/v1alpha1/runs_pb.d.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/agentevals/api/v1alpha1/runs_pb.js +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/agentevals/api/v1alpha1/sessions_pb.d.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/agentevals/api/v1alpha1/sessions_pb.js +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/agentevals/api/v1alpha1/system_pb.d.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/agentevals/api/v1alpha1/system_pb.js +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/agentevals/api/v1alpha1/views_pb.d.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/agentevals/api/v1alpha1/views_pb.js +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/opentelemetry/proto/common/v1/common_pb.d.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/opentelemetry/proto/common/v1/common_pb.js +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/opentelemetry/proto/logs/v1/logs_pb.d.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/opentelemetry/proto/logs/v1/logs_pb.js +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/opentelemetry/proto/resource/v1/resource_pb.d.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/opentelemetry/proto/resource/v1/resource_pb.js +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/opentelemetry/proto/trace/v1/trace_pb.d.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/generated/opentelemetry/proto/trace/v1/trace_pb.js +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/index.css +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/lib/console-capture.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/lib/eval-config.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/lib/evalset-builder.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/lib/liveSessions.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/lib/network-capture.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/lib/toolPairing.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/lib/trace-helpers.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/lib/trace-loader.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/lib/trace-metadata.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/lib/trace-patcher.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/lib/types.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/lib/utils.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/src/main.tsx +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/tsconfig.app.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/tsconfig.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/tsconfig.node.json +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/ui/vite.config.ts +0 -0
- {agentevals_cli-0.14.1 → agentevals_cli-0.15.1}/uv.lock +0 -0
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Metadata-Version: 2.5
|
|
2
2
|
Name: agentevals-cli
|
|
3
|
-
Version: 0.
|
|
3
|
+
Version: 0.15.1
|
|
4
4
|
Summary: Standalone framework to evaluate agent correctness based on portable OpenTelemetry traces
|
|
5
5
|
License-File: LICENSE
|
|
6
6
|
Requires-Python: >=3.11
|
|
@@ -260,7 +260,7 @@ docker run -p 8001:8001 -p 8002:8002 -p 4317:4317 -p 4318:4318 agentevals
|
|
|
260
260
|
helm install agentevals oci://ghcr.io/agentevals-dev/agentevals/helm/agentevals
|
|
261
261
|
```
|
|
262
262
|
|
|
263
|
-
The chart runs in memory by default. `--set storage.backend=postgres` with a bundled or external Postgres enables the async `/api/runs` pipeline and the Run History view. That storage layer is a preview and its schema may change between minor versions. See [Run History](docs/run-history.md) and the [Kubernetes example](examples/kubernetes/README.md) for a full walkthrough with kagent and an OpenTelemetry Collector.
|
|
263
|
+
The chart runs in memory by default. A parent chart can redirect every image with `global.imageRegistry` and add pull secrets with `global.imagePullSecrets`. `--set storage.backend=postgres` with a bundled or external Postgres enables the async `/api/runs` pipeline and the Run History view. That storage layer is a preview and its schema may change between minor versions. See [Run History](docs/run-history.md) and the [Kubernetes example](examples/kubernetes/README.md) for a full walkthrough with kagent and an OpenTelemetry Collector.
|
|
264
264
|
|
|
265
265
|
## Examples
|
|
266
266
|
|
|
@@ -213,7 +213,7 @@ docker run -p 8001:8001 -p 8002:8002 -p 4317:4317 -p 4318:4318 agentevals
|
|
|
213
213
|
helm install agentevals oci://ghcr.io/agentevals-dev/agentevals/helm/agentevals
|
|
214
214
|
```
|
|
215
215
|
|
|
216
|
-
The chart runs in memory by default. `--set storage.backend=postgres` with a bundled or external Postgres enables the async `/api/runs` pipeline and the Run History view. That storage layer is a preview and its schema may change between minor versions. See [Run History](docs/run-history.md) and the [Kubernetes example](examples/kubernetes/README.md) for a full walkthrough with kagent and an OpenTelemetry Collector.
|
|
216
|
+
The chart runs in memory by default. A parent chart can redirect every image with `global.imageRegistry` and add pull secrets with `global.imagePullSecrets`. `--set storage.backend=postgres` with a bundled or external Postgres enables the async `/api/runs` pipeline and the Run History view. That storage layer is a preview and its schema may change between minor versions. See [Run History](docs/run-history.md) and the [Kubernetes example](examples/kubernetes/README.md) for a full walkthrough with kagent and an OpenTelemetry Collector.
|
|
217
217
|
|
|
218
218
|
## Examples
|
|
219
219
|
|
|
@@ -0,0 +1,7 @@
|
|
|
1
|
+
apiVersion: v2
|
|
2
|
+
name: agentevals
|
|
3
|
+
description: agentevals web UI, gRPC API, OTLP HTTP+gRPC receivers, and MCP (Streamable HTTP)
|
|
4
|
+
type: application
|
|
5
|
+
# The release workflow sets version and appVersion to the release tag when it publishes the chart.
|
|
6
|
+
version: 0.15.0
|
|
7
|
+
appVersion: "0.15.0"
|
|
@@ -1,3 +1,6 @@
|
|
|
1
|
+
{{- if .Values.grpcApi.only }}
|
|
2
|
+
1. gRPC API (agentevals.api.v1alpha1): port {{ .Values.service.grpcApi.port }} (Service port name: grpc-api). It is the only port on the pod network; the web UI, REST API, OTLP receivers and MCP listen on 127.0.0.1 inside the pod.
|
|
3
|
+
{{- else }}
|
|
1
4
|
1. UI and API are available at port {{ .Values.service.http.port }} (Service port name: http).
|
|
2
5
|
2. OTLP HTTP receiver: port {{ .Values.service.otlpHttp.port }} (OTEL_EXPORTER_OTLP_ENDPOINT=http://<service>:{{ .Values.service.otlpHttp.port }}).
|
|
3
6
|
3. OTLP gRPC receiver: port {{ .Values.service.otlpGrpc.port }} (OTEL_EXPORTER_OTLP_ENDPOINT=<service>:{{ .Values.service.otlpGrpc.port }}, OTEL_EXPORTER_OTLP_PROTOCOL=grpc).
|
|
@@ -5,15 +8,30 @@
|
|
|
5
8
|
{{- if .Values.grpcApi.enabled }}
|
|
6
9
|
5. gRPC API (agentevals.api.v1alpha1): port {{ .Values.service.grpcApi.port }} (Service port name: grpc-api). Expose it only to trusted callers.
|
|
7
10
|
{{- end }}
|
|
11
|
+
{{- end }}
|
|
8
12
|
{{- if .Values.ephemeralVolume.enabled }}
|
|
9
|
-
{{ ternary 6 5 .Values.grpcApi.enabled }}. An emptyDir is mounted at /tmp with HOME=/tmp/agentevals-home (ephemeral; lost on pod restart). Set ephemeralVolume.enabled=false and readOnlyRootFilesystem=false if you need a writable root without this mount.
|
|
13
|
+
{{ if .Values.grpcApi.only }}2{{ else }}{{ ternary 6 5 .Values.grpcApi.enabled }}{{ end }}. An emptyDir is mounted at /tmp with HOME=/tmp/agentevals-home (ephemeral; lost on pod restart). Set ephemeralVolume.enabled=false and readOnlyRootFilesystem=false if you need a writable root without this mount.
|
|
14
|
+
{{- end }}
|
|
15
|
+
{{- if .Values.grpcApi.auth.enabled }}
|
|
16
|
+
|
|
17
|
+
gRPC API callers send a ServiceAccount token for audience "{{ .Values.grpcApi.auth.audience }}" as "authorization: Bearer <token>" metadata.
|
|
18
|
+
Allowed ServiceAccounts: {{ include "agentevals.allowedServiceAccounts" . | fromJsonArray | join ", " }}. Health checks need no token.
|
|
19
|
+
{{- if not .Values.grpcApi.only }}
|
|
20
|
+
WARNING: authentication covers only the gRPC API. The UI, REST API, OTLP receivers and MCP stay unauthenticated; set grpcApi.only=true to keep them on 127.0.0.1.
|
|
21
|
+
{{- end }}
|
|
10
22
|
{{- end }}
|
|
11
23
|
|
|
12
24
|
Get the Service URL:
|
|
13
25
|
export POD_NAME=$(kubectl get pods --namespace {{ include "agentevals.namespace" . }} -l "app.kubernetes.io/name={{ include "agentevals.name" . }},app.kubernetes.io/instance={{ .Release.Name }}" -o jsonpath="{.items[0].metadata.name}")
|
|
14
26
|
kubectl --namespace {{ include "agentevals.namespace" . }} port-forward $POD_NAME {{ .Values.service.http.port }}:{{ .Values.service.http.port }}
|
|
15
27
|
|
|
28
|
+
{{- if .Values.grpcApi.only }}
|
|
29
|
+
|
|
30
|
+
Health check: grpc.health.v1 on <pod-ip>:{{ .Values.service.grpcApi.containerPort }}
|
|
31
|
+
{{- else }}
|
|
32
|
+
|
|
16
33
|
Health check: GET http://<pod-ip>:{{ .Values.service.http.containerPort }}/api/health
|
|
34
|
+
{{- end }}
|
|
17
35
|
|
|
18
36
|
{{- if eq .Values.storage.backend "postgres" }}
|
|
19
37
|
|
|
@@ -0,0 +1,166 @@
|
|
|
1
|
+
{{- define "agentevals.name" -}}
|
|
2
|
+
{{- default .Chart.Name .Values.nameOverride | trunc 63 | trimSuffix "-" }}
|
|
3
|
+
{{- end }}
|
|
4
|
+
|
|
5
|
+
{{- define "agentevals.fullname" -}}
|
|
6
|
+
{{- if .Values.fullnameOverride }}
|
|
7
|
+
{{- .Values.fullnameOverride | trunc 63 | trimSuffix "-" }}
|
|
8
|
+
{{- else }}
|
|
9
|
+
{{- $name := default .Chart.Name .Values.nameOverride }}
|
|
10
|
+
{{- if contains $name .Release.Name }}
|
|
11
|
+
{{- .Release.Name | trunc 63 | trimSuffix "-" }}
|
|
12
|
+
{{- else }}
|
|
13
|
+
{{- printf "%s-%s" .Release.Name $name | trunc 63 | trimSuffix "-" }}
|
|
14
|
+
{{- end }}
|
|
15
|
+
{{- end }}
|
|
16
|
+
{{- end }}
|
|
17
|
+
|
|
18
|
+
{{- define "agentevals.namespace" -}}
|
|
19
|
+
{{- default .Release.Namespace .Values.namespaceOverride }}
|
|
20
|
+
{{- end }}
|
|
21
|
+
|
|
22
|
+
{{- define "agentevals.chart" -}}
|
|
23
|
+
{{- printf "%s-%s" .Chart.Name .Chart.Version | replace "+" "_" | trunc 63 | trimSuffix "-" }}
|
|
24
|
+
{{- end }}
|
|
25
|
+
|
|
26
|
+
{{- define "agentevals.image" -}}
|
|
27
|
+
{{- $registry := (.Values.global | default dict).imageRegistry | default .Values.image.registry | default .Values.registry -}}
|
|
28
|
+
{{- $tag := .Values.image.tag | default .Values.tag | default .Chart.AppVersion -}}
|
|
29
|
+
{{- $ref := printf "%s:%s" .Values.image.repository $tag -}}
|
|
30
|
+
{{- if .Values.image.digest -}}
|
|
31
|
+
{{- $ref = printf "%s@%s" .Values.image.repository .Values.image.digest -}}
|
|
32
|
+
{{- end -}}
|
|
33
|
+
{{- if $registry -}}
|
|
34
|
+
{{- printf "%s/%s" $registry $ref -}}
|
|
35
|
+
{{- else -}}
|
|
36
|
+
{{- $ref -}}
|
|
37
|
+
{{- end -}}
|
|
38
|
+
{{- end }}
|
|
39
|
+
|
|
40
|
+
{{- define "agentevals.labels" -}}
|
|
41
|
+
helm.sh/chart: {{ include "agentevals.chart" . }}
|
|
42
|
+
{{ include "agentevals.selectorLabels" . }}
|
|
43
|
+
{{- if .Chart.AppVersion }}
|
|
44
|
+
app.kubernetes.io/version: {{ .Chart.AppVersion | quote }}
|
|
45
|
+
{{- end }}
|
|
46
|
+
app.kubernetes.io/managed-by: {{ .Release.Service }}
|
|
47
|
+
app.kubernetes.io/part-of: agentevals
|
|
48
|
+
{{- end }}
|
|
49
|
+
|
|
50
|
+
{{- define "agentevals.selectorLabels" -}}
|
|
51
|
+
app.kubernetes.io/name: {{ include "agentevals.name" . }}
|
|
52
|
+
app.kubernetes.io/instance: {{ .Release.Name }}
|
|
53
|
+
{{- end }}
|
|
54
|
+
|
|
55
|
+
{{- /*
|
|
56
|
+
Selector labels scoped to the main app Pod and its Service. Carries the
|
|
57
|
+
``app.kubernetes.io/component: agentevals`` discriminator so the agentevals
|
|
58
|
+
Service does not also match the bundled Postgres Pod (which carries
|
|
59
|
+
``app.kubernetes.io/component: database`` instead).
|
|
60
|
+
*/ -}}
|
|
61
|
+
{{- define "agentevals.app.selectorLabels" -}}
|
|
62
|
+
{{ include "agentevals.selectorLabels" . }}
|
|
63
|
+
app.kubernetes.io/component: agentevals
|
|
64
|
+
{{- end }}
|
|
65
|
+
|
|
66
|
+
{{- define "agentevals.serviceAccountName" -}}
|
|
67
|
+
{{- if .Values.serviceAccount.create }}
|
|
68
|
+
{{- default (include "agentevals.fullname" .) .Values.serviceAccount.name }}
|
|
69
|
+
{{- else }}
|
|
70
|
+
{{- default "default" .Values.serviceAccount.name }}
|
|
71
|
+
{{- end }}
|
|
72
|
+
{{- end }}
|
|
73
|
+
|
|
74
|
+
{{/*
|
|
75
|
+
Service name for the bundled Postgres instance.
|
|
76
|
+
*/}}
|
|
77
|
+
{{- define "agentevals.postgresqlServiceName" -}}
|
|
78
|
+
{{- printf "%s-postgresql" (include "agentevals.fullname" .) -}}
|
|
79
|
+
{{- end -}}
|
|
80
|
+
|
|
81
|
+
{{/*
|
|
82
|
+
Bundled Postgres image reference (registry/repository/name:tag).
|
|
83
|
+
*/}}
|
|
84
|
+
{{- define "agentevals.postgresql.image" -}}
|
|
85
|
+
{{- $pg := .Values.database.postgres.bundled -}}
|
|
86
|
+
{{- $registry := (.Values.global | default dict).imageRegistry | default $pg.image.registry -}}
|
|
87
|
+
{{- printf "%s/%s/%s:%s" $registry $pg.image.repository $pg.image.name $pg.image.tag -}}
|
|
88
|
+
{{- end -}}
|
|
89
|
+
|
|
90
|
+
{{/*
|
|
91
|
+
imagePullSecrets for every pod: imagePullSecrets merged (union) with global.imagePullSecrets.
|
|
92
|
+
*/}}
|
|
93
|
+
{{- define "agentevals.imagePullSecrets" -}}
|
|
94
|
+
{{- with concat (.Values.imagePullSecrets | default list) ((.Values.global | default dict).imagePullSecrets | default list) | uniq -}}
|
|
95
|
+
imagePullSecrets:
|
|
96
|
+
{{- toYaml . | nindent 2 }}
|
|
97
|
+
{{- end -}}
|
|
98
|
+
{{- end -}}
|
|
99
|
+
|
|
100
|
+
{{/*
|
|
101
|
+
imagePullPolicy for a container: its own value, then imagePullPolicy, then global.imagePullPolicy,
|
|
102
|
+
then IfNotPresent.
|
|
103
|
+
Usage: {{ include "agentevals.imagePullPolicy" (dict "root" $ "local" .Values.image.pullPolicy) }}
|
|
104
|
+
*/}}
|
|
105
|
+
{{- define "agentevals.imagePullPolicy" -}}
|
|
106
|
+
{{- .local | default .root.Values.imagePullPolicy | default ((.root.Values.global | default dict).imagePullPolicy) | default "IfNotPresent" -}}
|
|
107
|
+
{{- end -}}
|
|
108
|
+
|
|
109
|
+
{{/*
|
|
110
|
+
ClusterRole and ClusterRoleBinding name for TokenReviews; cluster scoped, so it carries the namespace.
|
|
111
|
+
*/}}
|
|
112
|
+
{{- define "agentevals.tokenReviewName" -}}
|
|
113
|
+
{{- printf "%s-%s-tokenreview" (include "agentevals.namespace" .) (include "agentevals.fullname" .) -}}
|
|
114
|
+
{{- end -}}
|
|
115
|
+
|
|
116
|
+
{{/*
|
|
117
|
+
grpcApi.auth.allowedServiceAccounts as a JSON list, each entry rendered with tpl, so a parent chart
|
|
118
|
+
can name its own namespace and release in an entry.
|
|
119
|
+
*/}}
|
|
120
|
+
{{- define "agentevals.allowedServiceAccounts" -}}
|
|
121
|
+
{{- $rendered := list -}}
|
|
122
|
+
{{- range .Values.grpcApi.auth.allowedServiceAccounts -}}
|
|
123
|
+
{{- $rendered = append $rendered (tpl (toString .) $ | trim) -}}
|
|
124
|
+
{{- end -}}
|
|
125
|
+
{{- toJson $rendered -}}
|
|
126
|
+
{{- end -}}
|
|
127
|
+
|
|
128
|
+
{{/*
|
|
129
|
+
Fail the render on a gRPC API setup the server would refuse, or one that grants the TokenReview
|
|
130
|
+
permission to the namespace's default ServiceAccount.
|
|
131
|
+
*/}}
|
|
132
|
+
{{- define "agentevals.validateGrpcApi" -}}
|
|
133
|
+
{{- $api := .Values.grpcApi -}}
|
|
134
|
+
{{- if and $api.only (not $api.enabled) -}}
|
|
135
|
+
{{- fail "grpcApi.only needs grpcApi.enabled=true" -}}
|
|
136
|
+
{{- end -}}
|
|
137
|
+
{{- if $api.auth.enabled -}}
|
|
138
|
+
{{- if not $api.enabled -}}
|
|
139
|
+
{{- fail "grpcApi.auth.enabled needs grpcApi.enabled=true" -}}
|
|
140
|
+
{{- end -}}
|
|
141
|
+
{{- if empty $api.auth.audience -}}
|
|
142
|
+
{{- fail "grpcApi.auth.enabled needs grpcApi.auth.audience" -}}
|
|
143
|
+
{{- end -}}
|
|
144
|
+
{{- if empty $api.auth.allowedServiceAccounts -}}
|
|
145
|
+
{{- fail "grpcApi.auth.enabled needs grpcApi.auth.allowedServiceAccounts (namespace/name): any pod can mint a token for any audience, so the audience alone authorizes nothing" -}}
|
|
146
|
+
{{- end -}}
|
|
147
|
+
{{- range include "agentevals.allowedServiceAccounts" . | fromJsonArray -}}
|
|
148
|
+
{{- if not (regexMatch "^[a-z0-9]([-a-z0-9]{0,61}[a-z0-9])?/[a-z0-9]([-a-z0-9.]{0,251}[a-z0-9])?$" .) -}}
|
|
149
|
+
{{- fail (printf "grpcApi.auth.allowedServiceAccounts: %q is not namespace/name" .) -}}
|
|
150
|
+
{{- end -}}
|
|
151
|
+
{{- end -}}
|
|
152
|
+
{{- if and (not .Values.serviceAccount.create) (empty .Values.serviceAccount.name) -}}
|
|
153
|
+
{{- fail "grpcApi.auth.enabled needs serviceAccount.create=true or serviceAccount.name, so the TokenReview permission does not go to the namespace's default ServiceAccount" -}}
|
|
154
|
+
{{- end -}}
|
|
155
|
+
{{- if and .Values.serviceAccount.create (not .Values.serviceAccount.automount) -}}
|
|
156
|
+
{{- fail "grpcApi.auth.enabled needs serviceAccount.automount=true: the server calls the TokenReview API with its ServiceAccount token" -}}
|
|
157
|
+
{{- end -}}
|
|
158
|
+
{{- end -}}
|
|
159
|
+
{{- end -}}
|
|
160
|
+
|
|
161
|
+
{{/*
|
|
162
|
+
Secret name holding POSTGRES_PASSWORD for the bundled Postgres instance.
|
|
163
|
+
*/}}
|
|
164
|
+
{{- define "agentevals.passwordSecretName" -}}
|
|
165
|
+
{{- printf "%s-postgresql" (include "agentevals.fullname" .) -}}
|
|
166
|
+
{{- end -}}
|
|
@@ -1,3 +1,4 @@
|
|
|
1
|
+
{{- include "agentevals.validateGrpcApi" . -}}
|
|
1
2
|
apiVersion: apps/v1
|
|
2
3
|
kind: Deployment
|
|
3
4
|
metadata:
|
|
@@ -22,9 +23,8 @@ spec:
|
|
|
22
23
|
{{- toYaml . | nindent 8 }}
|
|
23
24
|
{{- end }}
|
|
24
25
|
spec:
|
|
25
|
-
{{- with .
|
|
26
|
-
|
|
27
|
-
{{- toYaml . | nindent 8 }}
|
|
26
|
+
{{- with include "agentevals.imagePullSecrets" . }}
|
|
27
|
+
{{- . | nindent 6 }}
|
|
28
28
|
{{- end }}
|
|
29
29
|
securityContext:
|
|
30
30
|
{{- toYaml .Values.podSecurityContext | nindent 8 }}
|
|
@@ -52,7 +52,7 @@ spec:
|
|
|
52
52
|
containers:
|
|
53
53
|
- name: agentevals
|
|
54
54
|
image: {{ include "agentevals.image" . | quote }}
|
|
55
|
-
imagePullPolicy: {{ .
|
|
55
|
+
imagePullPolicy: {{ include "agentevals.imagePullPolicy" (dict "root" $ "local" .Values.image.pullPolicy) }}
|
|
56
56
|
{{- if .Values.command }}
|
|
57
57
|
command:
|
|
58
58
|
{{- toYaml .Values.command | nindent 12 }}
|
|
@@ -70,6 +70,18 @@ spec:
|
|
|
70
70
|
- name: AGENTEVALS_GRPC_REFLECTION
|
|
71
71
|
value: "true"
|
|
72
72
|
{{- end }}
|
|
73
|
+
{{- if .Values.grpcApi.only }}
|
|
74
|
+
- name: AGENTEVALS_API_GRPC_ONLY
|
|
75
|
+
value: "true"
|
|
76
|
+
{{- end }}
|
|
77
|
+
{{- if .Values.grpcApi.auth.enabled }}
|
|
78
|
+
- name: AGENTEVALS_API_GRPC_AUTH
|
|
79
|
+
value: "kubernetes"
|
|
80
|
+
- name: AGENTEVALS_API_GRPC_AUTH_AUDIENCE
|
|
81
|
+
value: {{ .Values.grpcApi.auth.audience | quote }}
|
|
82
|
+
- name: AGENTEVALS_API_GRPC_AUTH_ALLOWED_SERVICE_ACCOUNTS
|
|
83
|
+
value: {{ include "agentevals.allowedServiceAccounts" . | fromJsonArray | join "," | quote }}
|
|
84
|
+
{{- end }}
|
|
73
85
|
{{- if .Values.ephemeralVolume.enabled }}
|
|
74
86
|
- name: TMPDIR
|
|
75
87
|
value: "/tmp"
|
|
@@ -111,6 +123,7 @@ spec:
|
|
|
111
123
|
{{- toYaml . | nindent 12 }}
|
|
112
124
|
{{- end }}
|
|
113
125
|
ports:
|
|
126
|
+
{{- if not .Values.grpcApi.only }}
|
|
114
127
|
- name: http
|
|
115
128
|
containerPort: {{ .Values.service.http.containerPort }}
|
|
116
129
|
protocol: TCP
|
|
@@ -123,6 +136,7 @@ spec:
|
|
|
123
136
|
- name: mcp
|
|
124
137
|
containerPort: {{ .Values.service.mcp.containerPort }}
|
|
125
138
|
protocol: TCP
|
|
139
|
+
{{- end }}
|
|
126
140
|
{{- if .Values.grpcApi.enabled }}
|
|
127
141
|
- name: grpc-api
|
|
128
142
|
containerPort: {{ .Values.service.grpcApi.containerPort }}
|
|
@@ -136,15 +150,21 @@ spec:
|
|
|
136
150
|
{{- $_ := set $sc "readOnlyRootFilesystem" false }}
|
|
137
151
|
{{- end }}
|
|
138
152
|
{{- toYaml $sc | nindent 12 }}
|
|
153
|
+
{{- /* In grpcApi.only mode /api/health listens on 127.0.0.1, out of the kubelet's reach. */}}
|
|
139
154
|
startupProbe:
|
|
155
|
+
{{- if .Values.grpcApi.only }}
|
|
156
|
+
grpc:
|
|
157
|
+
port: {{ .Values.service.grpcApi.containerPort }}
|
|
158
|
+
{{- else }}
|
|
140
159
|
httpGet:
|
|
141
160
|
path: /api/health
|
|
142
161
|
port: http
|
|
162
|
+
{{- end }}
|
|
143
163
|
failureThreshold: 60
|
|
144
164
|
periodSeconds: 10
|
|
145
165
|
timeoutSeconds: 5
|
|
146
166
|
readinessProbe:
|
|
147
|
-
{{- if and .Values.grpcApi.enabled .Values.grpcApi.grpcReadinessProbe }}
|
|
167
|
+
{{- if and .Values.grpcApi.enabled (or .Values.grpcApi.only .Values.grpcApi.grpcReadinessProbe) }}
|
|
148
168
|
grpc:
|
|
149
169
|
port: {{ .Values.service.grpcApi.containerPort }}
|
|
150
170
|
{{- else }}
|
|
@@ -155,9 +175,14 @@ spec:
|
|
|
155
175
|
initialDelaySeconds: 5
|
|
156
176
|
periodSeconds: 10
|
|
157
177
|
livenessProbe:
|
|
178
|
+
{{- if .Values.grpcApi.only }}
|
|
179
|
+
grpc:
|
|
180
|
+
port: {{ .Values.service.grpcApi.containerPort }}
|
|
181
|
+
{{- else }}
|
|
158
182
|
httpGet:
|
|
159
183
|
path: /api/health
|
|
160
184
|
port: http
|
|
185
|
+
{{- end }}
|
|
161
186
|
initialDelaySeconds: 15
|
|
162
187
|
periodSeconds: 20
|
|
163
188
|
{{- if or .Values.ephemeralVolume.enabled .Values.extraVolumeMounts }}
|
|
@@ -51,9 +51,8 @@ spec:
|
|
|
51
51
|
{{- include "agentevals.selectorLabels" . | nindent 8 }}
|
|
52
52
|
app.kubernetes.io/component: database
|
|
53
53
|
spec:
|
|
54
|
-
{{- with .
|
|
55
|
-
|
|
56
|
-
{{- toYaml . | nindent 8 }}
|
|
54
|
+
{{- with include "agentevals.imagePullSecrets" . }}
|
|
55
|
+
{{- . | nindent 6 }}
|
|
57
56
|
{{- end }}
|
|
58
57
|
serviceAccountName: {{ $fullname }}
|
|
59
58
|
securityContext:
|
|
@@ -64,7 +63,7 @@ spec:
|
|
|
64
63
|
containers:
|
|
65
64
|
- name: postgresql
|
|
66
65
|
image: {{ include "agentevals.postgresql.image" . }}
|
|
67
|
-
imagePullPolicy: {{ $pg.image.pullPolicy }}
|
|
66
|
+
imagePullPolicy: {{ include "agentevals.imagePullPolicy" (dict "root" $ "local" $pg.image.pullPolicy) }}
|
|
68
67
|
securityContext:
|
|
69
68
|
allowPrivilegeEscalation: false
|
|
70
69
|
ports:
|
|
@@ -0,0 +1,27 @@
|
|
|
1
|
+
{{- if .Values.grpcApi.auth.enabled -}}
|
|
2
|
+
apiVersion: rbac.authorization.k8s.io/v1
|
|
3
|
+
kind: ClusterRole
|
|
4
|
+
metadata:
|
|
5
|
+
name: {{ include "agentevals.tokenReviewName" . }}
|
|
6
|
+
labels:
|
|
7
|
+
{{- include "agentevals.labels" . | nindent 4 }}
|
|
8
|
+
rules:
|
|
9
|
+
- apiGroups: ["authentication.k8s.io"]
|
|
10
|
+
resources: ["tokenreviews"]
|
|
11
|
+
verbs: ["create"]
|
|
12
|
+
---
|
|
13
|
+
apiVersion: rbac.authorization.k8s.io/v1
|
|
14
|
+
kind: ClusterRoleBinding
|
|
15
|
+
metadata:
|
|
16
|
+
name: {{ include "agentevals.tokenReviewName" . }}
|
|
17
|
+
labels:
|
|
18
|
+
{{- include "agentevals.labels" . | nindent 4 }}
|
|
19
|
+
roleRef:
|
|
20
|
+
apiGroup: rbac.authorization.k8s.io
|
|
21
|
+
kind: ClusterRole
|
|
22
|
+
name: {{ include "agentevals.tokenReviewName" . }}
|
|
23
|
+
subjects:
|
|
24
|
+
- kind: ServiceAccount
|
|
25
|
+
name: {{ include "agentevals.serviceAccountName" . }}
|
|
26
|
+
namespace: {{ include "agentevals.namespace" . }}
|
|
27
|
+
{{- end }}
|
|
@@ -8,6 +8,7 @@ metadata:
|
|
|
8
8
|
spec:
|
|
9
9
|
type: {{ .Values.service.type }}
|
|
10
10
|
ports:
|
|
11
|
+
{{- if not .Values.grpcApi.only }}
|
|
11
12
|
- name: http
|
|
12
13
|
port: {{ .Values.service.http.port }}
|
|
13
14
|
targetPort: http
|
|
@@ -24,6 +25,7 @@ spec:
|
|
|
24
25
|
port: {{ .Values.service.mcp.port }}
|
|
25
26
|
targetPort: mcp
|
|
26
27
|
protocol: TCP
|
|
28
|
+
{{- end }}
|
|
27
29
|
{{- if .Values.grpcApi.enabled }}
|
|
28
30
|
- name: grpc-api
|
|
29
31
|
port: {{ .Values.service.grpcApi.port }}
|
|
@@ -2,6 +2,18 @@
|
|
|
2
2
|
# Global
|
|
3
3
|
# ==============================================================================
|
|
4
4
|
|
|
5
|
+
# Values a parent chart can share with this one.
|
|
6
|
+
global:
|
|
7
|
+
# -- Registry for every image of this chart, including the bundled Postgres.
|
|
8
|
+
# Takes precedence over registry, image.registry and
|
|
9
|
+
# database.postgres.bundled.image.registry.
|
|
10
|
+
imageRegistry: ""
|
|
11
|
+
# -- Pull secrets for every pod of this chart, merged (union) with
|
|
12
|
+
# imagePullSecrets.
|
|
13
|
+
imagePullSecrets: []
|
|
14
|
+
# -- Fallback pull policy where neither the image nor imagePullPolicy sets one.
|
|
15
|
+
imagePullPolicy: ""
|
|
16
|
+
|
|
5
17
|
# -- Number of replicas. Keep 1 when agents or a Collector send OTLP to this
|
|
6
18
|
# release: live sessions are held in the memory of the pod that receives them,
|
|
7
19
|
# so with more replicas one session's traces and logs end up split across pods.
|
|
@@ -9,16 +21,18 @@
|
|
|
9
21
|
# replicas (SELECT FOR UPDATE SKIP LOCKED claims), not live sessions.
|
|
10
22
|
replicaCount: 1
|
|
11
23
|
|
|
12
|
-
# --
|
|
24
|
+
# -- Container image registry (prepended to image.repository). global.imageRegistry
|
|
25
|
+
# takes precedence.
|
|
13
26
|
registry: ghcr.io
|
|
14
27
|
|
|
15
28
|
# -- Global image tag override (defaults to Chart.appVersion)
|
|
16
29
|
tag: ""
|
|
17
30
|
|
|
18
|
-
# --
|
|
19
|
-
imagePullPolicy
|
|
31
|
+
# -- Image pull policy for every container. Empty falls back to
|
|
32
|
+
# global.imagePullPolicy, then IfNotPresent.
|
|
33
|
+
imagePullPolicy: ""
|
|
20
34
|
|
|
21
|
-
# -- Image pull secrets
|
|
35
|
+
# -- Image pull secrets, merged with global.imagePullSecrets
|
|
22
36
|
imagePullSecrets: []
|
|
23
37
|
|
|
24
38
|
# -- Override the chart name
|
|
@@ -41,7 +55,9 @@ image:
|
|
|
41
55
|
repository: agentevals-dev/agentevals
|
|
42
56
|
# -- Container image tag (defaults to global tag, then Chart.appVersion)
|
|
43
57
|
tag: ""
|
|
44
|
-
# -- Container image
|
|
58
|
+
# -- Container image digest, e.g. "sha256:...". Takes precedence over the tag.
|
|
59
|
+
digest: ""
|
|
60
|
+
# -- Container image pull policy (defaults to imagePullPolicy)
|
|
45
61
|
pullPolicy: ""
|
|
46
62
|
|
|
47
63
|
# ==============================================================================
|
|
@@ -159,6 +175,25 @@ grpcApi:
|
|
|
159
175
|
# -- Check readiness with the gRPC health service on the gRPC API port instead of HTTP
|
|
160
176
|
# /api/health
|
|
161
177
|
grpcReadinessProbe: false
|
|
178
|
+
# -- Serve only the gRPC API on the pod network (--api-grpc-only). The web UI and
|
|
179
|
+
# REST API, the OTLP receivers and MCP listen on 127.0.0.1 inside the pod, where
|
|
180
|
+
# kubectl port-forward still reaches them. The Service exposes only grpc-api and
|
|
181
|
+
# every probe uses the gRPC health service.
|
|
182
|
+
only: false
|
|
183
|
+
auth:
|
|
184
|
+
# -- Require a Kubernetes ServiceAccount token on every gRPC API call except
|
|
185
|
+
# health checks (--api-grpc-auth kubernetes). Renders a ClusterRole and
|
|
186
|
+
# ClusterRoleBinding that let the chart's ServiceAccount create TokenReviews,
|
|
187
|
+
# so it needs serviceAccount.create or serviceAccount.name. Covers only the
|
|
188
|
+
# gRPC API: combine it with grpcApi.only.
|
|
189
|
+
enabled: false
|
|
190
|
+
# -- Audience the callers' tokens must be minted for
|
|
191
|
+
audience: agentevals
|
|
192
|
+
# -- ServiceAccounts allowed to call the API, as namespace/name. Required when
|
|
193
|
+
# enabled: any pod can mint a token for any audience, so the audience alone
|
|
194
|
+
# authorizes nothing. Entries are templates, so a parent chart can write
|
|
195
|
+
# "{{ .Release.Namespace }}/{{ .Release.Name }}-caller".
|
|
196
|
+
allowedServiceAccounts: []
|
|
162
197
|
|
|
163
198
|
# ==============================================================================
|
|
164
199
|
# Resources
|
|
@@ -273,8 +308,8 @@ database:
|
|
|
273
308
|
name: postgres
|
|
274
309
|
# -- Bundled Postgres image tag
|
|
275
310
|
tag: "18.3-alpine"
|
|
276
|
-
# -- Bundled Postgres image pull policy
|
|
277
|
-
pullPolicy:
|
|
311
|
+
# -- Bundled Postgres image pull policy (defaults to imagePullPolicy)
|
|
312
|
+
pullPolicy: ""
|
|
278
313
|
# -- PersistentVolumeClaim size for the bundled Postgres data
|
|
279
314
|
storage: 1Gi
|
|
280
315
|
# -- StorageClass for the PVC. Defaults to the cluster default when empty.
|
|
@@ -50,12 +50,28 @@ Errors use standard gRPC status codes with a `google.rpc.ErrorInfo` detail whose
|
|
|
50
50
|
| Setting | Purpose |
|
|
51
51
|
|---------|---------|
|
|
52
52
|
| `--api-grpc-port` or `AGENTEVALS_API_GRPC_PORT` | Port, default `8002`; `0` turns the API off |
|
|
53
|
+
| `--api-grpc-only` or `AGENTEVALS_API_GRPC_ONLY=true` | Serve only the gRPC API on `--host`, see below |
|
|
54
|
+
| `--api-grpc-auth` or `AGENTEVALS_API_GRPC_AUTH` | `none` (default) or `kubernetes`, see [Security](#security) |
|
|
55
|
+
| `--api-grpc-auth-audience` or `AGENTEVALS_API_GRPC_AUTH_AUDIENCE` | Token audience, default `agentevals` |
|
|
56
|
+
| `--api-grpc-auth-allowed-service-account` or `AGENTEVALS_API_GRPC_AUTH_ALLOWED_SERVICE_ACCOUNTS` | Allowed ServiceAccount as `namespace/name`; repeat the flag, or comma separate the env var |
|
|
53
57
|
| `AGENTEVALS_GRPC_REFLECTION=true` | Turn on server reflection |
|
|
54
58
|
| `AGENTEVALS_API_TRACES=true` | Export traces of the API server itself (see below) |
|
|
55
59
|
|
|
56
60
|
Messages can be up to 16 MiB. Uploaded trace documents are limited to 10 MiB each, as in the REST API.
|
|
57
61
|
|
|
58
|
-
The Helm chart has the same switches under `grpcApi`: `enabled`, `reflection`,
|
|
62
|
+
The Helm chart has the same switches under `grpcApi`: `enabled`, `reflection`, `grpcReadinessProbe` to check readiness with the gRPC health service, `only`, and `auth`. The Service exposes the port as `grpc-api`.
|
|
63
|
+
|
|
64
|
+
### Serving only the gRPC API
|
|
65
|
+
|
|
66
|
+
When one program is the only caller, run the server with `--api-grpc-only`. The gRPC API listens on `--host`. The web UI and REST API, both OTLP receivers and MCP listen on `127.0.0.1` only, so nothing else is reachable from the network:
|
|
67
|
+
|
|
68
|
+
```bash
|
|
69
|
+
uv run agentevals serve --api-grpc-only
|
|
70
|
+
```
|
|
71
|
+
|
|
72
|
+
Check health with `grpc.health.v1` on the gRPC API port; `/api/health` is only reachable from inside the host or pod. `kubectl port-forward` still reaches the web UI, because it connects to the pod's loopback address.
|
|
73
|
+
|
|
74
|
+
In the Helm chart, `grpcApi.only=true` does the same. The Service then exposes only `grpc-api`, and the startup, readiness and liveness probes use the gRPC health service.
|
|
59
75
|
|
|
60
76
|
## Tracing the API server
|
|
61
77
|
|
|
@@ -70,6 +86,54 @@ AGENTEVALS_API_TRACES=true OTEL_TRACES_EXPORTER=console uv run agentevals serve
|
|
|
70
86
|
|
|
71
87
|
## Security
|
|
72
88
|
|
|
73
|
-
|
|
89
|
+
By default the API has no authentication. Any caller that can reach the port can read sessions, run evaluations with the server's credentials, and submit runs. Expose port 8002 only to trusted callers.
|
|
74
90
|
|
|
75
91
|
On a laptop `agentevals serve` listens on all interfaces. Pass `--host 127.0.0.1` to keep every port local.
|
|
92
|
+
|
|
93
|
+
### Kubernetes ServiceAccount authentication
|
|
94
|
+
|
|
95
|
+
Inside a cluster, the server can admit only the ServiceAccounts you name:
|
|
96
|
+
|
|
97
|
+
```bash
|
|
98
|
+
agentevals serve --api-grpc-only \
|
|
99
|
+
--api-grpc-auth kubernetes \
|
|
100
|
+
--api-grpc-auth-allowed-service-account evals/controller
|
|
101
|
+
```
|
|
102
|
+
|
|
103
|
+
Callers send a ServiceAccount token minted for the audience as `authorization: Bearer <token>` metadata, for example a [projected token](https://kubernetes.io/docs/concepts/storage/projected-volumes/#serviceaccounttoken) with `audience: agentevals`. The server checks it with a TokenReview, so its own ServiceAccount needs `create` on `tokenreviews.authentication.k8s.io`.
|
|
104
|
+
|
|
105
|
+
| Result | Status |
|
|
106
|
+
|--------|--------|
|
|
107
|
+
| No token, a malformed or expired token, a token for another audience, or a user that is not a ServiceAccount | `UNAUTHENTICATED` |
|
|
108
|
+
| A valid ServiceAccount that is not on the list | `PERMISSION_DENIED` |
|
|
109
|
+
| The TokenReview fails, for example because the Kubernetes API is down | `UNAVAILABLE` |
|
|
110
|
+
|
|
111
|
+
The list is required: any pod can mint a token for any audience, so the audience alone proves nothing. The server refuses to start with an empty list, and never lets a call through when a check fails. A successful check is cached for up to 30 seconds and never past the token's expiry. Health checks need no token. Reflection, when turned on, needs one like every other call: `grpcurl -H "authorization: Bearer $TOKEN" ...`.
|
|
112
|
+
|
|
113
|
+
Authentication covers only the gRPC API. Combine it with `--api-grpc-only` so the REST API, the OTLP receivers and MCP stay on `127.0.0.1`; without it the server prints a warning.
|
|
114
|
+
|
|
115
|
+
With the Helm chart:
|
|
116
|
+
|
|
117
|
+
```yaml
|
|
118
|
+
serviceAccount:
|
|
119
|
+
create: true
|
|
120
|
+
grpcApi:
|
|
121
|
+
only: true
|
|
122
|
+
auth:
|
|
123
|
+
enabled: true
|
|
124
|
+
audience: agentevals
|
|
125
|
+
allowedServiceAccounts:
|
|
126
|
+
- evals/controller
|
|
127
|
+
```
|
|
128
|
+
|
|
129
|
+
The chart then adds a ClusterRole and ClusterRoleBinding that let its ServiceAccount create TokenReviews. It refuses to render with an empty `allowedServiceAccounts`, or without `serviceAccount.create` or `serviceAccount.name`, so the permission never goes to the namespace's `default` ServiceAccount.
|
|
130
|
+
|
|
131
|
+
Entries in `allowedServiceAccounts` are templates. A parent chart that ships agentevals as a subchart can name its own caller without knowing the namespace in advance:
|
|
132
|
+
|
|
133
|
+
```yaml
|
|
134
|
+
agentevals:
|
|
135
|
+
grpcApi:
|
|
136
|
+
auth:
|
|
137
|
+
allowedServiceAccounts:
|
|
138
|
+
- "{{ .Release.Namespace }}/{{ .Release.Name }}-controller"
|
|
139
|
+
```
|
|
@@ -137,7 +137,7 @@ def _build_lifespan():
|
|
|
137
137
|
from .rpc.services import ApiContext
|
|
138
138
|
|
|
139
139
|
context = ApiContext(manager=mgr, run_service=getattr(app.state, "run_service", None), ports=api_grpc.ports)
|
|
140
|
-
api_server = await start_api_server(context, api_grpc.host, api_grpc.port)
|
|
140
|
+
api_server = await start_api_server(context, api_grpc.host, api_grpc.port, api_grpc.auth)
|
|
141
141
|
|
|
142
142
|
yield
|
|
143
143
|
|