agentevals-cli 0.14.1__tar.gz → 0.15.0__tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (789) hide show
  1. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/PKG-INFO +2 -2
  2. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/README.md +1 -1
  3. agentevals_cli-0.15.0/charts/agentevals/Chart.yaml +7 -0
  4. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/charts/agentevals/templates/NOTES.txt +19 -1
  5. agentevals_cli-0.15.0/charts/agentevals/templates/_helpers.tpl +150 -0
  6. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/charts/agentevals/templates/deployment.yaml +30 -5
  7. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/charts/agentevals/templates/postgresql.yaml +3 -4
  8. agentevals_cli-0.15.0/charts/agentevals/templates/rbac-tokenreview.yaml +27 -0
  9. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/charts/agentevals/templates/service.yaml +2 -0
  10. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/charts/agentevals/values.yaml +39 -7
  11. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/docs/grpc-api.md +56 -2
  12. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/app.py +1 -1
  13. agentevals_cli-0.15.0/src/agentevals/api/rpc/auth.py +292 -0
  14. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/rpc/server.py +11 -3
  15. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/cli.py +120 -15
  16. agentevals_cli-0.15.0/tests/api/test_grpc_auth.py +341 -0
  17. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_cli.py +130 -0
  18. agentevals_cli-0.14.1/charts/agentevals/Chart.yaml +0 -6
  19. agentevals_cli-0.14.1/charts/agentevals/templates/_helpers.tpl +0 -90
  20. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/.claude/skills/eval/SKILL.md +0 -0
  21. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/.claude/skills/eval/evals/evals.json +0 -0
  22. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/.claude/skills/inspect/SKILL.md +0 -0
  23. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/.claude/skills/inspect/evals/evals.json +0 -0
  24. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/.dockerignore +0 -0
  25. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/.gitattributes +0 -0
  26. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/.github/ISSUE_TEMPLATE/bug_report.yml +0 -0
  27. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/.github/ISSUE_TEMPLATE/config.yml +0 -0
  28. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/.github/ISSUE_TEMPLATE/feature_request.yml +0 -0
  29. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/.github/dependabot.yml +0 -0
  30. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/.github/workflows/ci.yml +0 -0
  31. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/.github/workflows/kagent-contract-policy.yml +0 -0
  32. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/.github/workflows/kagent-contract.yml +0 -0
  33. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/.github/workflows/publish-evaluator-sdk.yml +0 -0
  34. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/.github/workflows/release.yml +0 -0
  35. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/.gitignore +0 -0
  36. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/.mcp.json +0 -0
  37. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/CONTRIBUTING.md +0 -0
  38. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/DEVELOPMENT.md +0 -0
  39. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/Dockerfile +0 -0
  40. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/LICENSE +0 -0
  41. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/Makefile +0 -0
  42. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/charts/agentevals/templates/postgresql-secret.yaml +0 -0
  43. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/charts/agentevals/templates/rbac.yaml +0 -0
  44. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/charts/agentevals/templates/serviceaccount.yaml +0 -0
  45. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/docs/assets/logo-color-on-transparent.svg +0 -0
  46. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/docs/assets/logo-color.png +0 -0
  47. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/docs/assets/logo-dark-on-transparent.svg +0 -0
  48. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/docs/custom-evaluators.md +0 -0
  49. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/docs/eval-set-format.md +0 -0
  50. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/docs/opentelemetry-pipeline.md +0 -0
  51. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/docs/otel-compatibility.md +0 -0
  52. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/docs/run-history.md +0 -0
  53. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/README.md +0 -0
  54. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/custom_evaluators/eval_config.yaml +0 -0
  55. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/custom_evaluators/response_quality.py +0 -0
  56. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/custom_evaluators/tool_call_checker.py +0 -0
  57. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/custom_sink/README.md +0 -0
  58. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/custom_sink/agentevals_example_custom_sink/__init__.py +0 -0
  59. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/custom_sink/agentevals_example_custom_sink/sink.py +0 -0
  60. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/custom_sink/pyproject.toml +0 -0
  61. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/dice_agent/README.md +0 -0
  62. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/dice_agent/agent.py +0 -0
  63. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/dice_agent/eval_set.json +0 -0
  64. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/dice_agent/main.py +0 -0
  65. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/dice_agent/test_streaming.py +0 -0
  66. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/kubernetes/README.md +0 -0
  67. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/kubernetes/agentevals-values.yaml +0 -0
  68. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/kubernetes/agents.yaml +0 -0
  69. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/kubernetes/otel-collector.yaml +0 -0
  70. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/langchain_agent/README.md +0 -0
  71. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/langchain_agent/agent.py +0 -0
  72. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/langchain_agent/eval_set.json +0 -0
  73. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/langchain_agent/main.py +0 -0
  74. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/langchain_agent/requirements.txt +0 -0
  75. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/langchain_agent/test_streaming.py +0 -0
  76. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/sdk_example/async_example.py +0 -0
  77. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/sdk_example/context_manager_example.py +0 -0
  78. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/sdk_example/decorator_example.py +0 -0
  79. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/sdk_example/requirements.txt +0 -0
  80. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/strands_agent/agent.py +0 -0
  81. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/strands_agent/eval_set.json +0 -0
  82. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/strands_agent/main.py +0 -0
  83. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/strands_agent/requirements.txt +0 -0
  84. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/zero-code-examples/adk/requirements.txt +0 -0
  85. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/zero-code-examples/adk/run.py +0 -0
  86. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/zero-code-examples/langchain/requirements.txt +0 -0
  87. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/zero-code-examples/langchain/run.py +0 -0
  88. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/zero-code-examples/ollama/requirements.txt +0 -0
  89. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/zero-code-examples/ollama/run.py +0 -0
  90. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/zero-code-examples/openai-agents/requirements.txt +0 -0
  91. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/zero-code-examples/openai-agents/run.py +0 -0
  92. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/zero-code-examples/pydantic-ai/requirements.txt +0 -0
  93. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/zero-code-examples/pydantic-ai/run.py +0 -0
  94. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/zero-code-examples/strands/requirements.txt +0 -0
  95. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/examples/zero-code-examples/strands/run.py +0 -0
  96. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/flake.lock +0 -0
  97. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/flake.nix +0 -0
  98. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/gen/go/README.md +0 -0
  99. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/gen/go/agentevals/api/v1alpha1/common.pb.go +0 -0
  100. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/gen/go/agentevals/api/v1alpha1/conversion.pb.go +0 -0
  101. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/gen/go/agentevals/api/v1alpha1/conversion_grpc.pb.go +0 -0
  102. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/gen/go/agentevals/api/v1alpha1/evaluation.pb.go +0 -0
  103. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/gen/go/agentevals/api/v1alpha1/evaluation_grpc.pb.go +0 -0
  104. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/gen/go/agentevals/api/v1alpha1/runs.pb.go +0 -0
  105. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/gen/go/agentevals/api/v1alpha1/runs_grpc.pb.go +0 -0
  106. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/gen/go/agentevals/api/v1alpha1/sessions.pb.go +0 -0
  107. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/gen/go/agentevals/api/v1alpha1/sessions_grpc.pb.go +0 -0
  108. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/gen/go/agentevals/api/v1alpha1/system.pb.go +0 -0
  109. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/gen/go/agentevals/api/v1alpha1/system_grpc.pb.go +0 -0
  110. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/gen/go/agentevals/api/v1alpha1/views.pb.go +0 -0
  111. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/gen/go/go.mod +0 -0
  112. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/gen/go/go.sum +0 -0
  113. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/packages/evaluator-sdk-py/README.md +0 -0
  114. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/packages/evaluator-sdk-py/pyproject.toml +0 -0
  115. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/packages/evaluator-sdk-py/src/agentevals_evaluator_sdk/__init__.py +0 -0
  116. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/packages/evaluator-sdk-py/src/agentevals_evaluator_sdk/decorator.py +0 -0
  117. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/packages/evaluator-sdk-py/src/agentevals_evaluator_sdk/types.py +0 -0
  118. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/proto/agentevals/api/v1alpha1/common.proto +0 -0
  119. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/proto/agentevals/api/v1alpha1/conversion.proto +0 -0
  120. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/proto/agentevals/api/v1alpha1/evaluation.proto +0 -0
  121. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/proto/agentevals/api/v1alpha1/runs.proto +0 -0
  122. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/proto/agentevals/api/v1alpha1/sessions.proto +0 -0
  123. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/proto/agentevals/api/v1alpha1/system.proto +0 -0
  124. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/proto/agentevals/api/v1alpha1/views.proto +0 -0
  125. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/proto/buf.gen.yaml +0 -0
  126. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/proto/buf.lock +0 -0
  127. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/proto/buf.yaml +0 -0
  128. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/pyproject.toml +0 -0
  129. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/samples/eval_set_helm.json +0 -0
  130. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/samples/evalset_helm_3_2026-02-23.json +0 -0
  131. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/samples/evalset_k8s_2026-02-20.json +0 -0
  132. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/samples/helm.json +0 -0
  133. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/samples/helm_2.json +0 -0
  134. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/samples/helm_3.json +0 -0
  135. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/samples/k8s.json +0 -0
  136. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/samples/tempo_export_with_batches.json +0 -0
  137. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/__init__.py +0 -0
  138. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/_protocol.py +0 -0
  139. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/_static/assets/index-BqibLiHO.css +0 -0
  140. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/_static/assets/index-vXShTu9I.js +0 -0
  141. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/_static/index.html +0 -0
  142. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/_static/logo.svg +0 -0
  143. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/_static/vite.svg +0 -0
  144. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/adk_bridge.py +0 -0
  145. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/__init__.py +0 -0
  146. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/debug_routes.py +0 -0
  147. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/dependencies.py +0 -0
  148. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/evaluation.py +0 -0
  149. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/models.py +0 -0
  150. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/otlp_app.py +0 -0
  151. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/otlp_grpc.py +0 -0
  152. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/otlp_http.py +0 -0
  153. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/otlp_processing.py +0 -0
  154. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/otlp_routes.py +0 -0
  155. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/redact.py +0 -0
  156. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/routes.py +0 -0
  157. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/rpc/__init__.py +0 -0
  158. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/rpc/convert.py +0 -0
  159. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/rpc/policy.py +0 -0
  160. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/rpc/services.py +0 -0
  161. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/runs_routes.py +0 -0
  162. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/streaming_routes.py +0 -0
  163. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/common_pb2.py +0 -0
  164. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/common_pb2.pyi +0 -0
  165. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/common_pb2_grpc.py +0 -0
  166. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/conversion_pb2.py +0 -0
  167. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/conversion_pb2.pyi +0 -0
  168. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/conversion_pb2_grpc.py +0 -0
  169. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/evaluation_pb2.py +0 -0
  170. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/evaluation_pb2.pyi +0 -0
  171. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/evaluation_pb2_grpc.py +0 -0
  172. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/runs_pb2.py +0 -0
  173. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/runs_pb2.pyi +0 -0
  174. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/runs_pb2_grpc.py +0 -0
  175. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/sessions_pb2.py +0 -0
  176. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/sessions_pb2.pyi +0 -0
  177. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/sessions_pb2_grpc.py +0 -0
  178. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/system_pb2.py +0 -0
  179. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/system_pb2.pyi +0 -0
  180. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/system_pb2_grpc.py +0 -0
  181. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/views_pb2.py +0 -0
  182. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/views_pb2.pyi +0 -0
  183. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/v1alpha1/views_pb2_grpc.py +0 -0
  184. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/api/views.py +0 -0
  185. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/builtin_metrics.py +0 -0
  186. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/config.py +0 -0
  187. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/custom_evaluators.py +0 -0
  188. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/eval_config_loader.py +0 -0
  189. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/evaluation_events.py +0 -0
  190. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/evaluator/__init__.py +0 -0
  191. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/evaluator/resolver.py +0 -0
  192. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/evaluator/sources.py +0 -0
  193. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/evaluator/templates.py +0 -0
  194. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/evaluator/venv.py +0 -0
  195. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/genai/__init__.py +0 -0
  196. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/genai/extract.py +0 -0
  197. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/genai/grouping.py +0 -0
  198. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/genai/matching.py +0 -0
  199. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/genai/messages.py +0 -0
  200. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/genai/model.py +0 -0
  201. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/genai/overlay.py +0 -0
  202. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/genai/routing.py +0 -0
  203. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/genai/semconv.py +0 -0
  204. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/judges.py +0 -0
  205. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/loader/__init__.py +0 -0
  206. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/loader/auto.py +0 -0
  207. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/loader/jaeger.py +0 -0
  208. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/loader/otlp.py +0 -0
  209. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/mcp_server.py +0 -0
  210. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/otel/__init__.py +0 -0
  211. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/otel/decode.py +0 -0
  212. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/otel/encode.py +0 -0
  213. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/otel/identity.py +0 -0
  214. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/otel/model.py +0 -0
  215. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/otel/sdk_export.py +0 -0
  216. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/otel/store.py +0 -0
  217. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/output.py +0 -0
  218. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/resolvers/__init__.py +0 -0
  219. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/resolvers/kubernetes.py +0 -0
  220. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/run/__init__.py +0 -0
  221. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/run/fetcher.py +0 -0
  222. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/run/result_builder.py +0 -0
  223. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/run/service.py +0 -0
  224. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/run/sinks.py +0 -0
  225. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/run/worker.py +0 -0
  226. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/runner.py +0 -0
  227. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/sdk.py +0 -0
  228. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/storage/__init__.py +0 -0
  229. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/storage/config.py +0 -0
  230. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/storage/models.py +0 -0
  231. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/storage/postgres/__init__.py +0 -0
  232. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/storage/postgres/migrations/000001_init.down.sql +0 -0
  233. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/storage/postgres/migrations/000001_init.up.sql +0 -0
  234. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/storage/postgres/migrations/000002_drop_openai_eval.down.sql +0 -0
  235. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/storage/postgres/migrations/000002_drop_openai_eval.up.sql +0 -0
  236. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/storage/postgres/migrator.py +0 -0
  237. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/storage/postgres/pool.py +0 -0
  238. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/storage/repos/__init__.py +0 -0
  239. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/storage/repos/memory.py +0 -0
  240. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/storage/repos/postgres.py +0 -0
  241. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/streaming/__init__.py +0 -0
  242. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/streaming/exports.py +0 -0
  243. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/streaming/manager.py +0 -0
  244. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/streaming/session.py +0 -0
  245. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/telemetry.py +0 -0
  246. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/trace_metrics.py +0 -0
  247. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/utils/__init__.py +0 -0
  248. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/src/agentevals/utils/log_buffer.py +0 -0
  249. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/api/__init__.py +0 -0
  250. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/api/test_api_tracing.py +0 -0
  251. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/api/test_evaluate_persistence.py +0 -0
  252. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/api/test_grpc_api.py +0 -0
  253. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/api/test_live_routes.py +0 -0
  254. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/api/test_redact.py +0 -0
  255. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/api/test_rpc_convert.py +0 -0
  256. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/api/test_runs_routes.py +0 -0
  257. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/api/test_views.py +0 -0
  258. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/README.md +0 -0
  259. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/check.sh +0 -0
  260. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/policy/agentevals.rego +0 -0
  261. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/registries/main-2cc3ffae/a2a.yaml +0 -0
  262. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/registries/main-2cc3ffae/imports.yaml +0 -0
  263. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/registries/main-2cc3ffae/kagent.yaml +0 -0
  264. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/registries/main-2cc3ffae/manifest.yaml +0 -0
  265. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/registries/main-2cc3ffae/signals.yaml +0 -0
  266. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/registries/pr3121-412ef54e/a2a.yaml +0 -0
  267. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/registries/pr3121-412ef54e/imports.yaml +0 -0
  268. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/registries/pr3121-412ef54e/kagent.yaml +0 -0
  269. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/registries/pr3121-412ef54e/manifest.yaml +0 -0
  270. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/registries/pr3121-412ef54e/signals.yaml +0 -0
  271. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/registries/v1.0.0-alpha9/a2a.yaml +0 -0
  272. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/registries/v1.0.0-alpha9/kagent.yaml +0 -0
  273. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/registries/v1.0.0-alpha9/manifest.yaml +0 -0
  274. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/registries/v1.0.0-alpha9/signals.yaml +0 -0
  275. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/test.sh +0 -0
  276. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/testdata/agentevals_contract_gone/manifest.yaml +0 -0
  277. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/testdata/agentevals_contract_gone/model.yaml +0 -0
  278. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/testdata/agentevals_contract_missing_attribute/manifest.yaml +0 -0
  279. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/testdata/agentevals_contract_missing_attribute/model.yaml +0 -0
  280. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/testdata/agentevals_contract_requirement_floor/manifest.yaml +0 -0
  281. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/testdata/agentevals_contract_requirement_floor/model.yaml +0 -0
  282. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/contract/kagent/weaver.sh +0 -0
  283. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/MANIFEST.md +0 -0
  284. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default/S1.json +0 -0
  285. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default/S1.truth.json +0 -0
  286. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default/S2.json +0 -0
  287. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default/S2.truth.json +0 -0
  288. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default/S3.json +0 -0
  289. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default/S3.truth.json +0 -0
  290. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default/S4a.json +0 -0
  291. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default/S4a.truth.json +0 -0
  292. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default/S4b.json +0 -0
  293. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default/S4b.truth.json +0 -0
  294. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default/S5.json +0 -0
  295. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default/S5.truth.json +0 -0
  296. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default/S6a.json +0 -0
  297. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default/S6a.truth.json +0 -0
  298. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default/S6b.json +0 -0
  299. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default/S6b.truth.json +0 -0
  300. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default_contrib/S1.json +0 -0
  301. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default_contrib/S1.truth.json +0 -0
  302. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default_contrib/S2.json +0 -0
  303. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default_contrib/S2.truth.json +0 -0
  304. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default_contrib/S3.json +0 -0
  305. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default_contrib/S3.truth.json +0 -0
  306. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default_contrib/S4a.json +0 -0
  307. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default_contrib/S4a.truth.json +0 -0
  308. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default_contrib/S4b.json +0 -0
  309. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default_contrib/S4b.truth.json +0 -0
  310. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default_contrib/S5.json +0 -0
  311. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default_contrib/S5.truth.json +0 -0
  312. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default_contrib/S6a.json +0 -0
  313. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default_contrib/S6a.truth.json +0 -0
  314. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default_contrib/S6b.json +0 -0
  315. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_default_contrib/S6b.truth.json +0 -0
  316. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable/S1.json +0 -0
  317. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable/S1.truth.json +0 -0
  318. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable/S2.json +0 -0
  319. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable/S2.truth.json +0 -0
  320. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable/S3.json +0 -0
  321. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable/S3.truth.json +0 -0
  322. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable/S4a.json +0 -0
  323. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable/S4a.truth.json +0 -0
  324. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable/S4b.json +0 -0
  325. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable/S4b.truth.json +0 -0
  326. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable/S5.json +0 -0
  327. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable/S5.truth.json +0 -0
  328. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable/S6a.json +0 -0
  329. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable/S6a.truth.json +0 -0
  330. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable/S6b.json +0 -0
  331. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable/S6b.truth.json +0 -0
  332. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S1.json +0 -0
  333. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S1.truth.json +0 -0
  334. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S2.json +0 -0
  335. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S2.truth.json +0 -0
  336. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S3.json +0 -0
  337. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S3.truth.json +0 -0
  338. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S4a.json +0 -0
  339. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S4a.truth.json +0 -0
  340. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S4b.json +0 -0
  341. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S4b.truth.json +0 -0
  342. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S5.json +0 -0
  343. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S5.truth.json +0 -0
  344. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S6a.json +0 -0
  345. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S6a.truth.json +0 -0
  346. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S6b.json +0 -0
  347. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_event_stable_contrib/S6b.truth.json +0 -0
  348. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_nolegacy/S1.json +0 -0
  349. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_nolegacy/S1.truth.json +0 -0
  350. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_nolegacy/S2.json +0 -0
  351. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_nolegacy/S2.truth.json +0 -0
  352. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_nolegacy/S3.json +0 -0
  353. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_nolegacy/S3.truth.json +0 -0
  354. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_nolegacy/S4a.json +0 -0
  355. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_nolegacy/S4a.truth.json +0 -0
  356. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_nolegacy/S4b.json +0 -0
  357. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_nolegacy/S4b.truth.json +0 -0
  358. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_nolegacy/S5.json +0 -0
  359. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_nolegacy/S5.truth.json +0 -0
  360. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_nolegacy/S6a.json +0 -0
  361. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_nolegacy/S6a.truth.json +0 -0
  362. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_nolegacy/S6b.json +0 -0
  363. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v1_nolegacy/S6b.truth.json +0 -0
  364. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_default/S1.json +0 -0
  365. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_default/S1.truth.json +0 -0
  366. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_default/S2.json +0 -0
  367. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_default/S2.truth.json +0 -0
  368. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_default/S3.json +0 -0
  369. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_default/S3.truth.json +0 -0
  370. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_default/S4a.json +0 -0
  371. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_default/S4a.truth.json +0 -0
  372. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_default/S4b.json +0 -0
  373. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_default/S4b.truth.json +0 -0
  374. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_default/S5.json +0 -0
  375. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_default/S5.truth.json +0 -0
  376. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_default/S6a.json +0 -0
  377. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_default/S6a.truth.json +0 -0
  378. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_default/S6b.json +0 -0
  379. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_default/S6b.truth.json +0 -0
  380. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only/S1.json +0 -0
  381. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only/S1.truth.json +0 -0
  382. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only/S2.json +0 -0
  383. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only/S2.truth.json +0 -0
  384. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only/S3.json +0 -0
  385. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only/S3.truth.json +0 -0
  386. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only/S4a.json +0 -0
  387. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only/S4a.truth.json +0 -0
  388. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only/S4b.json +0 -0
  389. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only/S4b.truth.json +0 -0
  390. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only/S5.json +0 -0
  391. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only/S5.truth.json +0 -0
  392. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only/S6a.json +0 -0
  393. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only/S6a.truth.json +0 -0
  394. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only/S6b.json +0 -0
  395. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only/S6b.truth.json +0 -0
  396. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S1.json +0 -0
  397. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S1.truth.json +0 -0
  398. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S2.json +0 -0
  399. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S2.truth.json +0 -0
  400. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S3.json +0 -0
  401. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S3.truth.json +0 -0
  402. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S4a.json +0 -0
  403. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S4a.truth.json +0 -0
  404. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S4b.json +0 -0
  405. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S4b.truth.json +0 -0
  406. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S5.json +0 -0
  407. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S5.truth.json +0 -0
  408. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S6a.json +0 -0
  409. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S6a.truth.json +0 -0
  410. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S6b.json +0 -0
  411. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_event_only_nolegacy/S6b.truth.json +0 -0
  412. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_no_content/S1.json +0 -0
  413. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_no_content/S1.truth.json +0 -0
  414. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_no_content/S2.json +0 -0
  415. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_no_content/S2.truth.json +0 -0
  416. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_no_content/S3.json +0 -0
  417. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_no_content/S3.truth.json +0 -0
  418. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_no_content/S4a.json +0 -0
  419. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_no_content/S4a.truth.json +0 -0
  420. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_no_content/S4b.json +0 -0
  421. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_no_content/S4b.truth.json +0 -0
  422. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_no_content/S5.json +0 -0
  423. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_no_content/S5.truth.json +0 -0
  424. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_no_content/S6a.json +0 -0
  425. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_no_content/S6a.truth.json +0 -0
  426. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_no_content/S6b.json +0 -0
  427. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_no_content/S6b.truth.json +0 -0
  428. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_and_event/S1.json +0 -0
  429. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_and_event/S1.truth.json +0 -0
  430. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_and_event/S2.json +0 -0
  431. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_and_event/S2.truth.json +0 -0
  432. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_and_event/S3.json +0 -0
  433. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_and_event/S3.truth.json +0 -0
  434. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_and_event/S4a.json +0 -0
  435. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_and_event/S4a.truth.json +0 -0
  436. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_and_event/S4b.json +0 -0
  437. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_and_event/S4b.truth.json +0 -0
  438. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_and_event/S5.json +0 -0
  439. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_and_event/S5.truth.json +0 -0
  440. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_and_event/S6a.json +0 -0
  441. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_and_event/S6a.truth.json +0 -0
  442. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_and_event/S6b.json +0 -0
  443. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_and_event/S6b.truth.json +0 -0
  444. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only/S1.json +0 -0
  445. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only/S1.truth.json +0 -0
  446. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only/S2.json +0 -0
  447. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only/S2.truth.json +0 -0
  448. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only/S3.json +0 -0
  449. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only/S3.truth.json +0 -0
  450. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only/S4a.json +0 -0
  451. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only/S4a.truth.json +0 -0
  452. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only/S4b.json +0 -0
  453. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only/S4b.truth.json +0 -0
  454. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only/S5.json +0 -0
  455. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only/S5.truth.json +0 -0
  456. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only/S6a.json +0 -0
  457. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only/S6a.truth.json +0 -0
  458. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only/S6b.json +0 -0
  459. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only/S6b.truth.json +0 -0
  460. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S1.json +0 -0
  461. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S1.truth.json +0 -0
  462. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S2.json +0 -0
  463. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S2.truth.json +0 -0
  464. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S3.json +0 -0
  465. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S3.truth.json +0 -0
  466. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S4a.json +0 -0
  467. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S4a.truth.json +0 -0
  468. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S4b.json +0 -0
  469. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S4b.truth.json +0 -0
  470. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S5.json +0 -0
  471. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S5.truth.json +0 -0
  472. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S6a.json +0 -0
  473. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S6a.truth.json +0 -0
  474. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S6b.json +0 -0
  475. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_contrib/S6b.truth.json +0 -0
  476. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S1.json +0 -0
  477. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S1.truth.json +0 -0
  478. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S2.json +0 -0
  479. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S2.truth.json +0 -0
  480. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S3.json +0 -0
  481. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S3.truth.json +0 -0
  482. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S4a.json +0 -0
  483. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S4a.truth.json +0 -0
  484. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S4b.json +0 -0
  485. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S4b.truth.json +0 -0
  486. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S5.json +0 -0
  487. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S5.truth.json +0 -0
  488. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S6a.json +0 -0
  489. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S6a.truth.json +0 -0
  490. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S6b.json +0 -0
  491. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2_span_only_nolegacy/S6b.truth.json +0 -0
  492. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_event_only/S1.json +0 -0
  493. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_event_only/S1.truth.json +0 -0
  494. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_event_only/S2.json +0 -0
  495. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_event_only/S2.truth.json +0 -0
  496. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_event_only/S3.json +0 -0
  497. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_event_only/S3.truth.json +0 -0
  498. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_event_only/S4a.json +0 -0
  499. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_event_only/S4a.truth.json +0 -0
  500. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_event_only/S4b.json +0 -0
  501. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_event_only/S4b.truth.json +0 -0
  502. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_event_only/S5.json +0 -0
  503. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_event_only/S5.truth.json +0 -0
  504. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_event_only/S6a.json +0 -0
  505. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_event_only/S6a.truth.json +0 -0
  506. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_event_only/S6b.json +0 -0
  507. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_event_only/S6b.truth.json +0 -0
  508. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_no_content/S1.json +0 -0
  509. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_no_content/S1.truth.json +0 -0
  510. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_no_content/S2.json +0 -0
  511. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_no_content/S2.truth.json +0 -0
  512. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_no_content/S3.json +0 -0
  513. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_no_content/S3.truth.json +0 -0
  514. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_no_content/S4a.json +0 -0
  515. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_no_content/S4a.truth.json +0 -0
  516. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_no_content/S4b.json +0 -0
  517. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_no_content/S4b.truth.json +0 -0
  518. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_no_content/S5.json +0 -0
  519. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_no_content/S5.truth.json +0 -0
  520. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_no_content/S6a.json +0 -0
  521. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_no_content/S6a.truth.json +0 -0
  522. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_no_content/S6b.json +0 -0
  523. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_no_content/S6b.truth.json +0 -0
  524. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only/S1.json +0 -0
  525. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only/S1.truth.json +0 -0
  526. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only/S2.json +0 -0
  527. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only/S2.truth.json +0 -0
  528. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only/S3.json +0 -0
  529. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only/S3.truth.json +0 -0
  530. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only/S4a.json +0 -0
  531. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only/S4a.truth.json +0 -0
  532. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only/S4b.json +0 -0
  533. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only/S4b.truth.json +0 -0
  534. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only/S5.json +0 -0
  535. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only/S5.truth.json +0 -0
  536. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only/S6a.json +0 -0
  537. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only/S6a.truth.json +0 -0
  538. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only/S6b.json +0 -0
  539. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only/S6b.truth.json +0 -0
  540. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S1.json +0 -0
  541. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S1.truth.json +0 -0
  542. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S2.json +0 -0
  543. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S2.truth.json +0 -0
  544. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S3.json +0 -0
  545. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S3.truth.json +0 -0
  546. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S4a.json +0 -0
  547. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S4a.truth.json +0 -0
  548. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S4b.json +0 -0
  549. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S4b.truth.json +0 -0
  550. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S5.json +0 -0
  551. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S5.truth.json +0 -0
  552. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S6a.json +0 -0
  553. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S6a.truth.json +0 -0
  554. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S6b.json +0 -0
  555. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/adk_py/v2proj_span_only_contrib/S6b.truth.json +0 -0
  556. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/adk_cycle_poisons_batch.json +0 -0
  557. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/adk_cycle_poisons_batch.truth.json +0 -0
  558. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/adk_go_main.json +0 -0
  559. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/adk_go_main.truth.json +0 -0
  560. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/content_capture_off.json +0 -0
  561. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/content_capture_off.truth.json +0 -0
  562. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/deprecated_aliases.json +0 -0
  563. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/deprecated_aliases.truth.json +0 -0
  564. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/details_event_log_debug.json +0 -0
  565. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/details_event_log_debug.truth.json +0 -0
  566. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/duplicate_span_ids.json +0 -0
  567. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/duplicate_span_ids.truth.json +0 -0
  568. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/ext_eval_eventName.json +0 -0
  569. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/ext_eval_eventName.truth.json +0 -0
  570. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/ext_eval_event_name_attr.json +0 -0
  571. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/ext_eval_event_name_attr.truth.json +0 -0
  572. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/ext_eval_otel_event_name.json +0 -0
  573. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/ext_eval_otel_event_name.truth.json +0 -0
  574. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/ext_eval_span_event.json +0 -0
  575. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/ext_eval_span_event.truth.json +0 -0
  576. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/failed_inference_then_retry.json +0 -0
  577. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/failed_inference_then_retry.truth.json +0 -0
  578. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/mcp_tool_call.json +0 -0
  579. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/mcp_tool_call.truth.json +0 -0
  580. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/openai_agents_handoff.json +0 -0
  581. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/openai_agents_handoff.truth.json +0 -0
  582. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/openai_v2_logs_no_span_id_ambiguous.json +0 -0
  583. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/openai_v2_logs_no_span_id_ambiguous.truth.json +0 -0
  584. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/openai_v2_logs_no_span_id_single.json +0 -0
  585. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/openai_v2_logs_no_span_id_single.truth.json +0 -0
  586. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/openai_v2_logs_span_id.json +0 -0
  587. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/openai_v2_logs_span_id.truth.json +0 -0
  588. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/remote_parent_root.json +0 -0
  589. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/remote_parent_root.truth.json +0 -0
  590. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/self_parent.json +0 -0
  591. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/self_parent.truth.json +0 -0
  592. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/strands_span_events.json +0 -0
  593. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/strands_span_events.truth.json +0 -0
  594. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/three_trace_conversation.json +0 -0
  595. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/three_trace_conversation.truth.json +0 -0
  596. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/tool_error_no_error_type.json +0 -0
  597. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/tool_error_no_error_type.truth.json +0 -0
  598. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/two_span_cycle.json +0 -0
  599. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/two_span_cycle.truth.json +0 -0
  600. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/upstream_new_parts.json +0 -0
  601. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/upstream_new_parts.truth.json +0 -0
  602. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/util_genai_openai_tool_loop.json +0 -0
  603. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/hand/util_genai_openai_tool_loop.truth.json +0 -0
  604. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/README.md +0 -0
  605. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/adk_go_1turn.json +0 -0
  606. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/adk_go_1turn.truth.json +0 -0
  607. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/adk_go_2turn.json +0 -0
  608. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/adk_go_2turn.truth.json +0 -0
  609. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/claude_native_1turn_subagent.json +0 -0
  610. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/claude_native_1turn_subagent.truth.json +0 -0
  611. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/claude_native_2turn.json +0 -0
  612. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/claude_native_2turn.truth.json +0 -0
  613. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/claude_recipe_2turn.json +0 -0
  614. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/kagent/v1.0.0-alpha9/claude_recipe_2turn.truth.json +0 -0
  615. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/samples/helm.json +0 -0
  616. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/samples/helm.truth.json +0 -0
  617. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/samples/helm_2.json +0 -0
  618. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/samples/helm_2.truth.json +0 -0
  619. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/samples/helm_3.json +0 -0
  620. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/samples/helm_3.truth.json +0 -0
  621. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/samples/k8s.json +0 -0
  622. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/samples/k8s.truth.json +0 -0
  623. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/samples/tempo_export_with_batches.json +0 -0
  624. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/fixtures/otlp/samples/tempo_export_with_batches.truth.json +0 -0
  625. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/genai/__init__.py +0 -0
  626. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/genai/test_continuations.py +0 -0
  627. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/genai/test_corpus.py +0 -0
  628. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/genai/test_failed_turns.py +0 -0
  629. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/genai/test_grouping.py +0 -0
  630. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/genai/test_legacy_chat.py +0 -0
  631. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/genai/test_resumed_turns.py +0 -0
  632. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/genai/test_tools.py +0 -0
  633. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/integration/__init__.py +0 -0
  634. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/integration/conftest.py +0 -0
  635. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/integration/test_evaluation_pipeline.py +0 -0
  636. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/integration/test_live_agents.py +0 -0
  637. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/integration/test_otlp_grpc_receiver.py +0 -0
  638. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/integration/test_session_grouping.py +0 -0
  639. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/integration/test_timing_stress.py +0 -0
  640. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/otel/__init__.py +0 -0
  641. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/otel/builders.py +0 -0
  642. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/otel/test_emit.py +0 -0
  643. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/otel/test_own_spans.py +0 -0
  644. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/otel/test_store.py +0 -0
  645. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/resolvers/__init__.py +0 -0
  646. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/resolvers/test_kubernetes.py +0 -0
  647. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/resolvers/test_registry.py +0 -0
  648. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/run/__init__.py +0 -0
  649. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/run/test_fetcher.py +0 -0
  650. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/run/test_result_builder.py +0 -0
  651. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/run/test_service.py +0 -0
  652. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/run/test_sinks.py +0 -0
  653. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/storage/__init__.py +0 -0
  654. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/storage/test_config.py +0 -0
  655. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/storage/test_memory_repos.py +0 -0
  656. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/storage/test_migrator.py +0 -0
  657. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/storage/test_models.py +0 -0
  658. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/storage/test_postgres_repos.py +0 -0
  659. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/streaming/__init__.py +0 -0
  660. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/streaming/test_live.py +0 -0
  661. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/streaming/test_session_export.py +0 -0
  662. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/streaming/test_watchers.py +0 -0
  663. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_adk_bridge.py +0 -0
  664. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_api.py +0 -0
  665. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_builtin_metrics.py +0 -0
  666. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_credential_injection.py +0 -0
  667. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_efficiency_metrics.py +0 -0
  668. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_eval_config_loader.py +0 -0
  669. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_invocation_owners.py +0 -0
  670. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_jaeger_loader.py +0 -0
  671. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_layering.py +0 -0
  672. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_loader_auto.py +0 -0
  673. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_mcp_server.py +0 -0
  674. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_otlp_http_protocol.py +0 -0
  675. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_otlp_loader.py +0 -0
  676. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_otlp_receiver.py +0 -0
  677. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_output.py +0 -0
  678. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_protocol.py +0 -0
  679. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_rubrics.py +0 -0
  680. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_runner.py +0 -0
  681. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_sdk.py +0 -0
  682. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/tests/test_trace_metrics.py +0 -0
  683. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/.gitignore +0 -0
  684. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/README.md +0 -0
  685. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/eslint.config.js +0 -0
  686. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/index.html +0 -0
  687. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/package-lock.json +0 -0
  688. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/package.json +0 -0
  689. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/public/logo.svg +0 -0
  690. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/public/vite.svg +0 -0
  691. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/App.css +0 -0
  692. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/App.tsx +0 -0
  693. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/api/client.ts +0 -0
  694. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/assets/react.svg +0 -0
  695. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/annotation-queue/AnnotationDetailPanel.tsx +0 -0
  696. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/annotation-queue/AnnotationQueueView.tsx +0 -0
  697. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/annotation-queue/AnnotationTable.tsx +0 -0
  698. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/bug-report/BugReportModal.tsx +0 -0
  699. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/builder/BuilderHeader.tsx +0 -0
  700. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/builder/BuilderView.tsx +0 -0
  701. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/builder/EvalCaseCard.tsx +0 -0
  702. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/builder/EvalCasesList.tsx +0 -0
  703. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/builder/InvocationEditor.tsx +0 -0
  704. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/builder/JsonPreview.tsx +0 -0
  705. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/builder/MetadataEditor.tsx +0 -0
  706. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/builder/TraceUploadZone.tsx +0 -0
  707. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/builder/index.ts +0 -0
  708. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/dashboard/DashboardView.tsx +0 -0
  709. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/dashboard/MetricScoreCard.tsx +0 -0
  710. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/dashboard/PerformanceCard.tsx +0 -0
  711. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/dashboard/PerformanceCharts.tsx +0 -0
  712. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/dashboard/SummaryStats.tsx +0 -0
  713. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/dashboard/TraceCard.tsx +0 -0
  714. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/dashboard/TraceTable.tsx +0 -0
  715. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/inspector/ComparisonPanel.tsx +0 -0
  716. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/inspector/DataSection.tsx +0 -0
  717. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/inspector/InspectorHeader.tsx +0 -0
  718. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/inspector/InspectorLayout.tsx +0 -0
  719. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/inspector/InspectorView.tsx +0 -0
  720. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/inspector/InvocationCard.tsx +0 -0
  721. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/inspector/InvocationSummaryPanel.tsx +0 -0
  722. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/inspector/MetricResultsSection.tsx +0 -0
  723. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/inspector/MetricsComparisonSection.tsx +0 -0
  724. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/inspector/PerformanceSection.tsx +0 -0
  725. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/inspector/ToolCallList.tsx +0 -0
  726. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/inspector/TrajectoryComparisonDetails.tsx +0 -0
  727. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/runs/PassRateTrendChart.tsx +0 -0
  728. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/runs/PerMetricTrendChart.tsx +0 -0
  729. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/runs/RunDetailView.tsx +0 -0
  730. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/runs/RunsHistoryTable.tsx +0 -0
  731. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/runs/RunsView.tsx +0 -0
  732. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/runs/runHistory.ts +0 -0
  733. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/sidebar/Sidebar.tsx +0 -0
  734. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/streaming/LiveConversationPanel.tsx +0 -0
  735. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/streaming/LiveMessage.tsx +0 -0
  736. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/streaming/LiveStreamingView.tsx +0 -0
  737. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/streaming/SessionCard.tsx +0 -0
  738. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/streaming/SessionMetadata.tsx +0 -0
  739. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/upload/EvalSetEditorDrawer.tsx +0 -0
  740. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/upload/FileDropZone.tsx +0 -0
  741. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/upload/MetricSelector.tsx +0 -0
  742. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/upload/RawJsonPreview.tsx +0 -0
  743. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/upload/TraceEditorDrawer.tsx +0 -0
  744. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/upload/UploadView.tsx +0 -0
  745. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/components/welcome/WelcomeView.tsx +0 -0
  746. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/config.ts +0 -0
  747. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/context/TraceContext.tsx +0 -0
  748. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/context/TraceProvider.tsx +0 -0
  749. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/agentevals/api/v1alpha1/common_pb.d.ts +0 -0
  750. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/agentevals/api/v1alpha1/common_pb.js +0 -0
  751. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/agentevals/api/v1alpha1/conversion_pb.d.ts +0 -0
  752. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/agentevals/api/v1alpha1/conversion_pb.js +0 -0
  753. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/agentevals/api/v1alpha1/evaluation_pb.d.ts +0 -0
  754. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/agentevals/api/v1alpha1/evaluation_pb.js +0 -0
  755. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/agentevals/api/v1alpha1/runs_pb.d.ts +0 -0
  756. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/agentevals/api/v1alpha1/runs_pb.js +0 -0
  757. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/agentevals/api/v1alpha1/sessions_pb.d.ts +0 -0
  758. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/agentevals/api/v1alpha1/sessions_pb.js +0 -0
  759. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/agentevals/api/v1alpha1/system_pb.d.ts +0 -0
  760. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/agentevals/api/v1alpha1/system_pb.js +0 -0
  761. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/agentevals/api/v1alpha1/views_pb.d.ts +0 -0
  762. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/agentevals/api/v1alpha1/views_pb.js +0 -0
  763. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/opentelemetry/proto/common/v1/common_pb.d.ts +0 -0
  764. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/opentelemetry/proto/common/v1/common_pb.js +0 -0
  765. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/opentelemetry/proto/logs/v1/logs_pb.d.ts +0 -0
  766. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/opentelemetry/proto/logs/v1/logs_pb.js +0 -0
  767. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/opentelemetry/proto/resource/v1/resource_pb.d.ts +0 -0
  768. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/opentelemetry/proto/resource/v1/resource_pb.js +0 -0
  769. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/opentelemetry/proto/trace/v1/trace_pb.d.ts +0 -0
  770. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/generated/opentelemetry/proto/trace/v1/trace_pb.js +0 -0
  771. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/index.css +0 -0
  772. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/lib/console-capture.ts +0 -0
  773. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/lib/eval-config.ts +0 -0
  774. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/lib/evalset-builder.ts +0 -0
  775. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/lib/liveSessions.ts +0 -0
  776. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/lib/network-capture.ts +0 -0
  777. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/lib/toolPairing.ts +0 -0
  778. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/lib/trace-helpers.ts +0 -0
  779. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/lib/trace-loader.ts +0 -0
  780. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/lib/trace-metadata.ts +0 -0
  781. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/lib/trace-patcher.ts +0 -0
  782. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/lib/types.ts +0 -0
  783. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/lib/utils.ts +0 -0
  784. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/src/main.tsx +0 -0
  785. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/tsconfig.app.json +0 -0
  786. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/tsconfig.json +0 -0
  787. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/tsconfig.node.json +0 -0
  788. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/ui/vite.config.ts +0 -0
  789. {agentevals_cli-0.14.1 → agentevals_cli-0.15.0}/uv.lock +0 -0
@@ -1,6 +1,6 @@
1
1
  Metadata-Version: 2.5
2
2
  Name: agentevals-cli
3
- Version: 0.14.1
3
+ Version: 0.15.0
4
4
  Summary: Standalone framework to evaluate agent correctness based on portable OpenTelemetry traces
5
5
  License-File: LICENSE
6
6
  Requires-Python: >=3.11
@@ -260,7 +260,7 @@ docker run -p 8001:8001 -p 8002:8002 -p 4317:4317 -p 4318:4318 agentevals
260
260
  helm install agentevals oci://ghcr.io/agentevals-dev/agentevals/helm/agentevals
261
261
  ```
262
262
 
263
- The chart runs in memory by default. `--set storage.backend=postgres` with a bundled or external Postgres enables the async `/api/runs` pipeline and the Run History view. That storage layer is a preview and its schema may change between minor versions. See [Run History](docs/run-history.md) and the [Kubernetes example](examples/kubernetes/README.md) for a full walkthrough with kagent and an OpenTelemetry Collector.
263
+ The chart runs in memory by default. A parent chart can redirect every image with `global.imageRegistry` and add pull secrets with `global.imagePullSecrets`. `--set storage.backend=postgres` with a bundled or external Postgres enables the async `/api/runs` pipeline and the Run History view. That storage layer is a preview and its schema may change between minor versions. See [Run History](docs/run-history.md) and the [Kubernetes example](examples/kubernetes/README.md) for a full walkthrough with kagent and an OpenTelemetry Collector.
264
264
 
265
265
  ## Examples
266
266
 
@@ -213,7 +213,7 @@ docker run -p 8001:8001 -p 8002:8002 -p 4317:4317 -p 4318:4318 agentevals
213
213
  helm install agentevals oci://ghcr.io/agentevals-dev/agentevals/helm/agentevals
214
214
  ```
215
215
 
216
- The chart runs in memory by default. `--set storage.backend=postgres` with a bundled or external Postgres enables the async `/api/runs` pipeline and the Run History view. That storage layer is a preview and its schema may change between minor versions. See [Run History](docs/run-history.md) and the [Kubernetes example](examples/kubernetes/README.md) for a full walkthrough with kagent and an OpenTelemetry Collector.
216
+ The chart runs in memory by default. A parent chart can redirect every image with `global.imageRegistry` and add pull secrets with `global.imagePullSecrets`. `--set storage.backend=postgres` with a bundled or external Postgres enables the async `/api/runs` pipeline and the Run History view. That storage layer is a preview and its schema may change between minor versions. See [Run History](docs/run-history.md) and the [Kubernetes example](examples/kubernetes/README.md) for a full walkthrough with kagent and an OpenTelemetry Collector.
217
217
 
218
218
  ## Examples
219
219
 
@@ -0,0 +1,7 @@
1
+ apiVersion: v2
2
+ name: agentevals
3
+ description: agentevals web UI, gRPC API, OTLP HTTP+gRPC receivers, and MCP (Streamable HTTP)
4
+ type: application
5
+ # The release workflow sets version and appVersion to the release tag when it publishes the chart.
6
+ version: 0.14.1
7
+ appVersion: "0.14.1"
@@ -1,3 +1,6 @@
1
+ {{- if .Values.grpcApi.only }}
2
+ 1. gRPC API (agentevals.api.v1alpha1): port {{ .Values.service.grpcApi.port }} (Service port name: grpc-api). It is the only port on the pod network; the web UI, REST API, OTLP receivers and MCP listen on 127.0.0.1 inside the pod.
3
+ {{- else }}
1
4
  1. UI and API are available at port {{ .Values.service.http.port }} (Service port name: http).
2
5
  2. OTLP HTTP receiver: port {{ .Values.service.otlpHttp.port }} (OTEL_EXPORTER_OTLP_ENDPOINT=http://<service>:{{ .Values.service.otlpHttp.port }}).
3
6
  3. OTLP gRPC receiver: port {{ .Values.service.otlpGrpc.port }} (OTEL_EXPORTER_OTLP_ENDPOINT=<service>:{{ .Values.service.otlpGrpc.port }}, OTEL_EXPORTER_OTLP_PROTOCOL=grpc).
@@ -5,15 +8,30 @@
5
8
  {{- if .Values.grpcApi.enabled }}
6
9
  5. gRPC API (agentevals.api.v1alpha1): port {{ .Values.service.grpcApi.port }} (Service port name: grpc-api). Expose it only to trusted callers.
7
10
  {{- end }}
11
+ {{- end }}
8
12
  {{- if .Values.ephemeralVolume.enabled }}
9
- {{ ternary 6 5 .Values.grpcApi.enabled }}. An emptyDir is mounted at /tmp with HOME=/tmp/agentevals-home (ephemeral; lost on pod restart). Set ephemeralVolume.enabled=false and readOnlyRootFilesystem=false if you need a writable root without this mount.
13
+ {{ if .Values.grpcApi.only }}2{{ else }}{{ ternary 6 5 .Values.grpcApi.enabled }}{{ end }}. An emptyDir is mounted at /tmp with HOME=/tmp/agentevals-home (ephemeral; lost on pod restart). Set ephemeralVolume.enabled=false and readOnlyRootFilesystem=false if you need a writable root without this mount.
14
+ {{- end }}
15
+ {{- if .Values.grpcApi.auth.enabled }}
16
+
17
+ gRPC API callers send a ServiceAccount token for audience "{{ .Values.grpcApi.auth.audience }}" as "authorization: Bearer <token>" metadata.
18
+ Allowed ServiceAccounts: {{ join ", " .Values.grpcApi.auth.allowedServiceAccounts }}. Health checks need no token.
19
+ {{- if not .Values.grpcApi.only }}
20
+ WARNING: authentication covers only the gRPC API. The UI, REST API, OTLP receivers and MCP stay unauthenticated; set grpcApi.only=true to keep them on 127.0.0.1.
21
+ {{- end }}
10
22
  {{- end }}
11
23
 
12
24
  Get the Service URL:
13
25
  export POD_NAME=$(kubectl get pods --namespace {{ include "agentevals.namespace" . }} -l "app.kubernetes.io/name={{ include "agentevals.name" . }},app.kubernetes.io/instance={{ .Release.Name }}" -o jsonpath="{.items[0].metadata.name}")
14
26
  kubectl --namespace {{ include "agentevals.namespace" . }} port-forward $POD_NAME {{ .Values.service.http.port }}:{{ .Values.service.http.port }}
15
27
 
28
+ {{- if .Values.grpcApi.only }}
29
+
30
+ Health check: grpc.health.v1 on <pod-ip>:{{ .Values.service.grpcApi.containerPort }}
31
+ {{- else }}
32
+
16
33
  Health check: GET http://<pod-ip>:{{ .Values.service.http.containerPort }}/api/health
34
+ {{- end }}
17
35
 
18
36
  {{- if eq .Values.storage.backend "postgres" }}
19
37
 
@@ -0,0 +1,150 @@
1
+ {{- define "agentevals.name" -}}
2
+ {{- default .Chart.Name .Values.nameOverride | trunc 63 | trimSuffix "-" }}
3
+ {{- end }}
4
+
5
+ {{- define "agentevals.fullname" -}}
6
+ {{- if .Values.fullnameOverride }}
7
+ {{- .Values.fullnameOverride | trunc 63 | trimSuffix "-" }}
8
+ {{- else }}
9
+ {{- $name := default .Chart.Name .Values.nameOverride }}
10
+ {{- if contains $name .Release.Name }}
11
+ {{- .Release.Name | trunc 63 | trimSuffix "-" }}
12
+ {{- else }}
13
+ {{- printf "%s-%s" .Release.Name $name | trunc 63 | trimSuffix "-" }}
14
+ {{- end }}
15
+ {{- end }}
16
+ {{- end }}
17
+
18
+ {{- define "agentevals.namespace" -}}
19
+ {{- default .Release.Namespace .Values.namespaceOverride }}
20
+ {{- end }}
21
+
22
+ {{- define "agentevals.chart" -}}
23
+ {{- printf "%s-%s" .Chart.Name .Chart.Version | replace "+" "_" | trunc 63 | trimSuffix "-" }}
24
+ {{- end }}
25
+
26
+ {{- define "agentevals.image" -}}
27
+ {{- $registry := (.Values.global | default dict).imageRegistry | default .Values.image.registry | default .Values.registry -}}
28
+ {{- $tag := .Values.image.tag | default .Values.tag | default .Chart.AppVersion -}}
29
+ {{- if $registry -}}
30
+ {{- printf "%s/%s:%s" $registry .Values.image.repository $tag -}}
31
+ {{- else -}}
32
+ {{- printf "%s:%s" .Values.image.repository $tag -}}
33
+ {{- end -}}
34
+ {{- end }}
35
+
36
+ {{- define "agentevals.labels" -}}
37
+ helm.sh/chart: {{ include "agentevals.chart" . }}
38
+ {{ include "agentevals.selectorLabels" . }}
39
+ {{- if .Chart.AppVersion }}
40
+ app.kubernetes.io/version: {{ .Chart.AppVersion | quote }}
41
+ {{- end }}
42
+ app.kubernetes.io/managed-by: {{ .Release.Service }}
43
+ app.kubernetes.io/part-of: agentevals
44
+ {{- end }}
45
+
46
+ {{- define "agentevals.selectorLabels" -}}
47
+ app.kubernetes.io/name: {{ include "agentevals.name" . }}
48
+ app.kubernetes.io/instance: {{ .Release.Name }}
49
+ {{- end }}
50
+
51
+ {{- /*
52
+ Selector labels scoped to the main app Pod and its Service. Carries the
53
+ ``app.kubernetes.io/component: agentevals`` discriminator so the agentevals
54
+ Service does not also match the bundled Postgres Pod (which carries
55
+ ``app.kubernetes.io/component: database`` instead).
56
+ */ -}}
57
+ {{- define "agentevals.app.selectorLabels" -}}
58
+ {{ include "agentevals.selectorLabels" . }}
59
+ app.kubernetes.io/component: agentevals
60
+ {{- end }}
61
+
62
+ {{- define "agentevals.serviceAccountName" -}}
63
+ {{- if .Values.serviceAccount.create }}
64
+ {{- default (include "agentevals.fullname" .) .Values.serviceAccount.name }}
65
+ {{- else }}
66
+ {{- default "default" .Values.serviceAccount.name }}
67
+ {{- end }}
68
+ {{- end }}
69
+
70
+ {{/*
71
+ Service name for the bundled Postgres instance.
72
+ */}}
73
+ {{- define "agentevals.postgresqlServiceName" -}}
74
+ {{- printf "%s-postgresql" (include "agentevals.fullname" .) -}}
75
+ {{- end -}}
76
+
77
+ {{/*
78
+ Bundled Postgres image reference (registry/repository/name:tag).
79
+ */}}
80
+ {{- define "agentevals.postgresql.image" -}}
81
+ {{- $pg := .Values.database.postgres.bundled -}}
82
+ {{- $registry := (.Values.global | default dict).imageRegistry | default $pg.image.registry -}}
83
+ {{- printf "%s/%s/%s:%s" $registry $pg.image.repository $pg.image.name $pg.image.tag -}}
84
+ {{- end -}}
85
+
86
+ {{/*
87
+ imagePullSecrets for every pod: imagePullSecrets merged (union) with global.imagePullSecrets.
88
+ */}}
89
+ {{- define "agentevals.imagePullSecrets" -}}
90
+ {{- with concat (.Values.imagePullSecrets | default list) ((.Values.global | default dict).imagePullSecrets | default list) | uniq -}}
91
+ imagePullSecrets:
92
+ {{- toYaml . | nindent 2 }}
93
+ {{- end -}}
94
+ {{- end -}}
95
+
96
+ {{/*
97
+ imagePullPolicy for a container: its own value, then imagePullPolicy, then global.imagePullPolicy,
98
+ then IfNotPresent.
99
+ Usage: {{ include "agentevals.imagePullPolicy" (dict "root" $ "local" .Values.image.pullPolicy) }}
100
+ */}}
101
+ {{- define "agentevals.imagePullPolicy" -}}
102
+ {{- .local | default .root.Values.imagePullPolicy | default ((.root.Values.global | default dict).imagePullPolicy) | default "IfNotPresent" -}}
103
+ {{- end -}}
104
+
105
+ {{/*
106
+ ClusterRole and ClusterRoleBinding name for TokenReviews; cluster scoped, so it carries the namespace.
107
+ */}}
108
+ {{- define "agentevals.tokenReviewName" -}}
109
+ {{- printf "%s-%s-tokenreview" (include "agentevals.namespace" .) (include "agentevals.fullname" .) -}}
110
+ {{- end -}}
111
+
112
+ {{/*
113
+ Fail the render on a gRPC API setup the server would refuse, or one that grants the TokenReview
114
+ permission to the namespace's default ServiceAccount.
115
+ */}}
116
+ {{- define "agentevals.validateGrpcApi" -}}
117
+ {{- $api := .Values.grpcApi -}}
118
+ {{- if and $api.only (not $api.enabled) -}}
119
+ {{- fail "grpcApi.only needs grpcApi.enabled=true" -}}
120
+ {{- end -}}
121
+ {{- if $api.auth.enabled -}}
122
+ {{- if not $api.enabled -}}
123
+ {{- fail "grpcApi.auth.enabled needs grpcApi.enabled=true" -}}
124
+ {{- end -}}
125
+ {{- if empty $api.auth.audience -}}
126
+ {{- fail "grpcApi.auth.enabled needs grpcApi.auth.audience" -}}
127
+ {{- end -}}
128
+ {{- if empty $api.auth.allowedServiceAccounts -}}
129
+ {{- fail "grpcApi.auth.enabled needs grpcApi.auth.allowedServiceAccounts (namespace/name): any pod can mint a token for any audience, so the audience alone authorizes nothing" -}}
130
+ {{- end -}}
131
+ {{- range $api.auth.allowedServiceAccounts -}}
132
+ {{- if not (regexMatch "^[a-z0-9]([-a-z0-9]{0,61}[a-z0-9])?/[a-z0-9]([-a-z0-9.]{0,251}[a-z0-9])?$" (toString .)) -}}
133
+ {{- fail (printf "grpcApi.auth.allowedServiceAccounts: %q is not namespace/name" (toString .)) -}}
134
+ {{- end -}}
135
+ {{- end -}}
136
+ {{- if and (not .Values.serviceAccount.create) (empty .Values.serviceAccount.name) -}}
137
+ {{- fail "grpcApi.auth.enabled needs serviceAccount.create=true or serviceAccount.name, so the TokenReview permission does not go to the namespace's default ServiceAccount" -}}
138
+ {{- end -}}
139
+ {{- if and .Values.serviceAccount.create (not .Values.serviceAccount.automount) -}}
140
+ {{- fail "grpcApi.auth.enabled needs serviceAccount.automount=true: the server calls the TokenReview API with its ServiceAccount token" -}}
141
+ {{- end -}}
142
+ {{- end -}}
143
+ {{- end -}}
144
+
145
+ {{/*
146
+ Secret name holding POSTGRES_PASSWORD for the bundled Postgres instance.
147
+ */}}
148
+ {{- define "agentevals.passwordSecretName" -}}
149
+ {{- printf "%s-postgresql" (include "agentevals.fullname" .) -}}
150
+ {{- end -}}
@@ -1,3 +1,4 @@
1
+ {{- include "agentevals.validateGrpcApi" . -}}
1
2
  apiVersion: apps/v1
2
3
  kind: Deployment
3
4
  metadata:
@@ -22,9 +23,8 @@ spec:
22
23
  {{- toYaml . | nindent 8 }}
23
24
  {{- end }}
24
25
  spec:
25
- {{- with .Values.imagePullSecrets }}
26
- imagePullSecrets:
27
- {{- toYaml . | nindent 8 }}
26
+ {{- with include "agentevals.imagePullSecrets" . }}
27
+ {{- . | nindent 6 }}
28
28
  {{- end }}
29
29
  securityContext:
30
30
  {{- toYaml .Values.podSecurityContext | nindent 8 }}
@@ -52,7 +52,7 @@ spec:
52
52
  containers:
53
53
  - name: agentevals
54
54
  image: {{ include "agentevals.image" . | quote }}
55
- imagePullPolicy: {{ .Values.image.pullPolicy | default .Values.imagePullPolicy }}
55
+ imagePullPolicy: {{ include "agentevals.imagePullPolicy" (dict "root" $ "local" .Values.image.pullPolicy) }}
56
56
  {{- if .Values.command }}
57
57
  command:
58
58
  {{- toYaml .Values.command | nindent 12 }}
@@ -70,6 +70,18 @@ spec:
70
70
  - name: AGENTEVALS_GRPC_REFLECTION
71
71
  value: "true"
72
72
  {{- end }}
73
+ {{- if .Values.grpcApi.only }}
74
+ - name: AGENTEVALS_API_GRPC_ONLY
75
+ value: "true"
76
+ {{- end }}
77
+ {{- if .Values.grpcApi.auth.enabled }}
78
+ - name: AGENTEVALS_API_GRPC_AUTH
79
+ value: "kubernetes"
80
+ - name: AGENTEVALS_API_GRPC_AUTH_AUDIENCE
81
+ value: {{ .Values.grpcApi.auth.audience | quote }}
82
+ - name: AGENTEVALS_API_GRPC_AUTH_ALLOWED_SERVICE_ACCOUNTS
83
+ value: {{ join "," .Values.grpcApi.auth.allowedServiceAccounts | quote }}
84
+ {{- end }}
73
85
  {{- if .Values.ephemeralVolume.enabled }}
74
86
  - name: TMPDIR
75
87
  value: "/tmp"
@@ -111,6 +123,7 @@ spec:
111
123
  {{- toYaml . | nindent 12 }}
112
124
  {{- end }}
113
125
  ports:
126
+ {{- if not .Values.grpcApi.only }}
114
127
  - name: http
115
128
  containerPort: {{ .Values.service.http.containerPort }}
116
129
  protocol: TCP
@@ -123,6 +136,7 @@ spec:
123
136
  - name: mcp
124
137
  containerPort: {{ .Values.service.mcp.containerPort }}
125
138
  protocol: TCP
139
+ {{- end }}
126
140
  {{- if .Values.grpcApi.enabled }}
127
141
  - name: grpc-api
128
142
  containerPort: {{ .Values.service.grpcApi.containerPort }}
@@ -136,15 +150,21 @@ spec:
136
150
  {{- $_ := set $sc "readOnlyRootFilesystem" false }}
137
151
  {{- end }}
138
152
  {{- toYaml $sc | nindent 12 }}
153
+ {{- /* In grpcApi.only mode /api/health listens on 127.0.0.1, out of the kubelet's reach. */}}
139
154
  startupProbe:
155
+ {{- if .Values.grpcApi.only }}
156
+ grpc:
157
+ port: {{ .Values.service.grpcApi.containerPort }}
158
+ {{- else }}
140
159
  httpGet:
141
160
  path: /api/health
142
161
  port: http
162
+ {{- end }}
143
163
  failureThreshold: 60
144
164
  periodSeconds: 10
145
165
  timeoutSeconds: 5
146
166
  readinessProbe:
147
- {{- if and .Values.grpcApi.enabled .Values.grpcApi.grpcReadinessProbe }}
167
+ {{- if and .Values.grpcApi.enabled (or .Values.grpcApi.only .Values.grpcApi.grpcReadinessProbe) }}
148
168
  grpc:
149
169
  port: {{ .Values.service.grpcApi.containerPort }}
150
170
  {{- else }}
@@ -155,9 +175,14 @@ spec:
155
175
  initialDelaySeconds: 5
156
176
  periodSeconds: 10
157
177
  livenessProbe:
178
+ {{- if .Values.grpcApi.only }}
179
+ grpc:
180
+ port: {{ .Values.service.grpcApi.containerPort }}
181
+ {{- else }}
158
182
  httpGet:
159
183
  path: /api/health
160
184
  port: http
185
+ {{- end }}
161
186
  initialDelaySeconds: 15
162
187
  periodSeconds: 20
163
188
  {{- if or .Values.ephemeralVolume.enabled .Values.extraVolumeMounts }}
@@ -51,9 +51,8 @@ spec:
51
51
  {{- include "agentevals.selectorLabels" . | nindent 8 }}
52
52
  app.kubernetes.io/component: database
53
53
  spec:
54
- {{- with .Values.imagePullSecrets }}
55
- imagePullSecrets:
56
- {{- toYaml . | nindent 8 }}
54
+ {{- with include "agentevals.imagePullSecrets" . }}
55
+ {{- . | nindent 6 }}
57
56
  {{- end }}
58
57
  serviceAccountName: {{ $fullname }}
59
58
  securityContext:
@@ -64,7 +63,7 @@ spec:
64
63
  containers:
65
64
  - name: postgresql
66
65
  image: {{ include "agentevals.postgresql.image" . }}
67
- imagePullPolicy: {{ $pg.image.pullPolicy }}
66
+ imagePullPolicy: {{ include "agentevals.imagePullPolicy" (dict "root" $ "local" $pg.image.pullPolicy) }}
68
67
  securityContext:
69
68
  allowPrivilegeEscalation: false
70
69
  ports:
@@ -0,0 +1,27 @@
1
+ {{- if .Values.grpcApi.auth.enabled -}}
2
+ apiVersion: rbac.authorization.k8s.io/v1
3
+ kind: ClusterRole
4
+ metadata:
5
+ name: {{ include "agentevals.tokenReviewName" . }}
6
+ labels:
7
+ {{- include "agentevals.labels" . | nindent 4 }}
8
+ rules:
9
+ - apiGroups: ["authentication.k8s.io"]
10
+ resources: ["tokenreviews"]
11
+ verbs: ["create"]
12
+ ---
13
+ apiVersion: rbac.authorization.k8s.io/v1
14
+ kind: ClusterRoleBinding
15
+ metadata:
16
+ name: {{ include "agentevals.tokenReviewName" . }}
17
+ labels:
18
+ {{- include "agentevals.labels" . | nindent 4 }}
19
+ roleRef:
20
+ apiGroup: rbac.authorization.k8s.io
21
+ kind: ClusterRole
22
+ name: {{ include "agentevals.tokenReviewName" . }}
23
+ subjects:
24
+ - kind: ServiceAccount
25
+ name: {{ include "agentevals.serviceAccountName" . }}
26
+ namespace: {{ include "agentevals.namespace" . }}
27
+ {{- end }}
@@ -8,6 +8,7 @@ metadata:
8
8
  spec:
9
9
  type: {{ .Values.service.type }}
10
10
  ports:
11
+ {{- if not .Values.grpcApi.only }}
11
12
  - name: http
12
13
  port: {{ .Values.service.http.port }}
13
14
  targetPort: http
@@ -24,6 +25,7 @@ spec:
24
25
  port: {{ .Values.service.mcp.port }}
25
26
  targetPort: mcp
26
27
  protocol: TCP
28
+ {{- end }}
27
29
  {{- if .Values.grpcApi.enabled }}
28
30
  - name: grpc-api
29
31
  port: {{ .Values.service.grpcApi.port }}
@@ -2,6 +2,18 @@
2
2
  # Global
3
3
  # ==============================================================================
4
4
 
5
+ # Values a parent chart can share with this one.
6
+ global:
7
+ # -- Registry for every image of this chart, including the bundled Postgres.
8
+ # Takes precedence over registry, image.registry and
9
+ # database.postgres.bundled.image.registry.
10
+ imageRegistry: ""
11
+ # -- Pull secrets for every pod of this chart, merged (union) with
12
+ # imagePullSecrets.
13
+ imagePullSecrets: []
14
+ # -- Fallback pull policy where neither the image nor imagePullPolicy sets one.
15
+ imagePullPolicy: ""
16
+
5
17
  # -- Number of replicas. Keep 1 when agents or a Collector send OTLP to this
6
18
  # release: live sessions are held in the memory of the pod that receives them,
7
19
  # so with more replicas one session's traces and logs end up split across pods.
@@ -9,16 +21,18 @@
9
21
  # replicas (SELECT FOR UPDATE SKIP LOCKED claims), not live sessions.
10
22
  replicaCount: 1
11
23
 
12
- # -- Global container image registry (prepended to image.repository)
24
+ # -- Container image registry (prepended to image.repository). global.imageRegistry
25
+ # takes precedence.
13
26
  registry: ghcr.io
14
27
 
15
28
  # -- Global image tag override (defaults to Chart.appVersion)
16
29
  tag: ""
17
30
 
18
- # -- Global image pull policy
19
- imagePullPolicy: IfNotPresent
31
+ # -- Image pull policy for every container. Empty falls back to
32
+ # global.imagePullPolicy, then IfNotPresent.
33
+ imagePullPolicy: ""
20
34
 
21
- # -- Image pull secrets
35
+ # -- Image pull secrets, merged with global.imagePullSecrets
22
36
  imagePullSecrets: []
23
37
 
24
38
  # -- Override the chart name
@@ -41,7 +55,7 @@ image:
41
55
  repository: agentevals-dev/agentevals
42
56
  # -- Container image tag (defaults to global tag, then Chart.appVersion)
43
57
  tag: ""
44
- # -- Container image pull policy (defaults to global imagePullPolicy)
58
+ # -- Container image pull policy (defaults to imagePullPolicy)
45
59
  pullPolicy: ""
46
60
 
47
61
  # ==============================================================================
@@ -159,6 +173,24 @@ grpcApi:
159
173
  # -- Check readiness with the gRPC health service on the gRPC API port instead of HTTP
160
174
  # /api/health
161
175
  grpcReadinessProbe: false
176
+ # -- Serve only the gRPC API on the pod network (--api-grpc-only). The web UI and
177
+ # REST API, the OTLP receivers and MCP listen on 127.0.0.1 inside the pod, where
178
+ # kubectl port-forward still reaches them. The Service exposes only grpc-api and
179
+ # every probe uses the gRPC health service.
180
+ only: false
181
+ auth:
182
+ # -- Require a Kubernetes ServiceAccount token on every gRPC API call except
183
+ # health checks (--api-grpc-auth kubernetes). Renders a ClusterRole and
184
+ # ClusterRoleBinding that let the chart's ServiceAccount create TokenReviews,
185
+ # so it needs serviceAccount.create or serviceAccount.name. Covers only the
186
+ # gRPC API: combine it with grpcApi.only.
187
+ enabled: false
188
+ # -- Audience the callers' tokens must be minted for
189
+ audience: agentevals
190
+ # -- ServiceAccounts allowed to call the API, as namespace/name. Required when
191
+ # enabled: any pod can mint a token for any audience, so the audience alone
192
+ # authorizes nothing.
193
+ allowedServiceAccounts: []
162
194
 
163
195
  # ==============================================================================
164
196
  # Resources
@@ -273,8 +305,8 @@ database:
273
305
  name: postgres
274
306
  # -- Bundled Postgres image tag
275
307
  tag: "18.3-alpine"
276
- # -- Bundled Postgres image pull policy
277
- pullPolicy: IfNotPresent
308
+ # -- Bundled Postgres image pull policy (defaults to imagePullPolicy)
309
+ pullPolicy: ""
278
310
  # -- PersistentVolumeClaim size for the bundled Postgres data
279
311
  storage: 1Gi
280
312
  # -- StorageClass for the PVC. Defaults to the cluster default when empty.
@@ -50,12 +50,28 @@ Errors use standard gRPC status codes with a `google.rpc.ErrorInfo` detail whose
50
50
  | Setting | Purpose |
51
51
  |---------|---------|
52
52
  | `--api-grpc-port` or `AGENTEVALS_API_GRPC_PORT` | Port, default `8002`; `0` turns the API off |
53
+ | `--api-grpc-only` or `AGENTEVALS_API_GRPC_ONLY=true` | Serve only the gRPC API on `--host`, see below |
54
+ | `--api-grpc-auth` or `AGENTEVALS_API_GRPC_AUTH` | `none` (default) or `kubernetes`, see [Security](#security) |
55
+ | `--api-grpc-auth-audience` or `AGENTEVALS_API_GRPC_AUTH_AUDIENCE` | Token audience, default `agentevals` |
56
+ | `--api-grpc-auth-allowed-service-account` or `AGENTEVALS_API_GRPC_AUTH_ALLOWED_SERVICE_ACCOUNTS` | Allowed ServiceAccount as `namespace/name`; repeat the flag, or comma separate the env var |
53
57
  | `AGENTEVALS_GRPC_REFLECTION=true` | Turn on server reflection |
54
58
  | `AGENTEVALS_API_TRACES=true` | Export traces of the API server itself (see below) |
55
59
 
56
60
  Messages can be up to 16 MiB. Uploaded trace documents are limited to 10 MiB each, as in the REST API.
57
61
 
58
- The Helm chart has the same switches under `grpcApi`: `enabled`, `reflection`, and `grpcReadinessProbe` to check readiness with the gRPC health service. The Service exposes the port as `grpc-api`.
62
+ The Helm chart has the same switches under `grpcApi`: `enabled`, `reflection`, `grpcReadinessProbe` to check readiness with the gRPC health service, `only`, and `auth`. The Service exposes the port as `grpc-api`.
63
+
64
+ ### Serving only the gRPC API
65
+
66
+ When one program is the only caller, run the server with `--api-grpc-only`. The gRPC API listens on `--host`. The web UI and REST API, both OTLP receivers and MCP listen on `127.0.0.1` only, so nothing else is reachable from the network:
67
+
68
+ ```bash
69
+ uv run agentevals serve --api-grpc-only
70
+ ```
71
+
72
+ Check health with `grpc.health.v1` on the gRPC API port; `/api/health` is only reachable from inside the host or pod. `kubectl port-forward` still reaches the web UI, because it connects to the pod's loopback address.
73
+
74
+ In the Helm chart, `grpcApi.only=true` does the same. The Service then exposes only `grpc-api`, and the startup, readiness and liveness probes use the gRPC health service.
59
75
 
60
76
  ## Tracing the API server
61
77
 
@@ -70,6 +86,44 @@ AGENTEVALS_API_TRACES=true OTEL_TRACES_EXPORTER=console uv run agentevals serve
70
86
 
71
87
  ## Security
72
88
 
73
- The API has no authentication. Any caller that can reach the port can read sessions, run evaluations with the server's credentials, and submit runs. Expose port 8002 only to trusted callers, for example inside a cluster behind a NetworkPolicy, and put authentication in front of it when you need it.
89
+ By default the API has no authentication. Any caller that can reach the port can read sessions, run evaluations with the server's credentials, and submit runs. Expose port 8002 only to trusted callers.
74
90
 
75
91
  On a laptop `agentevals serve` listens on all interfaces. Pass `--host 127.0.0.1` to keep every port local.
92
+
93
+ ### Kubernetes ServiceAccount authentication
94
+
95
+ Inside a cluster, the server can admit only the ServiceAccounts you name:
96
+
97
+ ```bash
98
+ agentevals serve --api-grpc-only \
99
+ --api-grpc-auth kubernetes \
100
+ --api-grpc-auth-allowed-service-account evals/controller
101
+ ```
102
+
103
+ Callers send a ServiceAccount token minted for the audience as `authorization: Bearer <token>` metadata, for example a [projected token](https://kubernetes.io/docs/concepts/storage/projected-volumes/#serviceaccounttoken) with `audience: agentevals`. The server checks it with a TokenReview, so its own ServiceAccount needs `create` on `tokenreviews.authentication.k8s.io`.
104
+
105
+ | Result | Status |
106
+ |--------|--------|
107
+ | No token, a malformed or expired token, a token for another audience, or a user that is not a ServiceAccount | `UNAUTHENTICATED` |
108
+ | A valid ServiceAccount that is not on the list | `PERMISSION_DENIED` |
109
+ | The TokenReview fails, for example because the Kubernetes API is down | `UNAVAILABLE` |
110
+
111
+ The list is required: any pod can mint a token for any audience, so the audience alone proves nothing. The server refuses to start with an empty list, and never lets a call through when a check fails. A successful check is cached for up to 30 seconds and never past the token's expiry. Health checks need no token. Reflection, when turned on, needs one like every other call: `grpcurl -H "authorization: Bearer $TOKEN" ...`.
112
+
113
+ Authentication covers only the gRPC API. Combine it with `--api-grpc-only` so the REST API, the OTLP receivers and MCP stay on `127.0.0.1`; without it the server prints a warning.
114
+
115
+ With the Helm chart:
116
+
117
+ ```yaml
118
+ serviceAccount:
119
+ create: true
120
+ grpcApi:
121
+ only: true
122
+ auth:
123
+ enabled: true
124
+ audience: agentevals
125
+ allowedServiceAccounts:
126
+ - evals/controller
127
+ ```
128
+
129
+ The chart then adds a ClusterRole and ClusterRoleBinding that let its ServiceAccount create TokenReviews. It refuses to render with an empty `allowedServiceAccounts`, or without `serviceAccount.create` or `serviceAccount.name`, so the permission never goes to the namespace's `default` ServiceAccount.
@@ -137,7 +137,7 @@ def _build_lifespan():
137
137
  from .rpc.services import ApiContext
138
138
 
139
139
  context = ApiContext(manager=mgr, run_service=getattr(app.state, "run_service", None), ports=api_grpc.ports)
140
- api_server = await start_api_server(context, api_grpc.host, api_grpc.port)
140
+ api_server = await start_api_server(context, api_grpc.host, api_grpc.port, api_grpc.auth)
141
141
 
142
142
  yield
143
143