@mastra/evals 1.2.0 → 1.2.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (10) hide show
  1. package/CHANGELOG.md +28 -0
  2. package/dist/docs/SKILL.md +1 -1
  3. package/dist/docs/assets/SOURCE_MAP.json +1 -1
  4. package/dist/docs/references/docs-evals-built-in-scorers.md +1 -1
  5. package/dist/docs/references/docs-evals-overview.md +8 -9
  6. package/dist/scorers/prebuilt/index.cjs +1 -1
  7. package/dist/scorers/prebuilt/index.cjs.map +1 -1
  8. package/dist/scorers/prebuilt/index.js +1 -1
  9. package/dist/scorers/prebuilt/index.js.map +1 -1
  10. package/package.json +7 -7
package/dist/scorers/prebuilt/index.js CHANGED
@@ -324,7 +324,7 @@ Matching Guidelines:
324
324
  - "semantic": The same concept or fact expressed differently but with equivalent meaning
325
325
  - "partial": Some overlap but missing important details or context
326
326
  - "missing": No corresponding information found in the output
327
- - "contradiction": Information that directly conflicts with the ground truth (wrong facts, incorrect names, false claims)
327
+ - For factually incorrect information (wrong facts, incorrect names), mark the match as "missing" and add it to the "contradictions" array
328
328
 
329
329
  CRITICAL: If the output contains factually incorrect information (wrong names, wrong facts, opposite claims), you MUST identify contradictions and mark relevant matches as "missing" while adding entries to the contradictions array.
330
330