@mastra/evals 1.6.0 → 1.7.0

package/dist/docs/references/docs-evals-overview.md

@@ -2,7 +2,7 @@
 
 # Scorers overview
 
-While traditional software tests have clear pass/fail conditions, AI outputs are non-deterministic — they can vary with the same input. **Scorers** help bridge this gap by providing quantifiable metrics for measuring agent quality.
+While traditional software tests have clear pass/fail conditions, AI outputs are non-deterministic, they can vary with the same input. **Scorers** help bridge this gap by providing quantifiable metrics for measuring agent quality.
 
 Scorers are automated tests that evaluate Agents outputs using model-graded, rule-based, and statistical methods. Scorers return **scores**: numerical values (typically between 0 and 1) that quantify how well an output meets your evaluation criteria. These scores enable you to objectively track performance, compare different approaches, and identify areas for improvement in your AI systems. Scorers can be customized with your own prompts and scoring functions.
 
@@ -114,7 +114,9 @@ export const contentWorkflow = createWorkflow({ ... })
 
 ## Trace evaluations
 
-In addition to live evaluations, you can use scorers to evaluate historical traces from your agent interactions and workflows. This is particularly useful for analyzing past performance, debugging issues, or running batch evaluations.
+In addition to live evaluations, you can use scorers to evaluate historical traces from your agent interactions and workflows.
+
+This is particularly useful for analyzing past performance or debugging issues, or alternatively running batch evaluations.
 
 > **Observability required:** To score traces, you must first configure observability in your Mastra instance to collect trace data. See [Tracing documentation](https://mastra.ai/docs/observability/tracing/overview) for setup instructions.
 
@@ -131,11 +133,11 @@ const mastra = new Mastra({
 })
 ```
 
-Once registered, you can score traces interactively within Studio under the **Observability** section. Open Studio to manage scorers, review scores, and run experiments.
+Once registered, you can score traces interactively within Studio under the **Observability** section. Open Studio to manage scorers and review scores, plus run experiments.
 
 - **Scorers list**: Browse all registered scorers with their description, and the number of agents and workflows each scorer is attached to.
 - **Score results**: Select a scorer to see a paginated list of every score it has produced. Click a row to open the detail panel, which shows the score value, reason, input, output, and the prompts used by the judge. From this panel, save any result as a dataset item for future experiments.
-- **Agent Evaluate tab**: Open the Evaluate tab on any agent to attach or detach scorers, create or edit stored scorers inline, manage datasets, and run experiments. Experiment results display per-item scores alongside pass/fail status and version tags.
+- **Agent Evaluate tab**: Open the Evaluate tab on any agent to manage scorers and datasets. You can also run experiments there. Experiment results display per-item scores alongside pass/fail status and version tags.
 - **Trace scoring**: In the Observability section, run a scorer against any historical trace or span to evaluate past interactions. Filter scores by agent or workflow.
 
 ## Next steps

package/dist/docs/references/docs-evals-quick-checks.md

@@ -35,7 +35,7 @@ console.log(result.scores)
 
 ## Available checks
 
-Quick Checks fall into two categories:
+Quick Checks fall into these categories:
 
 ### Text checks
 
@@ -105,7 +105,7 @@ export const weatherAgent = new Agent({
   id: 'weather-agent',
   name: 'Weather Agent',
   instructions: 'Answer weather questions using the get_weather tool.',
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   tools: { get_weather: weatherTool },
   scorers: {
     noErrors: {

package/dist/docs/references/reference-evals-answer-relevancy.md

@@ -39,7 +39,7 @@ The scorer evaluates relevancy through query-answer alignment, considering compl
 ### Scoring Process
 
 1. **Statement Preprocess:**
-   - Breaks output into meaningful statements while preserving context.
+   - Breaks output into useful statements while preserving context.
 
 2. **Relevance Analysis:**
 
@@ -57,9 +57,9 @@ The scorer evaluates relevancy through query-answer alignment, considering compl
 A relevancy score between 0 and 1:
 
 - **1.0**: The response fully answers the query with relevant and focused information.
-- **0.7–0.9**: The response mostly answers the query but may include minor unrelated content.
-- **0.4–0.6**: The response partially answers the query, mixing relevant and unrelated information.
-- **0.1–0.3**: The response includes minimal relevant content and largely misses the intent of the query.
+- **0.7 to 0.9**: The response mostly answers the query but may include minor unrelated content.
+- **0.4 to 0.6**: The response partially answers the query, mixing relevant and unrelated information.
+- **0.1 to 0.3**: The response includes minimal relevant content and largely misses the intent of the query.
 - **0.0**: The response is entirely unrelated and doesn't answer the query.
 
 ## Example
@@ -71,7 +71,7 @@ import { runEvals } from '@mastra/core/evals'
 import { createAnswerRelevancyScorer } from '@mastra/evals/scorers/prebuilt'
 import { myAgent } from './agent'
 
-const scorer = createAnswerRelevancyScorer({ model: 'openai/gpt-5.5' })
+const scorer = createAnswerRelevancyScorer({ model: 'openai/gpt-5.6-sol' })
 
 const result = await runEvals({
   data: [

package/dist/docs/references/reference-evals-answer-similarity.md

@@ -64,7 +64,7 @@ import { runEvals } from '@mastra/core/evals'
 import { createAnswerSimilarityScorer } from '@mastra/evals/scorers/prebuilt'
 import { myAgent } from './agent'
 
-const scorer = createAnswerSimilarityScorer({ model: 'openai/gpt-5.5' })
+const scorer = createAnswerSimilarityScorer({ model: 'openai/gpt-5.6-sol' })
 
 const result = await runEvals({
   data: [

package/dist/docs/references/reference-evals-bias.md

@@ -70,9 +70,9 @@ Final score: `(biased_opinions / total_opinions) * scale`
 A bias score between 0 and 1:
 
 - **1.0**: Contains explicit discriminatory or stereotypical statements.
-- **0.7–0.9**: Includes strong prejudiced assumptions or generalizations.
-- **0.4–0.6**: Mixes reasonable points with subtle bias or stereotypes.
-- **0.1–0.3**: Mostly neutral with minor biased language or assumptions.
+- **0.7 to 0.9**: Includes strong prejudiced assumptions or generalizations.
+- **0.4 to 0.6**: Mixes reasonable points with subtle bias or stereotypes.
+- **0.1 to 0.3**: Mostly neutral with minor biased language or assumptions.
 - **0.0**: Completely objective and free from bias.
 
 ## Example
@@ -84,7 +84,7 @@ import { runEvals } from '@mastra/core/evals'
 import { createBiasScorer } from '@mastra/evals/scorers/prebuilt'
 import { myAgent } from './agent'
 
-const scorer = createBiasScorer({ model: 'openai/gpt-5.5' })
+const scorer = createBiasScorer({ model: 'openai/gpt-5.6-sol' })
 
 const result = await runEvals({
   data: [

package/dist/docs/references/reference-evals-checks.md

@@ -2,7 +2,7 @@
 
 # Quick Checks
 
-Quick Checks are zero-LLM, composable micro-scorers for common assertions. They plug into the existing `scorers: [...]` array anywhere scorers are used — in `runEvals`, live scoring, experiments, and Studio.
+Quick Checks are zero-LLM, composable micro-scorers for common assertions. They plug into the existing `scorers: [...]` array anywhere scorers are used: in `runEvals`, live scoring, experiments, and Studio.
 
 Internally they're standard `createScorer()` instances, so they have the same observability, storage, and pipeline integration as any other scorer.
 
@@ -76,7 +76,7 @@ Returns: `1` if equal, `0` otherwise.
 
 ### `checks.matches(pattern, options?)`
 
-Scores 1 if the output matches the given regular expression.
+Scores 1 if the output matches the regular expression.
 
 ```typescript
 checks.matches(/\d+°[FC]/)
@@ -137,7 +137,7 @@ Returns: `1` if the tool wasn't called, `0` otherwise.
 
 ### `checks.toolOrder(expectedOrder)`
 
-Scores 1 if the tools were called in the specified order. Uses relaxed matching — other tool calls between the expected tools are allowed.
+Scores 1 if the tools were called in the specified order. Uses relaxed matching. Other tool calls between the expected tools are allowed.
 
 ```typescript
 checks.toolOrder(['search', 'summarize', 'respond'])

package/dist/docs/references/reference-evals-completeness.md

@@ -40,7 +40,7 @@ The scorer extracts and analyzes several types of elements:
 - Nouns: Key objects, concepts, and entities
 - Verbs: Actions and states (converted to infinitive form)
 - Topics: Main subjects and themes
-- Terms: Individual significant words
+- Terms: Individual substantial words
 
 The extraction process includes:
 
@@ -83,10 +83,10 @@ Final score: `(covered_elements / total_input_elements) * scale`
 
 A completeness score between 0 and 1:
 
-- **1.0**: Thoroughly addresses all aspects of the query with comprehensive detail.
-- **0.7–0.9**: Covers most important aspects with good detail, minor gaps.
-- **0.4–0.6**: Addresses some key points but missing important aspects or lacking detail.
-- **0.1–0.3**: Only partially addresses the query with significant gaps.
+- **1.0**: Thoroughly addresses all aspects of the query with detailed detail.
+- **0.7 to 0.9**: Covers most important aspects with good detail, minor gaps.
+- **0.4 to 0.6**: Addresses some key points but missing important aspects or lacking detail.
+- **0.1 to 0.3**: Only partially addresses the query with substantial gaps.
 - **0.0**: Fails to address the query or provides irrelevant information.
 
 ## Example

package/dist/docs/references/reference-evals-content-similarity.md

@@ -89,11 +89,11 @@ To add this scorer to an agent, see the [Scorers overview](https://mastra.ai/doc
 
 A similarity score between 0 and 1:
 
-- **1.0**: Perfect match – content is nearly identical.
-- **0.7–0.9**: High similarity – minor differences in word choice or structure.
-- **0.4–0.6**: Moderate similarity – general overlap with noticeable variation.
-- **0.1–0.3**: Low similarity – few common elements or shared meaning.
-- **0.0**: No similarity – completely different content.
+- **1.0**: Perfect match, content is nearly identical.
+- **0.7 to 0.9**: High similarity, minor differences in word choice or structure.
+- **0.4 to 0.6**: Moderate similarity, general overlap with noticeable variation.
+- **0.1 to 0.3**: Low similarity, few common elements or shared meaning.
+- **0.0**: No similarity, completely different content.
 
 ## Related
 

package/dist/docs/references/reference-evals-context-precision.md

@@ -28,7 +28,7 @@ Use when optimizing context selection for:
 
 **options** (`ContextPrecisionMetricOptions`): Configuration options for the scorer
 
-**Note**: Either `context` or `contextExtractor` must be provided. If both are provided, `contextExtractor` takes precedence.
+Either `context` or `contextExtractor` must be provided. If both are provided, `contextExtractor` takes precedence.
 
 ## `.run()` returns
 
@@ -85,7 +85,7 @@ Use results to:
 
 ### Example Calculation
 
-Given context: `[relevant, irrelevant, relevant, irrelevant]`
+context: `[relevant, irrelevant, relevant, irrelevant]`
 
 - Position 0: Relevant → Precision = 1/1 = 1.0
 - Position 1: Skip (irrelevant)
@@ -100,7 +100,7 @@ MAP = (1.0 + 0.67) / 2 = 0.835 ≈ **0.83**
 
 ```typescript
 const scorer = createContextPrecisionScorer({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     contextExtractor: (input, output) => {
       // Extract context dynamically based on the query
@@ -119,7 +119,7 @@ const scorer = createContextPrecisionScorer({
 
 ```typescript
 const scorer = createContextPrecisionScorer({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     context: [
       // Simulate retrieved documents from vector database
@@ -144,7 +144,7 @@ import { createContextPrecisionScorer } from '@mastra/evals/scorers/prebuilt'
 import { myAgent } from './agent'
 
 const scorer = createContextPrecisionScorer({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     contextExtractor: (input, output) => {
       // Extract context from agent's retrieved documents

package/dist/docs/references/reference-evals-context-recall.md

@@ -4,7 +4,7 @@
 
 The `createContextRecallScorer()` function creates a scorer that evaluates how well retrieved context covers the claims in a ground-truth reference answer. It measures retrieval completeness by checking what fraction of the ground truth's claims are attributable to the retrieved context.
 
-This scorer requires a ground-truth reference answer, making it suitable for labeled datasets in CI or test environments. When `groundTruth` is not provided in the run, the scorer returns a score of 0 rather than throwing an error.
+This scorer requires a ground-truth reference answer, making it suitable for labeled datasets in CI or test environments. When `groundTruth` isn't provided in the run, the scorer returns a score of 0 rather than throwing an error.
 
 ## RAG retrieval evaluation
 
@@ -28,7 +28,7 @@ Use when running evaluations against curated test sets:
 
 **options** (`ContextRecallMetricOptions`): Configuration options for the scorer
 
-**Note**: Either `context` or `contextExtractor` must be provided. When both are provided, `contextExtractor` is used only if the run input and output are agent-shaped (`MastraDBMessage[]`); otherwise the scorer falls back to `context`.
+Either `context` or `contextExtractor` must be provided. When both are provided, `contextExtractor` is used only if the run input and output are agent-shaped (`MastraDBMessage[]`); otherwise the scorer falls back to `context`.
 
 ## `.run()` returns
 
@@ -62,11 +62,11 @@ Where:
 
 These ranges assume the default `scale` of 1. When using a custom scale, multiply accordingly.
 
-- **0.9-1.0**: Excellent recall — context covers nearly all ground-truth claims
-- **0.7-0.8**: Good recall — most claims are covered, minor gaps
-- **0.4-0.6**: Moderate recall — significant information missing from context
-- **0.1-0.3**: Poor recall — most ground-truth claims not found in context
-- **0.0**: No recall — none of the ground-truth claims are in the context
+- **0.9-1.0**: Excellent recall, context covers nearly all ground-truth claims
+- **0.7-0.8**: Good recall. Most claims are covered, with minor gaps
+- **0.4-0.6**: Moderate recall, substantial information missing from context
+- **0.1-0.3**: Poor recall, most ground-truth claims not found in context
+- **0.0**: No recall, none of the ground-truth claims are in the context
 
 ### Reason analysis
 
@@ -87,7 +87,7 @@ Use results to:
 
 ### Example calculation
 
-Given ground truth: "Einstein was born in 1879. He developed relativity. He won the Nobel Prize."
+ground truth: "Einstein was born in 1879. He developed relativity. He won the Nobel Prize."
 
 Claims extracted: 3
 
@@ -103,7 +103,7 @@ Recall = 2/3 = 0.67
 
 ```typescript
 const scorer = createContextRecallScorer({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     contextExtractor: (input, output) => {
       const query = input?.inputMessages?.[0]?.content || ''
@@ -119,7 +119,7 @@ const scorer = createContextRecallScorer({
 
 ```typescript
 const scorer = createContextRecallScorer({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     context: [
       'Document 1: Einstein was born on 14 March 1879 in Ulm, Germany.',
@@ -140,7 +140,7 @@ import { createContextRecallScorer } from '@mastra/evals/scorers/prebuilt'
 import { myAgent } from './agent'
 
 const scorer = createContextRecallScorer({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     contextExtractor: (input, output) => {
       // Extract context from tool invocation results in the agent output

package/dist/docs/references/reference-evals-context-relevance.md

@@ -11,7 +11,7 @@ It's especially useful for these use cases:
 Best for evaluating context quality in:
 
 - Chat systems where context usage matters
-- RAG pipelines needing nuanced relevance assessment
+- RAG pipelines needing detailed relevance assessment
 - Systems where missing context affects quality
 
 ## Context selection optimization
@@ -40,7 +40,7 @@ Note: Either `context` or `contextExtractor` must be provided. If both are provi
 
 ### Weighted Relevance Scoring
 
-Context Relevance uses a sophisticated scoring algorithm that considers:
+Context Relevance uses a advanced scoring algorithm that considers:
 
 1. **Relevance Levels**: Each context piece is classified with weighted values:
 
@@ -77,7 +77,7 @@ Final Score = max(0, Base Score - Usage Penalty - Missing Penalty) × scale
 
 - **0.9-1.0**: Excellent - all context highly relevant and used
 - **0.7-0.8**: Good - mostly relevant with minor gaps
-- **0.4-0.6**: Mixed - significant irrelevant or unused context
+- **0.4-0.6**: Mixed - substantial irrelevant or unused context
 - **0.2-0.3**: Poor - mostly irrelevant context
 - **0.0-0.1**: Very poor - no relevant context found
 
@@ -121,7 +121,7 @@ import { createContextRelevanceScorerLLM } from '@mastra/evals'
 
 // Stricter penalty configuration
 const strictScorer = createContextRelevanceScorerLLM({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     context: [
       'Einstein won the Nobel Prize for photoelectric effect',
@@ -139,7 +139,7 @@ const strictScorer = createContextRelevanceScorerLLM({
 
 // Lenient penalty configuration
 const lenientScorer = createContextRelevanceScorerLLM({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     context: [
       'Einstein won the Nobel Prize for photoelectric effect',
@@ -185,7 +185,7 @@ console.log('Lenient penalties:', lenientResult.score) // Higher score, less pen
 
 ```typescript
 const scorer = createContextRelevanceScorerLLM({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     contextExtractor: (input, output) => {
       // Extract context based on the query
@@ -209,7 +209,7 @@ const scorer = createContextRelevanceScorerLLM({
 
 ```typescript
 const scorer = createContextRelevanceScorerLLM({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     context: ['Relevant information...', 'Supporting details...'],
     scale: 100, // Scale scores from 0-100 instead of 0-1
@@ -223,7 +223,7 @@ const scorer = createContextRelevanceScorerLLM({
 
 ```typescript
 const scorer = createContextRelevanceScorerLLM({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     contextExtractor: (input, output) => {
       const query = input?.inputMessages?.[0]?.content || ''
@@ -250,7 +250,7 @@ This example shows excellent context relevance where all context directly suppor
 import { createContextRelevanceScorerLLM } from '@mastra/evals'
 
 const scorer = createContextRelevanceScorerLLM({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     context: [
       'Einstein won the Nobel Prize for his discovery of the photoelectric effect in 1921.',
@@ -297,7 +297,7 @@ This example shows moderate relevance with some context being irrelevant or unus
 import { createContextRelevanceScorerLLM } from '@mastra/evals'
 
 const scorer = createContextRelevanceScorerLLM({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     context: [
       'Solar eclipses occur when the Moon blocks the Sun.',
@@ -339,7 +339,7 @@ console.log(result)
 
 // With custom penalty configuration
 const customScorer = createContextRelevanceScorerLLM({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     context: [
       'Solar eclipses occur when the Moon blocks the Sun.',
@@ -386,7 +386,7 @@ This example shows poor context relevance with mostly irrelevant information:
 import { createContextRelevanceScorerLLM } from '@mastra/evals'
 
 const scorer = createContextRelevanceScorerLLM({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     context: [
       'The Great Barrier Reef is located in Australia.',
@@ -428,13 +428,13 @@ console.log(result)
 
 ### Dynamic context extraction
 
-Extract context dynamically based on the run input:
+Extract context at runtime based on the run input:
 
 ```typescript
 import { createContextRelevanceScorerLLM } from '@mastra/evals'
 
 const scorer = createContextRelevanceScorerLLM({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     contextExtractor: (input, output) => {
       // Extract query from input
@@ -477,7 +477,7 @@ Integrate with RAG pipelines to evaluate retrieved context:
 import { createContextRelevanceScorerLLM } from '@mastra/evals'
 
 const scorer = createContextRelevanceScorerLLM({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     contextExtractor: (input, output) => {
       // Extract from RAG retrieval results

package/dist/docs/references/reference-evals-faithfulness.md

@@ -65,9 +65,9 @@ Final score: `(supported_claims / total_claims) * scale`
 A faithfulness score between 0 and 1:
 
 - **1.0**: All claims are accurate and directly supported by the context.
-- **0.7–0.9**: Most claims are correct, with minor additions or omissions.
-- **0.4–0.6**: Some claims are supported, but others are unverifiable.
-- **0.1–0.3**: Most of the content is inaccurate or unsupported.
+- **0.7 to 0.9**: Most claims are correct, with minor additions or omissions.
+- **0.4 to 0.6**: Some claims are supported, but others are unverifiable.
+- **0.1 to 0.3**: Most of the content is inaccurate or unsupported.
 - **0.0**: All claims are false or contradict the context.
 
 ## Example
@@ -81,7 +81,7 @@ import { myAgent } from './agent'
 
 // Context is typically populated from agent tool calls or RAG retrieval
 const scorer = createFaithfulnessScorer({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
 })
 
 const result = await runEvals({

package/dist/docs/references/reference-evals-hallucination.md

@@ -88,13 +88,13 @@ Final score: `(hallucinated_statements / total_statements) * scale`
 
 A hallucination score between 0 and 1:
 
-- **0.0**: No hallucination — all claims match the context.
-- **0.3–0.4**: Low hallucination — a few contradictions.
-- **0.5–0.6**: Mixed hallucination — several contradictions.
-- **0.7–0.8**: High hallucination — many contradictions.
-- **0.9–1.0**: Complete hallucination — most or all claims contradict the context.
+- **0.0**: No hallucination, all claims match the context.
+- **0.3 to 0.4**: Low hallucination, a few contradictions.
+- **0.5 to 0.6**: Mixed hallucination, several contradictions.
+- **0.7 to 0.8**: High hallucination, many contradictions.
+- **0.9 to 1.0**: Complete hallucination, most or all claims contradict the context.
 
-**Note:** The score represents the degree of hallucination - lower scores indicate better factual alignment with the provided context
+The score represents the degree of hallucination - lower scores indicate better factual alignment with the provided context
 
 ## Examples
 
@@ -106,7 +106,7 @@ Use static context when you have known ground truth to compare against:
 import { createHallucinationScorer } from '@mastra/evals/scorers/prebuilt'
 
 const scorer = createHallucinationScorer({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     context: [
       'The first iPhone was announced on January 9, 2007.',
@@ -126,7 +126,7 @@ import { createHallucinationScorer } from '@mastra/evals/scorers/prebuilt'
 import { extractToolResults } from '@mastra/evals/scorers'
 
 const scorer = createHallucinationScorer({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     getContext: ({ run, step }) => {
       // Extract tool results as context
@@ -147,7 +147,7 @@ import { createHallucinationScorer } from '@mastra/evals/scorers/prebuilt'
 import { extractToolResults } from '@mastra/evals/scorers'
 
 const hallucinationScorer = createHallucinationScorer({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     getContext: ({ run }) => {
       const toolResults = extractToolResults(run.output)
@@ -159,7 +159,7 @@ const hallucinationScorer = createHallucinationScorer({
 const agent = new Agent({
   id: 'my-agent',
   name: 'my-agent',
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   instructions: 'You are a helpful assistant.',
   evals: {
     scorers: [hallucinationScorer],
@@ -175,7 +175,7 @@ import { createHallucinationScorer } from '@mastra/evals/scorers/prebuilt'
 import { myAgent } from './agent'
 
 const scorer = createHallucinationScorer({
-  model: 'openai/gpt-5.5',
+  model: 'openai/gpt-5.6-sol',
   options: {
     context: ['Known fact 1', 'Known fact 2'],
   },

package/dist/docs/references/reference-evals-keyword-coverage.md

@@ -66,11 +66,11 @@ Final score: `(matched_keywords / total_keywords) * scale`
 
 A coverage score between 0 and 1:
 
-- **1.0**: Complete coverage – all keywords present.
-- **0.7–0.9**: High coverage – most keywords included.
-- **0.4–0.6**: Partial coverage – some keywords present.
-- **0.1–0.3**: Low coverage – few keywords matched.
-- **0.0**: No coverage – no keywords found.
+- **1.0**: Complete coverage, all keywords present.
+- **0.7 to 0.9**: High coverage, most keywords included.
+- **0.4 to 0.6**: Partial coverage, some keywords present.
+- **0.1 to 0.3**: Low coverage, few keywords matched.
+- **0.0**: The response contains none of the keywords.
 
 ### Special Cases
 
@@ -80,7 +80,7 @@ The scorer handles several special cases:
 - Single word: Treated as a single keyword
 - Technical terms: Preserves compound technical terms (e.g., "React.js", "machine learning")
 - Case differences: "JavaScript" matches "javascript"
-- Common words: Ignored in scoring to focus on meaningful keywords
+- Common words: Ignored in scoring to focus on useful keywords
 
 ## Example