@mastra/evals 0.0.0-commonjs-20250227130920

package/CHANGELOG.md

@@ -0,0 +1,777 @@
+# @mastra/evals
+
+## 0.0.0-commonjs-20250227130920
+
+### Patch Changes
+
+- 4a712fc: Add support for commonjs
+- Updated dependencies [ed55f1d]
+- Updated dependencies [06aa827]
+- Updated dependencies [8d13b14]
+- Updated dependencies [4a712fc]
+- Updated dependencies [108793c]
+- Updated dependencies [5f28f44]
+  - @mastra/core@0.0.0-commonjs-20250227130920
+
+## 0.1.6-alpha.0
+
+### Patch Changes
+
+- Updated dependencies [06aa827]
+  - @mastra/core@0.4.3-alpha.0
+
+## 0.1.5
+
+### Patch Changes
+
+- Updated dependencies [7fceae1]
+- Updated dependencies [8d94c3e]
+- Updated dependencies [99dcdb5]
+- Updated dependencies [6cb63e0]
+- Updated dependencies [f626fbb]
+- Updated dependencies [e752340]
+- Updated dependencies [eb91535]
+  - @mastra/core@0.4.2
+
+## 0.1.5-alpha.2
+
+### Patch Changes
+
+- Updated dependencies [8d94c3e]
+- Updated dependencies [99dcdb5]
+- Updated dependencies [e752340]
+- Updated dependencies [eb91535]
+  - @mastra/core@0.4.2-alpha.2
+
+## 0.1.5-alpha.1
+
+### Patch Changes
+
+- Updated dependencies [6cb63e0]
+  - @mastra/core@0.4.2-alpha.1
+
+## 0.1.5-alpha.0
+
+### Patch Changes
+
+- Updated dependencies [7fceae1]
+- Updated dependencies [f626fbb]
+  - @mastra/core@0.4.2-alpha.0
+
+## 0.1.4
+
+### Patch Changes
+
+- Updated dependencies [ce44b9b]
+- Updated dependencies [967da43]
+- Updated dependencies [b405f08]
+  - @mastra/core@0.4.1
+
+## 0.1.3
+
+### Patch Changes
+
+- Updated dependencies [2fc618f]
+- Updated dependencies [fe0fd01]
+  - @mastra/core@0.4.0
+
+## 0.1.3-alpha.1
+
+### Patch Changes
+
+- Updated dependencies [fe0fd01]
+  - @mastra/core@0.4.0-alpha.1
+
+## 0.1.3-alpha.0
+
+### Patch Changes
+
+- Updated dependencies [2fc618f]
+  - @mastra/core@0.4.0-alpha.0
+
+## 0.1.2
+
+### Patch Changes
+
+- Updated dependencies [f205ede]
+  - @mastra/core@0.3.0
+
+## 0.1.1
+
+### Patch Changes
+
+- d59f1a8: Added example docs for evals and export metricJudge
+- 91ef439: Add eslint and ran autofix
+- Updated dependencies [d59f1a8]
+- Updated dependencies [91ef439]
+- Updated dependencies [4a25be4]
+- Updated dependencies [bf2e88f]
+- Updated dependencies [2f0d707]
+- Updated dependencies [aac1667]
+  - @mastra/core@0.2.1
+
+## 0.1.1-alpha.0
+
+### Patch Changes
+
+- d59f1a8: Added example docs for evals and export metricJudge
+- 91ef439: Add eslint and ran autofix
+- Updated dependencies [d59f1a8]
+- Updated dependencies [91ef439]
+- Updated dependencies [4a25be4]
+- Updated dependencies [bf2e88f]
+- Updated dependencies [2f0d707]
+- Updated dependencies [aac1667]
+  - @mastra/core@0.2.1-alpha.0
+
+## 0.1.0
+
+### Minor Changes
+
+- 5916f9d: Update deps from fixed to ^
+- 633e198: Add bias metric
+- ddd2236: Add contextual metric
+- 94504ec: Add contextual relevancy metric
+- 8b416d9: Breaking changes
+- 240c3aa: Enable toxicity metric
+
+### Patch Changes
+
+- cf40fd7: Update evals metric and tests
+- c056555: Added faithfulness and updated docs
+- bdaf834: publish packages
+- 5fdc87c: Update evals storage in attachListeners
+- b97ca96: Tracing into default storage
+- 1944807: Unified logger and major step in better logs
+- f368477: Added evals package and added evals in core
+- 7892533: Updated test evals to use Mastra Storage
+- 9c10484: update all packages
+- 70dabd9: Fix broken publish
+- a8a459a: Updated Evals table UI
+- 27c933f: Added summarization and doc
+- 9625602: Use mastra core splitted bundles in other packages
+- 72d1990: Updated evals table schema
+- 07f45e7: Update evals to include all verdicts and updated docs
+- 06b2c0a: Update summarization prompt and fix eval input
+- ceb8086: Added hallucination metric and doc
+- cb2e997: Bundle evals package with tsup
+- d641d91: Fix exports for @mastra/evals
+- b9c7047: Move to non deprecated table name for eval insertion
+- 9ade36e: Changed measure for evals, added endpoints, attached metrics to agent, added ui for evals in playground, and updated docs
+- 876b8a2: Rename difference metric to textual difference metric
+- 1bbec77: Reorganized evals into nlp and llm
+- 35764f4: Added workflow for eval tests
+- 8769a62: Split core into seperate entry fils
+- aea3c13: Fix evals export for llm and nlp
+- 4f1d1a1: Enforce types ann cleanup package.json
+- 202d404: Added instructions when generating evals
+- Updated dependencies [f537e33]
+- Updated dependencies [6f2c0f5]
+- Updated dependencies [e4d4ede]
+- Updated dependencies [0be7181]
+- Updated dependencies [dd6d87f]
+- Updated dependencies [9029796]
+- Updated dependencies [6fa4bd2]
+- Updated dependencies [f031a1f]
+- Updated dependencies [8151f44]
+- Updated dependencies [d7d465a]
+- Updated dependencies [4d4f6b6]
+- Updated dependencies [73d112c]
+- Updated dependencies [592e3cf]
+- Updated dependencies [9d1796d]
+- Updated dependencies [e897f1c]
+- Updated dependencies [4a54c82]
+- Updated dependencies [3967e69]
+- Updated dependencies [8ae2bbc]
+- Updated dependencies [e9d1b47]
+- Updated dependencies [016493a]
+- Updated dependencies [bc40916]
+- Updated dependencies [93a3719]
+- Updated dependencies [7d83b92]
+- Updated dependencies [9fb3039]
+- Updated dependencies [d5e12de]
+- Updated dependencies [e1dd94a]
+- Updated dependencies [07c069d]
+- Updated dependencies [5cdfb88]
+- Updated dependencies [837a288]
+- Updated dependencies [685108a]
+- Updated dependencies [c8ff2f5]
+- Updated dependencies [5fdc87c]
+- Updated dependencies [ae7bf94]
+- Updated dependencies [8e7814f]
+- Updated dependencies [66a03ec]
+- Updated dependencies [7d87a15]
+- Updated dependencies [b97ca96]
+- Updated dependencies [23dcb23]
+- Updated dependencies [033eda6]
+- Updated dependencies [8105fae]
+- Updated dependencies [e097800]
+- Updated dependencies [1944807]
+- Updated dependencies [30322ce]
+- Updated dependencies [1874f40]
+- Updated dependencies [685108a]
+- Updated dependencies [f7d1131]
+- Updated dependencies [79acad0]
+- Updated dependencies [7a19083]
+- Updated dependencies [382f4dc]
+- Updated dependencies [1ebd071]
+- Updated dependencies [0b74006]
+- Updated dependencies [2f17a5f]
+- Updated dependencies [f368477]
+- Updated dependencies [7892533]
+- Updated dependencies [9c10484]
+- Updated dependencies [b726bf5]
+- Updated dependencies [70dabd9]
+- Updated dependencies [21fe536]
+- Updated dependencies [176bc42]
+- Updated dependencies [401a4d9]
+- Updated dependencies [2e099d2]
+- Updated dependencies [0b826f6]
+- Updated dependencies [d68b532]
+- Updated dependencies [75bf3f0]
+- Updated dependencies [e6d8055]
+- Updated dependencies [e2e76de]
+- Updated dependencies [ccbc581]
+- Updated dependencies [5950de5]
+- Updated dependencies [fe3dcb0]
+- Updated dependencies [78eec7c]
+- Updated dependencies [a8a459a]
+- Updated dependencies [0be7181]
+- Updated dependencies [7b87567]
+- Updated dependencies [b524c22]
+- Updated dependencies [d7d465a]
+- Updated dependencies [df843d3]
+- Updated dependencies [4534e77]
+- Updated dependencies [d6d8159]
+- Updated dependencies [0bd142c]
+- Updated dependencies [9625602]
+- Updated dependencies [72d1990]
+- Updated dependencies [f6ba259]
+- Updated dependencies [2712098]
+- Updated dependencies [eedb829]
+- Updated dependencies [5285356]
+- Updated dependencies [74b3078]
+- Updated dependencies [cb290ee]
+- Updated dependencies [b4d7416]
+- Updated dependencies [e608d8c]
+- Updated dependencies [06b2c0a]
+- Updated dependencies [002d6d8]
+- Updated dependencies [e448a26]
+- Updated dependencies [8b416d9]
+- Updated dependencies [fd494a3]
+- Updated dependencies [dc90663]
+- Updated dependencies [c872875]
+- Updated dependencies [3c4488b]
+- Updated dependencies [a7b016d]
+- Updated dependencies [fd75f3c]
+- Updated dependencies [7f24c29]
+- Updated dependencies [2017553]
+- Updated dependencies [a10b7a3]
+- Updated dependencies [cf6d825]
+- Updated dependencies [963c15a]
+- Updated dependencies [7365b6c]
+- Updated dependencies [5ee67d3]
+- Updated dependencies [d38f7a6]
+- Updated dependencies [38b7f66]
+- Updated dependencies [2fa7f53]
+- Updated dependencies [1420ae2]
+- Updated dependencies [f6da688]
+- Updated dependencies [3700be1]
+- Updated dependencies [9ade36e]
+- Updated dependencies [10870bc]
+- Updated dependencies [2b01511]
+- Updated dependencies [a870123]
+- Updated dependencies [ccf115c]
+- Updated dependencies [04434b6]
+- Updated dependencies [5811de6]
+- Updated dependencies [9f3ab05]
+- Updated dependencies [66a5392]
+- Updated dependencies [4b1ce2c]
+- Updated dependencies [14064f2]
+- Updated dependencies [f5dfa20]
+- Updated dependencies [327ece7]
+- Updated dependencies [da2e8d3]
+- Updated dependencies [95a4697]
+- Updated dependencies [d5fccfb]
+- Updated dependencies [3427b95]
+- Updated dependencies [538a136]
+- Updated dependencies [e66643a]
+- Updated dependencies [b5393f1]
+- Updated dependencies [d2cd535]
+- Updated dependencies [c2dd6b5]
+- Updated dependencies [67637ba]
+- Updated dependencies [836f4e3]
+- Updated dependencies [5ee2e78]
+- Updated dependencies [cd02c56]
+- Updated dependencies [01502b0]
+- Updated dependencies [16e5b04]
+- Updated dependencies [d9c8dd0]
+- Updated dependencies [9fb59d6]
+- Updated dependencies [a9345f9]
+- Updated dependencies [99f1847]
+- Updated dependencies [04f3171]
+- Updated dependencies [8769a62]
+- Updated dependencies [d5ec619]
+- Updated dependencies [27275c9]
+- Updated dependencies [ae7bf94]
+- Updated dependencies [4f1d1a1]
+- Updated dependencies [ee4de15]
+- Updated dependencies [202d404]
+- Updated dependencies [a221426]
+  - @mastra/core@0.2.0
+
+## 0.1.0-alpha.53
+
+### Patch Changes
+
+- cf40fd7: Update evals metric and tests
+- Updated dependencies [016493a]
+- Updated dependencies [382f4dc]
+- Updated dependencies [176bc42]
+- Updated dependencies [d68b532]
+- Updated dependencies [fe3dcb0]
+- Updated dependencies [e448a26]
+- Updated dependencies [fd75f3c]
+- Updated dependencies [ccf115c]
+- Updated dependencies [a221426]
+  - @mastra/core@0.2.0-alpha.110
+
+## 0.1.0-alpha.52
+
+### Patch Changes
+
+- b9c7047: Move to non deprecated table name for eval insertion
+
+## 0.1.0-alpha.51
+
+### Patch Changes
+
+- Updated dependencies [d5fccfb]
+  - @mastra/core@0.2.0-alpha.109
+
+## 0.1.0-alpha.50
+
+### Patch Changes
+
+- Updated dependencies [5ee67d3]
+- Updated dependencies [95a4697]
+  - @mastra/core@0.2.0-alpha.108
+
+## 0.1.0-alpha.49
+
+### Patch Changes
+
+- Updated dependencies [66a5392]
+  - @mastra/core@0.2.0-alpha.107
+
+## 0.1.0-alpha.48
+
+### Patch Changes
+
+- a8a459a: Updated Evals table UI
+- Updated dependencies [6f2c0f5]
+- Updated dependencies [a8a459a]
+  - @mastra/core@0.2.0-alpha.106
+
+## 0.1.0-alpha.47
+
+### Patch Changes
+
+- Updated dependencies [1420ae2]
+- Updated dependencies [99f1847]
+  - @mastra/core@0.2.0-alpha.105
+
+## 0.1.0-alpha.46
+
+### Patch Changes
+
+- 5fdc87c: Update evals storage in attachListeners
+- b97ca96: Tracing into default storage
+- 72d1990: Updated evals table schema
+- Updated dependencies [5fdc87c]
+- Updated dependencies [b97ca96]
+- Updated dependencies [72d1990]
+- Updated dependencies [cf6d825]
+- Updated dependencies [10870bc]
+  - @mastra/core@0.2.0-alpha.104
+
+## 0.1.0-alpha.45
+
+### Patch Changes
+
+- Updated dependencies [4534e77]
+  - @mastra/core@0.2.0-alpha.103
+
+## 0.1.0-alpha.44
+
+### Patch Changes
+
+- Updated dependencies [a9345f9]
+  - @mastra/core@0.2.0-alpha.102
+
+## 0.1.0-alpha.43
+
+### Patch Changes
+
+- 4f1d1a1: Enforce types ann cleanup package.json
+- Updated dependencies [66a03ec]
+- Updated dependencies [4f1d1a1]
+  - @mastra/core@0.2.0-alpha.101
+
+## 0.1.0-alpha.42
+
+### Patch Changes
+
+- Updated dependencies [9d1796d]
+  - @mastra/core@0.2.0-alpha.100
+
+## 0.1.0-alpha.41
+
+### Patch Changes
+
+- Updated dependencies [7d83b92]
+  - @mastra/core@0.2.0-alpha.99
+
+## 0.1.0-alpha.40
+
+### Patch Changes
+
+- 70dabd9: Fix broken publish
+- 202d404: Added instructions when generating evals
+- Updated dependencies [70dabd9]
+- Updated dependencies [202d404]
+  - @mastra/core@0.2.0-alpha.98
+
+## 0.1.0-alpha.39
+
+### Patch Changes
+
+- 7892533: Updated test evals to use Mastra Storage
+- d641d91: Fix exports for @mastra/evals
+- Updated dependencies [07c069d]
+- Updated dependencies [7892533]
+- Updated dependencies [e6d8055]
+- Updated dependencies [5950de5]
+- Updated dependencies [df843d3]
+- Updated dependencies [a870123]
+  - @mastra/core@0.2.0-alpha.97
+
+## 0.1.0-alpha.38
+
+### Patch Changes
+
+- Updated dependencies [74b3078]
+  - @mastra/core@0.2.0-alpha.96
+
+## 0.1.0-alpha.37
+
+### Patch Changes
+
+- Updated dependencies [9fb59d6]
+  - @mastra/core@0.2.0-alpha.95
+
+## 0.1.0-alpha.36
+
+### Minor Changes
+
+- 8b416d9: Breaking changes
+
+### Patch Changes
+
+- 9c10484: update all packages
+- Updated dependencies [9c10484]
+- Updated dependencies [8b416d9]
+  - @mastra/core@0.2.0-alpha.94
+
+## 0.1.0-alpha.35
+
+### Patch Changes
+
+- Updated dependencies [5285356]
+  - @mastra/core@0.2.0-alpha.93
+
+## 0.1.0-alpha.34
+
+### Patch Changes
+
+- Updated dependencies [4d4f6b6]
+  - @mastra/core@0.2.0-alpha.92
+
+## 0.1.0-alpha.33
+
+### Patch Changes
+
+- Updated dependencies [d7d465a]
+- Updated dependencies [d7d465a]
+- Updated dependencies [2017553]
+- Updated dependencies [a10b7a3]
+- Updated dependencies [16e5b04]
+  - @mastra/core@0.2.0-alpha.91
+
+## 0.1.0-alpha.32
+
+### Patch Changes
+
+- Updated dependencies [8151f44]
+- Updated dependencies [e897f1c]
+- Updated dependencies [3700be1]
+  - @mastra/core@0.2.0-alpha.90
+
+## 0.1.0-alpha.31
+
+### Patch Changes
+
+- Updated dependencies [27275c9]
+  - @mastra/core@0.2.0-alpha.89
+
+## 0.1.0-alpha.30
+
+### Patch Changes
+
+- Updated dependencies [ccbc581]
+  - @mastra/core@0.2.0-alpha.88
+
+## 0.1.0-alpha.29
+
+### Patch Changes
+
+- Updated dependencies [7365b6c]
+  - @mastra/core@0.2.0-alpha.87
+
+## 0.1.0-alpha.28
+
+### Minor Changes
+
+- 5916f9d: Update deps from fixed to ^
+
+### Patch Changes
+
+- Updated dependencies [6fa4bd2]
+- Updated dependencies [e2e76de]
+- Updated dependencies [7f24c29]
+- Updated dependencies [67637ba]
+- Updated dependencies [04f3171]
+  - @mastra/core@0.2.0-alpha.86
+
+## 0.1.0-alpha.27
+
+### Patch Changes
+
+- Updated dependencies [e9d1b47]
+  - @mastra/core@0.2.0-alpha.85
+
+## 0.1.0-alpha.26
+
+### Patch Changes
+
+- Updated dependencies [2f17a5f]
+- Updated dependencies [cb290ee]
+- Updated dependencies [b4d7416]
+- Updated dependencies [38b7f66]
+  - @mastra/core@0.2.0-alpha.84
+
+## 0.1.0-alpha.25
+
+### Patch Changes
+
+- 9625602: Use mastra core splitted bundles in other packages
+- 8769a62: Split core into seperate entry fils
+- Updated dependencies [30322ce]
+- Updated dependencies [78eec7c]
+- Updated dependencies [9625602]
+- Updated dependencies [8769a62]
+  - @mastra/core@0.2.0-alpha.83
+
+## 0.1.0-alpha.24
+
+### Patch Changes
+
+- Updated dependencies [73d112c]
+  - @mastra/core@0.1.27-alpha.82
+
+## 0.1.0-alpha.23
+
+### Patch Changes
+
+- Updated dependencies [9fb3039]
+  - @mastra/core@0.1.27-alpha.81
+
+## 0.1.0-alpha.22
+
+### Patch Changes
+
+- cb2e997: Bundle evals package with tsup
+
+## 0.1.0-alpha.21
+
+### Patch Changes
+
+- Updated dependencies [327ece7]
+  - @mastra/core@0.1.27-alpha.80
+
+## 0.1.0-alpha.20
+
+### Patch Changes
+
+- Updated dependencies [21fe536]
+  - @mastra/core@0.1.27-alpha.79
+
+## 0.1.0-alpha.19
+
+### Patch Changes
+
+- Updated dependencies [685108a]
+- Updated dependencies [685108a]
+  - @mastra/core@0.1.27-alpha.78
+
+## 0.1.0-alpha.18
+
+### Patch Changes
+
+- Updated dependencies [8105fae]
+  - @mastra/core@0.1.27-alpha.77
+
+## 0.1.0-alpha.17
+
+### Patch Changes
+
+- Updated dependencies [ae7bf94]
+- Updated dependencies [ae7bf94]
+  - @mastra/core@0.1.27-alpha.76
+
+## 0.1.0-alpha.16
+
+### Patch Changes
+
+- Updated dependencies [23dcb23]
+  - @mastra/core@0.1.27-alpha.75
+
+## 0.1.0-alpha.15
+
+### Patch Changes
+
+- Updated dependencies [7b87567]
+  - @mastra/core@0.1.27-alpha.74
+
+## 0.1.0-alpha.14
+
+### Patch Changes
+
+- Updated dependencies [3427b95]
+  - @mastra/core@0.1.27-alpha.73
+
+## 0.1.0-alpha.13
+
+### Patch Changes
+
+- 06b2c0a: Update summarization prompt and fix eval input
+- Updated dependencies [e4d4ede]
+- Updated dependencies [06b2c0a]
+  - @mastra/core@0.1.27-alpha.72
+
+## 0.1.0-alpha.12
+
+### Patch Changes
+
+- Updated dependencies [d9c8dd0]
+  - @mastra/core@0.1.27-alpha.71
+
+## 0.1.0-alpha.11
+
+### Patch Changes
+
+- bdaf834: publish packages
+
+## 0.1.0-alpha.10
+
+### Patch Changes
+
+- Updated dependencies [dd6d87f]
+- Updated dependencies [04434b6]
+  - @mastra/core@0.1.27-alpha.70
+
+## 0.1.0-alpha.9
+
+### Patch Changes
+
+- 1944807: Unified logger and major step in better logs
+- 9ade36e: Changed measure for evals, added endpoints, attached metrics to agent, added ui for evals in playground, and updated docs
+- Updated dependencies [1944807]
+- Updated dependencies [9ade36e]
+  - @mastra/core@0.1.27-alpha.69
+
+## 0.1.0-alpha.8
+
+### Patch Changes
+
+- Updated dependencies [0be7181]
+- Updated dependencies [0be7181]
+  - @mastra/core@0.1.27-alpha.68
+
+## 0.1.0-alpha.7
+
+### Patch Changes
+
+- Updated dependencies [c8ff2f5]
+  - @mastra/core@0.1.27-alpha.67
+
+## 0.1.0-alpha.6
+
+### Patch Changes
+
+- aea3c13: Fix evals export for llm and nlp
+
+## 0.1.0-alpha.5
+
+### Minor Changes
+
+- 633e198: Add bias metric
+
+### Patch Changes
+
+- ceb8086: Added hallucination metric and doc
+- Updated dependencies [14064f2]
+  - @mastra/core@0.1.27-alpha.66
+
+## 0.1.0-alpha.4
+
+### Minor Changes
+
+- ddd2236: Add contextual metric
+- 94504ec: Add contextual relevancy metric
+- 240c3aa: Enable toxicity metric
+
+### Patch Changes
+
+- 27c933f: Added summarization and doc
+- 07f45e7: Update evals to include all verdicts and updated docs
+- 1bbec77: Reorganized evals into nlp and llm
+
+## 0.0.1-alpha.3
+
+### Patch Changes
+
+- c056555: Added faithfulness and updated docs
+- Updated dependencies [e66643a]
+  - @mastra/core@0.1.27-alpha.65
+
+## 0.0.1-alpha.2
+
+### Patch Changes
+
+- 876b8a2: Rename difference metric to textual difference metric
+
+## 0.0.1-alpha.1
+
+### Patch Changes
+
+- 35764f4: Added workflow for eval tests
+
+## 0.0.1-alpha.0
+
+### Patch Changes
+
+- f368477: Added evals package and added evals in core
+- Updated dependencies [f368477]
+- Updated dependencies [d5ec619]
+  - @mastra/core@0.1.27-alpha.64