@learning-commons/evaluators 0.4.0 → 0.6.0

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@learning-commons/evaluators",
-  "version": "0.4.0",
+  "version": "0.6.0",
   "description": "TypeScript SDK for Learning Commons educational evaluators",
   "type": "module",
   "types": "./dist/index.d.ts",
@@ -28,6 +28,8 @@
     "src/batch/README.md"
   ],
   "scripts": {
+    "generate:schemas": "tsx scripts/generate-schema.ts ../../evals/prompts/purpose/config.json",
+    "generate:schemas:check": "tsx scripts/generate-schema.ts --check ../../evals/prompts/purpose/config.json",
     "build": "tsup",
     "dev": "tsup --watch",
     "test": "vitest run",
@@ -48,6 +50,10 @@
   ],
   "author": "Learning Commons",
   "license": "MIT",
+  "publishConfig": {
+    "access": "public",
+    "registry": "https://registry.npmjs.org"
+  },
   "repository": {
     "type": "git",
     "url": "git+https://github.com/learning-commons-org/evaluators.git",
@@ -56,7 +62,7 @@
   "bugs": {
     "url": "https://github.com/learning-commons-org/evaluators/issues"
   },
-  "homepage": "https://github.com/learning-commons-org/evaluators#readme",
+  "homepage": "https://github.com/learning-commons-org/evaluators/tree/main/sdks/typescript#readme",
   "peerDependencies": {
     "@ai-sdk/anthropic": ">=3.0.0",
     "@ai-sdk/google": ">=3.0.0",
@@ -77,23 +83,26 @@
   "dependencies": {
     "compromise": "^14.13.0",
     "csv-parse": "^6.1.0",
-    "p-limit": "^5.0.0",
+    "p-limit": "^7.3.0",
     "prompts": "^2.4.2",
     "syllable": "^5.0.1",
+    "text-readability": "^1.1.1",
     "zod": "^3.22.4"
   },
   "devDependencies": {
     "@ai-sdk/anthropic": "^3.0.12",
     "@ai-sdk/google": "^3.0.7",
     "@ai-sdk/openai": "^3.0.9",
-    "@types/node": "^20.11.5",
+    "@types/node": "^25.6.0",
     "@types/prompts": "^2.4.9",
     "@typescript-eslint/eslint-plugin": "^6.19.0",
     "@typescript-eslint/parser": "^6.19.0",
     "@vitest/coverage-v8": "^4.0.17",
     "ai": "^6.0.30",
     "eslint": "^8.56.0",
+    "json-schema-to-zod": "^2.8.1",
     "tsup": "^8.0.1",
+    "tsx": "^4.21.0",
     "typescript": "^5.3.3",
     "vitest": "^4.0.17"
   },

package/src/batch/README.md

@@ -61,7 +61,7 @@ Any additional columns beyond `text` and `grade` are preserved as-is in the outp
 
 The batch evaluator runs a fixed group of evaluators together. The current available group is:
 
-- **text-complexity**: Runs grade-level appropriateness, subject matter knowledge, vocabulary complexity, sentence structure, and conventionality evaluators together (requires both Google and OpenAI API keys). Maximum 50 input rows. If you exceed the limit, the CLI will exit with an error and suggest splitting into smaller batches.
+- **text-complexity**: Runs grade-level appropriateness, subject matter knowledge, vocabulary complexity, sentence structure, conventionality, and purpose evaluators together (requires both Google and OpenAI API keys). Maximum 50 input rows. If you exceed the limit, the CLI will exit with an error and suggest splitting into smaller batches. The limit can be bypassed with `--bypass-row-limit` — see [CLI Flags](#cli-flags) below.
 
 ### Output Files
 
@@ -103,6 +103,19 @@ evaluators-batch --concurrency 5 --max-retries 3 --no-telemetry
 | `--concurrency <n>` | `3` | Number of evaluations to run in parallel |
 | `--max-retries <n>` | `2` | Number of times to retry a failed evaluation |
 | `--no-telemetry` | telemetry on | Disable telemetry reporting |
+| `--bypass-row-limit` | off | Skip the per-group input row limit (50). Use with caution: longer runs increase the risk of provider throttling. |
+
+#### When to bypass the row limit
+
+The 50-row default keeps runs short and reduces the risk of provider throttling on the underlying Google and OpenAI calls. If you understand those risks and want to process a larger CSV in one run, pass `--bypass-row-limit` on the CLI or `bypassRowLimit: true` when constructing a `BatchEvaluator` programmatically:
+
+```ts
+const evaluator = new BatchEvaluator({
+  googleApiKey,
+  openaiApiKey,
+  bypassRowLimit: true,
+});
+```
 
 ### API Keys