coder-eval 0.8.4__tar.gz → 0.8.5__tar.gz

{coder_eval-0.8.4 → coder_eval-0.8.5}/.github/dependabot.yml

@@ -26,7 +26,7 @@ updates:
     directory: "/"
     schedule:
       interval: "monthly"
-    open-pull-requests-limit: 3  # Raised from 1: actions are SHA-pinned, so SHA bumps come as patch/minor PRs.
+    open-pull-requests-limit: 3  # Grouped below into one PR; headroom in case a major is held out of the group.
     labels:
       - "dependencies"
       - "github-actions"
@@ -36,3 +36,29 @@ updates:
       prefix: "chore"
     # No ignore block — keep SHA pins current for patch and minor releases too,
     # otherwise SHA pinning fossilizes the actions in place.
+    # One batched PR instead of one per action, matching the npm block below.
+    groups:
+      actions-all:
+        patterns: ["*"]
+
+  # evalboard frontend (npm). Without this block nothing routinely refreshes the
+  # Next.js app, so it drifts until a CVE fires and alerts pile up. Monthly,
+  # grouped bumps keep next/React/Azure ahead of most advisories.
+  - package-ecosystem: "npm"
+    directory: "/evalboard"
+    schedule:
+      interval: "monthly"
+    open-pull-requests-limit: 3
+    labels:
+      - "dependencies"
+      - "javascript"
+    # `chore` keeps the commit + PR title within the Conventional Commits
+    # allowed-type set enforced by conventional-commits.yml (see pip block).
+    commit-message:
+      prefix: "chore"
+      include: "scope"
+    # One batched PR instead of N noisy ones, matching the low-noise style of
+    # the pip/actions blocks above.
+    groups:
+      npm-all:
+        patterns: ["*"]

{coder_eval-0.8.4 → coder_eval-0.8.5}/CHANGELOG.md

@@ -2,6 +2,62 @@
 
 <!-- version list -->
 
+## v0.8.5 (2026-07-20)
+
+### Bug Fixes
+
+- **deps**: Bump mcp to >=1.28.1 for CVE-2026-52869/52870/59950
+  ([#25](https://github.com/UiPath/coder_eval/pull/25),
+  [`fb1ad4c`](https://github.com/UiPath/coder_eval/commit/fb1ad4cba2973414a6a883468f62c908deee532b))
+
+- **orchestration**: Isolate per-task config-resolution failures from the suite
+  ([#25](https://github.com/UiPath/coder_eval/pull/25),
+  [`fb1ad4c`](https://github.com/UiPath/coder_eval/commit/fb1ad4cba2973414a6a883468f62c908deee532b))
+
+- **orchestration**: Normalize the all-fail config-resolution abort to ValueError
+  ([#25](https://github.com/UiPath/coder_eval/pull/25),
+  [`fb1ad4c`](https://github.com/UiPath/coder_eval/commit/fb1ad4cba2973414a6a883468f62c908deee532b))
+
+- **orchestration**: Re-raise ValueError verbatim in the all-fail abort
+  ([#25](https://github.com/UiPath/coder_eval/pull/25),
+  [`fb1ad4c`](https://github.com/UiPath/coder_eval/commit/fb1ad4cba2973414a6a883468f62c908deee532b))
+
+- **orchestrator**: Interrupt-proof teardown so a timeout can't drop task.json
+  ([#29](https://github.com/UiPath/coder_eval/pull/29),
+  [`89ec0d0`](https://github.com/UiPath/coder_eval/commit/89ec0d0eda74616d21a87302680e3099473119bc))
+
+- **sandbox**: Prune capture-ignored entries on every preservation path; interrupt-proof teardown
+  ([#29](https://github.com/UiPath/coder_eval/pull/29),
+  [`89ec0d0`](https://github.com/UiPath/coder_eval/commit/89ec0d0eda74616d21a87302680e3099473119bc))
+
+### Chores
+
+- **evalboard**: Address npm Dependabot alerts ([#18](https://github.com/UiPath/coder_eval/pull/18),
+  [`3d5e7b7`](https://github.com/UiPath/coder_eval/commit/3d5e7b7d2358e10d95d59487c54596df7da1bef2))
+
+- **evalboard**: Batch github-actions bumps into one grouped PR
+  ([#18](https://github.com/UiPath/coder_eval/pull/18),
+  [`3d5e7b7`](https://github.com/UiPath/coder_eval/commit/3d5e7b7d2358e10d95d59487c54596df7da1bef2))
+
+### Documentation
+
+- **orchestrator**: Correct teardown comment to scope of the fix
+  ([#29](https://github.com/UiPath/coder_eval/pull/29),
+  [`89ec0d0`](https://github.com/UiPath/coder_eval/commit/89ec0d0eda74616d21a87302680e3099473119bc))
+
+### Features
+
+- **evalboard**: Show conversation transcript for simulation tasks
+  ([#23](https://github.com/UiPath/coder_eval/pull/23),
+  [`252722a`](https://github.com/UiPath/coder_eval/commit/252722ab17edf3dbc1b68a7ca3a357b2dd3cb0d3))
+
+### Refactoring
+
+- **orchestrator**: Trim to interrupt-proof teardown; drop preservation-prune
+  ([#29](https://github.com/UiPath/coder_eval/pull/29),
+  [`89ec0d0`](https://github.com/UiPath/coder_eval/commit/89ec0d0eda74616d21a87302680e3099473119bc))
+
+
 ## v0.8.4 (2026-07-13)
 
 ### Bug Fixes

{coder_eval-0.8.4 → coder_eval-0.8.5}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: coder-eval
-Version: 0.8.4
+Version: 0.8.5
 Summary: Evaluate, benchmark, and A/B-test AI coding agents (Claude Code, Codex, Gemini/Antigravity) with sandboxed, reproducible YAML task suites.
 Project-URL: Homepage, https://github.com/UiPath/coder_eval
 Project-URL: Repository, https://github.com/UiPath/coder_eval
@@ -46,7 +46,7 @@ Provides-Extra: codex
 Requires-Dist: openai-codex>=0.1.0b3; extra == 'codex'
 Provides-Extra: dev
 Requires-Dist: bandit[toml]>=1.9.4; extra == 'dev'
-Requires-Dist: mcp>=1.26.0; extra == 'dev'
+Requires-Dist: mcp>=1.28.1; extra == 'dev'
 Requires-Dist: pip-audit>=2.10.0; extra == 'dev'
 Requires-Dist: pre-commit>=4.5.1; extra == 'dev'
 Requires-Dist: pyright>=1.1.408; extra == 'dev'

{coder_eval-0.8.4 → coder_eval-0.8.5}/evalboard/package.json

@@ -12,15 +12,17 @@
         "verify": "tsc --noEmit && vitest run && next build"
     },
     "dependencies": {
-        "@azure/identity": "^4.13.1",
-        "@azure/storage-blob": "^12.31.0",
-        "next": "^15.1.0",
+        "next": "^15.5.20",
         "react": "^19.0.0",
         "react-dom": "^19.0.0",
         "react-markdown": "^10.1.0",
         "recharts": "^2.15.0",
         "remark-gfm": "^4.0.1"
     },
+    "optionalDependencies": {
+        "@azure/identity": "^4.13.1",
+        "@azure/storage-blob": ">=12.31.0 <12.33.0"
+    },
     "devDependencies": {
         "@tailwindcss/typography": "^0.5.19",
         "@testing-library/jest-dom": "^6.0.0",
@@ -36,5 +38,13 @@
         "tailwindcss": "^3.4.17",
         "typescript": "^5.6.3",
         "vitest": "^2.1.0"
+    },
+    "pnpm": {
+        "overrides": {
+            "postcss": "^8.5.10",
+            "fast-xml-builder": "^1.1.7",
+            "@babel/core": "^7.29.6",
+            "uuid": "^11.1.1"
+        }
     }
 }