codegraph-brain 0.11.0__tar.gz → 0.13.0__tar.gz

codegraph_brain-0.13.0/.gitattributes

@@ -0,0 +1,6 @@
+# The review fingerprint (#375) hashes file bytes, so a checkout that stores
+# CRLF would produce a different digest for identical code — and the measured
+# digest would disagree with the reconstructed one on the same commit. Pinned
+# rather than normalised at hash time, because a normaliser can only fail by
+# merging two reviewers that differ.
+*.py text eol=lf

{codegraph_brain-0.11.0 → codegraph_brain-0.13.0}/.github/workflows/ci.yml

@@ -115,6 +115,34 @@ jobs:
           # Deliberately scoped to scripts/. src/ keeps the rule — metrics.py:70
           # is library code and its instance deserves a real answer (#342).
           #
+          # pythonsecurity:S2083 ("do not construct the path from user-controlled
+          # data") is exempted for scripts/ too, but for a DIFFERENT reason than
+          # S8707 above, and the difference matters. S8707's argument is that
+          # confining these tools to a root would break legitimate ad-hoc runs.
+          # S2083 was raised against backfill_review_fingerprint.py, which does
+          # the opposite: `safe_corpus_path` resolves the argument, requires a
+          # .jsonl regular file, confines it under the repository root, raises
+          # otherwise, and returns the resolved path that `backfill()` then uses
+          # for every read and write — the original argument never reaches the
+          # filesystem again (#375).
+          #
+          # The finding survived that. It was reported first at the read, then at
+          # the write, unchanged by binding the check to the value used, because
+          # SonarCloud's Python taint engine does not model `Path.resolve()` plus
+          # `is_relative_to()` as a sanitiser. The remaining report is an engine
+          # limitation, not an unvalidated path. Verified rather than assumed:
+          # main carries no open S2083, and the one S8707 left in src/ is marked
+          # FALSE-POSITIVE by a human, so neither rule has a working precedent
+          # here to copy blindly.
+          #
+          # The alternative considered and rejected was taking a bare filename
+          # and building the path from a fixed base, which the engine would
+          # accept. It makes traversal inexpressible, but it changes a documented
+          # CLI to satisfy an analyser rather than to close a hole that is
+          # already closed. If a script ever takes a path it does NOT validate,
+          # this exemption hides it — that is the cost, and it is the reason the
+          # rule stays on for src/.
+          #
           # `sonar.newCode.referenceBranch` overrides the server-side new-code
           # definition for this analysis. The instance default is
           # `previous_version` (confirmed: sonar.leak.period=previous_version,
@@ -173,9 +201,11 @@ jobs:
             -Dsonar.tests=tests
             -Dsonar.python.version=3.12
             -Dsonar.python.coverage.reportPaths=coverage.xml
-            -Dsonar.issue.ignore.multicriteria=e1,e2,e3
+            -Dsonar.issue.ignore.multicriteria=e1,e2,e3,e4
             -Dsonar.issue.ignore.multicriteria.e1.ruleKey=pythonsecurity:S8707
             -Dsonar.issue.ignore.multicriteria.e1.resourceKey=scripts/**/*.py
+            -Dsonar.issue.ignore.multicriteria.e4.ruleKey=pythonsecurity:S2083
+            -Dsonar.issue.ignore.multicriteria.e4.resourceKey=scripts/**/*.py
             -Dsonar.issue.ignore.multicriteria.e2.ruleKey=githubactions:S8541
             -Dsonar.issue.ignore.multicriteria.e2.resourceKey=.github/workflows/*.yml
             -Dsonar.issue.ignore.multicriteria.e3.ruleKey=githubactions:S8544

codegraph_brain-0.13.0/.release-please-manifest.json

@@ -0,0 +1,3 @@
+{
+  ".": "0.13.0"
+}

{codegraph_brain-0.11.0 → codegraph_brain-0.13.0}/CHANGELOG.md

@@ -1,5 +1,44 @@
 # Changelog
 
+## [0.13.0](https://github.com/zaebee/codegraph-brain/compare/codegraph-brain-v0.12.0...codegraph-brain-v0.13.0) (2026-08-15)
+
+
+### Features
+
+* **guardian:** an identity for a reviewer, that a commit does not fragment ([#375](https://github.com/zaebee/codegraph-brain/issues/375)) ([#383](https://github.com/zaebee/codegraph-brain/issues/383)) ([e339a38](https://github.com/zaebee/codegraph-brain/commit/e339a38743ddfdaac1e7c8f0724281844d5a8b38))
+
+## [0.12.0](https://github.com/zaebee/codegraph-brain/compare/codegraph-brain-v0.11.0...codegraph-brain-v0.12.0) (2026-08-13)
+
+
+### Features
+
+* **guardian:** an ablation arm, because G5 cannot separate graph from language ([#342](https://github.com/zaebee/codegraph-brain/issues/342)) ([#366](https://github.com/zaebee/codegraph-brain/issues/366)) ([e2374a7](https://github.com/zaebee/codegraph-brain/commit/e2374a72016413414241e71d3cc37a7ce251c590))
+* **guardian:** bound the local finder's output, because it does not stop ([#246](https://github.com/zaebee/codegraph-brain/issues/246)) ([#381](https://github.com/zaebee/codegraph-brain/issues/381)) ([1e0b5e1](https://github.com/zaebee/codegraph-brain/commit/1e0b5e13332c697102a22838f90fed265c0fec67))
+* **guardian:** expose judge concurrency, because Mistral needs it at 1 ([#342](https://github.com/zaebee/codegraph-brain/issues/342)) ([#364](https://github.com/zaebee/codegraph-brain/issues/364)) ([47392e8](https://github.com/zaebee/codegraph-brain/commit/47392e829e8653e6d145533a637342e8a46b4982))
+* **guardian:** keep the valid prefix of a truncated finder response ([#248](https://github.com/zaebee/codegraph-brain/issues/248)) ([#377](https://github.com/zaebee/codegraph-brain/issues/377)) ([d34f01f](https://github.com/zaebee/codegraph-brain/commit/d34f01fa11208c0f8202579edc7e07dccb163ad4))
+* **guardian:** record what the judge spent, per row ([#342](https://github.com/zaebee/codegraph-brain/issues/342)) ([#378](https://github.com/zaebee/codegraph-brain/issues/378)) ([c4eea31](https://github.com/zaebee/codegraph-brain/commit/c4eea31b12492d90dafb92b3afacfbe9a942bab5))
+* **guardian:** refuse a review of a truncated prompt, and supply the missing visitor ([#248](https://github.com/zaebee/codegraph-brain/issues/248)) ([#371](https://github.com/zaebee/codegraph-brain/issues/371)) ([5f3e9b7](https://github.com/zaebee/codegraph-brain/commit/5f3e9b73bcc36aabe64d634e4aa95ea0f5bd7fb7))
+* **guardian:** review --slice, so the registered population is a command ([#342](https://github.com/zaebee/codegraph-brain/issues/342)) ([#373](https://github.com/zaebee/codegraph-brain/issues/373)) ([4d1fe6a](https://github.com/zaebee/codegraph-brain/commit/4d1fe6a8073641cdd46a9d9af24a3c31abd70764))
+* **guardian:** sampling reaches Ollama, instead of the chat template deciding ([#246](https://github.com/zaebee/codegraph-brain/issues/246)) ([#380](https://github.com/zaebee/codegraph-brain/issues/380)) ([14cb966](https://github.com/zaebee/codegraph-brain/commit/14cb9664f200aa9507f1f364f72dfb0de0981259))
+* **guardian:** send the registered temperature, and survive a 429 ([#342](https://github.com/zaebee/codegraph-brain/issues/342)) ([#372](https://github.com/zaebee/codegraph-brain/issues/372)) ([3d7efd8](https://github.com/zaebee/codegraph-brain/commit/3d7efd82efe750283a43eb0d5cb7941f7f67ddd1))
+* **guardian:** the union arm scores offline, and a unit bug made G8 unfailable ([#342](https://github.com/zaebee/codegraph-brain/issues/342)) ([#370](https://github.com/zaebee/codegraph-brain/issues/370)) ([dd290fe](https://github.com/zaebee/codegraph-brain/commit/dd290fef986ad0dcf0b62da9fa2824e0ace1b90d))
+
+
+### Bug Fixes
+
+* **guardian:** a dead judge is not a reviewer that found nothing ([#342](https://github.com/zaebee/codegraph-brain/issues/342)) ([#376](https://github.com/zaebee/codegraph-brain/issues/376)) ([2772c30](https://github.com/zaebee/codegraph-brain/commit/2772c305e9d7ca70c31bdfc2b12297392768330c))
+* **guardian:** a truncated review is not a review that found nothing ([#342](https://github.com/zaebee/codegraph-brain/issues/342)) ([#374](https://github.com/zaebee/codegraph-brain/issues/374)) ([9f86bb6](https://github.com/zaebee/codegraph-brain/commit/9f86bb63e297e2b8bdda6bf6214e5d1e1bbd9339))
+* **guardian:** the ablation must skip PRs with no graph to remove ([#342](https://github.com/zaebee/codegraph-brain/issues/342)) ([#367](https://github.com/zaebee/codegraph-brain/issues/367)) ([f9c36f5](https://github.com/zaebee/codegraph-brain/commit/f9c36f5cae503d83002ad03957eb7bf0cf31d263))
+
+
+### Documentation
+
+* **guardian:** bench a local model in a notebook, and retire a wrong lever ([#246](https://github.com/zaebee/codegraph-brain/issues/246)) ([#379](https://github.com/zaebee/codegraph-brain/issues/379)) ([419fcc1](https://github.com/zaebee/codegraph-brain/commit/419fcc1eb28fddd9a2c0cef814480d861e6d8c88))
+* **spec:** Phase 2 results — G5 fails at +9.5 pp against a 10 pp gate ([#342](https://github.com/zaebee/codegraph-brain/issues/342)) ([#362](https://github.com/zaebee/codegraph-brain/issues/362)) ([9481a54](https://github.com/zaebee/codegraph-brain/commit/9481a54c02b60786e14e6317d3a71c8a4cee12a0))
+* **spec:** Phase 3 registers the union arm, and the pilot says it is marginal ([#342](https://github.com/zaebee/codegraph-brain/issues/342)) ([#369](https://github.com/zaebee/codegraph-brain/issues/369)) ([bc9caf4](https://github.com/zaebee/codegraph-brain/commit/bc9caf43c16a2ce27a0075b14eb0766569ae8c2d))
+* **spec:** R5 — the noise floor equals the effect, so Phase 2 cannot answer its question ([#342](https://github.com/zaebee/codegraph-brain/issues/342)) ([#368](https://github.com/zaebee/codegraph-brain/issues/368)) ([8540bf1](https://github.com/zaebee/codegraph-brain/commit/8540bf1178a8535849bdd2fadfa5473f42040eb8))
+* **spec:** second judge — G5 fails under both, and the row becomes publishable ([#342](https://github.com/zaebee/codegraph-brain/issues/342)) ([#365](https://github.com/zaebee/codegraph-brain/issues/365)) ([62c49e4](https://github.com/zaebee/codegraph-brain/commit/62c49e4b36c0950df0c10cce26c09418674130eb))
+
 ## [0.11.0](https://github.com/zaebee/codegraph-brain/compare/codegraph-brain-v0.10.0...codegraph-brain-v0.11.0) (2026-08-12)
 
 

{codegraph_brain-0.11.0 → codegraph_brain-0.13.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.5
 Name: codegraph-brain
-Version: 0.11.0
+Version: 0.13.0
 Summary: Semantic code graph for AI agents — deterministic FQN resolution, impact analysis and architectural drift gates, exposed over MCP.
 Project-URL: Homepage, https://github.com/zaebee/codegraph-brain
 Project-URL: Repository, https://github.com/zaebee/codegraph-brain
@@ -169,6 +169,8 @@ GUARDIAN_PROVIDER=ollama GUARDIAN_MODEL=qwen2.5-coder:14b \
   uv run python scripts/guardian_review.py --pr 123 --db graph.db --inline
 ```
 
+No GPU on hand? **[Benchmark it on a notebook GPU →](docs/GUARDIAN_LOCAL_BENCH.md)** — free end to end, since the fixtures score without an LLM judge. Or **[point Guardian at a remote Ollama →](docs/GUARDIAN_REMOTE_OLLAMA.md)** — over an frp stcp tunnel, no public port, and a guard that refuses a review of a silently truncated prompt.
+
 ---
 
 ## 📈 Proof at Real Scale

{codegraph_brain-0.11.0 → codegraph_brain-0.13.0}/README.md

@@ -119,6 +119,8 @@ GUARDIAN_PROVIDER=ollama GUARDIAN_MODEL=qwen2.5-coder:14b \
   uv run python scripts/guardian_review.py --pr 123 --db graph.db --inline
 ```
 
+No GPU on hand? **[Benchmark it on a notebook GPU →](docs/GUARDIAN_LOCAL_BENCH.md)** — free end to end, since the fixtures score without an LLM judge. Or **[point Guardian at a remote Ollama →](docs/GUARDIAN_REMOTE_OLLAMA.md)** — over an frp stcp tunnel, no public port, and a guard that refuses a review of a silently truncated prompt.
+
 ---
 
 ## 📈 Proof at Real Scale

codegraph_brain-0.13.0/benchmarks/martian-judged.jsonl

@@ -0,0 +1,109 @@
+{"url":"https://github.com/getsentry/sentry/pull/80168","project":"sentry","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":3,"n_candidates":1,"tp":1,"fp":0,"fn":2,"precision":1.0,"recall":0.3333333333333333,"judge_failures":0,"decisions":[1,0,0],"judged_at":"2026-08-12T12:27:18.392581+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/10600","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":4,"n_candidates":1,"tp":0,"fp":1,"fn":4,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0,0],"judged_at":"2026-08-12T15:50:45.034169+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/10967","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":5,"n_candidates":8,"tp":1,"fp":7,"fn":4,"precision":0.125,"recall":0.2,"judge_failures":0,"decisions":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,0,0,0,0,0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T15:51:23.250457+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/11059","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":9,"n_candidates":7,"tp":4,"fp":3,"fn":5,"precision":0.5714285714285714,"recall":0.4444444444444444,"judge_failures":0,"decisions":[0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,1,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T15:52:22.090960+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/14740","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":6,"n_candidates":2,"tp":2,"fp":0,"fn":4,"precision":1.0,"recall":0.3333333333333333,"judge_failures":0,"decisions":[0,0,1,0,0,1,0,0,0,0,0,0],"judged_at":"2026-08-12T15:52:37.907593+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/14943","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":1,"tp":1,"fp":0,"fn":1,"precision":1.0,"recall":0.5,"judge_failures":0,"decisions":[0,1],"judged_at":"2026-08-12T15:52:41.611402+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/22345","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":1,"n_candidates":2,"tp":0,"fp":2,"fn":1,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0],"judged_at":"2026-08-12T15:52:44.658863+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/22532","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":4,"n_candidates":3,"tp":2,"fp":1,"fn":2,"precision":0.6666666666666666,"recall":0.5,"judge_failures":0,"decisions":[0,0,0,0,1,0,0,0,0,0,0,1],"judged_at":"2026-08-12T15:52:53.637681+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/7232","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":3,"n_candidates":6,"tp":1,"fp":5,"fn":2,"precision":0.16666666666666666,"recall":0.3333333333333333,"judge_failures":0,"decisions":[0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T15:53:15.982968+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/8087","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":1,"n_candidates":3,"tp":1,"fp":2,"fn":0,"precision":0.3333333333333333,"recall":1.0,"judge_failures":0,"decisions":[1,1,1],"judged_at":"2026-08-12T15:53:19.249040+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/8330","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":4,"tp":1,"fp":3,"fn":1,"precision":0.25,"recall":0.5,"judge_failures":0,"decisions":[0,1,0,0,0,0,0,0],"judged_at":"2026-08-12T15:53:27.357342+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/1","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":4,"n_candidates":5,"tp":2,"fp":3,"fn":2,"precision":0.4,"recall":0.5,"judge_failures":0,"decisions":[0,0,0,0,0,0,1,1,1,0,1,0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T15:53:45.264166+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/10","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":7,"n_candidates":4,"tp":2,"fp":2,"fn":5,"precision":0.5,"recall":0.2857142857142857,"judge_failures":0,"decisions":[0,0,0,0,1,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,1,0,0,0],"judged_at":"2026-08-12T15:54:08.700929+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/2","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":1,"n_candidates":2,"tp":1,"fp":1,"fn":0,"precision":0.5,"recall":1.0,"judge_failures":0,"decisions":[1,1],"judged_at":"2026-08-12T15:54:11.657358+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/3","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":3,"n_candidates":4,"tp":1,"fp":3,"fn":2,"precision":0.25,"recall":0.3333333333333333,"judge_failures":0,"decisions":[0,0,1,0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T15:54:23.188333+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/4","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":8,"n_candidates":7,"tp":1,"fp":6,"fn":7,"precision":0.14285714285714285,"recall":0.125,"judge_failures":0,"decisions":[0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T15:55:07.748360+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/5","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":3,"n_candidates":3,"tp":0,"fp":3,"fn":3,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T15:55:15.927219+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/6","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":1,"n_candidates":0,"tp":0,"fp":0,"fn":1,"precision":1.0,"recall":0.0,"judge_failures":0,"decisions":[],"judged_at":"2026-08-12T15:55:15.927811+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/7","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":3,"n_candidates":1,"tp":1,"fp":0,"fn":2,"precision":1.0,"recall":0.3333333333333333,"judge_failures":0,"decisions":[0,0,1],"judged_at":"2026-08-12T15:55:24.122948+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/8","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":6,"n_candidates":5,"tp":1,"fp":4,"fn":5,"precision":0.2,"recall":0.16666666666666666,"judge_failures":0,"decisions":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,0],"judged_at":"2026-08-12T15:55:44.654463+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/9","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":2,"tp":0,"fp":2,"fn":2,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0,0],"judged_at":"2026-08-12T15:55:48.717042+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/103633","project":"grafana","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":3,"n_candidates":2,"tp":1,"fp":1,"fn":2,"precision":0.5,"recall":0.3333333333333333,"judge_failures":0,"decisions":[0,0,0,1,0,0],"judged_at":"2026-08-12T15:55:55.805257+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/106778","project":"grafana","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":1,"tp":0,"fp":1,"fn":2,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0],"judged_at":"2026-08-12T15:56:00.203726+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/107534","project":"grafana","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":1,"n_candidates":0,"tp":0,"fp":0,"fn":1,"precision":1.0,"recall":0.0,"judge_failures":0,"decisions":[],"judged_at":"2026-08-12T15:56:00.203876+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/76186","project":"grafana","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":3,"n_candidates":3,"tp":1,"fp":2,"fn":2,"precision":0.3333333333333333,"recall":0.3333333333333333,"judge_failures":0,"decisions":[0,0,0,0,0,0,0,0,1],"judged_at":"2026-08-12T15:56:11.699764+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/79265","project":"grafana","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":5,"n_candidates":3,"tp":3,"fp":0,"fn":2,"precision":1.0,"recall":0.6,"judge_failures":0,"decisions":[0,0,0,1,0,0,0,1,1,0,1,0,0,0,0],"judged_at":"2026-08-12T15:56:29.213416+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/80329","project":"grafana","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":3,"tp":1,"fp":2,"fn":1,"precision":0.3333333333333333,"recall":0.5,"judge_failures":0,"decisions":[0,1,1,0,0,0],"judged_at":"2026-08-12T15:56:33.305408+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/90045","project":"grafana","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":3,"n_candidates":6,"tp":0,"fp":6,"fn":3,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T15:56:46.973302+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/90939","project":"grafana","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":1,"tp":1,"fp":0,"fn":1,"precision":1.0,"recall":0.5,"judge_failures":0,"decisions":[1,0],"judged_at":"2026-08-12T15:56:49.984824+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/94942","project":"grafana","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":2,"tp":2,"fp":0,"fn":0,"precision":1.0,"recall":1.0,"judge_failures":0,"decisions":[1,0,0,1],"judged_at":"2026-08-12T15:56:53.868855+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/97529","project":"grafana","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":3,"tp":1,"fp":2,"fn":1,"precision":0.3333333333333333,"recall":0.5,"judge_failures":0,"decisions":[0,0,1,0,0,0],"judged_at":"2026-08-12T15:57:01.834877+00:00"}
+{"url":"https://github.com/keycloak/keycloak/pull/32918","project":"keycloak","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":2,"tp":0,"fp":2,"fn":2,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0,0],"judged_at":"2026-08-12T15:57:05.862213+00:00"}
+{"url":"https://github.com/keycloak/keycloak/pull/33832","project":"keycloak","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":3,"n_candidates":3,"tp":1,"fp":2,"fn":2,"precision":0.3333333333333333,"recall":0.3333333333333333,"judge_failures":0,"decisions":[0,0,1,0,0,0,0,0,0],"judged_at":"2026-08-12T15:57:12.613113+00:00"}
+{"url":"https://github.com/keycloak/keycloak/pull/36880","project":"keycloak","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":4,"n_candidates":2,"tp":1,"fp":1,"fn":3,"precision":0.5,"recall":0.25,"judge_failures":0,"decisions":[0,0,0,1,0,0,0,0],"judged_at":"2026-08-12T15:57:22.542354+00:00"}
+{"url":"https://github.com/keycloak/keycloak/pull/36882","project":"keycloak","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":1,"tp":0,"fp":1,"fn":2,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0],"judged_at":"2026-08-12T15:57:25.355033+00:00"}
+{"url":"https://github.com/keycloak/keycloak/pull/37038","project":"keycloak","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":2,"tp":0,"fp":2,"fn":2,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0,0],"judged_at":"2026-08-12T15:57:30.370827+00:00"}
+{"url":"https://github.com/keycloak/keycloak/pull/37429","project":"keycloak","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":3,"n_candidates":1,"tp":0,"fp":1,"fn":3,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0],"judged_at":"2026-08-12T15:57:33.278922+00:00"}
+{"url":"https://github.com/keycloak/keycloak/pull/37634","project":"keycloak","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":4,"n_candidates":3,"tp":2,"fp":1,"fn":2,"precision":0.6666666666666666,"recall":0.5,"judge_failures":0,"decisions":[0,0,1,1,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T15:57:41.410586+00:00"}
+{"url":"https://github.com/keycloak/keycloak/pull/38446","project":"keycloak","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":3,"tp":0,"fp":3,"fn":2,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0,0,0,0],"judged_at":"2026-08-12T15:57:48.605584+00:00"}
+{"url":"https://github.com/keycloak/keycloak/pull/40940","project":"keycloak","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":2,"tp":1,"fp":1,"fn":1,"precision":0.5,"recall":0.5,"judge_failures":0,"decisions":[1,1,0,0],"judged_at":"2026-08-12T15:57:56.968323+00:00"}
+{"url":"https://github.com/getsentry/sentry/pull/67876","project":"sentry","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":3,"n_candidates":2,"tp":1,"fp":1,"fn":2,"precision":0.5,"recall":0.3333333333333333,"judge_failures":0,"decisions":[0,0,0,0,1,0],"judged_at":"2026-08-12T15:58:02.237262+00:00"}
+{"url":"https://github.com/getsentry/sentry/pull/77754","project":"sentry","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":3,"tp":1,"fp":2,"fn":1,"precision":0.3333333333333333,"recall":0.5,"judge_failures":0,"decisions":[1,1,0,0,0,0],"judged_at":"2026-08-12T15:58:10.250491+00:00"}
+{"url":"https://github.com/getsentry/sentry/pull/80528","project":"sentry","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":4,"tp":1,"fp":3,"fn":1,"precision":0.25,"recall":0.5,"judge_failures":0,"decisions":[0,0,1,0,0,0,0,0],"judged_at":"2026-08-12T15:58:15.912225+00:00"}
+{"url":"https://github.com/getsentry/sentry/pull/93824","project":"sentry","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":5,"n_candidates":2,"tp":2,"fp":0,"fn":3,"precision":1.0,"recall":0.4,"judge_failures":0,"decisions":[1,0,0,1,0,0,0,1,0,0],"judged_at":"2026-08-12T15:58:24.648564+00:00"}
+{"url":"https://github.com/getsentry/sentry/pull/95633","project":"sentry","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":1,"n_candidates":3,"tp":0,"fp":3,"fn":1,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0],"judged_at":"2026-08-12T15:58:26.995287+00:00"}
+{"url":"https://github.com/getsentry/sentry/pull/80168","project":"sentry","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":3,"n_candidates":1,"tp":1,"fp":0,"fn":2,"precision":1.0,"recall":0.3333333333333333,"judge_failures":0,"decisions":[1,0,0],"judged_at":"2026-08-12T16:20:06.348249+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/10600","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":4,"n_candidates":1,"tp":0,"fp":1,"fn":4,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0,0],"judged_at":"2026-08-12T16:20:27.001865+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/10967","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":5,"n_candidates":8,"tp":1,"fp":7,"fn":4,"precision":0.125,"recall":0.2,"judge_failures":0,"decisions":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,0,0,0,0,0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T16:21:17.393127+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/11059","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":9,"n_candidates":7,"tp":4,"fp":3,"fn":5,"precision":0.5714285714285714,"recall":0.4444444444444444,"judge_failures":0,"decisions":[0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,1,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T16:22:47.359303+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/14740","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":6,"n_candidates":2,"tp":2,"fp":0,"fn":4,"precision":1.0,"recall":0.3333333333333333,"judge_failures":0,"decisions":[0,0,1,0,0,1,0,0,0,0,0,0],"judged_at":"2026-08-12T16:23:05.716645+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/14943","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":2,"n_candidates":1,"tp":1,"fp":0,"fn":1,"precision":1.0,"recall":0.5,"judge_failures":0,"decisions":[0,1],"judged_at":"2026-08-12T16:23:08.341571+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/22345","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":1,"n_candidates":2,"tp":0,"fp":2,"fn":1,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0],"judged_at":"2026-08-12T16:23:10.418894+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/22532","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":4,"n_candidates":3,"tp":2,"fp":1,"fn":2,"precision":0.6666666666666666,"recall":0.5,"judge_failures":0,"decisions":[0,0,0,0,1,0,0,0,0,0,0,1],"judged_at":"2026-08-12T16:23:25.881697+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/7232","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":3,"n_candidates":6,"tp":1,"fp":5,"fn":2,"precision":0.16666666666666666,"recall":0.3333333333333333,"judge_failures":0,"decisions":[0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T16:23:54.416720+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/8087","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":1,"n_candidates":3,"tp":1,"fp":2,"fn":0,"precision":0.3333333333333333,"recall":1.0,"judge_failures":0,"decisions":[1,1,1],"judged_at":"2026-08-12T16:23:59.957083+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/8330","project":"cal_dot_com","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":2,"n_candidates":4,"tp":1,"fp":3,"fn":1,"precision":0.25,"recall":0.5,"judge_failures":0,"decisions":[0,1,0,0,0,0,0,0],"judged_at":"2026-08-12T16:24:11.384058+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/1","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":4,"n_candidates":5,"tp":2,"fp":3,"fn":2,"precision":0.4,"recall":0.5,"judge_failures":0,"decisions":[0,0,0,0,0,0,1,1,1,0,1,0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T16:24:38.971391+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/10","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":7,"n_candidates":4,"tp":2,"fp":2,"fn":5,"precision":0.5,"recall":0.2857142857142857,"judge_failures":0,"decisions":[0,0,0,0,1,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,1,0,0,0],"judged_at":"2026-08-12T16:25:15.252382+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/2","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":1,"n_candidates":2,"tp":1,"fp":1,"fn":0,"precision":0.5,"recall":1.0,"judge_failures":0,"decisions":[1,1],"judged_at":"2026-08-12T16:25:18.488501+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/3","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":3,"n_candidates":4,"tp":1,"fp":3,"fn":2,"precision":0.25,"recall":0.3333333333333333,"judge_failures":0,"decisions":[0,0,1,0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T16:25:36.181733+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/4","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":8,"n_candidates":7,"tp":1,"fp":6,"fn":7,"precision":0.14285714285714285,"recall":0.125,"judge_failures":0,"decisions":[0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T16:26:52.390168+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/5","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":3,"n_candidates":3,"tp":0,"fp":3,"fn":3,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T16:27:08.329871+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/6","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":1,"n_candidates":0,"tp":0,"fp":0,"fn":1,"precision":1.0,"recall":0.0,"judge_failures":0,"decisions":[],"judged_at":"2026-08-12T16:27:08.330041+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/7","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":3,"n_candidates":1,"tp":0,"fp":1,"fn":3,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0],"judged_at":"2026-08-12T16:27:14.967999+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/8","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":6,"n_candidates":5,"tp":1,"fp":4,"fn":5,"precision":0.2,"recall":0.16666666666666666,"judge_failures":0,"decisions":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,0],"judged_at":"2026-08-12T16:27:58.988929+00:00"}
+{"url":"https://github.com/ai-code-review-evaluation/discourse-graphite/pull/9","project":"discourse","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":2,"n_candidates":2,"tp":0,"fp":2,"fn":2,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0,0],"judged_at":"2026-08-12T16:28:04.838702+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/103633","project":"grafana","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":3,"n_candidates":2,"tp":1,"fp":1,"fn":2,"precision":0.5,"recall":0.3333333333333333,"judge_failures":0,"decisions":[0,0,0,1,0,0],"judged_at":"2026-08-12T16:28:15.995107+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/106778","project":"grafana","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":2,"n_candidates":1,"tp":0,"fp":1,"fn":2,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0],"judged_at":"2026-08-12T16:28:19.055775+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/107534","project":"grafana","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":1,"n_candidates":0,"tp":0,"fp":0,"fn":1,"precision":1.0,"recall":0.0,"judge_failures":0,"decisions":[],"judged_at":"2026-08-12T16:28:19.055909+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/76186","project":"grafana","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":3,"n_candidates":3,"tp":2,"fp":1,"fn":1,"precision":0.6666666666666666,"recall":0.6666666666666666,"judge_failures":0,"decisions":[0,0,0,1,1,0,0,0,1],"judged_at":"2026-08-12T16:28:35.803172+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/79265","project":"grafana","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":5,"n_candidates":3,"tp":3,"fp":0,"fn":2,"precision":1.0,"recall":0.6,"judge_failures":0,"decisions":[0,0,0,1,0,1,0,1,1,0,1,0,0,0,0],"judged_at":"2026-08-12T16:28:59.892928+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/80329","project":"grafana","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":2,"n_candidates":3,"tp":1,"fp":2,"fn":1,"precision":0.3333333333333333,"recall":0.5,"judge_failures":0,"decisions":[0,1,1,0,0,0],"judged_at":"2026-08-12T16:29:06.824534+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/90045","project":"grafana","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":3,"n_candidates":6,"tp":0,"fp":6,"fn":3,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T16:29:32.891351+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/90939","project":"grafana","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":2,"n_candidates":1,"tp":1,"fp":0,"fn":1,"precision":1.0,"recall":0.5,"judge_failures":0,"decisions":[1,0],"judged_at":"2026-08-12T16:29:35.869074+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/94942","project":"grafana","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":2,"n_candidates":2,"tp":2,"fp":0,"fn":0,"precision":1.0,"recall":1.0,"judge_failures":0,"decisions":[1,0,0,1],"judged_at":"2026-08-12T16:29:40.636438+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/97529","project":"grafana","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":2,"n_candidates":3,"tp":1,"fp":2,"fn":1,"precision":0.3333333333333333,"recall":0.5,"judge_failures":0,"decisions":[0,0,1,0,0,1],"judged_at":"2026-08-12T16:29:50.356145+00:00"}
+{"url":"https://github.com/keycloak/keycloak/pull/32918","project":"keycloak","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":2,"n_candidates":2,"tp":0,"fp":2,"fn":2,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0,0],"judged_at":"2026-08-12T16:29:57.036198+00:00"}
+{"url":"https://github.com/keycloak/keycloak/pull/33832","project":"keycloak","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":3,"n_candidates":3,"tp":1,"fp":2,"fn":2,"precision":0.3333333333333333,"recall":0.3333333333333333,"judge_failures":0,"decisions":[0,0,1,0,0,0,0,0,0],"judged_at":"2026-08-12T16:30:11.025125+00:00"}
+{"url":"https://github.com/keycloak/keycloak/pull/36880","project":"keycloak","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":4,"n_candidates":2,"tp":1,"fp":1,"fn":3,"precision":0.5,"recall":0.25,"judge_failures":0,"decisions":[0,0,0,1,0,0,0,0],"judged_at":"2026-08-12T16:30:22.611366+00:00"}
+{"url":"https://github.com/keycloak/keycloak/pull/36882","project":"keycloak","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":2,"n_candidates":1,"tp":0,"fp":1,"fn":2,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0],"judged_at":"2026-08-12T16:30:25.387979+00:00"}
+{"url":"https://github.com/keycloak/keycloak/pull/37038","project":"keycloak","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":2,"n_candidates":2,"tp":0,"fp":2,"fn":2,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0,0],"judged_at":"2026-08-12T16:30:32.020236+00:00"}
+{"url":"https://github.com/keycloak/keycloak/pull/37429","project":"keycloak","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":3,"n_candidates":1,"tp":0,"fp":1,"fn":3,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0],"judged_at":"2026-08-12T16:30:34.694059+00:00"}
+{"url":"https://github.com/keycloak/keycloak/pull/37634","project":"keycloak","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":4,"n_candidates":3,"tp":2,"fp":1,"fn":2,"precision":0.6666666666666666,"recall":0.5,"judge_failures":0,"decisions":[0,0,1,1,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T16:30:48.851088+00:00"}
+{"url":"https://github.com/keycloak/keycloak/pull/38446","project":"keycloak","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":2,"n_candidates":3,"tp":1,"fp":2,"fn":1,"precision":0.3333333333333333,"recall":0.5,"judge_failures":0,"decisions":[1,0,0,0,0,0],"judged_at":"2026-08-12T16:30:57.363694+00:00"}
+{"url":"https://github.com/keycloak/keycloak/pull/40940","project":"keycloak","pr_slice":"diff-only","had_graph":false,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":2,"n_candidates":2,"tp":1,"fp":1,"fn":1,"precision":0.5,"recall":0.5,"judge_failures":0,"decisions":[1,0,0,0],"judged_at":"2026-08-12T16:31:03.283412+00:00"}
+{"url":"https://github.com/getsentry/sentry/pull/67876","project":"sentry","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":3,"n_candidates":2,"tp":1,"fp":1,"fn":2,"precision":0.5,"recall":0.3333333333333333,"judge_failures":0,"decisions":[0,0,0,0,1,0],"judged_at":"2026-08-12T16:31:11.693148+00:00"}
+{"url":"https://github.com/getsentry/sentry/pull/77754","project":"sentry","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":2,"n_candidates":3,"tp":1,"fp":2,"fn":1,"precision":0.3333333333333333,"recall":0.5,"judge_failures":0,"decisions":[1,1,0,0,0,0],"judged_at":"2026-08-12T16:31:22.117408+00:00"}
+{"url":"https://github.com/getsentry/sentry/pull/80528","project":"sentry","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":2,"n_candidates":4,"tp":1,"fp":3,"fn":1,"precision":0.25,"recall":0.5,"judge_failures":0,"decisions":[0,0,1,0,0,0,0,0],"judged_at":"2026-08-12T16:31:30.193596+00:00"}
+{"url":"https://github.com/getsentry/sentry/pull/93824","project":"sentry","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":5,"n_candidates":2,"tp":1,"fp":1,"fn":4,"precision":0.5,"recall":0.2,"judge_failures":0,"decisions":[0,0,0,1,0,0,0,1,0,0],"judged_at":"2026-08-12T16:31:47.197197+00:00"}
+{"url":"https://github.com/getsentry/sentry/pull/95633","project":"sentry","pr_slice":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":1,"n_candidates":3,"tp":0,"fp":3,"fn":1,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0],"judged_at":"2026-08-12T16:31:51.143576+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/10600","project":"cal_dot_com","pr_slice":"graph","arm":"ablated","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":4,"n_candidates":2,"tp":0,"fp":2,"fn":4,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T17:23:54.962761+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/10967","project":"cal_dot_com","pr_slice":"graph","arm":"ablated","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":5,"n_candidates":6,"tp":0,"fp":6,"fn":5,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T17:24:23.980870+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/11059","project":"cal_dot_com","pr_slice":"graph","arm":"ablated","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":9,"n_candidates":8,"tp":4,"fp":4,"fn":5,"precision":0.5,"recall":0.4444444444444444,"judge_failures":0,"decisions":[1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,1,1,0,0,0,0,1,1,1,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T17:25:38.651780+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/14740","project":"cal_dot_com","pr_slice":"graph","arm":"ablated","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":6,"n_candidates":6,"tp":3,"fp":3,"fn":3,"precision":0.5,"recall":0.5,"judge_failures":0,"decisions":[0,0,0,0,0,0,1,0,0,0,0,0,0,1,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T17:26:10.466163+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/14943","project":"cal_dot_com","pr_slice":"graph","arm":"ablated","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":1,"tp":0,"fp":1,"fn":2,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0],"judged_at":"2026-08-12T17:26:13.980833+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/22345","project":"cal_dot_com","pr_slice":"graph","arm":"ablated","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":1,"n_candidates":2,"tp":0,"fp":2,"fn":1,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0],"judged_at":"2026-08-12T17:26:16.739651+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/22532","project":"cal_dot_com","pr_slice":"graph","arm":"ablated","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":4,"n_candidates":3,"tp":2,"fp":1,"fn":2,"precision":0.6666666666666666,"recall":0.5,"judge_failures":0,"decisions":[0,0,1,0,1,0,0,0,0,0,0,0],"judged_at":"2026-08-12T17:26:28.255534+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/7232","project":"cal_dot_com","pr_slice":"graph","arm":"ablated","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":3,"n_candidates":3,"tp":2,"fp":1,"fn":1,"precision":0.6666666666666666,"recall":0.6666666666666666,"judge_failures":0,"decisions":[0,1,0,1,0,0,0,0,0],"judged_at":"2026-08-12T17:26:38.452256+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/8087","project":"cal_dot_com","pr_slice":"graph","arm":"ablated","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":1,"n_candidates":3,"tp":1,"fp":2,"fn":0,"precision":0.3333333333333333,"recall":1.0,"judge_failures":0,"decisions":[1,1,1],"judged_at":"2026-08-12T17:26:42.595647+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/8330","project":"cal_dot_com","pr_slice":"graph","arm":"ablated","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":5,"tp":2,"fp":3,"fn":0,"precision":0.4,"recall":1.0,"judge_failures":0,"decisions":[0,0,0,1,0,0,0,0,0,1],"judged_at":"2026-08-12T17:26:51.484070+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/106778","project":"grafana","pr_slice":"graph","arm":"ablated","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":3,"tp":0,"fp":3,"fn":2,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0,0,0,0],"judged_at":"2026-08-12T17:26:58.467004+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/107534","project":"grafana","pr_slice":"graph","arm":"ablated","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":1,"n_candidates":1,"tp":0,"fp":1,"fn":1,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0],"judged_at":"2026-08-12T17:27:02.919567+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/79265","project":"grafana","pr_slice":"graph","arm":"ablated","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":5,"n_candidates":3,"tp":3,"fp":0,"fn":2,"precision":1.0,"recall":0.6,"judge_failures":0,"decisions":[0,0,0,1,1,1,1,0,1,1,0,0,0,0,0],"judged_at":"2026-08-12T17:27:22.487596+00:00"}
+{"url":"https://github.com/getsentry/sentry/pull/67876","project":"sentry","pr_slice":"graph","arm":"ablated","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":3,"n_candidates":1,"tp":1,"fp":0,"fn":2,"precision":1.0,"recall":0.3333333333333333,"judge_failures":0,"decisions":[0,0,1],"judged_at":"2026-08-12T17:27:28.212640+00:00"}
+{"url":"https://github.com/getsentry/sentry/pull/77754","project":"sentry","pr_slice":"graph","arm":"ablated","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":0,"tp":0,"fp":0,"fn":2,"precision":1.0,"recall":0.0,"judge_failures":0,"decisions":[],"judged_at":"2026-08-12T17:27:28.212871+00:00"}
+{"url":"https://github.com/getsentry/sentry/pull/80168","project":"sentry","pr_slice":"graph","arm":"ablated","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":3,"n_candidates":1,"tp":1,"fp":0,"fn":2,"precision":1.0,"recall":0.3333333333333333,"judge_failures":0,"decisions":[1,0,0],"judged_at":"2026-08-12T17:27:31.677446+00:00"}
+{"url":"https://github.com/getsentry/sentry/pull/80528","project":"sentry","pr_slice":"graph","arm":"ablated","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":2,"n_candidates":3,"tp":0,"fp":3,"fn":2,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0,0,0,0],"judged_at":"2026-08-12T17:27:37.138599+00:00"}
+{"url":"https://github.com/getsentry/sentry/pull/93824","project":"sentry","pr_slice":"graph","arm":"ablated","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":5,"n_candidates":1,"tp":0,"fp":1,"fn":5,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0,0,0],"judged_at":"2026-08-12T17:27:43.375706+00:00"}
+{"url":"https://github.com/getsentry/sentry/pull/95633","project":"sentry","pr_slice":"graph","arm":"ablated","had_graph":false,"profile":"core","judge_model":"gemini-2.5-flash","n_goldens":1,"n_candidates":4,"tp":0,"fp":4,"fn":1,"precision":0.0,"recall":0.0,"judge_failures":0,"decisions":[0,0,0,0],"judged_at":"2026-08-12T17:27:45.850785+00:00"}

codegraph_brain-0.13.0/benchmarks/martian-p3-judged-run1.jsonl

@@ -0,0 +1,2 @@
+{"url": "https://github.com/calcom/cal.com/pull/14943", "project": "cal_dot_com", "pr_slice": "graph", "arm": "graph", "had_graph": true, "profile": "core", "judge_model": "mistral-medium-latest", "n_goldens": 2, "n_candidates": 6, "tp": 1, "fp": 5, "fn": 1, "precision": 0.16666666666666666, "recall": 0.5, "judge_failures": 0, "decisions": [0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0], "judged_at": "2026-08-12T22:27:08.965464+00:00"}
+{"url": "https://github.com/calcom/cal.com/pull/10600", "project": "cal_dot_com", "pr_slice": "graph", "arm": "graph", "had_graph": true, "profile": "core", "judge_model": "mistral-medium-latest", "n_goldens": 4, "n_candidates": 22, "tp": 2, "fp": 20, "fn": 2, "precision": 0.09090909090909091, "recall": 0.5, "judge_failures": 0, "decisions": [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], "judged_at": "2026-08-12T22:29:26.006517+00:00"}

codegraph_brain-0.13.0/benchmarks/martian-p3-judged-run1.jsonl.corrupted-backup

@@ -0,0 +1,11 @@
+{"url":"https://github.com/calcom/cal.com/pull/14943","project":"cal_dot_com","pr_slice":"graph","arm":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":2,"n_candidates":6,"tp":1,"fp":5,"fn":1,"precision":0.16666666666666666,"recall":0.5,"judge_failures":0,"decisions":[0,0,1,0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T22:27:08.965464+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/10600","project":"cal_dot_com","pr_slice":"graph","arm":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":4,"n_candidates":22,"tp":2,"fp":20,"fn":2,"precision":0.09090909090909091,"recall":0.5,"judge_failures":0,"decisions":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,0,0,0,0,0,0,0],"judged_at":"2026-08-12T22:29:26.006517+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/10967","project":"cal_dot_com","pr_slice":"graph","arm":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":5,"n_candidates":25,"tp":0,"fp":25,"fn":5,"precision":0.0,"recall":0.0,"judge_failures":125,"decisions":[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null],"judged_at":"2026-08-12T23:12:52.623869+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/14740","project":"cal_dot_com","pr_slice":"graph","arm":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":6,"n_candidates":15,"tp":0,"fp":15,"fn":6,"precision":0.0,"recall":0.0,"judge_failures":90,"decisions":[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null],"judged_at":"2026-08-12T23:13:03.872687+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/22345","project":"cal_dot_com","pr_slice":"graph","arm":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":1,"n_candidates":6,"tp":0,"fp":6,"fn":1,"precision":0.0,"recall":0.0,"judge_failures":6,"decisions":[null,null,null,null,null,null],"judged_at":"2026-08-12T23:13:04.567149+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/22532","project":"cal_dot_com","pr_slice":"graph","arm":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":4,"n_candidates":12,"tp":0,"fp":12,"fn":4,"precision":0.0,"recall":0.0,"judge_failures":48,"decisions":[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null],"judged_at":"2026-08-12T23:13:10.390164+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/7232","project":"cal_dot_com","pr_slice":"graph","arm":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":3,"n_candidates":17,"tp":0,"fp":17,"fn":3,"precision":0.0,"recall":0.0,"judge_failures":51,"decisions":[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null],"judged_at":"2026-08-12T23:13:16.557834+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/8087","project":"cal_dot_com","pr_slice":"graph","arm":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":1,"n_candidates":19,"tp":0,"fp":19,"fn":1,"precision":0.0,"recall":0.0,"judge_failures":19,"decisions":[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null],"judged_at":"2026-08-12T23:13:18.874285+00:00"}
+{"url":"https://github.com/calcom/cal.com/pull/8330","project":"cal_dot_com","pr_slice":"graph","arm":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":2,"n_candidates":12,"tp":0,"fp":12,"fn":2,"precision":0.0,"recall":0.0,"judge_failures":24,"decisions":[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null],"judged_at":"2026-08-12T23:13:21.851955+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/106778","project":"grafana","pr_slice":"graph","arm":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":2,"n_candidates":20,"tp":0,"fp":20,"fn":2,"precision":0.0,"recall":0.0,"judge_failures":40,"decisions":[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null],"judged_at":"2026-08-12T23:13:26.566462+00:00"}
+{"url":"https://github.com/grafana/grafana/pull/107534","project":"grafana","pr_slice":"graph","arm":"graph","had_graph":true,"profile":"core","judge_model":"mistral-medium-latest","n_goldens":1,"n_candidates":6,"tp":0,"fp":6,"fn":1,"precision":0.0,"recall":0.0,"judge_failures":6,"decisions":[null,null,null,null,null,null],"judged_at":"2026-08-12T23:13:27.334546+00:00"}