A Decision-Only Judge Matches GPT-6 on Routine Evals for 0.36% of the Fee

StackSweep · 3 weeks ago · 15

TypeSafe JEV 1.13, a hosted decision-only LLM judge, matched GPT-6 on routine preference and evidence-grounded factuality but not on hard correctness tests. It cost $0.044 per 1,000 judgments versus GPT-6 at $12.18 (about 277x cheaper). Using JEV’s calibrated confidence to run a cascade cut spending by escalating 34% of items to GPT-6 while reaching 91.3% accuracy, but it still lagged on JudgeBench hard correctness by 14.6 points.