Google found a way to test Gemini without seeing the questions

The New Stack · 1 month ago · 17 ● 2 sources

Google DeepMind demonstrated a double-blind evaluation for Gemini where evaluators cannot see Gemini’s weights and Gemini cannot see the test questions. The pilot evaluated Gemini 2.5 Flash Lite against private MLCommons and Singapore AI Safety Institute benchmarks using an NVIDIA H100 Confidential GPU with Intel TDX and Confidential Space, with evaluation overhead reported as under 5%. This shifts focus from publishing a benchmark score to showing how to run tests with reduced benchmark leakage risk by keeping both sides’ data protected inside an encrypted enclave.