144 summarised stories about Benchmarking, each linking back to the original source. Browse all topics →
The Neuron 1 week ago
Ornn raised $33 million in funding to develop benchmarking tools for GPU compute pricing. The company aims to help buyers, sellers, lenders, and traders compare and evaluate GPU costs more transparently. This enables more informed purchasing decisions and pricing negotiations across the GPU market.
Hugging Face Blog 1 week ago
LeRobot released v0.6.0 with three world model policies that imagine future states during training, five new vision-language-action models, and a unified reward models API for detecting task success. The release includes six new simulation benchmarks (LIBERO-plus, RoboTwin 2.0, RoboCasa365, RoboCerebra, RoboMME, VLABench), depth sensing support, and a lerobot-rollout CLI for robot deployment with human-in-the-loop corrections. Users can now evaluate policies across nine benchmark families, annotate datasets automatically using vision-language models, and achieve up to 2x faster data loading with the new parallel decoding system.
