Open R1: Update #2

Hugging Face Blog · 1 year ago

The Open R1 project released OpenR1-Math-220k, a dataset of 220,000 mathematical reasoning problems with verified solutions generated using DeepSeek R1 on 512 H100 GPUs. The dataset achieved 90.6% on MATH-500 and 36.7% on AIME 2024 when used to fine-tune Qwen-7B, matching performance of DeepSeek's official distilled model. The open-source pipeline enables the community to scale reasoning data generation beyond mathematics to other domains like code.