TRL v1.0: Post-Training Library Built to Move with the Field

Hugging Face Blog · 3 months ago

TRL released v1.0, a post-training library that now implements over 75 methods and has shifted from research code to stable infrastructure powering production systems. The library is downloaded 3 million times per month and maintains a dual-contract stability model where stable components follow semantic versioning while experimental methods can evolve rapidly. The design deliberately avoids over-abstraction and accepts code duplication to remain adaptable as post-training methods continue to shift, with stable trainers for SFT, DPO, reward modeling, RLOO, and GRPO now in the core.