NVIDIA AI Releases Molt: A PyTorch-Native Agentic Reinforcement Learning Framework

MarkTechPost · 4 weeks ago · 19

NVIDIA's NeMo team released Molt, a PyTorch-native reinforcement learning framework designed for agentic AI research with a compact codebase of approximately 8.6K lines of RL code—roughly 7 times smaller than competing frameworks like verl. The framework composes Ray, vLLM, and NVIDIA AutoModel without forking them, and requires hardware resources of 2 nodes with 8 H100 GPUs each, with 8 GPUs dedicated to training and 8 to rollout. Molt enables researchers to rapidly iterate on RL algorithms while maintaining correctness invariants around token identity and policy-version semantics, making it accessible to frontier labs, well-funded startups, and enterprise research groups with multi-node GPU access.