Fine-tune NVIDIA Nemotron 3 models with Amazon SageMaker AI serverless model customization

AWS Machine Learning · 6 days ago

Amazon SageMaker AI now supports serverless fine-tuning for NVIDIA Nemotron 3 models, including Nemotron 3 Nano (30B parameters with 3B active) and Nemotron 3 Super (120B parameters with 12B active). The service offers three fine-tuning techniques—Supervised Fine-Tuning, Reinforcement Learning with Verifiable Rewards, and Reinforcement Learning from AI Feedback—allowing organizations to customize open-weight models without managing infrastructure. Users can access the customization workflow through SageMaker Studio console or Python SDK, with automatic compute provisioning and metric tracking via MLflow.