Fine-tune NVIDIA Nemotron 3 models with Amazon SageMaker AI serverless model customization
AWS Machine Learning Sandeep Raveesh-Babu
Amazon SageMaker AI now supports serverless fine-tuning for NVIDIA Nemotron 3 models, including Nemotron 3 Nano (30B parameters with 3B active) and Nemotron 3 Super (120B parameters with 12B active). The service offers three fine-tuning techniques—Supervised Fine-Tuning, Reinforcement Learning with Verifiable Rewards, and Reinforcement Learning from AI Feedback—allowing organizations to customize open-weight models without managing infrastructure. Users can access the customization workflow through SageMaker Studio console or Python SDK, with automatic compute provisioning and metric tracking via MLflow.
Why it matters
In this post, we explore what makes the Nemotron 3 architecture unique, walk through the fine-tuning techniques available, and show you step-by-step how to get started with serverless customization using SageMaker Studio.
