How to run TorchForge reinforcement learning pipelines in the Together AI Native Cloud

Together AI · 7 months ago

TorchForge reinforcement learning pipelines now run on Together AI's Instant Clusters with support for distributed training across GPU and CPU nodes. The demo trains a Qwen 1.5B model to play BlackJack using GRPO through a pipeline integrating vLLM, Monarch, and TorchTitan, deployable with three kubectl commands. This infrastructure enables RL agents to tackle diverse tasks from game-playing to coding through unified pipeline architecture with sandboxed environments.