New in Together GPU Clusters: Autoscaling, observability, and self-healing

Together AI · 4 months ago

Together AI introduced autoscaling, role-based access control, observability dashboards, and self-healing capabilities to its GPU Clusters platform. The autoscaling feature uses Kubernetes to automatically add or remove GPU nodes based on demand, while health checks and self-repair can restore failed nodes within minutes. These production-grade features enable teams to run large distributed training jobs and inference workloads without manual infrastructure management or losing compute time to hardware failures.