Introducing new Ray capabilities on SageMaker HyperPod
Amazon Web Services Nilesh PS
Amazon SageMaker HyperPod added new Ray capabilities that integrate Ray on HyperPod’s managed EKS infrastructure for foundation-model training and serving. The rollout provisions four pre-built Grafana dashboards in Amazon Managed Grafana (Ray Core, Ray Data, Ray Train, and Ray Serve). Users can now create and monitor Ray clusters from SageMaker Studio with automatic Ray Dashboard access, out-of-the-box observability, and HyperPod-backed resilience features like node recovery, hung job detection, and tiered checkpointing.
Why it matters
Amazon SageMaker HyperPod now offers managed Ray support on Amazon EKS. Create and monitor Ray clusters, connect JupyterLab and Code Editor notebooks to live clusters, get out-of-the-box observability, and run resilient distributed training and accelerated inference from SageMaker Studio, all with open-source KubeRay and standard Ray APIs.