TLDRocket
Sign in

AWS

162 summarised stories about AWS, each linking back to the original source. Browse all topics →

+ Follow this topic

Wednesday, 16 September 2026

Fault tolerant distributed training on Amazon EKS using NVRx

Amazon Web Services 4 weeks ago 39

NVIDIA Resiliency Extension (NVRx) was integrated with PyTorch FSDP on Amazon EKS so distributed training can recover from worker faults and reduce wasted time from checkpoint stalls. The post reports synchronous checkpointing consumed up to 40% of total wall time on cluster sizes used for its benchmarks on H100 GPUs. With NVRx, checkpointing is made async and training can restart in-process for soft faults or via ft_launcher for hard faults, cutting downtime while preserving progress.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.