TLDRocket
Sign in

GPU Infrastructure

592 summarised stories about GPU Infrastructure, each linking back to the original source. Browse all topics →

+ Follow this topic

Thursday, 10 September 2026

Jensen Huang explains why Nvidia will grow an astounding 70% next year

TechCrunch 1 month ago 21

Nvidia CEO Jensen Huang said Nvidia expects its AI-related revenue growth to continue through next year despite rising GPU competition. He reiterated a forecast of 70% year-over-year revenue growth for next year. Nvidia’s guidance implies the company is positioning for sustained demand across AI labs and systems, including GPUs and data-center infrastructure, rather than expecting a slowdown.

Reduce inference cold starts on Amazon SageMaker HyperPod with model caching

Amazon Web Services 1 month ago 6

Amazon SageMaker HyperPod inference experienced long pod cold-start times because each new pod had to pull the vLLM/LMI container image from Amazon ECR and download model weights from the configured remote source before it could serve requests. For a 600+ GB model such as DeepSeek-R1, the article says this can take 30 minutes or more for a single request and repeats on every scale-out event. Amazon launched model caching that pre-loads weights to node NVMe (about 7 GB/s) and can pre-pull images so pods typically start serving in seconds instead of tens of minutes, with fallbacks to normal downloading when cache-ready capacity isn’t available.

Red Hat AI 3.5 tackles the GPU queue that can stall AI pilots

The New Stack 1 month ago 49

Red Hat released Red Hat AI 3.5, expanding its platform for multi-tenant AI workloads with tenant isolation and priority-aware scheduling. The release adds a priority decision for every GPU request, plus new fairness scheduling and admission control for shared GPU inference. As a result, teams can move AI pilots into a governed enterprise architecture with pre-deployment safety benchmarking, real-time observability, and per-user token showback, reducing stalls from the GPU queue.

Physical AI Takes the Wheel: How the World’s Robotaxi Leaders Are Building With NVIDIA Technologies

NVIDIA Blog 1 month ago 43

NVIDIA says robotaxi leaders are building and scaling commercial driverless fleets using its end-to-end platform for AI training, simulation/validation, and in-vehicle computing. Uber plans to reach 28 cities by 2028 while using NVIDIA DRIVE Hyperion. As more programs adopt NVIDIA’s three-computer architecture, robotaxi deployment shifts toward standardized compute, simulation, and safety validation workflows across fleets at scale.

d-Matrix Adopts NVIDIA NVLink Fusion for Rack-Scale XPU Deployment

NVIDIA Blog 1 month ago 49

d-Matrix announced it will connect its next-generation Raptor XPUs to NVIDIA’s AI infrastructure using NVIDIA NVLink Fusion within the MGX rack architecture. NVLink Fusion is claimed to deliver 3x lower XPU-to-XPU latency than off-the-shelf Ethernet. As a result, d-Matrix can deploy its custom silicon via NVIDIA’s standardized rack-scale platform, rather than building rack-scale infrastructure itself.

Powering AI is an architecture problem

MIT Technology Review 1 month ago 5

Transmission-line faults and surge arrester failures in Ashburn, Virginia caused more than 3 gigawatts and about 1,500 megawatts of AI data-center load to drop off the grid within seconds, showing the issue was grid architecture rather than power supply. The article cites an early-2026 full-scale test at the National Laboratory of the Rockies, where the system cleared ERCOT large-load voltage ride-through requirements with room to spare. By moving AI UPS and power conditioning from low-voltage, battery-based, bypass-heavy setups to medium-voltage, inline systems near substations, load swings become harder to notice and backup power can also support grid programs.

To Infinity and Beyond: ThunderKittens Now on NVIDIA Vera Rubin NVL72!

Together AI 1 month ago 32

Together’s kernels team gained access to the NVIDIA Vera Rubin NVL72 platform and updated ThunderKittens to run NVFP4 and FP8 GEMMs on it by adding Rubin-specific ISA and memory/pipeline features. The NVFP4 GEMM kernels improve from about 42.1% of the roofline to over 22 PFLOPS. These changes increase attainable performance by doubling the K step, expanding tensor memory and shared memory use, and adjusting tiling and commit/collector behaviors so tensor cores stay fed.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.