TLDRocket
Sign in

GPU Infrastructure

594 summarised stories about GPU Infrastructure, each linking back to the original source. Browse all topics →

+ Follow this topic

Thursday, 27 August 2026

Google found a way to test Gemini without seeing the questions

The New Stack 1 month ago 17 ● 2 sources

Google DeepMind demonstrated a double-blind evaluation for Gemini where evaluators cannot see Gemini’s weights and Gemini cannot see the test questions. The pilot evaluated Gemini 2.5 Flash Lite against private MLCommons and Singapore AI Safety Institute benchmarks using an NVIDIA H100 Confidential GPU with Intel TDX and Confidential Space, with evaluation overhead reported as under 5%. This shifts focus from publishing a benchmark score to showing how to run tests with reduced benchmark leakage risk by keeping both sides’ data protected inside an encrypted enclave.

The AI storage stack gets an inference-era rethink

SiliconANGLE 1 month ago 20 ● 2 sources

DataDirect Networks Inc. unveiled DDN Enterprise AI HyperPOD with Super Micro Computer and Solidigm to simplify enterprise AI inference storage and data management based on Nvidia’s AI Data Platform. The solution supports scaling from a single rack and expanding by “pop[ping] in another rack,” rather than committing upfront to large numbers of GPUs. The shift moves storage toward a capacity-focused role for LLM workloads and aims to reduce customer integration complexity while enabling on-prem and hybrid sovereign AI deployments with multi-tenancy.

Report: Nvidia to acquire AI model repository Hugging Face for $13 billion

Ars Technica 1 month ago 9 ● 5 sources

Nvidia is reported to be acquiring Hugging Face to gain influence over the ecosystem that hosts and enables work on open-weight AI models. The deal is reportedly for $13 billion. This could strengthen Nvidia’s leverage with model deployment and training platforms and help it restart plans for a cloud AI business while supporting Nvidia hardware usage.

AI industry says Trump plans to tax chips in the “single dumbest way imaginable”

Ars Technica 1 month ago 23

The AI and tech industry says the Trump administration is considering new semiconductor tariffs that could be announced soon. It points to a possible plan that would “dramatically expand” duties to cover not only chips but also products made with them. If implemented, it would raise costs across a broader set of tech hardware used for AI, making US AI development harder.

This duck will teach you reinforcement learning — and pick up your socks

The New Stack 1 month ago 11 ● 4 sources

Pollen Robotics and Hugging Face opened pre-orders for the Microduck, a $399 bipedal duck-adjacent robot that can walk, use roller skates, pick up objects, and recover when it falls. The company expects first deliveries before Christmas. The project ships as an open-source reinforcement learning training platform with an SDK and simulator, plus optional accessory packs for power and development.

Reduce ASR inference costs by 75% with NVIDIA MPS on Amazon EC2

Amazon Web Services 1 month ago 5

Heidi Health, with AWS and NVIDIA, deployed CUDA Multi-Process Service (MPS) and NVIDIA Triton Inference Server on Amazon EC2 to serve its fine-tuned Parakeet TDT ASR model more efficiently. Using MPS reduced the number of GPU instances needed from 16 to 4 while keeping sub-second transcription latency at 92.1 requests per second per GPU. The setup changes production operations by partitioning one L40S GPU into concurrent MPS execution contexts and batching/scheduling requests through Triton, cutting infrastructure cost without increasing latency.

Nvidia CFO says about half of its data center business comes from customers beyond hyperscalers

Fortune 31 ● 3 sources

Nvidia reported fiscal second-quarter results and CFO Colette Kress said about half of its data center revenue comes from customers beyond major hyperscalers. Data Center revenue was $89.0 billion, and Kress said non-hyperscaler growth covers roughly half of the business. The company’s outlook for AI infrastructure demand is framed as increasingly diversified across enterprise and regional/sovereign and edge deployments rather than tied mainly to a few big cloud buyers.

Deep Learning Weekly: Issue 470

Deep Learning Weekly 1 month ago 45 ● 2 sources

Z.ai open-sourced GLM-5.3-Flash, a stealth “Ox Alpha” mixture-of-experts model with hybrid sparse-plus-linear attention and a 1M-token multimodal context, and multiple other deep-learning updates were shared alongside it. The issue’s FreeToken paper reports edge-native MoE serving that supports running a 753B GLM-5.2 on a single workstation GPU. Benchmarks and tool writeups in the issue shift focus toward more practical local/edge deployment and evaluating real-world LLM/agent behavior rather than only final answers.

How much of a problem is AI’s water use?

Ars Technica 1 month ago 10 ● 2 sources

Locals in Texas, New Mexico, and Arizona have increasingly protested U.S. data center expansion tied to AI capacity, citing water use, energy demand, and pollution concerns. Data center equipment can run at internal temperatures up to 176° Fahrenheit, driving heat removal that can involve water. The protests and public debate intensify while online claims about water use vary widely and available company consumption data remains incomplete or inconsistent.

GeForce NOW Gives Gamers More Ways to Play at Gamescom 2026

NVIDIA 1 month ago 17 ● 2 sources

NVIDIA announced multiple updates to GeForce NOW, adding new DLSS 4.5 tuning controls and expanding device and platform support across Steam, GOG, Firefox, and more Fire TV options. Ultimate members can redeem a limited-time offer to get CONTROL Resonant at launch with a 12-month GeForce NOW Ultimate membership, running Tuesday Aug. 25 through Sunday Sept. 27. The service will broaden where games can be streamed and how they can be configured, while new cloud-launch titles like CONTROL Resonant and STAR WARS Zero Company arrive on the platform.

Delivering Vera: NVIDIA’s First CPU Built for Agents Is Shipping Now

NVIDIA Blog 1 month ago 38 ● 3 sources

NVIDIA is delivering its Vera CPU systems to cloud providers and AI labs as Vera begins shipping at scale. The systems being handed off include AWS’s first NVIDIA Vera CPU server and NVIDIA Vera Rubin GPU delivered in Seattle on Aug. 27, 2026. This expands Vera’s rollout across major customers, including AWS and prior deliveries to Oracle Cloud Infrastructure, Anthropic, OpenAI, and SpaceXAI.

The Sequence Opinion #921: AI’s Sixth Layer Is Finance

TheSequence 1 month ago 12

The Sequence Opinion argues that AI’s sixth layer is finance, sitting beneath the commonly described layers that run from energy to applications. It points to “#921” and says Jensen Huang’s five-layer model is incomplete because the “cake” also exists on balance sheets and through financial constraints. As a result, the article reframes AI bottlenecks and growth as depending on power contracts, depreciation, debt covenants, and teams managing expensive hardware uptime rather than only on model quality.

Nvidia Posts Another Blockbuster Quarter, But Debt is Rising in AI Frenzy

Trending Topics 1 month ago 2 ● 3 sources

Nvidia reported fiscal 2027 Q2 results that beat expectations, with its data center business driving the quarter while investors focused on guidance. It projected $108 billion in current-quarter revenue, slightly above an estimate of about $104.2 billion. Nvidia’s stock rose on the outlook and it also highlighted expanded AI infrastructure partnerships, while noting rising debt and margin pressure.

Nvidia gave its first-ever year-ahead forecast—a 70% growth bombshell meant to silence AI bubble critics and ‘circular financing’ doomsayers

Fortune 21 ● 4 sources

Nvidia issued its first year-ahead forecast, projecting a 70% revenue increase next fiscal year, after reporting results that beat expectations and citing accelerating demand for its AI chips. The company forecast fiscal 2028 revenue growth of 70% and said customers’ forecasts indicate growth doubling next year, while also noting supply constraints limit delivery. Nvidia’s new guidance resets market expectations for next-year sales and sets updated supply, margin, and financing-related outlooks for investors to follow.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.