TLDRocket
Sign in

GPU Infrastructure

594 summarised stories about GPU Infrastructure, each linking back to the original source. Browse all topics →

+ Follow this topic

Monday, 17 August 2026

AI cloud operator Groq raises $350M more in funding

SiliconANGLE 2 months ago 17 ● 2 sources

Groq announced it raised an additional $350 million in funding, with Series A leadership from Disruptive and Nvidia planning to join later. The company said it will expand GroqCloud capacity from 57 megawatts to over 200 megawatts next year. GroqCloud will grow in capacity as a result, letting customers run more AI inference workloads on its public cloud infrastructure.

Same Cluster, 33 Points More Utilization: What Changed Was the Order

Hugging Face 2 months ago 30

A constraint-aware GPU allocator was benchmarked against a FIFO scheduler on identical hardware and workloads, and it produced higher GPU utilization and priority-weighted output by changing only the order of allocation decisions. In the training-heavy case on 8 GPUs, utilization rose from 53.6% to 87.0% (+33.4 points), with priority-weighted value increasing by 105.1%. The results show that scheduling that treats real-time demand as a curve and assigns GPU placements by priority across the full horizon improves utilization and value without tradeoffs across the tested scenarios, rather than simply keeping GPUs busy with FIFO ordering.

NVIDIA Nemotron 3.5 Lightning now available in Amazon SageMaker JumpStart

Amazon Web Services 2 months ago 33

NVIDIA Nemotron 3.5 Lightning was added to Amazon SageMaker JumpStart, letting users deploy the open model without manually configuring the serving infrastructure. The launch reports up to 4x higher throughput and up to 30% faster task completion for high-volume agentic workloads. Users can now pick the BF16 or NVFP4 model variants in JumpStart and create SageMaker AI endpoints, changing deployment from custom setup to one-click provisioning.

Groq raises $350M to fuel its pivot from AI chips to neocloud

TechCrunch 2 months ago 26 ● 2 sources

Groq raised $350 million to continue shifting from an AI chipmaker into a “neocloud” provider of GPU-based AI infrastructure. The round values the company at $3.5 billion, down from $6.9 billion in September. Groq plans to expand capacity from 54 megawatts to more than 200 megawatts by 2027 and operate Nvidia-based systems as an infrastructure provider within Nvidia’s ecosystem.

Nvidia investing $1.5B in SoftBank data center developer behind OpenAI project

TechCrunch 2 months ago 4 ● 7 sources

Nvidia agreed to invest $1.5 billion in SB Energy, a SoftBank-linked data center developer tied to OpenAI’s Ports-Pike site near Cincinnati. Nvidia also plans to provide up to $105 billion in credit and the facility is projected to scale from 4.25 gigawatts to 8 gigawatts. The deal makes Nvidia the sole compute infrastructure supplier for the data center and ties the buildout to a 9.2 gigawatt natural gas power plant expected to cost $33 billion.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.