Groq announced it raised an additional $350 million in funding, with Series A leadership from Disruptive and Nvidia planning to join later. The company said it will expand GroqCloud capacity from 57 megawatts to over 200 megawatts next year. GroqCloud will grow in capacity as a result, letting customers run more AI inference workloads on its public cloud infrastructure.
A constraint-aware GPU allocator was benchmarked against a FIFO scheduler on identical hardware and workloads, and it produced higher GPU utilization and priority-weighted output by changing only the order of allocation decisions. In the training-heavy case on 8 GPUs, utilization rose from 53.6% to 87.0% (+33.4 points), with priority-weighted value increasing by 105.1%. The results show that scheduling that treats real-time demand as a curve and assigns GPU placements by priority across the full horizon improves utilization and value without tradeoffs across the tested scenarios, rather than simply keeping GPUs busy with FIFO ordering.
NVIDIA Nemotron 3.5 Lightning was added to Amazon SageMaker JumpStart, letting users deploy the open model without manually configuring the serving infrastructure. The launch reports up to 4x higher throughput and up to 30% faster task completion for high-volume agentic workloads. Users can now pick the BF16 or NVFP4 model variants in JumpStart and create SageMaker AI endpoints, changing deployment from custom setup to one-click provisioning.
Groq raised $350 million to continue shifting from an AI chipmaker into a “neocloud” provider of GPU-based AI infrastructure. The round values the company at $3.5 billion, down from $6.9 billion in September. Groq plans to expand capacity from 54 megawatts to more than 200 megawatts by 2027 and operate Nvidia-based systems as an infrastructure provider within Nvidia’s ecosystem.
Nvidia agreed to invest $1.5 billion in SB Energy, a SoftBank-linked data center developer tied to OpenAI’s Ports-Pike site near Cincinnati. Nvidia also plans to provide up to $105 billion in credit and the facility is projected to scale from 4.25 gigawatts to 8 gigawatts. The deal makes Nvidia the sole compute infrastructure supplier for the data center and ties the buildout to a 9.2 gigawatt natural gas power plant expected to cost $33 billion.
Every AI story that matters,
in your inbox by 8am.
TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the
day in two minutes. Follow companies and topics for alerts, or get the
briefing in Slack. Free, no spam, unsubscribe anytime.
Reading TLDRocket needs no cookies, and the readership counts we rely on come from
our own cookieless analytics. Google Analytics is the exception: it sets cookies and
reports to Google, so it stays switched off until you allow it. You can change your
mind any time from “Cookie settings” in the footer.
Strictly necessary
Session security and form protection (tldrocket-session,
XSRF-TOKEN, 2 hours). The site cannot work without them,
so they need no consent.
Always on
Google Analytics 4 (_ga,
_ga_<id>, up to 2 years). Measures which
stories and sections readers use. Google acts as a third-party processor and may
store the data outside the EU. No advertising, no profiling, no data sold.