Moonshot AI closed new subscriptions for Kimi K3 within 48 hours of launch after demand overwhelmed its GPU capacity, while existing users retained access. The 2.8 trillion-parameter model ranked top in some benchmarks but exhausted inference infrastructure faster than anticipated. The incident highlights how AI companies must ration access to manage real-time inference costs, particularly for agentic workloads that consume resources longer than typical chatbot interactions.
NVIDIA's srt-slurm framework automates the creation and validation of distributed LLM serving benchmarks by converting YAML configurations into reproducible SLURM workflows. The tutorial demonstrates using srtctl to define cluster configurations, execute parameter sweeps across DeepSeek-R1 models with disaggregated prefill-decode deployments, and analyze throughput-versus-latency trade-offs through Pareto frontier visualization. Validated recipes can then be submitted to real GPU clusters with preflight checks, monitoring, and reproducible experiment comparison.
Researchers introduced CalibAtt, a training-free method that speeds up text-to-video generation by identifying and skipping unnecessary attention computations in transformer models. The technique achieves up to 1.58× end-to-end speedup on models like Wan 2.1 14B and Mochi 1 by using offline calibration to detect sparse attention patterns that remain stable across different inputs. This acceleration allows video diffusion models to generate content faster without degrading quality or text-video alignment.
Every AI story that matters,
in your inbox by 8am.
TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the
day in two minutes. Follow companies and topics for alerts, or get the
briefing in Slack. Free, no spam, unsubscribe anytime.
Reading TLDRocket needs no cookies, and the readership counts we rely on come from
our own cookieless analytics. Google Analytics is the exception: it sets cookies and
reports to Google, so it stays switched off until you allow it. You can change your
mind any time from “Cookie settings” in the footer.
Strictly necessary
Session security and form protection (tldrocket-session,
XSRF-TOKEN, 2 hours). The site cannot work without them,
so they need no consent.
Always on
Google Analytics 4 (_ga,
_ga_<id>, up to 2 years). Measures which
stories and sections readers use. Google acts as a third-party processor and may
store the data outside the EU. No advertising, no profiling, no data sold.
