TLDRocket
Sign in

AI Infrastructure

113 summarised stories about AI Infrastructure, each linking back to the original source. Browse all topics →

Thursday, 9 July 2026

Deep Learning Weekly: Issue 463

Deep Learning Weekly 1 week ago

This issue of Deep Learning Weekly covers recent AI model releases including xAI's Grok 4.5, OpenAI's GPT-Live voice model, and Mistral's open-sourced Leanstral 1.5, alongside developments in agentic AI systems and data infrastructure. Grok 4.5 achieves 80 tokens per second throughput and costs $2/$6 per million input/output tokens, while Leanstral 1.5 solves 587 out of 672 problems on PutnamBench. The newsletter highlights shifts toward agentic workloads requiring redesigned data systems, improved model interpretability through structural reasoning benchmarks, and engineering practices for optimizing AI agent efficiency and cost.

Capturing token IDs during agentic interactions for better reinforcement learning

Amazon Science 1 week ago

Anthropic released Turnstile, a proxy tool written in Rust that captures exact token-level data during reinforcement learning training of language models on multi-step tasks. Turnstile records token IDs, log probabilities, and loss masks at the moment of generation without modifying existing agent harnesses, solving the problem that transcript-based data loses critical information needed for effective RL training. The system enables RL training runs with existing agent harnesses as black boxes while handling complexities like mixture-of-experts routing and multimodal inputs from vision-language models.

Large Tabular Models Excel Where LLMs Fail

IEEE Spectrum AI 1 week ago

Large tabular models (LTMs) are a new class of AI foundation models designed to handle structured data in spreadsheets, where traditional LLMs fail due to their sequential nature and lack of deterministic outputs. Fundamental launched its LTM called NEXUS on February 5, 2026, with $275 million in funding and achieved adoption by Amazon Web Services, with competitors including Google's TabFM and research models like FlexTab also emerging. This shifts enterprise data analysis away from legacy machine learning algorithms like XGBoost toward pre-trained foundational models that require minimal task-specific engineering.