LWiAI Podcast #235 - Sonnet 4.6, Deep-thinking tokens, Anthropic vs Pentagon

Last Week in AI · 4 months ago

This podcast episode discusses major AI developments including Anthropic's release of Sonnet 4.6 with 1M context window and strong benchmark performance, Google's Gemini 3.1 Pro achieving significant gains on ARC-AGI-2 tasks, and Meta's reported $100B AMD chip deal. Concrete developments include MatX raising $500M for transformer chips shipping in 2027, World Labs securing $1B for world-model technology, and the Stargate data center project facing delays over control disputes between OpenAI, Oracle, and SoftBank. The podcast covers research on deep-thinking tokens as a reasoning-effort signal, mechanistic interpretability advances, policy tensions including Anthropic's Pentagon contract disagreement, and xAI reaching a deal to provide Grok for classified systems.