Mixture-of-Experts

43 summarised stories about Mixture-of-Experts, each linking back to the original source. Browse all topics →

Key players

Hugging Face Inkling NVIDIA Kimi K3 Moonshot AI OpenAI

Sunday, 2 August 2026

Thinking Machines Lab Releases Inkling-Small: A 276B Total, 12B Active Open Weights Multimodal MoE Model

MarkTechPost 3 weeks ago 15 ● 33 sources

Thinking Machines Lab released Inkling-Small, an open weights multimodal Mixture-of-Experts model with 276B total parameters and 12B active under Apache 2.0 license. The NVFP4 quantized checkpoint requires 180GB of aggregated VRAM, deployable on a single NVIDIA B300 GPU or two H200s, making it accessible to startups and mid-size enterprises. The smaller model surpasses its 975B-parameter teacher Inkling on reasoning and coding benchmarks including SWE-bench Verified (80.2% vs 77.6%) and ARC-AGI-2 (40.1% vs 36.5%), while regressing on factual recall tasks.

Read the full story

Open-Weight Models Multimodal Models Mixture-of-Experts

Latest open artifacts (#23): Laguna S2.1, Inkling, & Kimi K3 show the utility of open models on the Pareto frontier

Interconnects 4 weeks ago 28 ● 12 sources

Multiple AI companies are releasing competitive open-weight models despite predictions of industry consolidation, including Thinking Machines' Inkling (975B parameters), Poolside's Laguna S2.1, and Moonshot's Kimi K3. Open model releases have accelerated in 2025 with companies from the U.S., China, Korea, and Switzerland all contributing, with Kimi K3 being the largest release in some time though restricted by a noncommercial license requiring commercial agreements. The shift toward open models and token-generation revenue streams suggests the industry is moving toward sustained competition and adoption rather than consolidation, with open models increasingly claiming market share across performance tiers.

Read the full story

Open-Weight Models Model Release Mixture-of-Experts

Every AI story that matters,
in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.