TLDRocket
Sign in

Open Models

25 summarised stories about Open Models, each linking back to the original source. Browse all topics →

+ Follow this topic

Thursday, 16 July 2026

Moonshot AI Releases Kimi K3: A 2.8 Trillion Parameter Open MoE Model With Kimi Delta Attention and 1M Context

MarkTechPost 1 month ago 8 7 sources

Moonshot AI released Kimi K3, a 2.8-trillion-parameter sparse mixture-of-experts model with native vision and 1-million-token context window, featuring novel attention mechanisms called Kimi Delta Attention and Attention Residuals. The model achieves 6.3x faster decoding in million-token contexts and 25% higher training efficiency, while activating only 16 of 896 experts through Stable LatentMoE sparsity. K3 outperforms other open models on Moonshot's evaluations but remains behind proprietary models like Claude and GPT variants, expanding the scope of openly available large language models.

Sakana AI Teams With NVIDIA to Advance Open Model Innovation from Japan

Sakana AI 39 3 sources

Sakana AI is integrating NVIDIA's Nemotron open models into its Fugu multi-agent orchestration system, which coordinates multiple specialized models to handle complex tasks. In early evaluations, the orchestration-based approach has shown strong performance alongside leading frontier systems, demonstrating that model coordination can serve as a scaling path. This collaboration aims to create a feedback loop where open models, orchestration, and real-world use reinforce each other, reducing dependence on single providers and enabling more capable AI systems.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.