Moonshot AI released Kimi K3, a 2.8-trillion-parameter sparse mixture-of-experts model with native vision and 1-million-token context window, featuring novel attention mechanisms called Kimi Delta Attention and Attention Residuals. The model achieves 6.3x faster decoding in million-token contexts and 25% higher training efficiency, while activating only 16 of 896 experts through Stable LatentMoE sparsity. K3 outperforms other open models on Moonshot's evaluations but remains behind proprietary models like Claude and GPT variants, expanding the scope of openly available large language models.
A company released Inkling, an open-weights Mixture-of-Experts model with 975B total parameters and 41B active parameters, trained on 45 trillion tokens of multimodal data. The model supports a 1M token context window and includes a smaller 12B variant, with both available for fine-tuning on their Tinker platform. Inkling enables developers to customize and deploy models across diverse domains while balancing performance with computational efficiency through controllable thinking effort.
Thinking Machines released Inkling, an open-weight multimodal mixture-of-experts model with a 1M-token context window and controllable reasoning effort designed for enterprise customization. The model achieved benchmark performance between Kimi 2.5 and 2.6, positioning it as a competitive alternative to proprietary APIs. This release enables organizations to deploy and customize their own models rather than relying on vendor-specific solutions.
Every AI story that matters,
in your inbox by 8am.
TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the
day in two minutes. Follow companies and topics for alerts, or get the
briefing in Slack. Free, no spam, unsubscribe anytime.
Reading TLDRocket needs no cookies, and the readership counts we rely on come from
our own cookieless analytics. Google Analytics is the exception: it sets cookies and
reports to Google, so it stays switched off until you allow it. You can change your
mind any time from “Cookie settings” in the footer.
Strictly necessary
Session security and form protection (tldrocket-session,
XSRF-TOKEN, 2 hours). The site cannot work without them,
so they need no consent.
Always on
Google Analytics 4 (_ga,
_ga_<id>, up to 2 years). Measures which
stories and sections readers use. Google acts as a third-party processor and may
store the data outside the EU. No advertising, no profiling, no data sold.
