TLDRocket
Sign in

Mixture-of-Experts

82 summarised stories about Mixture-of-Experts, each linking back to the original source. Browse all topics →

+ Follow this topic

Tuesday, 28 July 2026

Moonshot Releases Kimi K3 Model Weights on Hugging Face

Hugging Face 2 months ago 15 ● 33 sources

Moonshot released Kimi K3, a 2.8-trillion-parameter open-weight multimodal model with a 1-million-token context window, available on Hugging Face. The model uses a Mixture-of-Experts architecture that activates 16 out of 896 experts, achieving approximately 2.5 times better scaling efficiency than its predecessor Kimi K2. The open release enables researchers and developers to build and deploy frontier AI systems for coding, knowledge work, and reasoning tasks.

Microsoft AI Releases MAI-Cyber-1-Flash: A 5B-Active-Parameter Cyber Model That Pushes MDASH to 95.95% on CyberGym

MarkTechPost 2 months ago 44 ● 4 sources

Microsoft released MAI-Cyber-1-Flash, a 5B-active-parameter AI model designed for cybersecurity vulnerability detection that runs within MDASH, Microsoft's multi-model scanning system. The model achieved 95.95% on CyberGym, a benchmark of 1,507 real-world vulnerability tasks, up from 88.45% when MDASH used only general-purpose models. MDASH now routes 90% of tasks to MAI-Cyber-1-Flash while escalating the hardest 10% to GPT-5.4, reducing costs by 50% while improving vulnerability discovery performance.

[AINews] Much ado about Open Weights

Latent Space 2 months ago 38 ● 75 sources

Moonshot AI released Kimi K3, a 2.8-trillion-parameter open-weights model with 104B active parameters, which independent benchmarks show outperforms Claude Opus 4.8 and ranks first among open models on agent benchmarks. The release included supporting infrastructure (FlashKDA kernels, MoE libraries, distributed agent environments) and uses source-available rather than permissive open-source licensing, with commercial restrictions on hosting providers over $20M/year revenue and products over 100M users. Meanwhile, NVIDIA launched an Open Secure AI Alliance arguing that defenders need access to both open and closed models for security, while Anthropic clarified it does not oppose open-weights models but supports chip controls and safety testing instead.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.