TLDRocket
Sign in

Mixture-of-Experts

84 summarised stories about Mixture-of-Experts, each linking back to the original source. Browse all topics →

+ Follow this topic

Monday, 6 July 2026

tencent/Hy3

Simon Willison's Weblog 3 months ago 21 ● 2 sources

Tencent released Hy3, a 295-billion-parameter mixture-of-experts model under Apache 2.0 license, following feedback from 50+ products that used its April preview version. The model uses 21 billion active parameters and supports a 256,000-token context length, with the full version requiring 598GB storage and a quantized version at 300GB. The model is available free on OpenRouter until July 21st and competes with open-source models having 2-5 times more parameters.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.