tencent/Hy3

Simon Willison · 1 week ago

Tencent released Hy3, a 295-billion-parameter mixture-of-experts model under Apache 2.0 license, following feedback from 50+ products that used its April preview version. The model uses 21 billion active parameters and supports a 256,000-token context length, with the full version requiring 598GB storage and a quantized version at 300GB. The model is available free on OpenRouter until July 21st and competes with open-source models having 2-5 times more parameters.