The Sequence AI of the Week #899: Inside Inkling: A Trillion-Parameter Model That Only Wakes Up 41 Billion at a Time

Substack · 1 month ago · 5

Inkling is a 975-billion-parameter language model that activates only 41 billion parameters per token through a routing mechanism that selects specialist modules. The model uses a sparse mixture-of-experts approach where a router selects six task-specific departments plus two general-purpose modules for each token, meaning only 4.2 percent of total capacity activates at any given time. This architecture allows the model to maintain enormous total capacity while keeping computational costs and memory requirements manageable during inference.