Prime Intellect Launches Prime Inference: Serverless and Reserved Serving for Frontier Open Models

MarkTechPost · 1 week ago · 35

Prime Intellect launched Prime Inference, a serving platform for frontier open-source models with serverless endpoints and reserved GPU capacity. It processed nearly 1 trillion tokens per day internally before the public release. The rollout changes how Prime’s open models are deployed by adding an OpenAI-compatible API, multi-datacenter automatic failover, and a serving-to-training feedback loop through production traces.