Investigation finds distillation could threaten frontier model business profits

The Neuron · 2 days ago

Researchers have identified model distillation—training one AI system on outputs from another—as a threat to the business model of frontier AI companies, with Chinese competitors using the technique to quickly develop cheaper alternatives to expensive US models. Chinese companies have built networks of overseas "transfer stations" charging as little as 10% of official prices to bypass access restrictions, allowing them to collect vast datasets for training their own systems. If distillation becomes widespread, it could erode the returns on the billions spent by OpenAI, Anthropic, and Google on developing leading models, with some researchers warning that restrictions may simply push developers toward open-source alternatives instead.