The Tokenpocalypse Is Here: Companies Are Scrambling To Stop Spending So Much on AI
Simon Willison’s Weblog 2 months ago 32 ● 4 sources
Accenture's internal data reveals that non-engineers are driving excessive token consumption at the company, with inefficient practices like converting PDFs to images and then to markdown files being major culprits. According to leaked meeting audio, converting PDFs to markdown is identified as one of the biggest token consumers, suggesting widespread inefficient AI usage patterns. Companies may need to train employees on more efficient AI workflows to control spiraling inference costs.