TLDRocket
Sign in

Tokenization

1 summarised story about Tokenization, each linking back to the original source. Browse all topics →

Tuesday, 14 July 2026

The Same TypeScript Costs 73% More Tokens on Claude Than GPT

TLDR Dev 3 days ago

Anthropic's new tokenizer for Claude models (Sonnet 5, Opus 4.8, Fable 5) produces approximately 30% more tokens from the same code than the previous tokenizer while maintaining the same list price. On identical TypeScript files, Claude's new tokenizer generates 1.73 times more tokens than GPT's o200k tokenizer, making Opus 4.8's effective price approximately $7.50/$37.50 rather than the listed $5.00/$25.00. Users comparing model prices must account for tokenizer differences rather than relying on published per-token rates, as the same work costs 32% more on Claude's newer models despite identical list pricing.