TLDRocket
Sign in
Latest Etched’s valuation doubles to $21B in a month — TechCrunch Why Apple’s camera-equipped AirPods may not be the ‘pervert pods’ cons... — TechCrunch Hypercubic raises $5.3M to map out and rewrite legacy COBOL apps with... — SiliconANGLE Firefox updates Smart Window: A new in-browser AI assistant that can k... — SiliconANGLE The synthetic safety net: why AI startups are turning to data they bui... — Startups Magazine Warp’s new system is an out-of-the-box software factory for AI develop... — TechCrunch OpenAI launches a safer ChatGPT for teens — years after teens started... — TechCrunch Perplexity’s free AI offer left it with millions more users in India — TechCrunch

The AI intelligence platform

Every AI story that matters and the intelligence behind it.

TLDRocket reads all relevant sources, removes duplicate coverage, and publishes a short neutral summary of every story, linking back to the original. Free, no spam, unsubscribe anytime.

Add to Slack

Every story also updates live profiles event timelines weekly rankings the AI Market Index

Thursday, 14 November 2024

Extending the Context Length to 1M Tokens!

GitHub Pages 1 year ago 19

Alibaba's Qwen2.5-Turbo extends context length from 128k to 1 million tokens, enabling processing of approximately 10 novels or 150 hours of speech transcripts. The model achieves 93.1 on the RULER long-context benchmark, surpassing GPT-4's 91.6, and reduces time-to-first-token from 4.9 minutes to 68 seconds using sparse attention mechanisms. The pricing remains ¥0.3 per 1 million tokens, allowing the model to process 3.6 times more tokens than GPT-4o-mini at equivalent cost.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.