TLDRocket
Sign in
Latest 20% of Americans are already using AI for financial advice — another 7... — Fortune Auto mode is now the default in Claude Code for Pro, Max, and Team pla... — Simon Willison’s Weblog AI labs shouldn't be allowed to grade their own homework — Fortune AI is changing work faster than the data can keep up — Fortune Planned Amazon data center could become the biggest climate polluter i... — TechCrunch Meet Shepherd: An Open-Source Python Substrate That Lets Meta-Agents F... — MarkTechPost OpenAI acquires presentation startup NextSlide — TechCrunch Pokee AI Releases Pokee-Isaac 28B: A 10M-Token Context Agentic Model B... — MarkTechPost

The AI intelligence platform

Every AI story that matters and the intelligence behind it.

TLDRocket reads all relevant sources, removes duplicate coverage, and publishes a short neutral summary of every story, linking back to the original. Free, no spam, unsubscribe anytime.

Add to Slack

Every story also updates live profiles event timelines weekly rankings the AI Market Index

Sunday, 26 January 2025

Qwen2.5-1M: Deploy Your Own Qwen with Context Length up to 1M Tokens

GitHub Pages 1 year ago 45 3 sources

Alibaba released open-source Qwen2.5-1M models, including 7B and 14B parameter versions that support context lengths up to 1 million tokens. The inference framework achieves 3.2x to 6.7x faster processing speeds on 1M-token sequences compared to baseline approaches, with the 14B model matching GPT-4o-mini performance on short texts while supporting eight times longer context. Developers can now deploy these models locally using the open-sourced vLLM-based framework, which requires 120GB VRAM for the 7B model and 320GB for the 14B model.

Qwen2.5 VL! Qwen2.5 VL! Qwen2.5 VL!

GitHub Pages 1 year ago 36 3 sources

Alibaba released Qwen2.5-VL, a vision-language model available in 3B, 7B, and 72B parameter sizes that can recognize objects, analyze documents and charts, process videos over 1 hour long, and function as a visual agent. The 7B model outperforms GPT-4o-mini on multiple tasks while the 72B model achieves competitive performance with much larger models like Llama-3-405B-Instruct. The model improves efficiency through a redesigned visual encoder with window attention and adds capabilities like structured output generation for financial documents and second-level event localization in videos.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.