TLDRocket
Sign in
Latest OpenAI in talks with UAE funds and BlackRock for $30B round at a fixed... — Tech Funding News Google’s Project Suncatcher: 5 things to know about its plan to put AI... — Tech Funding News Caterpillar and CoreWeave shorten the learning loop for physical AI — SiliconANGLE Meta teams up with Bret Taylor’s Sierra Technologies on new standards... — SiliconANGLE A Developer’s Guide to Laya: Zero-Shot Decisions and Calibration — MarkTechPost OpenAI “rogue” agent activities found on Wikimedia projects — Simon Willison’s Weblog Does intelligence need a hard cap? — Platformer Quoting Victoria Kim — Simon Willison’s Weblog

The AI intelligence platform

Every AI story that matters — and the intelligence behind it.

TLDRocket reads all relevant sources, removes duplicate coverage, and publishes a short neutral summary of every story, linking back to the original. Free, no spam, unsubscribe anytime.

Add to Slack

Every story also updates live profiles event timelines weekly rankings the AI Market Index

Friday, 3 May 2024

Bringing the Artificial Analysis LLM Performance Leaderboard to Hugging Face

Hugging Face 2 years ago 7

Artificial Analysis has launched a leaderboard on Hugging Face that evaluates over 100 serverless LLM API endpoints across three metrics: quality, speed, and price. The leaderboard tests each endpoint 8 times daily and reports performance data including throughput (tokens per second), latency (time to first token), and pricing, with results spanning six different workload configurations from ~100 to ~10k token prompts. Engineers can now compare models and providers in one place to optimize for their specific use case, whether prioritizing speed and cost over raw quality or vice versa.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.