Model Evaluation

206 summarised stories about Model Evaluation, each linking back to the original source. Browse all topics →

Key players

OpenAI Anthropic GPT-6 Astra MarkTechPost Google Hugging Face

Monday, 17 August 2026

Launch HN: Speko (YC S26) – OpenRouter for Voice AI

speko.ai 2 months ago 48

Speko, a YC S26 startup, launched an API-based router that benchmarks and selects speech-to-text, LLM, and text-to-speech models for voice AI stacks under user constraints. It charges for the hosted router and managed keys and said that since starting its batch in late June, external usage grew about 25% per week on average. Teams can switch voice models via a dashboard/API instead of re-integrating, and Speko publishes benchmark results while opening its MIT-licensed gateway for BYOK deployments.

Read the full story

AI APIs & Integration Model Evaluation Voice Agents Speech Recognition

A/B test models in production

Together AI 2 months ago 57

Together AI's platform enables A/B testing of LLM models at the endpoint level, allowing teams to split live traffic between a control and up to 20 variant deployments with configurable percentages. The system uses fixed traffic shares that remain constant during autoscaling, with routing logic handled server-side rather than in application code. Testing can progress from initial 95/5 splits through ramping stages to full 50/50 comparisons, then winners are promoted via blue-green rollout and experiments deleted without residual cleanup.

Read the full story

Model Evaluation Together AI

Every AI story that matters,
in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.