TLDRocket
Sign in

Model Evaluation

56 summarised stories about Model Evaluation, each linking back to the original source. Browse all topics →

+ Follow this topic

Tuesday, 8 April 2025

Arabic Leaderboards: Introducing Arabic Instruction Following, Updating AraGen, and More

Hugging Face 1 year ago 10

Inception launched Arabic-Leaderboards, a unified platform developed with Mohammed bin Zayed University of Artificial Intelligence to consolidate evaluations of Arabic language AI models. The AraGen-03-25 benchmark expanded from 279 to 340 question-answer pairs, with a new Arabic Instruction Following leaderboard powered by the Arabic IFEval Benchmark as the first publicly available instruction-following evaluation for Arabic. The platform enables researchers to assess Arabic LLM performance across generative tasks and instruction adherence, with plans to expand to additional modalities and invite community contributions.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.