Introducing the Enterprise Scenarios Leaderboard: a Leaderboard for Real World Use Cases

Hugging Face Blog · 2 years ago

Patronus announced the Enterprise Scenarios Leaderboard, which evaluates language models on real-world business tasks rather than academic benchmarks. The leaderboard includes 6 tasks—FinanceBench, Legal Confidentiality, Creative Writing, Customer Support Dialogue, Toxicity, and Enterprise PII—with metrics ranging from accuracy to relevance and toxicity scores. To prevent test-set gaming, four of the six datasets are kept closed source, with only validation sets released to users.