TLDRocket
Sign in

Benchmarking

22 summarised stories about Benchmarking, each linking back to the original source. Browse all topics →

Monday, 11 June 2018

Improving language understanding with unsupervised learning

OpenAI Blog 8 years ago

Researchers combined transformer models with unsupervised pre-training to achieve top results across multiple language understanding tasks. The system was tested on a diverse suite of benchmarks and released publicly. The findings suggest that unsupervised pre-training paired with supervised learning is effective, potentially encouraging further research at larger scales.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads 60+ sources, removes duplicate coverage, and summarises the day in two minutes. Free, no spam, unsubscribe anytime.