TLDRocket
Sign in

Benchmarking

34 summarised stories about Benchmarking, each linking back to the original source. Browse all topics →

+ Follow this topic

Monday, 11 June 2018

Improving language understanding with unsupervised learning

OpenAI 8 years ago 26

Researchers combined transformer models with unsupervised pre-training to achieve top results across multiple language understanding tasks. The system was tested on a diverse suite of benchmarks and released publicly. The findings suggest that unsupervised pre-training paired with supervised learning is effective, potentially encouraging further research at larger scales.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.