Language models can explain neurons in language models

OpenAI Blog · 3 years ago

GPT-4 was used to automatically generate and evaluate explanations describing what individual neurons do in large language models. The dataset covers all 1.5 million neurons in GPT-2, with each neuron receiving both an explanation and a quality score. This enables researchers to better understand how neural networks process language without manually analyzing each neuron.