Why language models hallucinate
OpenAI 1 year ago 45
OpenAI researchers identified mechanisms that cause language models to generate false information even when trained to be accurate. The study focuses on how evaluation methods can detect and measure hallucination rates across different model sizes and training approaches. Better evaluation techniques could help developers reduce hallucinations and improve model reliability in deployment.