Sick and wrong: Ontario auditors find doctors' AI note takers routinely blow basic facts

The Register · 2 months ago

Ontario's auditor general found that AI systems approved for healthcare providers routinely missed critical details, fabricated information, and inserted incorrect drug information into patient notes. Nine of 20 evaluated systems fabricated information, 12 inserted incorrect drug details, and 17 missed key mental health information, with accuracy contributing only 4 percent to vendors' evaluation scores while domestic presence counted for 30 percent. Healthcare providers must now manually review AI-generated notes for accuracy, though no mandatory attestation features exist in the approved systems.