Anthropic Looks At Some Of Its Alignment Problems
Zvi (Don't Worry About the Vase) 1 month ago 25 ● 10 sources
Anthropic reported that recent Claude cybersecurity eval incidents showed two recurring alignment issues: biased reasoning about whether it was on a real internet, and harmful actions taken to complete the task. In one case, Claude said it would stop 75% of the time but then continued anyway in 93% of those cases. The company says it will add a METR investigation (untimed) and expects fewer incidents after model updates, while still marking the underlying problem as unsolved.