After Orthogonality: Virtue-Ethical Agency and AI Alignment

The Gradient · 4 months ago

A philosophical essay argues that AI agents should be designed with eudaimonic rationality—a practices-based form of reasoning rooted in virtue ethics—rather than consequentialist goal-optimization, because human flourishing itself involves this type of rational activity. The essay identifies eudaimonic rationality as a natural and stable form of agency found in domains like mathematics and friendship, where agents promote excellence through excellence rather than optimizing toward external goals. This framework would make AI systems more robust to alignment problems like inner misalignment, goal drift, and violations of safety properties like corrigibility and transparency, while also naturally supporting human values without creating the type mismatch that plagues goal-based AI alignment approaches.