Constitutional AI with Open LLMs

Hugging Face Blog · 2 years ago

Researchers released Constitutional AI tools and datasets enabling open-source language models to self-align by critiquing their own outputs against user-defined principles. The team published the llm-swarm tool for generating synthetic training data at scale on GPU clusters, along with aligned Mistral 7B models and datasets based on both Anthropic's and a Grok-inspired constitution. This allows practitioners to customize model behavior without collecting expensive human feedback by having models identify and revise responses that violate constitutional principles.