Population-based Model Merging via Quality Diversity

Sakana AI ● Covered by 3 sources

Sakana AI proposes CycleQD, a method that evolves a population of specialized 8-billion-parameter language models using model merging and quality diversity techniques, rather than training a single large model. The framework was tested on three computer science tasks (coding, database operations, and OS operations) where it outperformed traditional fine-tuning and model merging baselines. This population-based approach creates diverse agents with complementary skills that can specialize in different domains while maintaining general capabilities, offering a more computationally sustainable path to developing capable AI agents.