Intentionally Designing the Future of AI

The Neuron · 5 days ago ● 4 sources

Goodfire proposes intentional design, an approach using interpretability techniques to guide AI model training by decomposing neural networks into semantically meaningful components and selectively controlling what models learn from each data point. The company aims to move from current trial-and-error training methods to closed-loop control systems where practitioners can steer learning during training rather than only evaluating afterward. This would enable sample-efficient learning from natural language feedback and better alignment of models with desired values during the training process itself.