Now in Nature: Retrofitting language models to operate over bytes
Allen Institute (AI2) 1 week ago 8
Ai2 published the Bolmo research in Nature and released new Hugging Face checkpoints for byte-level language models beyond the original Olmo-based versions. The release includes Stage 1 checkpoints that freeze the global model while training Bolmo’s byte-level components. This enables faster retrofitting of subword models into competitive byte-level models and supports broader experimentation without retraining from scratch.