Timm ❤️ Transformers: Use any timm model with transformers

Hugging Face · 1 year ago · 18

The Hugging Face transformers library now supports integration with timm (PyTorch Image Models), allowing users to leverage timm's 200K+ daily-downloaded computer vision models within the transformers ecosystem. An 8-bit quantized timm ViT model reduced from 346.27 MB to 88.20 MB (74.53% reduction) while maintaining nearly identical inference accuracy. Users can now fine-tune timm models with the Trainer API, apply LoRA for parameter-efficient training, use pipeline APIs for inference, and round-trip fine-tuned models back to timm's native format.