TLDRocket
Sign in

Efficiency & Optimization

59 summarised stories about Efficiency & Optimization, each linking back to the original source. Browse all topics →

Thursday, 4 January 2024

Welcome aMUSEd: Efficient Text-to-Image Generation

Hugging Face Blog 2 years ago

aMUSEd is an open-source text-to-image model that uses Masked Image Modeling instead of diffusion, requiring fewer inference steps to generate images. The model contains 800 million parameters and achieves significantly faster inference latencies compared to diffusion-based systems like SDXL, while also enabling zero-shot image inpainting without additional fine-tuning. The release encourages community exploration of non-diffusion approaches for image generation, with simplified fine-tuning possible on consumer GPUs using 11GB of VRAM or 7GB with LoRA optimization.