🧨 Accelerating Stable Diffusion XL Inference with JAX on Cloud TPU v5e

Hugging Face Blog · 2 years ago

Hugging Face Diffusers now supports running Stable Diffusion XL image generation on Google Cloud TPU v5e using JAX, enabling optimized inference through JIT compilation and parallelization. The setup generates four 1024×1024 images in 2.33 seconds on a TPU v5e-4 instance, achieving 2.4 times greater performance-per-dollar compared to TPU v4. Organizations can now deploy SDXL in production with reduced computational costs and faster inference times.