Google Releases LiteRT.js: A JavaScript Binding of LiteRT That Runs .tflite Models in Browsers via WebGPU

MarkTechPost · 1 day ago

Google released LiteRT.js, a JavaScript binding that runs .tflite models directly in web browsers by compiling its native on-device inference runtime to WebAssembly. LiteRT.js achieves up to 3x faster performance than other web runtimes and 5–60x speedup over CPU execution when using GPU or NPU backends through WebGPU and WebNN APIs. Web applications can now execute computer vision and audio models locally without server infrastructure, inheriting performance optimizations previously available only on Android, iOS, and desktop platforms.