TLDRocket
Sign in

Gemma

11 summarised stories about Gemma, each linking back to the original source. Browse all topics →

+ Follow this topic

Key players

Google Gemma Gemma 4 Hugging Face DeepSeek DeepSeek V4

Thursday, 30 July 2026

TurboFieldfare

GitHub 1 month ago 50

TurboFieldfare is a Swift and Metal runtime that runs Google's Gemma 4 26B language model in approximately 2 GB of RAM on Apple Silicon Macs by streaming expert weights from SSD rather than loading the full 14.3 GB model into memory. The system achieves 5.1–6.3 tokens per second on an 8 GB M2 MacBook Air and 31–35 tokens per second on a 24 GB M5 Pro by keeping only a 1.35 GB core and KV cache resident while fetching needed experts on-demand. Users can now run a 26-billion-parameter instruction-tuned model natively on entry-level Macs through a native app, CLI, or OpenAI-compatible server.

Read the full story
Inference Optimization Apple Model Optimization Gemma

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.