Launch HN: General Instinct (YC P26) – Frontier models on edge devices
Hacker News 2 months ago 25
General Instinct, a YC-backed startup, released InstinctRazor, a tool for compressing large language models to run on edge devices with limited compute. They compressed Qwen3.5-122B from 245 GB to 48 GB while matching or exceeding the performance of smaller models like Gemma-4-26B on benchmarks. The technique enables frontier models to run on robotics and edge hardware with 7.6–8 GB peak VRAM usage, addressing the gap between datacenter-optimized models and resource-constrained physical systems.