What is Decision 3.0? vLLM Semantic Router’s New Open Decision Models
MarkTechPost 6 days ago 13 ● 8 sources
vLLM Semantic Router released Decision 3.0, a family of multimodal decision models that read text, JSON, and images and answer typed questions with probability outputs instead of generated text. The release includes 5 Apache-2.0 models sized from 0.8B to 27B, with median single-request latency on one AMD Instinct MI325X ranging from 21.7 ms (text on d3-nano) to 84 ms (text on d3). Developers can use the probability-based outputs to classify, route, and gate requests without parsing LLM-generated responses, shifting decision logic toward calibrated thresholds.