Language Models

56 summarised stories about Language Models, each linking back to the original source. Browse all topics →

Key players

OpenAI Google Alibaba Amazon Hugging Face Mistral AI

Friday, 7 August 2026

Beyond Next-Token Prediction: A Performance Characterization of Diffusion versus Autoregressive Language Models

Apple Machine Learning Research 3 weeks ago 35

Researchers compared the performance characteristics of diffusion language models (DLMs) and autoregressive language models (ARMs) across inference scenarios. DLMs achieve higher arithmetic intensity through parallel token generation but fail to scale effectively with longer contexts, while ARMs maintain superior throughput in batched inference. The key finding is that reducing sampling steps in DLMs is essential for them to achieve lower latency than ARMs in practical deployments.

Read the full story

Inference Optimization Language Models Diffusion Models

Scaling Categorical Flow Maps

Apple Machine Learning Research 3 weeks ago 7

Researchers scaled Categorical Flow Maps (CFMs), a continuous flow matching approach for language models, to 1.7 billion parameters trained on 2.1 trillion tokens, demonstrating that the method can generate coherent text in as few as 4 inference steps while maintaining quality comparable to discrete approaches. The model maintains near-data-level token entropy and achieves results on standard benchmarks in the same range as discrete diffusion methods. This work establishes CFMs as a viable alternative to autoregressive language models at production scale, with detailed insights into loss weighting and scheduling challenges.

Read the full story

Language Models Model Training

Every AI story that matters,
in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.