TLDRocket
Sign in
Latest Anthropic invests $100 million to train 10,000 engineers and tackle th... — Anthropic Apple says it’s tightening macOS ‘Full Disk Access’ controls due to ne... — TechCrunch Call it AI, call it Super Intelligence, only 2% of consumers are buyin... — TechCrunch It’s not AI anymore, it’s ‘super intelligence’ (according to the White... — TechCrunch AI in customer experience has an orchestration problem, not an adoptio... — SiliconANGLE Circuit Breaker Labs hopes to make AI safer for your kids (and you) — TechCrunch Ai2 releases Olmo-core 3 to make developing large mixture-of-experts L... — SiliconANGLE A model guide for the GPT-6 family — OpenAI

The AI intelligence platform

Every AI story that matters — and the intelligence behind it.

TLDRocket reads all relevant sources, removes duplicate coverage, and publishes a short neutral summary of every story, linking back to the original. Free, no spam, unsubscribe anytime.

Add to Slack

Every story also updates live profiles event timelines weekly rankings the AI Market Index

Saturday, 9 August 2025

From GPT-2 to gpt-oss: Analyzing the Architectural Advances

Ahead of AI 1 year ago 36

OpenAI released gpt-oss-120b and gpt-oss-20b, their first open-weight models since GPT-2 in 2019, featuring standard transformer architecture with optimizations including RoPE positional embeddings, SwiGLU activation functions, and Mixture-of-Experts modules. The 20B model runs on 16GB consumer GPUs while the 120B model requires an H100 with 80GB RAM. The architectural changes from GPT-2 reflect iterative improvements across the industry in parameter efficiency and inference optimization rather than fundamental innovations.

Read the full story
Model Architecture

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.