TLDRocket
Sign in

Model Training

276 summarised stories about Model Training, each linking back to the original source. Browse all topics →

+ Follow this topic

Friday, 2 October 2026

Ai2 releases Olmo-core 3 to make developing large mixture-of-experts LLMs more efficient

SiliconANGLE 2 weeks ago 17 ● 3 sources

Allen Institute for AI released Olmo-core 3, a development framework intended to make mixture-of-experts large language model training more efficient. It reported 52,000 tokens per second on Nvidia B3000 GPUs for a 47-billion-parameter model, about 2.7× higher than Megatron-core at roughly 19,400 tokens per second. The update supports growing expert pools from 8 to 128 while selecting 4 experts per token, enabling scaling to over 1 trillion parameters with lower memory and compute overhead.

Fine-tune a search agent with multi-turn RL on Amazon SageMaker AI

Amazon Web Services 2 weeks ago 29

Amazon SageMaker AI fine-tuned a Qwen3.6-27B search agent using multi-turn reinforcement learning to improve how it searches across multiple interaction rounds. The failure rate on BrowseComp-Plus fell from 22.89% to 0.68%. Multi-turn RL raised retrieval quality on three of four held-out benchmarks and made the agent substantially more reliable by reducing task-completion errors within the turn and token limits.

Open-sourcing AstaBrief, the fast report-generation model in Asta

Hugging Face 2 weeks ago 44 ● 2 sources

Asta open-sourced AstaBrief, an 8B model that generates cited scientific reports from a user question and retrieved literature excerpts. The company reported Fast mode averaging 51.1 seconds per report versus 178.5 seconds for Thinking mode. As a result, AstaBrief is available to download and run on institutions’ own infrastructure, with released training data and an example workflow for local PDF-to-report generation.

AutoSynthData: Generating Training Data for Enterprise Agents

Hugging Face 2 weeks ago 25

ServiceNow CoreAI built AutoSynthData to turn enterprise agent capability gaps—identified from a target model’s environment failures—into executable training tasks generated and validated using a stronger teacher’s successes. AutoSynthData’s EnterpriseOps Gym pipeline uses a task-selection rule that favors target-model solves on no more than 1 of 3 trials while requiring the stronger solver to succeed on at least 2 of 3 trials. As the model improves, AutoSynthData shifts the curriculum toward tasks the model still struggles with, using iterative evaluation and feedback loops to expand and rebalance the training dataset.

A Coding Guide to Google Research’s Kauldron: Configs That Are Plain Data, Components Wired by String, and a JAX Trainer You Can Read End to End

MarkTechPost 2 weeks ago 6

A tutorial implements Google Research’s Kauldron JAX training library by demonstrating konfig (plain dict configs), kontext (string-key wiring that prevents components from importing each other), ktyping (runtime named-axis shape checks), and kd.train (a readable Trainer), then runs a synthetic CPU training run and a 5-variant config sweep with checkpointing and resume. It installs Kauldron pinned to version 1.4.2 and applies a small compatibility patch because a Trainer can otherwise raise AttributeError before completing a single step. The result is a workflow where changing one config line reshapes dependent values via references and where training components and tensor shapes are validated and rewired through data and strings instead of code edits.

Language Discrimination Improves Linguistic Learning in Multilingual Speech Models

Apple Machine Learning Research 2 weeks ago 18

Multilingual HuBERT-style self-supervised speech models improved linguistic learning when pretraining was made to better discriminate between languages. Phone-ABX error dropped from 11.6% in the bilingual baseline to 10.4% (monolingual: 10.8%) while lexical (sWUGGY) and prosodic performance also increased. The gains were largest when language discrimination was introduced in the first training iteration, whereas later or repeated use caused more language-wise segregation.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.