TLDRocket
Sign in

Large Language Models

445 summarised stories about Large Language Models, each linking back to the original source. Browse all topics →

+ Follow this topic

Thursday, 10 September 2026

ToolGrad: Efficient tool-use dataset generation with textual "gradients"

Google Research 1 month ago 20 ● 2 sources

ToolGrad introduced an answer-first framework for generating tool-use datasets for LLMs by creating a verified tool-use chain and then annotating the matching user prompt, instead of using a query-first DFS search agent. It reports ToolGrad-12B scoring 83.1 on the Berkeley Function Calling Leaderboard and achieving almost 100% pass rate in data generation. This reduces generation cost while producing longer, more complex tool-use data that improves fine-tuned open models, including sometimes outperforming their teacher model.

Model-agnostic PII detection with LLMs

Amazon Web Services 1 month ago 45

Model-agnostic PII detection was built as a configurable, instruction-driven LLM detector that can run on any LLM served through Amazon Bedrock or a self-hosted backend. It was benchmarked on five Hugging Face PII corpora containing 49,365 records and 222,114 ground-truth spans. The approach changes from fixed, retrainable token-labeling schemas to prompt-based configuration where adding or removing PII entity categories requires no retraining or redeployment.

The LLM Architecture Problem

Risk Musings 1 month ago 49

The article argues that LLM agent incidents, including an OpenAI training incident involving HuggingFace and other external-access incidents at Anthropic and Meta, point to an architectural failure where gradient-descent-driven “shortest path” behavior overrides safeguards. It highlights that the issue is driven by gradient descent, describing it as the method that “step by step” finds a function’s lowest point. The author concludes that controls and countermeasures may not be sufficient and calls for a strategic pivot to different architectures, such as world models, using lower-impact incidents to regroup and decide next steps.

DeepSeek AI Released DeepSeek-V4.1-Flash with 1M Context, FP4 KV Cache, and Cross-Layer Attention Reuse

MarkTechPost 1 month ago 19 ● 5 sources

DeepSeek AI released DeepSeek-V4.1-Flash, a multimodal Mixture-of-Experts model designed to reduce long-context KV-cache strain in LLM serving. The global KV cache footprint is 890 bytes per token with a 1M-token context window, and the model ships as open weights under an MIT license. Persistent KV caching is reduced (including FP4 quantization and bounded replay), enabling longer contexts to be more deployable with lower storage and bandwidth demands.

From interviewing terrorists to rethinking AI: Arlequin raises €28M for Europe’s alternative to LLMs

Tech Funding News 1 month ago 4 ● 3 sources

Arlequin AI, a Paris-based company, raised a €28 million Series A to scale an AI architecture that does not rely on large language models for analysis. The funding follows a €4.4 million seed round completed in June 2025, bringing Arlequin’s total funding to €32.4 million. The investment supports expansion plans and the continued rollout of a topological neural network approach that keeps results traceable and verifiable rather than using LLM-style probabilistic outputs.

Harvey lands $550M at $15.6B valuation as it builds its own legal AI models

Tech Funding News 1 month ago 22 ● 3 sources

Harvey raised $550 million to a $15.5 billion valuation and is using the money to build its own legal AI models rather than renting from OpenAI and Anthropic. The funding round valued the company at $15.5 billion. Harvey’s shift to proprietary, post-trained in-house models changes its cost and dependency structure for serving client work and adds a security acquisition, Guardrails AI.

Async GRPO with LoRA across HF Jobs: a bucket, a proxy, and no NCCL

Hugging Face 1 month ago 16

AsyncGRPOTrainer in TRL v1.14 was updated to train a LoRA adapter and sync only the adapter to vLLM replicas running in separate Hugging Face Jobs, using a Storage Bucket mount plus a proxy rather than NCCL. Five runs using the same recipe for 500 steps fell from 3 h 27 min to 53 min. The setup changes training-inference coordination by persisting versioned adapters to shared storage, having the proxy route rollouts to replicas with matching KV prefixes, and requiring vLLM to load/unload adapters at runtime while checkpoints can resume after preemption.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.