TLDRocket
Sign in

Scientific Research

126 summarised stories about Scientific Research, each linking back to the original source. Browse all topics →

+ Follow this topic

Friday, 28 August 2026

What happens when information theory accounts for reasoning?

IBM Research 1 month ago 50

IBM Research proposed an information-theory framework for communication that includes what a receiver can logically deduce from a message. The paper defines a new quantity called “logical semantic entropy” and is published in PNAS. The approach yields results like “No Need to Know” and “Less Is More,” changing the assumed communication limits by showing reasoning can improve efficiency but can also create paradoxical and security-relevant effects.

LLMs Are Not (Consistently) Bayesian: Quantifying Internal (In)consistencies of LLMs’ Probabilistic Beliefs

Apple Machine Learning Research 1 month ago 16 ● 2 sources

The article proposes treating large language models as information processing rules and measuring how far their belief updates deviate from Bayes updates. It introduces the “information processing gap” as the quantitative way to track these internal probabilistic (in)consistencies. As a result, the work frames LLM uncertainty behavior in terms of measurable Bayes-update errors rather than assuming consistent Bayesian reasoning.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.