TLDRocket
Sign in

OpenAI

592 summarised stories about OpenAI, each linking back to the original source. Browse all topics →

+ Follow this topic

Thursday, 16 January 2025

Structured Logprobs

GitHub 1 year ago 44

A Python library called structured-logprobs adds token-level log probability data to OpenAI's structured outputs, allowing developers to measure confidence in each generated value. The library provides two methods: adding log probabilities as a separate field (returning values like -5.5 for "capital_of_France") or embedding them inline within the JSON response. This enables assessment of reliability for extracted data by quantifying how likely the model found each token it generated.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.