Structured Logprobs
TLDR
A Python library called structured-logprobs adds token-level log probability data to OpenAI's structured outputs, allowing developers to measure confidence in each generated value. The library provides two methods: adding log probabilities as a separate field (returning values like -5.5 for "capital_of_France") or embedding them inline within the JSON response. This enables assessment of reliability for extracted data by quantifying how likely the model found each token it generated.
Why it matters
A Python library that enhances OpenAI chat completion responses by adding detailed information about token log properties and works with OpenAI Structured Outputs.