TLDRocket
Sign in

llm 0.32rc2

Simon Willison Simon Willison Covered by 10 sources

LLM 0.32rc2 release updated the default model from GPT-4o mini to GPT-5.6 Luna and added an openai endpoint command for running prompts against OpenAI-compatible endpoints without prior configuration. GPT-5.6 Luna costs $0.20 per million input tokens and $1.20 per million output tokens, compared to GPT-4o mini's $0.15/$0.60. Users can now test prompts against local or remote compatible endpoints directly via CLI without installing LLM.

Why it matters

Release: llm 0.32rc2 Hot on the heels of RC1, this fixes a dependency issue and also adds two neat new features: The default model for users who have not set their own default is now GPT-5.6 Luna. It was previously GPT-4o mini. Luna is a much better and more recent model, albeit slightly more expensive - $0.20 per million input tokens and $1.20 per million output tokens, compared to $0.15/$0.60 for 4o mini. You can switch back to 4o mini using llm models default gpt-4o-mini, or switch to GPT-5 nano, an even cheaper default model ($0.05/$0.40), using llm models default gpt-5-nano. #1576 New llm openai endpoint command for running prompts, chats and model listings against arbitrary OpenAI-compatible endpoints without first configuring a model. These calls are not logged. #1565 The llm openai endpoint command is really cool. I got frustrated at the lack of an obvious CLI tool for trying out prompts against arbitrary OpenAI Chat Completions imitation endpoints, so I decided to add that to

Also covered by

Related stories

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads 60+ sources, removes duplicate coverage, and summarises the day in two minutes. Free, no spam, unsubscribe anytime.