Token Forecaster
Product Hunt 3 weeks ago 20
Token Forecaster launches as an open-source tool that estimates an LLM reply length and flags if it is running long while the response streams. It reports a worst-case bound that held for 90.6% of 4,146 unseen calls. It adds length prediction and streaming-time status to LLM replies by learning from local history without changing the request.