Improved Batch Inference API: Enhanced UI, Expanded Model Support, and 3000× Rate Limit Increase

Together AI · 10 months ago

An AI company released an updated Batch Inference API offering a redesigned interface, support for more models, and rate limits increased to 30 billion tokens. The rate limit increase represents a 3000× improvement over the previous version. The enhancement enables users to process large datasets at 50% lower cost compared to real-time API pricing.