OpenAI Blog
·
1 year ago
OpenAI released a Realtime API that enables developers to build applications with fast speech-to-speech capabilities. The API supports bidirectional audio streaming with response times measured in hundreds of milliseconds. This allows developers to create interactive voice applications with lower latency than previous API options.
OpenAI Blog
·
1 year ago
OpenAI's fine-tuning API now supports GPT-4o with both images and text inputs, allowing developers to customize the model's vision capabilities. The update enables model training on multimodal datasets containing 1 to 500 training examples per task. This expands the fine-tuning options beyond text-only models to include vision-based applications.
OpenAI Blog
·
1 year ago
Anthropic added prompt caching to its API, which reduces costs for repeated input sections by storing them in the model's cache. Cached tokens cost 90% less than standard tokens after a 1,024-token minimum, and cached content remains available for five minutes. Users can lower expenses for applications that process the same documents, codebases, or instructions repeatedly.
OpenAI Blog
·
1 year ago
OpenAI now allows users to fine-tune smaller, cheaper models using outputs generated by larger frontier models through its API. The process runs entirely on OpenAI's platform, eliminating the need for external infrastructure. This enables developers to create cost-efficient models that replicate the capabilities of expensive large models without paying for repeated calls to those frontier models.