TLDRocket
Sign in
Latest Anthropic can’t reliably control its AI agents. It’s cutting off its i... — TechCrunch IBM connects enterprise AI orchestration to production readiness ahead... — SiliconANGLE Doctor Evidence Search Tool “Evidence Finder” Adds Sakana Namazu — Sakana AI Ukraine’s drones knock out AI data center belonging to "Russia’s Googl... — Ars Technica The maker of non-text AI model Jev valued at $7.5B just weeks after la... — TechCrunch Alibaba Qwen Releases Qwen-Image-2.1-Turbo, an 8-Step 7B Image Model — MarkTechPost Kubernetes on cgroup v1 is dead. Here’s what comes next. — The New Stack Jev creator TypeSafe closes $870M round at $7.5B valuation — SiliconANGLE

The AI intelligence platform

Every AI story that matters — and the intelligence behind it.

TLDRocket reads all relevant sources, removes duplicate coverage, and publishes a short neutral summary of every story, linking back to the original. Free, no spam, unsubscribe anytime.

Add to Slack

Every story also updates live profiles event timelines weekly rankings the AI Market Index

Thursday, 8 February 2024

From OpenAI to Open LLMs with Messages API on Hugging Face

Hugging Face 2 years ago 39

Hugging Face released a Messages API in Text Generation Inference version 1.4.0 that makes open-source language models compatible with OpenAI's Chat Completion API, allowing users to swap between OpenAI and open models using existing client libraries. The API works with OpenAI's Python and JavaScript clients as well as third-party frameworks like LangChain and LlamaIndex, requiring only a change in the endpoint URL and API key. The Messages API does not currently support function calling and only works with models that have a chat_template defined in their tokenizer configuration.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.