Run a vLLM Server on HF Jobs in One Command
Hugging Face 3 months ago 10
Hugging Face Jobs now allows users to deploy a vLLM server with a single command that creates an OpenAI-compatible endpoint on HF infrastructure without manual server provisioning. The service costs $1.50 per hour for an a10g-large GPU flavor and bills per second of usage. Users can query the endpoint from any location using curl or the OpenAI Python client with token-based authentication, making it suitable for testing, evaluations, and batch generation workloads.