llama.cpp

Specifications

No specifications recorded yet.

Latest developments

Deploying a 1-Bit Bonsai-27B Model with PrismML llama.cpp and OpenAI-Compatible Local Inference Workflows MarkTechPost · 6 days ago · 28 BaseRT provides faster runtime for serving AI models with less infrastructure The Neuron · 2 weeks ago · 9 Welcome Inkling by Thinking Machines Hugging Face Blog · 2 weeks ago · 40 Liberate your OpenClaw Hugging Face Blog · 4 months ago · 31 GGML and llama.cpp join HF to ensure the long-term progress of Local AI Hugging Face Blog · 5 months ago · 45

The Transformers Library: standardizing model definitions Hugging Face Blog · 1 year ago · 47

Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference Hugging Face Blog · 1 year ago · 11 Codestral Mamba Mistral AI · 2 years ago · 9

Q3 2026

◆ Thinking Machines releases Inkling, an open-source multimodal language model with 975 billion parameters Open source release

• 28 Jul Deploying a 1-Bit Bonsai-27B Model with PrismML llama.cpp and OpenAI-Compatible Local Inference Workflows
• 20 Jul BaseRT provides faster runtime for serving AI models with less infrastructure
• 15 Jul Welcome Inkling by Thinking Machines

Q1 2026

• 27 Mar Liberate your OpenClaw
• 20 Feb GGML and llama.cpp join HF to ensure the long-term progress of Local AI

Q2 2025

• 15 May The Transformers Library: standardizing model definitions

Q1 2025

• 16 Jan Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference

Q3 2024

◆ Mistral AI releases Codestral Mamba and NeMo models Model release

• 16 Jul Codestral Mamba

Relationships

Products & technology

• Integrated with Codestral Mamba · 1 source
• Integrated with Hugging Face · 1 source
• PrismML develops this model · 1 source
• Text Generation Inference integrated with this model · 1 source
• Transformers integrated with this model · 1 source