TOOLORA / Local reading edition
llama.cpp
Run local models in C/C++, with command-line tools, quantization utilities and a model server with a web interface.
Overview
llama.cpp is a model-inference project maintained by ggml-org, not a single Llama model. With compatible model files, users run a chat CLI or start a server with a web interface and compatible APIs. The project supports GGUF workflows, quantization and multiple CPU/GPU backends for local or self-managed inference. Check model files, licenses and hardware support separately; the project name does not imply every model is compatible.
Official sources and references
- Official websitehttps://github.com/ggml-org/llama.cpp
- Documentationhttps://github.com/ggml-org/llama.cpp/tree/master/tools/server
Descriptions summarize public information; consult official websites for features, pricing and regional availability.