FilesLocal IntelligenceRecord 001
Record 001 · Runtimes · 2023
67%23.01.U
llama.cpp
Georgi Gerganov
“The C++ engine that made a 7B model a laptop object, not a cluster job.”
Gerganov quantized and ported Llama to plain C/C++ with GGML, then GGUF. CPU, Metal, CUDA, Vulkan — one repo. Every later local UI is a frontend to this idea.
Opened local LLM inference as something you run, not rent.
- GGML/GGUF quantization
- CPU-first then GPU backends
- Single-binary local inference
The runtime that fit in RAM.
