Record 019 · Runtimes · 2023
50%23.19.U
LocalAI
LocalAI
“A drop-in OpenAI-compatible API that runs models at home.”
LocalAI lets existing apps keep their OpenAI client and change the base URL. P-to-P replacement is how local actually gets adopted.
Opened the compatibility layer that made local a backend, not a new app.
- OpenAI-compatible local API
- Multi-backend (llama.cpp, whisper, diffusers)
- Docker-first
The OpenAI API, pointed at your basement.
