KoboldCpp (2023) by LostRuins

Record 051 · Runtimes · 2023

67%23.51.U

KoboldCpp

LostRuins

“A llama.cpp package that became the creative-writing local UI.”

KoboldCpp bundled GPU backends, a good UI, and story tools. It is still how a lot of people run GGUFs for anything but enterprise chat.

The creative local-LLM frontend.

Official site
  • Bundled llama.cpp + UI
  • Story/adventure modes
  • Easy GPU builds

A frontend with a soul.