File 002 · Local Intelligence

Record 051 · Runtimes · 2023

23.51.U

KoboldCpp

LostRuins

KoboldCpp (2023) by LostRuins

A llama.cpp package that became the creative-writing local UI.

A frontend with a soul.

KoboldCpp bundled GPU backends, a good UI, and story tools. It is still how a lot of people run GGUFs for anything but enterprise chat.

The creative local-LLM frontend.

Filed notes

  • Bundled llama.cpp + UI
  • Story/adventure modes
  • Easy GPU builds

SIC

7372

Prepackaged Software

NAICS

511210

Software Publishers

Official

Also in this file