File 002 · Local Intelligence
Record 085 · Models · 2023
23.85.LAlpaca
Stanford CRFM
“A Llama fine-tune that showed a weekend of self-instruct could make a helpful local model.”
Instruction-following, from a 7B.
Alpaca's 52K demonstrations and the ensuing replicas (Vicuna, GPT4All-LoRA) created the instruction-tuned local chat model.
Opened cheap instruction-tuning of local models.
Filed notes
- Self-instruct data
- 7B instruction model
- Replicable recipe
SIC
7372
Prepackaged Software
NAICS
513210
Software Publishers
