File 002 · Local Intelligence
Record 089 · Models · 2023
23.89.LTinyLlama
Zhang et al.
“A 1.1B Llama-architecture model that made 'always-on tiny local' real.”
1.1B, trained on a pile, fits anywhere.
TinyLlama showed a 1B-class model trained on 3T tokens could be useful on a Pi or a phone. Edge SLM before Phi was everywhere.
The cute-but-serious tiny local LLM.
Filed notes
- 1.1B Llama-arch
- High-token training
- Edge-friendly
SIC
7372
Prepackaged Software
NAICS
513210
Software Publishers
