File 002 · Local Intelligence
Record 023 · Models · 2023
23.23.LMixtral 8x7B
Mistral AI
“A mixture-of-experts model that a 2×24GB box could actually serve.”
Sparse experts, dense enough to home-host.
Mixtral made MoE a homelab object, not a Google-only paper. Quality of a larger dense model at a fraction of active parameters.
Opened MoE as a local-serving pattern.
Filed notes
- Open MoE weights
- Home-servable experts
- Apache-2.0
SIC
7372
Prepackaged Software
NAICS
513210
Software Publishers
