Mixtral 8x7B

Mistral AI

“A mixture-of-experts model that a 2×24GB box could actually serve.”

Mixtral made MoE a homelab object, not a Google-only paper. Quality of a larger dense model at a fraction of active parameters.

Opened MoE as a local-serving pattern.

Sparse experts, dense enough to home-host.

Also in this file