BLOOM (2022) by BigScience

Record 087 · Models · 2022

67%22.87.L

BLOOM

BigScience

“The multilingual open model that proved a collaboration could release weights at GPT-3 scale.”

BLOOM was too big for a homelab, but petals, quantization, and the idea of a public 176B changed what 'open' meant. Local's political ancestor.

Opened truly large public generative weights.

Official site
  • Public 176B
  • Multilingual
  • Collaborative training

A 176B trained in public.