Record 038 · Accelerators · 2022
67%22.38.X
RTX 4090
NVIDIA
“A gaming card that became the standard local-LLM and diffusion GPU.”
24GB, wide, loud, and everywhere. 70B Q4, SDXL, Comfy video — the 4090 is the machine in a thousand closet servers. 3090 opened it; 4090 sealed it.
The default high-end local accelerator of the mid-2020s.
- 24GB consumer GPU
- Ada inference
- Diffusion + LLM dual use
The homelab's top shelf.
