Record 083 · Tooling · 2023
67%23.83.F
QLoRA
University of Washington
“4-bit fine-tuning that made adapter training a homelab sport.”
Dettmers et al. combined 4-bit NF4 quantization with LoRA. A single 24GB card could specialize a large model overnight.
Opened large-model fine-tunes on consumer GPUs.
- NF4 4-bit training
- 65B on 24GB
- bitsandbytes stack
Fine-tune a 65B on one GPU.
