File 002 · Local Intelligence
Record 039 · Runtimes · 2016
16.39.UROCm
AMD
“AMD's compute stack — the reason a 7900 XTX can run a model without NVIDIA.”
CUDA, if you brought an AMD card.
ROCm's rocky years still matter: llama.cpp, vLLM, and PyTorch-on-AMD are how non-NVIDIA local boxes exist. Strix Halo depends on this path.
Opened local GPU inference off the green team.
Filed notes
- Open GPU compute for AMD
- PyTorch/ROCm
- llama.cpp HIP
SIC
7372
Prepackaged Software
NAICS
511210
Software Publishers
