GPU × local model compatibility
Can RTX 4090 24GB run DeepSeek R1 Distill Qwen 32B?
No — it exceeds available memory.
DeepSeek R1 Distill 32B exposes the RTX 4090's capacity limit and makes lower-bit alternatives transparent.
24.59GBVRAM required
24.00GBAvailable memory
0.59GBVRAM shortfall
Q4_K_MRecommended quantization
8KContext
A lighter Q2_K / 8K configuration also fits.
Calculated estimate, not a measured benchmark.