GPU × local model compatibility
Can RTX 3090 24GB run Mistral Small 3.1 24B Instruct?
Yes — it can run.
Mistral Small 3.1 24B Q4 is a practical workload for a 24GB RTX 3090, subject to runtime and context settings.
17.84GBVRAM required
24.00GBAvailable memory
6.16GBMemory headroom
Q4_K_MRecommended quantization
8KContext
A lighter Q5_K_M / 8K configuration also fits.
Calculated estimate, not a measured benchmark.