GPU × local model compatibility
Can RTX 4070 SUPER 12GB run Mistral Small 3.1 24B Instruct?
No — it exceeds available memory.
Search impressions already exist for this ambitious pairing, so the answer highlights its VRAM gap and links to practical Mistral alternatives and fitting GPUs.
17.84GBVRAM required
12.00GBAvailable memory
5.84GBVRAM shortfall
Q4_K_MRecommended quantization
8KContext
A lighter Q2_K / 8K configuration also fits.
Calculated estimate, not a measured benchmark.