Local model run decision
Can Nvidia GeForce RTX 3090 24GB run Mistral Small 3.1 24B Instruct?
Yes — the recommended configuration fits.
6.16GB memory headroom remains.
17.84GBCalculated requirement
24GBUsable VRAM / RAM
Q4_K_MRecommended quant
8KContext
Calculated, not benchmarked.