Open-weight local model
DeepSeek R1 Distill Qwen 14B
Reasoning-focused dense model. Long reasoning output can make generation feel slower than chat models.
- Parameters
- 14.77B
- Recommended quantization
- Q4_K_M
- Weight estimate
- 9.3GB
- Maximum context
- 128K
Quantization memory at the default context
| Quantization | Weights | KV cache | Total VRAM |
|---|---|---|---|
| FP16 | 29.80GB | 1.61GB | 34.39GB |
| Q8_0 | 16.40GB | 1.61GB | 19.65GB |
| Q6_K | 12.60GB | 1.61GB | 15.47GB |
| Q5_K_M | 10.66GB | 1.61GB | 13.34GB |
| Q4_K_M | 9.30GB | 1.61GB | 11.84GB |
| Q3_K_M | 7.70GB | 1.61GB | 10.11GB |
| Q2_K | 4.85GB | 1.61GB | 7.26GB |
GPUs to check for this model
- Can RTX 4060 Ti 16 GB run it?
- Can RTX 4060 8GB run it?
- Can Apple MacBook Pro M3 Pro (14-core GPU) 18GB run it?
- Can Apple MacBook Pro M3 Pro (18-core GPU) 18GB run it?
- Can RTX 5080 16GB run it?
- Can RTX 5070 Ti 16GB run it?
- Can RTX 5070 Ti SUPER 16GB run it?
- Can RTX 5080 Mobile 16GB run it?
- Can RTX 6070 16GB run it?
- Can RTX 4080 SUPER 16GB run it?