Best hardware for Devstral Small 2 24B
24B parameters · mistral family : per-quant VRAM needs, the used-GPU configs that fit, and how buying compares with renting cloud GPUs. Hardware costs sum the cheapest listings that passed our trust screen, one per card the config needs (screened, not guaranteed). Eligible purchases are covered by the eBay Money Back Guarantee if an item never arrives or doesn't match its description.
Q4_K_M
Minimum VRAM: 17.02 GB (file 14.3 GB + context/runtime headroom at 8k ctx; see methodology).
Cheapest fitting cloud offer: Vast.ai $0.116/hr (rtx-3090 class, on-demand) · cloud prices checked 2026-07-31.
| Config | Total VRAM | Cheapest screened hw cost | Est. watts | Tokens/sec | Breakeven vs cloud | Verdict |
|---|---|---|---|---|---|---|
| 1× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 24 GB | $259
report
25,244 feedback (99.9%) · returns accepted · listed 21 days | 325 W | – | 23 mo | Buying wins by month 23 |
| 2× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 48 GB | $529 2 screened listings: $259 + $270
report
25,244 feedback (99.9%) · returns accepted · listed 21 days | 575 W | – | 133 mo | Renting wins at 40 h/mo |
| 1× NVIDIA TITAN RTX | 24 GB | $850
report
12,733 feedback (99.6%) · Top Rated seller · returns accepted · listed 21 days | 355 W | – | 82 mo | Renting wins at 40 h/mo |
| 1× AMD Radeon RX 7900 XTX | 24 GB | $898
report
2,597 feedback (99.6%) · Top Rated seller · returns accepted · listed 1 day | 430 W | – | 158 mo | Renting wins at 40 h/mo |
| 4× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 96 GB | $1,099 4 screened listings: $259 + $270 + $280 + $290 + shipping unknown on 2 of 4 listings
report
25,244 feedback (99.9%) · returns accepted · listed 21 days | 1075 W | – | never | Cloud always cheaper at this power price |
| 1× NVIDIA GeForce RTX 3090 | 24 GB | $1,240
report
39,860 feedback (99.7%) · returns accepted · listed 14 days | 425 W | – | 205 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 3090 Ti | 24 GB | $1,360
report
39,354 feedback (99.7%) · Top Rated seller · returns accepted · listed 21 days | 525 W | – | 351 mo | Renting wins at 40 h/mo |
| 1× NVIDIA RTX A5000 | 24 GB | $2,140
report
39,358 feedback (99.7%) · Top Rated seller · returns accepted · listed 21 days | 305 W | – | 263 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 4090 | 24 GB | $2,425
report
6,579 feedback (99.3%) · Top Rated seller · returns accepted · listed 21 days | 525 W | – | 564 mo | Renting wins at 40 h/mo |
| 2× NVIDIA GeForce RTX 3090 | 48 GB | $2,480 2 screened listings: $1,240 + $1,240
report
39,860 feedback (99.7%) · returns accepted · listed 14 days | 775 W | – | never | Cloud always cheaper at this power price |
| 1× NVIDIA RTX A6000 | 48 GB | $3,949
report
23,219 feedback (99.9%) · Top Rated seller · returns accepted · listed 21 days | 375 W | – | 599 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 5090 | 32 GB | $4,500
report
151 feedback (99.2%) · Top Rated seller · returns accepted · listed 21 days | 650 W | – | 3,375 mo | Renting wins at 40 h/mo |
| 2× NVIDIA GeForce RTX 4090 | 48 GB | $4,870 2 screened listings: $2,425 + $2,445
report
6,579 feedback (99.3%) · Top Rated seller · returns accepted · listed 21 days | 975 W | – | never | Cloud always cheaper at this power price |
| 4× NVIDIA GeForce RTX 3090 | 96 GB | $4,974 4 screened listings: $1,240 + $1,240 + $1,245 + $1,249
report
39,860 feedback (99.7%) · returns accepted · listed 14 days | 1475 W | – | never | Cloud always cheaper at this power price |
| 2× NVIDIA RTX A6000 | 96 GB | $7,948 2 screened listings: $3,949 + $3,999
report
23,219 feedback (99.9%) · Top Rated seller · returns accepted · listed 21 days | 675 W | – | 8,283 mo | Renting wins at 40 h/mo |
Fits, but not currently buyable as a set: 2× NVIDIA RTX A5000 (48 GB) needs 2 screened cards and the market has 1; 4× NVIDIA RTX A5000 (96 GB) needs 4 screened cards and the market has 1. We price a multi-card build from that many separate listings, so it stays unpriced until they exist.
- Configs without a screened purchase option are hidden until listings clear the trust screen (a multi-day survival window on eBay).
- Multi-card costs are the sum of that many separate screened listings; the cheapest listing counted twice is not a price anyone can pay. Prices exclude the PSU, board and case a multi-card build usually also needs.
- Tokens/sec: benchmarks coming; every number will be source-linked. We never publish unattributed performance figures.
- Breakeven and verdict use default assumptions (40 h/mo, $0.16/kWh, 24-month horizon, resale at 65% of median ask); adjust them in the calculator. Hardware links are screened, not guaranteed.
Run your own numbers for Devstral Small 2 24B (Q4_K_M) in the buy-vs-rent calculator →
Q8_0
Minimum VRAM: 28.36 GB (file 25.1 GB + context/runtime headroom at 8k ctx; see methodology).
Cheapest fitting cloud offer: Vast.ai $0.33/hr (rtx-5090 class, on-demand) · cloud prices checked 2026-07-31.
| Config | Total VRAM | Cheapest screened hw cost | Est. watts | Tokens/sec | Breakeven vs cloud | Verdict |
|---|---|---|---|---|---|---|
| 2× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 48 GB | $529 2 screened listings: $259 + $270
report
25,244 feedback (99.9%) · returns accepted · listed 21 days | 575 W | – | 14 mo | Buying wins by month 14 |
| 4× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 96 GB | $1,099 4 screened listings: $259 + $270 + $280 + $290 + shipping unknown on 2 of 4 listings
report
25,244 feedback (99.9%) · returns accepted · listed 21 days | 1075 W | – | 47 mo | Renting wins at 40 h/mo |
| 2× NVIDIA GeForce RTX 3090 | 48 GB | $2,480 2 screened listings: $1,240 + $1,240
report
39,860 feedback (99.7%) · returns accepted · listed 14 days | 775 W | – | 96 mo | Renting wins at 40 h/mo |
| 1× NVIDIA RTX A6000 | 48 GB | $3,949
report
23,219 feedback (99.9%) · Top Rated seller · returns accepted · listed 21 days | 375 W | – | 125 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 5090 | 32 GB | $4,500
report
151 feedback (99.2%) · Top Rated seller · returns accepted · listed 21 days | 650 W | – | 184 mo | Renting wins at 40 h/mo |
| 2× NVIDIA GeForce RTX 4090 | 48 GB | $4,870 2 screened listings: $2,425 + $2,445
report
6,579 feedback (99.3%) · Top Rated seller · returns accepted · listed 21 days | 975 W | – | 213 mo | Renting wins at 40 h/mo |
| 4× NVIDIA GeForce RTX 3090 | 96 GB | $4,974 4 screened listings: $1,240 + $1,240 + $1,245 + $1,249
report
39,860 feedback (99.7%) · returns accepted · listed 14 days | 1475 W | – | 426 mo | Renting wins at 40 h/mo |
| 2× NVIDIA RTX A6000 | 96 GB | $7,948 2 screened listings: $3,949 + $3,999
report
23,219 feedback (99.9%) · Top Rated seller · returns accepted · listed 21 days | 675 W | – | 310 mo | Renting wins at 40 h/mo |
Fits, but not currently buyable as a set: 2× NVIDIA RTX A5000 (48 GB) needs 2 screened cards and the market has 1; 4× NVIDIA RTX A5000 (96 GB) needs 4 screened cards and the market has 1. We price a multi-card build from that many separate listings, so it stays unpriced until they exist.
- Configs without a screened purchase option are hidden until listings clear the trust screen (a multi-day survival window on eBay).
- Multi-card costs are the sum of that many separate screened listings; the cheapest listing counted twice is not a price anyone can pay. Prices exclude the PSU, board and case a multi-card build usually also needs.
- Tokens/sec: benchmarks coming; every number will be source-linked. We never publish unattributed performance figures.
- Breakeven and verdict use default assumptions (40 h/mo, $0.16/kWh, 24-month horizon, resale at 65% of median ask); adjust them in the calculator. Hardware links are screened, not guaranteed.
Run your own numbers for Devstral Small 2 24B (Q8_0) in the buy-vs-rent calculator →