Best hardware for Gemma 4 12B
12B parameters · gemma family : per-quant VRAM needs, the used-GPU configs that fit, and how buying compares with renting cloud GPUs. Hardware costs sum the cheapest listings that passed our trust screen, one per card the config needs (screened, not guaranteed). Eligible purchases are covered by the eBay Money Back Guarantee if an item never arrives or doesn't match its description.
Q4_K_M
Minimum VRAM: 10.05 GB (file 7.66 GB + context/runtime headroom at 8k ctx; see methodology).
Cheapest fitting cloud offer: Vast.ai $0.072/hr (rtx-5060-ti-16gb class, on-demand) · cloud prices checked 2026-07-31.
| Config | Total VRAM | Cheapest screened hw cost | Est. watts | Tokens/sec | Breakeven vs cloud | Verdict |
|---|---|---|---|---|---|---|
| 1× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 24 GB | $259
report
25,244 feedback (99.9%) · returns accepted · listed 21 days | 325 W | – | 74 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 3060 12GB | 12 GB | $280 + shipping (not stated by seller)
report
124 feedback (98.8%) · no returns · listed 3 days | 245 W | – | 65 mo | Renting wins at 40 h/mo |
| 1× Intel Arc B580 | 12 GB | $300
report
39,358 feedback (99.7%) · Top Rated seller · returns accepted · listed 21 days | 265 W | – | 89 mo | Renting wins at 40 h/mo |
| 1× Intel Arc A770 16GB | 16 GB | $300
report
2,559 feedback (100%) · returns accepted · listed 4 days | 300 W | – | 91 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 3080 12GB | 12 GB | $420 + shipping (not stated by seller)
report
437 feedback (100%) · no returns · listed 21 days | 425 W | – | 768 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 4060 Ti 16GB | 16 GB | $500 + shipping (not stated by seller)
report
1,449 feedback (100%) · no returns · listed 21 days | 240 W | – | 116 mo | Renting wins at 40 h/mo |
| 2× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 48 GB | $529 2 screened listings: $259 + $270
report
25,244 feedback (99.9%) · returns accepted · listed 21 days | 575 W | – | never | Cloud always cheaper at this power price |
| 1× NVIDIA GeForce RTX 5060 Ti 16GB | 16 GB | $560
report
39,358 feedback (99.7%) · Top Rated seller · returns accepted · listed 21 days | 255 W | – | 155 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 4070 Ti SUPER | 16 GB | $775
report
6,272 feedback (99.6%) · returns accepted · listed 21 days | 360 W | – | 390 mo | Renting wins at 40 h/mo |
| 1× NVIDIA RTX A4000 | 16 GB | $800
report
133,548 feedback (99.7%) · returns accepted · listed 14 days | 215 W | – | 157 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 4080 | 16 GB | $833
report
2,538 feedback (99.6%) · returns accepted · listed 13 days | 395 W | – | 641 mo | Renting wins at 40 h/mo |
| 1× NVIDIA TITAN RTX | 24 GB | $850
report
12,733 feedback (99.6%) · Top Rated seller · returns accepted · listed 21 days | 355 W | – | 322 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 5070 Ti | 16 GB | $898
report
1,269 feedback (99.6%) · Top Rated seller · returns accepted · listed 5 days | 375 W | – | 660 mo | Renting wins at 40 h/mo |
| 1× AMD Radeon RX 7900 XTX | 24 GB | $898
report
2,597 feedback (99.6%) · Top Rated seller · returns accepted · listed 1 day | 430 W | – | 2,463 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 4080 SUPER | 16 GB | $930
report
6,272 feedback (99.6%) · returns accepted · listed 21 days | 395 W | – | 800 mo | Renting wins at 40 h/mo |
| 4× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 96 GB | $1,099 4 screened listings: $259 + $270 + $280 + $290 + shipping unknown on 2 of 4 listings
report
25,244 feedback (99.9%) · returns accepted · listed 21 days | 1075 W | – | never | Cloud always cheaper at this power price |
| 1× NVIDIA GeForce RTX 5080 | 16 GB | $1,150
report
14,464 feedback (99.8%) · Top Rated seller · returns accepted · listed 21 days | 435 W | – | 2,664 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 3090 | 24 GB | $1,240
report
39,860 feedback (99.7%) · returns accepted · listed 14 days | 425 W | – | 2,568 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 3090 Ti | 24 GB | $1,360
report
39,354 feedback (99.7%) · Top Rated seller · returns accepted · listed 21 days | 525 W | – | never | Cloud always cheaper at this power price |
| 1× NVIDIA RTX A5000 | 24 GB | $2,140
report
39,358 feedback (99.7%) · Top Rated seller · returns accepted · listed 21 days | 305 W | – | 770 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 4090 | 24 GB | $2,425
report
6,579 feedback (99.3%) · Top Rated seller · returns accepted · listed 21 days | 525 W | – | never | Cloud always cheaper at this power price |
| 2× NVIDIA GeForce RTX 3090 | 48 GB | $2,480 2 screened listings: $1,240 + $1,240
report
39,860 feedback (99.7%) · returns accepted · listed 14 days | 775 W | – | never | Cloud always cheaper at this power price |
| 1× NVIDIA RTX A6000 | 48 GB | $3,949
report
23,219 feedback (99.9%) · Top Rated seller · returns accepted · listed 21 days | 375 W | – | 2,846 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 5090 | 32 GB | $4,500
report
151 feedback (99.2%) · Top Rated seller · returns accepted · listed 21 days | 650 W | – | never | Cloud always cheaper at this power price |
| 2× NVIDIA GeForce RTX 4090 | 48 GB | $4,870 2 screened listings: $2,425 + $2,445
report
6,579 feedback (99.3%) · Top Rated seller · returns accepted · listed 21 days | 975 W | – | never | Cloud always cheaper at this power price |
| 4× NVIDIA GeForce RTX 3090 | 96 GB | $4,974 4 screened listings: $1,240 + $1,240 + $1,245 + $1,249
report
39,860 feedback (99.7%) · returns accepted · listed 14 days | 1475 W | – | never | Cloud always cheaper at this power price |
| 2× NVIDIA RTX A6000 | 96 GB | $7,948 2 screened listings: $3,949 + $3,999
report
23,219 feedback (99.9%) · Top Rated seller · returns accepted · listed 21 days | 675 W | – | never | Cloud always cheaper at this power price |
Fits, but not currently buyable as a set: 2× NVIDIA RTX A5000 (48 GB) needs 2 screened cards and the market has 1; 4× NVIDIA RTX A5000 (96 GB) needs 4 screened cards and the market has 1. We price a multi-card build from that many separate listings, so it stays unpriced until they exist.
- Configs without a screened purchase option are hidden until listings clear the trust screen (a multi-day survival window on eBay).
- Multi-card costs are the sum of that many separate screened listings; the cheapest listing counted twice is not a price anyone can pay. Prices exclude the PSU, board and case a multi-card build usually also needs.
- Tokens/sec: benchmarks coming; every number will be source-linked. We never publish unattributed performance figures.
- Breakeven and verdict use default assumptions (40 h/mo, $0.16/kWh, 24-month horizon, resale at 65% of median ask); adjust them in the calculator. Hardware links are screened, not guaranteed.
Run your own numbers for Gemma 4 12B (Q4_K_M) in the buy-vs-rent calculator →
Q8_0
Minimum VRAM: 15.31 GB (file 12.67 GB + context/runtime headroom at 8k ctx; see methodology).
Cheapest fitting cloud offer: Vast.ai $0.072/hr (rtx-5060-ti-16gb class, on-demand) · cloud prices checked 2026-07-31.
| Config | Total VRAM | Cheapest screened hw cost | Est. watts | Tokens/sec | Breakeven vs cloud | Verdict |
|---|---|---|---|---|---|---|
| 1× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 24 GB | $259
report
25,244 feedback (99.9%) · returns accepted · listed 21 days | 325 W | – | 74 mo | Renting wins at 40 h/mo |
| 1× Intel Arc A770 16GB | 16 GB | $300
report
2,559 feedback (100%) · returns accepted · listed 4 days | 300 W | – | 91 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 4060 Ti 16GB | 16 GB | $500 + shipping (not stated by seller)
report
1,449 feedback (100%) · no returns · listed 21 days | 240 W | – | 116 mo | Renting wins at 40 h/mo |
| 2× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 48 GB | $529 2 screened listings: $259 + $270
report
25,244 feedback (99.9%) · returns accepted · listed 21 days | 575 W | – | never | Cloud always cheaper at this power price |
| 1× NVIDIA GeForce RTX 5060 Ti 16GB | 16 GB | $560
report
39,358 feedback (99.7%) · Top Rated seller · returns accepted · listed 21 days | 255 W | – | 155 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 4070 Ti SUPER | 16 GB | $775
report
6,272 feedback (99.6%) · returns accepted · listed 21 days | 360 W | – | 390 mo | Renting wins at 40 h/mo |
| 1× NVIDIA RTX A4000 | 16 GB | $800
report
133,548 feedback (99.7%) · returns accepted · listed 14 days | 215 W | – | 157 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 4080 | 16 GB | $833
report
2,538 feedback (99.6%) · returns accepted · listed 13 days | 395 W | – | 641 mo | Renting wins at 40 h/mo |
| 1× NVIDIA TITAN RTX | 24 GB | $850
report
12,733 feedback (99.6%) · Top Rated seller · returns accepted · listed 21 days | 355 W | – | 322 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 5070 Ti | 16 GB | $898
report
1,269 feedback (99.6%) · Top Rated seller · returns accepted · listed 5 days | 375 W | – | 660 mo | Renting wins at 40 h/mo |
| 1× AMD Radeon RX 7900 XTX | 24 GB | $898
report
2,597 feedback (99.6%) · Top Rated seller · returns accepted · listed 1 day | 430 W | – | 2,463 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 4080 SUPER | 16 GB | $930
report
6,272 feedback (99.6%) · returns accepted · listed 21 days | 395 W | – | 800 mo | Renting wins at 40 h/mo |
| 4× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 96 GB | $1,099 4 screened listings: $259 + $270 + $280 + $290 + shipping unknown on 2 of 4 listings
report
25,244 feedback (99.9%) · returns accepted · listed 21 days | 1075 W | – | never | Cloud always cheaper at this power price |
| 1× NVIDIA GeForce RTX 5080 | 16 GB | $1,150
report
14,464 feedback (99.8%) · Top Rated seller · returns accepted · listed 21 days | 435 W | – | 2,664 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 3090 | 24 GB | $1,240
report
39,860 feedback (99.7%) · returns accepted · listed 14 days | 425 W | – | 2,568 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 3090 Ti | 24 GB | $1,360
report
39,354 feedback (99.7%) · Top Rated seller · returns accepted · listed 21 days | 525 W | – | never | Cloud always cheaper at this power price |
| 1× NVIDIA RTX A5000 | 24 GB | $2,140
report
39,358 feedback (99.7%) · Top Rated seller · returns accepted · listed 21 days | 305 W | – | 770 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 4090 | 24 GB | $2,425
report
6,579 feedback (99.3%) · Top Rated seller · returns accepted · listed 21 days | 525 W | – | never | Cloud always cheaper at this power price |
| 2× NVIDIA GeForce RTX 3090 | 48 GB | $2,480 2 screened listings: $1,240 + $1,240
report
39,860 feedback (99.7%) · returns accepted · listed 14 days | 775 W | – | never | Cloud always cheaper at this power price |
| 1× NVIDIA RTX A6000 | 48 GB | $3,949
report
23,219 feedback (99.9%) · Top Rated seller · returns accepted · listed 21 days | 375 W | – | 2,846 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 5090 | 32 GB | $4,500
report
151 feedback (99.2%) · Top Rated seller · returns accepted · listed 21 days | 650 W | – | never | Cloud always cheaper at this power price |
| 2× NVIDIA GeForce RTX 4090 | 48 GB | $4,870 2 screened listings: $2,425 + $2,445
report
6,579 feedback (99.3%) · Top Rated seller · returns accepted · listed 21 days | 975 W | – | never | Cloud always cheaper at this power price |
| 4× NVIDIA GeForce RTX 3090 | 96 GB | $4,974 4 screened listings: $1,240 + $1,240 + $1,245 + $1,249
report
39,860 feedback (99.7%) · returns accepted · listed 14 days | 1475 W | – | never | Cloud always cheaper at this power price |
| 2× NVIDIA RTX A6000 | 96 GB | $7,948 2 screened listings: $3,949 + $3,999
report
23,219 feedback (99.9%) · Top Rated seller · returns accepted · listed 21 days | 675 W | – | never | Cloud always cheaper at this power price |
Fits, but not currently buyable as a set: 2× NVIDIA RTX A5000 (48 GB) needs 2 screened cards and the market has 1; 4× NVIDIA RTX A5000 (96 GB) needs 4 screened cards and the market has 1. We price a multi-card build from that many separate listings, so it stays unpriced until they exist.
- Configs without a screened purchase option are hidden until listings clear the trust screen (a multi-day survival window on eBay).
- Multi-card costs are the sum of that many separate screened listings; the cheapest listing counted twice is not a price anyone can pay. Prices exclude the PSU, board and case a multi-card build usually also needs.
- Tokens/sec: benchmarks coming; every number will be source-linked. We never publish unattributed performance figures.
- Breakeven and verdict use default assumptions (40 h/mo, $0.16/kWh, 24-month horizon, resale at 65% of median ask); adjust them in the calculator. Hardware links are screened, not guaranteed.
Run your own numbers for Gemma 4 12B (Q8_0) in the buy-vs-rent calculator →