The amount of VRAM sets which models you can run. Memory bandwidth sets how fast they run. The connection (eGPU or desktop slot) barely matters once the model is loaded.
Used GPU prices since early 2026. An AI-driven memory shortage pushed a used 3090 from ~$800 to ~$1,600.
Each generated token reads every weight once. Real speeds land at ~60–75% of bandwidth ÷ model size.
Generation loss over OCuLink when the model fits in VRAM. Loading and CPU offload are where an eGPU hurts.
Data centers are buying up the world's memory chips, so cards with lots of VRAM cost much more than they did earlier this year. Guides that quote a "$700 used 3090" or a "$150 P40" are out of date.
Used = eBay sold or lowest listings. New = Tom's Hardware lowest price (Nov 3). The RTX 50 Super refresh is on hold over memory costs, so don't wait for it.
Pick a model size. Bars show generation speed for one user at Q4 (4-bit) quantization. Gray rows can't fit the model in VRAM. Hover over a row for details.
One pick per tier, chosen for value per dollar at November prices with the fewest software headaches. Alternatives are listed under each.
| Setup | VRAM | Cost (GPUs) | Runs | Note |
|---|---|---|---|---|
| 2× RTX 3060 12GB | 24GB | ~$600 | 32B, tight (~11 tok/s est.) | Cheapest route to 32B |
| 2× RTX 3090 | 48GB | ~$3,200 | 70B at 31.9 tok/s · 32B at 59.8 | The classic. Needs a 1,200–1,500W PSU |
| 2–4× R9700 / Arc Pro B70 | 64–128GB | $2,400–5,200 | 70B+, big MoE | Blower cards made to stack; weaker software |
| Strix Halo mini PC (no GPU) | 128GB shared | $3,300–4,300 | gpt-oss-120B 31–56 tok/s · 70B ~5 | Cheapest 128GB; good for MoE, slow on dense |
| DGX Spark | 128GB shared | $6,950 | Same class as Strix Halo | Same bandwidth as Strix Halo at twice the price. Skip for inference |
-sm tensor or vLLM TP) adds speed (70B on 2×3090: 19.5 → 31.9 tok/s) but wants identical cards and x8+ PCIe links. Never run tensor-parallel over eGPU links.Example parts lists at November prices.
First check the computer's ports: it needs OCuLink, Thunderbolt 3/4/5, or USB4. A plain USB-C port won't work.
Thunderbolt 5 only (no OCuLink)? Minisforum DEG2 (~$250) + Corsair RM850e (~$100), or Razer Core X V2 ($350) + PSU.
Use a desktop with two x16-size slots (x8/x8 on AM5 is fine) and room for two 3-slot cards, or use risers.
Power-limit each card to 280W (nvidia-smi -pl 280): under 1% slower, much less heat. Two cards stay within one 15A household circuit; four need two circuits.
Mostly want big MoE models (gpt-oss-120B, Qwen3 235B-A22B at low quant)? A 128GB Strix Halo box does it in one quiet machine.
Measured bandwidth from host to GPU. The model loads once; after that, single-GPU generation sends only a few KB per token over the link.
| Workload | OCuLink | Thunderbolt |
|---|---|---|
| Generation (model in VRAM) | −0–5% | −5–10%* |
| Model load time | ~4× slower | ~6–8× slower |
| Partial CPU offload | bad | prompt speed −54% |
| Tensor-parallel multi-GPU | avoid | avoid |
| Hot-plug | no, power off first | yes |
*Small fast models (100+ tok/s) suffer more from Thunderbolt latency. One uncontrolled 2024 test saw −38% on a 7B model.
171.5 vs 175.4 tok/s in a desktop (Notebookcheck, Minisforum DEG2).
tok/s, OCuLink+USB4 vs 2× Thunderbolt 3. With layer split, the link type doesn't matter.
Prompt tok/s, x16 vs Thunderbolt 3, with the model partly in system RAM. Keep the model fully in VRAM.
"Open frame" docks are bare boards: the GPU and PSU sit in the open. They're cheaper and fit any card. OCuLink is faster than Thunderbolt, but few laptops have it.
| Dock | Connection | Power | Price | Verdict |
|---|---|---|---|---|
| Aoostar AG01 | OCuLink | Built-in 400W | $149–179 | Budget pick for cards up to ~250W |
| Aoostar AG02 | OCuLink + USB4 | Built-in 800W | ~$229 | Best value. No PSU to buy; fine for a 3090/4090 |
| Minisforum DEG1 | OCuLink | Bring ATX/SFX | ~$110 | Cheapest if you have a good PSU |
| Minisforum DEG2 | OCuLink + TB5 | Bring ATX/SFX | $240–299 | Best reviewed; one dock for any computer |
| Aoostar AG03 | OCuLink + 2× TB5 | Built-in 800W (GPU ≤500W) | $249–279 | Newer, fewer reviews; no 5090 |
| Aoostar EG02 | 2× TB5 (+OCuLink) | Bring ATX/SFX | $219–299 | Tight for 3-slot cards |
| Razer Core X V2 | TB5 | Bring ATX | $350 | Enclosed, fits 4-slot cards, charges laptop 140W |
| Sonnet Breakaway 850 T5 | TB5 | Built-in 850W | $600 | Plug-and-play enclosed box; pricey |
| ADT-Link R43SG / F9G | M.2 slot → PCIe | Bring ATX | $50–107 | Hack: turns a free NVMe slot into a GPU port |
Error 43: update the Thunderbolt driver and BIOS. Code 12: enable "Above 4G Decoding."
Authorize Thunderbolt devices with boltctl. OCuLink shows up as a normal PCIe card, with fewer problems.
Use the shortest OCuLink cable you can (0.5m, 1m max). TB5 passive cables reach ~2m.
Docks without a built-in PSU take a standard ATX (or SFX) desktop PSU. The dock's 24-pin connector switches it on. Without a dock, a $5–10 "ATX jumper" plug does the same job.
| GPU | Card power | Dock-only PSU | In a desktop |
|---|---|---|---|
| RTX 3060 | 170W | 450–550W | 550–650W |
| RTX 5060 Ti | 180W | 450–550W | 650W |
| RTX 3090 | 350W* | 750W+ | 850W+ |
| RTX 4090 | 450W | 850W | 1000W |
| RTX 5090 | 575W | 1000W | 1200W |
| 2× RTX 3090 | 700W* | — | 1200–1500W |
*3090s spike to ~550–580W for about 1ms. Buy ATX 3.0/3.1 units, which are rated for 2× surges.
| Use | Model | Price |
|---|---|---|
| 3060 / 5060 Ti | Corsair RM750e (ATX 3.1) | $80–90 |
| One 3090 / 4090 | Corsair RM850e or MSI MAG A850GL | $90–110 |
| 5090, or a 3090 in a desktop | Montech Century II 1050W (10-yr warranty) or Thermaltake GF A3 1050W | $100–130 |
| 2× 3090 | Seasonic Vertex GX-1200 / Super Flower Leadex VII 1200W | $190–250 |
| 3–4 GPUs | Corsair HX1500i / Seasonic Prime TX-1600 (or a used HP 1200W server PSU + breakout board, ~$50: loud, 900W on 120V) | $300–450 |
Price and risk move in opposite directions. For anything over ~$500, pay for buyer protection.
| Source | Price vs eBay | Protection | Best for |
|---|---|---|---|
| eBay | baseline | Money Back Guarantee, 30 days, even on "no returns" listings | Used 3090/4090, Tesla & MI50 server pulls. Filter by Sold to see real prices |
| FB Marketplace / Craigslist / OfferUp | 10–20% cheaper | none, cash | Local deals. Only buy after watching the card run a load test |
| r/hardwareswap | ≈ eBay ±10% | PayPal Goods & Services only | Enthusiast sellers. Check confirmed-trade flair and timestamped photos |
| Jawa.gg | ≈ eBay | Escrow, 2-day inspection | Used parts from vetted sellers |
| Micro Center | open-box / refurb deals | 90-day refurb warranty | 3060 12GB, refurbished cards, new PSUs; in person |
| Amazon / Newegg / Best Buy | highest | Easy returns; Renewed 90 days | New cards, docks, PSUs |
| AliExpress / Alibaba | cheapest for MI50 & modded cards | weak | 48GB 4090 mods, MI50s, for those who accept the risk |
| GovDeals / university surplus | sometimes very cheap | as-is | Workstation and Tesla cards; luck-dependent |
Benchmark figures marked as estimates are derived from bandwidth or from a related model. Prices change weekly; check eBay's Sold listings before you buy.