Local AI Hardware

Mini PCs, unified-memory systems and DIY builds for running language models locally.

23 items · manufacturer-sourced

See the ranked shortlist →

Hardware

Mac Studio (M3 Ultra)
Apple
9.8Score
EMC8859
—
HDMIHDMI 2.1
Mac Studio M2 Ultra
Apple
9.8Score
GPU76-core GPU
Enthusiast
MemoryUp to 192GB Unified
Nvidia GeForce RTX 5090 (32GB)
Nvidia
9.7Score
Memory32GB GDDR7
—
Cuda Cores21760
Mac Mini M4 Pro (64GB)
Apple
9.5Score
Unified memory64 GB
Sweet spot
Throughput35-50 tok/s
NVIDIA GeForce RTX 4090
NVIDIA
9.5Score
Tdp450W
Enthusiast
HDCP2.3
Nvidia GeForce RTX 5070 Ti (16GB)
Nvidia
9.3Score
Memory16GB GDDR7
—
Cuda Cores8960
ClawBox
ClawBox
9.2Score
GPUNVIDIA Ampere
—
RAM8GB LPDDR5 unified memory
Minisforum MS-S1 Max
Minisforum
9.2Score
N5AMD Ryzen™ 7 255 / 16G DDR5 + 128G OS Storage
—
APUAMD Ryzen AI Max+ 395
Threadripper Pro + Dual RTX 4090 Build
9.2Score
Total VRAM48
Professional
RAM256 GB
Nvidia GeForce RTX 5080 (16GB)
Nvidia
9.1Score
Memory16GB GDDR7
—
Cuda Cores10752
MinisforumImage unavailable
Minisforum MS-01
Minisforum
8.5Score
Form factormini-pc
Sweet spot
Cores14 cores and 20 threads
Nvidia GeForce RTX 3090 (Used)
Nvidia
8.5Score
Boost Clock1.86 GHz | 1.70 GHz
—
Memory Size24 GB | 24 GB
GMKtec EVO-X2 (128GB)
GMKtec
8.0Score
Unified memory128 GB
Enthusiast
Throughput15-25 tok/s
Ryzen 5 + RTX 4060 Ti Build
7.5Score
VRAM16 GB
Entry
RAM64 GB
NVIDIAImage unavailable
GeForce RTX 5060
NVIDIA
FP4306.8 TFLOPS
—
FP6153.4 TFLOPS
NVIDIAImage unavailable
GeForce RTX 5060 Ti
NVIDIA
FP4379.3 TFLOPS
—
FP6189.6 TFLOPS
NVIDIAImage unavailable
GeForce RTX 5070
NVIDIA
FP4493.9 TFLOPS
—
FP6246.9 TFLOPS
NVIDIAImage unavailable
NVIDIA DGX Spark 64GB
NVIDIA
ComputeNVIDIA Grace Blackwell
—
NetworkingNVIDIA ConnectX-7
NVIDIA RTX Spark Windows PCs
NVIDIA
DLSSedit 12K 4:2:2 video with the NVIDIA Blackwell decoder
—
Size14- to 16-inch sizes
AMDImage unavailable
Radeon RX 9060 XT
AMD
FP8205.1 TFLOPS
—
TDP160 W
AMDImage unavailable
Radeon RX 9070
AMD
Rops128
—
Density151.0M / mm²
AMDImage unavailable
Radeon RX 9070 GRE
AMD
TDP220 W
—
TPP2194
AMDImage unavailable
Radeon RX 9070 XT
AMD
FP8389.3 TFLOPS
—
FSR4.1.2, XeSS 3

Further reading