Nvidia Benchmarks Groq 3 LPU Results Highlight Benefits of Its $20B Bet
Nvidia’s Groq 3 LPU benchmarks suggest its $20B bet on Groq’s LPU approach is paying off. Nvidia’s Rubin GPUs have far more onboard memory, but Groq’s 500 MB requires model distribution via Ethernet and pooled LPX racks. Gemma 4 31B can fit within an LPX rack using FP8 and FP8 SRAM, while larger dense serving needs many more accelerators.