The Thread Ripper workstation with 512GB of RAM has sufficient memory to load the full 405 billion parameter Llama 3.1 model, with peak memory usage reaching close to 200GB.

factualpending

Speaker

Dave

Evidence Quote

I think it will Peak up close close to 200 GB of total memory

Source

Run Local LLMs on Hardware from $50 to $50,000 - We Test and Compare!Dave's Garage
Created: 8/13/2026, 9:51:22 AM

My Notes

Loading notes...