AI & Tech··1 sources verified
Inference Now Drives Two-Thirds of AI Workloads, Pushing Chips Toward Modular Sites
Summarised by Relevant News AI · Read time: 3 min
AI spending is moving from large training clusters to smaller, quickly built sites, and modular data centers are emerging as a natural home for inference. Power, cooling, and memory supply now shape where tokens get generated as much as raw chip performance does. Inference-first chipmakers such as Positron AI are positioning to capture that shift.
Why it matters: Teams planning AI infrastructure need to weigh power, cooling, and memory availability alongside chip performance when deciding where inference capacity should go.
All sources