Silicon manufacturers announced specialized accelerators that promise up to 4× more tokens per watt versus the previous generation.
The improvement arrives as inference costs dominate budgets for LLM-powered products. Cloud providers are already preparing instances with the new chips for the fourth quarter.
Analysts expect competition to drive prices down and democratize access to large-scale models.