← Back to feed

Next-gen AI chips cut the cost of inference

New accelerators promise up to 4× better energy efficiency for LLM inference.

Next-gen AI chips cut the cost of inference

Silicon manufacturers announced specialized accelerators that promise up to 4× more tokens per watt versus the previous generation.

The improvement arrives as inference costs dominate budgets for LLM-powered products. Cloud providers are already preparing instances with the new chips for the fourth quarter.

Analysts expect competition to drive prices down and democratize access to large-scale models.