Emerald Rapids, Intel’s latest generation of Xeon server CPUs, has made significant gains on Advanced Micro Devices’ (AMD) Genoa server CPUs in terms of AI inference workloads, according to a recent review by Tom’s Hardware. While AMD still holds the advantage in core count with up to 96 cores compared to Emerald Rapids’ 64 cores, Intel’s new chips deliver impressive performance gains through architectural changes and increased cache memory.
The review specifically tested the Platinum 8592+ from Intel’s Emerald Rapids family, equipped with various built-in accelerators designed for specific workloads. The Platinum 8592+ includes an AI accelerator, which contributed to its strong showing in AI workloads. The chip also features a simpler tile-based design compared to Sapphire Rapids, reducing latency issues and allowing for faster data movement, critical for AI tasks. Additionally, Emerald Rapids offers more than triple the L3 cache of Sapphire Rapids.
In the AI tests conducted by Tom’s Hardware, Intel’s chips surpassed AMD’s Genoa in seven out of nine tests, demonstrating their prowess in AI workloads. This is particularly noteworthy considering that AMD’s 96-core Genoa chip fell flat in all tests using the popular TensorFlow AI software.
However, it is essential to note that AMD still leads in general-purpose computing, while Intel aims to close the gap with the upcoming Granite Rapids, the successor to Emerald Rapids, expected in the first half of 2024. Granite Rapids is anticipated to have a significantly higher core count and will be built on the Intel 3 manufacturing process. Intel also plans to launch Sierra Forest, a server CPU family with weaker cores but an impressive 288 cores per chip.
While Emerald Rapids may not be a direct competitor to Genoa, its performance gains over Sapphire Rapids and wins against Genoa in various workloads position Intel favorably in the server CPU market. As AI workloads continue to expand, Emerald Rapids is expected to find a significant customer base seeking to accelerate inference tasks.
Overall, Intel’s Emerald Rapids has showcased remarkable advancements in AI workloads and has solidified its lead over AMD in this domain. As the market evolves, both Intel and AMD are gearing up with their respective next-generation chips to stay competitive and cater to the growing demand for server CPUs across various workloads.
