The highly anticipated GTC developer conference of AI chip giant Nvidia is about to be held, and the global trend of AI computing power is receiving attention.
As UK chip architecture company Arm continues to focus on the server market and recently updated its product roadmap for the Arm Neoverse series of server processors, two new Arm Neoverse computing subsystems (CSS) based on the all-new third-generation Neoverse IP have been launched. The outside world will also have a glimpse of the next generation of AI "super chips" that integrate CPUs and GPUs, and whether Nvidia will follow suit will also be closely monitored.
Neoverse is a server processor brand launched by Arm in 2018 for the data center market. Under Arm's planning, Neoverse's N series, V series, and E series each have their own positioning. For example, the V series emphasizes performance first and is used in the high-end server market. The previous generation Neoverse V2 was used in Nvidia's AI chip design.
Last March, Nvidia launched its first "Grace Hopper" GH200 superchip that combines CPU and GPU packaging. "Grace" refers to Nvidia's data center Arm CPU series released in April 2021, while "Hopper" refers to Nvidia's latest architecture GPU production model H100.
A chip industry investor told Interface News that Nvidia's Grace Hopper chip combines CPUs with top AI training products (GPUs) to create a "super chip" and jointly build a complete AI solution.
GH200 can be used for AI training and inference, and Nvidia significantly improves data transmission efficiency between CPUs and GPUs by packaging one CPU and one H100 GPU into a single chip. In November of the same year, Nvidia upgraded the GH200 again, upgrading the 96GB capacity HBM3 memory equipped on the GPU in the GH200 to 144GB HBM3e, significantly improving data transmission efficiency once again.
In the process of Nvidia seizing the AI wave with its GPU products, Arm also benefits from Nvidia's strong position in AI computing, which means that the data center market may adopt more processors based on Arm technology.
Mohammed Awad, General Manager of Arm's Infrastructure Business Unit, explained to Interface News that Nvidia's previously launched Grace Hopper Superchip has redesigned the system architecture. In the past, data centers used a single CPU to manage multiple GPUs, while Grace Hopper chips have been transformed to correspond to only one GPU per CPU. "More CPUs mean memory consistency, which ultimately greatly improves GPU utilization."
Arm stated that as the industry's demand for AI computing power gradually shifts from training
