top of page
Chelsea Tang
Jun 52 min read

Computex 2024: Intel Unveils Xeon 6 Processors, Gaudi 3 AI Accelerator

Intel is not one to back down from rival AMD.

Intel Xeon 6
Credits: Intel

The chip giant unveiled on Tuesday at Computex 2024 in Taipei, Taiwan the latest generation of Xeon processors, the Xeon 6, in what is shaping up to be a bid to regain the market share it lost to AMD in the data centre sector.


The Xeon 6 platform, as Intel touts, is built for modern data centre, networking and edge deployments. It gives customers choice with new P-core and E-core SKUs to accommodate a wide range of use cases and workloads, including high-performance computing and AI.


Two options are available: the efficiency-focused 6700 and the larger and more powerful 6900. The former offers up to 1.4x higher memory bandwidth and up to 1.1x increased in and out bandwidth versus the previous generation. The latter, on the other hand, offers up to 1.8x increased inter-socket bandwidth compared to the previous generation, allowing it to deliver greater performance gains, especially for demanding tasks.


Both options support CXL 2.0 Type 1, Type 2 and Type 3, making it easier for customers’ computers to connect and communicate with other components like accelerators and memory expanders, among other devices.


Intel further touts that the Xeon 6 platform with E-cores can give customers a 3.2x improvement in rack-level performance and a 2.6x increase in performance per watt compared to the second-generation Xeon on media transcode workloads. These improvements to efficiency should allow the processors to free up space for AI projects.


What’s more, the new processors with E-cores are optimised for network and edge workloads, capable of reaching up to 2.7x higher 5G-User Plane Function performance per watt and up to 3.5x higher next gen firewall performance per watt compared to the second-generation Xeon processors.


The E-core models, specifically the Intel Xeon 6700E, is available starting today, with the P-core models launching within the third quarter of 2024. Intel plans to release more E-core and P-core models in the first quarter of 2025.

Intel Gaudi 3
Credits: Intel

Alongside the Xeon 6, Intel also shared more details about the previously announced Gaudi 3 AI accelerator, which includes eight Matrix Math Engines. The enterprise chip additionally features 64 Tensor processor cores and 128GB of HBM2E with 3.7TB/s memory bandwidth. It also boasts a 15% faster training throughput for 64X LLAMA2-70B versus the Nvidia H100 and up to 40% faster time-to-train for 8192 cluster compared to the same chip.


Intel said the Gaudi 3 AI accelerator sells for about US$125,000, positioning it as a more cost-effective alternative to Nvidia’s H100 CHIPS, which cost upwards of US$300,000.

 

  • Intel at Computex 2024 unveiled the Xeon 6 platform, which are processors built for modern data centre, networking and edge deployments.

  • The E-core Xeon 6 models, specifically the Intel Xeon 6700E, is available starting today, with the P-core models launching within the third quarter of 2024.

  • Alongside the Xeon 6, Intel also shared more details about the previously announced Gaudi 3 AI accelerator, which includes eight Matrix Math Engines.

As technology advances and has a greater impact on our lives than ever before, being informed is the only way to keep up.  Through our product reviews and news articles, we want to be able to aid our readers in doing so. All of our reviews are carefully written, offer unique insights and critiques, and provide trustworthy recommendations. Our news stories are sourced from trustworthy sources, fact-checked by our team, and presented with the help of AI to make them easier to comprehend for our readers. If you notice any errors in our product reviews or news stories, please email us at editorial@tech360.tv.  Your input will be important in ensuring that our articles are accurate for all of our readers.

bottom of page