The OCP Summit 2025 showcased a hidden gem: Intel's edge AI demo, powered by the Intel Xeon 6 SoC and Dell PowerEdge XR8720t. But wait, there's more to this story than meets the eye!
A Sneak Peek at the Cutting Edge:
Intel's demo was a live showcase of edge AI capabilities, featuring the Dell PowerEdge XR8720t server. This compact 2U platform accommodates two nodes, and at the summit, it ran multiple demos solely on the CPU, without any GPU acceleration.
The Power of Visuals:
The booth was adorned with cameras, including one on the Xeon 6 SoC, capturing the essence of the demo. These cameras simulated a retail environment, showcasing the system's prowess in video analytics and AI inference.
Controversial CPU vs. GPU Debate:
Here's where it gets controversial. The Intel Xeon 6 SoC boasts built-in inference acceleration and up to 72 cores, but it's not about outperforming GPUs. The focus was on demonstrating that CPU inference can be 'good enough' for certain tasks. While some algorithms utilize VNNI and AMX, others stick to AVX2, highlighting the diversity in AI workloads.
Dell's Expansion Options:
The Dell PowerEdge XR8720t offers flexibility with its ability to house two Intel Xeon 6 SoC nodes and various expansion options, including GPUs. However, at OCP 2025, Dell opted for the Intel E830-XXVDA8F, a dual SFF card with 8x 25GbE ports per card. This configuration provides a whopping 16 ports, excluding the Xeon 6 SoC ports.
A Server's Surprising Port Count:
Imagine a server with 24x 25GbE ports! It's not a switch but a server, and it's a sight to behold. This setup was a highlight for those in the know.
Honorable Mentions:
The UNEEC Edge-MHs system and Foxconn's Boulder Mesa platform also made an appearance, both utilizing the Intel E830-XXVDA8F in DSFF card slots. These platforms often find customers before they're even produced, making them intriguing booth attractions.
The Takeaway:
This demo was a reminder that AI isn't just about GPUs and accelerators. It highlighted the often-overlooked fact that CPUs have been powering edge video analytics and similar applications for generations. The new Xeon 6 SoC's built-in media accelerator is a testament to this, catering to the unique demands of these applications.
This unique use case, combining Xeon-D and innovative network cards, is a fascinating glimpse into the world of AI hardware. What do you think about the CPU's role in AI inference? Is it time to rethink our GPU-centric mindset?
