Zeus Kerravala, ZK Research | theCUBE + NYSE Wired: AI Factories - Data Centers of the Future

In this episode of theCUBE + NYSE Wired's AI Factories – Data Centers of the Future series, Zeus Kerravala from ZK Research engages in an enlightening discussion with Dave Vellante. They explore the pivotal role of networking in AI factories, emphasizing how advancements in AI have shifted the paradigm of computing from isolated servers to interconnected data centers. Kerravala articulates key concepts such as scale-up, scale-out, and the integration of multi-data center fabrics, underscoring the necessity for robust networking solutions to facilitate seamless GPU clusters and edge data accessibility. He also evaluates the coexistence of InfiniBand and Ethernet as critical components of modern data center architectures and highlights pragmatic strategies for enterprises looking to optimize their AI frameworks.

Key Topics Covered:

• The evolving landscape of networking in AI factories.
• Redefinition of the “unit of compute” extending from servers to data center fabrics.
• Importance of validated, turnkey designs for enterprise AI implementations.
• Historical data center network utilization rates and implications for future upgrades.
• The role of power constraints and innovative solutions like co-packaged optics.
• Adopting a zero-trust security model in the context of AI workloads.
• The competitive landscape of networking vendors, including Cisco and NVIDIA.
• Closing insights for CIOs on managing increasing AI traffic and performance requirements.