Sid Sheth, Founder, d-Matrix | theCUBE + NYSE Wired: AI Factories - Data Centers of the Future

In this episode of theCUBE + NYSE Wired, host Dave Vellante sits down with Sid Sheth, Founder and CEO of d-Matrix, to discuss the emerging trends in AI factories and their pivotal role in the future of data centers. Sheth highlights that 2025 heralds the 'age of inference,' a significant shift from traditional training towards scalable deployment. This transformation is characterized by enhanced efficiency, performance-per-watt, and cost efficiency, which are now determining factors for success in the industry. The conversation emphasizes the increasing demand for inferencing capabilities, expected to surpass training by a factor of 10 to 100. Data centers are evolving, with some enterprises turning towards mega training factories while many others adopt distributed inference models. Sheth also introduces key innovations from d-Matrix, such as the Corsair platform and JetStream I/O accelerator, designed to optimize performance and user experience. This episode serves as a vital resource for understanding how enterprises can adapt their infrastructure to capitalize on emerging AI advancements.

Key Topics Covered:

• The significance of 2025 as the "age of inference."
• The impact of the DeepSeek moment on AI model deployment.
• The projected demand for inferencing relative to training.
• d-Matrix's Corsair platform and its architecture innovations.
• The JetStream I/O accelerator's role in enhancing performance.
• Vertical integration and its benefits for AI infrastructure.
• The collaborative approach to augment existing data center models.
• The future landscape of training and inference in data centers.