Sid Sheth

In a captivating discussion, Sid Sheth, CEO and Co-Founder of d-Matrix, dives into how his startup is transforming AI inference. He highlights the significance of inference over training for the future of AI and how d-Matrix’s Corsair PCIe accelerator outshines NVIDIA's offerings. Sid explains the role of in-memory compute technologies, the shift towards heterogeneous AI infrastructure, and the global landscape of inference chips. With insights from his extensive semiconductor background, he reveals his vision for creating a formidable competitor to industry giants.

Parag Agrawal, former CEO of Twitter and now founder of Parallel Web Systems, shares insights on building AI web infrastructure and the future evolution of AI agents. Sid Sheth, CEO of d-Matrix, discusses their innovative inference chip challenging the GPU market, while Cory Weinberg reveals the boardroom turmoil at Grindr amid a takeover offer. The conversation also touches on Waymo's freeway expansion and its implications for autonomous vehicles, emphasizing the shift in public acceptance and safety perceptions.

Sid Sheth, founder and CEO of D‑Matrix, builds memory-centric AI inference hardware optimized for low-latency reasoning. He discusses SRAM-first accelerator designs, why HBM favors training not inference, digital in-memory compute to cut data movement, and trade-offs between latency and throughput. Practical deployment, software porting, and future multimodal/agentic inference trends are also covered.

In a dynamic conversation, Sid Sheth, Founder and CEO of d-Matrix, dives into the complexities of AI inference. He emphasizes that inference isn't a one-size-fits-all challenge and requires specialized hardware for different needs. Sid introduces d-Matrix's innovative modular platform, Corsair, designed to minimize memory-compute distance for faster performance. He also explores the parallels between human learning and AI deployment, and stresses the necessity for tailored infrastructure to enhance enterprise AI integration.

In this discussion, Sid Sheth, CEO and co-founder of d-Matrix, shares insights from his extensive semiconductor experience. He emphasizes that AI inference represents a transformative opportunity, driving productivity unlike any previous tech shift. Sid explains how more efficient, smaller models are key to AI's scalability and why a talent shortage could impede progress. He also discusses the need for purpose-built AI chips and highlights D-Matrix's innovative approach to integrating into existing data centers.