The Circuit

The podcast delves into the evolution of Computex, focusing on AI servers and data center components. AMD and Intel compete in AI chip production, while Qualcomm's Snapdragon leads in performance. Market challenges include accurate sizing and dominating presence of Nvidia. Discussions cover margin opportunities, ARM CPU expansion, and the significance of networking components in AI data centers.

With Special guests, Austin Lyons and Paul Karazuba! The conversation covers the topic of NPUs (Neural Processing Units) and delves into their architecture, performance, and relevance in the semiconductor industry. The discussion also addresses the use of tops per watt as a metric for NPU performance and the design origins of NPUs, including the use of licensed IP and the evolution from DSPs to NPUs. The conversation delves into the topic of NPUs (Neural Processing Units) and their integration into various devices. The speakers discuss the origins of NPUs, their design philosophy, and the potential impact on consumer devices. They also explore the role of NPUs in edge devices, AI PCs, and the future of consumer use cases for AI. The conversation concludes with predictions about the widespread adoption of NPUs and their potential impact on the market.

In this episode, Ben Bajarin and Jay Goldberg discuss the recent Google I/O event and the introduction of new TPUs and CPUs. They also explore the ARM architecture in the data center and the potential for switching between different ARM CPUs. Additionally, they touch on Qualcomm's launch of Windows on ARM and the significant adoption of Qualcomm SKUs by major OEMs. The conversation covers various topics including the dynamics in the PC space, Nvidia's earnings, and the 10-to-1 stock split. The main takeaways include the strong position of Windows in the PC ecosystem, the growth of Nvidia's data center networking business, and the potential impact of a dedicated inference chip. The conversation also discusses the competition in different parts of Nvidia's stack and the volatility that may come with the stock split.

In this episode of The Circuit, Ben Bajarin interviews Esam Elashmawi, Chief Strategy and Marketing Officer of Lattice, about the world of Field-Programmable Gate Arrays (FPGAs). They discuss the basics of FPGAs, their unique capabilities, and their pervasiveness across various applications. They also explore the advantages of FPGAs over Application-Specific Integrated Circuits (ASICs) and the flexibility they offer in terms of customization and reprogramming. Esam highlights the role of FPGAs in different markets, such as communications, computing, industrial, and automotive, and how Lattice differentiates itself in the FPGA market. They also touch on the challenges of building an FPGA company and the potential of FPGAs in AI applications, both in data centers and at the edge.

In this episode of The Circuit, Ben Bajarin and Jay Goldberg interview Aart de Geus, the executive chair and co-founder of Synopsys, about the semiconductor industry and the evolution of electronic design automation (EDA). They discuss the concept of EDA and how it allows designers to simulate and optimize circuits without physically building them. Aart de Geus highlights the shift from analog to digital design as a major inflection point in the industry. He also explains the role of EDA tools in automating the design process and the importance of functional correctness in chip design. The conversation then delves into the future of chip design, including the use of AI in EDA tools, the rise of chiplets and vertical stacking, and the increasing complexity of system-level design.

Industry analysts Ben Bajarin and Jay Goldberg delve into the latest trends in the semiconductor sector, analyzing data center performance, AI impact, Chinese market dynamics, PC super cycle potential, and outlook for automotive and industrial semiconductors. They focus on major players like Intel, AMD, Nvidia, Apple, Qualcomm, and NXP, discussing their earnings and market influences.

Ben Bajarin, a technology expert, and Jay Goldberg, a cloud investment commentator, dive deep into the soaring capex of cloud hyperscalers like Google and Amazon. They analyze the link between capex spending and revenue growth, spotlighting the hurdles in monetizing AI investments. The duo discusses the exciting potential of innovations in AI wearables, AR, and autonomous vehicles, while also contemplating the economic impact of these advancements. They emphasize the importance of clear consumer use cases and the deflationary effects on tech costs.

Episode SummaryThe recent downturn in semiconductor and AI-related stocks has sparked concerns about a bubble. The volatility in these stocks can be attributed to the unpredictability of retail investors and traders. The market is experiencing a correction, but it does not indicate a slowdown in AI. The hype around AI has been tempered by the realization that progress is slower than expected. The energy constraint is a topic of discussion, but improvements in hardware and software will continue to address this issue. The future of AI depends on the balance between compute power and energy efficiency.

This episode of The Circuit discusses the recent trend of companies developing their own custom CPUs and accelerators for AI workloads. Google, Amazon, and Microsoft have all announced their own custom chips, while Facebook and Marvell are also entering the custom chip market. The conversation also touches on the challenges and trade-offs of custom silicon, the impact on NVIDIA, and the difficulty of accurately sizing the AI market. The hosts highlight the uncertainty surrounding the future of AI outsourcing and the potential shift in the fortunes of the semiconductor and cloud industries.

SummaryIn this conversation, Ben Bajarin and Jay Goldberg discuss the recent Intel webinar on the foundry business and the financial breakout for Intel Foundry Services (IFS). They analyze the financial details, including the higher costs and lower margins than expected, and the potential for improvement in the future. They also discuss the impact of the CHIPS Act and the subsidies received by TSMC for their Arizona foundries. The conversation concludes with a discussion on Intel's progress under CEO Pat Gelsinger and the opportunities and challenges they face in the data center and AI markets.