The Data Stack Show

This episode is a re-air of one of our most popular conversations, featuring insights worth revisiting. This week on The Data Stack Show, John and Matt bring you another edition of the Cynical Data Guy. John and Matt dive into the evolution of customer data infrastructure, the growing influence of low-code tools like Clay, and the blurred lines around the “engineer” title in modern data roles. They also discuss the trade-offs between SaaS adoption and building custom solutions, the pitfalls of enterprise software buying, and the realities of platform lock-in—using Palantir’s unique business model as a case study. Key takeaways include the importance of simplicity and scalability in data engineering, the need for clear requirements when evaluating tools, and a healthy skepticism toward sales pitches and “art of the possible” features. Don’t miss this month’s Cynical Data Guy.  Highlights from this week’s conversation include: Reacting to the Rise of the GTM Engineer (1:11) Is "Engineer" the Right Term? (4:49) Low-Code Tools, AI, and Future Workflows (7:14) Simplicity in Data Engineering (14:38) The Pitfalls of "Simple" Solutions (15:18) Choosing SaaS vs. Building In-House (18:26) Business Process Abstraction and SaaS Adoption (21:31) Enterprise Software: Art of the Possible vs. Practicality (24:31) Sales Advice: Focus on Customer Needs (27:11) Forward Deployed Engineers and Delivery Models (29:05) Platform Lock-In: When Is It a Dirty Word? (36:41) Legacy Systems and the Reality of Lock-In (39:53) Final Thoughts and Takeaways (40:55) The Data Stack Show is a weekly podcast powered by RudderStack, customer data infrastructure that enables you to deliver real-time customer event data everywhere it’s needed to power smarter decisions and better customer experiences. Each week, we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data. RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com. Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Ben Rogojan, owner of Seattle Data Guy and data consultant who advises companies on analytics strategy and community building. He talks about how data teams must prove tangible value in tight budgets. Conversation covers AI’s impact, prioritizing high-impact work over vanity metrics, delivering minimal actionable outputs, and the skills needed to bridge data and business.

Barry McCardel, CEO and co-founder of Hex, shares his vast expertise in data tools and AI integration. He tackles the anxieties surrounding AI’s impact on job roles, emphasizing the shift from coding to strategic problem-solving. Barry discusses the benefits of embedding AI in workflows, enhancing team structures, and fostering innovation. He highlights the infinite demand for data insights and the necessity for organizations to adapt by leveraging AI-driven tools. Overall, he paints a picture of a rapidly evolving data landscape brimming with opportunity.

In this insightful discussion, Matt, known as the 'Cynical Data Guy', shares his experience with the evolution of AI, particularly GPT-5, noting its modest improvements and persistent issues. He delves into the risks of relying on tools, highlighting the need for control layers to mitigate AI hallucinations. The conversation addresses the ongoing debate of data warehouses versus agent-based approaches, and how understanding risk through poker can inform data teams. Matt also recommends reading fiction to enhance comprehension of human behavior in data work.

Pedram Navid, Chief Dashboard Officer at Dagster Labs, brings extensive experience in data engineering and DevRel. He dives into the synergy between DevRel and marketing, highlighting how understanding developers' learning styles can enhance outreach. Pedram explains data orchestration and its importance in automating workflows, contrasting task-based tools with Dagster's asset-based approach. He also shares insights on using open-source to build trust and discusses the impact of orchestration on team dynamics and AI workflows.

Paul Blankley, Founder and CTO of Zenlytic, shares his expertise on AI-driven business intelligence. He discusses how AI is evolving into context-aware analytics tools that enhance decision-making. Paul envisions AI acting as an 'employee,' tackling complex analytic tasks and thriving in both structured and unstructured data environments. They explore the convergence of these data types, the importance of governance, and the future of AI tools offering intelligent insights that transform business operations. It's a fascinating look at the next frontier of analytics!

Kostas Pardalis, an experienced data infrastructure engineer and founder of typedef, discusses his journey through data innovation. He explains how AI is transforming data workflows, condensing years of change into mere months. Kostas dives into the polarized reactions to AI's rise and reframes success in AI as exploratory rather than guaranteed. He highlights the limitations of AI copilots and the importance of reliable data systems. Finally, he shares insights on typedef, a platform that integrates LLM inference as a core component of data processes.

Ryan Dolley, VP of product strategy at GoodData and former playwriter, shares his unique journey into the world of business intelligence. He discusses the evolution of BI, emphasizing how storytelling connects data to real-world impact. The conversation dives into AI's transformative role in analytics and how it redefines data professional skills. Ryan suggests BI experts must adapt and learn coding to stay relevant, while addressing concerns about automation anxiety. He also highlights the significance of embedded analytics and capturing user intent through chat interfaces.

Viktor Kessler, co-founder of Vakamo and expert in lakehouse architecture, shares his insights on the evolution of data management. He discusses the transition from rigid data warehouses to flexible lakehouses, highlighting how Apache Iceberg enhances data governance and sharing. Viktor explores the idea of treating data as a product and the potential for AI-driven data exchanges. He also touches on the importance of decentralization, security concerns, and the future of data marketplaces, making the case for innovative, open-source solutions in the data economy.

Misha Laskin, Co-founder and CEO of ReflectionAI, shares his journey from theoretical physics to AI, highlighting insights from his time at DeepMind. He discusses the future of AI, emphasizing its potential to transform knowledge work and enhance human productivity. Misha explains the concepts of superhuman intelligence and artificial general intelligence (AGI), advocating for robust evaluation frameworks for AI success. He also dives into autonomous coding, discussing its challenges and the importance of automation in practical applications.