Kostas Pardalis, Co-Founder of typedef and seasoned data infrastructure expert, shares fascinating insights on the rapid evolution of AI in business. He discusses the hype vs. reality of AI, emphasizing practical innovation and the importance of making AI seamless in user experiences. Kostas dives into the challenges of integrating large language models into workflows and the necessity for robust data infrastructure. He highlights how AI can boost productivity without displacing jobs, showcasing a future where technology empowers rather than disrupts.
01:02:17
forum Ask episode
web_stories AI Snips
view_agenda Chapters
auto_awesome Transcript
info_circle Episode notes
insights INSIGHT
Legacy Data Tools Reflect Old Assumptions
Modern data infrastructure was built under BI-era assumptions focused on reporting and scale.
New use cases like ML and data-as-product demand different architectures and tooling.
insights INSIGHT
AI Disrupts Tech Workers Themselves
AI is unique because it threatens to disrupt the tech workforce itself, not just other industries.
That internal disruption fuels heightened polarization among engineers and technologists.
volunteer_activism ADVICE
Treat AI Work As Cheap, Iterative R&D
Expect many AI experiments to fail and treat them as R&D with learning value.
Keep experiments cheap and iterate quickly instead of committing huge one-time investments.
Get the Snipd Podcast app to discover more snips from this episode
This week on The Data Stack Show, Eric and John welcome back Kostas Pardalis, long-time co-host of the Data Stack Show and now Co-Founder of typedef. The group discusses the rapid evolution of AI and data infrastructure. The conversation also explores how AI is accelerating industry change, the challenges of integrating large language models (LLMs) into data workflows, and the limitations of current semantic layers. Kostas shares insights on building next-generation query engines, the importance of using familiar engineering paradigms, and the need to make AI seamless and almost invisible in user experiences. Key takeaways include the necessity of practical, incremental innovation, the reality behind AI hype, strategies for making advanced data tools accessible and reliable for engineers and businesses alike, and so much more.
Highlights from this week’s conversation include:
Kostas’s Background and Career Timeline (1:10)
Transition from RudderStack to Starburst Data (4:25)
AI Acceleration and Industry Impact (9:37)
AI Hype, Investment, and Polarized Reactions (12:05)
Historical Parallels and Tech Adoption (13:54)
AI Disrupting Tech Workers and Internal Drama (18:56)
Experimentation Phase and Future AI Applications (24:01)
Invisible AI and User Experience (28:21)
AI in Data Infrastructure and LLMs (34:24)
SQL, LLMs, and Engineering Solutions (36:35)
Standardization, Semantic Layers, and Data Modeling (41:01)
Introduction to typedef (45:49)
Productionizing AI Workloads with typedef (51:36)
Familiarity, Reliability, and Engineering Best Practices (57:24)
Security, Enterprise Concerns, and Open Source Models (1:00:48)
Final Thoughts and Takeaways (1:01:47)
The Data Stack Show is a weekly podcast powered by RudderStack, customer data infrastructure that enables you to deliver real-time customer event data everywhere it’s needed to power smarter decisions and better customer experiences. Each week, we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.
RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
The Data Stack Show