This interview was recorded for GOTO Unscripted.
https://gotopia.tech
Check out more here:
https://gotopia.tech/articles/412
Andrew Lamb - Staff Engineer at InfluxData, ASF Member & PMC Apache DataFusion & Apache Arrow
Olimpiu Pop - Technologist & Tech Journalist
RESOURCES
Andrew
https://bsky.app/profile/andrewlamb1111.bsky.social
https://x.com/andrewlamb1111
https://github.com/alamb
https://www.linkedin.com/in/andrewalamb
https://andrew.nerdnetworks.org
Olimpiu
https://x.com/olimpiupop
https://github.com/zroll
https://www.linkedin.com/in/olimpiupop
Links
https://www.influxdata.com/blog/flight-datafusion-arrow-parquet-fdap-architecture-influxdb
https://www.cidrdb.org/cidr2005/papers/P19.pdf
DESCRIPTION
Olimpiu Pop speaks with Andrew Lamb, staff engineer at InfluxData and PMC member of Apache DataFusion and Apache Arrow, about how modern data systems are built using standardized open source components rather than being developed from scratch.
Andrew discusses the FDAP Stack (Flight, DataFusion, Arrow & Parquet), the shift from row-based to columnar data storage, and how technologies like Apache Iceberg are enabling a new era of interoperability across data platforms. The discussion covers why this modular approach saves years of development time while providing better performance and compatibility.
RECOMMENDED BOOKS
Kasun Indrasiri & Danesh Kuruppu • gRPC: Up and Running • https://amzn.to/3sBGBJJ
Tomer Shiran, Jason Hughes & Alex Merced • Apache Iceberg: The Definitive Guide • https://amzn.to/488Z30k
William Smith • Arrow Flight Protocols and Practices • https://amzn.to/4o2Q2fd
Matthew Topol • In-Memory Analytics with Apache Arrow • https://amzn.to/4oJQ6BM
Apache Parquet A Complete Guide • https://amzn.to/4i7HVN6
Bluesky
Instagram
LinkedIn
Facebook
CHANNEL MEMBERSHIP BONUS
Join this channel to get early access to videos & other perks:
https://www.youtube.com/channel/UCs_tLP3AiwYKwdUHpltJPuA/join
Looking for a unique learning experience?
Attend the next GOTO conference near you! Get your ticket: gotopia.tech
SUBSCRIBE TO OUR YOUTUBE CHANNEL - new videos posted daily!
