Build vs. buy and ML infra choices

In our latest ELC episode, we are addressing some of the biggest challenges facing engineers today: identifying your scaling thesis, putting that thesis into practice, and addressing implementation challenges. Jaikumar Ganesh, Head of Engineering @ Anyscale, shares insights from his experience working at top tech companies like Android and Uber, and how to apply those lessons within your own orgs. We also cover strategies for identifying what to build, using data effectively when it comes to understanding AI agents, and keeping your intent (and customer success) top of mind. Additionally, Jaikumar discusses his experience as a GM and why all orgs should adopt cross-functional skillsets as part of their company culture.

ABOUT JAIKUMAR GANESH

Jaikumar Ganesh is an accomplished technology leader and the Head of Engineering at Anyscale. With a deep background in engineering and customer-facing roles, Jaikumar has a proven track record of building and scaling engineering organizations. He is passionate about pushing the boundaries of product and engineering innovation while ensuring customer needs are met, and is committed to building empowering organizations rooted in trust, respect, and growth. Jaikumar is excited about working with companies to harness the power of AI and distributed computing to achieve their goals. He previously co-started and co-led Uber's AI group—the central ML group at Uber—and was also on the early team at Android @ Google.

This episode is brought to you by Retool!

What happens when your team can't keep up with internal tool requests? Teams start building their own, Shadow IT spreads across the org, and six months later you're untangling the mess…

Retool gives teams a better way: governed, secure, and no cleanup required.

Retool is the leading enterprise AppGen platform, powering how the world's most innovative companies build the tools that run their business. Over 10,000 organizations including Amazon, Stripe, Adobe, Brex, and Orangetheory Fitness use the platform to safely harness AI and their enterprise data to create governed, production-ready apps.

Learn more at Retool.com/elc

SHOW NOTES:

• Reflecting on scaling patterns across the 2000s, 2010s, and the AI era (03:27)
• Why "copy-pasting" scaling strategies from other companies leads to failure (5:56)
• How to define a scaling thesis by mapping revenue projections to infrastructure strategy (7:52)
• Infrastructure shifts: From Android’s OS abstractions to Uber’s on-prem data centers (9:56)
• The "Build vs. Buy" dilemma in the age of AI agents and third-party solutions (12:09)
• Why "Knowing What to Build" is the new long pole in engineering productivity (20:17)
• Developing "Product Thinking" within engineering and infrastructure teams (23:10)
• The emergence of Context Graphs and "Source of Truth" platforms for AI agents (24:46)
• How to avoid data & context graphs becoming bottlenecks (27:05)
• Lessons from GM leadership: Bridging the gap between engineering, product, and sales (29:06)
• The "6-20" Initiative: Uniting cross-functional teams around specific customer wins (32:45)
• Training engineers to empathize with customer pain and translate technical wins into the language of sales (33:48)
• Utilizing cross-departmental daily standups and leaderboards to drive aggressive "block and tackle" execution (36:18)
• Tracing execution failures back to early decision-making and judgment gaps (38:42)
• Rapid fire questions (45:28)

This episode wouldn’t have been possible without the help of our incredible production team:

Patrick Gallagher - Producer & Co-Host

Jerry Li - Co-Host

Noah Olberding - Associate Producer, Audio & Video Editor https://www.linkedin.com/in/noah-olberding/

Dan Overheim - Audio Engineer, Dan’s also an avid 3D printer - https://www.bnd3d.com/

Ellie Coggins Angus - Copywriter, Check out her other work at https://elliecoggins.com/about/

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.