Balancing AI adoption with reliability

Enterprise customers demand 99.9% availability, regardless of how the underlying software is built. In this episode, Murali Swaminathan (CTO @ Freshworks) discusses how enterprises actually win with AI! We explore the “Architecture of Predictability” – proactive architectural safeguards to scale “responsible AI by design” across a global organization serving 75,000 customers. Murali shares his leadership playbook for implementing the technical safeguards and product trust controls that empower hundreds of engineers to build safely. We also dive into the shift from deterministic flowcharts to “workflows with a brain” and why backend systems engineers are the secret bedrock of agentic products. Plus, Murali deconstructs the dual evolution required of modern leaders: mastering strategic thinking at the business level while cultivating systems thinking at the engineering level.

ABOUT MURALI SWAMINATHAN

Murali Swaminathan joined Freshworks as Chief Technology Officer in September 2024. Murali is responsible for Freshworks’ technology roadmap and strategy, leading the company’s global engineering and architecture teams. With over 30 years of experience in software engineering, he has held leadership roles at ServiceNow, Recommind (now OpenText), and CA Technologies (now Broadcom), where he delivered scalable, secure solutions that enabled digital transformation and business agility. Murali holds a master’s degree in Software Engineering Management from Carnegie Mellon University and a bachelor’s degree in electronics and instrumentation from Annamalai University in India.

SHOW NOTES:

• Freshworks' operating context: Engineering for 75,000 global customers (2:09)
• Navigating the tension between rapid AI adoption and enterprise-grade reliability (4:58)
• Breaking the "Positive Scenario" Trap: Using AI to automate negative test cases and corner-case detection (6:40)
• Why Responsible AI is a competitive advantage: Building "kill switches" and trust gates (8:31)
• Responsible AI by Design: Moving from reactive compliance to proactive architectural safeguards (10:48)
• Technical safeguards: Leveraging hyperscaler frameworks for model compliance and data anonymization (13:39)
• Product Trust Controls: Demonstrating reliability through role-based access and thresholds (16:25)
• Why engineering leaders should experiment in small teams before global rollout (20:35)
• Simulating Chaos: Using Business Continuity Planning (BCP) to test AI system resilience (22:13)
• Workflows with a brain: Transitioning from deterministic flows to agentic runtime decisions (24:16)
• The AI Team Profile: Why backend system engineers, not just data scientists, are the bedrock of agentic products (29:25)
• Cultivating a mindset shift toward agentic system orchestration (32:10)
• The shift to systems thinking: How engineering roles evolve from "building pieces" to managing end-to-end system flows (33:38)
• How to approach strategic business thinking as an engineering leader (36:43)
• Rapid Fire Questions: Guy Kawasaki’s "Think Remarkable" and the best way to predict the future (38:23)

LINKS AND RESOURCES

• Think Remarkable: 9 Paths to Transform Your Life and Make a Difference - Tech titan and creator of the Remarkable People podcast Guy Kawasaki delivers a practical, tactical, and sometimes radical discussion of how to make a difference in the world and live a fulfilling life.

This episode wouldn’t have been possible without the help of our incredible production team:

Patrick Gallagher - Producer & Co-Host

Jerry Li - Co-Host

Noah Olberding - Associate Producer, Audio & Video Editor https://www.linkedin.com/in/noah-olberding/

Dan Overheim - Audio Engineer, Dan’s also an avid 3D printer - https://www.bnd3d.com/

Ellie Coggins Angus - Copywriter, Check out her other work at https://elliecoggins.com/about/

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.