S6 E5 - Farhan Sheikh – Reducing Variation: Reimagining Quality in the Age of AI

I have a conversation with Farhan Sheikh in this episode. We dive deep into W. Edwards Deming’s System of Profound Knowledge and explore how its principles can be applied to modern software development and AI-assisted coding.

Farhan shares his unique journey from developer to QA leader, where he applied Deming’s philosophy, particularly variation, theory of knowledge, and systems thinking, to transform how teams approach quality. Rather than relying on inspection at the end, he emphasizes building quality into the process through better test design, tighter feedback loops, and collaboration between testers and developers.

A central theme is Farhan’s “Darmok” approach: using structured examples and test cases to guide AI systems like Claude, instead of relying heavily on prompts. By feeding AI consistent, well-sequenced patterns, he demonstrates how teams can reduce variation in AI-generated code and achieve more reliable outcomes. This mirrors Deming’s principles, controlling variation and improving systems rather than reacting to defects.

The conversation also explores the evolving role of QA. Farhan argues that testers, with their strength in asking critical questions and creating clear examples, are uniquely positioned to become key players in AI-driven development. This shift blurs traditional roles, pointing toward a new kind of multidisciplinary “AI producer” who integrates development, testing, and system-level thinking.

Psychology and leadership emerge as critical factors. Farhan candidly discusses overcoming fear within teams, aligning motivations through data and experimentation, and the importance of leaders enabling systemic change rather than reinforcing silos.

The episode concludes with a powerful reflection: true digital transformation isn’t about adopting AI tools in isolation, but about rethinking the entire system of work through Deming’s lens, focusing on quality, reducing variation, and empowering people to learn and adapt.

Notes:

Linked In: https://www.linkedin.com/in/farhan-sheikh-fivetwofoureight

Github: https://github.com/farhan5248

Website: https://specificationbyprompt.com