Crazy Wisdom

Episode #495: The Black Box Mind: Prompting as a New Human Art

Oct 6, 2025
Jared Zoneraich, CEO of PromptLayer, delves into the evolving art of AI engineering. He discusses how PromptLayer serves as a workbench for testing LLM products and the tension between implicit and explicit knowledge in AI. The conversation explores the complexities of prompt evaluation, distinguishing between deterministic and probabilistic systems. They also touch on 'vibe coding', which emphasizes the influence of syntax and tone on AI outputs, and how this approach could reshape coding education and practices.
Ask episode
AI Snips
Chapters
Books
Transcript
Episode notes
ADVICE

Fix Prompt Bugs With Short Sprints

  • Use sprint-style iterations for practical prompt fixes: bootstrap recent production cases and iterate quickly.
  • Run multiple models and focus on hard disagreement cases to build a regression set.
INSIGHT

Versioning, Evals, Observability Trio

  • PromptLayer's three pillars are prompt/agent versioning, evals, and observability.
  • Logging every request enables replay, backtesting, and debugging in probabilistic systems.
INSIGHT

Control Inputs, Not Neurons

  • Treat large models as black-box input→output systems and focus on controlling inputs.
  • You don't have to understand neural internals to build reliable user-facing behavior.
Get the Snipd Podcast app to discover more snips from this episode
Get the app