Guardrails for generative AI and hallucination risks

Ray Brescia joins The Geek in Review this week to unpack a role with peak academia vibes, Associate Dean for Research and Intellectual Life at Albany Law School. Greg frames the title as “Chief Curator of Smart People Ideas,” and Ray embraces a “player-coach” approach, coaching faculty scholarship, unblocking stalled projects, and connecting peers across disciplines. The throughline is community, research momentum, and a practical view of how ideas move from draft to impact.

The conversation then pivots to the core thesis of Ray’s book, Lawyer 3.0. Ray maps the legal profession across three eras: Lawyer 1.0 as a low-barrier “amorphous bar,” Lawyer 2.0 as the institutional buildout of law schools, bar exams, ethics codes, and modern law firms, and Lawyer 3.0 as the next inflection point driven by technology. Ray ties prior shifts to urbanization, immigration, and industrial-scale commerce, then parallels those forces with today’s generative AI and analytics reshaping research, drafting, discovery, and service delivery.

Ray retells the famous milkshake study, then translates the idea into legal services: clients are not shopping for “a lawyer,” clients are shopping for problem resolution. This reframing pushes law firms to examine intake, scoping, and service design through the lens of client outcomes, business problems, and life problems, not internal practice labels. The milkshake becomes a metaphor for product-market fit in law, with fewer crumbs on the steering wheel.

Ray contrasts “bespoke services” with productized pathways, including a Model T style offering that meets most client needs at lower cost, plus higher-cost custom work when risk or complexity demands. Ray highlights expert-system style workflows such as Citizenshipworks, describing a TurboTax-like experience for straightforward matters, with “red flags” triggering referral to a lawyer. The same logic extends to limited scope representation and “lawyer for the day” programs in high-volume courts, where informed consent, reasonable scope, and “first, do no harm” reduce the chance of clients feeling abandoned midstream.

The final stretch tackles law firm AI adoption, hallucination risk, and professional responsibility. Ray stresses minimum competence: verify cases, verify quotations, verify sources, and treat generative outputs as drafts or starting points, not final work product. The panel discusses guardrails, education, and workflow design for large firms, plus the rising reality of clients arriving with AI-generated “research.” Ray’s crystal ball points toward more commoditized legal services at scale, a latent market of underserved people, and stronger interdisciplinary collaboration between lawyers and technologists so legal education aligns with Lawyer 3.0 realities.

Listen on mobile platforms:  ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Apple Podcasts⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ |  ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Spotify⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ | ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠YouTube⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ | Substack

[Special Thanks to ⁠Legal Technology Hub⁠ for their sponsoring this episode.]

⁠⁠⁠⁠⁠Email: geekinreviewpodcast@gmail.com
Music: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Jerry David DeCicca⁠⁠⁠⁠⁠⁠⁠⁠⁠

Transcript