Inferring race and ethnicity with LLMs

Move over Dr. Google, Dr. ChatGPT is here, and it's even worse as a medical intervention! Alex and Emily scrub in to slice up some harmful new nonsense in the world of "AI" for medicine. What's the cure for an expensive and inaccessible health care system? One thing's for sure — it's not AI hype.

References:

• "Stop Worrying, and Let A.I. Help Save Your Life"
• "Introducing ChatGPT Health"

Also referenced:

• "No, I don't want an AI scribe to write my pulmonologist’s note"
• "The Danger of Intimate Algorithms"
• MAIHT3k Episode 62: The Robo-Therapist Will See You Now (with Maggie Harrison Dupré)

Fresh AI Hell:

• Waymo files vague NHTSA report on crash that killed KitKat (See also: NHTSA Standing General Order on Crash Reporting)
• "Medical Schools Use AI Patients to Help With Clinical Training"
• "What If Your Coffee Mug Knew Your Next Move? AI Researchers Made It Happen"
• "Monkeys are on the loose in St. Louis and AI is complicating efforts to capture them"
• Using LLMs to "infer race, ethnicity"
• Tech CEOs hate ridicule as praxis!

Check out future streams on Twitch. Meanwhile, send us any AI Hell you see.

Our merch store is now live on the DAIR website!

Find our book, The AI Con, here.

Subscribe to our newsletter via Buttondown.

Follow us!

Emily

• Bluesky: emilymbender.bsky.social
• Mastodon: dair-community.social/@EmilyMBender

Alex

• Bluesky: alexhanna.bsky.social
• Mastodon: dair-community.social/@alex
• Twitter: @alexhanna

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Ozzy Llinas Goodman.