
weathering A taxonomy of bias: sensemaking, heretical physics, and the Tom Hanks/Bill Murray multiverse
Nov 25, 2025
00:00
<p>Bias has a pretty well-known definition in the world of AI/ML programming. But today’s paper asks us to expand that definition and consider how cultural, organizational, and human forces can intersect with development. The authors of “Identifying and Categorizing Bias in AI/ML for Earth Sciences” argue that, beyond considering bias and before mitigating bias, developers ought to be able to identify bias in all its modes & forms. Their taxonomy of bias is helpful, and inspired us to create an actionable check list of our own.</p>
<hr>
<h2>Paper</h2>
<p><strong><a href="https://journals.ametsoc.org/view/journals/bams/105/3/BAMS-D-23-0196.1.xml">Identifying and Categorizing Bias in AI/ML for Earth Sciences</a></strong>, McGovern et al</p>
<hr>
<h2>Chapters</h2>
<ul>
<li><strong>00:00:03</strong> - Intro</li>
<li><strong>00:02:39</strong> - Abstract</li>
<li><strong>00:03:33</strong> - Discussion of framing</li>
<li><strong>00:09:03</strong> - A taxonomy of bias 09:03</li>
<li><strong>00:47:52</strong> - Our proposed check list for mitigating bias</li>
<li><strong>01:08:14</strong> - Reading recs</li>
</ul>
<hr>
<p><strong>A check list for mitigating bias (in developing AI or for really any kind of technological development)</strong></p>
<ul>
<li>Use the language of “bias”, acknowledging both social and technical bias</li>
<li>Define your specific user and use case early</li>
<li>Establish a clear baseline for comparison</li>
<li>Ensure diversity of perspectives on your team</li>
<li>Practice reflexivity (question your assumptions, and continue that line of questioning throughout the development process.)</li>
<li>Examine your incentives vs. end-user incentives</li>
<li>Prioritize transparency (in your decision-making and in your incentives & goals.)</li>
</ul>
<p><strong>Recommended reading</strong></p>
<ul>
<li><a href="https://backup.ai2es.org/">AI2ES Newsletter</a></li>
<li><em>Groundhog Day</em> (film <em>AND</em> musical theater adaptation)</li>
<li><a href="https://sociology.sas.upenn.edu/sites/default/files/Weber-Science-as-a-Vocation.pdf">“Science as a Vocation</a>” by Max Weber</li>
<li><em>Book of the New Sun</em> by Gene Wolfe (four-book series)</li>
<li><em>Infinite Powers</em> by Steven Strogatz</li>
</ul>
