A taxonomy of bias: sensemaking, heretical physics, and the Tom Hanks/Bill Murray multiverse

<p>Bias has a pretty well-known definition in the world of AI/ML programming. But today’s paper asks us to expand that definition and consider how cultural, organizational, and human forces can intersect with development. The authors of “Identifying and Categorizing Bias in AI/ML for Earth Sciences” argue that, beyond considering bias and before mitigating bias, developers ought to be able to identify bias in all its modes &amp; forms. Their taxonomy of bias is helpful, and inspired us to create an actionable check list of our own.</p> <hr> <h2>Paper</h2> <p><strong><a href="https://journals.ametsoc.org/view/journals/bams/105/3/BAMS-D-23-0196.1.xml">Identifying and Categorizing Bias in AI/ML for Earth Sciences</a></strong>, McGovern et al</p> <hr> <h2>Chapters</h2> <ul> <li><strong>00:00:03</strong> - Intro</li> <li><strong>00:02:39</strong> - Abstract</li> <li><strong>00:03:33</strong> - Discussion of framing</li> <li><strong>00:09:03</strong> - A taxonomy of bias 09:03</li> <li><strong>00:47:52</strong> - Our proposed check list for mitigating bias</li> <li><strong>01:08:14</strong> - Reading recs</li> </ul> <hr> <p><strong>A check list for mitigating bias (in developing AI or for really any kind of technological development)</strong></p> <ul> <li>Use the language of “bias”, acknowledging both social and technical bias</li> <li>Define your specific user and use case early</li> <li>Establish a clear baseline for comparison</li> <li>Ensure diversity of perspectives on your team</li> <li>Practice reflexivity (question your assumptions, and continue that line of questioning throughout the development process.)</li> <li>Examine your incentives vs. end-user incentives</li> <li>Prioritize transparency (in your decision-making and in your incentives &amp; goals.)</li> </ul> <p><strong>Recommended reading</strong></p> <ul> <li><a href="https://backup.ai2es.org/">AI2ES Newsletter</a></li> <li><em>Groundhog Day</em> (film <em>AND</em> musical theater adaptation)</li> <li><a href="https://sociology.sas.upenn.edu/sites/default/files/Weber-Science-as-a-Vocation.pdf">“Science as a Vocation</a>” by Max Weber</li> <li><em>Book of the New Sun</em> by Gene Wolfe (four-book series)</li> <li><em>Infinite Powers</em> by Steven Strogatz</li> </ul>