A recent study by Virginia Tech researchers uncovered potential geographic bias in ChatGPT, an advanced artificial intelligence (AI) tool. The study, which focused on environmental justice issues, found significant differences in ChatGPT’s ability to provide location-specific information across counties. This finding highlights a critical challenge in developing AI tools: ensuring equitable access to information regardless of geographic location.
Limitations of ChatGPT in small rural areas
The study, published in the journal Telematics and Informatics, utilized a comprehensive approach that included a list of 3,108 counties in the contiguous United States. Researchers asked ChatGPT about environmental justice issues in each county. We found that this methodology allows ChatGPT to effectively provide detailed information for densely populated areas, but struggles for small, rural areas. For example, in states with large urban populations like California and Delaware, less than 1% of the population lived in counties for which ChatGPT could not provide specific information. Conversely, in rural areas like Idaho and New Hampshire, more than 90% of the population lived in counties where ChatGPT did not provide localized information.
Implications and future directions
These differences highlight important limitations of current AI models in addressing the nuanced needs of diverse geographic locations. Assistant Professor Jeonghwan Kim, a geographer and geospatial data scientist at Virginia Tech, emphasizes the need for further investigation into these limitations. He points out that recognizing potential bias is essential for future AI development. Assistant Professor Ismini Lourentzou, co-author of the study, proposes improving localized and context-based knowledge in large-scale language models such as ChatGPT. She also emphasizes the importance of protecting these models from ambiguous scenarios and increasing user awareness of their strengths and weaknesses.
This study not only confirms existing geographic biases in ChatGPT, but also serves as a call to action for AI developers. Particularly in the context of sensitive topics such as environmental justice, improving the reliability and resilience of large-scale language models is essential. The findings of Virginia Tech researchers pave the way for more inclusive and equitable AI tools that can serve diverse populations with diverse needs.
Image source: Shutterstock