Abstract
This study analyzes the results of six natural-language-processing geoparsing tools, using a set of 120 articles, to determine which would be most useful to incorporate into Journalmap.org, a scientific literature discovery tool. The evaluation of accurate locations was performed against a set of manually-verified geographic locations in the selected set of articles. Geoparser accuracy was determined by comparing the planar distance between the geoparser result and verified geographic locations. Parser-determined locations less than or equal to 161 km (100 mi) from the known geographic location were considered accurate. The tools tested in this study produced varying degrees of accuracy ranging from 20% to 65%. Libraries may use these tools for geographic indexing of literature or for similar discovery use cases, but emerging large language models (LLMs) appear ready to offer potentially improved results in the future.