論文種別 原著(症例報告除く)
言語種別 英語
査読の有無 その他(不明)
表題 Exploratory Evaluation of Large Language Models for Reducing Language Bias in Systematic Review Screening.
掲載誌名 正式名:Studies in health technology and informatics
略  称:Stud Health Technol Inform
ISSNコード:18798365/09269630
掲載区分国外
巻・号・頁 338,pp.130-134
著者・共著者 Junki Ikeguchi, Hiroaki Ueshima, Hiroshi Tamura
発行年月 2026/06
概要 Language bias arises in systematic reviews when non-English studies are excluded owing to resource constraints. Large language models (LLMs) can mitigate this problem through multilingual processing. To assess whether direct multilingual LLM processing reduces language-based disparities in systematic review screening performance compared to translation-mediated approaches. Six state-of-the-art LLMs were evaluated under three conditions: (1) an English benchmark dataset (n = 2,911), (2) direct screening of non-English abstracts (n = 483), and (3) screening of machine-translated non-English abstracts. Performance was measured using sensitivity, specificity, F1 score, balanced accuracy, and workload reduction. All models achieved high sensitivity on English data (≥0.938). Translation-mediated screening substantially reduced sensitivity in some models (range: 0.47-0.54), whereas direct multilingual processing maintained high sensitivity (range: 0.71-1.00). Considerable differences were observed among models. Direct multilingual LLM screening may reduce language-related sensitivity disparities; however, the effects on downstream meta-analytic bias require further investigation.
DOI 10.3233/SHTI260813
PMID 42393975