| 論文種別 | 原著(症例報告除く) |
| 言語種別 | 英語 |
| 査読の有無 | その他(不明) |
| 表題 | Exploratory Evaluation of Large Language Models for Reducing Language Bias in Systematic Review Screening. |
| 掲載誌名 | 正式名:Studies in health technology and informatics 略 称:Stud Health Technol Inform ISSNコード:18798365/09269630 |
| 掲載区分 | 国外 |
| 巻・号・頁 | 338,pp.130-134 |
| 著者・共著者 | Junki Ikeguchi, Hiroaki Ueshima, Hiroshi Tamura |
| 発行年月 | 2026/06 |
| 概要 | Language bias arises in systematic reviews when non-English studies are excluded owing to resource constraints. Large language models (LLMs) can mitigate this problem through multilingual processing. To assess whether direct multilingual LLM processing reduces language-based disparities in systematic review screening performance compared to translation-mediated approaches. Six state-of-the-art LLMs were evaluated under three conditions: (1) an English benchmark dataset (n = 2,911), (2) direct screening of non-English abstracts (n = 483), and (3) screening of machine-translated non-English abstracts. Performance was measured using sensitivity, specificity, F1 score, balanced accuracy, and workload reduction. All models achieved high sensitivity on English data (≥0.938). Translation-mediated screening substantially reduced sensitivity in some models (range: 0.47-0.54), whereas direct multilingual processing maintained high sensitivity (range: 0.71-1.00). Considerable differences were observed among models. Direct multilingual LLM screening may reduce language-related sensitivity disparities; however, the effects on downstream meta-analytic bias require further investigation. |
| DOI | 10.3233/SHTI260813 |
| PMID | 42393975 |