article · Nature · 2026
Synthesizing scientific literature with retrieval-augmented language models
Akari Asai, Jacqueline He, Rulin Shao, Weijia Shi, Amanpreet Singh, Joseph Chee Chang, Kyle Shih-Huang Lo, Luca Soldaini, Sergey Feldman, Mike D’Arcy, David Wadden, Matt Latzke, Jenna Sparks, Jena D. Hwang, Varsha Kishore, Minyang Tian, Pan Ji, Shengyan Liu, Hao Tong, Bohao Wu, Yanyu Xiong, Luke Zettlemoyer, Graham Neubig, Daniel S. Weld, Doug Downey, Wen-tau Yih, Pang Wei Koh, Hannaneh Hajishirzi
Cited by 4Open access
Abstract
Scientific progress depends on the ability of researchers to synthesize the growing body of literature. Can large language models (LLMs) assist scientists in this task? Here we introduce OpenScholar, a specialized retrieval-augmented language model (LM)<sup>1</sup> that answers scientific queries by identifying relevant passages from 45 million open-access papers and synthesizing citation-backed responses. To evaluate OpenScholar, we develop ScholarQABench, the first large-scale multi-domain benchmark for literature search, comprising 2,967 expert-written queries and 208 long-form answers across computer science, physics, neuroscience and biomedicine. Despite being a smaller open model, OpenScholar-8B outperforms GPT-4o by 6.1% and PaperQA2 by 5.5% in correctness on a challenging multi-paper synthesis task from the new ScholarQABench. Although GPT-4o hallucinates citations 78-90% of the time, OpenScholar achieves citation accuracy on par with human experts. OpenScholar's data store, retriever and self-feedback inference loop improve off-the-shelf LMs: for instance, OpenScholar-GPT-4o improves the correctness of GPT-4o by 12%. In human evaluations, experts preferred OpenScholar-8B and OpenScholar-GPT-4o responses over expert-written ones 51% and 70% of the time, respectively, compared with 32% for GPT-4o. We open-source all artefacts, including our code, models, data store, datasets and a public demo.
Cite this paper
Asai, A., He, J., Shao, R., Shi, W., Singh, A., Chang, J. C., Lo, K. S.-H., Soldaini, L., Feldman, S., D’Arcy, M., Wadden, D., Latzke, M., Sparks, J., Hwang, J. D., Kishore, V., Tian, M., Ji, P., Liu, S., Tong, H., . . . Hajishirzi, H. (2026). Synthesizing scientific literature with retrieval-augmented language models. Nature, 650(8103), 857–863. https://doi.org/10.1038/s41586-025-10072-4
Asai, Akari, et al. “Synthesizing scientific literature with retrieval-augmented language models.” Nature, vol. 650, no. 8103, 2026, pp. 857–63, https://doi.org/10.1038/s41586-025-10072-4.
Asai, Akari, Jacqueline He, Rulin Shao, Weijia Shi, Amanpreet Singh, Joseph Chee Chang, Kyle Shih-Huang Lo, et al. 2026. “Synthesizing scientific literature with retrieval-augmented language models.” Nature 650 (8103): 857–63. https://doi.org/10.1038/s41586-025-10072-4.
Asai, A. et al. (2026) ‘Synthesizing scientific literature with retrieval-augmented language models’, Nature, 650(8103), pp. 857–863. Available at: https://doi.org/10.1038/s41586-025-10072-4.
@article{asai2026synthesizing,
title = {{Synthesizing scientific literature with retrieval-augmented language models}},
author = {Asai, Akari and He, Jacqueline and Shao, Rulin and Shi, Weijia and Singh, Amanpreet and Chang, Joseph Chee and Lo, Kyle Shih-Huang and Soldaini, Luca and Feldman, Sergey and D’Arcy, Mike and Wadden, David and Latzke, Matt and Sparks, Jenna and Hwang, Jena D. and Kishore, Varsha and Tian, Minyang and Ji, Pan and Liu, Shengyan and Tong, Hao and Wu, Bohao and Xiong, Yanyu and Zettlemoyer, Luke and Neubig, Graham and Weld, Daniel S. and Downey, Doug and Yih, Wen-tau and Koh, Pang Wei and Hajishirzi, Hannaneh},
journal = {Nature},
volume = {650},
number = {8103},
pages = {857--863},
year = {2026},
doi = {10.1038/s41586-025-10072-4}
}Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.