PRISM: Patient Records Interpretation for Semantic clinical trial Matching system using large language models. NPJ Digit Med 2024 Oct 28;7(1):305
Date
10/29/2024Pubmed ID
39468259Pubmed Central ID
PMC11519882DOI
10.1038/s41746-024-01274-7Scopus ID
2-s2.0-85208118725 (requires institutional sign-in at Scopus site) 15 CitationsAbstract
Clinical trial matching is the task of identifying trials for which patients may be eligible. Typically, this task is labor-intensive and requires detailed verification of patient electronic health records (EHRs) against the stringent inclusion and exclusion criteria of clinical trials. This process also results in many patients missing out on potential therapeutic options. Recent advancements in Large Language Models (LLMs) have made automating patient-trial matching possible, as shown in multiple concurrent research studies. However, the current approaches are confined to constrained, often synthetic, datasets that do not adequately mirror the complexities encountered in real-world medical data. In this study, we present an end-to-end large-scale empirical evaluation of a clinical trial matching system and validate it using real-world EHRs. We perform comprehensive experiments with proprietary LLMs and our custom fine-tuned model called OncoLLM and show that OncoLLM outperforms GPT-3.5 and matches the performance of qualified medical doctors for clinical trial matching.
Author List
Gupta S, Basu A, Nievas M, Thomas J, Wolfrath N, Ramamurthi A, Taylor B, Kothari AN, Schwind R, Miller TM, Nadaf-Rahrov S, Wang Y, Singh HAuthors
Anai N. Kothari MD Assistant Professor in the Surgery department at Medical College of WisconsinBradley W. Taylor Chief Research Informatics Officer in the Clinical and Translational Science Institute department at Medical College of Wisconsin
