Medical College of Wisconsin
CTSICores SearchResearch InformaticsREDCap

Psychometric Properties of Computerized Cognitive Tools and Standard Neuropsychological Tests Used to Assess Sport Concussion: A Systematic Review. Neuropsychol Rev 2023 Dec;33(4):675-692

Date

08/31/2022

Pubmed ID

36040610

DOI

10.1007/s11065-022-09553-4

Scopus ID

2-s2.0-85137257452 (requires institutional sign-in at Scopus site)   2 Citations

Abstract

Athletic programs are more frequently turning to computerized cognitive tools in order to increase efficiencies in concussion assessment. However, assessment using a traditional neuropsychological test battery may provide a more comprehensive and individualized evaluation. Our goal was to inform sport clinicians of the best practices for concussion assessment through a systematic literature review describing the psychometric properties of standard neuropsychological tests and computerized tools. We conducted our search in relevant databases including Ovid Medline, Web of Science, PsycINFO, and Scopus. Journal articles were included if they evaluated psychometric properties (e.g., reliability, sensitivity) of a cognitive assessment within pure athlete samples (up to 30 days post-injury). Searches yielded 4,758 unique results. Ultimately, 103 articles met inclusion criteria, all of which focused on adolescent or young adult participants. Test-retest reliability estimates ranged from .14 to .93 for computerized tools and .02 to .95 for standard neuropsychological tests, with strongest correlations on processing speed tasks for both modalities, although processing speed tasks were most susceptible to practice effects. Reliability was improved with a 2-factor model (processing speed and memory) and by aggregating multiple baseline exams, yet remained below acceptable limits for some studies. Sensitivity to decreased cognitive performance within 72 h of injury ranged from 45%-93% for computerized tools and 18%-80% for standard neuropsychological test batteries. The method for classifying cognitive decline (normative comparison, reliable change indices, regression-based methods) affected sensitivity estimates. Combining computerized tools and standard neuropsychological tests with the strongest psychometric performance provides the greatest value in clinical assessment. To this end, future studies should evaluate the efficacy of hybrid test batteries comprised of top-performing measures from both modalities.

Author List

Wilmoth K, Brett BL, Emmert NA, Cook CM, Schaffert J, Caze T 2nd, Kotsonis T, Cusick M, Solomon G, Resch JE, Cullum CM, Nelson LD, McCrea M

Authors

Benjamin Brett PhD Assistant Professor in the Neurosurgery department at Medical College of Wisconsin
Michael McCrea PhD Professor in the Neurosurgery department at Medical College of Wisconsin
Lindsay D. Nelson PhD Associate Professor in the Neurosurgery department at Medical College of Wisconsin




MESH terms used to index this publication - Major topics in bold

Adolescent
Athletic Injuries
Brain Concussion
Cognition
Humans
Neuropsychological Tests
Psychometrics
Reproducibility of Results
Sports
Young Adult