Medical College of Wisconsin
CTSICores SearchResearch InformaticsREDCap

Eye of the beholder: Risk calculators and barriers to adoption in surgical trainees. Surgery 2018 Nov;164(5):1117-1123

Date

08/29/2018

Pubmed ID

30149939

Pubmed Central ID

PMC8383120

DOI

10.1016/j.surg.2018.07.002

Scopus ID

2-s2.0-85052232880 (requires institutional sign-in at Scopus site)   21 Citations

Abstract

BACKGROUND: Accurate risk assessment before surgery is complex and hampered by behavioral factors. Underutilized risk-based decision-support tools may counteract these barriers. The purpose of this study was to identify perceptions of and barriers to the use of surgical risk-assessment tools and assess the importance of data framing as a barrier to adoption in surgical trainees.

METHODS: We distributed a survey and risk assessment activity to surgical trainees at four training institutions. The primary outcomes of this study were descriptive risk assessment practices currently performed by residents, identifiable influences and obstacles to adoption, and the variability of preference sets when comparing modified System Usability Scores of a current risk calculator to a purpose-built calculator revision. Risk calculator comparison responses were compared with simple and multivariable regression to identify predictors for preferentiality.

RESULTS: We collected responses from 124 surgical residents (39% response rate). Participants endorsed familiarity with direct verbal communication (100%), sketch diagrams (87%), and brochures (59%). The most contemporary risk communication frameworks, such as best-worst case scenario framing (38%), case-specific risk calculators (43%), and all-procedure calculators (52%) were the least familiar. Usage favored traditional models of communication with only 26% of residents regularly using a strategy other than direct verbal discussion or anatomic sketch diagrams. Barriers limiting routine use included lack of electronic and clinical workflow integration. The mean modified System Usability Scores domain scores were widely dispersed for all domains, and no domain demonstrated one calculator's superiority over another.

CONCLUSION: Risk assessment tools are underutilized by trainees. Of importance, preference sets of clinicians appear to be unpredictable and may benefit more from a customizable, bespoke approach.

Author List

Leeds IL, Rosenblum AJ, Wise PE, Watkins AC, Goldblatt MI, Haut ER, Efron JE, Johnston FM

Author

Matthew I. Goldblatt MD Professor in the Surgery department at Medical College of Wisconsin




MESH terms used to index this publication - Major topics in bold

Adult
Clinical Competence
Clinical Decision-Making
Decision Support Techniques
Female
General Surgery
Humans
Internship and Residency
Male
Postoperative Complications
Preoperative Care
Risk Assessment
Risk Factors
Surgical Procedures, Operative
Surveys and Questionnaires