This study evaluates two training strategies to help surgeons use Better Conversations, an evidence-based communication framework that improves informed consent by supporting patient understanding, deliberation, and preparation for surgery. Prior work by the investigative team shows that Better Conversations addresses shortcomings in traditional consent practices, aligns with quality improvement standards, and is well-received by surgeons and patients.
This is a non-inferiority trial comparing (1) audit-and-feedback training delivered by an education specialist and (2) an automated training approach that uses natural language processing and active machine learning to identify key elements of Better Conversations in de-identified transcripts of surgical consultations. Automated output is reviewed and finalized by the education specialist before being shared with surgeons. The hypothesis is that automated training will be non-inferior to specialist-delivered training, with a 5% non-inferiority margin.
The study also evaluates feasibility and acceptability of training a large number of surgeons across two institutions. Feasibility is defined as training at least 80% of surgeons to competence. Acceptability will be assessed using surgeon surveys and exit interviews, and patient-reported outcomes. Patients will complete validated surveys (Feeling Heard and Understood; CAHPS Surgical Care items) before and after their surgeon's training. A subset of patients will participate in interviews regarding their consultation experience. A separate group of patients will consent to have their consultations audio recorded solely for surgeon training or assessment purposes.
Sixty surgeons from UW Health and the Medical College of Wisconsin will be randomized, stratified by site, to one of the two training groups. All surgeons will begin with a 30-minute didactic session, followed by 10 training recordings with corresponding feedback, and 5-7 assessment recordings used to evaluate competence. Consultations will be audio recorded, transcribed, and de-identified prior to feedback and analysis. Competence will be evaluated using a standardized adherence checklist developed by the study team, assessing both the presence and quality of required communication elements.
This study will generate estimates of within- and between-surgeon variation in communication performance and patient-reported outcomes. These data will inform analytic planning and power calculations for a future pragmatic trial examining the broader impact of Better Conversations on patient decision making, satisfaction, and health outcomes.