Evaluation of Impact of AI Assistance on Workload Associated w Preparation of Rare Tumor Case Repts

Primary outcomes

1. Subjective Cognitive workload (CWL)

   Time frame: Baseline to 2 hours

   Subjective Cognitive workload (CWL) will be measured while interviews using The National Aeronautics and Space Administration task load (NASA TLX) index is a tool for measuring and conducting a subjective mental workload (MWL) assessment.

   The NASA-TLX is a subjective measure of CWL and is used across many disciplines. The NASA-TLX considers six dimensions-Mental, Physical, and Temporal Demands, Frustration, Effort, and Performance. NASA-TLX scores ≥55 have been associated with reduced performance in numerous settings. NASA-TLX is considered to be the most used subjective measure of CWL. The validated two-stage process with participants performing 15 separate pair-wise comparisons between 6 dimensions of NASA-TLX will be used. A workload score will be marked from low and high for each dimension.

   Score values from 0 -100. The Interpretation Score of NASA TLX for Low 0-9, Medium 10-29, Somewhat high 30-49, High 50-79, and Very high 80-100

2. Perceived cognitive load

   Time frame: Baseline to 2 hours

   The perceived cognitive load will be measured using System Usability Scale (SUS).

   SUS is a validated post-test questionnaire that measures user satisfaction. Further, studies confirm that SUS is predictive of the impacts of changes to the user interface on usability when multiple changes to a single product were made over a large number of iterations.

   SUS is composed of 10 questions- five positive and five negative statements, each having a five-point scale that ranges from strongly disagree to strongly agree. SUS provides a score (range, 0-100) based on the participant's rating of 10 statements regarding usability with higher scores indicating greater satisfaction with usability.