Skip to main content
OpenTrials
Completed

NCT Number: NCT06934031

Interpretation Performance in Chinese and Japanese Medical Consultation Scenarios

This study aims to compare the translation and interpretation performance of ChatGPT, Google Translate(GT),and UD Talk in cardiopulmonary consultations and analyze their effectiveness in addressing language barriers.The investigators hypothesize that ChatGPT and UD Talk will outperform GT in terms of accuracy and error rates.

Completed

Looking for future studies?

Notify Me

Key information

Age range

18 year and older

Sex eligibility

All sexes

Study type

Observational

Primary location

Fu Jen Catholic University Hospital, Fu Jen Catholic University

New Taipei City, 24352, Taiwan

About this study

Background: Language barriers in healthcare have a significant impact on patient safety, health outcomes, and the quality of healthcare services. With the increase in global migration, more patients are facing language challenges in foreign healthcare systems. Literature shows that providing professional interpretation services significantly improves patient satisfaction and communication quality. However, due to the high usage of ad-hoc interpreters and the shortage of professional interpreters, clinical communication quality has declined.

Study Design: This is a one-year, single-center, prospective observational study. Methods: The study will be conducted in the cardiology and pulmonology outpatient clinics at Fu Jen University Hospital. A total of 20 cardiopulmonary disease patients will be enrolled, withtheir consultation sessions recorded and transcribed into Chinese. The study will compare the three tools' performance in terms of semantic accuracy, error types, and severity, and analyze their feasibility in clinical practice. Further analysis will involve satisfaction surveys from both professional interpreters and non-native speakers living in Taiwan. The translation results will be evaluated for accuracy and error rates by 8 professional medical interpreters, with a satisfaction survey completed by a total of 14 non-experts. The evaluation tool will be based on the assessment rubrics from the National Accreditation Authority for Translators and Interpreters.

Effect: It is expected that ChatGPT and UD Talk will show better translation accuracy and interpretation quality compared to GT. UD Talk is anticipated to perform better than the other two tools in real-time interpretation. The study results will provide valuable insights for future medical interpretation training and clinical applications.

Who can participate

Healthy volunteers accepted: Yes

Only the study team can determine whether someone qualifies for participation.

First part

Inclusion criteria

  • Age over 18 years
  • Patients visiting the Cardiology or Pulmonology Department at Fu Jen Catholic University Hospital from December 2024 to November 2025

Exclusion criteria

  • Patients unable to communicate effectively as assessed by the physician
  • Refusal to participate in the study

Second part

Inclusion criteria

  • Age over 18 years
  • Completed the Japanese-Chinese medical interpretation training course and has at least two years of clinical experience

Exclusion criteria

  • Refusal to participate in the study

Third part

Inclusion criteria

  • Age over 18 years
  • Non-native Chinese-speaking Japanese residents who have lived in Taiwan for at least two years

Exclusion criteria

  • Refusal to participate in the study

Treatment and study plan

translation software

Other

ChatGPT, Google Translate, and UD talk

Primary outcomes

  1. Translation Assessment Scale Score

    Time frame: 4 months

    6-point Likert scale, with 5 representing the highest score and 0 representing the lowest.

Sponsors and collaborators

Lead sponsor

Fu Jen Catholic University

Other

Registry information

Official study title

A Comparative Study of Interpretation Performance of ChatGPT, Google Translate, and UD Talk in Chinese and Japanese Medical Consultation Scenarios: Contexts of Cardiopulmonary Disease Consultation

Important dates

Study start
2025
Primary completion
2025
Study completion
2025
First posted
Apr 18, 2025
Registry last updated
Feb 4, 2026

OpenTrials presents study information sourced from ClinicalTrials.gov. The official registry record should be consulted for the latest information.

View the official ClinicalTrials.gov record (opens in a new tab)

This listing is for discovery and informational purposes only. It is not medical advice, does not guarantee that a study is recruiting, and does not determine eligibility. Contact the study team and a qualified healthcare professional when considering participation.

Published trials that share one or more normalized conditions with this study.