Hostname: page-component-5b777bbd6c-f9nfp Total loading time: 0 Render date: 2025-06-26T05:16:06.864Z Has data issue: false hasContentIssue false
  • English
  • Français

A natural language processing approach to uncover patterns among online ratings of otolaryngologists

Published online by Cambridge University Press:  20 March 2023

V Vasan Open the ORCID record for V Vasan [Opens in a new window] ,
Christopher P. Cheng ,
David K. Lerner ,
D Vujovic ,
M van Gerwen  and
A M Iloreta
V Vasan*
Affiliation:
Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA
Christopher P. Cheng
Affiliation:
Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA
David K. Lerner
Affiliation:
Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA
D Vujovic
Affiliation:
Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA
M van Gerwen
Affiliation:
Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA Institute for Translational Epidemiology, Icahn School of Medicine at Mount Sinai, New York, NY, USA
A M Iloreta
Affiliation:
Department of Otolaryngology-Head and Neck Surgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA
*
Corresponding author: Vikram Vasan; Email: vikram.vasan@icahn.mssm.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

Background

Patients increasingly use physician rating websites to evaluate and choose potential healthcare providers. A sentiment analysis and machine learning approach can uniquely analyse written prose to quantitatively describe patients’ perspectives from interactions with their physicians.

Methods

Online written reviews and star scores were analysed from Healthgrades.com using a natural language processing sentiment analysis package. Demographics of otolaryngologists were compared and a multivariable regression for individual words was performed.

Results

This study analysed 18 546 online reviews of 1240 otolaryngologists across the USA. Younger otolaryngologists (aged less than 40 years) had higher sentiment and star scores compared with older otolaryngologists (p < 0.001). Male otolaryngologists had higher sentiment and star scores compared with female otolaryngologists (p < 0.001). ‘Confident’, ‘kind’, ‘recommend’ and ‘comfortable’ were words associated with positive reviews (p < 0.001).

Conclusion

Positive bedside manner was strongly reflected in better reviews, and younger age and male gender of the otolaryngologist were associated with better sentiment and star scores.

Keywords

Natural language processingonline ratingsotolaryngologyphysician rating websitessentiment analysis
Type
Main Article
Information
The Journal of Laryngology & Otology , Volume 137 , Issue 12 , December 2023 , pp. 1384 - 1388
Copyright
Copyright © The Author(s), 2023. Published by Cambridge University Press on behalf of J.L.O. (1984) LIMITED

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

Footnotes

Mr V Vasan takes responsibility for the integrity of the content of the paper

*

Joint first authors

References

Gao, GG, McCullough, JS, Agarwal, R, Jha, AK. A changing landscape of physician quality reporting: analysis of patients’ online ratings of their physicians over a 5-year period. J Med Internet Res 2012;14:e3810.2196/jmir.2003CrossRefGoogle ScholarPubMed
Hanauer, DA, Zheng, K, Singer, DC, Gebremariam, A, Davis, MM. Public awareness, perception, and use of online physician rating sites. JAMA 2014;311:734–510.1001/jama.2013.283194CrossRefGoogle ScholarPubMed
Syed, UA, Acevedo, D, Narzikul, AC, Coomer, W, Beredjiklian, PK, Abboud, JA. Physician rating websites: an analysis of physician evaluation and physician perception. Arch Bone Jt Surg 2019;7:136–42Google ScholarPubMed
Rothenfluh, F, Schulz, PJ. Content, quality, and assessment tools of physician-rating websites in 12 countries: quantitative analysis. J Med Internet Res 2018;20:e21210.2196/jmir.9105CrossRefGoogle ScholarPubMed
Emmert, M, Meier, F, Pisch, F, Sander, U. Physician choice making and characteristics associated with using physician-rating websites: cross-sectional study. J Med Internet Res 2013;15:e18710.2196/jmir.2702CrossRefGoogle ScholarPubMed
Patients trust online reviews as much as doctor recommendations (and other shocking facts about transparency in healthcare). In: https://www.healthitoutcomes.com/doc/patients-trust-online-reviews-as-much-as-doctor-recommendations-0001 [7 July 2022]Google Scholar
Emmert, M, Gemza, R, Schöffski, O, Sohn, S. Public reporting in health care: the impact of publicly reported quality data on patient steerage [in German]. Gesundheitswesen 2012;74:e25–41Google ScholarPubMed
Sobin, L, Goyal, P. Trends of online ratings of otolaryngologists: what do your patients really think of you? JAMA Otolaryngol Head Neck Surg 2014;140:635–810.1001/jamaoto.2014.818CrossRefGoogle ScholarPubMed
Goshtasbi, K, Lehrich, BM, Moshtaghi, O, Abouzari, M, Sahyouni, R, Bagheri, K et al. Patients’ online perception and ratings of neurotologists. Otol Neurotol 2019;40:139–4310.1097/MAO.0000000000002075CrossRefGoogle ScholarPubMed
Calixto, NE, Chiao, W, Durr, ML, Jiang, N. Factors impacting online ratings for otolaryngologists. Ann Otol Rhinol Laryngol 2018;127:521–610.1177/0003489418778062CrossRefGoogle ScholarPubMed
Basa, K, Jabbour, N, Rohlfing, M, Schmoker, S, Lawlor, CM, Levi, J et al. Online reputations: comparing hospital- and patient-generated ratings in academic otolaryngology. Ann Otol Rhinol Laryngol 2021;130:1317–2510.1177/00034894211005985CrossRefGoogle ScholarPubMed
Tang, JE, Arvind, V, Dominy, C, White, CA, Cho, SK, Kim, JS. How are patients reviewing spine surgeons online? A sentiment analysis of physician review website written comments. Glob Spine J 2022. Epub 2022 Jan 27Google ScholarPubMed
Tang, JE, Arvind, V, White, CA, Dominy, C, Kim, JS, Cho, SK et al. Using sentiment analysis to understand what patients are saying about hand surgeons online. Hand (N Y) 2023;18:854–6010.1177/15589447211060439CrossRefGoogle ScholarPubMed
Hutto, C, Gilbert, E. VADER: a parsimonious rule-based model for sentiment analysis of social media text. Proc Int AAAI Conf Web Soc Media 2014;8:216–2510.1609/icwsm.v8i1.14550CrossRefGoogle Scholar
National Geographic. United States Regions. In: https://education.nationalgeographic.org/resource/united-states-regions [7 July 2022]Google Scholar
Bernstein, DN, Mesfin, A. Physician-review websites in orthopaedic surgery. JBJS Rev 2020;8:e015810.2106/JBJS.RVW.19.00158CrossRefGoogle ScholarPubMed
Holliday, AM, Kachalia, A, Meyer, GS, Sequist, TD. Physician and patient views on public physician rating websites: a cross-sectional study. J Gen Intern Med 2017;32:626–3110.1007/s11606-017-3982-5CrossRefGoogle ScholarPubMed
Sabin, JE. Physician-rating websites. Virtual Mentor 2013;15:932–6Google ScholarPubMed
Shintani Smith, S, Cheng, BT, Kern, RC, Cameron, KA, Micco, AG. Publicly reported patient satisfaction scores in academic otolaryngology departments. Laryngoscope 2021;131:2204–1010.1002/lary.29557CrossRefGoogle ScholarPubMed
Tracy, LF, Jabbour, N, Rubin, BR, Sobin, LB, Lawlor, CM, Basa, KC et al. Satisfaction in academic otolaryngology: do physician demographics impact Press Ganey survey scores? Laryngoscope 2020;130:1902–610.1002/lary.28335CrossRefGoogle ScholarPubMed
Nuyen, B, Altamirano, J, Fassiotto, M, Alyono, J. Effects of surgeon sociodemographics on patient-reported satisfaction. Surgery 2021;169:1441–510.1016/j.surg.2020.12.006CrossRefGoogle ScholarPubMed
Adudu, OP, Adudu, OG. Do patients view male and female doctors differently? East Afr Med J 2007;84:172–7Google ScholarPubMed
Dunivin, Z, Zadunayski, L, Baskota, U, Siek, K, Mankoff, J. Gender, soft skills, and patient experience in online physician reviews: a large-scale text analysis. J Med Internet Res 2020;22:e1445510.2196/14455CrossRefGoogle ScholarPubMed
Sama, AJ, Matichak, DP, Schiller, NC, Li, DJ, Donnaly, CJ, Damodar, D et al. The impact of social media presence, age, and patient reported wait times on physician review websites for sports medicine surgeons. J Clin Orthop Trauma 2021;21:10150210.1016/j.jcot.2021.101502CrossRefGoogle ScholarPubMed
Ginocchio, LA, Duszak, R, Rosenkrantz, AB. How satisfied are patients with their radiologists? Assessment using a national patient ratings website. AJR Am J Roentgenol 2017;208:W178–8310.2214/AJR.16.17298CrossRefGoogle ScholarPubMed
Elfil, M, Negida, A. Sampling methods in clinical research; an educational review. Emerg (Tehran) 2017;5:e52Google ScholarPubMed