Hostname: page-component-cb9f654ff-5jtmz Total loading time: 0 Render date: 2025-08-31T09:06:48.478Z Has data issue: false hasContentIssue false

Clinical Reasoning Skills in Psychiatric Education: Scenario and Question Generation with Chat-GPT

Published online by Cambridge University Press:  26 August 2025

B. Ozel*
Affiliation:
Department of Psychiatry, Baskent University, Ankara
E. Emekli
Affiliation:
Department of Psychiatry, Baskent University, Ankara
E. Emekli
Affiliation:
Department of Radiology, Eskişehir Osmangazi University, Eskişehir, Türkiye
*
*Corresponding author.

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.
Introduction

Case-based learning holds a crucial place in psychiatric education. Through methods such as written scenarios, video presentations, patient simulations, or observing real patients, students are expected to gain clinical reasoning skills by observing psychiatric cases.

Objectives

This study aims to generate case scenarios using ChatGPT-4 and create multiple-choice questions based on these cases.

Methods

A prompt was developed based on the literature to generate case scenarios for 12 psychiatric diagnoses, along with five related questions for each case (Figure) (Kıyak. Rev esp educ méd 2023; 4(3)). The scenarios and questions were organized into six forms, each containing two cases and ten questions.

Results

A total of 12 psychiatrists, (5.33 ± 1.31 years of practice) evaluated each form in pairs. The results of the case evaluations are presented in Table 1, and the question evaluations in Table 2.

Table 1Form 1Form 2Form 3Form 4Form 5Form 6Total
Schizophrenia/ MDDSchizophreniform/ ANBrief PD/ SSDPanic/ Bipolar IDysthymia/ BPDConversion/GAD
The clinical scenario represents a typical case for the queried disorder.2/22/21/22/22/22/223/24
The mental status examination findings in the case are appropriate for diagnosis.2/22/22/22/22/21/223/24
The case scenario is well-written.2/22/12/22/22/22/223/24
The case is of appropriate difficulty for medical students.2/21/12/12/22/21/220/24
The case is aimed at measuring clinical reasoning skills.2/22/22/12/21/12/221/24
Table 2The question text is clear.The question is clinically appropriate.The question has only one correct answer.The information provided is sufficient to find the correct answer.The distractors are plausible.The question was of appropriate difficulty for medical students.Factual Recall/Clinical reasoningTotal by question type
Diagnosis23232223231916149/168
Treatment24231220171517128/168
Differential diagnosis22171816191520127/168
Prognosis23221721191414130/168
Complications21191719131214115/168
Total by criterion113/120104/12086/12099/12091/12075/12081/120

Conclusions

The evaluation confirmed that the case scenarios were typical for the respective disorders and included appropriate mental status examinations for diagnosis (23/24). The cases were deemed suitably challenging for medical students (20/24) and effective in assessing clinical reasoning skills (21/24). However, the questions did not meet certain criteria, such as appropriate difficulty (75/120), the presence of a single correct answer (86/120), and the plausibility of distractors (91/120). It is suggested that further work on the prompt is needed to improve the quality of the questions. While ChatGPT is suitable for generating case scenarios, the questions should be reviewed before use.

Disclosure of Interest

None Declared

Information

Type
Abstract
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
© The Author(s), 2025. Published by Cambridge University Press on behalf of European Psychiatric Association
Submit a response

Comments

No Comments have been published for this article.