Use of Unstructured Parent Narratives to Evaluate Medical Student Competencies in Communication and Professionalism

Gilbert C. Liu, Mitchell Harris, Stacey A. Keyton, Richard Frankel

Research output: Contribution to journalArticle

9 Citations (Scopus)

Abstract

Objective: Medical education programs across the country are now required to conduct meaningful assessments of trainees' competencies, although uniform standards for conducting these evaluations have yet to be established. In 1999, the Indiana University School of Medicine introduced a comprehensive competency-based undergraduate curriculum. The overall goal of the curriculum is to make medical students' day-to-day experiences of training a source of learning about professionalism, communication, and aspects of medicine beyond factual knowledge. We sought to examine free-text comments by parents of pediatric inpatients as substrate for competency evaluation and feedback for third-year students on their pediatrics rotation. Methods: The study was conducted from June 2001 to February 2004. Parents of hospitalized children completed a short medical student evaluation form that included 2 questions inviting free-text response. We used narrative analysis, a qualitative research technique, to describe both the content and meaning of the parents' responses. Results: We collected 573 evaluations with narrative comments about 412 students. The most common aspect of medical student performance commented on by parents related to communication (53.8%). The next most common narrative comment was some form of affirmation of the student as a health care professional (26.0%). Other themes included establishing context for the comment, perceptions of the health care system, criticizing medical student performance, perceptions of the role of medical students, physical approach to the patient, expression of humility by the student, holistic approach to the patient, physical appearance of the student, superlative description of student, and advocating for the patient. Multiple themes were identified in 232 narrative comments (40.4%). Examples of each theme are provided. Conclusions: Family members of pediatric inpatients are a valuable source of information about medical student performance in at least 2 of the Accreditation Council for Graduate Medical Education competency areas (Communication and Professionalism). Themes identified in this study could be used to inform the design of a comprehensive 360-degree student evaluation strategy.

Original languageEnglish
Pages (from-to)207-213
Number of pages7
JournalAmbulatory Pediatrics
Volume7
Issue number3
DOIs
StatePublished - May 2007

Fingerprint

Medical Students
Communication
Students
Parents
Pediatrics
Curriculum
Inpatients
Medicine
Delivery of Health Care
Graduate Medical Education
Hospitalized Child
Qualitative Research
Accreditation
Medical Education
Professionalism
Research Design
Learning

Keywords

  • communication
  • medical student
  • qualitative research

ASJC Scopus subject areas

  • Pediatrics, Perinatology, and Child Health

Cite this

Use of Unstructured Parent Narratives to Evaluate Medical Student Competencies in Communication and Professionalism. / Liu, Gilbert C.; Harris, Mitchell; Keyton, Stacey A.; Frankel, Richard.

In: Ambulatory Pediatrics, Vol. 7, No. 3, 05.2007, p. 207-213.

Research output: Contribution to journalArticle

@article{0989d1089f8e49debd9b916f6942d837,
title = "Use of Unstructured Parent Narratives to Evaluate Medical Student Competencies in Communication and Professionalism",
abstract = "Objective: Medical education programs across the country are now required to conduct meaningful assessments of trainees' competencies, although uniform standards for conducting these evaluations have yet to be established. In 1999, the Indiana University School of Medicine introduced a comprehensive competency-based undergraduate curriculum. The overall goal of the curriculum is to make medical students' day-to-day experiences of training a source of learning about professionalism, communication, and aspects of medicine beyond factual knowledge. We sought to examine free-text comments by parents of pediatric inpatients as substrate for competency evaluation and feedback for third-year students on their pediatrics rotation. Methods: The study was conducted from June 2001 to February 2004. Parents of hospitalized children completed a short medical student evaluation form that included 2 questions inviting free-text response. We used narrative analysis, a qualitative research technique, to describe both the content and meaning of the parents' responses. Results: We collected 573 evaluations with narrative comments about 412 students. The most common aspect of medical student performance commented on by parents related to communication (53.8{\%}). The next most common narrative comment was some form of affirmation of the student as a health care professional (26.0{\%}). Other themes included establishing context for the comment, perceptions of the health care system, criticizing medical student performance, perceptions of the role of medical students, physical approach to the patient, expression of humility by the student, holistic approach to the patient, physical appearance of the student, superlative description of student, and advocating for the patient. Multiple themes were identified in 232 narrative comments (40.4{\%}). Examples of each theme are provided. Conclusions: Family members of pediatric inpatients are a valuable source of information about medical student performance in at least 2 of the Accreditation Council for Graduate Medical Education competency areas (Communication and Professionalism). Themes identified in this study could be used to inform the design of a comprehensive 360-degree student evaluation strategy.",
keywords = "communication, medical student, qualitative research",
author = "Liu, {Gilbert C.} and Mitchell Harris and Keyton, {Stacey A.} and Richard Frankel",
year = "2007",
month = "5",
doi = "10.1016/j.ambp.2007.03.001",
language = "English",
volume = "7",
pages = "207--213",
journal = "Academic Pediatrics",
issn = "1876-2859",
publisher = "Elsevier Inc.",
number = "3",

}

TY - JOUR

T1 - Use of Unstructured Parent Narratives to Evaluate Medical Student Competencies in Communication and Professionalism

AU - Liu, Gilbert C.

AU - Harris, Mitchell

AU - Keyton, Stacey A.

AU - Frankel, Richard

PY - 2007/5

Y1 - 2007/5

N2 - Objective: Medical education programs across the country are now required to conduct meaningful assessments of trainees' competencies, although uniform standards for conducting these evaluations have yet to be established. In 1999, the Indiana University School of Medicine introduced a comprehensive competency-based undergraduate curriculum. The overall goal of the curriculum is to make medical students' day-to-day experiences of training a source of learning about professionalism, communication, and aspects of medicine beyond factual knowledge. We sought to examine free-text comments by parents of pediatric inpatients as substrate for competency evaluation and feedback for third-year students on their pediatrics rotation. Methods: The study was conducted from June 2001 to February 2004. Parents of hospitalized children completed a short medical student evaluation form that included 2 questions inviting free-text response. We used narrative analysis, a qualitative research technique, to describe both the content and meaning of the parents' responses. Results: We collected 573 evaluations with narrative comments about 412 students. The most common aspect of medical student performance commented on by parents related to communication (53.8%). The next most common narrative comment was some form of affirmation of the student as a health care professional (26.0%). Other themes included establishing context for the comment, perceptions of the health care system, criticizing medical student performance, perceptions of the role of medical students, physical approach to the patient, expression of humility by the student, holistic approach to the patient, physical appearance of the student, superlative description of student, and advocating for the patient. Multiple themes were identified in 232 narrative comments (40.4%). Examples of each theme are provided. Conclusions: Family members of pediatric inpatients are a valuable source of information about medical student performance in at least 2 of the Accreditation Council for Graduate Medical Education competency areas (Communication and Professionalism). Themes identified in this study could be used to inform the design of a comprehensive 360-degree student evaluation strategy.

AB - Objective: Medical education programs across the country are now required to conduct meaningful assessments of trainees' competencies, although uniform standards for conducting these evaluations have yet to be established. In 1999, the Indiana University School of Medicine introduced a comprehensive competency-based undergraduate curriculum. The overall goal of the curriculum is to make medical students' day-to-day experiences of training a source of learning about professionalism, communication, and aspects of medicine beyond factual knowledge. We sought to examine free-text comments by parents of pediatric inpatients as substrate for competency evaluation and feedback for third-year students on their pediatrics rotation. Methods: The study was conducted from June 2001 to February 2004. Parents of hospitalized children completed a short medical student evaluation form that included 2 questions inviting free-text response. We used narrative analysis, a qualitative research technique, to describe both the content and meaning of the parents' responses. Results: We collected 573 evaluations with narrative comments about 412 students. The most common aspect of medical student performance commented on by parents related to communication (53.8%). The next most common narrative comment was some form of affirmation of the student as a health care professional (26.0%). Other themes included establishing context for the comment, perceptions of the health care system, criticizing medical student performance, perceptions of the role of medical students, physical approach to the patient, expression of humility by the student, holistic approach to the patient, physical appearance of the student, superlative description of student, and advocating for the patient. Multiple themes were identified in 232 narrative comments (40.4%). Examples of each theme are provided. Conclusions: Family members of pediatric inpatients are a valuable source of information about medical student performance in at least 2 of the Accreditation Council for Graduate Medical Education competency areas (Communication and Professionalism). Themes identified in this study could be used to inform the design of a comprehensive 360-degree student evaluation strategy.

KW - communication

KW - medical student

KW - qualitative research

UR - http://www.scopus.com/inward/record.url?scp=34248563759&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34248563759&partnerID=8YFLogxK

U2 - 10.1016/j.ambp.2007.03.001

DO - 10.1016/j.ambp.2007.03.001

M3 - Article

C2 - 17512880

AN - SCOPUS:34248563759

VL - 7

SP - 207

EP - 213

JO - Academic Pediatrics

JF - Academic Pediatrics

SN - 1876-2859

IS - 3

ER -