Natural language processing to extract follow-up provider information from hospital discharge summaries

Martin C. Were, Sergey Gorbachev, Jason Cadwallader, Joe Kesterson, Xiaochun Li, J. Marc Overhage, Jeff Friedlin

Research output: Contribution to journalArticle

1 Scopus citations


OBJECTIVE: We evaluate the performance of a Natural Language Processing (NLP) application designed to extract follow-up provider information from free-text discharge summaries at two hospitals.

EVALUATION: We compare performance by the NLP application, called the Regenstrief EXtracion tool (REX), to performance by three physician reviewers at extracting follow-up provider names, phone/fax numbers and location information. Precision, recall, and F-measures are reported, with 95% CI for pairwise comparisons.

RESULTS: Of 556 summaries with follow-up information, REX performed as follows in precision, recall, F-measure respectively: Provider Name 0.96, 0.92, 0.94; Phone/Fax 0.99, 0.92, 0.96; Location 0.83, 0.82, 0.82. REX was as good as all physician-reviewers in identifying follow-up provider names and phone/fax numbers, and slightly inferior to two physicians at identifying location information. REX took about four seconds (vs. 3-5 minutes for physician-reviewers) to extract follow-up information.

CONCLUSION: A NLP program had physician-like performance at extracting provider follow-up information from discharge summaries.

Original languageEnglish (US)
Pages (from-to)872-876
Number of pages5
JournalAMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium
StatePublished - 2010

ASJC Scopus subject areas

  • Medicine(all)

Fingerprint Dive into the research topics of 'Natural language processing to extract follow-up provider information from hospital discharge summaries'. Together they form a unique fingerprint.

  • Cite this