Provider-specific quality measurement for ERCP using natural language processing

Timothy Imler, Stuart Sherman, Thomas Imperiale, Huiping Xu, Fangqian Ouyang, Christopher Beesley, Charity Hilton, Gregory A. Coté

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Background and Aims: Natural language processing (NLP) is an information retrieval technique that has been shown to accurately identify quality measures for colonoscopy. There are no systematic methods by which to track adherence to quality measures for ERCP, the highest risk endoscopic procedure widely used in practice. Our aim was to demonstrate the feasibility of using NLP to measure adherence to ERCP quality indicators across individual providers. Methods: ERCPs performed by 6 providers at a single institution from 2006 to 2014 were identified. Quality measures were defined using society guidelines and from expert opinion, and then extracted using a combination of NLP and data mining (eg, ICD9-CM codes). Validation for each quality measure was performed by manual record review. Quality measures were grouped into preprocedure (5), intraprocedure (6), and postprocedure (2). NLP was evaluated using measures of precision and accuracy. Results: A total of 23,674 ERCPs were analyzed (average patient age, 52.9 ± 17.8 years, 14,113 were women [59.6%]). Among 13 quality measures, precision of NLP ranged from 84% to 100% with intraprocedure measures having lower precision (84% for precut sphincterotomy). Accuracy of NLP ranged from 90% to 100% with intraprocedure measures having lower accuracy (90% for pancreatic stent placement). Conclusions: NLP in conjunction with data mining facilitates individualized tracking of ERCP providers for quality metrics without the need for manual medical record review. Incorporation of these tools across multiple centers may permit tracking of ERCP quality measures through national registries.

Original languageEnglish (US)
JournalGastrointestinal Endoscopy
DOIs
StateAccepted/In press - Oct 4 2016

Fingerprint

Natural Language Processing
Endoscopic Retrograde Cholangiopancreatography
Data Mining
Information Storage and Retrieval
Expert Testimony
Colonoscopy
Stents
Medical Records
Registries
Guidelines

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging
  • Gastroenterology

Cite this

Provider-specific quality measurement for ERCP using natural language processing. / Imler, Timothy; Sherman, Stuart; Imperiale, Thomas; Xu, Huiping; Ouyang, Fangqian; Beesley, Christopher; Hilton, Charity; Coté, Gregory A.

In: Gastrointestinal Endoscopy, 04.10.2016.

Research output: Contribution to journalArticle

@article{6d4e32cc93a34372bbb5274467dd8483,
title = "Provider-specific quality measurement for ERCP using natural language processing",
abstract = "Background and Aims: Natural language processing (NLP) is an information retrieval technique that has been shown to accurately identify quality measures for colonoscopy. There are no systematic methods by which to track adherence to quality measures for ERCP, the highest risk endoscopic procedure widely used in practice. Our aim was to demonstrate the feasibility of using NLP to measure adherence to ERCP quality indicators across individual providers. Methods: ERCPs performed by 6 providers at a single institution from 2006 to 2014 were identified. Quality measures were defined using society guidelines and from expert opinion, and then extracted using a combination of NLP and data mining (eg, ICD9-CM codes). Validation for each quality measure was performed by manual record review. Quality measures were grouped into preprocedure (5), intraprocedure (6), and postprocedure (2). NLP was evaluated using measures of precision and accuracy. Results: A total of 23,674 ERCPs were analyzed (average patient age, 52.9 ± 17.8 years, 14,113 were women [59.6{\%}]). Among 13 quality measures, precision of NLP ranged from 84{\%} to 100{\%} with intraprocedure measures having lower precision (84{\%} for precut sphincterotomy). Accuracy of NLP ranged from 90{\%} to 100{\%} with intraprocedure measures having lower accuracy (90{\%} for pancreatic stent placement). Conclusions: NLP in conjunction with data mining facilitates individualized tracking of ERCP providers for quality metrics without the need for manual medical record review. Incorporation of these tools across multiple centers may permit tracking of ERCP quality measures through national registries.",
author = "Timothy Imler and Stuart Sherman and Thomas Imperiale and Huiping Xu and Fangqian Ouyang and Christopher Beesley and Charity Hilton and Cot{\'e}, {Gregory A.}",
year = "2016",
month = "10",
day = "4",
doi = "10.1016/j.gie.2017.04.030",
language = "English (US)",
journal = "Gastrointestinal Endoscopy",
issn = "0016-5107",
publisher = "Mosby Inc.",

}

TY - JOUR

T1 - Provider-specific quality measurement for ERCP using natural language processing

AU - Imler, Timothy

AU - Sherman, Stuart

AU - Imperiale, Thomas

AU - Xu, Huiping

AU - Ouyang, Fangqian

AU - Beesley, Christopher

AU - Hilton, Charity

AU - Coté, Gregory A.

PY - 2016/10/4

Y1 - 2016/10/4

N2 - Background and Aims: Natural language processing (NLP) is an information retrieval technique that has been shown to accurately identify quality measures for colonoscopy. There are no systematic methods by which to track adherence to quality measures for ERCP, the highest risk endoscopic procedure widely used in practice. Our aim was to demonstrate the feasibility of using NLP to measure adherence to ERCP quality indicators across individual providers. Methods: ERCPs performed by 6 providers at a single institution from 2006 to 2014 were identified. Quality measures were defined using society guidelines and from expert opinion, and then extracted using a combination of NLP and data mining (eg, ICD9-CM codes). Validation for each quality measure was performed by manual record review. Quality measures were grouped into preprocedure (5), intraprocedure (6), and postprocedure (2). NLP was evaluated using measures of precision and accuracy. Results: A total of 23,674 ERCPs were analyzed (average patient age, 52.9 ± 17.8 years, 14,113 were women [59.6%]). Among 13 quality measures, precision of NLP ranged from 84% to 100% with intraprocedure measures having lower precision (84% for precut sphincterotomy). Accuracy of NLP ranged from 90% to 100% with intraprocedure measures having lower accuracy (90% for pancreatic stent placement). Conclusions: NLP in conjunction with data mining facilitates individualized tracking of ERCP providers for quality metrics without the need for manual medical record review. Incorporation of these tools across multiple centers may permit tracking of ERCP quality measures through national registries.

AB - Background and Aims: Natural language processing (NLP) is an information retrieval technique that has been shown to accurately identify quality measures for colonoscopy. There are no systematic methods by which to track adherence to quality measures for ERCP, the highest risk endoscopic procedure widely used in practice. Our aim was to demonstrate the feasibility of using NLP to measure adherence to ERCP quality indicators across individual providers. Methods: ERCPs performed by 6 providers at a single institution from 2006 to 2014 were identified. Quality measures were defined using society guidelines and from expert opinion, and then extracted using a combination of NLP and data mining (eg, ICD9-CM codes). Validation for each quality measure was performed by manual record review. Quality measures were grouped into preprocedure (5), intraprocedure (6), and postprocedure (2). NLP was evaluated using measures of precision and accuracy. Results: A total of 23,674 ERCPs were analyzed (average patient age, 52.9 ± 17.8 years, 14,113 were women [59.6%]). Among 13 quality measures, precision of NLP ranged from 84% to 100% with intraprocedure measures having lower precision (84% for precut sphincterotomy). Accuracy of NLP ranged from 90% to 100% with intraprocedure measures having lower accuracy (90% for pancreatic stent placement). Conclusions: NLP in conjunction with data mining facilitates individualized tracking of ERCP providers for quality metrics without the need for manual medical record review. Incorporation of these tools across multiple centers may permit tracking of ERCP quality measures through national registries.

UR - http://www.scopus.com/inward/record.url?scp=85020431467&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85020431467&partnerID=8YFLogxK

U2 - 10.1016/j.gie.2017.04.030

DO - 10.1016/j.gie.2017.04.030

M3 - Article

JO - Gastrointestinal Endoscopy

JF - Gastrointestinal Endoscopy

SN - 0016-5107

ER -