Achievable benchmarks of care: The ABC(TM)s of benchmarking

Norman W. Weissman, Jeroan J. Allison, Catarina I. Kiefe, Robert M. Farmer, Michael T. Weaver, O. Dale Williams, Ian G. Child, Judy H. Pemberton, Kathleen C. Brown, C. Suzanne Baker

Research output: Contribution to journalArticle

88 Citations (Scopus)

Abstract

Benchmarking is generally considered to be an important tool for quality improvement. Traditional approaches to benchmarking have relied on subjective identification of 'leaders in the field'. We derive an objective, reproducible and attainable Achievable Benchmark of Care (ABC(TM)) by measuring and analysing performance on process-of-care indicators. Three characteristics of the ABC(TM) that we deem essential are: (i) benchmarks represent a measurable level of excellence; (2) benchmarks are demonstrably attainable; (3) benchmarks are derived from data in an objective, reproducible and predetermined fashion. From these characteristics it follows that (4) providers with high performance are selected to define a level of excellence in a predetermined fashion, but (5) providers with high performance on small numbers Of Cases do not influence unduly benchmark levels. We use the 'pared mean' to operationalize the: ABC(TM). Roughly, the pared mean summarizes the performance of top-ranked providers whereby at least 10% of the patient pool across all providers is included. Bayesian estimators for adjustment of performance of providers with small sample Sizes are used to rank providers. Randomized controlled trials to assess the independent effect of the ABC(TM) in quality improvement projects are under way. We have developed a methodology objectively and reproducibly to derive a level of excellent, attainable performance, based on measured performance by a group of providers. The ABC(TM) can be applied to groups of providers in communities, to institutions and departments within them, or to individual practitioners.

Original languageEnglish (US)
Pages (from-to)269-281
Number of pages13
JournalJournal of Evaluation in Clinical Practice
Volume5
Issue number3
DOIs
StatePublished - 1999
Externally publishedYes

Fingerprint

Benchmarking
Quality Improvement
Sample Size
Randomized Controlled Trials

Keywords

  • Benchmarks
  • CQI
  • Performance measures
  • Process of care
  • Quality improvement
  • Quality of care

ASJC Scopus subject areas

  • Public Health, Environmental and Occupational Health
  • Health Information Management
  • Nursing(all)

Cite this

Weissman, N. W., Allison, J. J., Kiefe, C. I., Farmer, R. M., Weaver, M. T., Dale Williams, O., ... Suzanne Baker, C. (1999). Achievable benchmarks of care: The ABC(TM)s of benchmarking. Journal of Evaluation in Clinical Practice, 5(3), 269-281. https://doi.org/10.1046/j.1365-2753.1999.00203.x

Achievable benchmarks of care : The ABC(TM)s of benchmarking. / Weissman, Norman W.; Allison, Jeroan J.; Kiefe, Catarina I.; Farmer, Robert M.; Weaver, Michael T.; Dale Williams, O.; Child, Ian G.; Pemberton, Judy H.; Brown, Kathleen C.; Suzanne Baker, C.

In: Journal of Evaluation in Clinical Practice, Vol. 5, No. 3, 1999, p. 269-281.

Research output: Contribution to journalArticle

Weissman, NW, Allison, JJ, Kiefe, CI, Farmer, RM, Weaver, MT, Dale Williams, O, Child, IG, Pemberton, JH, Brown, KC & Suzanne Baker, C 1999, 'Achievable benchmarks of care: The ABC(TM)s of benchmarking', Journal of Evaluation in Clinical Practice, vol. 5, no. 3, pp. 269-281. https://doi.org/10.1046/j.1365-2753.1999.00203.x
Weissman NW, Allison JJ, Kiefe CI, Farmer RM, Weaver MT, Dale Williams O et al. Achievable benchmarks of care: The ABC(TM)s of benchmarking. Journal of Evaluation in Clinical Practice. 1999;5(3):269-281. https://doi.org/10.1046/j.1365-2753.1999.00203.x
Weissman, Norman W. ; Allison, Jeroan J. ; Kiefe, Catarina I. ; Farmer, Robert M. ; Weaver, Michael T. ; Dale Williams, O. ; Child, Ian G. ; Pemberton, Judy H. ; Brown, Kathleen C. ; Suzanne Baker, C. / Achievable benchmarks of care : The ABC(TM)s of benchmarking. In: Journal of Evaluation in Clinical Practice. 1999 ; Vol. 5, No. 3. pp. 269-281.
@article{0de8bb6b8f37454c86feda608bb50089,
title = "Achievable benchmarks of care: The ABC(TM)s of benchmarking",
abstract = "Benchmarking is generally considered to be an important tool for quality improvement. Traditional approaches to benchmarking have relied on subjective identification of 'leaders in the field'. We derive an objective, reproducible and attainable Achievable Benchmark of Care (ABC(TM)) by measuring and analysing performance on process-of-care indicators. Three characteristics of the ABC(TM) that we deem essential are: (i) benchmarks represent a measurable level of excellence; (2) benchmarks are demonstrably attainable; (3) benchmarks are derived from data in an objective, reproducible and predetermined fashion. From these characteristics it follows that (4) providers with high performance are selected to define a level of excellence in a predetermined fashion, but (5) providers with high performance on small numbers Of Cases do not influence unduly benchmark levels. We use the 'pared mean' to operationalize the: ABC(TM). Roughly, the pared mean summarizes the performance of top-ranked providers whereby at least 10{\%} of the patient pool across all providers is included. Bayesian estimators for adjustment of performance of providers with small sample Sizes are used to rank providers. Randomized controlled trials to assess the independent effect of the ABC(TM) in quality improvement projects are under way. We have developed a methodology objectively and reproducibly to derive a level of excellent, attainable performance, based on measured performance by a group of providers. The ABC(TM) can be applied to groups of providers in communities, to institutions and departments within them, or to individual practitioners.",
keywords = "Benchmarks, CQI, Performance measures, Process of care, Quality improvement, Quality of care",
author = "Weissman, {Norman W.} and Allison, {Jeroan J.} and Kiefe, {Catarina I.} and Farmer, {Robert M.} and Weaver, {Michael T.} and {Dale Williams}, O. and Child, {Ian G.} and Pemberton, {Judy H.} and Brown, {Kathleen C.} and {Suzanne Baker}, C.",
year = "1999",
doi = "10.1046/j.1365-2753.1999.00203.x",
language = "English (US)",
volume = "5",
pages = "269--281",
journal = "Journal of Evaluation in Clinical Practice",
issn = "1356-1294",
publisher = "Wiley-Blackwell",
number = "3",

}

TY - JOUR

T1 - Achievable benchmarks of care

T2 - The ABC(TM)s of benchmarking

AU - Weissman, Norman W.

AU - Allison, Jeroan J.

AU - Kiefe, Catarina I.

AU - Farmer, Robert M.

AU - Weaver, Michael T.

AU - Dale Williams, O.

AU - Child, Ian G.

AU - Pemberton, Judy H.

AU - Brown, Kathleen C.

AU - Suzanne Baker, C.

PY - 1999

Y1 - 1999

N2 - Benchmarking is generally considered to be an important tool for quality improvement. Traditional approaches to benchmarking have relied on subjective identification of 'leaders in the field'. We derive an objective, reproducible and attainable Achievable Benchmark of Care (ABC(TM)) by measuring and analysing performance on process-of-care indicators. Three characteristics of the ABC(TM) that we deem essential are: (i) benchmarks represent a measurable level of excellence; (2) benchmarks are demonstrably attainable; (3) benchmarks are derived from data in an objective, reproducible and predetermined fashion. From these characteristics it follows that (4) providers with high performance are selected to define a level of excellence in a predetermined fashion, but (5) providers with high performance on small numbers Of Cases do not influence unduly benchmark levels. We use the 'pared mean' to operationalize the: ABC(TM). Roughly, the pared mean summarizes the performance of top-ranked providers whereby at least 10% of the patient pool across all providers is included. Bayesian estimators for adjustment of performance of providers with small sample Sizes are used to rank providers. Randomized controlled trials to assess the independent effect of the ABC(TM) in quality improvement projects are under way. We have developed a methodology objectively and reproducibly to derive a level of excellent, attainable performance, based on measured performance by a group of providers. The ABC(TM) can be applied to groups of providers in communities, to institutions and departments within them, or to individual practitioners.

AB - Benchmarking is generally considered to be an important tool for quality improvement. Traditional approaches to benchmarking have relied on subjective identification of 'leaders in the field'. We derive an objective, reproducible and attainable Achievable Benchmark of Care (ABC(TM)) by measuring and analysing performance on process-of-care indicators. Three characteristics of the ABC(TM) that we deem essential are: (i) benchmarks represent a measurable level of excellence; (2) benchmarks are demonstrably attainable; (3) benchmarks are derived from data in an objective, reproducible and predetermined fashion. From these characteristics it follows that (4) providers with high performance are selected to define a level of excellence in a predetermined fashion, but (5) providers with high performance on small numbers Of Cases do not influence unduly benchmark levels. We use the 'pared mean' to operationalize the: ABC(TM). Roughly, the pared mean summarizes the performance of top-ranked providers whereby at least 10% of the patient pool across all providers is included. Bayesian estimators for adjustment of performance of providers with small sample Sizes are used to rank providers. Randomized controlled trials to assess the independent effect of the ABC(TM) in quality improvement projects are under way. We have developed a methodology objectively and reproducibly to derive a level of excellent, attainable performance, based on measured performance by a group of providers. The ABC(TM) can be applied to groups of providers in communities, to institutions and departments within them, or to individual practitioners.

KW - Benchmarks

KW - CQI

KW - Performance measures

KW - Process of care

KW - Quality improvement

KW - Quality of care

UR - http://www.scopus.com/inward/record.url?scp=6544243327&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=6544243327&partnerID=8YFLogxK

U2 - 10.1046/j.1365-2753.1999.00203.x

DO - 10.1046/j.1365-2753.1999.00203.x

M3 - Article

C2 - 10461579

AN - SCOPUS:6544243327

VL - 5

SP - 269

EP - 281

JO - Journal of Evaluation in Clinical Practice

JF - Journal of Evaluation in Clinical Practice

SN - 1356-1294

IS - 3

ER -