Measuring surgical competency in facial trauma

The Arch Bar Placement Assessment Scale

Roberto L. Flores, Robert J. Havlik, Matthew Choi, Joseph F. Heidelman, Jeffrey D. Bennett, Sunil Tholpady

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

BACKGROUND: Surgical education is in a period of significant change. Assessment of surgical competency is imprecise compared with cognitive knowledge and judgment. A surgical competency measurement tool may be useful for plastic surgery training programs and certification societies. We present a validation study of a novel measurement instrument for arch bar placement and dental wire handling. METHODS: An Arch Bar Placement Assessment Scale (ABPAS) was created via consensus by 2 craniofacial and 2 maxillofacial surgeons. Residents and faculty members of plastic and maxillofacial surgery (n = 20) then placed an arch bar on the lower jaw of a skull model. Performances were video recorded without revealing identities. Two study groups were created based on subjects experience level: group 1 (n = 10) previously placed fewer than 25 arch bars; group 2 (n = 10) previously placed more than 25 arch bars. Two craniofacial surgeons used the ABPAS to blindly grade surgical performance. RESULTS: The ABPAS consisted of a 48-point rating scale that included a 23-point task-specific work list and a 25-point global rating scale. Pearson coefficient showed limited intraobserver (P = 0.97) and interobserver (P = 0.95) variance of test scores. The ABPAS demonstrated superior performance in group 2 in the task-specific work list [12.6 (5.5) vs 17.6 (1.5), P = 0.02], global rating scale [17.4 (4.4) vs 22 (2.1), P = 0.01], and ABPAS score [30 (9.8) and 39.6 (3.2), P = 0.01]. CONCLUSIONS: The ABPAS is a novel measurement tool which assesses technical surgical skill and can identify surgical competency in arch bar placement and dental wire handling. This tool may have future use in residency training and continuing education.

Original languageEnglish
JournalAnnals of Plastic Surgery
DOIs
StateAccepted/In press - Jun 12 2013

Fingerprint

Plastic Surgery
Tooth
Education
Oral Surgery
Validation Studies
Continuing Education
Certification
Wounds and Injuries
Internship and Residency
Jaw
Skull
Consensus
Handling (Psychology)
Surgeons
Oral and Maxillofacial Surgeons

ASJC Scopus subject areas

  • Surgery

Cite this

Flores, R. L., Havlik, R. J., Choi, M., Heidelman, J. F., Bennett, J. D., & Tholpady, S. (Accepted/In press). Measuring surgical competency in facial trauma: The Arch Bar Placement Assessment Scale. Annals of Plastic Surgery. https://doi.org/10.1097/SAP.0b013e31827aeb37

Measuring surgical competency in facial trauma : The Arch Bar Placement Assessment Scale. / Flores, Roberto L.; Havlik, Robert J.; Choi, Matthew; Heidelman, Joseph F.; Bennett, Jeffrey D.; Tholpady, Sunil.

In: Annals of Plastic Surgery, 12.06.2013.

Research output: Contribution to journalArticle

Flores, Roberto L. ; Havlik, Robert J. ; Choi, Matthew ; Heidelman, Joseph F. ; Bennett, Jeffrey D. ; Tholpady, Sunil. / Measuring surgical competency in facial trauma : The Arch Bar Placement Assessment Scale. In: Annals of Plastic Surgery. 2013.
@article{357400045af5472581ab1760934edfb9,
title = "Measuring surgical competency in facial trauma: The Arch Bar Placement Assessment Scale",
abstract = "BACKGROUND: Surgical education is in a period of significant change. Assessment of surgical competency is imprecise compared with cognitive knowledge and judgment. A surgical competency measurement tool may be useful for plastic surgery training programs and certification societies. We present a validation study of a novel measurement instrument for arch bar placement and dental wire handling. METHODS: An Arch Bar Placement Assessment Scale (ABPAS) was created via consensus by 2 craniofacial and 2 maxillofacial surgeons. Residents and faculty members of plastic and maxillofacial surgery (n = 20) then placed an arch bar on the lower jaw of a skull model. Performances were video recorded without revealing identities. Two study groups were created based on subjects experience level: group 1 (n = 10) previously placed fewer than 25 arch bars; group 2 (n = 10) previously placed more than 25 arch bars. Two craniofacial surgeons used the ABPAS to blindly grade surgical performance. RESULTS: The ABPAS consisted of a 48-point rating scale that included a 23-point task-specific work list and a 25-point global rating scale. Pearson coefficient showed limited intraobserver (P = 0.97) and interobserver (P = 0.95) variance of test scores. The ABPAS demonstrated superior performance in group 2 in the task-specific work list [12.6 (5.5) vs 17.6 (1.5), P = 0.02], global rating scale [17.4 (4.4) vs 22 (2.1), P = 0.01], and ABPAS score [30 (9.8) and 39.6 (3.2), P = 0.01]. CONCLUSIONS: The ABPAS is a novel measurement tool which assesses technical surgical skill and can identify surgical competency in arch bar placement and dental wire handling. This tool may have future use in residency training and continuing education.",
author = "Flores, {Roberto L.} and Havlik, {Robert J.} and Matthew Choi and Heidelman, {Joseph F.} and Bennett, {Jeffrey D.} and Sunil Tholpady",
year = "2013",
month = "6",
day = "12",
doi = "10.1097/SAP.0b013e31827aeb37",
language = "English",
journal = "Annals of Plastic Surgery",
issn = "0148-7043",
publisher = "Lippincott Williams and Wilkins",

}

TY - JOUR

T1 - Measuring surgical competency in facial trauma

T2 - The Arch Bar Placement Assessment Scale

AU - Flores, Roberto L.

AU - Havlik, Robert J.

AU - Choi, Matthew

AU - Heidelman, Joseph F.

AU - Bennett, Jeffrey D.

AU - Tholpady, Sunil

PY - 2013/6/12

Y1 - 2013/6/12

N2 - BACKGROUND: Surgical education is in a period of significant change. Assessment of surgical competency is imprecise compared with cognitive knowledge and judgment. A surgical competency measurement tool may be useful for plastic surgery training programs and certification societies. We present a validation study of a novel measurement instrument for arch bar placement and dental wire handling. METHODS: An Arch Bar Placement Assessment Scale (ABPAS) was created via consensus by 2 craniofacial and 2 maxillofacial surgeons. Residents and faculty members of plastic and maxillofacial surgery (n = 20) then placed an arch bar on the lower jaw of a skull model. Performances were video recorded without revealing identities. Two study groups were created based on subjects experience level: group 1 (n = 10) previously placed fewer than 25 arch bars; group 2 (n = 10) previously placed more than 25 arch bars. Two craniofacial surgeons used the ABPAS to blindly grade surgical performance. RESULTS: The ABPAS consisted of a 48-point rating scale that included a 23-point task-specific work list and a 25-point global rating scale. Pearson coefficient showed limited intraobserver (P = 0.97) and interobserver (P = 0.95) variance of test scores. The ABPAS demonstrated superior performance in group 2 in the task-specific work list [12.6 (5.5) vs 17.6 (1.5), P = 0.02], global rating scale [17.4 (4.4) vs 22 (2.1), P = 0.01], and ABPAS score [30 (9.8) and 39.6 (3.2), P = 0.01]. CONCLUSIONS: The ABPAS is a novel measurement tool which assesses technical surgical skill and can identify surgical competency in arch bar placement and dental wire handling. This tool may have future use in residency training and continuing education.

AB - BACKGROUND: Surgical education is in a period of significant change. Assessment of surgical competency is imprecise compared with cognitive knowledge and judgment. A surgical competency measurement tool may be useful for plastic surgery training programs and certification societies. We present a validation study of a novel measurement instrument for arch bar placement and dental wire handling. METHODS: An Arch Bar Placement Assessment Scale (ABPAS) was created via consensus by 2 craniofacial and 2 maxillofacial surgeons. Residents and faculty members of plastic and maxillofacial surgery (n = 20) then placed an arch bar on the lower jaw of a skull model. Performances were video recorded without revealing identities. Two study groups were created based on subjects experience level: group 1 (n = 10) previously placed fewer than 25 arch bars; group 2 (n = 10) previously placed more than 25 arch bars. Two craniofacial surgeons used the ABPAS to blindly grade surgical performance. RESULTS: The ABPAS consisted of a 48-point rating scale that included a 23-point task-specific work list and a 25-point global rating scale. Pearson coefficient showed limited intraobserver (P = 0.97) and interobserver (P = 0.95) variance of test scores. The ABPAS demonstrated superior performance in group 2 in the task-specific work list [12.6 (5.5) vs 17.6 (1.5), P = 0.02], global rating scale [17.4 (4.4) vs 22 (2.1), P = 0.01], and ABPAS score [30 (9.8) and 39.6 (3.2), P = 0.01]. CONCLUSIONS: The ABPAS is a novel measurement tool which assesses technical surgical skill and can identify surgical competency in arch bar placement and dental wire handling. This tool may have future use in residency training and continuing education.

UR - http://www.scopus.com/inward/record.url?scp=84878783727&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84878783727&partnerID=8YFLogxK

U2 - 10.1097/SAP.0b013e31827aeb37

DO - 10.1097/SAP.0b013e31827aeb37

M3 - Article

JO - Annals of Plastic Surgery

JF - Annals of Plastic Surgery

SN - 0148-7043

ER -