Test performance of a local examination at a nonlocal site for evaluation of surgical clerks

Gary Dunnington, D. Witzke, J. Hassett, L. Reisner, J. Fulginiti, R. Rubeck

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Surgical clerkships frequently use locally prepared examinations or nationally available test item banks as an alternative to Surgery Shelf Examinations from the National Board of Medical Examiners (SSNBME) for student evaluation. This study examines performance of a well-designed, item-analyzed local examination (available nationally through the Association for Surgical Education) at a nonlocal site. A 100-item test with a stratified sample from a 442-item bank was administered to 72 third-year students in addition to the SSNBME. The Pearson product moment correlation coefficient between the two examinations was 0.61 (p <0.001). Test performance between the local site and nonlocal site was compared by the Kuder-Richardson formula 20 for subtest reliability (internal consistency) and difficulty index (percent correct responses) and the point biserial correlation coefficient (correlation of a student's performance on one item with performance on the rest of the items) for test item analysis. Data show that despite fair correlation with SSNBME, significant deterioration in both test item performance and reliability occur with the use of a local examination at a nonlocal site. This likely results from problems with content validity at the nonlocal site. Clerkships that use local examinations or national test bank items are strongly advised to evaluate test performance and revise appropriately before using results for formal student evaluation.

Original languageEnglish (US)
Pages (from-to)236-239
Number of pages4
JournalSurgery
Volume108
Issue number2
StatePublished - 1990
Externally publishedYes

Fingerprint

Coroners and Medical Examiners
Students
Medical Students
Education

ASJC Scopus subject areas

  • Surgery

Cite this

Dunnington, G., Witzke, D., Hassett, J., Reisner, L., Fulginiti, J., & Rubeck, R. (1990). Test performance of a local examination at a nonlocal site for evaluation of surgical clerks. Surgery, 108(2), 236-239.

Test performance of a local examination at a nonlocal site for evaluation of surgical clerks. / Dunnington, Gary; Witzke, D.; Hassett, J.; Reisner, L.; Fulginiti, J.; Rubeck, R.

In: Surgery, Vol. 108, No. 2, 1990, p. 236-239.

Research output: Contribution to journalArticle

Dunnington, G, Witzke, D, Hassett, J, Reisner, L, Fulginiti, J & Rubeck, R 1990, 'Test performance of a local examination at a nonlocal site for evaluation of surgical clerks', Surgery, vol. 108, no. 2, pp. 236-239.
Dunnington G, Witzke D, Hassett J, Reisner L, Fulginiti J, Rubeck R. Test performance of a local examination at a nonlocal site for evaluation of surgical clerks. Surgery. 1990;108(2):236-239.
Dunnington, Gary ; Witzke, D. ; Hassett, J. ; Reisner, L. ; Fulginiti, J. ; Rubeck, R. / Test performance of a local examination at a nonlocal site for evaluation of surgical clerks. In: Surgery. 1990 ; Vol. 108, No. 2. pp. 236-239.
@article{5224058f10e648b49496ae1dedec25c1,
title = "Test performance of a local examination at a nonlocal site for evaluation of surgical clerks",
abstract = "Surgical clerkships frequently use locally prepared examinations or nationally available test item banks as an alternative to Surgery Shelf Examinations from the National Board of Medical Examiners (SSNBME) for student evaluation. This study examines performance of a well-designed, item-analyzed local examination (available nationally through the Association for Surgical Education) at a nonlocal site. A 100-item test with a stratified sample from a 442-item bank was administered to 72 third-year students in addition to the SSNBME. The Pearson product moment correlation coefficient between the two examinations was 0.61 (p <0.001). Test performance between the local site and nonlocal site was compared by the Kuder-Richardson formula 20 for subtest reliability (internal consistency) and difficulty index (percent correct responses) and the point biserial correlation coefficient (correlation of a student's performance on one item with performance on the rest of the items) for test item analysis. Data show that despite fair correlation with SSNBME, significant deterioration in both test item performance and reliability occur with the use of a local examination at a nonlocal site. This likely results from problems with content validity at the nonlocal site. Clerkships that use local examinations or national test bank items are strongly advised to evaluate test performance and revise appropriately before using results for formal student evaluation.",
author = "Gary Dunnington and D. Witzke and J. Hassett and L. Reisner and J. Fulginiti and R. Rubeck",
year = "1990",
language = "English (US)",
volume = "108",
pages = "236--239",
journal = "Surgery",
issn = "0039-6060",
publisher = "Mosby Inc.",
number = "2",

}

TY - JOUR

T1 - Test performance of a local examination at a nonlocal site for evaluation of surgical clerks

AU - Dunnington, Gary

AU - Witzke, D.

AU - Hassett, J.

AU - Reisner, L.

AU - Fulginiti, J.

AU - Rubeck, R.

PY - 1990

Y1 - 1990

N2 - Surgical clerkships frequently use locally prepared examinations or nationally available test item banks as an alternative to Surgery Shelf Examinations from the National Board of Medical Examiners (SSNBME) for student evaluation. This study examines performance of a well-designed, item-analyzed local examination (available nationally through the Association for Surgical Education) at a nonlocal site. A 100-item test with a stratified sample from a 442-item bank was administered to 72 third-year students in addition to the SSNBME. The Pearson product moment correlation coefficient between the two examinations was 0.61 (p <0.001). Test performance between the local site and nonlocal site was compared by the Kuder-Richardson formula 20 for subtest reliability (internal consistency) and difficulty index (percent correct responses) and the point biserial correlation coefficient (correlation of a student's performance on one item with performance on the rest of the items) for test item analysis. Data show that despite fair correlation with SSNBME, significant deterioration in both test item performance and reliability occur with the use of a local examination at a nonlocal site. This likely results from problems with content validity at the nonlocal site. Clerkships that use local examinations or national test bank items are strongly advised to evaluate test performance and revise appropriately before using results for formal student evaluation.

AB - Surgical clerkships frequently use locally prepared examinations or nationally available test item banks as an alternative to Surgery Shelf Examinations from the National Board of Medical Examiners (SSNBME) for student evaluation. This study examines performance of a well-designed, item-analyzed local examination (available nationally through the Association for Surgical Education) at a nonlocal site. A 100-item test with a stratified sample from a 442-item bank was administered to 72 third-year students in addition to the SSNBME. The Pearson product moment correlation coefficient between the two examinations was 0.61 (p <0.001). Test performance between the local site and nonlocal site was compared by the Kuder-Richardson formula 20 for subtest reliability (internal consistency) and difficulty index (percent correct responses) and the point biserial correlation coefficient (correlation of a student's performance on one item with performance on the rest of the items) for test item analysis. Data show that despite fair correlation with SSNBME, significant deterioration in both test item performance and reliability occur with the use of a local examination at a nonlocal site. This likely results from problems with content validity at the nonlocal site. Clerkships that use local examinations or national test bank items are strongly advised to evaluate test performance and revise appropriately before using results for formal student evaluation.

UR - http://www.scopus.com/inward/record.url?scp=0025158096&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0025158096&partnerID=8YFLogxK

M3 - Article

VL - 108

SP - 236

EP - 239

JO - Surgery

JF - Surgery

SN - 0039-6060

IS - 2

ER -