J Dent Educ. 70(4): 378-386 2006
© 2006 American Dental Education Association
Educational Methodologies |
Correcting for Guessing Increases Validity in Multiple-Choice Examinations in an Oral and Maxillofacial Pathology Course
Thomas J. Prihoda, Ph.D.;
R. Neal Pinckard, Ph.D.;
C. Alex McMahan, Ph.D.;
Anne Cale Jones, D.D.S.
Key words: validity, formula scoring, correction for guessing, educational methodology, educational measurement, examination performance, evaluation, multiple-choice questions, short-answer questions, dental education
Submitted for publication 09/21/05;
accepted 12/15/05
A standard correction for random guessing on multiple-choice examinations was examined retrospectively in an oral and maxillofacial pathology course for second-year dental students. The correction was a weighting formula for points awarded for correct answers, incorrect answers, and unanswered questions such that the expected value of the increase in test score due to guessing was zero. We compared uncorrected and corrected scores on examinations using a multiple-choice format with scores on examinations composed of short-answer questions. The short-answer format eliminated or at least greatly reduced the potential for guessing the correct answer. Agreement of corrected multiple-choice scores with short-answer scores (intraclass correlation coefficient 0.78) was significantly (p=0.015) higher than agreement of uncorrected multiple-choice scores with short-answer scores (intraclass correlation coefficient 0.71). The higher agreement indicated increased validity for the corrected multiple-choice examination.
This article has been cited by other articles:

|
 |

|
 |
 
D. W. Chambers, T. J. Prihoda, R. N. Pinckard, C. A. McMahan, and A. C. Jones
Correcting for Guessing on Multiple-Choice Exams
J Dent Educ.,
February 1, 2007;
71(2):
193 - 196.
[Full Text]
[PDF]
|
 |
|
Copyright © 2006 by the American Dental Education Association.