JDE
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
QUICK SEARCH:   [advanced]


     

J Dent Educ. 70(4): 428-433 2006
© 2006 American Dental Education Association
This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Haj-Ali, R.
Right arrow Articles by Feil, P.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Haj-Ali, R.
Right arrow Articles by Feil, P.

Milieu in Dental School and Practice

Rater Reliability: Short- and Long-Term Effects of Calibration Training

Reem Haj-Ali, B.D.S., D.D.S., M.S.; Philip Feil, Ed.D.

Key words: calibration, measurement, reliability

Submitted for publication 09/13/05; accepted 12/22/05

The purpose of this investigation was to evaluate the immediate effects of calibration on inter-rater agreement to a gold standard (GS) and to determine whether the effects can be sustained over a ten-week period. Valid criteria for a Class II amalgam preparation, a three-point rating scale, and a grade form were developed. Three tests were administered: prior to calibration training, immediately following training, and ten weeks later. Each test consisted of faculty independently evaluating ten prepared teeth. Agreement with GS scores for most of the grading criteria improved as a result of training and did not deteriorate over time. The overall percent agreement was 54.5, 66.9, and 64.6 percent across test periods. The most impressive gains in agreement occurred when the criteria evaluated had a GS score of either "standard not met" or "ideal." There was very little gain when the gold standard score was "acceptable." It is concluded that, with training, inter-rater agreement with a gold standard can improve and such improvement is reasonably resistant to deterioration after ten weeks. Nevertheless, future training ought to consider the use of a mastery approach in calibration training to ensure that a satisfactory degree of agreement with the GS is obtained.




This article has been cited by other articles:


Home page
 J Dent EducHome page
K. V. Garland and K. J. Newell
Dental Hygiene Faculty Calibration in the Evaluation of Calculus Detection
J Dent Educ., March 1, 2009; 73(3): 383 - 389.
[Abstract] [Full Text] [PDF]

Home page
 J Dent EducHome page
A. M. Hauser and D. M. Bowen
Primer on Preclinical Instruction and Evaluation
J Dent Educ., March 1, 2009; 73(3): 390 - 398.
[Abstract] [Full Text] [PDF]

Home page
 J Dent EducHome page
J. E.N. Albino, S. K. Young, L. M. Neumann, G. A. Kramer, S. C. Andrieu, L. Henson, B. Horn, and W. D. Hendricson
Assessing Dental Students' Competence: Best Practice Recommendations in the Performance Assessment Literature and Investigation of Current Practices in Predoctoral Dental Education
J Dent Educ., December 1, 2008; 72(12): 1405 - 1435.
[Abstract] [Full Text] [PDF]

Home page
 J Dent EducHome page
M. E. Jacks, C. Blue, and D. Murphy
Short- and Long-Term Effects of Training on Dental Hygiene Faculty Members' Capacity to Write SOAP Notes
J Dent Educ., June 1, 2008; 72(6): 719 - 724.
[Abstract] [Full Text] [PDF]

Home page
 J Dent EducHome page
F. W. Licari, G. W. Knight, and P. J. Guenzel
Designing Evaluation Forms to Facilitate Student Learning
J Dent Educ., January 1, 2008; 72(1): 48 - 58.
[Abstract] [Full Text] [PDF]


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
Copyright © 2006 by the American Dental Education Association.