JDE
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


J Dent Educ. 72(3): 265-277 2008
© 2008 American Dental Education Association
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Curtis, D. A.
Right arrow Articles by Finzen, F. C.
Right arrow Search for Related Content
PubMed
Right arrow Articles by Curtis, D. A.
Right arrow Articles by Finzen, F. C.

Educational Methodologies

Dental Students’ Self-Assessment of Preclinical Examinations

Donald A. Curtis, D.M.D.; Samuel L. Lind, Ph.D.; Mark Dellinges, D.D.S.; Gaurav Setia, D.D.S.; Frederick C. Finzen, D.D.S.

Key words: self-assessment, student evaluation, self-directed learning

Submitted for publication 07/30/07; accepted 11/20/07


   Abstract
 Top
 Author information
 Abstract
 Methods
 Results
 Discussion
 Conclusions
 Appendix
 References
 
Accurate self-assessment is an important attribute for practicing dentists and, therefore, an important skill to develop in dental students. Our purpose was to examine the relationship between faculty and student assessments of preclinical prosthodontic procedures. Seventy-six second-year students completed two consecutive examinations and two self-assessments. The examinations involved setting maxillary denture teeth on a model to simulate the clinical procedure of a complete maxillary denture. Results indicated no significant increases in examination or student self-assessment mean scores; however, regression analysis indicated changes in student self-assessment scores explained 16.3 percent of the variation in examination scores. In essence, improvement in student self-assessment predicted improvement in examination scores among dental students completing a preclinical dental procedure.


There are many ways to measure student performance. Traditional assessments involve the assessor (usually faculty) providing formative or summative feedback to the person being assessed (usually student). This is the predominant method in dental schools, and alternatives such as peer assessment or self-assessment are less frequently used, despite being recommended by educators and educational groups.19

Self-assessment is often advocated as a way to share educational responsibility and to develop patterns of reflective learning in students.810 The advantages of self-assessment are said to be especially valuable in formative learning by helping students direct efforts towards information and/or skills that they have not yet developed.9,11 There has been increasing interest in self-assessment because students should have a realistic sense of their own strengths and weaknesses and should be guided towards responsible self-directed learning.12,13 Although self-evaluation skills are integral to the lifelong learning process,14 self-assessment has not been a significant part of curricula in health care education.15

Most educators agree that self-assessment is potentially valuable; however, there has been a reluctance to embrace the use of this technique because of poor agreement between external measures of students’ performance and students’ self-assessments of performance.12,16 Generally, students do not accurately self-assess because they tend to evaluate their potential or historical levels of achievement, rather than actual performance.17,18 Investigators have shown that the highest-achieving students often self-assess with their potential in mind and, as a result, they often underrate themselves.3,17 Conversely, low-achieving students and those with the most confidence often overrate themselves.19 Self-assessment ratings are generally higher than peer ratings20 and correspond with a student’s level of confidence rather than actual performance.21 Evans et al. concluded that students would prefer to have someone else (an expert) assess them rather than complete a self-assessment.22 Because self-assessment can be unsettling, it is difficult to create a school culture in which students are comfortable making judgments about their own performance.7

It is unclear if students can improve their ability to self-assess. Some investigators feel that self-assessment is a behavioral quality that remains consistent across both skill and knowledge tasks as well as over time.21,23 In a study of over 300 medical students, Fitzgerald et al. compared students’ abilities to self-assess performance on a knowledge-based exam and a clinical exam.23 They concluded that students’ self-assessment skills were consistent over a range of skills and tasks. In contrast to this study, other investigators have shown modest improvement in student/faculty agreement when the study design includes multiple self-assessments.5,8,24,25 In a study evaluating preclinical skills of dental students, Geissler noted student scores differed an average of 5 percent from faculty assessments but improved to a 3.3 percent difference after a four-month trial, indicating a modest improvement in the calibration of students to faculty with multiple self-assessment trials.5 Additionally, in a study of eighty-six dental students, Knight et al. showed recognition skills in preclinical exercises improved over a ten-week trial, indicating self-assessment skills can improve examination results.25 Unfortunately, there are few studies that have assessed the consistency of self-assessment over time or between trials.

Confounding the issue of student self-assessment skills is the issue of reliability among faculty ratings.21,26,27 Often, studies comparing student to faculty evaluations include methodological inconsistencies such as lack of reliability, students and faculty using different criteria or scales for assessment, or students rating their effort while faculty rate the product of that effort.21,27

It is difficult to compare self-assessment studies because investigators often differ in the way they define self-assessment. Often, they compare completely different populations and use different external measures to validate the results.21,26,27 Some investigators use self-assessment as a means to compare a student’s skills against faculty criteria used as a benchmark,23 while others have measured self-assessment against various external standards.2,8 External standards of student performance have included knowledge-based written examinations, clinical decision making with objective structured clinical exams, and global ratings by faculty mentors.4,6,7 Most investigations have looked at student/faculty agreement as the basis for determining accuracy in self-assessment. Almost all self-assessment studies have used descriptive statistics, and many have used correlations to show bivariate association, but relatively few have used regression analysis to explain predictive variability. Additionally, most studies have used a cross-sectional design in which one self-assessment effort is compared to one external standard rather than measuring self-assessment over time.27

If we are interested in better understanding the relationship of self-assessment to student performance on examinations, it makes sense to measure at least two self-assessment efforts to determine change in self-assessment over time. It also makes sense to determine the relationships between changes in self-assessment scores over time and examination scores over the same period. For example, do students who improve most from the first to second self-assessment also improve the most on successive examinations? This could be evaluated by comparing faculty/student agreement over successive examinations. To the best of our knowledge, this type of comparative investigation has not previously been completed in dental education and is the rationale for our study. Our purpose was twofold: first, to determine if students who perform well on an initial preclinical examination were more accurate on initial self-assessments; and second, to determine if students who improve more from the first to second self-assessment also improve more on successive examinations.

An area of the curriculum where we felt self- assessment skills could be readily evaluated and developed in dental students was the preclinical technique courses in which psychomotor skills and clinical procedures are taught. Our goal was to complete consecutive preclinical prosthodontic assessments of students’ abilities to assess their own work and determine relationships between student performance on examinations and self-assessment.


   Methods
 Top
 Author information
 Abstract
 Methods
 Results
 Discussion
 Conclusions
 Appendix
 References
 
All seventy-seven second-year dental students (twenty-nine males, forty-eight females) from the 2009 class participated in this study. One student did not finish the second examination, so analysis is based on the seventy-six students who completed the study. Human subject approval was obtained from the University of California, San Francisco Committee on Human Research after review of our protocol. Student confidentiality was maintained. Two identical three-hour preclinical examinations spaced five weeks apart were completed by the students during the first half of their sophomore year.

First and Second Examinations and Self-Assessment
The first examination required students to set maxillary denture teeth against a standardized mandibular cast mounted on an articulator (Figure 1Go). Students were rated on their ability to position denture teeth to an ideal patient setup simulating the clinical equivalent of a maxillary denture with bilateral balanced occlusion. Evaluation criteria included denture tooth position, arch form, midline positioning of teeth, contact in centric relation, and functional measures in working, nonworking, and protrusive movements (see Appendix). The criteria were familiar to students from previous instruction and a review of the evaluation format provided prior to the first examination. Students were advised that the self-assessment performance would count significantly towards their grade. Clear criteria and appropriate incentives were provided, as they have been shown to improve self-assessment accuracy.21,28


Figure 1
View larger version (125K):
[in this window]
[in a new window]

 
Figure 1. A student working on the preclinical prosthodontic examination (denture setup to simulate the clinical equivalent of a maxillary complete denture)

 
Immediately after completing the three-hour denture setup examination, students were given one hour to complete a self-assessment of their denture setup using the form shown in the Appendix. The same form was then used by faculty, using a different color ink, to grade the denture setup, and later by faculty to compare student self-assessments and faculty evaluations to calculate faculty/student agreement (Figure 2Go). The faculty member who graded all maxillary denture setups was masked to student identity. Student grades were based on the combined results of the faculty assessment and accuracy of student self-assessment. After the faculty assessment and self-assessment scores were recorded, the results were shared with the students.


Figure 2
View larger version (106K):
[in this window]
[in a new window]

 
Figure 2. A faculty member evaluates a student’s maxillary denture setup

 
Approximately five weeks after the first examination, and after a modest amount of additional practice, a second identical denture setup examination and self-assessment were completed by the students.

One faculty member graded all examinations. To establish a measure of reliability, the faculty member graded ten denture setups twice—five from each of the two examinations.

Data Analysis
The following data were collected:

  1. Examination score: the total correct points as assessed by faculty.
  2. Student self-assessment: the total correct points as assessed by the student. This score provides a measure of self-assessment skill as perceived by a student. Student responses were measured against the examination that was used as a standard, not against faculty. For example, if the student felt the anterior arch form was ideal, he or she would have circled "ideal" on the examination form (Appendix) and received a point towards the self-assessment score. If the student felt the anterior arch form was not ideal and circled "too wide" on the examination form, he or she would have received no points as a result of not feeling he or she had completed this portion of the examination correctly. Points were considered binary (correct/not correct) with the examination as the criterion for student comparisons.
  3. Validated self-assessment: the total number of points on the examination on which faculty and a student agreed. We view the validated self-assessment score as an external affirmation of the student self-assessment score because it measures both the correct and incorrect student answers consistent with faculty grading, whereas the student self-assessment score reflects only the points a student felt were correctly answered.

For example, in the function section of the examination (Appendix), if a student considered there were working contacts on all seven denture teeth, he or she would circle all seven answers and have a self-assessment score of seven points. If the faculty felt that only five teeth had working contact, then the validated self-assessment score would be five points. As a second example, if a student thought there were working contacts on denture teeth one through five but not six or seven, and the faculty agreed, then the student self-assessment score would be five points while the validated self-assessment score would be seven, since there was agreement between the student and faculty member on all seven points.

We also calculated index scores that measured change for each of the three scores from the first examination to the second, as we anticipated that the changes might provide valuable criteria by which to compare student performance. The following indexes were calculated: 1) {Delta} examination index: change in examination score from the first examination to the second; 2) {Delta} student self-assessment index: change in the student self-assessment score from the first self-assessment to the second; and 3) {Delta} validated self-assessment index: change in the validated self-assessment score from the first self-assessment to the second. The three indices allowed comparisons of improvement, decline, or no change from the first examination to the second for the three evaluation measures. Because some students’ scores decreased from the first examination to the second, resulting in negative differences, 100 was added to the differences, creating positive index values to facilitate statistical procedures such as multiple correlation and regression analysis.

Descriptive measures for all variables were prepared to assess general characteristics of the data and to identify variation among students’ scores on their first and second examinations, student self-assessment, and validated self-assessment scores. Paired t-tests comparing mean differences for each of the three sets of scores were used to determine if statistically significant performance differences existed.

Graphic and numeric measures of association were developed to understand general relationships between faculty scores and the two measures of self-assessment. Pearson’s multiple correlation coefficients were used to evaluate individual bivariate associations among examination scores and measures of self-assessment. Scatter diagrams were also plotted to visually illustrate associations between examination and self-assessment scores.

Regression modeling using SPSS software was used to predict the individual effects of student self-assessment and validated self-assessment scores on examination outcomes for both indexed and non-indexed values. Indexed and non-indexed regression models were also used to predict the individual effects of student self-assessment scores on validated self-assessment scores. This technique allowed us to measure the predictive power of both self-assessment instruments on individual examination performance and change in examination performance over time. Similarly, the indexed and non-indexed approach was also useful for predictions of student self-assessment scores with validated self-assessment scores individually and between examination periods. Nine models were formulated to evaluate these characteristics.

Regression models using indexed scores ({Delta} examination, {Delta} student self-assessment, {Delta} validated self-assessment) were also developed to evaluate changes in student performance. Regression models evaluated change in examination scores as the dependent variable and change in student self- assessment and change in validated self-assessment as independent variables. Because the variables student self-assessment scores and validated self- assessment scores exhibited a high degree of multi-collinearity, these independent variables could not be combined in a multiple regression model; therefore, all models are simple regressions.


   Results
 Top
 Author information
 Abstract
 Methods
 Results
 Discussion
 Conclusions
 Appendix
 References
 
Descriptive measures and statistical t-test results (Table 1Go) comparing differences between first and second examination variables show that mean scores and their respective standard deviations changed insignificantly (p>0.05) among graded exams (130.79 ±17.2 vs. 130.71 ±18.8), student self-assessment scores (122.97 ±27.0 vs. 126.07 ±27.6), and validated self-assessment scores (124.71 ±17.4 vs. 128.67 ±17.4).


View this table:
[in this window]
[in a new window]

 
Table 1. Descriptive statistical measures for variables and t-tests comparing mean differences between first and second examination scores (N=76)
 
The multiple correlation matrix (Table 2Go) shows that associations were very weak between the first and second examination scores (r=0.057), moderately strong between the first and second student self-assessment scores (r=0.592), and moderate between the first and second validated self-assessment scores (r=0.216).


View this table:
[in this window]
[in a new window]

 
Table 2. Correlation matrix for variables (N=76)
 
Correlations between variables were stronger on the second examination compared to the first examination (Table 2Go). For example, between the first and second examinations, correlations for examination scores with student self-assessment scores increased from r=0.225 to 0.370, respectively, and for examination scores with validated self-assessment scores from r=0.340 to 0.429, respectively. A similar increase (from r=0.510 to 0.672) was observed for correlation of student self-assessment scores with validated self-assessment scores. The scatter diagrams in Figures 3Go and 4Go illustrate the increasing association between examination scores with student self-assessment scores across examination periods. As a measure of reliability of the single faculty member that completed all grading, the correlation for a single rater’s evaluation of the same ten examinations twice was r=0.77.


Figure 3
View larger version (12K):
[in this window]
[in a new window]

 
Figure 3. Graphic display of the association (r=0.225) between student self-assessment and exam scores on the first examination

 

Figure 4
View larger version (13K):
[in this window]
[in a new window]

 
Figure 4. Graphic display of the association (r=0.370) between student self-assessment and exam scores on the second examination

 
All of the nine regression models that estimated the effects of student and validated self-assessment scores on examination scores and the effects of self-assessment scores on each other were statistically significant for the models and the independent variable coefficients. The models and coefficients were at least at a significance of F and t=0.05, respectively, with eight of the nine models and coefficients (89 percent) statistically significant at F and t≤0.05, respectively. For all of the models, variance of the independent variables explained from 5.1 percent to 45.2 percent of the variability in the dependent variables (Table 3Go).


View this table:
[in this window]
[in a new window]

 
Table 3. Regression analysis of student self-assessment and validated self-assessment scores on examination outcomes for both indexed and non-indexed values (N=76)
 
Of the nine regression models, six predicted from 5.1 percent to 18.4 percent of the variance in examination scores with self-assessment variability, while the remaining three explained from 26.0 percent to 45.2 percent of the variance in validated self-assessment with variability in student self- assessment. Similarly, six models explained relationships among examination scores and both measures of self-assessment individually (non-indexed models), and three predicted change across examination periods (indexed models) predicting from 5.1 percent to 45.2 percent of the variability in the non-indexed models and from 14.2 percent to 31.8 percent of the variance in the indexed models (Table 3Go).

The predictive power of regression modeling improved significantly from the first examination to the second as demonstrated by both indexed and non-indexed models. For example, independent variables predicting change in scores for the three index models explained 14.2 percent, 16.3 percent, and 31.8 percent, respectively, of the variability of the three dependent variables, indicating that change in self-assessment scores are valid predictors of change in the designated outcome variables over time.

Confirming the observation that the explanatory power of regression modeling increased over time, the predictions of the non-indexed models improved from the first examination to the second as well. As an example, for the non-indexed models, between the first and second examinations, the variation in examination scores explained by student self-assessments increased from 5.1 percent to 13.7 percent and for validated self-assessments from 11.6 percent to 18.4 percent. This trend of prediction improvement between the first and second examinations was also observed by the increase from 26.0 percent to 45.2 percent of the variance in validated self-assessment predicted by the variation in student self-assessment. That the regression modeling predictive results improved over time indicates that the self-assessment instruments gained in their ability to explain and predict changes in student outcomes.


   Discussion
 Top
 Author information
 Abstract
 Methods
 Results
 Discussion
 Conclusions
 Appendix
 References
 
When evaluating the data to determine the relationship of examination scores to self-assessment results, we observed interesting trends that require looking beyond mean values of each group to carefully consider associations among individual student performance variables. For example, mean scores for examination, student self-assessment, and validated self-assessment did not change on a statistically significant basis (p>0.05) from the first examination to the second (Table 1Go). However, comparing correlations between the two examination periods for student self-assessment scores (r=0.592) and validated self-assessment scores (r=0.216) indicates that, for the self-assessment evaluations, there exists a moderate to moderately strong relationship between students’ performance on successive assessments (Table 2Go). Although mean values of the two self- assessment groups did not change between examination periods, individual initial assessment scores were associated with subsequent performance. That is, while the groups did not improve on average, those students who scored well on the first assessment were associated with good performance on the second assessment and conversely. In an article evaluating the self-assessment literature, Ward et al. determined that comparing mean values alone could be misleading,27 which we also observed with our data.

More importantly, although there was no statistically significant improvement in mean scores from the first examination period to the second, the association of examination scores with student self-assessment scores and with validated self-assessment scores strengthened between periods. The examination/student self-assessment correlation increased from r=0.225 to 0.370, the examination/validated self-assessment correlation from r=0.340 to 0.429, and the student self-assessment/validated self-assessment correlation from r=0.510 to 0.672 (Table 2Go; Figures 3Go and 4Go).

These stronger associations in the second examination period indicate that student self-assessment skills became a more accurate predictor of exam performance and instructor-validated self-assessment. At the second examination, while group mean scores failed to improve significantly, individual students rearranged themselves about the mean, so that the association of competent self-assessors with exemplary exam performance and validation of self-assessment became an even stronger indicator of success. The converse held that poor self-assessment skills were more associated with poorer performance in the subsequent period.

Regression analysis showed the predictive value of student self-assessment improved from the first examination to the second (R2 from 0.051 to 0.137). We noted similar improvement in predicting validated self-improvement (R2 from 0.116 to 0.184). This improvement is consistent with Geissler, who found that student self-assessment scores became more closely aligned with faculty assessments over time.5 Geissler’s study suggested that, with self-assessment experience, there was an increased willingness to award marks outside the middle range and a closer faculty/student agreement resulted. The finding by Geissler may help explain our findings that, although mean values did not increase, student/faculty agreement improved on successive examinations. Our findings are also consistent with Knight et al., who found that students who improved in recognition tasks also improved on examination scores and conversely that students who did not improve in recognition tasks did not improve on examination scores.25 Our findings, along with those of Geissler and Knight et al., support the concept that self-assessment practice can modestly improve self-assessment scores, which improves examination scores.

Our finding of consistent mean scores on successive student self-assessment efforts is similar to results of other investigators.10,24,29 In a study of 275 medical students followed over a two-year period, Sobral utilized a behavioral measure called the reflection-in-learning scale (RLS).10 He considered self-assessment measures were a component of reflection-in-learning and showed that 70 percent of the students who had higher (upper quartile) RLS scores maintained them in a second appraisal.10 Fitzgerald et al. found a similar pattern when they followed over 300 medical students over a three-year period and measured consistency of self-assessment on classroom examinations and on objective structured clinical examinations (OSCEs).29 They determined that correlation of self-assessment to faculty assessment varied between r=0.46 and 0.69, depending on the task measured, and found that self-assessment scores remained steady over the three-year period. Our correlation results of examination scores with student self-assessment scores (r=0.225 and 0.370) on the first and second examinations, respectively, were lower than Fitzgerald et al., while our results for examination scores with validated self-assessment scores (r=0.34 and 0.429) for the first and second examinations, respectively, were also slightly lower. Our findings of validated self-assessment scores were consistent with Falchikov, who completed a meta-analysis of forty-four studies on self-assessment in higher education and calculated an average correlation of r=0.39.30

The index regression shows that students who improved in their ability to complete their self- assessment over successive examinations also improved on the self-assessment scores validated by their instructors. The model predicted 32 percent of the variation in scores on the validated self-assessment index with the variance in scores on the student self-assessment index. The student self-assessment score is the student’s perception of correct answers, while the validated self-assessment score reflects agreement between student and faculty about correct and incorrect responses, providing an external validation of student. It is not surprising that, when students improve in self-assessment accuracy, they will improve in their agreement to faculty assessments.

Our findings showed 16.3 percent of the variation in the examination index was explained by variation in the student self-assessment index (Table 3Go). This means, in essence, that change on successive student self-assessments helps explain change in successive examination scores. Although being able to predict 16.3 percent of the variation in the examination score may not seem very predictive, it actually explains more, for example, than Scholastic Aptitude Test scores predict first-year college grade point average (GPA) (8.4 percent) or how much high school GPA predicts first year of college GPA (12.6 percent).31 Therefore, the explanatory power of our model to predict examination results with student self-assessment scores is comparable to or stronger than commonly used predictors of academic performance.

We need to ask how our results might be applied to anecdotal constructs from clinical teaching. When reviewing a clinical procedure completed by a student, faculty will identify areas that might be improved. Some students will understand and positively respond to faculty feedback, while other students will not learn from faculty feedback, resulting in a frustrating experience for both parties. We believe that students who are able to see what the faculty members see and thus recognize both their correct and incorrect actions in completing a clinical procedure may be the students with higher self-assessment scores. Obviously, this anecdotal construct needs to be tested, and this is an area we plan to explore.

A potential reason self-assessments are not used more often in dental education may be the dichotomy between societal pressures and educational needs. On one hand, we live in a society in which mistakes are often perceived as a sign of weakness. Students are naturally reluctant to acknowledge their mistakes, and this can stifle learning.32 On the other hand, reflective learning exercises, such as self-assessment, require students to develop skills in recognizing, understanding, and learning from their mistakes. Resolving this incongruity requires nurturing an environment in which mistakes are openly shared, discussed, and accepted as part of the total learning experience.

Most clinical skills in dentistry and medicine are taught in an apprentice style, and clinical education is primarily based on experimental learning.9 When students don’t learn from faculty mentors or peers, they often learn by their mistakes. Creating an environment in which students are encouraged to understand that their mistakes are an integral part of the educational process is a challenge, but it could lead to improved self-assessment skills, which the current study suggests could result in improved learning.


   Conclusions
 Top
 Author information
 Abstract
 Methods
 Results
 Discussion
 Conclusions
 Appendix
 References
 
We can draw three conclusions from this study:

  1. Although mean self-assessment scores did not improve, the correlation between self-assessment scores and examination scores increased from the first to the second assessments. This finding suggests that students improved their ability to more accurately self-assess their skills.
  2. Improvement in student self-assessment predicted improvement in examination scores among dental students completing preclinical laboratory assessments.
  3. Improvement in instructor-validated student assessments also predicted improvement in examination scores among dental students completing preclinical laboratory assessments.


   APPENDIX
 Top
 Author information
 Abstract
 Methods
 Results
 Discussion
 Conclusions
 Appendix
 References
 
PRDS 127 COMPLETE DENTURE PROSTHODONTICS Student #_________

Directions to Complete Self-Assessment Sheet:

Please circle the appropriate answer that best describes your denture set-up. For example, if you feel your set-up has excessive horizontal overlap, circle excessive and you will get credit for a correct answer. If you circle ideal horizontal overlap when your set-up had excessive horizontal overlap, you will receive no credit. In other words, if you correctly identify all your mistakes, you can receive a 100% score. (The illustrations on this form show an ideal set-up and were included for clarity!)

GENERAL TOOTH POSITION

(circle one answer in each of the three general categories)

Anterior Arch Form:

A. ideal B. too wide C. too narrow

Posterior Arch Form:

A. ideal B. too wide C. too narrow

Maxillary/Mandibular Midline:

A. ideal B. to right of mandibular midline C. to left of mandibular midline


Figure 5

CENTRIC RELATION: Circle all that apply in your denture set-up. In other words, if you feel the maxillary first and second molars were touching the mandibular dentition bilaterally but the two bicuspids bilaterally were not contacting the lower teeth, you would circle the 6 and 7 as shown in the following example (example: (7 6 5 4 | 4 5 6 7). For a second example, if you felt the axial inclination of all 4 maxillary bicuspids had the correct axial inclination, you would circle the 4 and 5 as shown in the following example (5 4 | 4 5) .

maxillary lingual cusp touching (circle if touching) 7 6 5 4 | 4 5 6 7


Figure 6

mandibular buccal cusp touching (circle if touching) 7 6 5 4 | 4 5 6 7


Figure 7

interdigitation (mesio/distal mesh) (circle where correct) 7 6 5 4 | 4 5 6 7

axial inclination of maxillary bicuspids (circle where correct inclination) 5 4 | 4 5

In this section please circle where you feel the overlap is ideal, too much, or too little. For example, if you feel the horizontal overlap of the upper right second molar is ideal, you would circle the I for ideal under #7. If you felt the upper right first molar had too much horizontal overlap, you would circle the + under #6. There is one correct answer for each tooth so you should be circling either I, + or – under each tooth. Follow the same instructions for the vertical overlap of the anterior teeth.


Figure 8

Horizontal overlap of Anterior and Posterior Teeth:


Figure 9

Vertical overlap of Anterior Teeth:


Figure 10

ANTERIOR AXIAL INCLINATION (axial inclination-as related to gingival placement of tooth) Please circle the response that best describes your anterior denture tooth set-up. For example, if the upper tooth #6 has an ideal axial inclination, circle I for ideal. If the upper tooth #6 is too distally inclined, circle D for tooth #6.


Figure 11

Figure 12

FUNCTIONS: In this section please circle the correct answer (s). For example, if in your denture set-up you see contacts on the maxillary right first and second molar in a right working movement but do not see contact on the bicuspids or anterior teeth you would circle 6 and 7, (7 6 5 4 3 2 1 | ). On the left side during a right working movement if you saw balancing contacts on the bicuspids only you would mark 4 and 5; for example (_|_4 5 6 7) .


Figure 13

right working contacts 7 6 5 4 3 2 1 | left balancing contacts _| 4 5 6 7 (pin off table yes no)

left working contacts _| 1 2 3 4 5 6 7 right balancing contacts 7 6 5 4 |_ (pin off table yes no)


Figure 14

protrusive contacts 7 6 5 4 3 2 1 | 1 2 3 4 5 6 7 (pin off table yes no)


   Acknowledgments
 
The authors would like to acknowledge Thomas A. Curtis, D.D.S., for his mentoring and guidance on this study.


   Author Information
 Top
 Author information
 Abstract
 Methods
 Results
 Discussion
 Conclusions
 Appendix
 References
 
Dr. Curtis is Professor, Department of Preventive and Restorative Dental Sciences, School of Dentistry, University of California, San Francisco; Dr. Lind is Associate Professor, School of Economics and Business Administration, Saint Mary’s College of California, Moraga; Dr. Dellinges is Health Sciences Clinical Professor, Department of Preventive and Restorative Dental Sciences, School of Dentistry, University of California, San Francisco; Dr. Setia is Clinical Health Sciences Assistant Professor, School of Dentistry, University of California, San Francisco; and Dr. Finzen is Health Sciences Clinical Professor and Chair of Prosthodontics, School of Dentistry, University of California, San Francisco. Direct correspondence to Dr. Donald A. Curtis, Department of Preventive and Restorative Dental Sciences, D-3212, School of Dentistry, University of California, San Francisco, 707 Parnassus Ave., San Francisco, CA 94143-0758; 415-476-5827 phone; 415-476-0858 fax; Don.Curtis{at}ucsf.edu.


   REFERENCES
 Top
 Author information
 Abstract
 Methods
 Results
 Discussion
 Conclusions
 Appendix
 References
 

  1. Hendricson WD, Andrieu SC, Chadwick DG, Chmar JE, Cole JR, George MC, et al. Educational strategies associated with development of problem-solving, critical thinking, and self-directed learning. J Dent Educ 2006; 70(9):925–36.[Abstract/Free Full Text]
  2. Mast TA, Bethart H. Evaluation of clinical dental procedures by senior dental students. J Dent Educ 1978; 42(4):196–7.[Medline]
  3. Brehm TW. Peer evaluation of fixed partial dentures in a preclinical course. J Dent Educ 1972; 36(2):54–5.[Medline]
  4. Boud DFN. Quantitative studies of student self-assessment in higher education: a critical analysis of findings. Higher Educ 1989; 18:529–49.
  5. Geissler PR. Student self-assessment in dental technology. J Dent Educ 1973; 37(9):19–21.[Medline]
  6. Asadoorian J, Batty HP. An evidence-based model of effective self-assessment for directing professional learning. J Dent Educ 2005; 69(12):1315–23.[Abstract/Free Full Text]
  7. Evans AW, McKenna C, Oliver M. Self-assessment in medical practice. J R Soc Med 2002; 95(10):511–3.[Free Full Text]
  8. Lindemann RA, Jedrychowski J. Self-assessed clinical competence: a comparison between students in an advanced dental education elective and in the general clinic. Eur J Dent Educ 2002; 6(1):16–21.[Medline]
  9. Duffy FD, Holmboe ES. Self-assessment in lifelong learning and improving performance in practice: physician know thyself. JAMA 2006; 296(9):1137–9.[Free Full Text]
  10. Sobral DT. Medical students’ mindset for reflective learning: a revalidation study of the reflection-in-learning scale. Adv Health Sci Educ Theory Pract 2005; 10(4):303–14.[Medline]
  11. Holmboe ES, Prince L, Green M. Teaching and improving quality of care in a primary care internal medicine residency clinic. Acad Med 2005; 80(6):571–7.[Medline]
  12. Davis DA, Thomson MA, Oxman AD, Haynes RB. Evidence for the effectiveness of CME: a review of 50 randomized controlled trials. JAMA 1992; 268(9):1111–7.[Abstract/Free Full Text]
  13. Simon FA, Aschenbrener CA. Undergraduate medical education accreditation as a driver of lifelong learning. J Contin Educ Health Prof 2005; 25(3):157–61.[Medline]
  14. Orest MR. Clinicians’ perceptions of self-assessment in clinical practice. Phys Ther 1995; 75:824–9.[Abstract/Free Full Text]
  15. Lind DS, Rekkas S, Bui V, Lam T, Beierle E, Copeland EM 3rd. Competency-based student self-assessment on a surgery rotation. J Surg Res 2002; 105(1):31–4.[Medline]
  16. Eva KW, Regehr G. Self-assessment in the health professions: a reformulation and research agenda. Acad Med 2005; 80(10):S46–54.[Medline]
  17. Woolliscroft JO, TenHaken J, Smith J, Calhoun JG. Medical students’ clinical self-assessments: comparisons with external measures of performance and the students’ self-assessments of overall performance and effort. Acad Med 1993; 68(4):285–94.[Medline]
  18. Arnold L, Willoughby TL, Calkins EV. Self-evaluation in undergraduate medical education: a longitudinal perspective. J Med Educ 1985; 60(1):21–8.[Medline]
  19. Antonelli MA. Accuracy of second-year medical students’ self-assessment of clinical skills. Acad Med 1997; 72: S63–5.[Medline]
  20. Jacobs RM, Briggs DH, Whitney DR. Continuous-progress education: III. Student self-evaluation and peer evaluation. J Dent Educ 1975; 39(10):535–41.[Medline]
  21. Gordon MJ. A review of the validity and accuracy of self-assessments in health professions training. Acad Med 1991; 66(12):762–9.[Medline]
  22. Evans AW, McKenna C, Oliver M. Towards better understanding of self-assessment in oral and maxillofacial surgery. Med Educ 2001; 35(11):1077.[Medline]
  23. Fitzgerald JT, Gruppen LD, White CB. The influence of task formats on the accuracy of medical students’ self- assessments. Acad Med 2000; 75(7):737–41.[Medline]
  24. Calhoun JG, Woolliscroft JO, Hockman EM, Wolf FM, Davis WK. Evaluating medical student clinical skill performance: relationships among self, peer, and expert ratings. Res Med Educ 1984; 23:205–10.[Medline]
  25. Knight GW, Guenzel PJ, Fitzgerald M. Teaching recognition skills to improve products. J Dent Educ 1990; 54(12):739–42.[Abstract]
  26. Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA 2006; 296(9):1094–102.[Abstract/Free Full Text]
  27. Ward M, Gruppen L, Regehr G. Measuring self-assessment: current state of the art. Adv Health Sci Educ Theory Pract 2002; 7(1):63–80.[Medline]
  28. Berdie R. Self-claimed and tested knowledge. J Educ Psychol Measure 1971; 31:629–36.
  29. Fitzgerald JT, White CB, Gruppen LD. A longitudinal study of self-assessment accuracy. Med Educ 2003; 37(7):645–9.[Medline]
  30. Falchikov NBD. Student self-assessment in higher education: a meta-analysis. Rev Educ Res 1989; 59:395–430.
  31. Zwick RBT, Sklar J. California and the SAT: a reanalysis of University of California admissions data. Research & Occasional Paper Series: CSHE.8.04. Berkeley: University of California, Berkeley, Center for Studies in Higher Education, 2004:1–35.
  32. Edmondson AC. Learning from failure in health care: frequent opportunities, pervasive barriers. Qual Saf Health Care 2004;13(Suppl 2):ii,3–9.



This article has been cited by other articles:


Home page
J Dent EducHome page
E. T. Nance, S. K. Lanning, and J. C. Gunsolley
Dental Anatomy Carving Computer-Assisted Instruction Program: An Assessment of Student Performance and Perceptions
J Dent Educ., August 1, 2009; 73(8): 972 - 979.
[Abstract] [Full Text] [PDF]


Home page
J Dent EducHome page
A. M. Hauser and D. M. Bowen
Primer on Preclinical Instruction and Evaluation
J Dent Educ., March 1, 2009; 73(3): 390 - 398.
[Abstract] [Full Text] [PDF]


Home page
J Dent EducHome page
G. A. Kramer, J. E.N. Albino, S. C. Andrieu, W. D. Hendricson, L. Henson, B. D. Horn, L. M. Neumann, and S. K. Young
Dental Student Assessment Toolbox
J Dent Educ., January 1, 2009; 73(1): 12 - 35.
[Full Text] [PDF]


Home page
J Dent EducHome page
J. E.N. Albino, S. K. Young, L. M. Neumann, G. A. Kramer, S. C. Andrieu, L. Henson, B. Horn, and W. D. Hendricson
Assessing Dental Students' Competence: Best Practice Recommendations in the Performance Assessment Literature and Investigation of Current Practices in Predoctoral Dental Education
J Dent Educ., December 1, 2008; 72(12): 1405 - 1435.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Curtis, D. A.
Right arrow Articles by Finzen, F. C.
Right arrow Search for Related Content
PubMed
Right arrow Articles by Curtis, D. A.
Right arrow Articles by Finzen, F. C.


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS