|
|
||||||||
Critical Issues in Dental Education |
Key words: dental licensure examination, gender, dental school performance
Submitted for publication 11/28/05; accepted 02/01/06
| Abstract |
|---|
|
|
|---|
| Review of Gender Differences on Benchmark Examinations |
|---|
|
|
|---|
Several reports have supported gender differences in performance on critical benchmark examinations such as the DAT, the Perceptual Ability Test (PAT), and National Board Dental Examination Part II.712
The Perceptual Ability Test of the DAT is reported to be a valid cognitive measure for spatial reasoning and ability. Gray and Deem8 reported on relationships between performance on the PAT and performance in eight preclinical technique courses for 19982001 graduates of Temple University School of Dentistry. They hypothesized that general cognitive ability is a major component of general psychomotor ability and that PAT performance might correlate with performance in technique courses. They reported that students with high PAT scores were the best performers based on final preclinical technique course grades, regardless of their entering GPA or DAT academic average subtest scores. Their results showed that PAT scores accounted for a significantly high proportion, approximately 25 percent, of the variance of the final grades in preclinical technique courses. These studies suggest a possible relationship between technical performance and PAT scores. In 2002, Sandow et al.9 reported that PAT scores had some predictive value for dental school performance. In a study correlating admission criteria with dental school performance for UFCD graduating classes 199499, Sandow et al. reported that undergraduate science GPA and the PAT were the only indicators of programmatic progress in their multivariate analysis. In addition, Sandow et al. reported that low PAT scores were the only admission criteria associated with students who were dismissed from the program.
A study by Potter10 in 1986 reported a relationship between PAT scores and gender. Potters analysis of six classes at Indiana University showed male applicants had a higher mean score than females on the three-dimensional PAT of the DAT. Relationships among gender, PAT scores, and technical performance have been reported as well. In 2003, Coy et al.11 reported performance differences by male and female students on the PAT. A correlational analysis of 492 University of Oklahoma College of Dentistry graduates over a ten-year period showed that the PAT maintained a statistically significant capacity for predicting technical performance in dental school. Coy et al.s analysis indicated that males performed better than females on the PAT. In addition, the PAT was predictive of male performance in practical technique examinations but not female performance. While males performed better than females, Coy et al. also stated the practical predictive capacity was limited because the PAT accounted for only 59 percent of the variance on practical examinations. Coy et al. concluded that PAT scores did not predict development of technical skills for males versus females and appeared to have little value beyond a gross screening tool.
Success in dental school should provide a foundation for successful performance on a licensure examination. Performance on a dental licensure exam is important for several reasons. It is often used as an outcome indicator to university administration and to ADA accreditation site visitors regarding the effectiveness of a clinical program. Of greater significance is the outcome for the graduate. Board examination failure often results in a delay in the graduates ability to begin generating income for self-support and for repayment of educational loans and may result in a loss of self-confidence.
It is feasible that some performance predictors for dental school could correlate with predictors for a state licensure examination. Only two studies12,13 have discussed the correlation among benchmark examinations, gender, and performance on dental licensure exams. Fields et al.12 analyzed data from six consecutive graduating classes of 128 women and 323 men. Variables included entering and graduating GPAs, DAT scores, National Board Dental Examination Part I (NBDE I) and Part II (NBDE II) scores, and North East Regional Board of Dental Examiners (NERB) pass/fail status. Men outperformed women in all areas of the DAT except reading comprehension and biology. NBDE I results favored men, and men significantly outscored women on the NBDE II. A comparison of raw data by gender for pass rates on the NERB, NBDE I, and NBDE II showed mean scores for males slightly higher than females. The mean score for the NERB was 56.72 for females and 65.74 for males out of a possible 100 points. However, after controlling for academic performance, the difference in pass rates for males and females was not statistically significant. Fields et al. attributed gender differences to women performing less well on "gatekeeper" board exams.
Casada et al.13 reported on performance predictors for the Texas State Dental Board Examination analyzing data from five consecutive years of graduates (372) from the University of Texas Dental Branch at Houston. Independent variables included gender, age at graduation, DAT score, admission rank, NBDE I and II scores, class rank in dental school, entering and graduating GPAs, and ethnic background. The licensure exam failure rate for the 230 males was 19.6 percent. For the 142 females, the failure rate was 25.4 percent. However, gender was not found to be a statistically significant predictor of licensure exam failure rates. Only class rank in dental school and ethnic background were included in the final regression equation. There was a significant but weak association between class rank and passing the board examination. In addition, candidates of Asian origin demonstrated lower odds of passing the examination compared with other ethnic groups (Caucasian, Hispanic, and African American). The other variables including gender, age at graduation, DAT score, admission rank, NBDE I and II scores, and entering and graduating GPAs were not found to be statistically significant predictors of licensure exam performance.
These reports indicate a variety of variables have been examined to determine whether they predict performance on various tests and outcomes used in dental education. To provide additional insight and answer our questions about the role of gender, we conducted an analysis of performance variables including benchmark preadmission and academic performance parameters, numbers of clinical experiences or procedures completed, senior mock board examination performance, and licensure examination performance. The focus of this analysis was the identification of performance predictors for success on the state licensure examination.
| Methods |
|---|
|
|
|---|
Four categories of response variables were considered: academic measures, clinical productivity, senior mock board examination, and Florida dental licensure examination. The academic variables included composite academic average of the Dental Admission Test (DAT), the Perceptual Ability Test (PAT) of the DAT, grade point average (GPA) upon entering dental school, and dental school GPA upon graduating. Clinical productivity measures were the numbers of specific restorative and periodontal procedures completed during the clinical curriculum. These included numbers of clinical amalgam restorations, Class II composite restorations, Class IV composite restorations, periodontal scaling and root planing procedures, endodontic root canal procedures, and fixed prosthodontic units completed. These were selected because they were consistent with the type of procedures required on the state licensure exam. The senior mock board exam variables consisted of performance on two portions: the clinical portion and the written state laws and rules examination. Performance variables on the state licensure examination consisted of the same clinical and written components. The clinical sections included a patient-based Class II amalgam preparation and restoration (weighted at 25 percent), clinical periodontal scaling and root planing on five teeth (15 percent), dentoform procedures (60 percent) consisting of a Class II composite restoration, a Class IV composite restoration, a Class II amalgam restoration, two fixed prosthodontic preparations, and a root canal procedure on an extracted tooth. Scoring for the clinical mock board and clinical state board exam ranged from "0" for failing to "5" for excellent performance, with an average
3.0 required for "passing" the clinical portion of the examinations. The written portion was an exam on the Florida Dental Practice Act.
The initial analysis was to determine whether performance, as measured by the four groups of variables, differed with gender, both individually and collectively. A one-way analysis of variance was conducted with gender as the explanatory variable. A univariate analysis was conducted for each response variable, and a multivariate analysis of variance was used to determine whether, collectively, the response variables differed with gender. The gender means and standard errors for each variable, as well as the p-value associated with the test for the equality of the means for the genders, were calculated. To gain further insight into factors that were most predictive of the score on the state licensure examination, a stepwise regression using the maximum R2 procedure was used.
| Results |
|---|
|
|
|---|
|
Although only marginally significant, males scored lower on the state board examination on laws governing the practice of dentistry. A similar process was undertaken to try to adjust for the gender effect. After adjusting for academic average, numbers of clinical procedures completed, the estimated mean state law scores were 89.62 for females and 88.81 for males, and these were not significantly different (p=0.1881).
| Discussion |
|---|
|
|
|---|
Of particular interest were our findings related to the PAT. As mentioned in this report, many perceive the PAT has some relationship to technical performance while others do not. In our analysis, males performed significantly better than females on the PAT subtest of the DAT. In addition, the PAT was a predictor for success on the Florida licensure examination. Could the PAT predict performance in clinical settings and on licensure examinations? The design of this study was not constructed to answer that question, but it is an interesting concept. While these results do not recommend the PAT as a performance predictor for licensure examinations, the results could be used to encourage faculty to devote more attention to students who have the combination of low PAT scores and poor performance in preclinical technique courses. This attention would help ensure that they develop cognitive and technical skills at the same pace as their peers.
Hypotheses for gender gaps on high-stakes examinations have been provided by psychologists. Some would attribute differences in performance to low self-esteem among females. This theory, originally proposed by Bandura,14 is known as self-efficacy expectations and refers to a persons beliefs concerning his or her ability to successfully perform a given task or behavior. Applying the self-efficacy theory, Hackett and Betz15 found gender differences with respect to male-dominated careers. Another theory suggested that mere knowledge of cultural stereotypes could affect test performance in high-stakes examinations. Steele16 found this could be true for racial, ethnic, or gender identity. A 2005 report by Minter et al.17 indicated that women in general surgical and plastic surgical residency programs tended to underestimate their abilities compared with their male counterparts. On objective measures employed in the Minter et al. study, the males and females performed equivalently. Males and females underestimated their abilities compared with faculty assessments, but female residents demonstrated a greater degree of underestimation. This difference was small and not statistically significant.
Controlling for academic performance, one would expect prepared students to perform similarly. The slight differences in female performance found in this study, though not statistically significant, might have relevance for attending dental faculty who provide technical feedback and constructive comments.
The results of our analysis showed relationships between performance on the licensure examination and performance on the mock board clinical exam and numbers of amalgams completed. This would seem reasonable as the Class II amalgam preparation and restoration comprise 25 percent of the grade on the senior mock board exam and on the Florida dental licensure exam. Completing a higher number of Class II amalgam restorations could improve the skill level and self-confidence of the graduate.
| Conclusion |
|---|
|
|
|---|
Due to consistency of our findings with similar recent reports,12,13 it might be reasonable to think the gender gap on standard performance measures/outcomes used in dental education is narrowing. Additional studies from other regions would provide support for this concept.
| Footnotes |
|---|
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
L. E. Itaya, D. W. Chambers, and P. A. King Analyzing the Influence of Admissions Criteria and Cultural Norms on Success in an International Dental Studies Program J Dent Educ., March 1, 2008; 72(3): 317 - 328. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Kim and J. I. Lee Variables Predicting Students' First Semester Achievement in a Graduate-Entry Dental School in Korea J Dent Educ., April 1, 2007; 71(4): 550 - 556. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |