|
|
||||||||
Critical Issues in Dental Education |
Key words: aptitude tests, clinical competence, college admission test, dental education, dental licensure, dental schools, dental students, psychometrics, school admission criteria, United States
Submitted for publication 09/10/07; accepted 11/05/07
| Abstract |
|---|
|
|
|---|
Predental college grades and scores on the Dental Admission Test (DAT) are among the criteria used by dental school admissions committees to select candidates out of an extremely competitive applicant pool. Each of the various selection criteria is considered to measure a unique construct, but all are believed to be indicators of a candidates potential for success in dental school and as a dental professional; thus, some overlap between the unique constructs is to be expected. Only one study has previously examined associations among overall predental grade point average (GPA), predental science GPA, and component DAT scores.5
A few reports have described the correlations among various measures of dental school achievement,6,7 as well as those between measures of dental school achievement and performance on dental licensure examinations.8–12 In addition, numerous authors have investigated the relationships between admission criteria and dental school performance.6,7,13–29 In a 2005 review of the literature, Ranney et al. summarized that predental GPA and DAT scores provide dental schools in the United States and Canada with defensible methods for selecting students.30
The purpose of our study was to investigate the associations among several admission criteria, among several measures of dental school achievement, and between admission criteria and measures of dental school achievement for 2000–07 graduates of the University of Iowa College of Dentistry.
| Methods |
|---|
|
|
|---|
Preadmission Credentials
In addition to overall predental college GPA and predental college science GPA, preadmission credentials analyzed included the Academic Average score, Perceptual Ability Test score, and Total Science score from the Dental Admission Test (DAT).
The DAT is conducted by the American Dental Association (ADA) and has been in operation on a national basis since 1950. The testing program is designed to measure general academic ability, comprehension of scientific information, and perceptual ability. All U.S. dental schools require candidates for admission to participate in the dental admission testing program. There are four individual tests contained in the DAT battery: I. Survey of the Natural Sciences (Biology, General Chemistry, and Organic Chemistry); II. Perceptual Ability; III. Reading Comprehension; and IV. Quantitative Reasoning. The entire program requires just over one half-day for administration.31
On the DAT, eight standard test scores are reported: Quantitative Reasoning, Reading Comprehension, Biology, General Chemistry, Organic Chemistry, Total Science (combining Biology, General Chemistry, and Organic Chemistry), Perceptual Ability, and Academic Average (the average of the standard scores on the Quantitative Reasoning, Reading Comprehension, Biology, and General and Organic Chemistry tests). The results are reported in terms of standard scores rather than raw scores or percentile equivalents. The current standard score scale has been used since October 1988. Scores range from 1 to 30. The standard score of 17 typically signifies average performance on a national basis.32
Measures of Dental School Achievement
In addition to overall dental school GPA, dental school achievement measures analyzed in this study included scores on Part I and Part II of the National Board Dental Examination (NBDE), final grade in the course 114:188 Clinical Competencies in Comprehensive Care, and pass/fail status on the students first attempt at the Central Regional Dental Testing Service (CRDTS) licensure examination.
NBDE.
The purpose of the NBDE is to assist state boards in determining qualifications of dentists who seek licensure to practice dentistry. The examination assesses the ability to understand important information from basic biomedical and dental sciences and also the ability to apply such information in a problem-solving context. Although written examinations may be developed at the local level, most licensing boards use the NBDE (Parts I and II) as a major portion of their written examination requirement.
The NBDE is organized into two parts. Part I is usually taken after two years of dental school; it consists of four examinations on the basic biomedical sciences (Anatomic Sciences, Biochemistry-Physiology, Microbiology-Pathology, and Dental Anatomy and Occlusion). Part II is usually taken during the last year of dental school; it consists of a comprehensive, one-and-a-half-day examination covering the clinical dental sciences (Operative Dentistry, Pharmacology, Endodontics, Periodontics, Oral and Maxillofacial Surgery/Pain Control, Prosthodontics, Orthodontics/Pediatric Dentistry, Oral Diagnosis, and Patient Management).
Generally, National Board results are reported in standard scores of 49 to 99. A score of below 75 is considered a failure and does not earn National Board credit. For Part I, one score is reported for each of the four examinations, plus an additional Part I Average Score.33 For Part II, a single comprehensive score is reported.34 (Beginning in January 2007, Part I was restructured to be interdisciplinary in nature and more clinically relevant. Items from the traditional basic and dental science disciplines are now intermingled in Part I, and clinically relevant items are included in the form of testlets.35 During the years considered in this study, all students took the examination in the earlier format.)
Clinical Competencies in Comprehensive Care.
The course 114:188 Clinical Competencies in Comprehensive Care carries more semester credit hours than any other single course in the entire dental curriculum at the University of Iowa College of Dentistry. The course grade is based on evaluation by all clinical instructors who have supervised the student in the comprehensive care (Family Dentistry) clinic during the final thirty weeks of dental school. It is believed that the grade earned in 114:188 represents the clinical facultys most accurate assessment of the students clinical competency at the time of graduation.
The CRDTS Examination.
Prior to 2001, the CRDTS examination consisted of two parts, the Restorative Clinical Examination and the Periodontal Clinical Examination. Scoring for the examination was principally "conjunctive," in that a separate total score was reported for each part, and a failure of one part of the examination necessitated a retake of only that part within an eighteen-month period. From 2001 through 2005, the CRDTS exam was scored using a compensatory scoring system that yielded one overall score. Candidates who failed the exam now had to retake the entire exam rather than retaking only the part(s) they failed as in the past. Beginning with the 2005–06 examination cycle, the Central Regional Dental Testing Service, Inc. adopted the ADLEX format developed by the American Board of Dental Examiners, Inc. (ADEX) as the CRDTS examination. The examination now consists of five separate parts—I) computer-based examination; II) manikin-based endodontics examination; III) manikin-based fixed prosthodontics examination; IV) patient-based periodontal examination; and V) patient-based restorative examination—and utilizes a conjunctive scoring routine; that is, candidates who are unsuccessful with any part of the examination must retake only the part(s) they failed. The CRDTS offers the ADLEX examination in two formats: the Traditional Format (in which the examination is administered in its entirety over the course of three days), and the Integrated Format (in which the examination is administered in segments over the course of eight months to eligible dental students during their senior year in dental school). All University of Iowa dental students in the graduating Classes of 2006 and 2007 who took the CRDTS-ADLEX examination took it in the Integrated Format.
Mean value, standard deviation, range, and number of students were tabulated for five preadmission credentials (DAT Academic Average score, DAT Perceptual Ability Test score, DAT Total Science score, predental science GPA, and overall predental GPA) and five measures of dental school achievement (NBDE Part I average score, NBDE Part II score, overall dental school GPA, final 114:188 clinical grade, and pass/fail of the CRDTS examination on the first attempt) for each graduation year from 2000 through 2007. Pearson product moment correlations (r) were computed for the association of each preadmission credential with each of the other preadmission credentials, of each measure of dental school achievement with each of the other measures of dental school achievement, and of each preadmission credential with each measure of dental school achievement. Utilizing the Wilcoxon-Mann-Whitney two-sample rank-sum test, measures of dental school achievement and preadmission credentials were compared between the group of candidates who passed the CRDTS examination (on the first attempt) and those who failed the examination.
| Results |
|---|
|
|
|---|
|
|
|
|
|
|
|
| Discussion |
|---|
|
|
|---|
While there have been many studies examining the association between admission criteria and dental school performance, there is not as much in the literature concerning correlation of one preadmission credential with other preadmission credentials. In a study of all students admitted to the University of California, San Francisco School of Dentistry in 1996, 1997, and 1998 (Classes of 2000, 2001, and 2002), Gansky et al. reported a very strong association between predental science GPA and overall predental GPA (Spearman correlation co-efficient, rs=0.90).5 This is consistent with the correlation we observed between predental science GPA and overall predental GPA (r=0.936). An association between these two measures is not surprising, since the course grades contributing to predental science GPA are also considered in the computation of the overall predental GPA.
Gansky et al. also found DAT Perceptual Ability scores to have a moderate correlation with overall DAT scores (rs=0.35), DAT scores to be weakly associated with predental science GPA and overall predental GPA (rs=0.22 and 0.21, respectively), and DAT Perceptual Ability scores to have a very weak negative correlation with predental science GPA and overall predental GPA (rs=–0.11 and –0.14, respectively).5 These are not as strong as the associations we report for the same measures in our study.
Measures of Dental School Achievement
Scores on NBDE Parts I and II, four-year dental school GPA, and final grade for the clinical course 114:188 remained fairly consistent through the years for 2000–07 graduates of the University of Iowa College of Dentistry. The CRDTS pass-fail outcome (on the candidates first attempt) ranged from 6 percent to 9 percent for the years 2000 through 2004, but the failure rate increased sharply in the last three years, with 15 percent failing in 2005, 22 percent in 2006, and 21 percent in 2007. The increased failure rate on the CRDTS examination is likely attributable, at least in part, to substantial changes in the format and scoring of the examination.
Several previous studies have investigated the possible association between various measures of dental school achievement, including overall dental school grade point average, performance in preclinical courses and clinical courses, scores on NBDE Parts I and II, and performance on clinical licensure examinations.
In an investigation of students matriculating through the University of Texas Health Science Center at San Antonio (UTHSCSA) Dental School between 1993 and 1996, Hermesch et al. found dental school GPA to be strongly correlated with scores on National Board Part I (r=0.74 for Early Acceptance students; r=0.60 for "standard admissions" students) and Part II (r=0.72 for Early Acceptance students; r=0.64 for "standard admissions" students).6 In a study of 836 D.D.S. graduates of the Baltimore College of Dental Surgery/Dental School, University of Maryland, during the years 1994 through 2002, Ranney et al. reported a strong correlation of four-year dental school GPA with NBDE Part II scores (r=0.75; rs=0.75).38 These are consistent with our findings that four-year dental school GPA was strongly correlated with scores on National Board Part I (r=0.757) and Part II (r=0.696)
In a study of eighty-four students at the Harvard School of Dental Medicine who graduated during the period 2002–04, Park et al. found no significant correlation between NBDE Part I scores and clinical productivity or clinical performance.7 In our study, we found a weak correlation (r=0.339) between the final clinical grade for course 114:188 Clinical Competencies in Comprehensive Care and scores on National Board Part I.
In our study, we also report that four measures of dental school achievement were higher for the group who passed the CRDTS examination than for those who failed. Previous reports in the literature are somewhat contradictory on the association between performance on regional licensure examinations and measures of dental school achievement. In a 1981 study of new graduates of two dental schools, Hangorsky found no correlation between their academic rank as fourth-year dental students and their performance on the North East Regional Board (NERB) clinical examination.8 In a study of 202 students at the Columbia University School of Dental and Oral Surgery from 1994 to 1997, Formicola et al. found no correlation between student performance on in-school clinical examinations and NERB examinations.9 In a study of 835 D.D.S. graduates of the Baltimore College of Dental Surgery/Dental School, University of Maryland from 1994 through 2002, Ranney et al. reported that "NERB examination results from one dental school failed to be a good measure for detecting the quality of those graduates as determined by the dental schools faculty."11 However, in a study of 524 University of Florida College of Dentistry graduates from 1996 to 2003, Stewart et al. identified a strong correlation between academic rank in dental school and performance on the Florida dental licensure exam.12
Correlation Between Predental Credentials and Measures of Dental School Achievement
In our study, scores on the National Board Parts I and II were moderately correlated with DAT Academic Average scores (r=0.610 and 0.524), DAT Total Science scores (r=0.582 and 0.469), predental science GPA (r=0.527 and 0.460), and overall pre-dental GPA (r=0.497 and 0.433). These are higher correlations than the national trends for 2000–04, which showed scores on the NBDE Parts I and II were less strongly correlated with the DAT Academic Average score (r ranged from 0.420 to 0.516 for Part I and from 0.305 to 0.365 for Part II), DAT Total Science score (r ranged from 0.394 to 0.478 and from 0.243 to 0.330), predental science GPA (r ranged from 0.271 to 0.380 and from 0.185 to 0.323), and overall predental GPA (r ranged from 0.262 to 0.357 and from 0.180 to 0.334).26
Other investigations of the predictive value of DAT scores on NBDE scores reported correlations in the same range. In a study of 114 students matriculating at the University of Mississippi School of Dentistry from 1992 through 1995, De Ball et al. reported that DAT scores were moderately correlated with subtest scores on the NBDE Part I (r ranged from 0.460 to 0.553). Multiple regression analyses revealed that DAT Perceptual Ability Test scores were not significant predictors of scores on the NBDE Part I.21 In an investigation of students matriculating through the University of Florida College of Dentistry from 1990 through 1995 (the graduating classes of 1994 through 1999), Sandow et al. found predental science GPA to be moderately correlated with scores on the NBDE Part I (r=0.309), Part II (r=0.280), and overall dental school GPA (r=0.425). They found DAT Academic Average scores to have stronger correlations with scores on the NBDE Part I (r=0.507), Part II (r=0.433), and dental school GPA (r=0.317). DAT Perceptual Ability scores had a weaker correlation with scores on the NBDE Part I (r=0.263), Part II (r=0.304), and dental school GPA (r=0.198).20 In a study of 244 students who matriculated at the Harvard School of Dental Medicine during the period of 1995–2002, Bergman et al. reported that DAT scores were relatively poor predictors of NBDE Part I subtest performance.28 In an investigation of 225 students in the first three classes at the University of Nevada, Las Vegas, School of Dental Medicine, Kingsley et al. reported that certain DAT section scores were significantly correlated with the NBDE Part I (r ranged from 0.122 to 0.304) and with four-year dental school GPA (for the initial cohort class of seventy-four students, r ranged from 0.064 to 0.332).29
Hermesch et al. found predental GPA to have some correlation with dental school GPA (r=0.50 for Early Acceptance students; r=0.42 for "standard admissions" students), and scores on the National Board Part I (r=0.39 for Early Acceptance students; r=0.28 for "standard admissions" students) and Part II (r=0.48 for Early Acceptance students; r=0.29 for "standard admissions" students).6 Kingsley et al. reported a weak correlation of predental science GPA and overall predental GPA with the NBDE Part I (r=0.227 and 0.222) and with four-year dental school GPA (r=0.217 and 0.224).29
In our study, the DAT Perceptual Ability score was observed to be the best predictor of the grade earned in 114:188, but the DAT Perceptual Ability score only accounted for less than 8 percent of the variation in the 114:188 grade (r=0.280). Similar findings have been previously reported by others. Park et al. reported that clinical performance on operative procedures was significantly associated with predental science GPA and DAT biology section score, but found no statistically significant predictors of clinical performance for major restorative or removable prosthodontic procedures. They concluded that it is possible that the overlap in skill sets required for success in the predental/preclinical and clinical areas is minimal.7 In an investigation of students from the Temple University School of Dentistry graduating classes of 1998 to 2001, Gray and Deem found a significant correlation of the DAT Perceptual Ability score with grades in preclinical technique courses (r=0.496), but a weak correlation of either the DAT Academic Average score or overall predental GPA with grades in preclinical technique courses (r=0.188 and 0.173, respectively).22 In another study regarding the same students, Gray et al. reported a weak to in-significant correlation of the DAT Academic Average scores and DAT Perceptual Ability Test scores with final grades in clinical courses (r=0.068 and 0.051, respectively).23
| Conclusions |
|---|
|
|
|---|
Among the measures of dental school achievement, the strongest association was observed between NBDE scores and four-year dental school GPA. All three of these variables were also moderately correlated with the final grade in the clinical course 114:188. This suggests that there is likely overlap between the constructs measured by these variables, with greater overlap occurring between NBDE scores and four-year dental school GPA. All of the measures of dental school achievement were slightly stronger for candidates who passed the CRDTS examination than for those who failed that exam, suggesting that some overlap may occur between the construct identified by the CRDTS examination and the other four variables.
Of the predental credentials considered, pre-dental science GPA and overall predental GPA were the best predictors of four-year dental school GPA. Again, it could be argued that the constructs identified by these measures overlap. The DAT Academic Average score was the best predictor of NBDE scores. Although the DAT Perceptual Ability score was the best predictor of clinical competency at the time of graduation (as measured by the grade earned in 114:188), these two variables were only weakly correlated. The DAT Perceptual Ability scores and overall predental GPA were slightly higher for candidates who passed the CRDTS examination than for those who failed that examination.
In summary, then, the results of this study suggest that students who demonstrate strength in one didactic or cognitive measure may be more likely to achieve high scores on other didactic or cognitive measures. Students who have done well on standardized, multiple-choice, fill-in-the-dot tests are likely to do well on subsequent standardized, multiple-choice, fill-in-the-dot tests. Students who earn a high grade point average in undergraduate school are likely to earn a high GPA in dental school. This is, in essence, the rationale used by dental school admissions committees when they rely heavily on GPA and DAT scores in making admission decisions. And it seems to work reasonably well if we only consider didactic and cognitive measures such as National Board Dental Examination scores and dental school GPA to be the ultimate measure of success in dental education. But while these are important benchmarks of dental school achievement, the admissions process should identify applicants who are likely to excel on other measures of dental school achievement as well. Moreover, the process should identify applicants who show promise of becoming successful oral health practitioners (and future dental faculty members39). As Chmar et al. note, "Dental schools . . . have the responsibility to administer a broadly considered and fair process that enables the selection of a diverse body of capable students, giving rise to competent graduates and practitioners who can best serve the profession, the publics health, and the public good."40 However, even a valid admissions process that reliably selects the "right" students is not a guarantee that students will achieve their full potential in dental school. It is the duty of dental school faculty to design, implement, and perpetually refine relevant curricula in order to facilitate the development of capable students into complete, competent professionals. This is an extremely worthwhile area for continuing discussion, investigation, and innovation.
| Acknowledgments |
|---|
| Footnotes |
|---|
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
N. Lopez, K. Self, and J. Karnitz Developing a Tool for Systematic Inclusion of Non-Academic Factors in Dental School Admissions: Towards Building Diversity in the Dental Workforce J Dent Educ., December 1, 2009; 73(12): 1347 - 1352. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |