|
|
||||||||
Educational Methodologies |
Key words: dental education, national dental boards, board preparation course, teaching methods, curriculum, prospective study
Submitted for publication 11/07/06; accepted 03/15/07
| Abstract |
|---|
|
|
|---|
The National Board Dental Examination Part I (NBDE Part I) is eight hours in length. The focus of the examination is to assess students comprehension of the basic biomedical sciences knowledge dentists should possess before beginning clinical practice. It consists of four basic biomedical science sections: Anatomic Sciences (gross anatomy, histology, and developmental biology), Biochemistry-Physiology, Microbiology-Pathology, and Dental Anatomy and Occlusion. Each of the four sections consists of 100 questions.1,2
The American Dental Association (ADA) publishes the subject question distribution for each section. The ADA also releases old examinations, which are available in most dental school libraries, the American Dental Association Library, and for purchase from the American Student Dental Association. The ADA provides a free tutorial, enabling candidates who are tested primarily with paper and pen to become familiar with the mechanics of taking this examination using a computer.13
The minimum passing score for the NBDE Part I is 75. The examination score is obtained by multiplying a conversion scale with the number of correct answers selected by the candidate. The conversion scale is determined for each examination and enables the scores to be consistent from one examination to another.1
The percentage of candidates who fail the NBDE Part I varies considerably depending on whether the candidate attended an ADA-accredited or nonaccredited dental school and if the candidate previously failed the examination. In 2003, the percentages of individuals who failed the examination were the following: 9.5 percent for individuals from accredited dental schools and taking the examination for first time; 34.7 percent for individuals from accredited dental schools and repeating the examination; 56.1 percent for individuals from non-accredited dental schools and taking the examination for first time; and 71.7 percent for individuals from nonaccredited dental schools and repeating the examination.1 Non-ADA-accredited dental schools include most schools outside of the United States and Canada.
It is our experience that many dental school faculty perceive that students often do not demonstrate the desired motivation when preparing for this examination. The perception is that dental students tend to just "wing" the examination with the assumption that they can pass without much study time and thus are not interested in taking a preparatory review course.4
| Review of Evidence: Effectiveness of Board Preparation Courses |
|---|
|
|
|---|
Nursing schools throughout the country use a wide variety of techniques to prepare nursing students for their National Council Licensure Examination (NCLEX). The techniques include support groups with other nursing students, organized test plans, data-based item analysis approaches, and peer- advisor programs to help increase pass rates.59 Many nursing programs are located within undergraduate institutions, which generally have preexisting remediation programs. This infrastructure enables the NCLEX to be easily incorporated into the universitys existing undergraduate remediation programs. Many other nursing programs identify students who are at high risk for failure and provide them with in-depth written study plans as well as support until completion of the examination.10,11
In addition to the traditional review courses conducted in classrooms, nursing programs use websites and other computer-assisted online materials. This technology has been used to help students earn certification as medical surgical nurses, complete didactic coursework, and pass the NCLEX.1214 Aside from technology issues and NCLEX support programs, one study evaluated which factors significantly influenced NCLEX passing rates. It found the number of hours a student studied before the examination directly affected his or her pass rate, while studying new course content material had a negative correlation with pass rates.15
Medical schools are similarly interested in their students passing Step 1 and Step 2 of the United States Medical Licensing Examination (USMLE) and have conducted courses to help students prepare for the examination. Studies have indicated that performance on this examination is mostly strongly associated with prior academic performance and not with the completion of a preparation course or use of a commercial study product.1620
Other health professions educators have attempted to predict the performance on their national board examinations. Students at the Texas Chiropractic College were asked to complete the Learning and Study Strategies Inventory (LASSI). The LASSI is a ten-scale, eighty-item assessment of students awareness and use of learning and test-taking strategies, and it also asks students to assess test preparation methods, strategies for recognizing important course material, and time management. The focus of the LASSI is on behaviors, attitudes, and beliefs related to successful learning that can be altered through educational interventions. Pringle and Lee compared students GPAs and LASSI results with National Chiropractic Board of Examiners (NCBE) scores. Their findings revealed that there were moderately high correlations between the NCBE and each LASSI component, while there was low correlation between GPAs and NCBE scores. These authors recommended that the LASSI results be used to determine which students should attend an NCBE preparation course.21
Another attempt to predict performance was addressed with scores from the National Physical Therapy Examination (NPTE). Researchers were interested in whether the professional school GPA and the comprehensive examination scores correlated with NPTE performance. Findings revealed a significant correlation among GPA, comprehensive examination scores, and NPTE performance.22
The literature provides many examples of preparation courses or predictors for national examination success among nursing, medical, and allied health sciences examinations. Dental schools in the past have provided similar courses to their students, but there has been limited investigation of the outcomes of these preparation courses. One strategy that some schools use in their preparation courses is to require that all students pass a mock examination prior to challenging the licensure examination. Successful mock examination performance was found to be correlated with passing the written licensure examination.23,24 Psychiatry and urology residencies have also successfully used mock licensing examinations to prepare their students to pass specialty boards.2528
A recent study specifically addressed the issue of evaluating aspects of the mock examination. The results indicated that no particular aspect of the mock examination had a significant effect on students performance on dental examination scores.29 Another study followed 410 dental school graduates to determine the characteristics of students prone to failing the written national examination and found there was a weak (not statistically significant) correlation between class rank and passing the examination.30
For the Dental Hygiene National Board Examination (DHNBE), Dadian et al. reported that mock examination performance prior to taking the examination predicted DHNBE success or failure for 75 percent of the students.31 These authors recommended the mock examination be used as an additional resource to indicate which students need further preparation for the examination. Similar studies in nursing by Wendt and Slimmer addressed the use of mock examinations and reported similar pass rate prediction.32 Dental hygiene programs have also specifically addressed performance on the DHNBE by developing preparation courses.33 One study compared the students DHNBE performance with GPAs and participation in an external preparation course and found the GPA to be a better predictor for DHNBE performance than participation in the preparation course.34 Other studies have also attempted to look at predictive variables for passing the DHNBE. After evaluating several variables, early course grade averages and mock DHNBE scores strongly correlated with DHNBE performance.35
There is an assumption that mandatory board preparation courses enhance students scores, but the evidence in support of this belief is limited to a small number of studies with inconsistent findings. The literature identifies many other variables that more strongly affect passing national examinations. One significant finding can be gleaned from the research: preparation courses, mock examinations, study groups, and other forms of additional assistance do not adversely affect students as they prepare for the examination. Several of the authors of the studies described in the preceding literature review recommended that students be given the latitude to decide which materials they find most effective for their particular learning style from among the wide variety of study aids available in most of the health professions.
In light of the relatively small amount of information available about the effectiveness of board preparation courses for dental students, this study was conducted to investigate the influence of a voluntary preparation course on student performance on the NBDE Part I and to assess students perspectives about the format and value of the preparation course.
| Methods |
|---|
|
|
|---|
Directors of the courses in the dental school curriculum on each subject addressed on NBDE Part I were asked to provide preparation presentations in the subject areas they taught. Three of the course directors were unable to participate in the NBDE Preparation Course, so other faculty members who were familiar with the material participated. The instructors who provided the presentations placed their presentations and additional preparation material (summary charts, tables, PowerPoint presentations) on Blackboard, an online course management system. All eligible students could freely access the Blackboard material at their convenience. Therefore, students choosing not to attend the presentations could still obtain the material.
The students for whom the preparation course was designed had recently completed their sophomore year of dental school and, at the time of the preparation course in June, were participating in a four-week summer clinical experience, Monday through Thursday. The clinic was only open in the mornings (9:00 a.m. to 12:00 noon), and the students were free in the afternoon unless they volunteered to attend an oral surgery rotation or were performing remediation of a sophomore course. Two-hour presentations for the NBDE Preparation Course were provided in the afternoons (from 1:30 to 3:30 p.m.) during the students second, third, and fourth weeks of this summer clinic.
The school imposed a July 24, 2006, deadline by which every new junior was required to take the NBDE Part I. The deadline prevented procrastinating students from having examination preparation interfere with the beginning of the junior year curriculum, which is a busy and stressful time as students transition into the major component of the clinical curriculum. In accordance with this guideline, the vast majority of students who participated in the board preparation course scheduled their computer or written examination during the three and a half weeks that followed the preparation course and prior to the deadline; all students completed their examinations prior to July 24.
Immediately following the deadline, the entire junior class received a course evaluation survey (see the Appendix) to elicit their opinions about the NBDE Preparation Course. Two focus groups were conducted to allow students an opportunity to provide their perceptions about this course and the process of preparing for the NBDE Part I. One focus group consisted of students who attended many of the preparation presentations, and the other consisted of students who did not attend any of the preparation course presentations. All data regarding dental school GPAs, grades for courses covered by the examination, and NBDE Part I scores were obtained through the deans office.
| Results |
|---|
|
|
|---|
For this class of sophomore students, there were significant associations between the students GPA and their overall examination score (Spearmans rho=.65) and between their GPA and each section score (Spearmans rho for Anatomic Sciences, .60; Biochemistry-Physiology, .52; Microbiology-Pathology, .62; Dental Anatomy and Occlusion, .65). Significant associations were also observed between the course grades corresponding with the content of each NBDE section and the students section scores (Spearmans rho for Anatomic Sciences, .56; Biochemistry-Physiology, .64; Microbiology-Pathology, .54; Dental Anatomy and Occlusion, .49). However, students who attended a subject area review in the preparation course did not obtain significantly better scores for that subject compared with nonattending students (unpaired Students t-test p-values for Anatomic Sciences, .49; Biochemistry-Physiology, .50; Microbiology-Pathology, .42; Dental Anatomy and Occlusion, .22).
The students did not obtain significantly better overall scores (the average of the four subject area scores) for the 2006 NBDE Part I than in previous years (F-test p=.17), in spite of the fact that there was a higher pass rate than in the previous five years. Students attending at least one preparation session did not have significantly better scores than students who attended none of the preparation sessions (unpaired Students t-test p=.70), and two of the students who failed the examination had attended a total of three preparation sessions.
Sixty-four students completed the student survey; key findings are presented in Tables 1
, 2
, and 3
. The most frequent student rating for most of the presentations was "somewhat helpful," while the most frequent rating for the material placed on Blackboard was "helpful" (Table 1
). There was a trend that students found review of old tests more helpful than review of handouts or material posted on Blackboard (Wilcoxon signed-ranks test p=.081).
|
|
|
In the survey, students chose whether attendance at future NBDE Preparation Courses should be required, not required, or were undecided; the percentages of students who chose each category were 5 percent (n=3), 73 percent (n=47), and 22 percent (n =14), respectively. Students also estimated the percent of old national board questions they recognized on their examination (Table 2
). Students most frequently rated the Dental Decks NBDE Part I Cards as the most helpful study aid (n=43), followed by old NBDE Part I tests (n=22) (Table 3
).
The last three questions on the survey asked students what was most helpful from the NBDE Preparation Course and how the course could be improved and requested additional comments. The students found the presentations most helpful when the instructor discussed the reason for the correct and incorrect answers to old NBDE Part I questions. They found the material placed on Blackboard most helpful when the instructor provided summary charts and tables.
Two focus groups were conducted within three weeks following the deadline for taking the NBDE Part I. One focus group consisted of students who attended many of the course presentations (participation focus group), and the other consisted of students who did not attend the preparation presentations (nonparticipation focus group).
Students in the participation focus group stated that the preparation presentations helped them focus on studying for the upcoming board examination, helped them worry less about this examination, and provided them with answers for questions they would have missed if they had not attended the course presentations. The students reinforced survey responses by stating that the presentations were most helpful when the instructor discussed the reasons for the correct and incorrect answers to old examination questions. The students complimented the instructors for placing their PowerPoint presentations and other course material on Blackboard. The students reported that reviewing old NBDE Part I questions was most helpful, but warned this could also give students a false sense of security regarding their level of preparation for the examination. Students felt that providing the preparation course in the afternoons following morning clinic was probably the best time for this review. But students in the focus group strongly felt attendance at the presentations should be voluntary, which is consistent with the survey responses.
Students in the participation focus group also felt they should not receive a dental school grade (that appeared on their transcript) that reflected their NBDE Part I performance (e.g., a higher grade is earned from a higher NBDE Part I score). They expressed the opinion that most of their classmates were worried about passing this examination, but not worried enough to study for a top grade. The students who were interested in going into postdoctoral training focused more attention on the examination, believing a high score would help them obtain acceptance into a postdoctoral program. These students perceived that most of their classmates actually were not particularly concerned with doing exceptionally well on this examination, just wanted to perform well enough to pass, and did not place any value on obtaining a high score.
Students in the nonparticipation focus group were no less worried about this examination or less likely to attend postdoctoral training than their classmates who did attend the preparation course. These students stated that most of their classmates did not attend the board preparation presentations because they wanted to concentrate on the summer clinic that was conducted in the mornings during the same weeks as the prep course and/or felt they studied better by themselves.
Many of the responses from students in the nonparticipation focus group were similar to those of the students who attended the preparation course. Nonparticipant students stated that they did not attend the preparation course because laboratory work from the morning clinic did not allow them to attend. Students also stated they did not attend because they do not learn well in a classroom setting or they had other activities scheduled for the afternoon in which they needed to participate. They similarly felt attendance at the presentations should be voluntary. However, some nonparticipants stated they reviewed preparation course material placed on Blackboard and found it beneficial.
| Discussion |
|---|
|
|
|---|
Through the student survey and focus groups, students informed us that some students learn more effectively by self-study rather than attending a preparation course, and they strongly oppose it being a mandatory attendance preparation course. This view was supported by the findings that 1) students attending at least one preparation session did not have significantly better scores than students who did not attend any of the preparation sessions; 2) students attending a preparation section subject area did not obtain significantly better scores for that subject compared with nonattending students; and 3) students most often rated the preparation course presentations as "somewhat helpful," while most often rated the summary tables and charts placed on Blackboard as "helpful" (Table 1
).
Similar to studies with medical students,1620 physical therapy students,22 and dental hygiene students,34 we found an association between the students GPAs and their national board performance. These studies suggest that students who fail this examination generally have lower GPAs and tend to be the academically weaker students. Medical and dental hygiene schools similarly found completion of a preparation course was not correlated with better examination performance.1620,34
| Conclusion |
|---|
|
|
|---|
Our communication with faculty at other institutions indicates that many dental schools provide some form of NBDE Part I preparation. The results of our study suggest a preparation course may not be the most effective means for preparing dental students for their NBDE Part I. If the faculty of a dental school chooses to provide a preparation course, members should be cognizant that students surveyed in this study related that 1) the course helped them focus on studying for the upcoming board examination; 2) the most helpful presentation style was for the instructor to discuss reasons for the correct and incorrect answers to old NBDE Part I questions (but warn the students that they may develop a false sense of being well prepared for the examination); and 3) summary charts and tables were helpful in preparation for the examination.
Other dental schools may choose to target their at-risk students; this study and historical evidence at our dental school indicates that these students can be identified by their GPAs. The responsible faculty member may desire to counsel at-risk students about their susceptibility for failing and its repercussions, which may motivate these students to devote appropriate time to studying.
Some other dental schools may choose to motivate all of their students to prepare for this examination by requiring them to pass a mock NBDE Part I prior to allowing them to challenge the actual examination. This method has also been shown to predict which students will pass the written examinations.23,24,31,32
Our study demonstrates that attending a preparation course is not a magic bullet for preparing eligible students to pass the NBDE Part I, and some students appear to be able to effectively study on their own.
| APPENDIX. NBDE Preparation Course Evaluation Survey 2006 National Board Preparation Course |
|---|
|
|
|---|
|
|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Thank you for completing this survey and your assistance with improving next years Board Preparation Course.
| Footnotes |
|---|
| REFERENCES |
|---|
|
|
|---|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |