|
|
||||||||
Milieu in Dental School and Practice |
Key words: dental education, dental students, curriculum, stress
Submitted for publication 05/05/05; accepted 07/07/05
| Abstract |
|---|
|
|
|---|
| Background |
|---|
|
|
|---|
The American Dental Education Association obtains opinions about curricular content/emphasis (e.g., too much, too little, about right) from graduating seniors annually and communicates this information to schools, but these reports provide no qualitative data (i.e., students perceptions of their learning experiences) to guide curricular decision making. A Medline review encompassing 19782003 identified twenty-eight interview or survey-based studies for dental education that reported the perceptions and opinions of enrolled students or recent graduates about the process and structure of predoctoral education, program strengths and weaknesses, and adequacy of preparation for practice and/or recommendations for program modifications. These studies went beyond the typical course questionnaires employed to solicit student feedback about individual components of a curriculum.
These twenty-eight studies addressed a variety of issues including student values,4 student and graduate perceptions of their academic preparation for professional roles,58 evolution of attitudes about career choice,22 graduates perceptions of training in various oral health specialties,912 self-perceived competence at graduation,1314 graduates use of techniques taught in dental school,15 student assessment of curriculum changes or school closing,1619 impact of the learning environment on student values,20 impact of learning environment on student perception of stress,2,2124 graduates perception of their profession and themselves as care providers,2526 perceptions of students about providing dental care to others outside the main dental facility,27 students perspectives about HIV infections and AIDS,28 and students perspectives on various curriculum delivery formats including online instruction and other aspects of electronic curriculum.2930
However, only two of the twenty-eight studies involved a nationwide sample of students and requested a comprehensive assessment of their dental school experience. One of these involved an unpublished study of student opinions about their dental education in Sweden and Finland (reported in Farge et al.17); the other, by Gerbert et al., reported data from U.S. dental students collected between 1980 and 1982.31 The Gerbert study was the catalyst for the current "senior survey" conducted by ADEA about the appropriateness of content emphasis in the dental school curriculum. Gerbert et al. surveyed 362 dental school graduates regarding the adequacy of their dental education for opening a practice and practicing dentistry. Seventy-five curriculum topics were listed, and the graduates ranked their level of preparedness on a five-point scale. Ten areas in which the graduating students felt well prepared centered in preventative dentistry, restorative dentistry, and radiology. Ten of the areas in which the students felt least prepared were from behavioral sciences, practice management, and orthodontics. Although this study yielded valuable information about students perception of topic coverage, no data on the students impressions of favorable and unfavorable aspects of the dental school environment were obtained.
In summary, our review of the literature found no reports of a broad-based, multischool assessment of U.S. dental students qualitative impressions of their educational experience and the learning environment in dental school. There has been extensive commentary about the future structure, scope, and goals of dental education by faculty, practitioners, and blue ribbon study commissions for an entire decade since the IOM report.3235 But there has been no effort to determine the opinions and recommendations from the other side of the tablefrom the students who consume the educational "meal" served to them. As the old saying goes, "If you are serious about evaluating the quality of a meal, you dont ask the chef; you ask the people who paid for it and who ate it."
It is imperative for curriculum committees and administrators to not only evaluate selected portions of a dental school but also to address the entire efficiency of the program. Course evaluations are used to identify strengths and weaknesses of courses but may fail to address other important issues related to dental school education because they do not ask the student to reflect on the overall curricular experience and entire learning environment with the school. Thus, negative perceptions that could have unforeseen consequences on student performance during school and their overall satisfaction with the profession may go undetected in spite of an elaborate system to individually evaluate each course in the curriculum. For example, Hendricson et al.36 identified that U.S. and Canadian dental schools have devoted major effort to enhancing information technology capacity and incorporating electronic curriculum into the students educational experiences (for example, online courses, required purchase of laptops with embedded software, wireless classrooms, convenient access to email and the Internet, electronic patient record systems). However, nearly 1,000 dental students who participated in a fifteen-school study by Hendricson et al. in 2004 were largely skeptical about the value of e-curriculum from educational and financial perspectives.37
Learning Environment Assessment Instruments
Beginning in the 1970s, a number of survey-based instruments were developed to assess students perceptions of their learning experiences and the overall environment within a school. Educators were stimulated to examine the influence of school environment on student performance by a series of reports that indicated that students perceptions of their schools educational, emotional, and social environment were stronger predictors of academic performance in universities than prior achievement in secondary school.38 Learning environment research became a major line of inquiry in secondary and higher education, and a journal specifically devoted to this area of inquiryLearning Environment Researchemerged in the 1990s. A variety of instruments were developed for college and university education including the Classroom Environment Scale, The Learning Environment Inventory, and the College and University Environment Inventory.39
Health professions educators also developed interest in exploring students opinions about their learning experiences. The catalyst for a number of instruments developed to explore the unique environment of health professions was the Medical School Learning Environment Survey (MSLES) originally created in the 1970s by Marshall. The first published use of the MSLES was a 1978 analysis of medical students perceptions of the education they received in the Chicago Medical School.40 Marshall developed the MSLES to identify perceptions of the learning environment, intellectual climate, social environment, and student-teacher relationships and determine how these components affected student stress and academic performance. The MSLES quickly caught on among medical schools and became an "instrument of choice" during the 1980s and 1990s to help faculty understand how students felt about the learning climate in school.41 Medical school administrators believed if they could identify areas in the educational process leading to medical students dissatisfaction, corrective action could be implemented in the curriculum. The MSLES spawned a number of similar environmental assessment instruments that closely followed the MSLES format and used many of the same items including the Clinical Post Conference Environment Survey (CPCLES)42 and the Clinical Learning Environment Inventory (CLEI)43 in nursing education, the Dundee Ready Education Environment Measure (DREEM) in medical education,4445 and several others.46
The original MSLES contained fifty items although subsequent versions contained fifty-five items subdivided into seven scales. The MSLES was developed to measure student perceptions of 1) the extent of opportunities for faculty and students to modify the learning environment and the degree of control imposed on students (Flexibility); 2) the extent to which students in different years and the same year mix socially and academically (Student-to-Student Interactions); 3) the way in which students experiences in their courses affects their nonintellectual (affective) perceptions of the schools environment (Emotional Climate); 4) the extent of staff support and encouragement provided to students (Supportiveness/Nurturance); 5) the degree to which structured learning activities are seen to be relevant to the practice of medicine (Meaningful Experience); 6) the degree of overall cohesion and coherence of learning experiences within the curriculum (Organization); and 7) the extent to which students are encouraged to develop and sustain extracurricular activities outside of regular coursework (Breadth of Interest). Four of the MSLES scales (Breadth of Interest, Student Interaction, Organization, and Flexibility) came from a previous school environment survey developed by Rothman and Ayoade,47 while the other three scales (Meaningful Learning Experience, Emotional Climate, and Supportiveness/Nurturance) were based on Marshalls work with medical students to determine sources of stress and academic dysfunction. Table 1
includes the seven MSLES scales, definitions of each scale, and examples of items in each category.
|
Feleti and Clarke demonstrated the reliability of the instrument by calculating the internal consistency (Cronbachs alpha) of the MSLES subscales at two Australian medical schools using samples of 165 and 112 students. At one school with a traditional, lecture-based curriculum, internal consistency ranged from lows of 0.56 for the Flexibility and Breadth of Interest scales to 0.76 for Supportiveness with an overall alpha of 0.89. At a school with a problem-based learning curriculum, internal consistency ranged from 0.70 for Flexibility and Social Interaction to 0.82 for Supportiveness with an overall alpha of 0.94.48 Marshall reported an overall reliability of 0.92.40 Feleti and Clarke subsequently demonstrated that the MSLES had a strong overall test-retest reliability of 0.75.49 MSLES results are reported in the form of means and standard deviations of each of the seven subscales. On previous administrations of this learning environment assessment inventory, means for each subscale typically ranged from 1.50 to 3.00. Higher scores indicate a more positive and supportive learning environment, and lower scores indicate an environment that is potentially less desirable. For example, in Marshalls original usage of the MSLES with medical students, the subscale Meaningful Learning Experience received the lowest mean score (1.9) while Supportiveness/Nurturance was rated the highest by students (2.8).40
In order to gain a better appreciation of dental students perceptions of their education, the MSLES was slightly modified by one of the coauthors in the early 1990s to create a parallel instrument for dental school known as the DSLES (Dental Student Learning Environment Survey). The DSLES is identical to the MSLES except for one item where "dentistry" replaces "medicine" and two items where "dentist" replaces "physician." For example, the MSLES statement "Students feel that they are learning what they need to learn in order to become competent physicians" is "Students feel that they are learning what they need to learn in order to become competent dentists" in the DSLES. The DSLES consists of the same subscales as the MSLES as previously described: Flexibility, Student-to-Student Interaction, Emotional Climate, Supportiveness, Meaningful Experience, Organization, and Breadth of Interest. The four-point rating scale was identical to the MSLES except for changing "more often than not" to "fairly often" based on feedback from previous student users of the DSLES who recommended that the phrase "fairly often" was easier to understand and constituted a more representative response. The DSLES was used to monitor impact of curriculum changes at two dental schools in 1990 and 1993, and the reliability of the DSLES was also assessed based on responses from a total of 163 dental students (Personal communication from William Hendricson). Internal consistency of the DSLES scales ranged from .67 to .86 with an overall alpha of .91, which is similar to other reports.
The DSLES is one of three components of a larger project entitled the Students Perspective Project (SPP), a study funded by the Council of Sections Project Pool of the American Dental Education Association. The overall goal of the SPP was to identify areas of strengths and weaknesses within dental education from the students perspective and provide administrators with target areas for improvement. The two other forms used in the SPP were the Clinical Education Instructional Quality Questionnaire (ClinEdIQ) and the Curriculum Strengths, Weaknesses, Opportunities, and Threats (C-SWOT) survey. The ClinEdIQ is a validated instrument that has been used in several health professions to measure learners perceptions of instructional quality in four components of clinical experience: teacher activities, learner involvement, learning opportunities, and environment for learning. Junior and senior dental students and graduate students completed the ClinEdIQ at each participating SPP school. The Curriculum SWOT questionnaire, which employs an open-ended, write-in format, was completed by sophomore and junior students and graduate students at each SPP school to obtain student perceptions of the overall quality of predoctoral dental education including curriculum strengths, curriculum weaknesses, opportunities for improvement, and threats to program viability and attractiveness to applicants. Results from the ClinEdIQ and the C-SWOT surveys will be published subsequently.
| Methods |
|---|
|
|
|---|
|
When the study was originally designed, the project called for twenty-five freshman and twenty-five junior students from the participating schools to complete the survey. Due to the larger than expected number of schools that agreed to participate in the study, the original numbers requested were decreased to fifteen students per year (thirty respondents per school). However, several schools submitted more than the requested fifteen each from freshman and junior students. This brought the average number of respondents to twenty-seven, which was close to the thirty students per school that was the original sample size target. Overall, a total of 619 dental students completed the DSLES (360 freshmen and 259 juniors) during the spring semester of 2003.
| Results |
|---|
|
|
|---|
|
|
|
| Discussion |
|---|
|
|
|---|
Breadth of Interest was identified as one of the two highest rated subscales for both groups of students. This subscale focuses on the facultys ability to address areas of interest outside the field of dentistry. This could be interpreted to mean that both freshmen and juniors believed that the dental school faculty valued the world outside of the realm of dentistry and encouraged students to pursue nondental interests. The subscale titled Meaningful Learning Experience was another favorable area of the students dental education. This subscale addresses the degree to which structured learning activities were seen as relevant to the practice of dentistry and individual items addressed the relationship between basic science and clinical experience. Both groups of students were apparently encouraged by the facultys ability to combine experiences to make their overall learning purposeful.
As mentioned earlier, one area of concern for the freshman class centered on the Emotional Climate of the dental school experience. Marshall identified Emotional Climate as the students affective (nonintellectual) responses to their experiences within courses. The emotional reaction to freshman courses might lead students to develop a perception that all future courses and instructors will hold similar characteristics of recently completed courses. It would benefit dental education to identify what areas of the freshman curriculum are most problematic for students. By addressing these issues, freshman students might not develop potentially negative attitudes that carry over into subsequent components of their dental education.
Junior students were most concerned with Faculty Supportiveness. This subscale was originally titled "Nurturance" when first used by Marshall. The term "Faculty Supportiveness" references the students perception of the facultys and administrations level of concern for the students welfare. The results indicate junior students are not entirely satisfied with the amount of support or nurturance received from faculty. Assessment of the data from the previously described ClinEdIQ instrument, which specifically focuses on teaching and learning issues in the clinic, may shed additional light on student perceptions of faculty support and nurturance in the clinical years.
Overall, the mean scores from this administration of the DSLES at eighteen North American dental schools were somewhat different from means reported by other investigators. Table 6
compares the mean scores obtained in this study of 619 freshman and junior dental students to five other reported administrations of the original MSLES involving a total of approximately 2,000 medical students40,48,49 and two previous DSLES administrations involving 163 dental students. For example, the overall mean for both freshman and junior students in this study (2.49) was higher than four of the five comparison administrations in medical schools and higher than two previous dental school administrations. The means obtained for the scales of Meaningful Learning Experience and Breadth of Interest in this eighteen-school sample were higher than in four of the five medical school administrations and both of the previous dental school assessments in the early 1990s. In contrast, the means for Student-to-Student Interaction (both freshmen and juniors) and Emotional Climate, for freshmen, from this study were lower than previous reports.
|
| Implication |
|---|
|
|
|---|
Limitations
An original letter of interest to participate in this study was sent to all sixty-five dental schools in North America. Twenty-three of the schools agreed to participate in the study, but only eighteen returned materials. The foremost limitation in this study is the overall return rate of 28 percent. Caution must be taken when attempting to generalize the findings of the study to all dental schools across North America. Personal phone calls to the academic dean at the remaining five schools that agreed to participate in the study might have increased the overall return rate to 35 percent. Although these numbers still cannot be used to suggest generalizability, it would have provided more information sources for dental students perceptions of their education.
Another limitation was surveying only freshman and junior students for this project. By requesting information from these students, we hoped to obtain a suitable cross section of experiences in both the didactic and clinical components of the curriculum. Increasing the number of students who received the DSLES for completion might have increased the scope of student perceptions. In order to minimize the extra effort involved with survey distribution, limited numbers of students were asked to complete the survey. Other instruments involved in the Student Perspective Project (SPP) will hopefully identify strengths and weaknesses of the classes not surveyed in this study.
| Conclusion |
|---|
|
|
|---|
| Acknowledgments |
|---|
| Footnotes |
|---|
This study was supported by a grant from the Council of Sections Project Pool of the American Dental Education Association.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
W. R. Cardall, R. C. Rowan, and C. Bay Dental Education from the Students' Perspective: Curriculum and Climate J Dent Educ., May 1, 2008; 72(5): 600 - 609. [Abstract] [Full Text] [PDF] |
||||
![]() |
W. D. Hendricson, E. Anderson, S. C. Andrieu, D. G. Chadwick, J. R. Cole, M. C. George, G. N. Glickman, J. F. Glover, J. S. Goldberg, N. K. Haden, et al. Does Faculty Development Enhance Teaching Effectiveness? J Dent Educ., December 1, 2007; 71(12): 1513 - 1533. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. A. Horst Bootstrapping Student Publication in the JDE: An ADEA Council of Students Initiative J Dent Educ., October 1, 2007; 71(10): 1265 - 1266. [Full Text] [PDF] |
||||
![]() |
A. Chapper, S. A. Campani, V. d. S. Paiva, C. de A. de Assis, E. Garcia, and F. A. A. e Silva Comparison of Student Satisfaction in Public Versus Private Dental Schools in Brazil J Dent Educ., October 1, 2007; 71(10): 1363 - 1369. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Henzi, E. Davis, R. Jasinevicius, and W. Hendricson In the Students' Own Words: What Are the Strengths and Weaknesses of the Dental School Curriculum? J Dent Educ., May 1, 2007; 71(5): 632 - 645. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |