|
|
||||||||
Milieu in Dental School and Practice |
Key words: dental education, evaluation, information technology, curriculum, learning
Submitted for publication 02/21/08; accepted 09/15/08
| Abstract |
|---|
|
|
|---|
"All happy families are alike; each unhappy family is unhappy in its own way."
—Leo Tolstoy, first sentence of Anna Karenina
The year 2008 marks the eleven-year anniversary of the inception of a broad-based effort at curriculum reform at the University of California, San Francisco, School of Dentistry (UCSF). In looking back on the history and process of this reform, the opening line from Anna Karenina has special meaning for the faculty, staff, and administrators at UCSF. These words speak both to the similarities between families and dental academic institutions and to some critical differences. In the case of curriculum reform, the source of "unhappiness" within the academic "family" of faculty and students arose from a number of factors, including redundancy, overcrowding, lack of coordination of content, lack of critical thinking and active learning, and lack of time to pursue individual interests. In the late 1990s, UCSF found itself struggling to keep its curricular offerings current. Many had read the Institute of Medicine (IOM) report calling for curriculum reform1 and analyses like the Tedesco report on dental curricula lamenting how little has changed in a changing world2—but there was little in the way of an institutional response at UCSF.
Each dental school can approach these common issues with different approaches, depending on the particular environment and resources.3 A central feature of the curriculum reform effort that began at UCSF was that it originated from faculty and student concerns rather than as a mandate from the administration or other top-down approaches as has been reported at other dental schools4 or as a recommended approach.5 As with a recently published article describing the faculty-led curriculum reform efforts at Case School of Dental Medicine,6 this grassroots approach at UCSF brought its own problems of "buy-in" from the faculty and students, as well as commitment from the administration to devote the necessary resources in order to make significant changes. Reforms were achieved with curriculum content flow, integration, and oversight through consensus support from all constituents.
In this article, the strategies and actions used to develop, refine, and modify the curriculum reform plan, problems encountered during the planning and implementation process, solutions devised to bring the reform plan to reality, assessment of the revised curriculum, and issues in preserving its central goals over time are presented.
| Identifying the Problem |
|---|
|
|
|---|
An example of one of the major curriculum issues at UCSF was that clinical courses for the comprehensive care approach, designed to place the dental students into the clinic in the first and second years, were scheduled during the few remaining free hours during the week and in the evening following a full day of classes.7 No sustained effort was made to evaluate other components of the curriculum to identify free time or redundancies that would allow new course offerings to be added without increasing the total number of hours of instruction. The structure of the curriculum was constrained by departmental responsibility for hours and topics and by a lack of overall administrative authority for the curriculum that would have permitted meaningful reform of the entire system.
The UCSF curriculum was made up of a collection of incremental changes, many of them created appropriately and with faculty oversight, but without consideration for the consequences to the total curriculum. As has been stated by others, such long-range oversight is critical for far-reaching curriculum reform efforts to be achieved.8 The schedule at UCSF was populated with many one- or two-unit courses of one or two lectures or three to six hours of laboratory instruction per week. This cluttered schedule had a particular effect on final examinations, in which as many as fifteen finals were administered over just a few days at the end of each quarter. Students accommodated to this system by studying selectively for large-unit courses. As a result, they often undervalued and did not learn adequately the content that had been presented in the smaller courses. As reported in previous studies in other dental schools, the burden of numerous courses and examinations also created a high level of stress among the students at UCSF.9–13 Curriculum material was also poorly integrated: the students were expected to make connections among biological sciences, the mastery of skills, and clinical care of patients with little faculty guidance. The situation is illustrated in Table 1
. The schools curriculum prior to July 1, 2004 could be summarized as follows:
|
This constraining schedule made it difficult for faculty and students to take full advantage of the rich intellectual environment and resources at UCSF. A major concern of the faculty was the limited extent to which students were learning to think critically and developing the skills to continue to grow intellectually beyond graduation from dental school, an issue that has been addressed in several key position papers on dental education in the past.2,14–19 There was also little time to identify and mentor promising students who could be encouraged to participate in research and/or to train for careers in academic dentistry. A few students managed to participate in these activities, but most were simply too burdened with the demands of the dense and uncoordinated curriculum.
In 1996, UCSF revised its strategic plan to address several curriculum problems. The recommendations that emerged were similar in intent to those of the IOM report1 and included the following: 1) making the curriculum more intellectually challenging, scientifically current, and biomedically oriented; 2) providing students with an education in which problem-solving and critical thinking were fundamental to the instructional program; 3) better integrating clinical medicine and physical and psychological diagnosis with oral health care; and 4) promoting lifelong learning.
The path to curriculum reform clearly included eliminating redundancy to streamline the curriculum offerings and preserving some time in the curriculum for independent learning and reflection. The first step in the process was to develop a comprehensive and far-reaching strategy that was nimble enough to serve the curriculum needs for the future and, at the same time, be feasible in its planning, implementation, and assessment. Of paramount importance in this process was an attempt to fully integrate basic and clinical material across all departments and disciplines. This task of full integration is perhaps one of the most difficult to achieve. For example, the 2004 report by Kassebaum et al. on a survey of U.S. and Canadian dental school reported that only 7 percent of schools had a curriculum organized around specific themes.20 While a minimal level of resources need to be available to institute large-scale curriculum reforms,3 the UCSF School of Dentistry did not have extensive resources to coordinate a large-scale planning and implementation process. As an alternate strategy, a dedicated group of faculty members expressed to the administration and to the dean of the School of Dentistry, Dr. Charles Bertolami, a willingness to take on the ambitious task of planning an extensive evaluation of the full curriculum and proposing a comprehensive reform plan. With administrative support, this group of faculty members was formally appointed as the curriculum reform committee for the school and was charged to evaluate the entire current curriculum and to recommend a sequence of new courses for a new curriculum.
| Creating the Blueprint |
|---|
|
|
|---|
The first task was to examine what was taught to students over the four-year curriculum. This required examining the existing curriculum course by course and lecture by lecture. The committee recognized that the individuals who knew the most about the curriculum were the students, so students provided information about each course. The process took a year and generated about 5,000 pages of lecture notes, course outlines, and old exams. It became apparent from the analysis that much of the material presented could be organized into thematic "streams" of knowledge (or themes) that could serve as a framework for reordering the content of the curriculum and allow for better vertical and horizontal integration of course material across departments and disciplines. Similar thematic approaches have been reported in the past, in particular as complementary pathways to the content approaches used in the first two years of the medical school curriculum at the same institution.21–23 Utilizing these thematic streams, course material would be centered around concepts rather than time constraints for units, department offerings, or even academic years. This entailed elimination of smaller and more narrowly focused courses taught by one department or division and integration of material and faculty into larger interdepartmental courses. The first diagrammatic model for this structure is presented in Figure 1
and served as the framework for all further developments in planning. The basic stream elements proposed at these initial planning meetings were as follows:
|
During the identification and development of these four thematic streams, the committee realized that important elements were missing: the development of the critical thinking skills and the acquisition of skills needed for students to become lifelong learners. The committee thus proposed a fifth stream for this purpose that would also help with the integration of the other four streams.
In addition to identifying five thematic "streams" of content, the committee also sought to organize the number of hours of formal instruction, both to ease overcrowding of the curriculum and offer students time for reflection and synthesis of course content and to permit students to take electives and pursue research. The committee set, as a goal, a maximum of thirty-two hours of formal teaching per five-day week and the scheduling of two half-day blocks of time of four hours each for independent study. These times are referred to as Independent Study Options (ISO) time. The committee also was aware that a reduction of formal teaching from thirty-eight or more hours per week to thirty-two hours per week was a reasonable step, as several other dental schools have achieved fewer formal instruction hours per week.
During the planning process, the faculty discovered what students already knew: that there was tremendous repetition in the curriculum. Although some degree of redundancy is desirable for reinforcement of concepts, the principle developed was to minimize unplanned redundancy. An example of "planned redundancy" or reinforcement would be learning a basic medical concept in lecture during the first year of the curriculum, such as diabetes, and then reviewing the concept subsequently when the medical management of the diabetic patient was treated in the comprehensive care clinic.
| Building Consensus |
|---|
|
|
|---|
As stated in the recent position paper by Haden et al., a broad consensus among educators is essential for any successful major curriculum reform efforts.18 At UCSF, such a broad consensus and approval from the faculty prior to implementation was achieved through participation and engagement at each stage of the planning process, particularly when frameworks and drafts were proposed. Existing forums such as the school committees, general faculty meetings, faculty-student-administration liaison meetings, and town halls were used. In addition, over a three-year period, the annual schoolwide faculty retreat was almost entirely devoted to curriculum reform efforts in three phases:
Throughout this process, there were also frequent meetings with the general faculty, Faculty Council, and student representatives, as well as posting of curriculum plans and proposed new courses online for all faculty members to provide feedback. During the early stages of planning, the initial proposals were met with a general level of approval and enthusiasm; however, some faculty members expressed concern when it became apparent that they would be giving up their individual, small-unit courses and would likely need to modify their teaching content in the context of redesigned courses. At the third faculty retreat of 2000, a formal ballot measure posed two questions, asking first for general support for the curriculum revision plan and then for a more personal response about willingness to work with other faculty members to change both curriculum format and teaching strategies. Fortunately, both ballot questions receive very high approval ratings. With broad consensus established in 2000, the implementation process was begun.
| Continuing the Process |
|---|
|
|
|---|
|
Among the first agreements of the faculty leaders were to maintain the goal of the first curriculum planning committee of limiting the curriculum hours to thirty-two per week for the ten-week quarters and to preserve the three-month summer break that occurred at the end of the first year. Limiting curriculum time would permit the school to encourage both independent study and reflection by students and provide time for students to engage in mentored research activities. As planning and implementation progressed, the agreement to limit formal instruction to thirty-two hours a week has been the most difficult to maintain; every thematic stream faced a reduction in hours of instruction, but there has been relentless pressure to increase instruction time. A major concern was that this arrangement would decrease clinic time for students in the third and fourth years. It was therefore decided that clinics would continue during final exams week. This was made possible by the integration of all the one-unit courses in the third year, so that there was one planned final examination rather than eight or more. In the final plan, clinics ran forty-four weeks per year, four more weeks than previously.
When the commitment of the planning group to keep the same number of clinical instruction hours was made, it meant that other disciplines would shrink disproportionately. Time would have to be found during the day to teach the first- and second-year clinical courses, thus further impacting clinic assignments for others. The faculty groups particularly affected were the restorative laboratory faculty in the Preventive and Restorative Dentistry stream and the biomedical science faculty in the Biomedical Sciences stream. Both faced major issues in reducing hours in the curriculum. The resolution of this issue was managed using the following approaches:
When the curriculum was defined in weekly half-day blocks of time totaling thirty-two hours per week, there was concern that the four hours of time in one lecture hall or studying particular topics would be too much to ask of students. However, laboratory and clinic sessions were already three hours in length, and graduate dentists were required to take continuing education courses often modeled as full-day courses. Thus, the planners agreed to this structure in order to preserve the two one-half-day time periods for independent study (ISO time). An example for this thematic plan for the curriculum for one quarter of the first year of dental school is presented in Figure 2
.
|
New information technology was brought into the curriculum. WebCT had been available through the UCSF library for several years but was not heavily utilized within the school. As curriculum planning progressed, a template was created for the School of Dentistry courses, and faculty training was provided to assist in the utilization of these tools. A template was instituted so that certain web tools would be available in each of the courses and the homepage of each course looked consistent.
The idea also emerged to have an electronic "commons room" for students, which was developed as an e-Commons site. This was particularly needed at UCSF because there was no physical gathering place for students such as a student union. The e-Commons contained discussion boards, access for postings for each class, rosters, schedules, National Board review materials, administrative resources, and general information. At the suggestion of the students, an anonymous suggestion box was added.
UCSF is a small campus with tightly scheduled lecture halls, seminar rooms, laboratories, and clinics for the dental school shared with the schools of medicine, nursing, and pharmacy and the graduate division. It quickly became apparent that a staggered start to the revised curriculum would present tremendous scheduling problems and would, in some instances, require faculty members to teach material twice in a single year, which would further limit classroom space and scheduling. So the faculty and administration decided to begin the entire curriculum on July 1, 2004. This presented many challenges for matriculated students and required modifying existing courses in the year before the changeover, so that each class of students was provided all of the curriculum material. Existing courses in 2003–04 were modified to present material in a manner that would be compatible with the flow of curriculum material the following year in the new courses. In a few instances, faculty members presented courses that were taught only once as the curriculum implementation unfolded. Student kit materials also had to be adjusted for the laboratory courses in 2003–04, as exercises were to be reorganized.
Independent of the redesign of the curriculum by the stream leaders, the Faculty Council (the elected faculty representatives of the school) initiated an analysis of grading policies. After extensive research and deliberation, the faculty decided to move the school to a pass/no pass grading system. This required that the faculty adopt criterion-referenced grading and the marginal pass (D) grade was eliminated. The new grading system included the awarding of honors grades based on criteria specified by each course director in the third and fourth years, and incorporated the use of letters of commendation by faculty in the first two years of the curriculum to acknowledge outstanding students. This change eliminated the ranking of students in classes. These proposals were presented to the faculty in the same collegial manner as the initial curriculum plans, and most faculty members endorsed the pass/no pass system. It also received wide support from the students, as they perceived that the academic environment would change to reduce competition and increase collaborative learning. With this consensus approval from faculty and students, the regulations ending letter grades were approved in time for the inauguration of the revised curriculum in July 2004.
Maximizing Communication and Pride of Ownership
To achieve the goal of an updated and revised curriculum, communication with all individuals in the school was of paramount importance. The assistant dean and members of the stream leaders group kept faculty and students apprised of the progress of curriculum reform through the following mechanisms:
These efforts were augmented by the creation of communication materials put in a brief booklet called the "Owners Manual." The booklet provided the context for curriculum reform, outlined the goals of this reform, organization of streams, curriculum changes, and the new schedule, and included a statement of support from the dean. It also highlighted the phrase developed by Dean Bertolami to identify and describe the curriculum: "Educating Men and Women of Science." It was found that the "Owners Manual" was the communications tool that most effectively explained the full scope of the curriculum reform to our community. Figure 3
shows the cover of this booklet.
|
| Assessment |
|---|
|
|
|---|
Approaches to Assessment and Findings
A number of evaluation strategies were developed to assess the changes in the curriculum. These included the following:
Quarterly
Continuous communication
Annual outcomes assessment
Follow-up
Student Responses to the Curricular Changes
Student focus groups held during and after the first year of the initiation of the revised curriculum provided insight into the changes. Students were mostly quite positive, as others who had completed courses the previous years under the old curriculum structure told them they were lucky to be experiencing the changes. Students also noted that the transition year was tough, some didactic material seemed out of sequence, and there was a sense of uncertainty. One major concern for students was the transition from paper to electronic course materials including syllabi. Many courses previously used extensive written syllabi to provide teaching material. At the request of the students, the faculty provided materials online at least twenty-four hours before class. The use of hard-copy handouts has greatly diminished as students preferred PDF versions that can be annotated and better used for study. As an aside, it should be noted that the faculty continue to hear complaints about insufficient chair time in the clinic, a situation unchanged over the decades.
Students revealed that some faculty members were not scanning slides and using digital presentations and were not providing enough time for student-centered learning, despite administration-sponsored efforts for faculty development in these more active learning approaches. Students urged faculty members to change their teaching techniques and offered to help. As a result, students participated in developing teaching aids in science and laboratory courses, participated more in student-led teaching, and scanned slides to assist faculty in the transition from the older instructional media to web-based electronic media. Many students had excellent computer skills and were eager to assist in improving the curriculum. As a corollary to this, communications with students became entirely digital, using campus email and email within the online courses. Telephone contact and voicemail were reserved for patient contacts, and paper mail was no longer used.
Students also clearly stated that they preferred to not have a didactic course in the fourth year, as had been the case for the previous ten years. However, the faculty felt that it was critical to continue presenting appropriate advanced didactic material in the fourth year.
Students evaluations of the Introduction to Dentistry course indicated that it was a good transition from undergraduate education to professional education. They consistently provided ratings between 4 and 5 on a scale of 1 (strongly disagree) to 5 (strongly agree) for feeling welcome (4.8), preparation for studies at UCSF (4.3), and preparation for the profession (4.2). The only criticism of the intensive program was that the days were long. Evaluation scores have remained consistent in the past four years, averaging 4.2 or higher, and the single criticism of long days has not changed.
Students were initially unclear as to what the specific performance requirements were for each course in the new pass/no pass system. Faculty set consistent pass criteria and required remediation and demonstrations of mastery of material, so that students soon recognized that the revised curriculum was just as rigorous, if not more rigorous, than the previous courses. Faculty reported that they now spent more time in remediation of students who are performing marginally than before, since the pass/no pass system required that the students sustain an acceptable level of performance in all aspects of all courses. This was in contrast to awarding "D" grades that could be averaged away in GPA calculations of acceptable overall performance.
An interesting aside to all the faculty and student changes was that staffing support for the new curriculum with extensive use of WebCT and digitally enhanced teaching needed to change. Over time, new staff members with much more sophisticated computer skills have been hired. One individual was identified specifically to interact with faculty and the library staff in support of the online courses. These changes coincided with reductions in the traditional administrative assistant support staff levels through attrition.
Student Evaluations of the New Courses
Electronic course evaluations were made available for each class at the end of each term. Students were encouraged to respond; however, the rate was rarely more than 50 percent. Students related that some feared that the system was not anonymous and others felt that faculty would not change no matter what was said. In all, response rates varied from class to class, from a high of 78 percent of first-year students responding to an average of 50 percent for the second-, third-, and fourth-year classes.
Figure 4
represents the overall evaluations for the courses in the new curriculum on a scale of 1 (poor) to 5 (excellent) for spring quarter 2005, the first year of the revised curriculum, and spring quarter of 2008, a recent evaluation of the same courses. The goal was for every course to be rated three or higher. Courses that scored lower in the streams were addressed by the stream leader and assistant dean to make plans for improvement. Student evaluation scores for courses have been consistent over time.
|
| Other Assessments |
|---|
|
|
|---|
|
| New and Continuing Challenges |
|---|
|
|
|---|
The second major challenge for the faculty is to change traditional teaching modes to incorporate more learner-centered activities. Thus far, small-group discussions, panel discussions, student presentations, and digital presentations that can be reviewed at any time have been used to augment the traditional lecture-style presentations. Much remains to be done, but the structure of the new curriculum has provided interdisciplinary and interdepartmental opportunities for faculty members to work together, which was difficult to achieve with the previous curriculum structure.
From an administrative point of view, some faculty members still think in terms of adding new material by adding hours to the thirty-two-hour week and therefore reducing time for independent study. Three or four requests emerge every few months, with very good rationales, for increasing class, lab, or clinic time and decreasing independent study time. These are presented to the stream leaders at their retreats and to faculty committees, and are discussed at great length. Interestingly, having many faculty members discuss changes has led to increased cooperation and problem-solving, so that independent study time has been preserved.
| Discussion and Conclusions |
|---|
|
|
|---|
UCSF has begun to address the problems in the curriculum described by Bertolami: the problem of content, in which the core question is how best to incorporate advances in biomedical science and technology; and the problem of form, which includes inadequate learning and dissatisfied students.14 The major restructuring of the curriculum at UCSF School of Dentistry has established a framework that permits faculty to redress the ills of irrelevant, redundant, and unrelated presentations of material in dated traditional lecture, lab, and clinic formats that do not appeal to this generation of students. The notion that students need time for reflection, creativity, and scientific inquiry and that they benefit from it has been embraced. Faculty members have sensed the need, if not the urgency, for change and have directed their considerable skills and attention toward creating that reality.
| Acknowledgments |
|---|
| Author Information |
|---|
|
|
|---|
| REFERENCES |
|---|
|
|
|---|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |