|
|
||||||||
Educational Methodologies |
Key words: dental education, computers, web-based, blended learning, online, evidence-based
Submitted for publication 07/18/06; accepted 10/27/06
| Abstract |
|---|
|
|
|---|
Computers in dentistry have been used as a learning tool since the early 1970s,4 and the first CAL (Computer-Aided Learning) tool was developed at the University of Kentucky.5 However, the real development did not actually start until the early 1990s, when several CAL packages were developed.68 These were mainly distributed through floppy disks and CD-ROMs, as the Internet was not as widely available and easily accessible as it is today. Whilst those packages were mainly meant for continuing professional education, after the mid-1990s there were some attempts to create CAL packages for undergraduate education.911
From the beginning of this decade, as Internet accessibility and connectivity speeds have increased (and are likely to continue to do so),12 electronic education (e-education) is moving away from the hard mediums (floppy disks, CD-ROMs, etc.) and is now primarily offered in online environments,1316 as they offer numerous advantages for the learner, including increasing the students independence and "anytime, anywhere" access to educational opportunities, as well as allowing teachers to more easily update e-education materials than they could with the previous hard mediums. The move towards e-education evolves through e-publishing (the use of static material) to e-learning (the use of interaction) as described by Allen.17
E-education has progressed in recent years to a new approach in the form of blended learning. Blended learning is the thoughtful integration of classroom face-to-face learning experiences with online learning experiences.2 The main advantage of blended learning is that it integrates the strengths of synchronous (face-to-face) and asynchronous (web-based) learning activities.
Two key approaches for the development of online materials are described in the literature: direct instruction and student-centered approach.18 The direct instruction model is based on behaviorist learning theory,19,20 described as a direct provision of information. The student-centered approach is based on constructivist learning theory,21,22 which supports the notion that knowledge is constructed by learners through interaction. Another approach that lies between the two key approaches is minimalism, first described by Carroll.23 The key ideas behind this theory are that instructional material should be kept to a minimum to avoid obstruction of learning and the design should be focused on activities that support learner-directed activities.
In recent years, more and more dental schools have moved to supporting face-to-face teaching using online platforms,2426 but only a few studies have evaluated this transformation of the curriculum,27 especially in relation to a specific course.14 Furthermore, as the blended-learning approach is relatively new to education, only a few studies are available in the literature.2830 To address this gap in the literature, our research study evaluated a blended-learning course titled "Information and Communication Technologies" (ICT), developed for the undergraduate dental students (B.D.S.), postgraduate students (PG), and Diploma of Hygiene and Therapy students (DHT) at the School of Clinical Dentistry of the University of Sheffield. Student behaviors, attitudes, and opinions towards the blended-learning ICT course were evaluated.
| The ICT Course |
|---|
|
|
|---|
The environment used to host the course was the iCT Portal. The iCT Portal was developed in 2003 on an independent web server, connected to the University of Sheffields main data network. The front-end screen shot is shown in Figure 1
.
|
The core objectives of the ICT course were for the students to learn information-sourcing techniques, data manipulation, and evidence appraisal while building on their practical IT skills.
As shown in Table 1
, there were similarities between the structures of the different course years (modules). The first and last sessions of the course were in a traditional lecture setting, while the middle sessions were online-supported practical sessions. For the practical sessions, all the information required to complete the sessions was given through the iCT Portal, and the presence of the tutor was mainly to provide synchronous support to the students. Attendance at the course sessions was compulsory for all groups. Course assessment was based on the session assignments.
|
| Methods |
|---|
|
|
|---|
For the purpose of this study, the overall methodology used was action research.31,32 The action research model is a spiral process: the cycle comprises diagnosis (data gathering, analysis, and representation), action planning, action taking, and action evaluation.33 The data were collected using three processes: questionnaires to collect contextual data from students taking the course; a student-led, nominal group technique to collect group data from participants of the course; and non-participant observer technique to record the context in which certain group and individual behaviors occurred.
Questionnaires34 consisted of both closed and open-ended questions. The questions focused on eliciting attitudes towards the course content, the educational setting, and the e-learning innovations applied, as well as past, current, and possible future behaviors. Anonymous questionnaires were distributed at the start of the last session of each class (year group) and were collected at the end of it. The students were informed that participation was voluntary.
The Nominal Group (NG) Technique35 was used to identify strengths and weaknesses, using a group setting, to allow solutions to be thought out and analyzed and plans for their implementation to be considered. This technique can be split into four main stages: idea, "round Robin," clarification, and voting.36 One NG session was organized for each student year, and five to ten students were invited for each session. The NG sessions took place on all occasions within two weeks of the completion of the course. The researcher introduced the NG technique to the students and responded to any queries. The same instruction sheets were given to all student groups, and the venue for all sessions was the same. Only the students were present during the nominal group sessions, and group participants were self-selected.
Non-participant observation37 is an ethnographic technique that provides information about the group dynamics. The researcher was present at all sessions. Students were not informed of the intention of the observation in order to avoid change in behaviors.
The quantitative analysis of the closed questions data was done with SPSS v13.38 Chi square (
2) test was used to compare means between categorical data and ANOVA.39 The level of statistical significance was set at p< 0.05. Thematic analysis was performed for the nominal group, non-participant observation, and open questions data from the questionnaires.
| Results |
|---|
|
|
|---|
For each individual class the participation was as follows: first-year B.D.S., six students (three female/three male); third-year B.D.S., five students (three female/two male); fourth-year B.D.S., six students (three female/three male); postgraduate dentists, seven students (four female/three male); and DHT, eight students (eight females).
Thirty-six sessions of non-participant observations were observed. Six sessions were for the first-year B.D.S. course, six for the third-year B.D.S. course, four for the fourth-year B.D.S. course, ten for the postgraduate course, and ten for the DHT course.
The following sections summarize the findings from the questionnaires, nominal group, and non-participant observations.
Summary of Data from the Questionnaires
According to 64 percent of the respondents, the aims and objectives of the course were clear. A significant difference was found between the years, as postgraduate and DHT students gave a more positive response than did the B.D.S. students (p<0.01; Table 2
). There was no difference between male and female students.
|
When asked about skills gained from the course, around 60 percent of the respondents believed that their skills had improved. A statistical difference between the classes (years) was found, with p<0.01. Again the difference was between B.D.S. students and the other groups (Table 3
).
|
|
|
|
Summary of Data from the Nominal Group Sessions
On the iCT Portal, the students commented positively on the usefulness of the environment, but they would have preferred it to be integrated with other online resources at the university. Problems accessing the portal due to passwords were also reported by some groups. According to the first-year B.D.S. and the DHT students, the variety of available forums was effective for student communication. The DHT students reported problems with the interface and the design of the iCT Portal, while the other student groups found it easy to use.
In relation to the course content, students indicated that the following sessions were valuable: finding literature online and referencing based on the minimalism approach; MS Excel/statistics using the direct instruction approach; and presentation sessions based on the student-centered approach. B.D.S. students suggested including more dental-oriented subjects in the session material. Another issue reported from the third- and fourth-year B.D.S. students was that, due to similarities between the B.D.S. levels, no new IT skills were obtained. Postgraduate students would have preferred the material to be available online before the sessions.
For the sessions structure and timing, differences were found between the groups. Postgraduate students proposed extending the practice time; third-year B.D.S. students believed that the course was time-consuming and they would prefer to distribute that time in more clinical-related courses; and fourth-year B.D.S. students wanted more tutors available in the practical sessions.
Finally, another aspect reported was the diversity of computer skills among the students. A more detailed view of the similarities and differences between the years as revealed from the nominal group session analysis is presented in Table 6
.
|
Regarding the group behaviors and group dynamics, similarities were recorded among the students cohorts (year groups). When the direct instruction approach was used for development of the session, students worked alone, with interactions occurring only between adjacent sitting students and with the tutor. Those interactions were minimal and, in most cases, were related to clarification of the instructions. At the minimalism-based sessions, some interaction among the students was recorded, but to a limited extent. Besides the queries regarding instructions, some students engaged in group discussions and collaborated to assist each other in completing the tasks. During sessions that employed a student-centered approach, students worked collaboratively, and group formation increased. However, this collaboration was mainly face-to-face: the iCT Portal forums were used only for student communication by the first-year B.D.S. and DHT students and that was outside sessions only.
| Discussion |
|---|
|
|
|---|
Many studies have been carried out in the past to evaluate computer-assisted education in dentistry.611,13,42,43 But a careful review of the literature did not reveal any study that evaluated a blended-learning course using more than a single group of learners in a dental school.
We have to accept that a possible limitation of this study was the subject of the course. Even though ICT skills are seen as useful, they are often not yet seen as essential by dental students. Hence, the interest level in the course, especially from the B.D.S. students, may have been limited. Nevertheless, there was an advantage in that the subject of the course was related to computers, which may have minimized the novelty effect44 of a new learning environment.
The results from our study indicate that the majority of students were satisfied with the course. No differences were found between genders in any of the responses. It is clear though that there were several differences between the different student groups (Table 2
and Table 3
). An interesting finding was the impressive positive difference recorded between postgraduate students and the other student groups. This difference could possibly be attributed to the fact that postgraduate students see themselves more as researchers and therefore ICT skills are more essential to them. The other student groups seemed to be, as it has been reported and in some nominal group sessions, more focused on the clinical aspects of dentistry. It is also worth noting that overall third-year B.D.S. students gave the lowest level of positive responses. This finding can not be solely attributed to the "clinical focus" reason, since fourth-year B.D.S. studentswho are expected to be more clinically orientedhad better results. It may be that it is a coincidental finding attributed to this specific group of students and thus requires further investigation.
The comparison of the two learning experiencesface-to-face and online-supported (blended)showed no differences, and the students felt comfortable with both. Indeed, both teaching sessions and practical sessions were understandable for 63 percent of the students. The teaching sessions were based on the traditional face-to-face model, while practical sessions employed an online-supported model.
Postgraduate and DHT students responded that they gained significantly more skills from the course than did B.D.S. students. Postgraduate students attending this course were mainly overseas students from several countries; similarly, DHT students came from a variety of backgrounds and age groups. As a result, the initial ICT skills for those two groups were probably lower than for the B.D.S. students. Nominal group sessions also pointed out the diversity of ICT knowledge and the lack of ICT skills within those two student groups. Moreover, based on the questionnaires, skills gained from the course seemed to decrease in more junior B.D.S. cohorts (Table 1
), which actually contradicts the comments made at the nominal group session by the third- and fourth-year B.D.S. students regarding similarities of the years. This may be explained by the possibility that the younger B.D.S. students possessed a wider variety of initial ICT skills than their older colleagues. A state of readiness survey could provide a more definite answer.
Drawing on these results, it may be said that a web-based course has the potential to provide a highly personalized learning content. This course design could provide the means to cope with the diversity of knowledge and skills among students and also could possibly increase the students online expertise regardless of their prior experience.
All students groups said the iCT Portal was a valuable resource. If the online environment could be integrated with other university resources, then the problems regarding its accessibility and passwords, reported at the nominal group sessions, could be minimized. It may also be pointed out that the easier it is to access a system, the higher its acceptance, especially when most people have to remember numerous passwords and URLs.
Several reports in the literature indicate that the online learning experience is enhanced when the web delivery of information is combined with interaction.42,43 This is what actually distinguishes e-publishing from e-learning according to Allen.17 Moore45 describes three types of learner interaction: learner-content, learner-instructor, and learner-learner. The design of the iCT Portal was based on the social constructivism learning theory22 and promoted learner-instructor and learner-learner types of interaction through the use of forums. However, the majority of students did not use the iCT Portal as a communication tool; they used it mainly to retrieve information. There was some information-sharing through posting outside sessions in the forums, but practically no discussion and collaboration within the student groups (Table 5
). Synchronous face-to-face access to the tutor and their colleagues during the practical sessions is probably one reason for not using this feature in the sessions. The reasons for the unsatisfactory use of this feature outside the sessions are not clear. Some possible explanations could be the students previous inexperience with online forums and their preference for other types of communication or that the session material itself did not actually promote online communication. This remains to be investigated in the future.
However, it is encouraging that when students used the iCT Portal forums to communicate with their colleagues and tutors, they then seemed to perceive the value of the system as more important. Figure 2
correlates the data from Table 4
and Table 5
. One could argue that those more comfortable with the use of the software were the ones expected to post more. But it is not always true that the most comfortable users are those who post in forums. A wide variety of reasons are put forward for active participation.46 It was also important that new undergraduate intakes explored those capabilities of the environment to a greater extent than did students in the more senior B.D.S. years.
Finally, no difference in relation to the usefulness and difficulty of the different approaches applied was found in the students responses to the questionnaires and in the nominal group sessions, but as the aim of this study was not to evaluate those three approaches, those data have limited value. It is clear, however, from the non-participant observations that as we move from behaviorism to minimalism and constructivism, learner-to-learner interaction and group formation increase significantly.
| Conclusions |
|---|
|
|
|---|
The online component of the course was accepted as a valuable resource by the majority of learners. This type of blended-learning environment decreases the necessity for online collaboration. Online information-sharing outside the sessions occurred, but no evidence of online collaboration was recorded.
Both face-to-face and online structured sessions were similarly understandable and valued. The future use of the virtual learning environment increased when learners perceived it as a communication tool.
The different pedagogical approaches did play a role in collaborative learning, but according to the students, not on session difficulty and usefulness. More than a single group evaluation may be required for this type of research to avoid coincidental findings.
| Footnotes |
|---|
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
K. Pahinis, C. W. Stokes, T. F. Walsh, E. Tsitrou, and G. Cannavina A Blended Learning Course Taught to Different Groups of Learners in a Dental School: Follow-Up Evaluation J Dent Educ., September 1, 2008; 72(9): 1048 - 1057. [Abstract] [Full Text] [PDF] |
||||
![]() |
F. D. Salajan and G. J. Mount University of Toronto's Dental School Shows "New Teeth": Moving Towards Online Instruction J Dent Educ., May 1, 2008; 72(5): 532 - 542. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |