Skip to main content

Main menu

  • Home
  • Content
    • Current Issue
    • Online Ahead of Print
    • Past Issues
  • Info for
    • Authors
      • Resources
    • Institutions
    • Advertisers
    • Subscribing
  • About
    • About the JDE
    • Editorial Board
  • More
    • Alerts
    • Feedback
    • Reprints
    • Help
  • Other Publications

User menu

  • My Alerts
  • Log In
  • My Cart

Search

  • Advanced search
Journal of Dental Education
Visit the American Dental Education Association's main website
  • My Alerts
  • Log In
  • My Cart
Journal of Dental Education

Advanced Search

  • Home
  • Content
    • Current Issue
    • Online Ahead of Print
    • Past Issues
  • Info for
    • Authors
    • Institutions
    • Advertisers
    • Subscribing
  • About
    • About the JDE
    • Editorial Board
  • More
    • Alerts
    • Feedback
    • Reprints
    • Help
  • Visit jde Template on Facebook
  • Follow jde Template on Twitter
  • Follow jde Template on YouTube
  • View jde RSS feed
  • TOC Alerts
Research ArticlePredoctoral Dental Education

Early Performance in a Humanistic Medicine Course as a Predictor of Dental Students’ Later Clinical Performance

Linda Pollak Nelson, Peter Maramaldi, Taru H. Kinnunen and Elsbeth Kalenderian
Journal of Dental Education August 2013, 77 (8) 1006-1012;
Linda Pollak Nelson
Dr. Nelson is Assistant Clinical Professor of Developmental Biology (Pediatric Dentistry), Harvard School of Dental Medicine and Director of Postdoctoral Pediatric Dentistry Residency Program, Children’s Hospital, Boston; Dr. Maramaldi is Associate Professor at Simmons School of Social Work, Research Associate Professor at Simmons School of Health Sciences, and Clinical Instructor, Department of Oral Health Policy and Epidemiology, Harvard School of Dental Medicine; Dr. Kinnunen is Assistant Professor, Department of Oral Health Policy and Epidemiology, Harvard School of Dental Medicine; and Dr. Kalenderian is Chair, Oral Health Policy and Epidemiology, and Chief of Quality, Harvard Dental Center, Harvard School of Dental Medicine.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Peter Maramaldi
Dr. Nelson is Assistant Clinical Professor of Developmental Biology (Pediatric Dentistry), Harvard School of Dental Medicine and Director of Postdoctoral Pediatric Dentistry Residency Program, Children’s Hospital, Boston; Dr. Maramaldi is Associate Professor at Simmons School of Social Work, Research Associate Professor at Simmons School of Health Sciences, and Clinical Instructor, Department of Oral Health Policy and Epidemiology, Harvard School of Dental Medicine; Dr. Kinnunen is Assistant Professor, Department of Oral Health Policy and Epidemiology, Harvard School of Dental Medicine; and Dr. Kalenderian is Chair, Oral Health Policy and Epidemiology, and Chief of Quality, Harvard Dental Center, Harvard School of Dental Medicine.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Taru H. Kinnunen
Dr. Nelson is Assistant Clinical Professor of Developmental Biology (Pediatric Dentistry), Harvard School of Dental Medicine and Director of Postdoctoral Pediatric Dentistry Residency Program, Children’s Hospital, Boston; Dr. Maramaldi is Associate Professor at Simmons School of Social Work, Research Associate Professor at Simmons School of Health Sciences, and Clinical Instructor, Department of Oral Health Policy and Epidemiology, Harvard School of Dental Medicine; Dr. Kinnunen is Assistant Professor, Department of Oral Health Policy and Epidemiology, Harvard School of Dental Medicine; and Dr. Kalenderian is Chair, Oral Health Policy and Epidemiology, and Chief of Quality, Harvard Dental Center, Harvard School of Dental Medicine.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Elsbeth Kalenderian
Dr. Nelson is Assistant Clinical Professor of Developmental Biology (Pediatric Dentistry), Harvard School of Dental Medicine and Director of Postdoctoral Pediatric Dentistry Residency Program, Children’s Hospital, Boston; Dr. Maramaldi is Associate Professor at Simmons School of Social Work, Research Associate Professor at Simmons School of Health Sciences, and Clinical Instructor, Department of Oral Health Policy and Epidemiology, Harvard School of Dental Medicine; Dr. Kinnunen is Assistant Professor, Department of Oral Health Policy and Epidemiology, Harvard School of Dental Medicine; and Dr. Kalenderian is Chair, Oral Health Policy and Epidemiology, and Chief of Quality, Harvard Dental Center, Harvard School of Dental Medicine.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site

GTranslate

English French German Italian Portuguese Russian Spanish
  • Article
  • Figures & Data
  • Info & Metrics
  • PDF
Loading

Abstract

The purpose of this study was to test the hypothesis that dental students’ early ability to demonstrate a humanistic approach with patients is associated with later clinical performance. A first-year humanistic medicine course, Patient Doctor I (PDI), at Harvard School of Dental Medicine combines training in conducting the medical interview with human values, placing a high value on strengthening relationships with patients and emphasizing empowerment, respect, and strong communication skills. Retrospective data were collected in the following domains: PDI course evaluations, admissions information, National Board Dental Examination Parts I and II scores, and Promotions Committee and faculty evaluation scores for hand skills and humanistic and interactive patient-student skills. Planned linear contrasts comparisons were performed for each clinical outcome variable. Tests to support the a priori hypothesis of linear relationships between PDI evaluation ratings and clinical performance, defined as hand skills and humanistic and interactive patient-student skills scores, were significant, both at p=0.03. This study demonstrated the feasibility of measuring dental students’ humanistic qualities during the first year. Humanistic qualities (PDI performance) during the first year were found to be associated with clinical performance in the third year of dental school.

  • dental education
  • clinical performance
  • humanistic medicine
  • academic performance
  • admissions criteria
  • predictive study

There is a dearth of empirically supported factors that predict student performance after admission to a dental program.1–3 Two Canadian studies suggest that student interpersonal skills may be associated with academic and clinical performance.4,5 We previously published a report on an American Dental Association-funded pilot study that documented the development of an innovative rating system for qualitative narrative assessments of first-year students’ interviewing skills.6 The study described in this article tested the hypothesis that students’ early ability to demonstrate a humanistic approach with patients is associated with later clinical performance.

Similar to the practice at some other institutions, first-year students at Harvard School of Dental Medicine (HSDM) conduct patient interviews, creating a rich context for experiencing physical and behavioral issues with actual patients. The pedagogy in the first-year patient-centered course uses problem-based learning (PBL) to teach students the tenets of humanistic medicine, which entails approaching the patient as a person rather than a mere case or a sign or symptom of disease.7 Humanistic medicine can be taught and learned, and it is central to the curriculum at HSDM where, in addition to dental classes, students complete the entire first two years of required coursework in medicine.8 The first-year humanistic medicine course at HSDM is called Patient Doctor I (PDI). It combines training in conducting the medical interview with human values such as compassion, caring, sincerity, understanding, and integrity. It places a high value on strengthening relationships with patients and emphasizes empowerment, respect, and strong communication skills.9 In a humanistic approach to dentistry, active listening is used to emphasize the shared humanity of patient and provider, enabling the dentist to practice with empathy, reflection, professionalism, and trustworthiness.10

Methods

Internal Review Board approval was obtained. The sample frame consisted of HSDM students who graduated between 2003 and 2011 and had data available in the following domains: PDI course evaluations, admissions information, National Board Dental Examination (NBDE) Parts I and II scores, and Promotions Committee and faculty evaluation scores for hand skills and humanistic and interactive patient-student skills.

Deductions from the literature and empirical observations were used to develop three concepts related to our hypothesis that students’ early ability to demonstrate a humanistic approach with patients is associated with later clinical performance: 1) humanistic qualities (student’s individual PDI performance ratings), 2) NBDE and year three promotion scores, and 3) two faculty evaluation scores related to clinical performance—hand skills (3a) and humanistic and interactive patient-student skills (3b). Student information was deidentified by the registrar, who extracted data from the admission information, including students’ year of admission, year of undergraduate matriculation, GPAs and Dental Admission Test scores, and demographic information.

Definitions of Concepts and Study Variables

We defined “humanistic qualities” as attitudes and behaviors that reflect empathy and understanding of the patient’s perceptions (operationally defined by the ratings of assessments of students’ performance in the Patient Doctor I course). Faculty-rated student performance utilizing qualitative evaluations was quantified and assessed for reliability. Focus groups and individual interviews were used to develop a quantitative coding strategy. Faculty members used superlatives to identify high performance (1=best) and the absences of superlatives combined with negative comments to identify low performance (5=worst).6 Previously published empirical findings used to generate the coding strategy are shown in Table 1.

View this table:
  • View inline
  • View popup
Table 1

PDI evaluation ratings compared to demographic data, pre-admissions data, clinical performance, national board scores, and promotion scores

We defined “NBDE and promotion scores” as students’ command of the didactic curriculum (operationally defined by scores on the NBDE Parts I and II and year three Promotions Committee data). At HSDM, students take the NBDE I just prior to starting their third year. Most students take the NBDE II during their fourth year. We used the composite score in our analysis.

The minutes of the Promotions Committee reflect each student’s performance and the decision to promote or hold the student back for remediation. Promotions Committee data were used to score the students as follows: students receiving Honors=1; students without concerns=2/3; students held back and not allowed to go on rotation immediately after completing their third year=4; and students with serious promotion concerns=5. This rating runs parallel to PDI narrative assessment quantitative ratings with 1 being the best and 5 being the worst.

We defined “hand skills” as dexterity and mastery of manual skills associated with direct patient care (operationally defined by hand skills scores, taken from dental faculty evaluations). “Humanistic and interactive patient-student skills” were defined as the clinical management of patient care, including infection control, treatment planning, and time management (operationally defined as humanistic and interactive patient-student skills scores, taken from faculty evaluations). The faculty used numerical thresholds to evaluate clinical performance for the third-year dental students with specific procedural requirements for the following disciplines: Operative Dentistry, Prosthodontics, Periodontics, Oral Surgery, Endodontics, and Pediatric Dentistry. For each completed procedure, students received a grade for treatment planning, professionalism, and infection control (humanistic and interactive patient-student skills) and a grade for the actual clinical dental procedure (hand skills). For the study reported here, we considered all graded completed procedures during the third clinical year. These were the only available clinical grade data for the study population. We combined the grades in all disciplines in order to average the clinical procedures scores. This enabled us to generate one mean hand skills score (1=best, 5=worst) and one mean humanistic and interactive patient-student skills score (1=best, 5=worst).

Statistical Methods

Given that our research questions were new and innovative, it was hard to estimate an exact effect size. However, as the initial population that we were drawing from was over 300, we allowed for missing data or non-availability and hence used n=200 as an estimate, because even a small effect size can be detected with 0.80 power (0.1 to 0.3=small effect; 0.3 to 0.5=moderate effect; and >0.5=large difference effect).11 While the suggested Recommended Minimum Effect Size is 0.20 in social sciences,12 we wanted to report even smaller effects to illustrate findings of this pilot study by using 0.15 as a cut-off point for minimum effect size. Our final sample size of 170 is sufficient to detect an effect size of 0.14 and larger.12

Descriptive statistics were computed for all variables. Pearson and Spearman (promotions scores) were calculated among these variables: PDI evaluation ratings, demographics, pre-admission data, clinical performance, NBDE scores, and promotions scores. The relationship between PDI evaluation ratings (classified as 1, 2, 3, and 4/5) and other variables were assessed by one-way ANOVAs for continuous variables and chi-square (Pearson and Fisher exact) for categorical variables. In addition, we had hypothesized a linear relationship between PDI evaluation ratings and clinical performance (hand skills and humanistic and interactive patient-student skills). Therefore, while calculating the overall significance of the F in the two one-way ANOVAs, planned linear contrasts comparisons were performed for each clinical outcome variable. In each planned contrast comparison, weights (in parentheses) were assigned to the means for each of the four PDI groups, according to the conventions stated by Rosenthal and Rosnow13: Group 1 (−2), Group 2 (−1), Group 3 (1), and Group 4/5 (2).

Results

Data were available for 170 students who had records for all the study variables. They included students who graduated in 2003, 2005, and between 2007 and 2011. By gender, the group was 55 percent women and 45 percent men. The majority were white/non-Hispanic (55 percent). One-third (34 percent) identified themselves as Asian/Pacific Islanders. Small percentages were black non-Hispanic (4 percent) or Hispanic (5 percent). The mean age at entrance was twenty-four (CI 23.5–24.4).

Correlations among the study variables tended to be weak. Strong correlations were found between humanistic and interactive patient-student skills and hand skills (r=0.89, p<0.001) and between NBDE I and NBDE II (r=0.67, p<0.001). This correlation indicated a strong relationship between the two parts of the grading system: humanistic and interactive patient-student skills and hand skills.

The relationships between PDI evaluation ratings and other variables are shown in Table 1. None of the one-way ANOVAs or chi-square tests yielded significant results. However, tests to support the a priori hypothesis of linear relationships between PDI evaluation ratings and hand skills and humanistic and interactive patient-student skills scores were significant, both at p=0.03. The results are shown in Table 2 and Figures 1 and 2.

Figure 1
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1

Linear relationship between PDI evaluation ratings and clinical performance: humanistic and interactive patient-student skills

ANOVA F(3, 166)=1.75, p=0.16; linear contrast F(1, 166)=4.76, p=0.03 Vertical bars denote 0.95 confidence intervals.

Figure 2
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 2

Linear relationship between PDI evaluation ratings and clinical performance: hand skills

ANOVA F(3, 166)=1.75, p=0.16; linear contrast F(1, 166)=4.76, p=0.03 Vertical bars denote 0.95 confidence intervals.

View this table:
  • View inline
  • View popup
Table 2

Key words or phrases used to obtain the PDI evaluation ratings

Key Words and/or Phrases in Narrative Evaluations in Form of Direct Quotes Taken from Faculty Interviews

Discussion

Our findings supported the a priori hypothesis that students’ early ability to demonstrate a humanistic approach with patients is associated with later clinical performance. The required PDI course is akin to humanistic medicine, which may be included in the curriculum at other schools.

This study showed an association between PDI evaluation ratings (humanistic skills) and third-year clinical performance (hand skill and humanistic and interactive patient-student skills). Similar to Buyse and Lievens’s findings with Situational Judgment Tests (SJTs),14 we found that humanistic skills are a predictor for clinical performance in later years. SJTs measure interpersonal skills and noncognitive characteristics. We liken characteristics captured in SJTs to what we defined as humanistic qualities, which we used to predict student performance during the clinical years of training. Our findings support Buyse and Lievens’s suggestion that dental educators might include selection criteria assessing both noncognitive skills and cognitive skills during the admission process.

Park et al. evaluated predictors of dental student clinical performance within a predoctoral dental program.15 Proficiency was evaluated within their Clinical Evaluation System in four areas: operative, major restorative, and removable and fixed prosthodontics. They found that none of the predental and preclinical benchmarks (such as undergraduate GPA, Dental Admission Test scores, and NBDE I results) significantly predicted clinical performance. Admissions criteria and preclinical didactic performance also did not appear to be associated with clinical performance among their sample of eighty-four dental students. Similar to Park et al.’s findings, our study found that preadmissions data were not associated with clinical performance at HSDM. However, in our study, humanistic skills were associated with clinical performance.

The findings from our study suggest that research is needed to develop measures of the potential to learn the tenets of humanistic medicine. This is especially important because humanistic skills can be learned. Dental schools might consider integrating courses that teach humanistic qualities into their first-year curricula and student evaluations.

While we as dental educators seek clinical excellence, we should also strive to produce humanistic practitioners. The advent of the medical home and accountable care organizations underscore the importance of clinical practice that goes beyond traditional perspectives limited to merely the mastering of clinical skills. The mouth must be viewed as a window to assessing overall health, as oral health is a part of general health. Dentistry should align with medicine in ensuring that humanistic qualities are instilled in its graduates. The “dental home” should be fully integrated with the medical home, including the application of humanistic skills by health care providers.

Conclusion

This study demonstrated the feasibility of measuring dental students’ humanistic qualities during the first year. Humanistic qualities (PDI performance) during the first year were associated with clinical performance in the third year of dental school.

There are several caveats to consider about this study. The evaluations conducted by the faculty may be flawed due to subjectivity. However, students are evaluated by faculty members from multiple disciplines and specialties, which serves as a form of checks and balances. Although clinical faculty members in each department calibrate student performance standards at the beginning of the clinic year, there may be intra- and interevaluator variation. This is true both in PDI and in the dental clinic. In addition, given that this was a pilot investigation, the study was conducted in a single institution, and there were limitations with the size and scope of the study sample. Future investigations will benefit from larger samples and a sample frame including more than one institution. These issues limit the generalizability of these findings beyond our institution. However, we hope that these limitations will not discourage future investigations from using these findings as formative data for future research. Forthcoming directions may also include more direct or prospective measurements of humanistic/interactive behaviors in clinic settings in an effort to further corroborate these findings.

Acknowledgments

The authors wish to thank Anne Berg and Diane Spinell for their assistance with data collection, Howard Chu for his assistance with data analysis, and Dr. Beverly Woo for her ongoing support and dedication to the Patient Doctor I course. This project was supported in part by the American Dental Association 2009 IDEA award. The content is solely the responsibility of the authors and does not necessarily represent the official views of the American Dental Association.

Footnotes

  • Dr. Nelson and Dr. Maramaldi contributed equally to this work.

REFERENCES

  1. ↵
    1. Curtis DA,
    2. Lind SL,
    3. Plesh O,
    4. Finzen FC
    Correlation of admissions criteria with academic performance in dental students. J Dent Educ 2007;71:(10)1314–21.
    OpenUrlAbstract/FREE Full Text
    1. Lynch CD,
    2. McConnell RJ,
    3. Hannigan A
    . Dental school admissions in Ireland: can current selection criteria predict success? Eur J Dent Educ 2006;10(2):73–9.
    OpenUrlPubMed
  2. ↵
    1. Kingsley K,
    2. Sewell J,
    3. Ditmyer M,
    4. O’Malley S,
    5. Galbraith GM
    . Creating an evidence-based admissions formula for a new dental school: University of Nevada, Las Vegas, School of Dental Medicine. J Dent Educ 2007;71(4): 492–500.
    OpenUrlAbstract/FREE Full Text
  3. ↵
    1. Poole A,
    2. Catano VM,
    3. Cunningham DP
    . Predicting performance in Canadian dental schools: the new CDA structured interview, a new personality assessment, and the DAT. J Dent Educ 2007;71(5):664–76.
    OpenUrlAbstract/FREE Full Text
  4. ↵
    1. Chamberlain TC,
    2. Catano VM,
    3. Cunningham DP
    . Personality as a predictor of professional behavior in dental school: comparisons with dental practitioners. J Dent Educ 2005;69(11):1222–37.
    OpenUrlAbstract/FREE Full Text
  5. ↵
    1. Kalenderian E,
    2. Maramaldi P,
    3. Kinnunen TH,
    4. Spinell D,
    5. Nelson LP
    . Assessing early performance in the patient-doctor relationship in dental education. J Dent Educ 2012;76(2):159–67.
    OpenUrlAbstract/FREE Full Text
  6. ↵
    1. Lowen BA
    . Health care communications for students. In: Patient-Doctor I course guide. Boston: Harvard Medical School, 2006.
  7. ↵
    1. Susarla SM,
    2. Medina-Martinez N,
    3. Howell TH,
    4. Karimbux NY
    . Problem-based learning: effects on standard outcomes. J Dent Educ 2003;67(9):1003–10.
    OpenUrlAbstract
  8. ↵
    Health Politics with Dr. Mike Magee. What is humanistic medicine? At: www.healthpolitics.org/meetmikemagee/humanistic_medicine.asp. Accessed: November 2, 2008.
  9. ↵
    1. Charon R
    . Narrative medicine: form, function, and ethics. Ann Intern Med 2001;134(1):83–7.
    OpenUrlPubMed
  10. ↵
    1. Cohen J
    . Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum, 1988.
  11. ↵
    1. Ferguson CJ
    . An effect size primer: a guide for clinicians and researchers. Prof Psychol Res Pract 2009;40(5):532–8.
    OpenUrlCrossRef
  12. ↵
    1. Rosenthal R,
    2. Rosnow RL
    . Contrast analysis: focused comparisons in the analysis of variance. New York: Cambridge University Press, 1985.
  13. ↵
    1. Buyse T,
    2. Lievens F
    . Situational judgment tests as a new tool for dental student selection. J Dent Educ 2011;75(6):743–9.
    OpenUrlAbstract/FREE Full Text
  14. ↵
    1. Park SE,
    2. Susarla SM,
    3. Massey W
    . Do admissions data and NBDE Part I scores predict clinical performance among dental students? J Dent Educ 2006;70(5):518–24.
    OpenUrlAbstract/FREE Full Text
View Abstract

This article requires a subscription to view the full text. If you have a subscription you may use the login form below to view the article. Access to this article can also be purchased.

PreviousNext
Back to top

In this issue

Journal of Dental Education: 77 (8)
Journal of Dental Education
Vol. 77, Issue 8
1 Aug 2013
  • Table of Contents
  • Index by author

GTranslate

English French German Italian Portuguese Russian Spanish
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Journal of Dental Education.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Early Performance in a Humanistic Medicine Course as a Predictor of Dental Students’ Later Clinical Performance
(Your Name) has sent you a message from Journal of Dental Education
(Your Name) thought you would like to see the Journal of Dental Education web site.
Citation Tools
Early Performance in a Humanistic Medicine Course as a Predictor of Dental Students’ Later Clinical Performance
Linda Pollak Nelson, Peter Maramaldi, Taru H. Kinnunen, Elsbeth Kalenderian
Journal of Dental Education Aug 2013, 77 (8) 1006-1012;

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero

Request Permissions

Share
Early Performance in a Humanistic Medicine Course as a Predictor of Dental Students’ Later Clinical Performance
Linda Pollak Nelson, Peter Maramaldi, Taru H. Kinnunen, Elsbeth Kalenderian
Journal of Dental Education Aug 2013, 77 (8) 1006-1012;
del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo LinkedIn logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
  • Linkedin Share Button

Jump to section

  • Article
    • Abstract
    • Methods
    • Definitions of Concepts and Study Variables
    • Statistical Methods
    • Results
    • Discussion
    • Conclusion
    • Acknowledgments
    • Footnotes
    • REFERENCES
  • Figures & Data
  • Info & Metrics
  • PDF

Related Articles

  • No related articles found.
  • Scopus
  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Scopus (3)
  • Google Scholar

More in this TOC Section

  • Dental Dam and Isovac Usage: Factors Influencing Dental Students’ Decisions on Isolation Techniques
  • Predictive Validity of a Caries Risk Assessment Model at a Dental School
  • A Retrospective Analysis of a Cross-Year Peer Tutoring Program for Oral Health Students
Show more Predoctoral Dental Education

Similar Articles

Keywords

  • dental education
  • clinical performance
  • humanistic medicine
  • academic performance
  • admissions criteria
  • predictive study

About

  • About ADEA
  • About the JDE
  • Editorial Review Board
  • Contact Us

Author Information

  • Submit a Paper
  • Submission Information
  • FAQ for Authors
  • Reprint Policies

More Information

  • Advertise
  • Subscribe
  • Email Alerts
  • Help

© 2019 Journal of Dental Education

Powered by HighWire