JDE
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


J Dent Educ. 73(2_suppl): 10-14 2009
© 2009 American Dental Education Association
This Article
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Andersen, R. M.
Right arrow Articles by Davidson, P. L.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Andersen, R. M.
Right arrow Articles by Davidson, P. L.

Chapter 1

Introduction to the Evaluating the Dental Pipeline Program Report

Ronald M. Andersen, Ph.D.; Pamela L. Davidson, Ph.D.

Key words: dental education, community-based clinical education, minority student recruitment, curricular change, dental care access

This report describes the evaluation of the Pipeline, Profession, and Practice: Community-Based Dental Education program, sponsored by the Robert Wood Johnson Foundation (RWJF) and The California Endowment (TCE). The Pipeline program was developed to address the critical shortage of oral health care for underserved and disadvantaged populations in the United States. The report is published to document the successes, challenges, and lessons learned in the program and explore implications for the dental and other health professions.

RWJF funded programs in eleven of the fifty-six accredited dental schools in 2002. In 2003, TCE funded four additional programs in dental schools in California. The National Evaluation Team (NET) based in the Department of Health Services at the University of California, Los Angeles, School of Public Health was chosen by the foundations to be the national evaluator of the Pipeline program. The NET employed a multidisciplinary team using qualitative and quantitative methods and multiple data sources to conduct a comprehensive five-year evaluation of the program. In addition, the NET in collaboration with the American Dental Education Association (ADEA) received a grant from the RWJF to publish this report.

In total, the two foundations invested more than $25 million in the Pipeline program and its evaluation. Additionally, the W.K. Kellogg Foundation and TCE contributed $1.6 million for financial aid to underrepresented minority and low-income students recruited by the Pipeline schools.


   Significance of the Pipeline Program
 Top
 Author information
 Significance of the pipeline...
 Goals of the pipeline...
 Contents of this report
 Utilization of the report...
 References
 
The Pipeline program fits well under major programmatic initiatives of both the RWJF and TCE. Both seek to invest in human capital for health and health care. The concept of human capital has a long tradition in the economics of investment. Arthur Cecil Pigou noted in 1928, "There is such a thing as investment in human capital as well as investment in material capital . . . beyond the region of luxuries and ‘unnecessary’ comforts; a check to personal consumption is also a check to investment."1 Later, in his classic work, Human Capital, Gary Becker noted that just as one can invest in the physical means of production (e.g., factories and machines), one can also invest in human capital via education, training, or medical treatment.2

The Pipeline program is part of RWJF’s major program area, the Human Capital Portfolio. This portfolio "seeks to assure that the nation has a diverse, well-trained leadership and workforce in health and health care to meet the needs of all Americans."3 It aims to build diversity in the health professions and increase the number of health and health care professionals trained in quality improvement methods.

The Pipeline program is also an implementation of TCE’s mission, which includes expanding "access to affordable, quality health care for underserved individuals and communities."4 A goal to achieve this mission is to make a health care system that is "culturally competent to respond to the diversity and demographic changes in the state of California." Under this goal, TCE funds proposals that "focus on increasing racial and ethnic diversity of the health care workforce and improving the geographic distribution of health providers, particularly in rural and underserved areas."

Both foundations are especially interested, from a human capital perspective, in investing in underrepresented and low-income populations. These needy populations have great potential for human capital development through increased investment in their education, training, and medical treatment.

The need for the Pipeline program and the importance of the concerns it addresses have been documented by significant national reports. First, the Institute of Medicine’s report on diversity in health care emphasized that human capital development of diverse populations through health care requires a strong, capable, and diverse health care workforce.5 Such a workforce is nurtured through leadership development, training, and research funding. Second, the U.S. surgeon general’s report on oral health referred specifically to the oral health professions’ workforce diversity and development.6 The nation’s oral health has improved, but critical access problems remain and disparities exist, according to the report, especially for underrepresented minority populations. Arguably, the disparities are greater for oral health than for general health. Yet the dental safety net of providers for the underserved is limited, and access problems seem likely to accelerate unless a new tack is taken.

One such tack is to make the dental workforce more diverse by increasing minority representation in the dental profession. In general, minorities appear more willing to seek care from someone with whom they more easily identify.7 For example, they may prefer language-concordant providers.8 Also, minority providers are more likely to provide care to underserved minority populations, and minority dental students and dental students prepared to treat diverse populations are more likely to plan to care for diverse patients.914 Entry into the health professions by underrepresented minorities at least in proportion to their number in society (if not in proportion to the needs of minority groups) might be argued to be a requirement in an equitable society.


   Goals of the Pipeline Program
 Top
 Author information
 Significance of the pipeline...
 Goals of the pipeline...
 Contents of this report
 Utilization of the report...
 References
 
In response to the evidence and societal values concerning oral health disparities and lack of diversity among oral health providers, RWJF and, subsequently, TCE sponsored the Pipeline program. The initiative focuses on recruitment and retention of underrepresented minority dental students, curriculum revisions to stress community-based dental education, and increased extramural clinical rotations for students in the community. The expectation for the program is that these changes in dental education can lead to improved access for underserved populations. The Pipeline program seeks not only to increase underrepresented minority recruitment but also to build cultural competence for all dental students so that they are better prepared to treat a diverse group of patients.

Specifically, the primary goal of the Pipeline program is to reduce disparities in access to dental care. To achieve this goal, the objectives established by RWJF were the following:

  1. To increase the number of underrepresented minority and low-income students (URM/LI) enrolled in Pipeline dental schools;
  2. To provide students with didactic courses and clinical experiences to prepare them for treating disadvantaged patients in community sites; and
  3. To have senior students spend an average of sixty days in patient-centered community clinics and practices treating underserved patients.

TCE made some adjustments to the three RWJF program objectives. In addition to senior students, TCE accepted general and pediatric dentistry residents to meet the average of sixty days in community-based facilities treating underserved patients, but specified that 25 percent of the community sites had to be located in rural communities. Also, TCE required the California schools to cooperate in the development of a regional recruitment program for underrepresented and low-income students and a coordinated state and federal health policy agenda. The purpose of the policy effort was to sustain the community-based education and disadvantaged student recruitment programs after the Pipeline program ended and, more broadly, to reduce disparities in oral health.


   Contents of This Report
 Top
 Author information
 Significance of the pipeline...
 Goals of the pipeline...
 Contents of this report
 Utilization of the report...
 References
 
This report documents the NET’s efforts to conduct an objective external evaluation of a national demonstration program. It describes the Pipeline program and its development, the methods used in the evaluation, and the evaluation findings and their implications.

Chapter 2 describes the Pipeline program.15 It is written by Howard Bailit and Allan Formicola, co-directors of the National Program Office (NPO), and their associates who developed the Pipeline program, selected and monitored the participating schools, and provided them with technical assistance throughout the project. It is written from the perspective of these involved stakeholders who, indeed, were part of the intervention and includes their perceptions of what did and did not work.

Chapter 3 presents the comprehensive evaluation framework developed by the NET and the literature review relevant to each component of the framework.16 The components include the context or environment in which the Pipeline program operates, as well as the structure and processes of the program itself that influenced program outcomes for the Pipeline schools. These outcomes include changes in recruitment, curriculum, external clinical rotations, practice plans of graduating students, health policy initiatives, and oral health care outcomes for underserved populations, as well as the likelihood of whether observed changes can be sustained.

Chapter 4 describes the ingredients for conducting a large-scale longitudinal evaluation.17 The evaluation process was initiated when the NET successfully competed for the grant to evaluate the Pipeline program. The major purpose of this chapter is to describe the process used to conduct the longitudinal evaluation and to summarize the methods used in the data collection and analysis. We show how the larger policy questions related to workforce diversity and oral health care access were translated into concrete and measurable evaluation questions. In turn, these questions led to the design of the evaluation framework or logic model. The framework was used as a guide for specifying and operationalizing variables to assess the effects of context, structure, and process on the intermediate and longer-term program outcomes. We identified relevant stakeholders and used existing data sources or created new data sources if none existed. Various evaluation designs were used in the study, depending on the evaluation questions and data sources used to address the question. The chapter culminates with a description of opportunities and challenges related to data triangulation.

After an introduction in Chapter 5.0, Chapters 5.1 through 5.14 are case studies for fourteen Pipeline schools participating in Phase I of the program.1832 These case studies are written by co-investigators on the NET team who chaired multiple site visits to each of the schools over the course of the project (three visits to the RWJF-funded schools and two visits to the TCE-funded schools). The coauthors for each case study are other NET team members who participated in the site visits. The UCLA site visits were chaired by Dr. Helen Gift, Ruth Stafford Co-nabeer Distinguished Service Professor of Sociology and Organizational Systems at Brevard College, who has extensive oral health care research and evaluation experience but no UCLA affiliation in order to ensure the objectivity of the UCLA evaluation. (All of the NET co-investigators have affiliations with the UCLA Schools of Public Health and/or Dentistry.) The case studies utilize all of the data sources collected by the NET and include discussions of all of the major outcomes as assessed for that particular school. These include recruitment, curriculum, clinical services, and practice plans of the fourth-year dental students, as well as consideration of the sustainability of Pipeline achievements and the involvement of the California schools and some others in collaborative health policy initiatives. Each case study also includes an invited response of the principal investigator of the Pipeline initiative at that school to critique the case study and provide general commentary on the program.

Chapters 6.0 through 6.6 present findings from the evaluation but shift from case studies of the Pipeline schools to comparisons across the schools and between Pipeline schools and other dental schools not part of the Pipeline program.3339 These chapters report on the results of multivariable analyses using variables from all components of the conceptual framework to determine the influence of the Pipeline program on key outcomes expected. These outcomes include URM recruitment, community-based dental education curriculum development, extramural clinical rotations, practice plans of graduating students, health policy involvement of the Pipeline schools, and the likelihood that Pipeline achievements can be sustained after completion of the project.

Chapter 7 brings the work of the NET evaluation together.40 It summarizes the findings, draws conclusions, and reports on the policy implications of the results and lessons learned for program implementation and evaluation.

For this study, the NET obtained the assistance of two respected external reviewers: Dr. Raymond Kuthy, University of Iowa, and Dr. Marilyn Woolfolk, University of Michigan. These reviewers critiqued and provided comments on drafts of Chapters 1 through 7 of this report. In Chapter 8, they provide their own assessments of the Pipeline program and its evaluation.41 The chapter also includes assessments and lessons learned from the perspective of Howard Bailit, Allan Formicola, and Kim C. D’Abreu from the National Program Office.

An afterword by George Zamora and Ignatius Bau from The California Endowment follows Chapter 8.42 This afterword describes Phase II of the California Pipeline program that seeks to further increase minority enrollment, integrate cultural competence into the curriculum, and expand community-based dental education in the California dental schools.


   Utilization of the Report and the Evaluation Findings
 Top
 Author information
 Significance of the pipeline...
 Goals of the pipeline...
 Contents of this report
 Utilization of the report...
 References
 
The NET hopes this report will be widely distributed and read by those interested in health professions education, workforce diversity, and access to care. The intended audiences include educators and administrators undertaking school and curriculum reform, practitioners involved in community-based clinical training, evaluators of health and education programs, researchers who study health professions and higher education, and policymakers interested in reforms to improve workforce diversity and access in underserved and low-income populations.


   Author Information
 Top
 Author information
 Significance of the pipeline...
 Goals of the pipeline...
 Contents of this report
 Utilization of the report...
 References
 
Dr. Andersen is the Wasserman Professor Emeritus, former Chair of the Department of Health Services, School of Public Health, University of California, Los Angeles, and Principal Investigator on the National Evaluation Team for the Pipeline program; Dr. Davidson is Associate Professor, School of Public Health, University of California, Los Angeles, and Project Director and Co-Principal Investigator on the National Evaluation Team for the Pipeline program. Direct correspondence to Dr. Ronald M. Andersen, Wasserman Professor Emeritus, UCLA School of Public Health, Box 951772, 31-269 CHS, Los Angeles, CA 90095-1772; 310-206-1810 phone; 310-825-3317 fax; randerse{at}ucla.edu.


   REFERENCES
 Top
 Author information
 Significance of the pipeline...
 Goals of the pipeline...
 Contents of this report
 Utilization of the report...
 References
 

  1. Pigou AC. A study in public finance. London: Macmillan and Co., Limited, 1923:29.
  2. Becker GS. Human capital: a theoretical and empirical analysis, with special reference to education. 3rd ed. Chicago: University of Chicago Press, 1993.
  3. Robert Wood Johnson Foundation (RWJF). Program areas: building human capital. At: www.rwjf.org/programareas/. Accessed: October 21, 2008.
  4. The California Endowment (TCE). Program areas: access to health. At: www.calendow.org/program_areas/index.stm. Accessed: October 21, 2008.
  5. In the nation’s compelling interest: ensuring diversity in the health care workforce. Washington, DC: Institute of Medicine, 2004.
  6. Oral health in America: a report of the surgeon general. Rockville, MD: U.S. Department of Health and Human Services, National Institute of Dental and Craniofacial Research, National Institutes of Health, 2000. At: www.surgeongeneral.gov/library/oralhealth. Accessed: May 25, 2007.
  7. Cohen JJ, Gabriel BA, Terrell C. The case for diversity in the health care workforce. Health Aff (Millwood) 2002; 21(5):90–102.[Abstract/Free Full Text]
  8. Saha S, Taggart SH, Komaromy M, Bindman AB. Do patients choose physicians of their own race? Health Aff (Millwood) 2000; 19(4):76–83.[Abstract]
  9. Butters JM, Winter PA. Professional motivation and career plan differences between African-American and Caucasian dental students: implications for improving workforce diversity. J Natl Med Assoc 2002; 94(6):492–504.[Medline]
  10. Davidson PL, Carreon DC, Baumeister SE, Nakazono TT, Gutierrez JJ, Afifi AA, Andersen RM. Influence of contextual environment and community-based dental education on practice plans of graduating seniors. J Dent Educ 2007; 71(3):403–18.[Abstract/Free Full Text]
  11. Hayes-Bautista DE, Kahramanian MI, Richardson EG, Hsu P, Sosa L, Gamboa C, Stein RM. The rise and fall of the Latino dentist supply in California: implications for dental education. J Dent Educ 2007; 71(2):227–34.[Abstract/Free Full Text]
  12. Mofidi M, Konrad TR, Portefield DS, Niska R, Wells B. Provisions of care to the underserved population by National Health Service Corps alumni dentists. Health Dent 2002; 62(2):102–8.
  13. Rosenblatt RA, Andrilla CH. The impact of U.S. medical students’ debt on their choice of primary care careers: an analysis of data from the 2002 medical school graduation questionnaire. Acad Med 2005; 80(9):815–9.[Medline]
  14. Taylor RW, Kress GC Jr. Factors that influence minority dental students’ career plans. J Dent Educ 1987; 51(9): 528–31.[Abstract]
  15. Bailit HL, Formicola AJ, D’Abreu K, Bau I, Zamora G, Stavisky JS. The dental pipeline program: the national program office perspective. J Dent Educ 2009; 73(2 Suppl): S15–S22.[Free Full Text]
  16. Carreon DC, Davidson PL, Andersen RM. The evaluation framework for the dental pipeline program with literature review. J Dent Educ 2009; 73(2 Suppl):S23–S36.[Free Full Text]
  17. Davidson PL, Nakazono TT, Afifi A, Gutierrez JJ. Methods for evaluating change in community-based dental education. J Dent Educ 2009; 73(2 Suppl):S37–S51.[Free Full Text]
  18. Gutierrez JJ, Nakazono TT, Carreon DC, Andersen RM. Introduction to case studies of the pipeline program at fourteen U.S. dental schools. J Dent Educ 2009; 73 (2 Suppl):S52–S57.[Free Full Text]
  19. Crall JJ, Hewlett ER, Friedman JA. The pipeline program at Boston University Goldman School of Dental Medicine. J Dent Educ 2009; 73(2 Suppl):S58–S69.[Free Full Text]
  20. Andersen RM, Atchison KA, Hewlett ER. The pipeline program at Howard University College of Dentistry. J Dent Educ 2009; 73(2 Suppl):S70–S82.[Free Full Text]
  21. Friedman JA, Thind A, Davidson PL. The pipeline program at Meharry Medical College School of Dentistry. J Dent Educ 2009; 73(2 Suppl):S83–S95.[Free Full Text]
  22. Thind A, Hewlett ER, Andersen RM. The pipeline program at The Ohio State University College of Dentistry: Oral Health Improvement through Outreach (OHIO) Project. J Dent Educ 2009; 73(2 Suppl):S96–S107.[Free Full Text]
  23. Davidson PL, Thind A, Friedman JA, Carreon DC. The pipeline program at the University of Connecticut School of Dental Medicine. J Dent Educ 2009; 73(2 Suppl): S108–S119.[Free Full Text]
  24. Atchison KA, Hewlett ER, Friedman JA. The pipeline program at the University of Illinois at Chicago College of Dentistry. J Dent Educ 2009; 73(2 Suppl):S120–S134.[Free Full Text]
  25. Hewlett ER, Andersen RM, Atchison KA. The pipeline program at the University of North Carolina at Chapel Hill School of Dentistry. J Dent Educ 2009; 73(2 Suppl): S135–S147.[Free Full Text]
  26. Atchison KA, Friedman JA, Freed JR. The pipeline program at the University of Washington School of Dentistry. J Dent Educ 2009; 73(2 Suppl):S148–S160.[Free Full Text]
  27. Friedman JA, Hewlett ER, Atchison KA. The pipeline program at West Virginia University School of Dentistry. J Dent Educ 2009; 73(2 Suppl):S161–S174.[Free Full Text]
  28. Crall JJ, Friedman JA, Atchison KA. The pipeline program at Loma Linda University School of Dentistry. J Dent Educ 2009; 73(2 Suppl):S175–S185.[Free Full Text]
  29. Gift HC, Andersen RM, Davidson PL, Thind A. The pipeline program at the University of California, Los Angeles, School of Dentistry. J Dent Educ 2009; 73(2 Suppl):S186–S198.[Free Full Text]
  30. Hewlett ER, Andersen RM, Atchison KA. The pipeline program at the University of California, San Francisco, School of Dentistry. J Dent Educ 2009; 73(2 Suppl): S199–S210.[Free Full Text]
  31. Thind A, Andersen RM, Davidson PL. The pipeline program at the University of the Pacific Arthur A. Dugoni School of Dentistry. J Dent Educ 2009; 73(2 Suppl): S211–S221.[Free Full Text]
  32. Davidson PL, Andersen RM, Thind A. The pipeline program at the University of Southern California School of Dentistry. J Dent Educ 2009; 73(2 Suppl):S222–S235.[Free Full Text]
  33. Gutierrez JJ, Nakazono TT, Carreon DC, Andersen RM. Introduction to the cross-site comparisons and multivariable analyses of the dental pipeline program. J Dent Educ 2009; 73(2 Suppl):S236–S237.[Free Full Text]
  34. Andersen RM, Friedman JA, Carreon DC, Bai J, Nakazono TT, Afifi A, Gutierrez JJ. Recruitment and retention of underrepresented minority and low-income dental students: effects of the pipeline program. J Dent Educ 2009; 73(2 Suppl):S238–S258.[Free Full Text]
  35. Hewlett ER, Davidson PL, Nakazono TT, Carreon DC, Gutierrez JJ, Afifi A. Revisions to dental school curricula: effects of the pipeline program. J Dent Educ 2009; 73(2 Suppl):S259–S268.[Free Full Text]
  36. Atchison KA, Thind A, Nakazono TT, Wong D, Gutierrez JJ, Carreon DC, Andersen RM. Community-based clinical dental education: effects of the pipeline program. J Dent Educ 2009; 73(2 Suppl):S269–S282.[Free Full Text]
  37. Davidson PL, Nakazono TT, Carreon DC, Bai J, Afifi A. Practice plans of dental school graduating seniors: effects of the pipeline program. J Dent Educ 2009; 73(2 Suppl): S283–S296.[Free Full Text]
  38. Thind A, Atchison KA, Nakazono TT, Gutierrez JJ, Carreon DC, Bai J. Sustainability of dental school recruitment, curriculum, and community-based pipeline initiatives. J Dent Educ 2009; 73(2 Suppl):S297–S307.[Free Full Text]
  39. Crall JJ, Davidson PL, Nakazono TT, Gutierrez JJ, Andersen RM. Involvement in health policy regarding oral health care and dental education: effects of the pipeline program. J Dent Educ 2009; 73(2 Suppl):S308–S318.[Free Full Text]
  40. Andersen RM, Davidson PL, Atchison KA, Crall JJ, Fried-man JA, Hewlett ER, Thind A. Summary and implications of the dental pipeline program evaluation. J Dent Educ 2009; 73(2 Suppl):S319–S330.[Free Full Text]
  41. Kuthy RA, Woolfolk M, Bailit HL, Formicola AJ, D’Abreu K. Assessment of the dental pipeline program from the external reviewers and national program office. J Dent Educ 2009; 73(2 Suppl):S331–S339.[Free Full Text]
  42. Zamora G, Bau I. Afterword to the evaluating the dental pipeline program report: the California dental pipeline program, phase II. J Dent Educ 2009; 73(2 Suppl): S340–S343.[Free Full Text]



This article has been cited by other articles:


Home page
J Dent EducHome page
H. L. Bailit, A. J. Formicola, K. C. D'Abreu, I. Bau, G. Zamora, and J. S. Stavisky
The Dental Pipeline Program: The National Program Office Perspective
J Dent Educ., February 1, 2009; 73(2_suppl): S15 - 22.
[Full Text] [PDF]


Home page
J Dent EducHome page
J. J. Gutierrez, T. T. Nakazono, D. C. Carreon, and R. M. Andersen
Introduction to the Cross-Site Comparisons and Multivariable Analyses of the Dental Pipeline Program
J Dent Educ., February 1, 2009; 73(2_suppl): S236 - 237.
[Full Text] [PDF]


This Article
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Andersen, R. M.
Right arrow Articles by Davidson, P. L.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Andersen, R. M.
Right arrow Articles by Davidson, P. L.


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS