Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
R E Glasgow,
T M Vogt and
S M Boles
AMC Cancer Research Center, Denver, CO 80214, USA. glasgowr@amc.org
Progress in public health and community-based interventionshas been hampered by the lack of a comprehensive evaluationframework appropriate to such programs. Multilevel interventionsthat incorporate policy, environmental, and individual componentsshould be evaluated with measurements suited to their settings,goals, and purpose. In this commentary, the authors proposea model (termed the RE-AIM model) for evaluating public healthinterventions that assesses 5 dimensions: reach, efficacy, adoption,implementation, and maintenance. These dimensions occur at multiplelevels (e.g., individual, clinic or organization, community)and interact to determine the public health or population-basedimpact of a program or policy. The authors discuss issues inevaluating each of these dimensions and combining them to determineoverall public health impact. Failure to adequately evaluateprograms on all 5 dimensions can lead to a waste of resources,discontinuities between stages of research, and failure to improvepublic health to the limits of our capacity. The authors summarizestrengths and limitations of the RE-AIM model and recommendareas for future research and application.
This article has been cited by other articles:
W. Du, C. F. Finch, A. Hayen, L. Bilston, J. Brown, and J. Hatfield Relative Benefits of Population-Level Interventions Targeting Restraint-Use in Child Car Passengers
Pediatrics,
February 1, 2010;
125(2):
304 - 312.
[Abstract][Full Text][PDF]
R. D. Reid, K.-A. Mullen, M. E. Slovinec D'Angelo, D. A. Aitken, S. Papadakis, P. M. Haley, C. A. McLaughlin, and A. L. Pipe Smoking cessation for hospitalized smokers: An evaluation of the "Ottawa Model"
Nicotine Tob Res,
January 1, 2010;
12(1):
11 - 18.
[Abstract][Full Text][PDF]
D. Romer, S. Sznitman, R. DiClemente, L. F. Salazar, P. A. Vanable, M. P. Carey, M. Hennessy, L. K. Brown, R. F. Valois, B. F. Stanton, et al. Mass Media as an HIV-Prevention Strategy: Using Culturally Sensitive Messages to Reduce HIV-Associated Sexual Behavior of At-Risk African American Youth
Am J Public Health,
December 1, 2009;
99(12):
2150 - 2159.
[Abstract][Full Text][PDF]
L M Buffart, H P van der Ploeg, B J Smith, J Kurko, L King, and A E Bauman General practitioners' perceptions and practices of physical activity counselling: changes over the past 10 years
Br. J. Sports Med.,
December 1, 2009;
43(14):
1149 - 1153.
[Abstract][Full Text][PDF]
W. Brouwer, A. Oenema, H. Raat, R. Crutzen, J. de Nooijer, N. K. de Vries, and J. Brug Characteristics of visitors and revisitors to an Internet-delivered computer-tailored lifestyle intervention implemented for use by the general public
Health Educ. Res.,
November 6, 2009;
(2009)
cyp063v1.
[Abstract][Full Text][PDF]
S. Bakken and C. M Ruland Translating Clinical Informatics Interventions into Routine Clinical Care: How Can the RE-AIM Framework Help?
JAMIA,
November 1, 2009;
16(6):
889 - 898.
[Abstract][Full Text][PDF]
R. C. Brownson, J. F. Chriqui, and K. A. Stamatakis Understanding Evidence-Based Public Health Policy
Am J Public Health,
September 1, 2009;
99(9):
1576 - 1583.
[Abstract][Full Text][PDF]
L. K. Bartholomew, W. C Cushman, J. A Cutler, B. R Davis, G. Dawson, P. T Einhorn, J. F Graumlich, L. B Piller, S. Pressel, E. J Roccella, et al. Getting clinical trial results into practice: design, implementation, and process evaluation of the ALLHAT Dissemination Project
Clinical Trials,
August 1, 2009;
6(4):
329 - 343.
[Abstract][PDF]
S. Aoun, R. Osseiran-Moisson, F. Collins, R. Newton, and M. Newton A Self-management Concept for Men at the Community Level: The `Waist' Disposal Challenge
J Health Psychol,
July 1, 2009;
14(5):
663 - 674.
[Abstract][PDF]
J. P Elder and K. Ballenger-Browning Community involvement in dengue vector control
BMJ,
June 9, 2009;
338(jun09_1):
b1023 - b1023.
[Full Text]
H. H. Severson, A. L. Peterson, J. A. Andrews, J. S. Gordon, J. A. Cigrang, B. G. Danaher, C. M. Hunter, and M. Barckley Smokeless tobacco cessation in military personnel: A randomized controlled trial
Nicotine Tob Res,
June 1, 2009;
11(6):
730 - 738.
[Abstract][Full Text][PDF]
E. F. Ellerbeck, J. D. Mahnken, A. P. Cupertino, L. S. Cox, K. A. Greiner, L. M. Mussulman, N. Nazir, T. I. Shireman, K. Resnicow, and J. S. Ahluwalia Effect of Varying Levels of Disease Management on Smoking Cessation: A Randomized Trial
Ann Intern Med,
April 7, 2009;
150(7):
437 - 446.
[Abstract][Full Text][PDF]
E. B. Fisher, R. C. Strunk, G. R. Highstein, R. Kelley-Sykes, K. L. Tarr, K. Trinkaus, and J. Musick A Randomized Controlled Evaluation of the Effect of Community Health Workers on Hospitalization for Asthma: The Asthma Coach
Arch Pediatr Adolesc Med,
March 1, 2009;
163(3):
225 - 232.
[Abstract][Full Text][PDF]
L. G. Planas Intervention design, implementation, and evaluation
Am. J. Health Syst. Pharm.,
October 1, 2008;
65(19):
1854 - 1863.
[Abstract][Full Text][PDF]
F. Li, P. Harmer, R. Glasgow, K. A. Mack, D. Sleet, K. J. Fisher, M. A. Kohn, L. M. Millet, J. Mead, J. Xu, et al. Translation of an Effective Tai Chi Intervention Into a Community-Based Falls-Prevention Program
Am J Public Health,
July 1, 2008;
98(7):
1195 - 1198.
[Abstract][Full Text][PDF]
R. Crutzen, J. de Nooijer, W. Brouwer, A. Oenema, J. Brug, and N. K. de Vries Internet-delivered interventions aimed at adolescents: a Delphi study on dissemination and exposure
Health Educ. Res.,
June 1, 2008;
23(3):
427 - 439.
[Abstract][Full Text][PDF]
K. Horn, G. Dino, C. Hamilton, N. Noerachmanto, and J. Zhang Feasibility of a smoking cessation intervention for teens in the emergency department: reach, implementation fidelity, and acceptability.
Am. J. Crit. Care.,
May 1, 2008;
17(3):
205 - 216.
[Abstract][Full Text][PDF]
S. Eldridge, D. Ashby, C. Bennett, M. Wakelin, and G. Feder Internal and external validity of cluster randomised trials: systematic review of recent trials
BMJ,
April 19, 2008;
336(7649):
876 - 880.
[Abstract][Full Text][PDF]
R. A. Meriwether, F. Lobelo, and R. R. Pate Themed Review: Clinical Interventions to Promote Physical Activity in Youth
American Journal of Lifestyle Medicine,
February 1, 2008;
2(1):
7 - 25.
[Abstract][PDF]
M. K. Campbell, K. Resnicow, C. Carr, T. Wang, and A. Williams Process Evaluation of an Effective Church-Based Diet Intervention: Body & Soul
Health Educ Behav,
December 1, 2007;
34(6):
864 - 880.
[Abstract][PDF]
M. D. Iversen CARE IV Series: State of Knowledge, Practice, and Translation in Interdisciplinary Arthritis Research and Care
Physical Therapy,
December 1, 2007;
87(12):
1574 - 1576.
[Full Text][PDF]
L. M Hayward, H S. Campbell, and C. Sutherland-Brown Aboriginal users of Canadian quitlines: an exploratory analysis
Tob. Control,
December 1, 2007;
16(Suppl_1):
i60 - i64.
[Abstract][Full Text][PDF]
C. M. Boyd, C. Boult, E. Shadmi, B. Leff, R. Brager, L. Dunbar, J. L. Wolff, and S. Wegener Guided Care for Multimorbid Older Adults: Kathleen Walsh Piercy, PhD, Editor
Gerontologist,
October 1, 2007;
47(5):
697 - 704.
[Abstract][Full Text][PDF]
K. K. Hood and T. R. Nansel Commonalities in Effective Behavioral Interventions for Children and Adolescents With Type 1 Diabetes: A Review of Reviews
Diabetes Spectr,
October 1, 2007;
20(4):
251 - 254.
[Full Text][PDF]
I. U. Eneli, I. D. Kalogiros, K. A. McDonald, and D. Todem Parental Preferences on Addressing Weight-Related Issues in Children
Clinical Pediatrics,
September 1, 2007;
46(7):
612 - 618.
[Abstract][PDF]
E. G. Eakin, S. S. Bull, K. Riley, M. M. Reeves, S. Gutierrez, and P. McLaughlin Recruitment and retention of Latinos in a primary care-based physical activity and diet trial: The Resources for Health study
Health Educ. Res.,
June 1, 2007;
22(3):
361 - 371.
[Abstract][Full Text][PDF]
R. P. Farris, J. C. Will, O. Khavjou, and E. A. Finkelstein Beyond Effectiveness: Evaluating the Public Health Impact of the WISEWOMAN Program
Am J Public Health,
April 1, 2007;
97(4):
641 - 647.
[Abstract][Full Text][PDF]
B. C.K. Choi, J. Frank, J. S. Mindell, A. Orlova, V. Lin, A. D.M.G. Vaillancourt, P. Puska, T. Pang, H. A. Skinner, M. Marsh, et al. Vision for a Global Registry of Anticipated Public Health Studies
Am J Public Health,
April 1, 2007;
97(Supplement_1):
S82 - S87.
[Abstract][Full Text][PDF]
M. Aittasalo, S. Miilunpalo, T. Stahl, and K. Kukkonen-Harjula From innovation to practice: initiation, implementation and evaluation of a physician-based physical activity promotion programme in Finland
Health Promot. Int.,
March 1, 2007;
22(1):
19 - 27.
[Abstract][Full Text][PDF]
S. J. Curry, S. Emery, A. K. Sporer, R. Mermelstein, B. R. Flay, M. Berbaum, R. B. Warnecke, T. Johnson, P. Mowery, J. Parsons, et al. A National Survey of Tobacco Cessation Programs for Youths
Am J Public Health,
January 1, 2007;
97(1):
171 - 177.
[Abstract][Full Text][PDF]
C. M. Fuller, S. Galea, W. Caceres, S. Blaney, S. Sisco, and D. Vlahov Multilevel Community-Based Intervention to Increase Access to Sterile Syringes Among Injection Drug Users Through Pharmacy Sales in New York City
Am J Public Health,
January 1, 2007;
97(1):
117 - 124.
[Abstract][Full Text][PDF]
C. M. Lyles, L. S. Kay, N. Crepaz, J. H. Herbst, W. F. Passin, A. S. Kim, S. M. Rama, S. Thadiparthi, J. B. DeLuca, M. M. Mullins, et al. Best-Evidence Interventions: Findings From a Systematic Review of HIV Behavioral Interventions for US Populations at High Risk, 2000-2004
Am J Public Health,
January 1, 2007;
97(1):
133 - 143.
[Abstract][Full Text][PDF]
M. Sabir, R. Breckman, R. Meador, E. Wethington, M. C. Reid, and K. Pillemer The CITRA Research-Practice Consensus-Workshop Model: Exploring a New Method of Research Translation in Aging
Gerontologist,
December 1, 2006;
46(6):
833 - 839.
[Abstract][Full Text][PDF]
P J Marang-van de Mheen, M C Stadlander, and J Kievit Adverse outcomes in surgical patients: implementation of a nationwide reporting system.
Qual. Saf. Health Care,
October 1, 2006;
15(5):
320 - 324.
[Abstract][Full Text][PDF]
R. E. Glasgow, L. M. Klesges, D. A. Dzewaltowski, P. A. Estabrooks, and T. M. Vogt Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues
Health Educ. Res.,
October 1, 2006;
21(5):
688 - 694.
[Abstract][Full Text][PDF]
T. B. Sahay, F. D. Ashbury, M. Roberts, and I. Rootman Effective Components for Nutrition Interventions: A Review and Application of the Literature
Health Promot Pract,
October 1, 2006;
7(4):
418 - 427.
[Abstract][PDF]
T. Prohaska, E. Belansky, B. Belza, D. Buchner, V. Marshall, K. McTigue, W. Satariano, and S. Wilcox Physical Activity, Public Health, and Aging: Critical Issues and Research Priorities
J Gerontol B Psychol Sci Soc Sci,
September 1, 2006;
61(5):
S267 - S273.
[Full Text][PDF]
D. Cassady, R. Vogt, D. Oto-Kent, R. Mosley, and R. Lincoln The Power of Policy: A Case Study of Healthy Eating Among Children
Am J Public Health,
September 1, 2006;
96(9):
1570 - 1571.
[Abstract][Full Text][PDF]
D. B. Abrams Applying Transdisciplinary Research Strategies to Understanding and Eliminating Health Disparities
Health Educ Behav,
August 1, 2006;
33(4):
515 - 531.
[Abstract][PDF]
N. D. Eves and R. C. Plotnikoff Resistance Training and Type 2 Diabetes: Considerations for implementation at the population level
Diabetes Care,
August 1, 2006;
29(8):
1933 - 1941.
[Full Text][PDF]
C. D. Etkin, T. R. Prohaska, B. A. Harris, N. Latham, and A. Jette Feasibility of Implementing the Strong for Life Program in Community Settings
Gerontologist,
April 1, 2006;
46(2):
284 - 292.
[Abstract][Full Text][PDF]
L. W. Green and R. E. Glasgow Evaluating the Relevance, Generalization, and Applicability of Research: Issues in External Validation and Translation Methodology
Eval Health Prof,
March 1, 2006;
29(1):
126 - 153.
[Abstract][PDF]
R. E. Glasgow RE-AIMing Research for Application: Ways to Improve Evidence for Family Medicine
J Am Board Fam Med,
January 1, 2006;
19(1):
11 - 19.
[Abstract][Full Text][PDF]
W. Hardeman, S. Sutton, S. Griffin, M. Johnston, A. White, N. J. Wareham, and A. L. Kinmonth A causal modelling approach to the development of theory-based behaviour change programmes for trial evaluation
Health Educ. Res.,
December 1, 2005;
20(6):
676 - 687.
[Abstract][Full Text][PDF]
N. Jackson, E. Waters, and for the Guidelines for Systematic Reviews in Healt Criteria for the systematic review of health promotion and public health interventions
Health Promot. Int.,
December 1, 2005;
20(4):
367 - 374.
[Abstract][Full Text][PDF]
J. Two Feathers, E. C. Kieffer, G. Palmisano, M. Anderson, B. Sinco, N. Janz, M. Heisler, M. Spencer, R. Guzman, J. Thompson, et al. Racial and Ethnic Approaches to Community Health (REACH) Detroit Partnership: Improving Diabetes-Related Outcomes Among African American and Latino Adults
Am J Public Health,
September 1, 2005;
95(9):
1552 - 1560.
[Abstract][Full Text][PDF]
T. Bodenheimer, D. M. Young, K. MacGregor, and J. S. Holtrop Practice-Based Research in Primary Care: Facilitator of, or Barrier to, Practice Improvement?
Ann. Fam. Med,
July 1, 2005;
3(suppl_2):
S28 - S32.
[Abstract][Full Text][PDF]
A. M. Adelman and M. Graybill Integrating a Health Coach into Primary Care: Reflections From the Penn State Ambulatory Research Network
Ann. Fam. Med,
July 1, 2005;
3(suppl_2):
S33 - S35.
[Full Text][PDF]
W. D. Pace, E. W. Staton, and S. Holcomb Practice-Based Research Network Studies in the Age of HIPAA
Ann. Fam. Med,
May 1, 2005;
3(suppl_1):
S38 - S45.
[Abstract][Full Text][PDF]
L. M. Barnett, E. van Beurden, E. G. Eakin, J. Beard, U. Dietrich, and B. Newman Program sustainability of a community-based intervention to prevent falls among older Australians
Health Promot. Int.,
September 1, 2004;
19(3):
281 - 288.
[Abstract][Full Text][PDF]
D. A. Dzewaltowski, P. A. Estabrooks, L. M. Klesges, S. Bull, and R. E. Glasgow Behavior change intervention research in community settings: how generalizable are the results?
Health Promot. Int.,
June 1, 2004;
19(2):
235 - 245.
[Abstract][Full Text][PDF]
L. Jack Jr., L. Liburd, T. Spencer, and C. O. Airhihenbuwa Understanding the Environmental Issues in Diabetes Self-Management Education Research: A Reexamination of 8 Studies in Community-Based Settings
Ann Intern Med,
June 1, 2004;
140(11):
964 - 971.
[Abstract][Full Text][PDF]
A. Donner and N. Klar Pitfalls of and Controversies in Cluster Randomization Trials
Am J Public Health,
March 1, 2004;
94(3):
416 - 422.
[Abstract][Full Text][PDF]
J Sims, N Huang, J Pietsch, and L Naccarella The Victorian Active Script Programme: promising signs for general practitioners, population health, and the promotion of physical activity
Br. J. Sports Med.,
February 1, 2004;
38(1):
19 - 25.
[Abstract][Full Text][PDF]
S. S. Bull, C. Gillette, R. E. Glasgow, and P. Estabrooks Work Site Health Promotion Research: To what Extent can we Generalize the Results and what is Needed to Translate Research to Practice?
Health Educ Behav,
October 1, 2003;
30(5):
537 - 549.
[Abstract][PDF]
R. E. Glasgow, E. Lichtenstein, and A. C. Marcus Why Don't We See More Translation of Health Promotion Research to Practice? Rethinking the Efficacy-to-Effectiveness Transition
Am J Public Health,
August 1, 2003;
93(8):
1261 - 1267.
[Abstract][Full Text][PDF]
R. E. Glasgow Translating Research to Practice: Lessons learned, areas for improvement, and future directions
Diabetes Care,
August 1, 2003;
26(8):
2451 - 2456.
[Full Text][PDF]
R. E. Glasgow, D. A. Dzewaltowski, P. A. Estabrooks, L. M. Klesges, and S. S. Bull Response to Connelly. Response from the Behavior Change Consortium Representativeness and Translation Work Group: the issue is one of impact, not of world view or preferred approach
Health Educ. Res.,
December 1, 2002;
17(6):
696 - 699.
[Full Text][PDF]
T. Bodenheimer, K. Lorig, H. Holman, and K. Grumbach Patient Self-management of Chronic Disease in Primary Care
JAMA,
November 20, 2002;
288(19):
2469 - 2475.
[Abstract][Full Text][PDF]
M. G. Ory, P. J. Jordan, and T. Bazzarre The Behavior Change Consortium: setting the stage for a new century of health behavior-change research
Health Educ. Res.,
October 1, 2002;
17(5):
500 - 511.
[Abstract][Full Text][PDF]
P. G. Clark, C. R. Nigg, G. Greene, D. Riebe, and S. D. Saunders The Study of Exercise and Nutrition in Older Rhode Islanders (SENIOR): translating theory into research
Health Educ. Res.,
October 1, 2002;
17(5):
552 - 561.
[Abstract][Full Text][PDF]
D. J. Toobert, L. A. Strycker, R. E. Glasgow, M. Barrera, and J. D. Bagdade Enhancing support for health behavior change among women at risk for heart disease: the Mediterranean Lifestyle Trial
Health Educ. Res.,
October 1, 2002;
17(5):
574 - 585.
[Abstract][Full Text][PDF]
C. R. Nigg, J. P. Allegrante, and M. Ory Theory-comparison and multiple-behavior research: common themes advancing health behavior research
Health Educ. Res.,
October 1, 2002;
17(5):
670 - 679.
[Abstract][Full Text][PDF]
S. L. Norris, J. Lau, S. J. Smith, C. H. Schmid, and M. M. Engelgau Self-Management Education for Adults With Type 2 Diabetes: A meta-analysis of the effect on glycemic control
Diabetes Care,
July 1, 2002;
25(7):
1159 - 1171.
[Abstract][Full Text][PDF]
J. A. Earp, E. Eng, M. S. O'Malley, M. Altpeter, G. Rauscher, L. Mayne, H. F. Mathews, K. S. Lynch, and B. Qaqish Increasing Use of Mammography Among Older, Rural African American Women: Results From a Community Trial
Am J Public Health,
April 1, 2002;
92(4):
646 - 654.
[Abstract][Full Text][PDF]
J. Judd, C. J. Frankish, and G. Moulton Setting standards in the evaluation of community-based health promotion programmes-- a unifying approach
Health Promot. Int.,
December 1, 2001;
16(4):
367 - 380.
[Abstract][Full Text][PDF]
L. A. Linnan, G. Sorensen, G. Colditz, N. Klar, and K. M. Emmons Using Theory to Understand the Multiple Determinants of Low Participation in Worksite Health Promotion Programs
Health Educ Behav,
October 1, 2001;
28(5):
591 - 607.
[Abstract][PDF]
M Higgins Patients, families and populations at high risk for coronary heart disease
Eur. Heart J.,
September 2, 2001;
22(18):
1682 - 1690.
[PDF]
B. K. Rimer, K. Glanz, and G. Rasband Searching for Evidence about Health Education and Health Behavior Interventions
Health Educ Behav,
April 1, 2001;
28(2):
231 - 248.
[Abstract][PDF]
R. E. Glasgow and S. S. Bull Making a Difference With Interactive Technology: Considerations in Using and Evaluating Computerized Aids for Diabetes Self-Management Education
Diabetes Spectr,
April 1, 2001;
14(2):
99 - 106.
[Abstract][Full Text][PDF]
S. L. Norris, M. M. Engelgau, and K.M. Venkat Narayan Effectiveness of Self-Management Training in Type 2 Diabetes: A systematic review of randomized controlled trials
Diabetes Care,
March 1, 2001;
24(3):
561 - 587.
[Abstract][Full Text]
R. E. Glasgow, R. G. Hiss, R. M. Anderson, N. M. Friedman, R. A. Hayward, D. G. Marrero, C. B. Taylor, and F. Vinicor Report of the Health Care Delivery Work Group: Behavioral research related to the establishment of a chronic disease model for diabetes care
Diabetes Care,
January 1, 2001;
24(1):
124 - 130.
[Abstract][Full Text]
R. E. Glasgow Diabetes Education Research
The Diabetes Educator,
November 1, 1999;
25(6_suppl):
5 - 6.
[PDF]
E. A. Walker Characteristics of the Adult Learner
The Diabetes Educator,
November 1, 1999;
25(6_suppl):
16 - 24.
[Abstract][PDF]
R. E. Glasgow Outcomes of and for Diabetes Education Research
The Diabetes Educator,
November 1, 1999;
25(6_suppl):
74 - 88.
[Abstract][PDF]