© 2003 American Public Health Association
Richard K. Zimmerman, Mary Patricia Nowalk, Mahlon Raymund, and Melissa Tabbarah are with the Department of Family Medicine and Clinical Epidemiology, University of Pittsburgh School of Medicine, Pittsburgh, Pa. Richard K. Zimmerman is also with the Department of Behavioral and Community Health Sciences, Graduate School of Public Health, University of Pittsburgh, as is Edmund M. Ricci. David G. Hall is with the East Liberty Family Health Care Center, Pittsburgh. J. Todd Wahrenberger is with the Northside Christian Health Center, Pittsburgh. Stephen A. Wilson is with the University of Pittsburgh Medical Center St. Margaret Family Practice Residency. Correspondence: Requests for reprints should be sent to Richard K. Zimmerman, MD, MPH, Department of Family Medicine and Clinical Epidemiology, University of Pittsburgh School of Medicine, 3518 Fifth Ave, Pittsburgh, PA 15261 (e-mail: zimmer{at}pitt.edu).
Objectives. We designed and evaluated interventions to increase adult immunizations within inner-city health centers. Methods. Interventions included reminders, standing orders, and walk-in "flu shot clinics." Patients were surveyed and records evaluated. Results. Records from 1 center showed that immunization rates increased from 24% to 30% (P < .001) for patients aged 50 to 64 years and from 45% to 53% for patients aged 65 years and older (P < .001). Self-reported vaccination rates did not increase. In logistic regression analyses, the strongest predictor of vaccination among patients aged 50 to 64 years was the belief that unvaccinated persons will contract influenza (odds ratio [OR] = 5.4; 95% confidence interval [CI] = 2.4, 12.0). Among patients aged 65 years and older, the strongest predictor of vaccination was the belief that friends/relatives thought that they should be vaccinated (OR = 9.7; 95% CI = 4.2, 22.3). Conclusions. Tailored interventions can improve immunization rates at inner-city health centers.
In the United States, influenza is responsible for more than 36 000 deaths per year.1 It is estimated that influenza vaccine prevents thousands of deaths each year, yet in the second quarter of 2002, the influenza vaccination rate was only 68% among adults aged 65 years and older.2 Even lower vaccination rates among elderly minority populations have been reported, including rates of 47% for Hispanics and 52% for Blacks of nonHispanic origin.3 For this reason, racial disparity in immunization rates is one of the areas targeted for elimination in the US Public Health Services Healthy People 2010 objectives for the nation.4 Moderate overall immunization rates and racial disparity in rates are perplexing, given that (1) Medicare covers influenza vaccine, (2) influenza vaccine is known to be efficacious, and (3) systematic reviews of effective methods to increase immunization rates have been published.5,6 In our approach to the present study, we were influenced by the in-depth analyses of barriers to prevention of Miller, Stange, Crabtree, and others, who have pointed out the complexity and diversity of primary-care practices and the importance of understanding the internal operating models and values of each practice.79 They point to the need to tailor interventions to the practice to enhance success and continued use of the interventions.912 We sought to implement tailored interventions to raise adult immunization rates in inner-city health centers.
At each health center that served as a study site, we shared results from our earlier study of immunization barriers in inner-city health centers1315 and conducted provider education on immunization, including discussions about types of interventions proven to be effective by systematic evidence reviews.6 Centers were then encouraged to choose interventions that staff believed would be most effective and feasible, given the unique characteristics of each centers operational systems, staffing patterns, and patient population. The impact of these tailored interventions was evaluated with a survey of patients about immunization and, where applicable, patients electronic medical records (EMRs) documenting administration of the influenza vaccine.
Site Descriptions Health Center A consists of 2 sister sites in the same organization serving different neighborhoods. One site is located in a primarily residential neighborhood, and the other is on a side street of a commercial district but within 1 to 2 blocks of public-housing high-rise apartments. Health Center A has 6 full-time equivalent (FTE) providers with 12 medical support staff divided between the 2 sites. This center served a total of 5610 persons in 2002, of whom 48% were Black, 25% were White, and 2% were Hispanic or other (25% were unreported). Health insurance coverage for patients at Health Center A is 22% uninsured, 33% Medicaid, and 45% private/Medicare/other. Health Center B is a single site located in a mixed-use commercial district on a busy thoroughfare. It has 3.2 FTE providers with 2 medical support staff. This center served 3984 persons in 2002, of whom 45% were Black, 51% were White, 1% were Hispanic, and 3% were Asian. The insurance coverage of Health Center B patients is 16% uninsured, 37% Medicaid, and 47% private/Medicare/other.
Interventions
Immunization Rates Immunization rates for the 20002001 and 20012002 influenza seasons were defined in 2 distinct ways: (1) patient selfreporting on the survey and (2) number of doses divided by number of patients from EMRs. Total doses administered were collected from immunization logs.
Survey
Questionnaire.
The questionnaire was designed by a multidisciplinary team using an iterative process. It was based on the Triandis model for consumer decisionmaking, which draws upon the theory of reasoned action. This model considers facilitating conditions (e.g., the ease of travel for a flu shot) and behavioral intention. This factor consists of attitude about the activity (e.g., belief that getting a flu shot is wise), social influences (e.g., physician or family member recommends the flu shot), and the consequences of the activity (e.g., the flu shot prevents flu). The model accurately predicts a variety of behaviors,1619 including exercise18 and birth control/fertility17 behavior. It has been used in different cultural and economic situations.17 In several analyses, Montano has shown the model to be internally consistent and externally valid when used for predicting influenza immunization (Cronbach The final questionnaire contained approximately 57 questions, depending on skip pattern, including multiple-choice items and Likert scale items. Each of the sampled patients was sent a personalized introductory letter and a letter from the respective site endorsing the project and encouraging participation. An honorarium was offered to encourage participation. Interviews were performed with computer-assisted telephone interviewing (CATI). Use of CATI allowed for data entry during the interviews, directed the sequence of questioning, prevented skipped questions through automated skip patterns, and blocked illogical or out-of-range values. Trained interviewers conducted the telephone interviews between August and October 2002, before vaccine supplies for the next season were delivered. Statistical analysis. We calculated weights based on the achieved sample to account for different sampling fractions and stratification by age group and site. Chi-square tests were weighted and used to compare participants who did and did not receive the 20012002 influenza vaccine for the variables of interest by age group. Frequency data are reported as weighted percentages only (i.e., reported sample sizes are unweighted). The McNemar test was used to evaluate yearly differences between vaccination rates overall and by site and age group. Logistic regression analyses were also weighted and performed to determine variables significantly associated with receipt of the influenza vaccine in the 20012002 season by age group. All variables of P < .10 were included with the outcome variable in a forward selection procedure. Statistical significance was set at P < .05, and all statistical analyses were conducted with SAS software (SAS Institute Inc, Cary, NC).
EMRs EMR statistical analysis. Immunization dates, date of first visit, and date of most recent visit retrieved on October 8, 2002, and cleaned with FORTRAN 77 software (Free Software Foundation, Boston, Mass). Using dates of first and most recent visits, we created denominators for each influenza vaccination season. SAS software was used to calculate influenza immunization rates from September 1, 2000, to August 31, 2002, and the McNemar test was used to evaluate yearly differences between vaccination rates by age group for Health Center A.
Patient Survey Demographics. Demographic characteristics, with the exception of race, among patients who completed the survey did not vary by site. Health Center A had a significantly higher proportion of Black respondents than did Health Center B (57% vs 34%; P < .001). Demographic characteristics differed by age for marital status, annual household income, highest level of education completed, and employment status. Compared with patients aged 50 to 64 years (n = 185), patients aged 65 years and older (n = 190) were more frequently widowed (46% vs 15%) and less frequently single (8% vs 17%), married (28% vs 32%), or separated/divorced (18% vs 36%) (P < .001). Furthermore, patients aged 65 years and older reported annual household incomes less than $20 000 (75% vs 56%; P = .009), fewer years of education (up to high school graduate, or technical or vocational school) (75% vs 53%; P < .001), and unemployed work status (88% vs 46%; P < .001).
Overall, 210 respondents (53%) reported being vaccinated between September 2001 and March 2002 (i.e., during the 20012002 influenza vaccination season). Despite the difference in racial distribution by site, vaccination rates did not vary by site. Vaccination rates were 58% for Health Center A and 49% for Health Center B (P = .114). Vaccination rates differed significantly by age, with older patients more frequently reporting being vaccinated (65%) than did younger patients (47%) (P < .001). Therefore, subsequent analyses were stratified by age. Demographic and health characteristics by age and vaccination status are shown in Table 2
Influences and rationale. The survey allowed patients to cite more than 1 source for hearing about the vaccine. No differences across age groups were found in how patients heard about the vaccine (P = .158), whether they received a letter from their physician regarding vaccination (P = .751), or whether they saw a poster advertising a "flu shot clinic" (a time set aside for administering influenza vaccines with no appointment needed) (P = .263). Within the 50- to 64-year age group, however, vaccinated patients reported hearing about the flu shot most frequently from medical professionals (65%), compared with 45% of unvaccinated patients (P < .001), whereas more frequent sources of information about the flu shot for unvaccinated patients were TV/radio (52% vaccinated vs 62% unvaccinated; P = .045) and friends/family (20% vaccinated vs 42% unvaccinated; P = .002). Among patients aged 65 years and older, vaccination status did not differ by source for hearing about the flu shot. Reasons mentioned for getting vaccinated differed by age group: flu prevention (50 to 64 years: 64%; 65 years and older: 83%), having a history of flu (50 to 64 years: 18%; 65 years and older: 8%), receiving a recommendation from a health professional (50 to 64 years: 14%; 65 years and older: 8%), to prevent others from getting the flu (50 to 64 years: 1%; 65 years and older: 1%), and other (50 to 64 years: 3%; 65 and older years: 0%) (P = .039). Interestingly, convenience and the vaccine being given free of charge were not reasons given for receiving the influenza vaccine within either age group. In addition, setting of vaccination did not differ between age groups (P = .775), and most vaccinations took place in a physicians office during a regular visit (50 to 64 years: 67%; 65 years and older: 63%), or other locations such as a "flu shot clinic" in the community (50 to 64 years: 19%; 65 years and older: 21%), the health department/other (50 to 64 years: 11%; 65 years and older: 10%), or a vaccine clinic at a physicians office (50 to 64 years: 3%; 65 years and older: 6%). The survey allowed patients to cite more than 1 reason for not getting vaccinated. Among the unvaccinated, patients differed significantly by age group in reasons for not getting vaccinated (P = .009). Unvaccinated patients aged 50 to 64 years attributed their behavior to believing that they were not likely to get the flu (33%), having had a previous adverse reaction to influenza vaccine (18%), fearing side effects (16%), not knowing it was needed (13%), forgetting (5%), lacking the time to get the shot (3%), being allergic to the vaccine (2%), believing that the flu shot causes the flu (1%), and other/unspecified reasons (8%). By contrast, unvaccinated patients aged 65 years and older attributed their behavior to having had a previous adverse reaction to influenza vaccine (33%), forgetting to get the shot (15%), fear of side effects (18%), believing that they were unlikely to get the flu (11%), not knowing the shot was needed (5%), being sick at the time the vaccine was recommended (5%), believing that the flu shot causes the flu (5%), and other/unspecified reasons (6%).
Facilitators of and barriers to immunization.
Participants were asked a series of questions to determine which factors of the Triandis model were related to vaccination status. Compared with patients aged 65 years and older, younger patients more frequently paid for the vaccine (11% vs 3%; P = .043) and less frequently had health insurance (81% vs 98%; P < .001). Within the 50- to 64-year age group, having health insurance was significantly associated with vaccination status (Table 3
Participants were asked to rate their level of trust in the health information they received from various sources. Compared with patients aged 65 years and older, patients aged 50 to 64 years more frequently reported trusting "most or some" information from friends/family (71% vs 56%; P = .003) and from newspapers/magazines (72% vs 57%; P = .003). Within each age group, vaccinated and unvaccinated participants trusted health information from their personal physicians, television/radio, friends/family, government, local churches/religious leaders, and newspapers/magazines with relatively equal frequency. No differences in whether patients felt that they could freely ask their physicians questions were found; nearly all felt that they could do so (50 to 64 years: 97%; 65 years and older: 98%). Interventions. Overall, self-reported immunization rates did not change significantly between the 20002001 and the 20012002 influenza season (56% in 20002001 vs 57% in 20012002; P = .807). Although patients aged 50 to 64 years showed an increasing trend in immunization rates (40% in 20002001, 47% in 20012002; P = .08), patients aged 65 years and older did not (70% in 20002001, 66% in 20012002; P = .122). Rates did not differ over time by site (Health Center A: 58% in 20002001, 61% in 20012002; P = .473; Health Center B: 53% in 20002001, 52% in 20012002; P = .868). At Health Center A, for which we also had EMR data (reported in this section), selfreported vaccination rates did not change over time within age groups (50 to 64 years: 43% in 20002001, 50% in 20012002; P = .189; 65 years and older: 73% in 20002001, 71% in 20012002; P = .754). Furthermore, despite differences in intervention strategies, few differences arose across sites. Sixty-three percent of Health Center A patients reported receiving a recommendation to get an influenza vaccination, compared with 53% of Health Center B patients (P = .052). Not surprisingly, more patients at Health Center A, which mailed flu vaccine reminders, reported receiving a letter than at Health Center B, which did not send reminders (37% vs 13%; P < .001). Logistic regression analyses. Preliminary analyses for both age groups revealed that receipt of the influenza vaccine in the previous year (20002001 season) was strongly correlated with receipt of the influenza vaccine in the 20012002 season (50 to 64 years: r = 0.6; P < .001; 65 years and older: r = 0.7; P < .001). Therefore, we chose to exclude this variable in the logistic regression analyses. Furthermore, although we tested the interactions of site and individual predictors in each model, none was significant.
In logistic regression analyses specific to patients aged 50 to 64 years, variables positively associated with receiving the influenza vaccine in the 20012002 season included believing that persons who do not get the flu shot will probably get the flu and having had the flu shot recommended by someone. The belief that the flu shot causes a person to get the flu was negatively associated with vaccination status (Table 4
Number of Influenza Vaccine Doses Administered According to vaccination log data on all patients reported by sites, the number of influenza vaccinations administered at Health Center A increased 34%, from 797 doses in 20002001 to 1071 in 20012002. At Health Center B, the doses administered increased 114%, from 350 doses in 20002001 to 750 in 20012002.
Rates of Influenza Vaccination From EMRs
The purpose of this study was to develop and examine intervention strategies to increase influenza vaccination rates at inner-city health centers with racially mixed populations. At both sites, the number of doses administered increased. Although overall vaccination rates remained lower than national goals, racial disparities were eliminated through targeted interventions. We believe that individualization of interventions was important. Health centers have their own values and internal structures that serve unique communities. Consequently, staff were integral to the decisionmaking process for selecting intervention strategies. At Health Center A, the medical director noted, "We have consistently tried to create an environment where flu and other immunizations are valued as a very effective means of promoting health." Among a menu of proven options, Health Center A established a nursing policy whereby staff could check immunization status as part of obtaining vital signs and vaccinate by standing order. Checking immunization status could be performed verbally with the patient or through an automatic reminder in the patients EMR. At Health Center B, the medical director indicated that having staff focus on a problem in the context of applicable background information and appreciation for staffs contributions were key to success, because staff became engaged in solving a health issue facing their own community. Thus, the choice of interventions at each health center was based on that centers values and internal operating models, which, according to the analyses of barriers to prevention of Crabtree and others,79 are essential aspects of success.
Beliefs, Social Influence, and Trust In the 65-and-older age group, the belief that friends/family think that the subject should get vaccinated and visiting a physician more than twice a year were positively associated with vaccination. Age differences in the results were not unexpected, given the recent addition of 50- to 64-year-olds to national recommendations for annual influenza vaccination.26,27 Another explanation may be differences in insurance coverage, because Medicare covers influenza immunization. We found no difference in vaccination by insurance coverage for patients aged 65 years or older, but among patients aged 50 to 64 years, vaccinated patients were more likely than unvaccinated patients to report having insurance coverage. The few published studies that have explored the role of trust in participation in medical treatment and/or research have indicated that Black patients have far less trust than do White patients.2830 The lack of racial disparity in our data may be explained in part by the high level of trust in their personal physicians reported by the respondents and by the fact that most respondents reported learning about immunization from their physicians. The faith-based nature of these neighborhood health centers, which were established specifically to serve disadvantaged populations, may contribute to their patients trust in those who treat them.
Strengths and Limitations We observed a difference at Health Center A between vaccination rates reported by patients in the survey and recorded in the EMRs. Influenza vaccination is available at many community sites, and 24% of vaccinated patients at this site reported receiving the flu shot at a location other than their physicians office. Once this difference was taken into account, the rates nearly matched. The fact that only those with the financial resources to have a telephone were eligible for participation in the survey may have biased the data toward higher rates. On the other hand, EMRs include homeless persons, and 22% of the health centers patients are uninsured. Many such patients visit the clinic sporadically but would be included in the denominator. Also, the denominator could be affected by patients who entered or left the practice before the end of the season and by patients seen for consultations or in nursing home visits but whose immunization data would not be contained in the office records.
Conclusions
This project was funded by the Agency for Healthcare Research and Quality (grant P01 HS10864).
Human Participant Protection
Contributors R. K. Zimmerman was the project principal investigator and helped design interventions and analyses. M. P. Nowalk was the project manager and helped design interventions. M. Raymond was data manager for computer-assisted telephone interviewing (CATI) and immunization data and analyzed EMR immunization data. M. Tabbarah analyzed CATI data. D. G. Hall was head of interventions at Health Center A. J. T. Wahrenberger was head of interventions at Health Center B. S. A. Wilson was a co-investigator and helped design and implement interventions at Health Center B. E. M. Ricci was the overall grant principal investigator. Accepted for publication May 30, 2003.
1. National Center for Health Statistics. Early Release of Selected Estimates Based on Data From the First Quarter of 2002 NHIS. Available at: http://www.cdc.gov/nchs/about/major/nhis/released200209.htm. Accessed July 8, 2003. 2. National Center for Health Statistics. Percent of adults aged 18 years and over who received influenza vaccine during the past 12 months, by age group and quarter: United States, 19972002. Available at: http://www.cdc.gov/nchs/about/major/nhis/released200212/figures04_1-4_3.htm. Accessed July 8, 2003. 3. National Center for Health Statistics. Percent of adults aged 65 years and over who received influenza vaccine during the past 12 months, by race/ethnicity: United States, JanuaryJune 2002. Available at: http://www.cdc.gov/nchs/about/major/nhis/released200212/figures04_1-4_3.htm. Accessed July 8, 2003. 4. US Department of Health and Human Services. Healthy People 2010. Conference ed. Washington, DC: US Dept of Health and Human Services; 2000. 5. Gyorkos TW, Tannenbaum TN, Abrahamowicz M, et al. Evaluation of the effectiveness of immunization delivery methods. Can J Public Health. 1994;85(suppl):S14S30. 6. Briss PA, Rodewald LE, Hinman AR, et al. Reviews of evidence regarding interventions to improve vaccination coverage in children, adolescents, and adults. Am J Prev Med. 2000;18(1 suppl):97126.[Web of Science][Medline] 7. Miller WL, Crabtree BF, McDaniel R, Stange KC. Understanding change in primary care practice using complexity theory. J Fam Pract. 1998;46:369376.[Web of Science][Medline] 8. Stange KC, Zyzanski SJ, Jaen CR, et al. Illuminating the "black box." A description of 4454 patient visits to 138 family physicians. J Fam Pract. 1998;46:377389.[Web of Science][Medline] 9. Crabtree BF, Miller WL, Aita VA, Flocke SA, Stange KC. Primary care practice organization and preventive services delivery: a qualitative analysis. J Fam Pract. 1998;46:403409.[Web of Science][Medline] 10. Carney PA, Dietrich AJ, Keller A, Landgraf J, OConnor GT. Tools, teamwork, and tenacity: an office system for cancer prevention. J Fam Pract. 1992;35:388394.[Web of Science][Medline] 11. McIlvain HE, Crabtree BF, Gilbert C, Havranek R, Backer EL. Current trends in tobacco prevention and cessation in Nebraska physicians offices. J Fam Pract. 1997;44:193202.[Web of Science][Medline]
12. Greco PJ, Eisenberg JM. Changing physicians practices. N Engl J Med. 1993;329:12711273. 13. Zimmerman RK, Mieczkowski TA, Wilson SA. Immunization rates and beliefs among elderly patients of inner-city neighborhood health centers. Health Promot Pract. 2002;3:197206.[Abstract] 14. Zimmerman RK, Santibanez TA, Janosky JE, et al. What affects influenza vaccination rates among older patients? An analysis from inner-city, suburban, rural, and veterans affairs practices. Am J Med. 2003;114:3138.[Web of Science][Medline] 15. Zimmerman RK, Silverman M, Janosky JE, et al. A comprehensive investigation of barriers to adult immunization: a methods paper. J Fam Pract. 2001;50:703.[Medline] 16. Montano DE. Predicting and understanding influenza vaccination behavior. Alternatives to the health belief model. Med Care. 1986;24:438453.[Web of Science][Medline] 17. Davidson AR, Jaccard JJ, Triandis HC, Morales ML, Diaz-Guerrero R. Cross-cultural model testing: toward a solution of the etic-emic dilemma. Int J Psychol. 1976;11:113. 18. Valois P, Desharnais R, Godin G. A comparison of the Fishbein and Ajzen and the Triandis attitudinal models for the prediction of exercise intention and behavior. J Behav Med. 1988;11:459472.[Web of Science][Medline] 19. Landis D, Triandis HC, Adamopoulos J. Habit and behavioral intentions as predictors of social behavior. J Soc Psychol. 1978;106:227237.[Web of Science] 20. Centers for Disease Control and Prevention. Reasons reported by Medicare beneficiaries for not receiving influenza and pneumococcal vaccinationsUnited States, 1996. MMWR Morb Mortal Wkly Rep. 1999;48:886890.[Medline] 21. Pregliasco F, Sodano L, Mensi C, et al. Influenza vaccination among the elderly in Italy. Bull World Health Organ. 1999;77:127131.[Web of Science][Medline]
22. Dietz VJ, Baughman AL, Dini EF, Stevenson JM, Pierce BK, Hersey JC. Vaccination practices, policies, and management factors associated with high vaccination coverage levels in Georgia public clinics. Georgia Immunization Program Evaluation Team. Arch Pediatr Adolesc Med. 2000;154:184189. 23. Fiebach NH, Viscoli CM. Patient acceptance of influenza vaccination. Am J Med. 1991;91:393400.[Web of Science][Medline] 24. Gene J, Espinola A, Cabezas C, et al. Do knowledge and attitude about influenza and its immunization affect the likelihood of obtaining immunization? Fam Pract Res J. 1992;12:6173.[Medline] 25. Centers for Disease Control and Prevention. Adult immunization: knowledge, attitudes, and practicesDeKalb and Fulton Counties, Georgia, 1988. MMWR Morb Mortal Wkly Rep. 1988;37:657661.[Medline] 26. Zimmerman RK. Lowering the age for routine influenza vaccination to 50 years: AAFP leads the nation in influenza vaccine policy. American Academy of Family Physicians. Am Fam Physician. 1999;60:20612066.[Web of Science][Medline] 27. Centers for Disease Control and Prevention. Prevention and control of influenza: recommendations of the Advisory Committee on Immunization Practices (ACIP). MMWR Recomm Rep. 2000;49(RR-03):138.[Medline]
28. Corbie-Smith G, Thomas SB, St George DM. Distrust, race, and research. Arch Intern Med. 2002;162:24582463. 29. Gray BH, Osterweis M. Ethical issues in a social context. In: Aiken L, Mechanic D, eds. Applications of Social Sciences to Clinical Medicine and Health Policy. New Brunswick, NJ: Rutgers University Press; 1987:543564. 30. Mechanic D. The functions and limitations of trust in the provision of medical care. J Health Polit Policy Law. 1998;23:661686. This article has been cited by other articles:
eLetters:Read all eLetters
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||