© 2008 American Public Health Association DOI: 10.2105/AJPH.2007.119586
At the time of the study, Micaela H. Coady, Shannon Blaney, Danielle C. Ompad, Sarah Sisco, and David Vlahov were with the Center for Urban Epidemiological Studies at the New York Academy of Medicine, New York, NY. Sandro Galea is with the School of Public Health, University of Michigan, Ann Arbor. Correspondence: Requests for reprints should be sent to Sandro Galea, MD, DrPH, The University of Michigan, Department of Epidemiology, School of Public Health, 1214 S University, Room 243, Ann Arbor, MI 48104-2548 (e-mail: sgalea{at}umich.edu).
Objectives. We sought to determine whether the work of a community-based participatory research partnership increased interest in influenza vaccination among hard-to-reach individuals in urban settings. Methods. A partnership of researchers and community members carried out interventions for increasing acceptance of influenza vaccination in disadvantaged urban neighborhoods, focusing on hard-to-reach populations (e.g., substance abusers, immigrants, elderly, sex workers, and homeless persons) in East Harlem and the Bronx in New York City. Activities targeted the individual, community organization, and neighborhood levels and included dissemination of information, presentations at meetings, and provision of street-based and door-to-door vaccination during 2 influenza vaccine seasons. Participants were recruited via multiple modalities. Multivariable analyses were performed to compare interest in receiving vaccination pre- and postintervention. Results. There was increased interest in receiving the influenza vaccine postintervention (P<.01). Being a member of a hard-to-reach population (P=.03), having ever received an influenza vaccine (P<.01), and being in a priority group for vaccination (P<.01) were also associated with greater interest in receiving the vaccine. Conclusions. Targeting underserved neighborhoods through a multilevel community-based participatory research intervention significantly increased interest in influenza vaccination, particularly among hard-to-reach populations. Such interventions hold promise for increasing vaccination rates annually and in pandemic situations.
National guidelines recommend annual influenza vaccination for high-risk groups—specifically, persons 50 years and older and persons of any age with chronic medical conditions and their household contacts.1 Despite these guidelines and the patent benefits of influenza vaccination—including reductions in influenza-related morbidity and mortality, attendant health care costs, and productivity losses2—vaccination rates among adults in the United States remain lower than recommended levels, especially among elderly with high-risk conditions and racial/ ethnic minorities.1,3–5 Although data are sparse, influenza vaccination rates are particularly low among marginalized hard-to-reach urban populations such as substance abusers, undocumented immigrants, and homebound elderly.6 During the 2004–2005 influenza vaccine shortage, the vaccination rate was 21% among hard-to-reach populations in designated priority groups for vaccination, compared with estimates of 42% among designated priority groups in the general population during this same period.7 Members of these hard-to-reach groups are less likely to access routine health care or have a health care provider.8–10 Low vaccination rates combined with risk factors and barriers to accessing health care place hard-to-reach populations at particularly high risk for influenza and attendant morbidity. Additionally, the need for improvements in annual influenza coverage is coupled with recent concern for the potential of a human influenza pandemic.11,12 Unvaccinated persons within the larger population may propagate disease, particularly in the event of a pandemic.2,13 Consequently, public health officials face mounting pressure to vaccinate persons in all risk groups and to do so in a brief period of time.14–16 Members of disadvantaged, urban, multiethnic communities may face additional challenges during a pandemic, including increased vulnerability and transmissibility from overcrowded living conditions, reliance on mass transportation, and limited access to health care.17 Although there have been some previous efforts to vaccinate high-risk populations, few were community-based.18 Community-based programs that contributed to increased vaccination coverage have included vaccination at syringe exchange sites,19 an immunization "blitz" in a neighborhood with widespread injection drug use,20 interventions in religion-based neighborhood health centers, and public service announcements and mailings targeted to racial/ethnic minority Medicaid populations.21,22 Interventions in medical settings have included components such as standing orders,23,24 mailings,25–27 education,28–30 targeted advertising,31 and visiting nurse programs.32 Unfortunately, these efforts may have had little impact on hard-to-reach populations, because members of these groups are less likely to access routine health care. In December 2003, members of the Harlem Community and Academic Partnership,33 comprised of representatives from community and academic organizations committed to implementing interventions by using a community-based participatory research (CBPR) approach, formed an intervention working group to address challenges in vaccinating local hard-to-reach populations. Community-based participatory research is a collaborative process among researchers and community members that emphasizes building trust, equitable power sharing, capacity building, and long-term commitment from all involved in the research process.34–36 The intervention working group, which was comprised of members representing community residents, community-based organizations (CBOs), academic institutions, and the local health department, met regularly throughout the project to develop the research agenda and study design and to guide project implementation and evaluation. Guided by the Harlem Community and Academic Partnership principles of collaboration, the working group adopted a participatory approach to decisionmaking processes. A multilevel study design was chosen to address individual, social, and contextual factors related to access to, and acceptance of, the influenza vaccine among hard-to-reach populations.37,38 The working group developed methods to target intervention activities to 3 levels: neighborhood, CBO, and individual. The overall goal of the Project VIVA (Venue-Intensive Vaccines for Adults) intervention was to develop, implement, and assess a rapid-vaccination protocol for hard-to-reach populations that would increase interest in vaccination, provide free vaccination during 2 influenza seasons, and establish a model for the rapid vaccination of individuals that could be generalizable to other urban areas. We report the results of Project VIVA, including pre–post surveys in the 8 target areas within East Harlem and the Bronx, New York City, that evaluated whether interest in receiving influenza vaccination changed after intervention.
Study Population Intervention activities were conducted in 8 racially and ethnically diverse and economically disadvantaged locations in East Harlem and the Bronx. These 3 neighborhood areas in East Harlem and 5 in the Bronx were 6 to 8 blocks in size and were chosen through a participatory decisionmaking process with members of the intervention working group. The neighborhoods were also chosen on the basis of existing partnerships with CBOs in the area and because the neighborhoods included areas in which hard-to-reach populations were known to congregate.6,39 Although there is no uniform definition of hard-to-reach populations,40–43 populations of interest included substance abusers, possible undocumented immigrants, homeless persons, commercial sex workers, and persons 65 years or older, including the homebound elderly.
Study Design The flu vaccine shortage of 2004–2005 caused a delay in project activities, postponing the pilot vaccination phase until more vaccine was procured. From October to December 2004 (phase 2), outreach workers surveyed community members to assess awareness of the shortage and access to the vaccine.7 Beginning in January 2005, phases 3 and 4 were implemented with a crossover design: 4 neighborhoods chosen at random received the pilot vaccination intervention to assess acceptance of vaccination (January–March 2005), whereas the remaining 4 neighborhoods received the rapid vaccination intervention later that year (September–October 2005). The rapid vaccination effort was used to develop a protocol for vaccinating hard-to-reach populations in the event of an influenza pandemic or other emergency situation.44 During phase 3, a team of 4 outreach workers and 1 clinician offered vaccination door-to-door in apartment buildings over 8 weeks. Phase 4 was designed to scale up, by aiming to vaccinate 1500 individuals in the remaining 4 neighborhood areas simultaneously during 10 working days.44 Following 6 weeks of outreach efforts, 4 teams of 2 nurses and 4 outreach workers offered vaccination door-to-door, at street-based venues, and at CBOs. Phase 5 focused on generalization and dissemination of the most promising elements of the intervention. We developed a project Web site (http://www.projectviva.org) and sponsored an experts meeting to generate strategies to improve immunization rates among hard-to-reach populations.45 Project staff also presented findings at community meetings, CBOs, and scientific conferences.
Data Collection Participants were eligible to receive the vaccine following survey administration if they provided written informed consent, reported no previous adverse reactions to a vaccine, reported no allergy to eggs, had not been previously diagnosed with Guillain-Barré syndrome, were older than 19 years, had not already received the vaccine for that flu vaccine season, and were not pregnant. Participants 19 years and older were eligible for vaccination because state reporting requirements mandated that younger persons report vaccinations, rendering the process confidential but not anonymous. Additionally, although pregnancy is not a contraindication for influenza vaccination, working group members decided that vaccination of pregnant women would not be well received in our target communities.
Intervention Activities At the neighborhood level, outreach workers distributed project informational flyers, a comic strip outlining common vaccination myths, and locations of free vaccine clinics to community residents via door-to-door and street-based venues. Materials were disseminated over the course of the project to raise awareness and visibility and to increase interest in vaccination. A project phone number was included on all materials and calls were answered during business hours. At the community organization level, staff members presented information about the project at local community board meetings and CBOs. Presentations informed community members about future activities and gathered feedback on project methods and results. At the individual level, nurses and physicians provided vaccination to eligible participants during the vaccination phases (phases 3 and 4).
Data Analysis Three multivariate logistic regression models were developed to assess possible correlates of interest in receiving influenza vaccination. Groups modeled included the preintervention sample (phases 1–2), the postintervention sample (phases 3–4), and the combined pre- and postintervention samples (phases 1–4). Additionally, interest in vaccination was also modeled by neighborhood and hard-to-reach population groups. In the preintervention period, outreach efforts raised awareness and increased visibility of the vaccination effort. The postintervention period, in addition to the pilot and rapid vaccination efforts, also included a significant outreach component. Generalized estimating equations were used to account for intraneighborhood correlations. From the final models, odds ratios (ORs) and corresponding 95% confidence intervals (CIs) and P values were derived. All analyses were performed with SAS software, version 8 (SAS Institute Inc, Cary, North Carolina).
Among 6826 participants surveyed from February to October 2005 (n = 3744 preintervention and n = 3082 postintervention) the mean age was 41 years, 60% were women, 72% were Hispanic, and 68% reported an annual income of $9600 or less. Interest in vaccination significantly increased following intervention (80% preintervention to 94% postintervention; P< .01). Overall, 37% of participants were members of 1 or more hard-to-reach populations, including substance users (18%), sex workers (2%), persons 65 years or older (7%), undocumented immigrants (16%), and homeless persons (6%). Demographic characteristics differed by study phase. Participants surveyed before the intervention were more likely to be younger, female, and Black, whereas participants surveyed after the intervention were more likely to be Hispanic (all P<.01). Participants were more likely to be sampled door-to-door if they were older, Hispanic/ Latino, and a member of a hard-to-reach population, and more likely to be sampled from street-based settings if they were women (all P<.01). The number of missing values ranged from 24 to 282 (<1%–4%) for all variables.
Intervention Activities
Phases 1 and 2 Results of bivariable and multivariable correlates of interest in vaccination among the 3744 study participants sampled in East Harlem and the Bronx during the preintervention period are presented in Table 2
During phase two, 272 participants were surveyed to assess attitudes and other barriers to vaccination in the target areas during the 2004–2005 influenza vaccine shortage. The findings, described in a previous report, indicated that vaccination rates were substantially lower than the national estimates.7 However, a higher proportion of those who received vaccination were members of a priority group for vaccine. There was widespread awareness of the shortage (90%), and most attributed it to vaccine production problems.7 Finally, many of those surveyed said they would be more likely to seek vaccination in current and subsequent influenza seasons because of the shortage.
Phases 3 and 4
Table 2
Bivariable and multivariable correlates of interest in receiving the influenza vaccine among the 6826 participants sampled during the pre- and postintervention periods are shown in Table 3
Interest in vaccination among participants sampled in the pre- and postintervention periods was also modeled by neighborhood area and hard-to-reach population. Interest in vaccination increased following intervention in 2 areas in East Harlem and 2 in the Bronx (P< .01 for all). Hard-to-reach populations were more likely to be interested in receiving the vaccine in 2 of the Bronx areas (P= .04 and P< .01, respectively), and ever having received a flu vaccination was significantly associated with interest in vaccination in all but 1 of the neighborhoods (P< .01 for all). Participants medically indicated for vaccination were more likely to be interested in vaccination in 1 area (P= .03). Among hard-to-reach populations, undocumented immigrants, sex workers, and substance users were significantly more likely to be interested in vaccination postintervention (P< .01 for all). Prior vaccination was significantly associated with an increased interest in receiving vaccination among participants 65 years and older, homeless persons, and substance abusers (P< .01 for all).
Following Project VIVA—a multilevel community-based intervention aimed at increasing interest in vaccination among hard-to-reach populations through outreach efforts and vaccine distribution—persons living in intervention neighborhoods were more interested in receiving influenza vaccine compared with before the intervention. Specifically, members of hard-to-reach populations, persons reporting any prior influenza vaccine, and persons medically indicated for vaccination were significantly more likely to be interested in receiving the vaccine. The CBPR approach has been shown to be an effective means to address components of health promotion in population-level intervention studies.46 The CBPR methods used here, including the intervention working group–led intervention planning and implementation, helped ensure incorporation of community priorities, and contributed to our ability to overcome issues of distrust and to gain access to members of hard-to-reach populations to deliver immunization. Specific factors related to using a CBPR approach to research, including outreach activities, and the selection of staff with personal knowledge of project neighborhoods, ultimately contributed to the success of the intervention.44 These factors allowed us to gain access to populations unlikely to report to a private or government-sponsored health clinic to receive immunization. Without the expertise and guidance of the intervention working group it is unlikely that we would have seen the high rates of interest in vaccination among study participants. Our findings demonstrate the feasibility of offering vaccination to members of hard-to-reach populations in nontraditional urban settings through the use of a CBPR framework.
Vaccination of Hard-to-Reach Populations During the door-to-door vaccine distribution, less than half of those who opened their door were subsequently vaccinated. However, on the street, only those interested in receiving vaccine were surveyed when approached by project staff. Although different population groups were reached via door-to-door sampling compared with street-based sampling, prioritizing street-based vaccination may maximize the number of vaccines distributed, especially in an era of vaccine shortages or when project resources are limited. We found that those who had been vaccinated in the past were more likely to be interested in receiving vaccine. This finding is consistent with other studies47–49 and highlights the importance of promoting access to primary health care and routine vaccination. Other studies have also found that increased access to and use of health care was correlated with higher rates of vaccination.50 Partnering with CBOs to deliver health care services may hold promise for vaccinating persons without a regular health care provider or persons unlikely to report to a government-sponsored health clinic. The finding that members of high-risk groups medically indicated for vaccination were more likely to be interested in receiving vaccination is consistent with national estimates of influenza vaccination coverage levels indicating that 26% of persons aged 18 to 49 years with high-risk conditions were vaccinated, compared with 17% of persons without high-risk conditions.1 Our outreach efforts, including the dissemination of national vaccine guidelines, may have contributed to the higher rates of interest in receiving vaccination among persons in priority groups. In pandemic situations, gaining access to hard-to-reach populations for immunization could be particularly challenging.44 Unvaccinated populations may serve as undetected reservoirs of infection and key bridge populations, thereby limiting the effectiveness of populationwide vaccination efforts. The planning process for an influenza pandemic should include the extension of immunization strategies beyond traditional providers to involve immunization in nontraditional settings, including CBOs.45
Limitations
Conclusions
This work was supported by the National Institute on Drug Abuse (grant DA017004) and the Merck Foundation. This study was developed and conducted by members of the Harlem Community and Academic Partnership and the Center for Urban Epidemiological Studies. In addition to the studys authors, the Project VIVA Intervention Working Group members were Ann Boyer (Mt Sinai Medical Center, Womens Information Network, and Birdsong); Robert Brackbill (NY City Department of Health and Mental Hygiene); Brian Brown (Harm Reduction Educators); Jose Caraballo (Palladia Inc); Katherine Glidden (Center for Urban Epidemiological Studies); Karyn London (Mt Sinai Medical Center); Gail Love (Womens Information Network); Pat Monahan (East Harlem Community Health Committee Inc and Little Sisters of the Assumption Family Health Services); Erica Phillips (Weill Cornell Medical College, New York Presbyterian Hospital); Sharon Stancliff (Harm Reduction Coalition); and Linda Weiss (Office of Special Populations at the New York Academy of Medicine).
Human Participant Protection
Peer Reviewed
Contributors Accepted for publication October 10, 2007.
1. Smith NM, Bresee JS, Shay DK, Uyeki TM, Cox NJ, Strikas RA. Prevention and Control of Influenza: recommendations of the Advisory Committee on Immunization Practices (ACIP). MMWR Recomm Rep. 2006; 55(RR-10):1–42.[Medline] 2. Nichol KL, Treanor JJ. Vaccines for seasonal and pandemic influenza. J Infect Dis. 2006;194(suppl 2): S111–S118.[CrossRef][Web of Science][Medline] 3. Centers for Disease Control and Prevention. Racial/ ethnic disparities in influenza and pneumococcal vaccination levels among persons aged > or = 65 years—United States, 1989–2001. MMWR Morb Mortal Wkly Rep. 2003;52:958–962.[Medline] 4. Egede LE, Zheng D. Racial/ethnic differences in influenza vaccination coverage in high-risk adults. Am J Public Health. 2003;93:2074–2078. 5. Singleton JA, Santibanez TA, Wortley PM. Influenza and pneumococcal vaccination of adults aged > or = 65: racial/ethnic differences. Am J Prev Med. 2005;29:412–420.[CrossRef][Web of Science][Medline] 6. Bryant WK, Ompad DC, Sisco S, et al. Determinants of influenza vaccination in hard-to-reach urban populations. Prev Med. 2006;43:60–70.[CrossRef][Web of Science][Medline] 7. Ompad DC, Galea S, Blaney S, et al. Access to influenza vaccine in East Harlem and the Bronx during a national vaccine shortage. J Community Health. 2007; 32:195–202.[CrossRef][Web of Science][Medline] 8. Wright NM, Tompkins CN. How can health services effectively meet the health needs of homeless people? Br J Gen Pract. 2006;56:286–293.[Web of Science][Medline] 9. McBride DC, Drumm RD, Terry-McElrath Y, Chitwood DD. Back to basics: the role of health insurance in getting a physical exam. Soc Work Health Care. 2005;42:93–106.[CrossRef][Medline] 10. Marshall KJ, Urrutia-Rojas X, Mas FS, Coggin C. Health status and access to health care of documented and undocumented immigrant Latino women. Health Care Women Int. 2005;26:916–936.[CrossRef][Medline] 11. Cinti S. Pandemic influenza: are we ready? Disaster Manag Response. 2005;3:61–67.[CrossRef][Medline] 12. Fauci AS. Pandemic influenza threat and preparedness. Emerg Infect Dis. 2006;12:73–77.[Web of Science][Medline] 13. Mills CE, Robins JM, Lipsitch M. Transmissibility of 1918 pandemic influenza. Nature. 2004;432:904–906.[CrossRef][Medline] 14. Gust ID, Hampson AW, Lavanchy D. Planning for the next pandemic of influenza. Rev Med Virol. 2001; 11:59–70.[CrossRef][Web of Science][Medline] 15. Hadler JL. Public health strategies for distribution of influenza vaccine during an influenza pandemic. Yale J Biol Med. 2005;78:277–286.[Medline] 16. Schwartz B, Wortley P. Mass vaccination for annual and pandemic influenza. Curr Top Microbiol Immunol. 2006;304:131–152.[Web of Science][Medline] 17. Weisfuse IB, Berg D, Gasner R, Layton M, Misener M, Zucker JR. Pandemic influenza planning in New York City. J Urban Health. 2006;83:351–354.[CrossRef][Web of Science][Medline] 18. Ompad DC, Galea S, Vlahov D. Distribution of influenza vaccine to high-risk groups. Epidemiol Rev. 2006;28:54–70. 19. Stancliff S, Salomon N, Perlman DC, Russell PC. Provision of influenza and pneumococcal vaccines to injection drug users at a syringe exchange. J Subst Abuse Treat. 2000;18:263–265.[CrossRef][Web of Science][Medline] 20. Weatherill SA, Buxton JA, Daly PC. Immunization programs in non-traditional settings. Can J Public Health. 2004;95:133–137.[Web of Science][Medline] 21. Zimmerman RK, Nowalk MP, Raymund M, et al. Tailored interventions to increase influenza vaccination in neighborhood health centers serving the disadvantaged. Am J Public Health. 2003;93:1699–1705. 22. Barker WH, Bennett NM, LaForce FM, Waltz EC, Weiner LB. "McFlu." The Monroe County, New York, Medicare vaccine demonstration. Am J Prev Med. 1999; 16(suppl 3):118–127.[CrossRef][Web of Science][Medline] 23. Nichol KL. Ten-year durability and success of an organized program to increase influenza and pneumococcal vaccination rates among high-risk adults. Am J Med. 1998;105:385–392.[CrossRef][Web of Science][Medline] 24. Dexter PR, Perkins S, Overhage JM, Maharry K, Kohler RB, McDonald CJ. A computerized reminder system to increase the use of preventive care for hospitalized patients. N Engl J Med. 2001;345:965–970. 25. Nichol KL, Korn JE, Margolis KL, Poland GA, Petzel RA, Lofgren RP. Achieving the national health objective for influenza immunization: success of an institution-wide vaccination program. Am J Med. 1990; 89:156–160.[CrossRef][Web of Science][Medline] 26. Spaulding SA, Kugler JP. Influenza immunization: the impact of notifying patients of high-risk status. J Fam Pract. 1991;33:495–498.[Web of Science][Medline] 27. Ahmed F, Friedman C, Franks A, et al. Effect of the frequency of delivery of reminders and an influenza tool kit on increasing influenza vaccination rates among adults with high-risk conditions. Am J Manag Care. 2004;10:698–702.[Web of Science][Medline] 28. Knoell KR, Leeds AL. Influenza vaccination program for elderly outpatients. Am J Hosp Pharm. 1991; 48:256–259.[Abstract] 29. Herman CJ, Speroff T, Cebul RD. Improving compliance with immunization in the older adult: results of a randomized cohort study. J Am Geriatr Soc. 1994;42:1154–1159.[Web of Science][Medline] 30. Humair JP, Buchs CR, Stalder H. Promoting influenza vaccination of elderly patients in primary care. Fam Pract. 2002;19:383–389. 31. Ohmit SE, Furumoto-Dawson A, Monto AS, Fasano N. Influenza vaccine use among an elderly population in a community intervention. Am J Prev Med. 1995;11:271–276.[Web of Science][Medline] 32. Dalby DM, Sellors JW, Fraser FD, Fraser C, van Ineveld C, Howard M. Effect of preventive home visits by a nurse on the outcomes of frail elderly people in the community: a randomized controlled trial. CMAJ. 2000;162:497–500. 33. Galea S, Factor SH, Bonner S, et al. Collaboration among community members, local health service providers, and researchers in an urban research center in Harlem, New York. Public Health Rep. 2001;116:530–539.[Web of Science][Medline] 34. Israel BA, Schulz AJ, Parker EA, Becker AB; Community-Campus Partnerships for Health. Community-based participatory research: policy recommendations for promoting a partnership approach in health research. Educ Health (Abingdon). 2001;14:182–197.[CrossRef][Medline] 35. Israel BA, Parker EA, Rowe Z, et al. Community-based participatory research: lessons learned from the Centers for Childrens Environmental Health and Disease Prevention Research. Environ Health Perspect. 2005;113:1463–1471.[Web of Science][Medline] 36. Leung MW, Yen IH, Minkler M. Community based participatory research: a promising approach for increasing epidemiologys relevance in the 21st century. Int J Epidemiol. 2004;33:499–506. 37. Metzler MM, Higgins DL, Beeker CG, et al. Addressing urban health in Detroit, New York City, and Seattle through community-based participatory research partnerships. Am J Public Health. 2003;93:803–811. 38. Israel BA, Krieger J, Vlahov D, et al. Challenges and facilitating factors in sustaining community-based participatory research partnerships: lessons learned from the Detroit, New York City and Seattle Urban Research Centers. J Urban Health. 2006;83:1022–1040.[CrossRef][Web of Science][Medline] 39. Caesar EP, Coady MH, Galea S, et al. Predictors of influenza vaccination in an urban community during a national shortage. J Health Care Poor Underserved. 2008;19:611–624.[CrossRef][Web of Science][Medline] 40. Martsolf DS, Courey TJ, Chapman TR, Draucker CB, Mims BL. Adaptive sampling: recruiting a diverse community sample of survivors of sexual violence. J Community Health Nurs. 2006;23:169–182.[CrossRef][Web of Science][Medline] 41. Deren S, Shedlin M, Decena CU, Mino M. Research challenges to the study of HIV/AIDS among migrant and immigrant Hispanic populations in the United States. J Urban Health. 2005;82(2 suppl 3): iii13–iii25.[Web of Science][Medline] 42. Magnani R, Sabin K, Saidel T, Heckathorn D. Review of sampling hard-to-reach and hidden populations for HIV surveillance. AIDS. 2005;19(suppl 2): S67–S72. 43. Benoit C, Jansson M, Millar A, Phillips R. Community-academic research on hard-to-reach populations: benefits and challenges. Qual Health Res. 2005;15:263–282. 44. Coady MH, Weiss L, Galea S, Ompad DC, Glidden K, Vlahov D. Rapid vaccine distribution in nontraditional settings: lessons learned from project VIVA. J Community Health Nurs. 2007;24:79–85.[Web of Science][Medline] 45. Vlahov D, Coady MH, Ompad DC, Galea S. Strategies for improving influenza immunization rates among hard-to-reach populations. J Urban Health. 2007;84:615–631.[CrossRef][Web of Science][Medline] 46. Israel BA, Schulz AJ, Parker EA, Becker AB. Review of community-based research: assessing partnership approaches to improve public health. Annu Rev Public Health. 1998;19:173–202.[CrossRef][Web of Science][Medline] 47. Nichol KL, Lofgren RP, Gapinski J. Influenza vaccination. Knowledge, attitudes, and behavior among high-risk outpatients. Arch Intern Med. 1992;152:106–110. 48. Brewer NT, Hallman WK. Subjective and objective risk as predictors of influenza vaccination during the vaccine shortage of 2004–2005. Clin Infect Dis. 2006;43:1379–1386.[CrossRef][Web of Science][Medline] 49. Telford R, Rogers A. What influences elderly peoples decisions about whether to accept the influenza vaccination? A qualitative study. Health Educ Res. 2003;18:743–753. 50. Nowalk MP, Zimmerman RK, Tabbarah M, Raymund M, Jewell IK. Determinants of adult vaccination at inner-city health centers: a descriptive study. BMC Fam Pract. 2006;7:2.[CrossRef][Medline] This article has been cited by other articles:
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||