© 2007 American Public Health Association DOI: 10.2105/AJPH.2007.114934
Salomeh Keyhani is with the Health Services Research and Development (HSR&D) Targeted Research Enhancement Program, James J. Peters Veterans Administration Medical Center, New York, NY, and the Department of Health Policy, Mount Sinai School of Medicine, New York, NY. Joseph S. Ross, Cornelia Dellenbaugh, Joan D. Penrod, and Albert L. Siu are with the HSR&D Targeted Research Enhancement Program, James J. Peters Veterans Administration Medical Center, New York, and the Department of Geriatrics and Adult Development, Mount Sinai School of Medicine, New York. Paul Hebert is with the Department of Health Policy, Mount Sinai School of Medicine, New York. Correspondence: Requests for reprints should be sent to Salomeh Keyhani, MD, MPH, Department of Health Policy, Mount Sinai School of Medicine, Box 1077, 1 Gustave L. Levy Pl, New York, NY 10029 (e-mail: salomeh.keyhani{at}mountsinai.org).
Objectives. We compared use of preventive care among veterans receiving care through the Veterans Health Administration (VHA), Medicare fee-for-service (FFS) plans, and Medicare health maintenance organizations (HMOs). Methods. Using both the Costs and Use, and Access to Care files of the Medicare Current Beneficiary Survey (2000–2003), we performed a cross-sectional analysis examining self-reported use of influenza vaccination, pneumococcal vaccination, serum cholesterol screening, and serum prostate-specific antigen measurement among male veterans 65 years or older. Veterans care was categorized as received through VHA, Medicare FFS, Medicare HMOs, VHA and Medicare FFS, or VHA and Medicare HMOs. Results. Veterans receiving care through VHA reported 10% greater use of influenza vaccination (P<.05), 14% greater use of pneumococcal vaccination (P<.01), a nonsignificant 6% greater use of serum cholesterol screening (P=.1), and 15% greater use of prostate cancer screening (P<.01) than did veterans receiving care through Medicare HMOs. Veterans receiving care through Medicare FFS reported less use of all 4 preventive measures (P<.01) than did veterans receiving care through Medicare HMOs. Conclusions. Receiving care through VHA was associated with greater use of preventive care.
The Veterans Health Administration (VHA) is the largest integrated public-sector health care system in the United States.1 Under a set of reforms in 1995 that emphasized increased use of information technology, performance measurement, and service integration, VHA has become a leader in delivering high-quality care to veterans.2–6 One comprehensive cross-sectional study of 596 VHA patients and 992 community patients (older than 35 years) between 1997 and 2000 found that veterans treated at VHA scored significantly higher for overall quality of care, chronic disease care, and preventive care.7 Previous research has also demonstrated that Medicare health maintenance organizations (HMOs) are superior to Medicare fee-for-service (FFS) plans in delivering preventive care to patients.8 Medicare HMOs can use health care management techniques such as performance measurement, data analysis, and care coordination to improve the efficiency and quality of care delivered to patients.9,10 There are few studies, however, that have compared Medicare HMOs and VHA.11,12 Only 1 study to date has compared the quality of care delivered by VHA to the care delivered by high-performing commercial managed-care programs.11 That study, which focused on diabetes, found that diabetes-related processes of care (e.g., eye examination and hemoglobin A1C measurement) and 2 intermediate outcomes (targets for hemoglobin A1C and low-density lipoprotein cholesterol) were more likely to be achieved for patients cared for in the VHA system than for patients cared for in commercial managed-care plans. In contrast to VHA, in which the strides in quality improvement have been relatively uniform across the 21 different Veterans Integrated Service Networks, there is large variation in the quality of care delivered by Medicare HMOs plans.13 This variation may be because of different organizational characteristics among plans. A plan can be structured as a staff-model organization, in which the plan owns the hospital and physicians are salaried, or as a loose financial arrangement between multiple providers in unrelated practice settings.10,13 Previous research has identified 4 factors in high-performing managed-care programs that lead to the delivery of high-quality care: (1) a strong working relationship with the plans physicians; (2) quality-focused leadership, culture, and values; (3) a high-quality physician practice base in the delivery system; and (4) an emphasis on the use of data and analysis in clinical improvement.10,14 VHA has all 4 of these characteristics. It has strong local practice leadership, with emphasis on performance measurement and quality improvement; strong relationships with academic medical centers, which creates a high-quality physician practice base; and an electronic health record that facilitates use of data for clinical improvement. VHA is in effect a large managed-care organization caring for over 5 million veterans across the country.1,15 Our primary objective was to use pooled data on veterans from the Medicare Current Beneficiary Survey (MCBS) to compare the preventive care delivered to veterans in VHA with care delivered to veterans by Medicare HMO and FFS plans. Many elderly veterans, however, are eligible to receive care from both Medicare and VHA and can also use both programs simultaneously (dual users). Therefore, we also compared the preventive care received by veterans through dual use of these sources with care received through Medicare HMO plans. We focused on measures of preventive care because these measures have an important role in reducing morbidity and mortality in the elderly.16–19
Study Design We conducted a cross-sectional analysis of pooled data from the 2000–2003 MCBS. Medicare beneficiaries were surveyed on their service in the armed forces, insurance coverage, and use of VHA as a source of care, which allowed comparisons of receipt of preventive care across different settings. The MCBS is conducted by the Center for Medicare and Medicaid Services. The data are collected for a nationally representative sample of aged, disabled, and institutionalized Medicare beneficiaries from 107 geographic sampling units. The MCBS uses a 4-year "rotating panel,"20 whereby each year one third of the sample is retired and a new group is added. For this analysis, we used data from both the 2000–2003 Cost and Use and Access to Care files. Both files track data on enrollment status, insurance, self-rated physical and mental health, and sociodemographic characteristics. The Cost and Use files also provide data on health care use and expenditures, and the Access to Care file provides additional data on access to care variables such as having a usual place of care.20
Sample
Outcome Variables
Independent Variables We computed an MCBS-adapted Charlson Comorbidity Index for each veteran on the basis of self-reported comorbidities.21,22 The Charlson Index contains 19 categories of comorbidity, which are primarily defined through diagnosis codes from the International Classification of Diseases, Ninth Revision (ICD-9).23 Each category had an associated weight, taken from the original Charlson report, which was based on the adjusted risk of 1-year mortality.22,24,25 The overall comorbidity score reflects the cumulative increased likelihood of 1-year mortality; the higher the score, the more severe the comorbidity. For each veteran, we also included information on access to care, such as whether he had a usual place to obtain care or had supplemental health insurance. The relationship between receiving age-appropriate preventive care and source of care may be related to limited contact with the health care system. We therefore also collected data on "total payments to all sources" as a measure of use from the Cost and Use files.
Statistical Analysis We repeated each analysis, including an MCBS-adapted Charlson Comorbidity Index, to determine whether the presence of comorbid conditions affected the results.21 Because the likelihood of receiving preventive care may be influenced by the frequency of contacts with the health care system, we performed a sensitivity analysis by including a measure of use (total payments to all sources) as an independent variable in the analysis. Individuals missing outcome data were excluded from the relevant adjusted analyses. Among eligible respondents, fewer than 0.6% were missing data for influenza vaccination, 0.3% for pneumococcal vaccination, 0.3% for cholesterol screening, and 5% for serum prostate-specific antigen testing. Individuals with missing sociodemographic data were also excluded from adjusted analyses (< 1% of respondents for each characteristic, except household size, which was missing for 3% of respondents, and usual place of care, which was missing for 8% of respondents). Given the large number of veterans who were missing data on usual place of care, we coded this variable as a categorical variable (1 = usual place of care, 2 = no usual place of care, and 3 = missing or refused to answer) to diminish loss of information from the analysis. Because we were analyzing nonrare events, odds ratios from adjusted analyses were converted to risk ratios for easier interpretation of results.26–29 All analyses took into account the complex survey design and weighted sampling probabilities of the data source and were performed with Stata version 9.0 (StataCorp LP, College Station, Tex). All statistical tests were 2-tailed.
Characteristics Related to Source of Care There were 5646 elderly veterans surveyed between 2000 and 2003, including 193 women, who were eliminated from the sample. The final sample included 5453 male veterans with self-reported data on flu and pneumonia vaccination, 5165 with data on serum prostate-specific antigen testing, and 4201 with data on cholesterol screening. We compared the sociodemographic characteristics, access to care, and health status of veterans who accessed care through 1 of 5 sources (Table 1
Use of Preventive Services Overall, use of preventive services across all 5 sources of care was high, ranging from 70% to 95% across all outcomes measured (Table 2
Relationship Between Source of Care and Use of Preventive Services Use of only VHA for care was associated with an increased use of preventive services (Table 3
Overall, dual users had a higher use of preventive measures than did veterans cared for through Medicare HMO plans. Veterans who received care through both VHA and Medicare FFS had a 7% to 10% higher use of all 4 preventive measures studied than did veterans cared for through Medicare HMO plans (P<.01); veterans who sought care through both VHA and Medicare HMO plans had 16% higher use of pneumococcal vaccination (P<.01) and a 19% higher use of prostate cancer screening (P<.01) than did users of Medicare HMO plans only, with no difference in receipt of influenza vaccination and cholesterol screening. Compared with care through Medicare HMO plans, care through Medicare FFS was associated with a 9% to 30% lower use of the 4 preventive measures examined (P<.001). The Hosmer–Lemeshow test gave no evidence of an improper functional form (P>.3 for each model).
Given the disagreement in the literature as to whether inclusion of comorbid conditions is appropriate in examining receipt of age-appropriate care, we also examined how inclusion of the Charlson Comorbidity Index affected the relationships examined (Table 4
We did not present models that included the variable "total annual payments from all sources," because of potential underreporting of payments by Medicare HMOs and VHA and the lack of uniformity in measuring and reporting costs between VHA and Medicare. However, inclusion of this variable in the models presented did not alter the magnitude or significance of the relationships observed (data not shown).
The transformation of VHA is widely attributed to a set of reforms that took place in the 1990s under the leadership of Kenneth Kizer.1,3,5 As part of these reforms, VHA instituted a comprehensive electronic medical record system that includes a reminder system with emphasis on preventive care (e.g., vaccination, screening), chronic care management (e.g., blood pressure, diabetes, and cholesterol control), and integration of care.1 We found that veterans receiving care through VHA (either alone or through dual use) reported significantly higher use of preventive care services than did veterans who received care through Medicare HMO plans. Managed-care plans differ widely in their organizational structure, and there is significant variation in the quality of care delivered by these plans.8,13,31 They can be little more than loose networks of physicians tied together through various financial arrangements; group-model HMOs, in which the plan contracts with a single large group of physicians on an exclusive basis and the physicians are paid through capitation; or full staff-model HMOs, in which physicians are salaried employees.31 In our study, we could not differentiate between the different types of managed-care organizations and may have combined HMOs that differ in culture, organization, and type of quality-care processes employed. Many HMOs are not staff-model organizations that have electronic health records and electronic reminder systems available to the same degree as VHA and therefore cannot as readily integrate and monitor care. Managed-care plans that primarily comprise a loose network of physicians may not have the same tools (e.g., accessibility of data for quality improvement, electronic reminder system) to improve quality of care that are available in staff- or group-model HMOs or VHA. There are many reasons that could explain why VHA is better at delivering preventive care than are Medicare HMO plans. VHA may be more attuned to the needs of veterans than other sources of care. In addition, the political oversight provided through Congress and the strong political constituency of veterans provide a strong incentive for VHA to improve the quality of care.1 Medicare HMOs also have an incentive to improve their publicly reported Healthcare Effectiveness Data and Information Set (HEDIS) measures but many also have to respond to the profit expectations of shareholders; these 2 incentives do not always converge. In addition, VHA is organized into 21 Veterans Integrated Service Networks, each responsible for health care planning and resource allocation in a particular geographic region.1 Veterans Integrated Service Networks are centered around the notion that health care delivery should be based on the specific population served. Because each network is composed of a number of hospitals and ambulatory-care facilities, resources are aligned around the population served, forcing the network to pool and coordinate its resources and services.32 The implementation of the electronic health record across all VHA medical centers and the planning for care through global budgets have led to a degree of integration of care that may not be possible in Medicare FFS or Medicare HMO plans.32 VHA is unique in the US health care system because it is both the payer and provider of care, which allows planning for the delivery of high-quality, cost-efficient care. Our findings also highlight the phenomenon of veterans dual use of Medicare and VHA services. Dual users had a higher mean Charlson Comorbidity Index, indicating that they were sicker than were VHA-only users. Dual users were also wealthier and more educated than were patients who sought care at VHA only. Veterans who received care through VHA and Medicare FFS had increased use of all 4 preventive care services, and among dual users of VHA and Medicare HMO plans, we found either increased use of preventive care services or no difference in receipt of preventive care. Previous work found that HMO-enrolled veterans access care through the VA.33 Further research is needed to determine whether dual use represents duplication of care or an attempt by veterans to use resources from both sources to complement diverse health care needs. Previous research comparing Medicare FFS with Medicare HMOs found that managed care was better at delivering preventive services, whereas traditional Medicare was better in other aspects of care related to access and satisfaction.8,34 Similarly, we found that Medicare HMO plans were better than Medicare FFS plans at delivering preventive care to veterans.
Limitations Furthermore, the fact that most patients who had no payments made from any source of care were enrolled in Medicare FFS may suggest that VHA and Medicare HMO plans are making a concerted effort to identify and provide patients with age-appropriate preventive care. Therefore, it may not be appropriate to include a measure of use in the analysis, because it would bias the results in favor of Medicare FFS. Also, we studied the use of prostate cancer screening despite the current debate about its clinical benefit. In 2002, the US Preventive Services Task Force determined that the evidence is insufficient to recommend for or against routine screening for prostate cancer.35 Even though the clinical utility of serum prostate-specific antigen testing is unclear, the pattern of this testing across different sources of care was similar to other preventive measures in our study.
Conclusions
This study was financially supported by the Department of Veterans Affairs Health Services Research and Development Service (grant IIR 003-226-2). Note. The Department of Veterans Affairs had no role in the design or conduct of the study; collection, management, analysis or interpretation of the data; or preparation, review, or approval of the article. The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs.
Human Participant Protection
Peer Reviewed
Contributors Accepted for publication June 22, 2007.
1. Oliver A. The Veterans Health Administration: an American success story? Milbank Q. 2007;85:5–35.[CrossRef][Web of Science][Medline] 2. Petersen LA, Normand SL, Daley J, McNeil BJ. Outcome of myocardial infarction in Veterans Health Administration patients as compared with Medicare patients. N Engl J Med. 2000;343(26):1934–1941. 3. Jha AK, Perlin JB, Kizer KW, Dudley RA. Effect of the transformation of the Veterans Affairs Health Care System on the quality of care. N Engl J Med. 2003; 348(22):2218–2227. 4. Jha AK, Perlin JB, Steinman MA, Peabody JW, Ayanian JZ. Quality of ambulatory care for women and men in the Veterans Affairs Health Care System. J Gen Intern Med. 2005;20(8):762–765.[CrossRef][Web of Science][Medline] 5. Perlin JB, Kolodner RM, Roswell RH. The Veterans Health Administration: quality, value, accountability, and information as transforming strategies for patient-centered care. Am J Manag Care. 2004;10(11 pt 2): 828–836.[Web of Science][Medline] 6. Piette JD. Satisfaction with care among patients with diabetes in two public health care systems. Med Care. 1999;37(6):538–546.[CrossRef][Web of Science][Medline] 7. Asch SM, McGlynn EA, Hogan MM, et al. Comparison of quality of care for patients in the Veterans Health Administration and patients in a national sample. Ann Intern Med. 2004;141(12):938–945. 8. Landon BE, Zaslavsky AM, Bernard SL, Cioffi MJ, Cleary PD. Comparison of performance of traditional Medicare vs Medicare managed care. JAMA. 2004; 291(14):1744–1752. 9. Foote SB, Halaas GW. Defining a future for fee-for-service Medicare. Health Aff (Millwood). 2006;25(3): 864–868. 10. Felt-Lisk S, Kleinman LC. Study of Effective Practices in Managed Care: Ten Case Studies. New York, NY: Common Wealth Fund; 2000. 11. Kerr EA, Gerzoff RB, Krein SL, et al. Diabetes care quality in the Veterans Affairs Health Care System and commercial managed care: the TRIAD study. Ann Intern Med. 2004;141(4):272–281. 12. Selim AJ, Kazis LE, Rogers W, et al. Risk-adjusted mortality as an indicator of outcomes: comparison of the Medicare Advantage Program with the Veterans Health Administration. Med Care. 2006;44(4): 359–365.[CrossRef][Web of Science][Medline] 13. Miller RH, Luft HS. Does managed care lead to better or worse quality of care? Health Aff (Millwood). 1997;16:7–25.[Abstract] 14. Gillies RR, Chenok KE, Shortell SM, Pawlson G, Wimbush JJ. The impact of health plan delivery system organization on clinical quality and patient satisfaction. Health Serv Res. 2006;41(4 pt 1):1181–1199.[Web of Science][Medline] 15. 2005 Survey of Veteran Enrollees Health and Reliance Upon VA. Available at: http://www1.va.gov/vhareorg/reports/SOE05ExcSum.pdf. Accessed May 1, 2007. 16. Ryan J, Zoellner Y, Gradl B, Palache B, Medema J. Establishing the health and economic impact of influenza vaccination within the European Union 25 countries. Vaccine. 2006;24(47–48):6812–6822.[CrossRef][Web of Science][Medline] 17. Spaude KA, Abrutyn E, Kirchner C, Kim A, Daley J, Fisman DN. Influenza vaccination and risk of mortality among adults hospitalized with community-acquired pneumonia. Arch Intern Med. 2007;167(1):53–59. 18. Parsons HK, Metcalf SC, Tomlin K, Read RC, Dockrell DH. Invasive pneumococcal disease and the potential for prevention by vaccination in the United Kingdom. J Infect. 2007;54(5):435–438.[CrossRef][Web of Science][Medline] 19. Fisman DN, Abrutyn E, Spaude KA, Kim A, Kirchner C, Daley J. Prior pneumococcal vaccination is associated with reduced death, complications, and length of stay among hospitalized adults with community-acquired pneumonia. Clin Infect Dis. 2006;42(8): 1093–1101.[CrossRef][Web of Science][Medline] 20. Balsa AI, Cao Z, McGuire TG. Does managed health care reduce health care disparities between minorities and whites? J Health Econ. 2007;26(1): 101–121.[CrossRef][Web of Science][Medline] 21. Chaudhry S, Jin L, Meltzer D. Use of a self-report-generated Charlson Comorbidity Index for predicting mortality. Med Care. 2005;43(6):607–615.[CrossRef][Web of Science][Medline] 22. Deyo RA, Cherkin DC, Ciol MA. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J Clin Epidemiol. 1992;45(6): 613–619.[CrossRef][Web of Science][Medline] 23. International Classification of Diseases, Ninth Revision. Geneva, Switzerland: World Health Organization; 1980. 24. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40:373–383.[CrossRef][Web of Science][Medline] 25. Charlson Index. Available at: http://www.umanitoba.ca/centres/mchp/concept/dict/comorb_compl/charlson_index.html. Accessed June 6, 2007. 26. Zhang J, Yu KF. Whats the relative risk? A method of correcting the odds ratio in cohort studies of common outcomes. JAMA. 1998;280(19):1690–1691. 27. Holcomb WL Jr, Chaiworapongsa T, Luke DA, Burgdorf KD. An odd measure of risk: use and misuse of the odds ratio. Obstet Gynecol. 2001;98(4): 685–688.[CrossRef][Web of Science][Medline] 28. McNutt LA, Wu C, Xue X, Hafner JP. Estimating the relative risk in cohort studies and clinical trials of common outcomes. Am J Epidemiol. 2003;157(10): 940–943. 29. Robbins AS, Chao SY, Fonseca VP. Whats the relative risk? A method to directly estimate risk ratios in cohort studies of common outcomes. Ann Epidemiol. 2002;12(7):452–454.[CrossRef][Web of Science][Medline] 30. AACE medical guidelines for clinical practice for the diagnosis and treatment of dyslipidemia and prevention of atherogenesis. Endocr Pract. 2000;6(2): 162–213.[Medline] 31. Safran DG, Rogers WH, Tarlov AR, et al. Organizational and financial characteristics of health plans: are they related to primary care performance? Arch Intern Med. 2000;160(1):69–76. 32. Institute of Medicine. Managed care systems and emerging infections: challenges and opportunities for strengthening surveillance, research, and prevention, workshop summary (2000). Available at: http://books.nap.edu/openbook.php?record_id=9760&page=83. Accessed June 11, 2007. 33. Shen Y, Hendricks A, Li D, Gardner J, Kazis L. VA–Medicare dual beneficiaries enrollment in Medicare HMOs: access to VA, availability of HMOs, and favorable selection. Med Care Res Rev. 2005;62(4): 479–495. 34. Landon BE, Zaslavsky AM, Bernard SL, Cioffi MJ, Cleary PD. Comparison of performance of traditional Medicare vs Medicare managed care. JAMA. 2004; 291(14):1744–1752. 35. US Preventive Services Task Force. Screening for prostate cancer. Available at: http://www.ahrq.gov/clinic/uspstf/uspsprca.htm. Accessed March 19, 2007. 36. Agha Z, Lofgren RP, VanRuiswyk JV, Layde PM. Are patients at Veterans Affairs medical centers sicker? A comparative analysis of health status and medical resource use. Arch Intern Med. 2000;160(21): 3252–3257. 37. Ayanian JZ, Weissman JS, Chasan-Taber S, Epstein AM. Quality of care by race and gender for congestive heart failure and pneumonia. Med Care. 1999;37(12): 1260–1269.[CrossRef][Web of Science][Medline] 38. Virnig BA, Lurie N, Huang Z, Musgrave D, McBean AM, Dowd B. Racial variation in quality of care among Medicare+Choice enrollees. Health Aff (Millwood). 2002;21:224–230. 39. Heisler M, Smith DM, Hayward RA, Krein SL, Kerr EA. Racial disparities in diabetes care processes, outcomes, and treatment intensity. Med Care. 2003; 41(11):1221–1232.[CrossRef][Web of Science][Medline] 40. Jiang HJ, Andrews R, Stryer D, Friedman B. Racial/ethnic disparities in potentially preventable readmissions: the case of diabetes. Am J Public Health. 2005;95(9):1561–1567. 41. Blanchard J, Lurie N. Preventive care in the United States: are blacks finally catching up? Ethn Dis. 2005;15(3):498–504.[Web of Science][Medline] 42. Trivedi AN, Zaslavsky AM, Schneider EC, Ayanian JZ. Trends in the quality of care and racial disparities in Medicare managed care. N Engl J Med. 2005;353(7): 692–700.
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||