© 2004 American Public Health Association
Charles D. Phillips and Catherine Hawes are with the School of Rural Public Health, Health Science Center, Texas A&M University, Bryan. Michael Sherman is with the Department of Statistics, Texas A&M University, College Station. Scott Holan is with the Department of Statistics, University of MissouriColumbia. Malgorzata Leyk Williams is with the Department of Statistics, Texas A&M University. Correspondence: Requests for reprints should be sent to Charles D. Phillips, PhD, MPH, School of Rural Public Health, 3000 Briarcrest Drive, Suite 310, Bryan, TX 77802 (e-mail: phillipscd@srph.tamushsc.edu).
Objectives. We examined differences in quality of care among nursing homes in locales of varying degrees of rurality. Methods. We classified locales into 4 classes according to rurality. We analyzed a 10% sample of nursing home admissions in the United States in 2000 (n=198613) to estimate survival models for 9 quality indicators. Results. For postacute admissions, we observed significant differences in rates of decline for residents in facilities in large towns compared with urban areas, but differences in quality were both negative and positive. Among admissions for long-term or chronic care, rates of decline in 2 of 9 quality areas were lower for residents in isolated areas. Conclusions. We observed significant differences in a number of quality indicators among different classes of nursing home locations, but differences varied dramatically according to type of admission. These differences did not exhibit the monotonicity that we would have expected had they derived solely from rurality. Also, quality indicators exhibited more similarities than differences across the 4 classes of locales. The results underscore the importance, in some instances, of emphasizing the effects of specific settings rather than some continuum of rurality and of moving beyond the assumption that nursing home residents constitute a homogeneous population.
The demographic shift in the United States to a significantly older population has been well-documented. Estimates are that 1 in 5 persons in the country will be aged 65 years or older by 2030.1 However, for the planning of service delivery systems and planning for change in these delivery systems, it is also critical to understand the geographic distribution of the elderly. Rurality is a significant factor in gauging the proportion of a locales population that is elderly and likely to need long-term care services. In urban areas in 2000, only 5.6% of the population were aged 75 years or older, whereas in isolated rural areas the percentage was roughly one third higher (7.4%). In nonurban areas, this aging population has resulted in relatively higher rates of nursing home use, with over 560000 nursing home residents receiving care in nursing homes operating outside metropolitan areas.2 Researchers interested in nursing homes in rural areas have focused largely on an array of topics emphasizing access and utilization rather than quality of care. They have shown interest in the "premature" use of nursing homes in rural areas,3 the characteristics of admissions to urban and rural nursing homes,4,5 and differences in other aspects of nursing home and long-term care use.610 Much less attention has been given to questions of quality differences in homes in locales differing in rurality.11 Only recently has research on quality of care in rural nursing homes begun to appear. Recent literature now contains comparisons of feeding tube use in urban and rural homes in 1 state,12 data on multiple hospitalizations from 6 states,13 and a more general analysis of quality indicators in a single state.14 The research presented in this article attempts to move beyond previous research on quality of care in rural nursing homes through (1) use of an admission cohort to alleviate problems in risk-adjustment; (2) use of a measure of rurality that includes commuting patterns as well as population; (3) the merging of individual and home characteristics; and (4) use of a nationally representative sample of individuals admitted to certified nursing homes. These differences allow the research team to make, for the first time, statements about quality differences in urban and rural nursing homes that are generalizable to the nation as a whole.
Database The data used in this research came from the national archive of Minimum Data Set (MDS) assessments maintained by the Centers for Medicare and Medicaid Services (CMS). The MDS is a multidimensional assessment instrument used to assess all residents in Medicare- or Medicaid-certified nursing homes. Residents are assessed fully at admission and then annually. Quarterly assessments are performed with a subset of MDS items. The MDS has demonstrated reliability and validity when used in studies based on data collected in research studies and in studies based on archival data.1518 We analyzed a 10% sample of all nursing home admissions during calendar year 2000. Ten percent of the records from each home in the database were randomly selected, and assessments for each resident were identified for the 12 months following admission. All assessments for each individual were merged to create a longitudinal, resident-level file. Information on the nursing homes themselves was obtained from CMSs Online Survey and Certification Automated Reporting System for calendar year 2000 and merged with resident records. This process resulted in a sample of 198 613 nonduplicated nursing home residents admitted to 1 of 17 107 nursing homes during calendar year 2000. An admission cohort was used because it does not present the same problems with risk adjustment that arise when using data from a sample of current nursing home residents. In analyses of outcomes in acute care settings, the risk-adjustment process focuses on patient status at admission.19 In analyses of nursing home quality of care, admission data are often ignored, and data on current residents are the basis for quality indicators and risk-adjustment models.20 Unfortunately, appropriate risk adjustment in long-term care is difficult when using data on current residents. For example, when looking at the development of pressure ulcers, researchers often adjust for the fact that a resident is confined to a bed. Those residents who are confined to bed are at greater risk of developing a pressure ulcer. However, the resident may be confined because of a homes earlier failure to provide care necessary for the resident to maintain mobility. As this example illustrates, differentiating between those factors on which a home can have an effect and those on which it can have no effect is difficult when data from current residents are used. These problems are largely alleviated when data from an admission cohort are used. A residents health and financial status at admission are not the responsibility of the home to which the resident is admitted. However, changes in health status that occur in the nursing home after admission can be considered the results of 3 factors: residents status at admission, provider behavior, and random factors. Controlling for resident status at admission in a multivariate model then leaves changes in status as the result of provider behavior (quality of care) and status changes attributable to random factors that should be evenly distributed across the population.
Defining the Time to Decline
Defining the Variables The independent variable of primary interest was the homes location class. Locations were classified using the ruralurban commuting area codes.25 These codes combine the population of a zip code with the commuting patterns for the population in that zip code. Locations were classified into 4 categories, each representing (respectively) greater levels of rurality: urban (i.e., a city with a population > 50 000 and its commuting area), large town (i.e., a city with a population of 10 00049 999 and its commuting area), small town (i.e., a city with a population of 25009999 and its commuting area), and isolated areas (i.e., remaining areas). Although most of the independent variables were baseline measures of the dependent variables, other variables were used only as covariates. These variables included the following: the major payer for a residents admission, the occupancy rate for the home, the homes ownership arrangement (i.e., for-profit, not-for-profit, government), the percentage of a homes residents whose stay was paid for by Medicare, nurse staffing per resident per day, and resident acuity (i.e., case mix) in the home. Home case mix was measured using the average Resource Utilization Groups III nursing case-mix index for all nursing home residents.26 The staffing variable was the sum of registered nurse, vocational nurse, and nurse aide hours per resident per day in each home at the time of its certification and licen-sure survey. This variable was classified into 7 categories. Age and gender were included in the models as ordinal and dichotomous indicators, respectively. The final covariate was the 6-level Minimum Data SetChanges in Health, End-Stage Disease and Symptoms and Signs (MDSCHESS) scale, which measures clinical instability and is used to predict mortality and other adverse outcomes.27 Each increasing increment represented greater frailty and likelihood of death.
Analysis Strategy
Specifically, Table 3
The results of survival analyses for the quality indicators appear in Table 4
To focus on the dependent variable of primary interest and to reduce the volume of information presented, Table 4
Table 1
Table 2
Table 3
As interesting as the bivariate results may be, the results of the multivariate models in Table 4 The pattern of results for the chronic or long-term care admissions is at odds with that observed in the postacute population. The greatest differences in the rates of decline appeared between residents in urban homes and residents in homes operating in isolated locales. In 2 of the 3 significant differences for this group, one sees results implying that residents in isolated areas received better quality of care. The only result implying poorer quality of care in isolated areas was mood. For those in homes in or near small towns, differences indicate this population had higher rates of discharge to the hospital and lower rates of decline in cognition relative to residents in urban homes.
The results shown in Table 4 Unfortunately, what remains puzzling is the cause of these differences. No coherent, falsifiable theory provides insight into these differences. However, reasonable conjectures are possible. In terms of postacute care, urban homes have almost always maintained a steady stream of long-term care admissions and a relatively high proportion of postacute admissions. However, in recent years, many nursing homes have moved more heavily into postacute care for the purposes of increased reimbursement, whereas homes located in isolated areas or small towns, understanding clearly the limitations of their location classes, may have made no such moves and maintained their earlier admission strategies. The same may not be true of homes in larger towns. If so, these homes may have moved into the world of postacute care but only partially mastered that care. Thus, one sees variations in care outcomes for postacute admissions in those homes. The results for residents admitted for chronic or long-term care are comprehensible from a different perspective. Chronic care has always been the mainstay of nursing homes operating in isolated areas, and it may be that nursing home care in isolated areas is nested within a wealth of other social networks in ways not seen, or even possible, in other locales. Such networks should, even in the face of lower staffing levels, generate more care that is resident-centered than one finds in the more anomic world of nursing home care outside these areas. Thus, one sees arguably better outcomes of care for residents in homes located in isolated areas. Although our article has emphasized observed differences, it is also appropriate to note that, in the most general sense, these results indicate that care differed across locales only on selected measures. For acute care, there were 7 statistically significant differences and 20 other comparisons that showed no significant difference. In chronic care, 6 significant differences were observed, whereas 21 comparisons indicated no significant differences. Although the observed differences are obviously important, it is also important to remember that nursing home care across these settings displayed more similarities than differences. Whatever the final determination of our conjectures and conclusions may be in the face of further investigation, these results do clearly emphasize 2 important, general points that can provide guidance for future research on long-term care quality in different locales. First, at least in long-term care, it no longer seems appropriate to look at rurality as a continuum. Nursing homes outside a metropolitan area did not perform in the ways one would predict if rurality had a monotonic effect on quality of care. These results imply that it may be better to speak of differences based on the specifics of locale or setting rather than some more general concept of a continuum of rurality. Second, future researchers can benefit from differentiating among different types of nursing home residents when evaluating quality of care. The differences observed in rates of decline for postacute admissions differed substantially from those for long-term care admissions. For just such reasons, the most recent nursing home quality initiative from the CMS introduced a distinction between quality indicators for postacute and long-term care.36 The design of this study alleviates a number of potential threats to validity. The national sample provides a reasonable expectation of good external validity. The use of an admission sample with a wide range of covariates measured at baseline reduces the concern about "overadjustment" in the analyses and the confounding of resident and home effects. The range of quality indicators investigated included both general measures of cognitive and physical function and measures reflecting more specific conditions or care problems. However, the study does have limitations. As always, to the degree that the models fail to include variables that significantly affect rates of decline and are highly correlated with locale, the estimated parameters for locale may be biased. A wide range of quality indicators, beyond the 9 included in this analysis, constitute important indicators of nursing home quality.18,20 In addition, some might argue that higher death rates and higher rates of hospitalization do not unfailingly reflect poorer care. Investigations that analyze the risk of decline in other indicators over longer time periods may lead to different conclusions. In addition, the focus here has been solely on quality of care in nursing homes rather than the more global construct, the quality of life in nursing homes, of which quality of care is but 1 dimension.37
This research was supported by the Office of Rural Health Policy, Health Services and Resources Administration, US Department of Health and Human Services (grant 5 U1C RH 00033). The specific project that produced this research was undertaken for Health Services and Resources Administration as part of the activities of the Southwest Rural Health Research Center. The MDS data were provided by the Centers for Medicare and Medicaid Services, US Department of Health and Human Services. Note. The views expressed herein do not necessarily reflect those of any supporting agency or the home institutions of the authors. Any errors or omissions are the responsibility of the authors.
Contributors C. Hawes and C. D. Phillips developed the initial research questions and database. M. Sherman supervised the statistical analysis. S. Holan and M. L. Williams performed statistical analyses and contributed written sections for the initial draft. C. D. Phillips was primarily responsible for the initial interpretations of the results and drafting text. All authors participated in model development, reviewed results, reviewed article drafts, and provided comments and suggested revisions.
Human Participant Protection Accepted for publication June 1, 2004.
1. A Profile of Older Americans: 2001. Washington, DC: Administration on Aging, US Dept. of Health and Human Services; 2001. Available at: http://research.aarp.org/general/profile_2001.pdf. Accessed September 16, 2003. 2. Phillips C, Hawes C, Leyk Williams M. Nursing Homes in Rural and Urban Areas, 2000. College Station, TX: Texas A&M University System Health Science Center, School of Rural Public Health, Southwest Rural Health System Research Center; 2003. 3. Greene VL.Premature institutionalization among the rural elderly in Arizona. Public Health Rep. 1984;99;5863.[Web of Science][Medline] 4. Duncan RP, Coward RT, Gilbert GH. Rural-urban comparisons of age and health at the time of nursing home admission. J Rural Health. 1997;13:118125.[Web of Science][Medline] 5. Penrod JD.Functional disability at nursing home admission: a comparison of urban and rural admission cohorts. J Rural Health. 2001;17:230238.
6. Dwyer JW, Barton AJ, Vogel WB. Area of residence and the risk of institutionalization. J Gerontol. 1994;49:S75S84. 7. McConnel CE, Zetzman MR. Urban/rural differences in health services utilization by elderly persons in the United States. J Rural Health. 1993;9:270280.[Medline] 8. Nyman JA, Cyphert ST, Russell DW, Wallace RB. The ratio of impaired elderly in the community to those in nursing homes in two rural Iowa counties. Med Care. 1989;27;920927.[Web of Science][Medline] 9. Dubay L.Explaining urban-rural differences in the use of skilled nursing facility benefit. Med Care. 1993;31;111129.[Web of Science][Medline] 10. Coburn AF, Bolda EJ, Keith RG. Variations in nursing home discharge rates for urban and rural nursing facility residents with hip fracture. J Rural Health. 2003;19;148155.[Web of Science][Medline] 11. Coburn AF.Rural long-term care: what do we need to know to improve policy and programs? J Rural Health. 2002;18;256269(suppl). 12. Gessert CE, Calkins DR. Rural-urban differences in end-of-life care: the use of feeding tubes. J Rural Health. 2001;17;1624.[Web of Science][Medline]
13. Coburn AF, Keith RG, Bolda EJ. The impact of rural residence on multiple hospitalizations in nursing facility residents. Gerontologist. 2002;42;661666. 14. Coburn AF, Fralich JT, McGuire C, Fortinsky RH. Variations in Outcomes of Care in Urban and Rural Nursing Facilities in Maine. Portland, ME: Maine Rural Health Research Center, Edmund S. Muskie Institute of Public Affairs, University of Southern Maine; 1994. Working paper 2. 15. Morris J, Hawes C, Fries BE, et al. Designing the National Resident Assessment Instrument for nursing homes. Gerontologist. 1990;30;293307.[Abstract] 16. Hawes C, Morris J, Phillips C, Mor V, Fries BE, Nonemaker S. Reliability estimates for the Minimum Data Set for nursing facility resident assessment and care screening (MDS). Gerontologist. 1995;35;172178.[Abstract] 17. Phillips C, Morris J. The potential for using administrative and clinical data to analyze outcomes for the cognitively impaired: an assessment of the Minimum Data Set for nursing homes. Alzheimer Dis Assoc Disord. 1997;11;162167(suppl 6). 18. Mor V, Angelelli J, Jones R, Roy J, Moore T, Morris J. Inter-rater reliability of nursing home quality indicators in the US BMC Health Serv Res. 2003;3;20.[Medline] 19. Iezonni L.Risk and outcomes. In: Iezonni L, ed. Risk Adjustment for Measuring Health Care Outcomes, 2nd ed. Chicago, IL: Health Administration Press; 1997:141. 20. Zimmerman D, Karon SL, Arling G, et al. Development and testing of nursing home quality indicators. Health Care Financ Rev. 1995;16;107127.[Medline] 21. Morris JN, Fries BE, Morris SA. Scaling ADLs within the MDS. J Gerontol A Biol Sci Med Sci. 1999; 54:M546M553.[Abstract] 22. Morris JN, Fries BE, Mehr DR, et al. MDS Cognitive Performance Scale. J Gerontol A Biol Sci Med Sci. 1994;49:M174M182. 23. Hartmaier S, Sloane P, Guess H, Koch G, Mitchell CM, Phillips C. Validation of the Minimum Data Set Cognitive Performance Scale: agreement with the Mini-Mental Status Examination. J Gerontol A Biol Sci Med Sci. 1995;50;M128M133.
24. Burrows AB, Morris JN, Simon SE, Hirdes JP, Phillips C. Development of a Minimum Data Set-based depression rating scale for use in nursing homes. Age Aging. 2000;29;165172. 25. WWAMI Rural Health Research Center [Web site]. Seattle, WA: University of Washington. Updated December 2003. Available at: http://www.fammed.washington.edu/wwamirhrc. Accessed June 14, 2002. 26. Fries BE, Schneider DP, Foley WJ, Gavazzi M, Burke R, Cornelius E. Refining a case-mix measure for nursing homes: Resource Utilization Groups (RUG-III). Med Care. 1994;32;668685.[Web of Science][Medline] 27. Hirdes JP, Dinnus HF, Teare GF. The MDS-CHESS scale: a new measure to predict mortality in institutionalized older people. J Am Geriatr Soc. 2003;51;96100.[Web of Science][Medline] 28. Kovner CT, Harrington C. CMS study: correlation between staffing and quality. Am J Nurs. 2002;102;6566.[Web of Science][Medline] 29. Kaplan EL, Meier P. Nonparametric estimation from incomplete observations. J Am Stat Assoc. 1958; 53:457481.[Web of Science] 30. Shah BV, Barnwell BG, Bieler GS. SUDAAN Users Manual: Software for Analysis of Correlated Data, Release 6.40. Research Triangle Park, NC: Research Triangle Institute; 1996. 31. Harrington C, Kovner C, Mezey M, et al. Experts recommend minimum nurse staffing standards for nursing facilities in the United States. Gerontologist. 2000;40;516.[Abstract]
32. Harrington C, Zimmerman D, Karon SL, Robinson J, Beutel P. Nursing home staffing and its relationship to deficiencies. J Gerontol B Psychol Sci Soc Sci. 2000; 55:S278S287. 33. Munroe DJ.The influence of registered nurse staffing on the quality of nursing home care. Res Nurs Health. 1990;13;263270.[Web of Science][Medline] 34. Kayser-Jones J, Schell E. The effect of staffing on the quality of care at mealtime. Nurs Outlook. 1997;45;6472.[Web of Science][Medline] 35. Bowers BJ, Esmond S, Jacobson N. The relationship between staffing and quality in long-term care facilities: exploring the views of nurse aides. J Nurs Care Qual. 2000;14;5564.[Web of Science][Medline] 36. National Nursing Home Quality Measures: Users Manual, January, 2004, vol 1. Cambridge, MA: Abt Associates; 2004. 37. Phillips CD. Measuring and assuring quality care in nursing homes. In: Noelker LS, Harel Z, eds. Linking Quality of Long-Term Care and Quality of Life. New York: Springer; 2001:162181. This article has been cited by other articles:
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||