© 2002 American Public Health Association
The authors are with the Department of Health Services, Boston University School of Public Health, Boston, Mass, and the Center for Health Quality, Outcomes and Economic Research, Bedford, Mass. Judith A. Jones is also with the Department of General Dentistry, Boston University Goldman School of Dental Medicine. Correspondence: Requests for reprints should be sent to Ulrike Boehmer, PhD, Center for Health Quality, Outcomes and Economic Research, 200 Springs Rd, Bldg 70, Bedford, MA 01730 (e-mail: boehmer{at}bu.edu).
Concerns about administrative data on race/ethnicity have led some researchers to consider self-reported race/ethnicity as superior.15 However, few studies have examined the differential impact of the source of race/ethnicity data, that is, observed or selfreported, on study outcomes. We investigated whether differences in reporting of race/ethnicity led to different results with regard to the use of one therapeutic dental procedure, root canal therapy.
From a retrospective secondary data study of Department of Veterans Affairs (VA) dental outpatients who underwent either root canal or tooth extraction between October 1, 1997, and September 30, 1998 (Jones et al., unpublished data), we selected the first treatment of the year for 15 137 patients, on whom we had both self-reported race/ethnicity from the 1999 Large Health Survey of Veteran Enrollees6 and administrative race/ethnicity data from the VA outpatient clinic files. Clinical information on the dental procedure performed as well as the severity of dental disease and the medical comorbidities was obtained from the VA administrative data files (Jones et al., unpublished data). In the administrative data each patient was assigned a single race/ethnicity from among 6 categories: (1) Hispanic, (2) American Indian, (3) Black, (4) Asian, (5) White, (6) unknown or missing. Survey respondents were asked to describe their race/ethnicity by selecting all that applied from among 6 categories: (1) American Indian or Alaska Native, (2) Asian, (3) Black or African American, (4) Spanish, Hispanic, or Latino, (5) Native Hawaiian or Pacific Islander, (6) White. Those who did not answer were coded as "missing." We eliminated 35 who self-reported Native Hawaiian or Pacific Islander as their single race, since there was no comparable category in the administrative database. This reduced our sample to 15 102 patients with a single visit during which either a root canal or a tooth extraction was performed. Using self-reported race/ethnicity as the gold standard, we calculated the proportion of each racial/ethnic category correctly recorded in the administrative database, once for those who self-reported a single race/ethnicity and once allowing for those who chose multiple responses. Using logistic regression, we estimated the probability of obtaining root canal therapy vs tooth extraction for patients of different race/ethnicity, calculating 3 models. The first model used administrative race/ethnicity data, the second self-reported single race/ethnicity, and the third used selfreported race/ethnicity by weighing multiple race/ethnicities by the number of categories.
We determined the amount of agreement between self-reported race/ethnicity and the administrative data, once using only the 82.4% of patients who reported a single race/ethnicity and once including the 4.9% who reported multiple (between 2 and 6) race/ethnicity categories. Following one of the US Census Bureaus suggestions about the compilation of multiple race/ethnicity responses, we counted patients who reported combinations such as "White and Asian and African American" 3 times: (1) "White alone or in combination," (2) "Asian alone or in combination," and (3) "African American alone or in combination."7 Thus the multiple counting increases the sample size from 15 102 patients to 15 906 race/ethnicity responses.
Table 1
Table 2
Race/ethnicity in administrative data were more frequently incorrect for patients whose race/ethnicity was other than White, as indicated by other studies.8,9 Source of race/ethnicity data influenced the assessment of the outcome, root canal therapy, in that results for patients with unknown race/ethnicity differed significantly by data source. The level of disagreement and the differences in assessment suggest that estimates of racial/ethnic differences are dependent on the source of race/ethnicity data. Our results suggest that future studies of racial/ethnic variations should be sensitive to the source of race/ethnicity data. Studies that depend on administrative race/ethnicity should note the limitations of this approach.
This research was supported by funding from the Department of Veterans Affairs Health Services Research and Development Service (HSR&D IIR 98.161) and by the Veterans Health Administration, Office of Quality and Performance. The authors gratefully acknowledge A. Pitman for providing programming support.
Human Participant Protection
Peer Reviewed Note. The views expressed in this article are those of the authors and do not necessarily represent the views of the Department of Veterans Affairs. U. Boehmer designed the study, analyzed the data, and wrote the brief. N. R. Kressin, D. R. Berlowitz, and J. A. Jones assisted in the study design, data analyses, and writing. C. L. Christiansen provided guidance on the data analyses and assisted in the writing. L. E. Kazis designed and conducted the 1999 survey that provided the self-reported data and reviewed the manuscript. Accepted for publication December 28, 2001.
1. Williams DR. Race/ethnicity and socioeconomic status: measurement and methodological issues. Int J Health Serv. 1996;26:483505.[Medline]
2. Amaro H, Zambrana RE. Criollo, mestizo, mulato, LatiNegro, indigena, white, or black? The US Hispanic/Latino population and multiple responses in the 2000 census. Am J Public Health. 2000;90:17241727. 3. Swallen KC, Glaser SL, Stewart SL, West DW, Jenkins CN, McPhee SJ. Accuracy of racial classification of Vietnamese patients in a population-based cancer registry. Ethn Dis. 1998;8:21827.[Medline] 4. Williams DR. Race and health: basic questions, emerging directions [see comments]. Ann Epidemiol. 1997;7:322333.[Medline] 5. Hahn RA, Stroup DF. Race and ethnicity in public health surveillance: criteria for the scientific use of social categories. Public Health Rep. 1994;109:715.[Medline] 6. Health Status and Outcomes of Veterans: Physical and Mental Component Summary Scores Veterans SF-36. 1999 Large Health Survey of Veteran Enrollees. Executive Report. Washington, DC: Veterans Health Administration, Dept of Veterans Affairs; May 2000. 7. US Census Bureau. Questions and answers for Census 2000 data on race. March 14, 2001. Available at: http://www.census.gov/Press-Release/www/2001/raceqandas.html. Accessed June 28, 2002. 8. Hahn RA, Truman BI, Barker ND. Identifying ancestry: the reliability of ancestral identification in the United States by self, proxy, interviewer, and funeral director. Epidemiology. 1996;7:7580.[Medline]
9. Hahn RA, Mulinare J, Teutsch SM. Inconsistencies in coding of race and ethnicity between birth and death in US infants. A new look at infant mortality, 1983 through 1985. JAMA. 1992;267:25963. This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||