© 2008 American Public Health Association DOI: 10.2105/AJPH.2006.087783
Patricia G. Schnitzer is with the Sinclair School of Nursing, University of Missouri, Columbia. Theresa M. Covington is with the National Center for Child Death Review Policy and Practice, Michigan Public Health Institute, Okemos. Stephen J. Wirtz is with Epidemiology and Prevention for Injury Control, California Department of Health Services, Sacramento. Wendy Verhoek-Oftedahl is with the Department of Community Health, Brown Medical School, Providence, RI. Vincent J. Palusci is with the Department of Pediatrics, Wayne State University School of Medicine, Detroit, Mich. Correspondence: Requests for reprints should be sent to Patricia G. Schnitzer, PhD, Assistant Professor, S331, Sinclair School of Nursing, University of Missouri, Columbia, MO 65211 (e-mail: schnitzerp{at}health.missouri.edu).
Objectives. We sought to describe approaches to surveillance of fatal child maltreatment and to identify options for improving case ascertainment. Methods. Three states—California, Michigan, and Rhode Island—used multiple data sources for surveillance. Potential cases were identified, operational definitions were applied, and the number of maltreatment deaths was determined. Results. These programs identified 258 maltreatment deaths in California, 192 in Michigan, and 60 in Rhode Island. Corresponding maltreatment fatality rates ranged from 2.5 per 100000 population in Michigan to 8.8 in Rhode Island. Most deaths were identified by child death review teams in Rhode Island (98%), Uniform Crime Reports in California (56%), and child welfare agency data in Michigan (44%). Compared with the total number of cases identified, child welfare agency (the official source for maltreatment reports) and death certificate data underascertain child maltreatment deaths by 55% to 76% and 80% to 90%, respectively. In all 3 states, more than 90% of cases ascertained could be identified by combining 2 data sources. Conclusions. No single data source was adequate for thorough surveillance of fatal child maltreatment, but combining just 2 sources substantially increased case ascertainment. The child death review team process may be the most promising surveillance approach.
Child maltreatment causes a significant number of fatalities in the United States, and accurately determining the number of maltreatment-related deaths each year remains a challenge. With data from child protective services agencies, the National Child Abuse and Neglect Data System estimated there were nearly 1500 child abuse–related or neglect-related deaths in 2004 (2.0 per 100 000 children).1 However, child protective services data are known to underestimate maltreatment deaths for a variety of reasons including difficulties identifying, investigating, and reporting deaths to child protective services; lack of standard definitions of child maltreatment; and differing legal standards for substantiation of maltreatment.2,3 In the United States, a death certificate is the official record of death. Death certificates include a determination of the cause and manner of death and are often used to summarize the mortality burden of injuries and diseases. It is, however, well documented that these vital records underestimate the magnitude of fatal child maltreatment.3–6 In fact, 50% to 60% of all child maltreatment deaths are not identified as such by death certificates,3,5,6 with 1 report estimating that 85% of deaths related to child maltreatment are recorded on the death certificate as attributable to other causes.7 The combination of data from multiple sources to obtain more accurate identification of individuals with the condition under surveillance (i.e., case ascertainment) has enhanced public health surveillance of injuries and violence8–11 and has shown promise as a method for obtaining more accurate estimates of mortality related to child maltreatment.3,6 In September 2001, the Centers for Disease Control and Prevention (CDC) funded programs in 3 states—California, Michigan, and Rhode Island—to develop and evaluate public health surveillance of fatal child maltreatment through the use of multiple data sources for case ascertainment. We describe the approaches taken in these programs and summarize the epidemiology of fatal child maltreatment. Because underascertainment of fatal child maltreatment by both child protective services and death certificate data are well documented, we focused on the relative utility of additional data sources available for surveillance and explored various options for improving case ascertainment. Four of the authors took part in the state programs (T. M. C. and V. J. P. in Michigan, S. J. W. in California, and W. V-O. in Rhode Island). By summarizing options for surveillance based on their experiences, we hope to provide useful information to other states interested in establishing surveillance for fatal child maltreatment.
Identification of child maltreatment deaths for inclusion in the surveillance program (i.e., surveillance case ascertainment) was conducted for 2 years (2000 and 2001) in California and Michigan and for 5 years in Rhode Island (1998–2002, to compensate for the small number of deaths). Each state developed an approach to child maltreatment case ascertainment by using multiple sources of applicable data available in their state. The 3 states used 4 data sources in common: records from the states child welfare agency, state child death review team(s) data, law enforcement reports of homicides made to the Federal Bureau of Investigation Uniform Crime Report system (UCR), and death certificates. Although California and Rhode Island each used an additional data source (Child Abuse Central Index in California and medical examiner records in Rhode Island), we focused on the 4 sources of child maltreatment fatalities consistently available in most states.
The 3 states used the same conceptual case definition that included deaths of children aged younger than 10 years that resulted from actions or inactions by the childs parent or other adult caregiver (e.g., babysitter). In addition, each state program developed unique operational definitions to identify cases from the data sources in that state. Once potential cases were identified and the operational definitions of child maltreatment were applied, the total number of maltreatment deaths for the surveillance period was determined. Duplicate cases (i.e., deaths ascertained by more than 1 source) were identified by name and other personal identifiers and counted in the total only once. The implementation of this process differed by state and is described below. All data sources, criteria for identifying potential cases, and operational definitions used are listed in Table 1
California The California Department of Health Services obtained information on all deaths that met the criteria for potential cases from each data source (Table 1 As a method of verification, the California Department of Health Services sent each county child death review team the list of potential child maltreatment deaths that occurred either in its jurisdiction or to a resident of the jurisdiction. The teams were asked if they had reviewed these deaths (approximately 75% had been reviewed) and, if so, whether the deaths were determined by the team to be maltreatment related. They were also asked to submit information on any other deaths not included on the list that they had reviewed and considered to be maltreatment related. This verification process is referred to as the Child Death Review Team Reconciliation Audit. The maltreatment deaths reported here are those identified from all sources, including deaths added by the Child Abuse Central Index and the Child Death Review Team Reconciliation Audit, but excluding deaths determined during the audit to not be maltreatment related.
Michigan
Case ascertainment began after the work group determined specific criteria for the identification of potential cases from each data source. A case abstractor then compiled all records related to the deaths that met these criteria. The work group developed an operational case definition based on Michigan laws and policies and then met on a regular basis to review the abstracted records on each potential case. Deaths were classified as maltreatment related if they met any of the case definition criteria (Table 1 A special emphasis for Michigan was to more completely ascertain neglect-related deaths. The work group chose to do this by examining the circumstances of unintentional injury deaths. Because of the enormous volume of these deaths among children aged younger than 10 years, only unintentional injury deaths of children with any substantiated child protective services report on the child or family member was reviewed (approximately 27% of child injury deaths met these criteria). These deaths were identified, abstracted, reviewed, and classified in the same manner as deaths identified from the other 4 sources.
Rhode Island
Data Analyses
Ascertainment of Maltreatment Deaths The total number of maltreatment deaths, the number identified by each data source, and the number identified by combining sources are presented by state in Table 2
Of the deaths ascertained by each of the 4 data sources, the most deaths were ascertained by the child death review team in Rhode Island (98%), UCR in California (56%; followed closely by the child death review team at 55%), and child welfare agencies in Michigan (44%). Sources that identified the fewest cases, 20% or less, were death certificates in all 3 states and UCR in Rhode Island and Michigan. State child welfare agencies, the official reporting source for child maltreatment, identified approximately one fourth of the deaths ascertained in California (24%) and Rhode Island (27%), and 44% in Michigan.
Table 2 In all 3 states, more than 90% of the cases ascertained by combining the 4 data sources could be identified by linking just 2 of the sources, although the 2 key sources differed by state. In Rhode Island, all but 1 of the cases were ascertained with the child death review team data; combining child death review team and child welfare agency data resulted in ascertainment of all 60 cases. In Michigan, the combination of child death review team and child welfare agency data identified all but 2 of the cases ascertained by the 4 sources (108 of 110). And in California, child death review team and UCR data identified 93% (214 of 230) of cases identified by the 4 sources.
Descriptive Epidemiology of Fatal Child Maltreatment
Child maltreatment fatality rates by data source for each state are shown in Table 4
Our results confirm existing literature that documents the underascertainment of child maltreatment deaths by state child welfare agency and death certificate data. When compared with the total number of cases identified by multiple sources and alternative approaches to surveillance in these 3 states, state child welfare agency data underascertained child maltreatment deaths by 55% to 76%, and death certificates underascertained deaths by 80% to 90%, a range that is consistent with the literature.3,5–7 Our findings further contribute to the understanding of child maltreatment by documenting case ascertainment by other sources of existing state data proposed for surveillance and by summarizing important differences across states regarding how well individual data sources perform. For example, in California, UCR data identified the most cases, but in Michigan and Rhode Island, UCR data were completely redundant—every case identified by UCR data was also identified by another source. Although no single source was consistently the best or worst across all 3 states, child death review team data were the best or second-best single source in Rhode Island, California, and Michigan, identifying 98%, 55%, and 32% of cases, respectively. Our results demonstrate that each data source, when used in isolation, substantially underascertains the total number of fatal child maltreatment cases identified. The exception is child death review team data in Rhode Island. The success of the child death review team in Rhode Island is likely related to the relatively small number of child deaths that occur in the state each year. Furthermore, the child death review team process in Rhode Island differs from the processes in California and Michigan in that 1 team reviews deaths for the entire state and this team included a child abuse pediatrician, factors that may have facilitated identification of fatal child maltreatment by the Rhode Island child death review team. By contrast, California and Michigan have child death review teams in each county that may (although many do not) include a child abuse pediatrician. These teams review the death and then transmit data to a state agency that aggregates and summarizes the data provided. The results further demonstrate the value of using multiple existing data sources to improve child maltreatment surveillance. In each state, the use of 2 data sources resulted in ascertainment of more than 90% of unique cases identified from all 4 sources. Although the 2 data sources were not consistent across the states, child death review team data were a key source. Combining child death review team data with child welfare data in Michigan and Rhode Island resulted in 98% (108 of 110) and 100% (60 of 60) ascertainment, respectively, whereas combining child death review team and UCR data in California identified 93% (214 of 230) of cases ascertained by all sources. In addition, the expanded surveillance processes in California and Michigan ascertained cases not identified from the 4 common sources. This suggests that even when multiple data sources are combined, maltreatment fatalities are still underascertained, and other methods to identify cases such as the effort in Michigan to identify neglect by linking death certificates to child welfare agency records may be necessary to further improve surveillance. Maltreatment-related fatality rates per 100 000 children ranged from 2.5 in California to 8.8 in Rhode Island. National fatality rate estimates from the National Child Abuse and Neglect Data System for 2000 and 2001 are 3.3 and 3.8 per 100 000 children aged younger than 10 years, respectively (L. Zikratova, personal communication, October 31, 2005). These national estimates are similar to the rates calculated with only child welfare agency data in Michigan (3.0 per 100 000) and Rhode Island (2.4 per 100 000) but substantially lower than the rates identified by the combined surveillance approaches in these 2 states (6.8 per 100 000 and 8.8 per 100 000, respectively). The higher rates obtained with the combined surveillance data not only further substantiate the undercount in available national data but also highlight the value of conducting public health surveillance for fatal child maltreatment. After comparing fatal child maltreatment surveillance data in 3 states using multiple data sources for case ascertainment, we found consistent underascertainment by all individual sources; the amount of underascertainment varied across states and across data sources. These data indicate that no single source is sufficient for thorough surveillance with the methods employed by these states, except possibly the child death review team process in Rhode Island. However, combining as few as 2 data sources can markedly improve surveillance.
Limitations
Recommended Strategies Determination of the unduplicated total from multiple data sources was the strategy used in Rhode Island and the starting point for surveillance in California and Michigan. This option is more comprehensive than use of a single source and substantially increased the number of cases ascertained. Because it requires centralized processing of data and skilled staff to integrate and link the data, it is somewhat time and labor intensive. However, once surveillance is conducted in this manner for a few years, it would be possible to revise the surveillance strategy to use fewer sources. Selecting a "relative standard" source and using this to reconcile other sources was the option used by California (Child Death Review Team Reconciliation Audit), and its use resulted in the inclusion of cases not identified from other sources. Importantly, this option would require no more resources than simply linking multiple data sources, because the personnel and data linkage capabilities would already be in place. The surveillance approach used in Michigan was analogous to creating a "gold standard" review process. Advantages of this method include the development and consistent application of an operational case definition and the ability to adapt the process to an active surveillance approach (case finding for fatal neglect). In addition to being time and labor intensive, the major challenges of this approach are getting state-level and multiagency commitment to the process and access to sufficient case material to determine if a death was maltreatment related. Although this approach may be viewed as impractical given its resource intensity, Michigan found such value in the process that it was institutionalized and continues today. Selecting a single best source may be the least expensive and labor intensive of all options described, but it will clearly undercount the number of maltreatment-related deaths. Although identification of a single best source in other states might be difficult, our findings indicate that child death review team data are a good single-source option. It should be noted, however, that child death review team data will work for state and local surveillance only if there is a standardized data collection and reporting system in place. Furthermore, many child death review teams lack definitions for maltreatment, so standard definitions would need to be adopted and consistently applied. Finally, the resources needed to build capacity and maintain a well-functioning child death review team program could be substantial. It is noteworthy to mention the Child Death Review Case Reporting System developed by the National Resource Center for Child Death Review Policy and Practice (http://www.childdeathreview.org). This is an ongoing project that addresses many of the limitations of using child death review team data for child-maltreatment surveillance. The goal of the reporting system is to compile standardized data from state and local child death review team programs and summarize the circumstances and causes of child deaths. Importantly, key variables for identifying child maltreatment are included in this system, facilitating the consistent identification of these deaths across participating states (http://www.childdeathreview.org/toolsforteams.htm). In conclusion, the surveillance projects described here provide critical information for understanding the nature of current data sources available for surveillance, and insights into how states might better ascertain maltreatment deaths. Availability and implementation of standard surveillance case definitions will enable comparison of data across sources and states and are essential for moving these efforts forward.
Funding for this project was provided by the Centers for Disease Control and Prevention (cooperative agreements U81/CCU920885, U81/CCU920887, U81/ CCU520883, and U81/CCU120884). We gratefully acknowledge our colleagues at the Centers for Disease Control and Prevention for their guidance and input during the development of the surveillance approaches. In California, we acknowledge the dedicated work of all the local child death review teams, the support of the State Child Death Review Council, and Erin Griffin at the California Department of Health Services. In Rhode Island, we acknowledge the members of Rhode Island Child Death Review Team under the guidance of Elizabeth Laposata, as well as Carole Jenny, Christine Barron, Kirsten Spalding, Lauren Contursi, Laura Roesler, and Andrea Alvarez. In Michigan, we acknowledge the dedicated work of local child death review teams, Laurie Johnson and Steve Yager from the Michigan Department of Human Services, and Jane Paterson, formerly of the Michigan Public Health Institute.
Human Participant Protection
Peer Reviewed
Contributors Accepted for publication August 16, 2006.
1. Child Maltreatment 2004. Washington DC: Administration on Children, Youth and Families [updated 2006 Jun 13]. Available at: http://www.acf.hhs.gov/programs/cb/pubs/cm04/index.htm. Accessed June 13, 2006. 2. National Research Council. Understanding Child Abuse and Neglect. Washington, DC: National Academy of Sciences; 1993. 3. Ewigman B, Kivlahan C, Land G. The Missouri child fatality study: underreporting of maltreatment fatalities among children younger than five years of age, 1983 through 1986. Pediatrics. 1993;91:330–337. 4. Herman-Giddens ME. Underrecording of child abuse and neglect fatalities in North Carolina. N C Med J. 1991;52:634–639.[Medline] 5. Herman-Giddens ME, Brown G, Verbiest S, et al. Underascertainment of child abuse mortality in the United States. JAMA. 1999;282:463–467. 6. Crume TL, DiGuiseppi C, Byers T, Sirotnak AP, Garrett CJ. Underascertainment of child maltreatment fatalities by death certificates, 1990–1998. Pediatrics. 2002;110(2 pt 1):e18. 7. McClain PW, Sacks JJ, Froehlke RG, Ewigman BG. Estimates of fatal child abuse and neglect, United States, 1979 through 1988. Pediatrics. 1993;91: 338–343. 8. Rosman DL, Knuiman MW. A comparison of hospital and police road injury data. Accid Anal Prev. 1994;26:215–222.[CrossRef][Web of Science][Medline] 9. Barber CW, Ozonoff VV, Schuster M, et al. Massachusetts Weapon-Related Injury Surveillance System. Am J Prev Med. 1998;15(Suppl 3):57–66.[CrossRef][Web of Science][Medline] 10. Verhoek-Oftedahl W, Pearlman DN, Coutu Babcock J. Improving surveillance of intimate partner violence by use of multiple data sources. Am J Prev Med. 2000;19:308–315.[CrossRef][Web of Science][Medline] 11. Shepherd JP, Sivarajasingam V, Rivara FP. Using injury data for violence prevention. Government proposal is an important step towards safer communities. BMJ. 2000;321:1481–1482. 12. Ingram DD, Parker JD, Schenker N, et al. United States Census 2000 population with bridged race categories. Vital Health Stat 2. 2003:1–55. Hyattsville, Md: National Center for Health Statistics; 2005. Available at: http://www.cdc.gov/nchs/about/major/dvs/popbridge/popbridge.htm. Accessed: December 2, 2004. 13. Hammond WR. Public health and child maltreatment prevention: the role of the Centers for Disease Control and Prevention. Child Maltreat. 2003;8:81–83. 14. Whitaker DJ, Lutzker JR, Shelley GA. Child maltreatment prevention priorities at the Centers for Disease Control and Prevention. Child Maltreat. 2005;10: 245–259. 15. US Department of Health and Human Services. Surgeon Generals Workshop. Making prevention of child maltreatment a national priority: implementing innovations of a public health approach [Web cast] [updated 2005 Aug 30]. Available at: http://www.surgeongeneral.gov/healthychild/workshop.html. Accessed June 23, 2006. 16. International Classification of Diseases, Ninth Revision. Geneva, Switzerland: World Health Organization; 1980. 17. International Classification of Diseases, 10th Revision. Geneva, Switzerland: World Health Organization; 1992. This article has been cited by other articles:
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||