© 2007 American Public Health Association DOI: 10.2105/AJPH.2005.073692
The authors are with the Initiative for Maternal Mortality Programme Assessment (IMMPACT), University of Aberdeen, Aberdeen, Scotland. Correspondence: Requests for reprints should be sent to Julia Hussein, University of Aberdeen, Health Sciences Building, Foresterhill, Aberdeen AB25 2ZD, Scotland, UK (e-mail: j.hussein{at}abdn.ac.uk).
Maternal and perinatal mortality reduction has remained a priority on the international health agenda for nearly 2 decades. During this time, strategies for achieving these goals have shifted in emphasis from prevention of pregnancies to provision of care. Robust evidence is limited, particularly regarding what works best in delivering care in specific health system settings and at the population level. We describe the limited evidence base using a framework that highlights the consequences of the major gaps in measurement, evidence, and action, and we discuss existing opportunities for bridging these gaps at the policy level. Capitalizing on current global policy interests and generating demand-driven evidence is a priority for enabling documentation of progress toward reaching the United Nations Millennium Development Goals for 2015.
SINCE THE LAUNCH OF THE international Safe Motherhood Initiative in 1987,1 widely endorsed initiatives such as the 1994 International Conference for Population and Development and the 1997 Safe Motherhood Technical Consultation2 have emphasized the need for an increased focus on reductions in maternal mortality. Although the priority health outcomes have essentially remained the sameless maternal and perinatal mortalitythe intervention strategies have shifted in emphasis over time, from prevention of pregnancies to traditional birth attendant training on safe delivery care or provision of emergency obstetric care in hospitals.3,4 The reasons for such shifts are varied; they include the changing agendas of international organizations, a degree of disillusionment regarding progress, and intensified competition for scarce health resources. As of yet, what has not been available to inform these shifts is what works best for a particular health system at the population level. This lack of knowledge is a reflection of 3 significant, interrelated gapsin measurement, evidence, and action. Twenty years would seem like a sufficient time for these gaps to be narrowed and health burdens to be reduced. The reality is that the gaps still limit both our expectation and demonstration of progress. The United Nations Millennium Development Goals (MDGs), which aim to reduce global poverty and, in particular, seek a three quarter reduction in maternal mortality by 2015, have now brought a new time-line into focus.2 What, then, are the prospects for narrowing the gaps during the next decade?
A goal which cannot be monitored cannot be met or missed. Johansson and Stewart 5(p2) The data currently available on the magnitude, trends, and differentials for maternal and perinatal mortality and morbidity are woefully inadequate in those countries where the need for data is greatest. This data deficiency is not just a consequence of underdevelopment; it is also a contributory factor.6 There are many historical examples of how demonstrating improvements in public health can have the power to enhance the supply of and demand for health services. Indeed, it has been argued that providing access to reliable information is the single most cost-effective achievable strategy for sustainable improvements in health care.7 To date, only a few developing countriesSri Lanka, Thailand, and Honduras, for examplehave shown progress in reducing maternal mortality nationally.8,9 The reductions have been dramatic in some casesfor example, maternal mortality in Sri Lanka dropped 80% over a 20-year period.8 One reason for the success of these countries may have been that they had statistics to parade before policy decisionmakers and the public to break the vicious cycle10 of poor data, thus low priority, thus limited resources, and so poor data. Why are the data still so inadequate and why does it matter? These 2 crucial questions are part of the vicious cycle but also part of the solution. Much has been written on the inadequacies,11,12 with weak routine information systems often unfairly blamed. This analysis of the problem has led to a lack of data on maternal and perinatal outcomes being considered normal. Continuing to work with dubious data is necessary to avoid a total stalling of commitment.13 It should be accompanied by taking on the grand challenge of making the deaths and disabilities of women and their babies lead to ethical, political, and numerical improvements.14 Currently, there are still arguments that the magnitude of these deaths and disabilities is unacceptably highwhich is undoubtedly true, but how high and for whom? If we do not know the level of the current burden of maternal and perinatal conditions, how can we know whether progress has been made and what made the difference? Many district health directors in the poorest countries still have no reliable recent information on the number of maternal deaths, stillbirths, or early neonatal deaths in heath institutions, let alone those occurring silently and tragically at home or when mothers are on their way to seek help. Few ministers of health in these countries can confidently state their national maternal mortality ratios or perinatal mortality rates. In Burkina Faso, for example, crude modeled estimates suggest that the number of maternal deaths per 100 000 live births could be 630 or it could be almost 3 times this figure.15 Major international initiatives such as the Global Burden of Disease (a part of the World Banks Disease Control Priorities Project) do not include stillbirths, and only deaths and disabilities attributed to direct obstetric complications are captured in the maternal category.16 Maternal mortality is 1 of 3 MDGs that cannot be monitored directly, the others being poverty and HIV/AIDS.5 The omission from the Global Burden of Disease initiative of countries lacking data also removes those facing the greatest challenges, potentially giving an inflated impression of the proportion progressing toward the 2015 targets. The measurement gap is therefore the difference between measurements that are sufficient for advocacy purposes (i.e., adequate and accurate data) and measurements that can inform actions (i.e., data that can help us to monitor trends). But there are now heightened opportunities for bridging this gap by building upon what may be called "heads of steam" to create momentum. These are highly topical and often sensitive issues currently at the forefront of the attention of national and international players.
The Gender Disparity There are also a growing number of countries in which governments have been encouraged to address preventable causes of maternal death that violate womens rights to life and health.19 The head of steam behind this rights-based approach can provide the momentum needed for generating and meeting heightened demands for data to show the extent and nature of discrimination, including disproportionate burdens on particular socioeconomic groups or regions. One example is Brazil, where there are well-documented inequalities between geographical regions and significant gender discrimination.20
The PoorRich Disparity Monitoring poverty-reduction strategies only in terms of coverage statistics does not, however, provide proof of equitable health gain or indeed equitable survival.22 Increased use of health care by the poorest women is a necessary but insufficient condition for the reduction of maternal and perinatal mortality at the population level, particularly if the quality of care is not also ensured. Maternal death and disability is widely regarded as a sensitive barometer of the functioning of the entire health system,6,2325 and tracking poverty differentials in these outcomes can thus also highlight market and government failures in the system. The head of steam currently behind poverty-relevant indicators, therefore, provides an opportunity to rally concerted popular and political support for better data on maternal and perinatal conditions.
The Tools-and-Technology Disparity Aside from the need for a larger array of validated instruments and mechanisms for identifying adverse maternal and perinatal events, there is also a need to bridge the digital- and paper-based technology divide. In 2000, a lack of paper for essential tasks such as printing health records or plotting utilization figures was standard in many poor countries where the printed word is still preferred by health professionals.28 This is despite the fact that 10 years earlier it seemed the world was entering the information age and technology would help overcome major barriers in the capture, management, and dissemination of reliable, relevant health information.29 The head of steam created by the ongoing global review of access to health information in developing countries30 should be a stimulus to developing, testing, and sharing measurement tools and technologies as global public goods. Research will play a crucial role in helping to narrow the so-called 10/90 gapthe term for the fact that only 10% of global expenditure on health research and development is allocated to the poorest 90% of the worlds population.29
Bridging the Measurement Gap Measurement, however, is not an end in itself but rather a means for informing decisions to achieve a higher-level objectivethe reduction of maternal and perinatal mortality and morbidity. The tools and mechanisms currently available are inadequate for generating timely, relevant, and appropriate information on these outcomes and thus for monitoring and attributing progress. Consequently, precious human and financial resources are being allocated to major safe motherhood interventions whose effectiveness in improving maternal and perinatal conditions at the population level is unproven. As the competition for these limited resources continues to intensify, decisionmakers will need to answer some hard questions about the value of investment posed by political powers and by civil society.
We have evidence on how to reduce deaths and improve health.32(p1) Evidence is currently a much used and abused term in international public health. After being imported from the original domain of medicine into health policy and programs, the term has become ambiguous. In the context of safe motherhood, this ambiguity has led to more ambiguity about claims of "knowing what works."33,34 Regarding the core components of the discrepancies or gaps in our understanding of safe motherhood, 3 important clarifications are needed: the certainty or quality of the "knowing" (advice vs evidence), the level of the "what" (the intervention), and the generalizability of the "works" (how evidence can be applied and reapplied in different contexts and large-scale programs).
The "Level-of-Intervention" Discrepancy Naturally, there is still room for the improvement of specific technologies,35 but it is also reasonable to claim that "we know what works" at the patient level and for many conditions. Proof of a single interventions efficacy or effectiveness at preventing individual-level death or disability, however, is not proof of benefit for an entire population, because interventions still need to be supplied through a functioning health system and on a scale that meets demand. These systems comprise many other interventionsof known or unknown benefitand operate in the real world in which there are a host of other influences on the death, disability, and health of mothers and babies. At the population level, it is therefore less helpful to discuss single interventionsthere are no "magic bullets" or quick fixes.36 Rather, the debate needs to encompass whole composites of interventionshere called intervention strategiesthat imply not only content (the components) and implementation (the delivery of components) but also contextthe settings in which strategies become implemented as programs. Categorizing or typifying intervention strategies highlights differences in emphasis in what might be called the underlying model of intent or belief. At the extreme ends, for example, are the strategies based on a philosophy or belief that emphasizes secondary prevention (emergency obstetric care) versus those prioritizing primary prevention (family planning). In practice, many developing countries have multiple and overlapping programs being implemented. Differentiating them on the basis of underlying models enables major units of resource expenditure to be isolated and valid questions to be answered on the cost-effectiveness at the population level.
The Advice-Versus-Evidence Discrepancy Why is this? A multitude of explanations could be given; for example, the argument that scarce resources should be used for implementation rather than evaluation. Another set of reasons relates to the challenges regarding measurement that evaluations of intervention strategies present.37 These challenges are undoubtedly significant and fall within the domain of scientific research, which must drive the search for solutions. Not only are realistic and appropriate measurement tools needed to track changes in key health outcome and process indicators, but also innovative thinking is needed to grapple with the complexities of content, implementation, and context that are characteristic of intervention strategies. Measurement and evidence gaps need to be addressed together. These major evaluations require the capture and management of a wide range of types of information, both primary (new) and secondary (existing), which can be assessed from a variety of perspectives, including the use of conventional grades of evidence related to, for example, randomized trials or observational studies. Modeling techniques can be used on secondary data to predict potentially cost-effective intervention strategies,16 and opportunities to test these techniques may arise where enhancements to ongoing programs are possible. Technological innovation is needed in knowledge management, both on the input side and on the user interface, and this innovation can have major spin-offs into other health service areas in which, ironically, information dearth is replaced by information overload.26 The units of evidence need to be pieced together to create a coherent story of the cost-effectiveness of alternative intervention strategies in reducing maternal and perinatal death and disability and of the pathways or mechanisms by which these benefits are achieved. The novel concept of causal networks, which are complex explanatory models of cause and effect,37 holds promise as a "story-telling device" and has particular relevance to the generalizability of findings through control for key contextual factors. Moreover, when fundamental questions regarding which intervention strategies achieve greatest health gain are investigated, a causal network approach would require that a host of additional subquestions be answered along the causal pathway, through primary or secondary research, thereby increasing the overall evidence base for safe motherhood. The continuous process of improving the quality and scope of evidence must, of course, happen alongside promoting use of the "best" evidence available at the time to inform policy and program decisionmaking.
The Going-to-Scale Discrepancy There is limited evidence on which intervention strategies effectively correct the underutilization of health care,17 but there is a strong sense that effectiveness will be context specific, particularly in the case of social or community mobilization initiatives. If this assumption is true, generalizability between countries and from specific evaluations is dependent on the availability and use of sensitive tools to describe the context or setting. Evaluations to identify cost-effective intervention strategies, whether comparing differences in scale alone or also in content, are thus needed. These contextual factors are also crucial to other bases on which to judge what works at a population levelnamely, equity and sustainability.
The "knowdo" gap is at least as great in developing as in developed countries. Godlee et al . 29(p298) There is a large and growing literature indicating that generating evidence on "what works best" does not guarantee its use.39,40 There are 2 interrelated aspects to this "knowdo gap"41accepting or taking up the knowledge and putting it into action. Developing the tools necessary to create knowledge or evidence does not ensure its application. Behavior change among the intended beneficiaries of evidence and tools is poorly understood in general and certainly no clearer in the area of safe motherhood.42 Bridging the measurement and evidence gap is thus a necessary but insufficient condition for reducing maternal and perinatal mortality and disability. Rapid action based on evidence also is required. A relevant lesson that has both historical and contemporary resonance is the importance of creating demand. The recent work of Godlee et al.29 on health information systems has many parallels here; they noted the continuing tendency to supply information to potential users rather than responding to and strengthening the demand of the information needs of those users. In safe motherhood, there is now a critical mass of demand for evidence and thus tools, not the least of which is the desire to achieve the MDGs as well as the implementation of Poverty Reduction Strategy Papers. At a country level, this desire necessitates a particular type of listening partnership that identifies, fosters, and delivers on the demand for evidence by decisionmakers. To strengthen the demand for evidence on the cost-effectiveness of safe motherhood intervention strategies, the capability of both institutions and of decision-makers within countries must be increased. Explicitly fostering this demand fundamentally involves understanding and acknowledging the priority questions as identified by decision-makers in the context of their own settings. Satisfying these demands will require research methods and partnerships that draw upon collaborative networks and dissemination technologies that encourage demand rather than supply. Researchers must therefore be responsive to the ultimate users of research products, seeking their perspectives on tools and evidence from the outset and identifying early applications to policy and practice. For example, methods developed to describe the health systems context of safe motherhood programs clearly have broader relevance to the health sector as a whole, and the architects can facilitate wider demand by partnering with international agencies, such as the World Health Organization, that have broader mandates. The researcheruser interface is crucial not only in regard to the demand for or acceptance of evidence but also for taking action for safe motherhood at a variety of levels.37,39,40,43 This fact highlights the importance of having a broad constituency of partners, of using interdisciplinary approaches, of positioning research in a broad international context, and of grounding the lessons in practical program implementation. Developing methods and using them to evaluate the cost-effectiveness of specific intervention strategies may be described simply as an "alongside initiative," but the politics of such partnerships are far from simple, and time is needed to build mutual confidence and understanding. Generating and sharing demand-driven evidence and ensuring its use cannot be achieved overnight, but there are now brighter prospects for minding the gaps in safe motherhood.
Funding for this study was provided by the University of Aberdeen (to W.J. G.) and IMMPACT (to W.J. G. and J. H.). IMMPACT is funded by the Bill & Melinda Gates Foundation, the Department for International Development (UK), the European Commission, and the US Agency for International Development. Note. The views expressed in this article are those of the authors and do not necessarily reflect the views of the funding organizations.
Human Participant Protection
Peer Reviewed
Contributors Accepted for publication June 28, 2006.
1. Rosenfield A, Maine D. Maternal mortalitya neglected tragedy. Where is the M in MCH? Lancet. 1985;2:8385.[Web of Science][Medline] 2. Starrs AM. Safe motherhood initiative: 20 years and counting. Lancet. 2006;368:11301132.[CrossRef][Web of Science][Medline] 3. Bullough C, Meda N, Makowiecka K, Ronsmans C, Achadi EL, Hussein J. Current strategies for the reduction of maternal mortality. BJOG. 2005;112:11801188.[CrossRef][Web of Science][Medline] 4. Hussein J, Clapham S. Message in a bottle: sinking in a sea of safe motherhood concepts. Health Policy. 2005;73:294302.[CrossRef][Web of Science][Medline] 5. Johansson C, Stewart D. The Millennium Development Goals: Commitments and Prospects. New York, NY: UN Development Program; 2002. Human Development Report Office Working Papers and Notes, Working Paper No. 1. 6. Commission on Macroeconomics and Health. Improving the Health Outcomes of the Poor: Report of Working Group 5 of the Commission on Macroeconomics and Health. Geneva, Switzerland: World Health Organization; 2002. 7. Pakenham-Walsh N, Priestly C, Smith R. Meeting the information needs of health workers in developing countries. BMJ. 1997;314:90. 8. Pathmanathan I, Liljestrand J, Martins JM, et al. Investing in Maternal Health Learning From Malaysia and Sri Lanka. Washington, DC: World Bank; 2003. 9. Koblinsky MA, ed. Reducing Maternal Mortality: Learning From Bolivia, China, Egypt, Honduras, Indonesia, Jamaica and Zimbabwe. Washington, DC: World Bank; 2003. 10. Graham W, Campbell O. The measurement trap. Soc Sci Med. 1992;35:967976.[CrossRef][Web of Science][Medline] 11. AbouZahr C. Maternal mortality overview. In: Murray CJ, Lopez AD, eds. Health Dimensions of Sex and Reproduction. Geneva, Switzerland: World Health Organization; 1998:111164. 12. Graham WJ. Now or never: the case for measuring maternal mortality. Lancet. 2002;359:701704.[CrossRef][Web of Science][Medline] 13. Maine D, Rosenfield A. The Safe Motherhood Initiative: why has it stalled? Am J Public Health. 1999;89:480482. 14. Graham W, Hussein J. The right to count. Lancet. 2004;363:6768.[CrossRef][Web of Science][Medline] 15. Maternal Mortality in 2000: Estimates Developed by WHO, UNICEF and UNFPA. Geneva, Switzerland: Dept of Reproductive Health Research, World Health Organization; 2004. 16. Graham WJ, Cairns, J, Bhattacharya S, Bullough CHW, Quayyum Z, Rogo K. Maternal and perinatal conditions. In: Jamison DT, Breman JG, Measham AR, et al., eds. Disease Control Priorities. 2nd ed. Washington, DC: World Bank; 2006:499529. 17. Germain A. Reproductive health and human rights. Lancet. 2004;363:6364. 18. State of the Worlds Population. New York, NY: UN Population Fund; 2004. 19. Cook RJ, Galli Bevilacqua MB. Invoking human rights to reduce maternal deaths. Lancet. 2004;363:73.[CrossRef][Web of Science][Medline] 20. Concluding observations of CESCR: Brazil, E/C.12/1/Add. 87. Geneva, Switzerland, Committee on Economic, Social and Cultural Rights (CESCR). 2003. Available at: http://www.universalhumanrightsindex.org/documents/827/279/document/en/pdf/text.pdf Accessed March 27, 2007. 21. The Wealth Gap in Health. Washington, DC: Population Reference Bureau; 2004. 22. Graham W, Fitzmaurice AE, Bell JS, Cairns JA. The familial technique for linking maternal death and poverty. Lancet. 2004;363:2327.[CrossRef][Web of Science][Medline] 23. Goodburn E, Campbell O. Reducing maternal mortality in the developing world: sector-wide approaches may be the key. BMJ. 2001;322:917920. 24. Say L, Pattinson RC, Gulmezoglu M. WHO systematic review of maternal morbidity and mortality: the prevalence of severe acute maternal morbidity (near miss). Reprod Health. 2004;1:3. Available at: http://www.reproductive-health-journal.com/content/1/1/3. Accessed May 5, 2006.[CrossRef][Medline] 25. United Nations Population Fund (UNFPA), University of Aberdeen. Maternal Mortality Update 2004. Delivering into good hands. Available at: http://www.unfpa.org/publications. Accessed January 12, 2006. 26. Evans T, Stansfield S. Health information in the new millennium: a gathering storm? Bull World Health Organ. 2003;81:856.[Web of Science][Medline] 27. World Health Organization. Health Metrics Network. Available at: http://www.who.int/healthmetrics/about/en. Accessed May 4, 2006. 28. Horton R. North and South: bridging the information gap. Lancet. 2000; 355:22312236.[CrossRef][Web of Science][Medline] 29. Godlee F, Pakenham-Walsh N, Ncayiyana D, Cohen B, Packer A. Can we achieve health information for all by 2015? Lancet. 2004;364:295300.[CrossRef][Web of Science][Medline] 30. International Network for the Availability of Scientific Publications. Ensuring world-wide access to information and knowledge. Available at: http://www.inasp.info. Accessed March 26, 2007. 31. Jamison DT, Jamison JS, Lawn J, Shahid-Salles S, Zupan J. Incorporating Deaths Near the Time of Birth Into Estimates of the Global Burden of Disease. Bethesda, Md: Disease Control Priorities Project; 2004. Working Paper 26. 32. Reducing Maternal Deaths: Evidence and Action. A Strategy for DFID. London, England: Department for International Development; September 2004. 33. Miller S, Sloan NL, Winikoff B, Langer A, Fikree F. Where is the "E" in MCH? The need for an evidence-based approach in safe motherhood. J Midwifery Womens Health. 2003;48:1018.[CrossRef][Web of Science][Medline] 34. Institute of Medicine. Improving Birth Outcomes: Meeting the Challenges in the Developing World. Bale J, Stoll B, Mack A, Lucas A, eds. Washington, DC: National Academy of Sciences; 2003. 35. Tsu VD. New and underused technologies to reduce maternal mortality. Lancet. 2004;363:7374.[CrossRef][Web of Science][Medline] 36. Milne L, Scotland G, Tagiyeva-Milne N, Hussein J. Safe motherhood program evaluation: theory and practice. J Midwifery Womens Health. 2004; 49:338344.[CrossRef][Web of Science][Medline] 37. Pawson R, Tilley N. Realistic Evaluation. London, England: SAGE Publications Ltd; 1997. 38. IMMPACT. Conceptual framework. Available at: http://www.abdn.ac.uk/immpact/resources/framework/index.php. Accessed March 26, 2007. 39. In This Months Bulletin. Bull World Health Organ. 2004;82:719810. Available at: http://www.who.int/bulletin/volumes/82/10/en. Accessed March 26, 2007. 40. Shiffman J. Generating political will for safe motherhood in Indonesia. Soc Sci Med. 2003;56:11971207.[CrossRef][Web of Science][Medline] 41. Garner P, Kale R, Dickson R, Dans T, Salinas R. Getting research findings into practice: implementing research findings in developing countries. BMJ. 1998;317:531535. 42. Haines A, Kuruvilla S, Borchert M. Bridging the implementation gap between knowledge and action for health. Bull World Health Organ. 2004;82:724731.[Web of Science][Medline] 43. Kavanagh A, Daly J, Melder A, Jolley D. Mind the gap: assessing the quality of evidence for public health problems. In: Lin V, Gibson B, eds. Evidence-Based Health Policy, Problems and Possibilities. Melbourne, Australia: Oxford University Press; 2003:7079. This article has been cited by other articles:
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||