Why we need more Impact Evaluations

The work of intervention, particularly in relation to public health, is focused on communicating with a localized body of people, identifying their needs and striving to establish better conditions. Developmental in nature, these public policy initiatives are aimed at providing the necessary tools for at-risk communities. In terms of global health—raising individuals from impoverished conditions, alleviating the prevalence of fatal diseases such as HIV/AID, Malaria, and TB, and taking measures to prevent the incidence of new cases—programs are generally centered around providing aid through education, nutrition, and access to essential medicines.

Every year, billions of public and private dollars are spent on such efforts. [2] With all of this energy from a wide assortment of international entities and aid agencies, we must ask ourselves several important questions. Are these programs truly effective in achieving their desired goals? How effective are they? Why are they effective? What specific procedures produced positive results? This manner of thinking is an essential aspect of Impact Evaluation, a methodical approach closely related to evidence-based policy making. [1] In other words, this is the evaluation of public policy initiatives based on outcomes and results. Impact evaluation is a vital tool in deciding which programs are viable and should receive further funding, and which programs require restructuring and improvement. [2]

Impact Evaluation procedures were taken into account for the introduction of Insecticide-Treated Mosquito Nets (ITNs) in Busia, Kenya. [1] ITNs are mosquito nets or ‘bed-nets’ that are placed above a sleeping area. Mosquitoes, which are often malaria-carriers, and are generally active most during the twilight hours, tend to infect their victims while their victims are asleep. ITNs, treated with powerful insecticides, serve as efficient mosquito repellants. [3] In Busia, "a two-phase pricing experiment was used to measure both the short-term and long-term impacts on demand for insecticide treated bed nets.” [1]The study produced several conclusions. First, product-pricing and device implementation are negatively related: adoption rates increased as the purchase-price of ITNs decreased. When offered free-of-charge, 98 percent of households adopted the device. [1] Finally, in the long-run, when ITNs were widely distributed within a community, individuals became more willing to purchase the device, despite pricing; Nearby residents noticed the positive impact of ITNs and wanted one of their own, even at higher prices. In the long-term, social learning took place and this preventative health measure became normative. [1]

The Abdul Latif Jameel Poverty Action Lab (J-PAL) is operating a large-number of Impact Evaluations with wide ranging consequences. Centered at Massachusetts Institute of Technology, J-PAL includes a network of university-based researchers focused on the ‘wicked problems’ facing global health and poverty. [2] Abhijit Banarjee, co-founder and active director of J-PAL, stated that the lab was only conducting some 70 evaluations annually in the early 2000s. Today, as Impact Evaluations are actively creating changes in public policy development, that number nears 800 world-wide. [2]

One issue still persists: the number of aid programs vastly outweigh the number of ongoing evaluations. This large data gap means we still do not know the effectiveness of our most well-funded initiatives and programs around the globe. Moving forward, the wide-spread implementation of Impact Evaluations is necessary. Several ethical and effective studies demonstrate the validity of evidence-based investigations. With limited resources and a slew of challenging, multi-faceted issues, we must use every available tool. In the future, we should look towards an increase in the number of evaluations conducted worldwide, and their increased importance in shaping policy, initiatives, and aid programs, ultimately helping better the lives of those in need around the globe.

References:

1. [1]Gertler, Paul. "Chapter 1. Why Evaluate?" Impact Evaluation in Practice. Washington, D.C.: World Bank, 2011. N. pag. Print.
2. [2]Aizenman, Nurith. "How Do You Know If Aid Really Works? Turns Out ... We Often Don't." NPR. NPR, n.d. Web. 25 Jan. 2017. http://www.npr.org/sections/goatsandsoda/2017/01/21/509555816/how-do-you-know-if-aid-really-works-turns-out-we-often-dont#http://www.npr.org/sections/goatsandsoda/2016/11/01/500093608/you-asked-we-answer-can-tiny-loans-lift-women-out-of-poverty.
3. [3]"PMI, President's Malaria Initiative, Fighting Malaria and Saving Lives." Insecticide-Treated Mosquito Nets | PMI. N.p., n.d. Web. 25 Jan. 2017. https://www.pmi.gov/how-we-work/technical-areas/insecticide-treated-mosquito-nets-(itns)-pmi.