The Developmental Evaluation Pilot Activity (DEPA-MERL) will test the effectiveness of a developmental evaluation (DE) approach, as well as accompanying monitoring and evaluation tools and flexible contracting mechanisms, in achieving effective programming for innovative interventions, untested theories of change, and/or implementation in complex contexts.
For complex interventions or new innovations, traditional midterm and end line evaluations can occur too late to aid in programmatic fine tuning; and often help interventions reach their pre-defined outcomes, rather than work on systems change that may require the redefinition of outputs and outcomes.
Traditional approaches to monitoring and evaluation focus on making existing processes, structures and systems more effective. DE seeks to improve not only program design, but takes into account the entire complex dynamic system in which the program, project or activity is taking place. DE provides an approach to evaluation that is quick, ongoing, and takes an iterative approach to data collection, analysis and feedback that contributes to timely changes throughout the project cycle and allows for system changes as well as changes in targeted outcomes.
Developmental Evaluators are “embedded” within the program, project, or activity to contribute to modifications in program design and targeted outcomes throughout implementation. However, Developmental Evaluators remain independent from implementing staff, providing a third-party perspective to support an adaptive management process. DE does not prescribe a single methodological design, tool, or framework – the evaluation approach taken is based on emerging needs. Methods might include network and outcome mapping, contribution analysis, or other approaches based on information needs. DE is a highly flexible approach and is well-suited for projects under flexible contracting mechanisms in which implementation is likely to change in response to emerging conditions on the ground.
DEPA-MERL has piloted four DEs to date to test the effectiveness of the approach. Learn about each pilot and see examples of deliverables and learning products at the links below:
Additional Resources from DEPA-MERL
Advancing the Use of Developmental Evaluation- A summary of key questions answered during a multiyear study of developmental evaluations implemented at USAID
A Practical Guide for Evaluators and Administrators - Evidence-based, step-by-step guidance and templates for Developmental Evaluators and firms that manage Developmental Evaluations on how to successfully design and implement a DE.
A Practical Guide for Funders -Evidence-based, step-by-step guidance and templates for funders of Developmental Evaluations on how to successfully design and implement a DE.
Developmental Evaluation Case Study Series - This series of case studies gives examples of implemented DEs around the globe, both inside and outside DEPA-MERL. Each case study provides background on the programming, the DE design and implementation approach, the suitability of DE, and lessons learned for implementation.
Boresha Afya (USAID) - USAID supports the government of Tanzania to strengthen integrated health services through the Boresha Afya program. This DE, conducted between 2017 and 2021, helps USAID generate real-time evidence and support adaptive management practices to improve the quality, efficiency, utilization, and scalability of integrated health services in Tanzania.
Jilinde (Gates Foundation) - Jilinde’s learning laboratory approach integrates DE at multiple levels to help partners scale up and retain a pre-exposure prophylaxis (PrEP) service with its most vulnerable clients. The DE identifies enablers and challenges throughout its 5-year implementation (2017-2022).
CMP (U.S. Department of State) - Beginning in 2015, this DE provides ongoing learning for the project, which uses memory to support peacebuilding and reconciliation in post-war Sri Lankan communities.
Jalin (USAID) - Between 2018 and 2022, this DE supports Indonesia’s Ministry of Health and DAI Global in their efforts to reduce maternal and neonatal mortality from preventable death through co-created, local solutions.
FCF (DEPA-MERL) - From 2016 to 2018, this DE improved coordination between stakeholders from nearly 50 organizations as they implemented a collective impact model to increase the number of children in Cambodia living in safe, nurturing family-based care.
Uptake (DEPA-MERL) - In 2017 and 2018, this DE brought together diverse partners to catalyze the next generation of breakthrough innovations to advance USAID’s mission to support partner countries on their journey to self-reliance
- Tools: Embedded evaluators, emerging needs tailoring, network mapping, outcome mapping, contribution analysis
- Funding mechanism: Contract (buy-in option for USAID operating units)
- Partners: Social Impact (prime), Search for Common Ground, The William Davidson Institute at the University of Michigan
- Period of Performance: 10/01/2015 – 9/30/2024