Developing evaluation capacity: a conversation with the head of Global Evaluation Initiative

Developing evaluation capacity: a conversation with the head of World Bank's Global Evaluation Initiative

It seems straightforward: producing and using high-quality development evidence requires evaluators and policymakers to have the capacity to do so. However, getting there is not always so simple. When funding decisions are made and evaluation programs assembled, capacity strengthening efforts often take a back seat to other priorities.

A broad and diverse coalition of governments, international, national and local development organizations, and M&E experts, the Global Evaluation Initiative (GEI) launched last year with a mandate to change this status quo—and 3ie is one of the initiative's partners in implementing its capacity development agenda. The GEI aims to support country-level M&E frameworks, build sustainable evaluation capacity, reduce fragmentation in capacity development services, and produce global public goods. Country ownership of evaluation frameworks is a key part of GEI's vision.

3ie Executive Director Marie Gaarder recently joined GEI Program Manager Dugan Fraser on an episode of the initiative's Stronger Together podcast to discuss ways to develop evaluation capacity around the world.

"If we want to influence policy, [an evaluation] needs to be relevant, it needs to be good-quality and contextualized, it needs to be demanded, it needs to be understood, its insights appreciated, it needs to be used, and it needs to not be misused," Gaarder said. "And so, you need to really work on building the capacity all through this chain."

Even in the pandemic, 3ie has been busy with training and capacity-strengthening activities for that whole range of evidence producers and users, Gaarder said. She cited training events with the African Population and Health Research Center, the University of Zambia, and Columbia's National Planning Department. Still, those efforts are only part of the battle, Gaarder said.

Gaarder said training is probably the easy part "Linking the people, who have been trained, with hands-on real work and real-world experience is harder… For a training to really stick, the trainees must be able to get experience doing the work," she added.

The sticking point often arrives in discussions of budgets and timelines, according to her.

"We find it hard to find funding for the types of studies which incorporate a teaching component," Gaarder said. "Funders offer us this impossible task, right? They want short timelines, they often put insufficient resources for the task, and they do want [evaluation capacity development] built in, and they want it at no risk."

Although the COVID-19 pandemic has created countless challenges, it has actually made some capacity-strengthening efforts easier because of how it normalized the use of virtual communication tools, Gaarder said.

"The virtual world has allowed us to bring capacity development home to people in a very different way," she said.
Gaarder lauded the GEI's mission to serve a coordinating role for the different organizations around the world working on building evaluation capacity. GEI can help make sure efforts are not duplicated and each organization's unique skillsets are most efficiently deployed.

"It's really great to see much more collaboration between international partners, working together to share resources or contribute to common goals," Gaarder said. "This goes a long way towards things like harmonizing standards."

As an example, she mentioned the costing community of practice, in which 3ie is working on developing guidelines and resources for incorporating cost evidence into economic evaluations. That collaboration also includes J-PAL, IPA, CEGA, and DIME.

In closing, Fraser asked Gaarder about her vision of success for the GEI.

"The GEI will be successful if we see a significant increase in the depth of use of evidence to inform policy and programs in participating countries, and an increasing amount of quality evaluations being demanded and led locally," Gaarder said.

For more on developing evaluation capacity, the full video of Gaarder’s and Fraser's discussion is available here.

Comments

We wish to introduce our TRUST’s brief statement thus: Interwaste R&D (EA) Trust is a
nonprofit registered in Kenya, and focused in Africa and also UNEP/UNCCD accredited and
member/ partner of CTCN and Sustainable Building and Construction of One Planet Network,
ClimateWork Foundation etc. As principal catalyst partner, we are looking for strategic and
specialized partners, investors, and technical assistance for implementation services of our
initiatives in Africa, through value addition and use of advanced technologies currently
available, while inspiring circular economy solutions from around the Globe.
Our concerns are environmental challenges caused by urban solid waste , wastewater, WASH,
agriculture/irrigation, DEFORESTATION, AFFORESTATION, cities underground infrastructures
(water, sewer lines etc ) assessment, and chemical and hazardous wastes sectors in Africa and
others like;
 Desertification, land degradation and drought (DLDD)
 Integrated water management, Agro-forestry
 Soil conservation
 Rangeland management
 Ecological monitoring and early warning systems
 New and renewable energy sources and technologies
 Sustainable agricultural farming systems
 Climate Change
 World Circular Economy Innovations/Solutions
And look forward to planet pollution free. We target waste to energy schemes, urban waste,
wastewater engineering, land filling engineering, landfill gas, dump sites rehabilitation; with
development of mechanism for reduction of GHG Emissions developing countries; anaerobic
digestion and Bioelectrochemical systems, education, research & development and training
young men and women in these sectors in Africa. We need support from countries,
companies and experts with environmental success stories and other infrastructure
development projects (including real estate) as committed relevant Organizations. We need to
establish a partners consortium –working together to accelerate climate action, planning,
budgeting in Africa/East Africa.
Thank you.
Kind regards
John Gakunga
Founder and Managing Trustee
Interwaste R&D (EA) Trust
Cellphone: +254 720549340
Corporate email: jwgakunga@interwaste-ea.co.ke
Personal email: jwgakunga@gmail.com
Website: https://www.interwaste-ea.co.ke

Marie is absolutely right in stressing the importance of demand for evaluations in order to promote the culture of meaningful impact evaluations of public interventions. Indeed, in my view, it's a MUST. I said so in a piece, entitled "Evaluation of Governance: A Study of the Government of India's Outcome Budget" that appeared in the December 2010 issue of the Journal of Development Effectiveness. I see some progress, but I am not happy with it. Much more needs to be done.
I wish the GEI all the best.
Anand P Gupta
Former Professor of Economics
Indian Institute of Management, Ahmedabad, India

Yes if we focus on trainings and the trainees have no hands on experience it's all a waste of time though some cases people are trained and still they cannot deliver to the best expectations this takes us back to how the trainings are conducted, where, who attended, what basics we're used to consider them .

In SE Asia, we are offering training to researchers on how to improve impact evaluations, but we also need to train funders. Funding for research is limited in the region and often goes to studies that lack the rigor required to produce useful evidence. The funding agencies create the demand and they need to know what to ask for.
Tom Corcoran
SEAMEO STEM Education Centre

Add new comment

This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

Authors

Paul-Thissen Paul ThissenSenior Evaluation and Communication Specialist

About

Evidence Matters is 3ie’s blog. It primarily features contributions from staff and board members. Guest blogs are by invitation.

3ie publishes blogs in the form received from the authors. Any errors or omissions are the sole responsibility of the authors. Views expressed are their own and do not represent the opinions of 3ie, its board of commissioners or supporters.

Archives

Authors

Paul-Thissen Paul ThissenSenior Evaluation and Communication Specialist

About

Evidence Matters is 3ie’s blog. It primarily features contributions from staff and board members. Guest blogs are by invitation.

3ie publishes blogs in the form received from the authors. Any errors or omissions are the sole responsibility of the authors. Views expressed are their own and do not represent the opinions of 3ie, its board of commissioners or supporters.

Archives