What we offer
At the core of our work, impact evaluations are rigorous studies that measure the effects of international development programmes. We focus on conducting impact evaluations on policy-relevant research questions where credible findings can drive decision-making.

3ie invented evidence gap maps, which provide a visual overview of existing and ongoing studies or reviews in a sector or sub-sector of international development. These maps help policymakers find the most relevant evidence for a given question, thereby improving decision-making.

Our synthesis products, including systematic reviews, integrate findings from multiple different studies which address a common research question. Because they look systematically across the evidence base to see what works and why, systematic reviews and other synthesis products are more reliable for decision-making than results from a single study used in an ad hoc way.

Often, policy decisions must be made quickly. To make sure that decision-makers get the evidence they need when they need it, 3ie has developed a set of helpdesk services and rapid evidence products. Our Rapid Response Briefs and Rapid Evidence Assessments draw from the latest high-quality research to answer policy questions in a fraction of the time of traditional evaluations or systematic reviews.

We work with governments and other organizations to build their capacities in evaluation and evidence-informed decision-making. In addition to providing trainings on a wide range of evaluation methods, we offer ongoing support services to ensure our partners have access to the most up-to-date evidence and evaluation tools.

3ie specialises in increasing access to, demand for and use of evidence by governments, parliaments, programme managers, civil society, programme participants and the media. We do this by emphasising the value of planning and engaging with stakeholders to ensure that evaluations and reviews are relevant and useful. We use robust and effective monitoring to measure evidence use so that we can convey evidence impact on programmes and policies with greater confidence.

Since 3ie was founded, transparency, reproducibility, and ethics (TRE) have been core considerations in our work. We have developed and refined tools and best practices to ensure our studies apply technically rigorous methodologies, transparently share design and analysis decisions, yield computationally reproducible analysis, and incorporate foundational principles of research ethics into design, implementation, and dissemination. 3ie’s Transparency, Reproducibility, and Ethics (TRE) Policy articulates this commitment to TRE best practices.
Evidence hub
3ie’s Development Evidence Portal is the largest-of-its-kind repository of rigorous evidence on what works in international development. This portal includes evaluations and synthesis of studies conducted in low-and middle-income countries. It combines records from 3ie’s Impact Evaluation and Systematic Review repositories, as well as, evidence gap maps.

These provide a visual display of completed and ongoing systematic reviews and impact evaluations in a sector or sub-sector, structured around a framework of interventions and outcomes.

Evidence impact summaries briefly describe how 3ie-supported evidence has informed and influenced decision makers. Each summary highlights verified instances of evidence impact.

We provide funding for replications, conduct in-house replication research and publish guidance on replication methodology. We also provide funding to original authors of 3ie-funded for preparing their raw datasets.

As part of our mandate as a knowledge producer and translator for our main audiences, we publish a range of knowledge products. These include briefs, impact evaluation reports, systematic review reports and summaries, replication papers, evidence gap map reports, scoping reports and working papers.

3ie’s Registry for International Development Impact Evaluations (RIDIE) aims to enhance the transparency and quality of impact evaluation research before it begins.
Our work
- Working with goverments
3ie’s evidence programmes support studies to fill critical knowledge gaps in a sector, sub-sector or in an area with limited rigorous evidence. We fund studies under a specific theme or which address a particular question or set of questions in programme areas where our donors want to expand global public knowledge of what works and what does not.

Improving adolescent sexual and reproductive health requires decision-makers to have evidence on what works or not, for whom and why, particularly in low- and middle-income countries (L&MIC).

Despite the availability of agricultural technologies, few smallholder farmers in developing economies adopt new inputs and practices. One of the factors preventing this is the lack of effective knowledge dissemination.

Agriculture is a major source of sustenance for rural populations in low- and middle income countries. But owing to weather, pests, diseases and price fluctuations, farmers face numerous risks, including crop and livestock losses.

The production and consumption of fish, a nutritious source of food for around one billion people, is rising globally. The bulk of aquaculture still originates from small-scale farming in developing countries, such as Bangladesh.

According to the United Nations estimates, 103 million youth worldwide lack basic literacy skills, and more than 60 per cent of them are women.

3ie, funded by the Bill & Melinda Gates Foundation, is supporting studies and other work on HIV combination prevention to maximize the useful knowledge and policy implications from these interventions.

To gain a better understanding of whether providing HIV self-tests to people would increase HIV testing rates, and who might benefit most from availability of tests, 3ie funded seven pilot interventions and their impact evaluations in Kenya, Uganda and Zambia.

The Saamuhika Shakti or Collective Impact initiative aims to improve the lives of waste pickers in Bengaluru, in India’s southern state of Karnataka, through a coordinated multi-sectoral approach.

We are supporting the generation of rigorous evidence in humanitarian contexts on interventions related to water, sanitation and hygiene, food security, multi-sectoral humanitarian programming and interventions targeting malnutrition.

In alignment with our mission, 3ie promotes rigorous, efficient, and ethical use of innovative data sources for impact evaluations, including in those conducted by 3ie, by 3ie research partners, and in the global development community more broadly.

A major challenge in the fight against vaccine-preventable deaths and diseases is the limited evidence available on innovative and successful community-based approaches for expanding immunization coverage in countries with low or stagnating vaccination rates.

Much of the evidence surrounding the integration of HIV services with maternal, neonatal, and child health services, as well as with sexual and reproductive health and family planning services, does not come from rigorous studies.

3ie, the World Health Organization and the Partnership for Maternal Newborn & Child Health worked together to create a gap map to assess the evidence available on social, behavioural and community engagement interventions related to reproductive, maternal, newborn and child health programs in low and middle-income countries.

Everyone needs reliable access to a sufficient quantity of affordable, nutritious food. However, all too often, this need is not fulfilled. Despite best efforts, significant gaps persist between global nutrition targets and actual achievements.

Fragility has expensive, long-term consequences and trying to build peace in situations of protracted conflicts is becoming the norm. In 2016, 1.8 billion people – nearly a quarter of the world's population – were living in situations of fragility. Social cohesion is widely considered important in building sustainable peace in fragile contexts.

Safe sanitation is a key determinant of many public health outcomes and ending open defecation is necessary in order to achieve safe sanitation. To this end, the Indian government has led a massive sanitation program, Swachh Bharat Abhiyan - Gramin, to improve latrine access and use.

Launched in 2011, the National Rural Livelihoods Mission (NRLM) aims to link the rural poor in India to sustainable livelihood opportunities and financial services.

We set up our Replication Programme to address the need for a freely available global public good that helps improve the quality and reliability of impact evaluation evidence used for development decision-making. Replication is the most established method of research validation in science, yet it has not been fully embraced by the research community or development donors, leading to this gap.

The natural resource governance sector is under-researched and programs in it are under-evaluated. 3ie supported seven impact evaluations to fill critical knowledge gaps on what works to improve governance in the extractives sector in low- and middle-income countries.

3ie, in partnership with the Water Supply and Sanitation Collaborative Council (WSSCC), developed this program to build the evidence base in L&MICs and to support global efforts towards increasing equitable access to and use of WASH services.

We support impact evaluations to build the evidence base on the effectiveness of interventions that reduce the risks faced by the poor through participation in public works and employment programmes.

India has one of the lowest female labor force participation rates in South Asia. Among rural women, less than 30 per cent are engaged in productive work, paid or unpaid.

It is widely recognized that preventive measures are crucial in tackling the HIV epidemic in Sub-Saharan Africa. Three randomized controlled trials and numerous observational studies have shown that male circumcision reduces HIV acquisition by approximately 60 per cent for men, suggesting that efforts to increase male circumcision can play a significant role in HIV prevention.

3ie champions the research transparency and reproducibility movement as a means of understanding and mitigating challenges to the credibility of social science research, while also working toward stronger integration of ethical principles into practice.

.

3ie, in partnership with the Philippines National Economic and Development Authority (NEDA) and Australia’s Department of Foreign Affairs and Trade, is implementing a multi-year Philippines Evidence Program (also known as Policy Window Philippines).

Working in collaboration with the Office of the Prime Minister, the primary aim is to improve developmental outcomes through evidence-informed decision making in Uganda. 3ie is currently supporting evaluation of government programmes around youth livelihood, family planning, public service delivery and local governance, and universal primary education.

3ie and the government of Benin are working on a a multi-year regional initiative that aims to promote the institutionalization of evaluation in government systems across eight countries in West Africa, including: Benin, Burkina Faso, Côte d’Ivoire, Guinea-Bissau, Mali, Niger, Senegal and Togo.
Funding
- Open opportunities
View our current funding opportunities for evaluations, systematic reviews and internal replication studies.

About 3ie evidence impact summaries

Read how 3ie verifies and classifies evidence impact

Highlights

Evidence impact

Evaluation findings reinforced the challenges of the Special Programme for Employment of Students (SPES) and prompted the Department of Labour and Employment (DOLE) to invite the research team to present findings and implications at the National Congress of Public Employment Service Offices, attended by the municipal officials who implement the SPES.

Factors that contributed to impact

3ie partnered with the National Economic and Development Authority to implement the Philippines Evidence Programme, under which departments such as DOLE commissioned evaluations based on their evidence needs. Thus, DOLE steered the SPES evaluation and engaged with researchers at Innovations for Poverty Action from the early stages.
Researchers invested in building capacity of researchers with the Institute of Labour Studies, a think tank within DOLE, helping the Institute of Labour Studies provide inputs in study design and facilitate implementation.
DOLE set up a technical working group for the evaluation, headed by Assistant Secretary Alex V Avila, which the research team was able to leverage for stakeholder dialogue on process and impact evaluation findings and implications.

Title: Impact evaluation of the Philippine Special Program for Employment of Students

Authors: Emily Beam, Leigh Linden, Stella Quimbo and Heather Richmond

Status : Completed February 2018

Increasing opportunities for youth employment in the Philippines

Context

The 2013 World Bank Development Report on jobs identified youth unemployment as a key barrier to growth amongst low- and middle-income countries. In the Philippines, approximately 17 per cent of youth 15 to 24 years old are unemployed and account for nearly half of the unemployed persons in the labour force. The challenge of finding work is particularly pronounced for individuals who do not graduate high school.

Since 1993, DOLE, through the SPES, has tried to increase high-school graduation rates and improve employability amongst graduating students. The SPES aims to link youth from low-income households – either enrolled in schools or out of school – to formal work opportunities at decent wages during their school breaks. The employers (public and private) are offered a 40 per cent wage subsidy. DOLE collaborates with the provincial and municipal Public Employment Service Offices (PESO) in implementing the programme.

In 2015, 3ie partnered with Innovations for Poverty Action to conduct a process and impact evaluation to assess the effectiveness of the SPES. The study measured how the SPES affected academic outcomes, youth employability measured by labour market perceptions, and employment and job-search efforts. Applicants randomly chosen to participate in the SPES formed the treatment group. The remainder, who were not invited to participate, formed the control group.

Evidence

Findings showed that although the SPES did not have an impact on education outcomes such as school enrolment, graduation and grades in the medium run, it did increase enrolment for men, who were at higher risk of dropping out of school.

In terms of employability, the SPES did not have an impact on life skills or self-esteem. Aside from answering phones and bookkeeping, the SPES did not improve relevant work skills amongst the participating youth. Although it did improve participants’ confidence about their work prospects after graduation, it did not affect their perception of earning improved wages.

The most promising impact of the programme was on employment outcomes. Participation in the SPES increased the likelihood of being employed (at the time of the study) with a private employer, local government unit or NGO, compared to the control group (70% increase). However, despite the positive impact on employment, the cost of the SPES to DOLE was high – approximately US$1,920 per job found.

Evidence impacts

Reinforced plans to improve SPES with evidence

Researchers presented the evaluation evidence at the 17th National PESO Congress in October 2017. More than 800 participants attended, including DOLE Regional Office SPES focal persons, the Bureau of Local Employment and senior DOLE officials as well as nationwide PESO managers and staff who implement SPES.

Evaluation findings reinforced DOLE’s view of recasting SPES as a work support programme and adding a life skills training component. Following amendments to the SPES law in 2016, DOLE increased the working days from 52 to 78 days and wage subsidy to employers to 60 per cent (from an earlier 40 per cent) in low income local government units so that SPES can better target poorer participants.

In recent years, DOLE refocussed SPES with added emphasis on improving youth employability. DOLE is also working towards increasing private sector participation for better on-the-job learning experience. According to the study, a majority of the current SPES participants are engaged in administrative tasks as part of their jobs at the local government units.

‘I think one good thing about the impact evaluation is really realising [the importance] of strengthening our monitoring and evaluation system, because that is where we are very weak within so many competing tasks at the bureau level and also at the regional level. So, that needs to be strengthened. We also see the value of having [other programmes] evaluated as well, as we have experienced in our SPES programme.’

Dr Dominique Rubia-Tutay

OIC-Assistant Secretary and Concurrent Director IV

Bureau of Local Employment, Department of Labor and Employment

Suggested citation

International Initiative for Impact Evaluation (3ie), 2020. Strengthening support for youth employment in the Philippines [online summary], Evidence Impact Summaries. New Delhi: 3ie.

The impact of a youth employment bridging program in the Philippines
Innovations for Poverty Action’s study summary on the intervention

Evidence impact summaries aim to demonstrate and encourage the use of evidence to inform programming and policymaking. These reflect the information available to 3ie at the time of posting. Since several factors influence policymaking, the summaries highlight contributions of evidence rather than endorsing a policy or decision or claiming that it can be attributed solely to evidence. If you have any suggestions or updates to improve this summary, please write to influence@3ieimpact.org

Last updated on 11th November 2020

Increasing opportunities for youth employment in the Philippines

Context

Evidence

Evidence impacts

Reinforced plans to improve SPES with evidence

Suggested citation

Related