The impact of India's JSY conditional cash transfer programme: a replication study

The impact of India's JSY conditional cash transfer programme: a replication study

3ie Replication Paper 6

Natalie Carvalho and Slawa Rokicki

In this study, Natalie Carvalho and Slawa Rokicki conduct an internal replication of the first impact evaluation of India’s Janani Suraksha Yojana (JSY) intervention, a large-scale conditional cash transfer programme designed to incentivise the use of formal birthing facilities. The original impact evaluation by Stephen S. Lim, Lalit Dandona, Joseph A. Hoisington, Spencer L. James, Margaret C. Hogan and Emmanuela Gakidou from 2010 showed positive effects of the programme across India. JSY is one of the largest programmes of its kind in the world. Given its scale, any study related to this conditional cash transfer programme is crucial to understanding the effectiveness of the programme in improving maternal and neonatal health outcomes and reducing existing inequities in access. Understanding the programme’s effectiveness is important for policymakers in India and is also relevant for other countries with low rates of institutional delivery and poor reproductive health outcomes.

Specifically focusing on the exact matching analysis, the replication study by Carvalho and Rokicki reexamines both the original study’s methodological approach and the robustness of the research to various model specifications. In the measurement and estimation analysis, the researchers check the original matching algorithm and explore state-level multi-level modeling to test the robustness of the original research. They also explore differences in JSY’s implementation, to see if these differences influenced the original research findings. 

The researchers find the original results robust to changes in model specifications and analysis. The study does find state-level differences in health coverage and mortality outcomes, which should be considered in future analyses of the programme. The researchers conclude that the effect of JSY on health outcomes may be understated when averaged over all states and districts, especially when accounting for the implementation lag across the country. 

3ie also invites formal replies from the original authors. If received, the reply will be posted on the 3ie website alongside the replication study.

Biometric Smartcards and payment disbursement: a replication study of a state capacity-building experiment in India

Biometric Smartcards and payment disbursement: a replication study of a state capacity-building experiment in India

Replication paper 3ie 2019
The National Rural Employment Guarantee Scheme and Social Security Pension are two of the largest employment programmes in Andhra Pradesh. Muralidharan and colleagues (2016) investigated the impacts of biometrically-authenticated payment infrastructure (Smartcards) on beneficiaries of the two employment programmes.

RPS22

Risk sharing and transaction costs: a replication study of evidence from Kenya’s mobile money revolution

Replication paper 3ie 2019
This replication study starts with the twin strategies of push-button and pure replications of the original study. It then followed this up with various consistency and robustness checks, such as propensity score matching and the Tobit model specification.

Cash and change: a replication study of a cash transfer experiment in Malawi

Cash and change: a replication study of a cash transfer experiment in Malawi

Replication paper 3ie 2019
Maira Reimão conducted a replication of a 2011 study, Cash or condition? Evidence from a cash transfer experiment, by Baird and colleagues, which is one of the few studies that empirically compares the impact of unconditional cash transfers to that of conditional cash transfers.

Impact of unconditional cash transfers: a replication study of the short-term effects in Kenya

Impact of unconditional cash transfers: a replication study of the short-term effects in Kenya

Replication paper 3ie 2019

Wang and colleagues replicate the results of a randomized evaluation carried out by Haushofer and Shapiro in 2016.

3ie Replication paper 18

Savings revisited: a replication study of a savings intervention in Malawi

Replication paper 3ie 2018

Jesper Stage and Tharshini Thangavelu replicate the results of a randomized evaluation carried out by Lasse Brune and colleagues in 2016 in Malawi.