I head off tomorrow for a few weeks of meetings and research in Kenya. I’ll join my collaborators, Lily Tsai and Dan Posner, and our project manager, Jessica Grody to continue our work trying to understand the impact of the Uwezo initiative. We’ll get started in Nairobi, and from there we’ll do some traveling around the country.
In our research so far, we have examined whether the direct provision of information to parents – specifically, their own children’s literacy and numeracy test results as well as information about what parents can do to be more active citizens – actually leads them to higher levels of local involvement in education. Like many other scholars, we are trying to understand if and when the provision of information leads to greater government accountability in terms of the delivery of key services.
For good reason, a great deal of impact evaluation research these days is being carried out using experimental methods. And if the definition of an experiment requires that the analyst randomly assign treatment to subjects, then technically speaking, ours was not an experiment. But fortunately, Uwezo had decided for various reasons to carry out this portion of their initiative to a random sample of villages around the country. Thus, one could not make the claim that there was something systematically distinctive about the villages that received the intervention. In order to estimate the effects of these informational “bundles” we required a control group. So prior to beginning our study, we identified a set of villages that were highly similar to the ones that had been randomly selected by Uwezo. Then we conducted surveys, focus groups, and other research in both sets of villages. We will complete a draft of a scholarly paper on this study fairly soon, and we will be presenting our results at the late August meetings of the American Political Science Association.
As for our estimates of the effect of those “information bundles”…. Well, we didn’t find any substantial impact. But in fairness, we didn’t hold particularly high expectations for an effect. It was important to see if this aspect of the initiative could drive desired outcomes on its own. It can’t. And now, we will investigate whether some of the much larger information dissemination campaigns make a difference.
On this trip we won’t be carrying out any systematic research – just learning about what Uwezo has been doing and what they plan to do going forward. Hopefully, we will finalize some interesting proposals for research in the coming years.
