Monitoring and Evaluation in Health and Social Development Interpretive and Ethnographic Perspectives

New approaches are needed to monitor and evaluate health and social development. Existing strategies tend to require expensive, time-consuming analytical procedures. The growing emphasis on results-based programming has resulted in evaluation being conducted in order to demonstrate accountability and success, rather than how change takes place, what works and why. The tendency to monitor and evaluate using log frames and their variants closes policy makers’ and practitioners’ eyes to the sometimes unanticipated means by which change takes place.Two recent developments hold the potential to transcend these difficulties and to lead to important changes in the way in which the effects of health and social development programming are understood. First, there is growing interest in ways of monitoring programmes and assessing impact that are more grounded in the realities of practice than many of the ‘results-based’ methods currently utilised. Second, there are calls for the greater use of interpretive and ethnographic methods in programme design, monitoring and evaluation.Responding to these concerns, this book illustrates the potential of interpretative methods to aid understanding and make a difference in real people’s lives. Through a focus on individual and community perspectives, and locally-grounded explanations, the methods explored in this book offer a potentially richer way of assessing the relationships between intent, action and change in health and social development in Africa, Asia, Europe and the Americas.

1. Interpretive and Ethnographic Perspectives – Alternative Approaches to Monitoring and Evaluation Practice Stephen A. Bell and Peter Aggleton Part 1: The Present Challenge 2.The Political Economy of Evidence: Personal Reflections on the Value of the Interpretive Tradition and its Methods Angela Kelly-Hanku 3. Measurement, Modification and Transferability: Evidential Challenges in the Evaluation of Complex Interventions Helen Lambert 4. What Really Works? Understanding the Role of ‘Local Knowledges’ in the Monitoring and Evaluation of a Maternal, Newborn and Child Health Project in Kenya Elsabédu Plessis and Robert Lorway PART 2: Programme Design 5. Permissions, Vacations and Periods of Self-regulation: Using Consumer Insight to Improve HIV Treatment Adherence in Four Central American Countries Kim Longfield, Isolda Fortin, Jennifer Wheeler and Dana Sievers 6. Generating Local Knowledge:A Role for Ethnography in Evidence-based Programme Design for Social Development Ruth Edmonds7. Interpretation, Context and Time: An Ethnographically Inspired Approach to Strategy Development for Tuberculosis Control in Odisha, India Jens Seeberg and Tushar K. Ray 8.Designing Health and Leadership Programmes for Young Vulnerable Women Using Participatory Ethnographic Research in Freetown, Sierra Leone Naana Otoo-Oyortey, Elizabeth King and Kate Norman Part 3: Monitoring Processes9. Using Social Mapping Techniques to Guide Programme Redesign in the Tingim Laip HIV Prevention and Care Project in Papua New Guinea Lou McCallum, Jennifer Miller, Scott Berry and Christopher Hersey 10. Pathways to Impact: New Approaches to Monitoring and Improving Volunteering for Sustainable Environmental Management Jody Aked 11.Ethnographic Process Evaluation:A Case Study of an HIV Prevention Programme with Injecting Drug Users in the USA Yan Alicia Hong, Shannon G. Mitchell, James Peterson, Carl Latkin and Karin Tobin 12. Using the Reality Check Approach to Shape Quantitative Findings: Experience from Mixed Method Evaluations in Ghana and Nepal Dee JuppPart 4: Understanding Impact and Change 13. Innovation in Evaluation: Using SenseMaker to Assess the Inclusion of Smallholder Farmers in Modern Markets Irene Guijt 14. The Use of the Rapid PEER Approach for the Evaluation of Sexual and Reproductive Health Programmes Eleanor Brown, Rachel Grellier and Kirstan Hawkins 15. Using Interpretive Research to Make Quantitative Evaluation More Effective: Oxfam's Experience in Pakistan and Zimbabwe Martin Walsh 16. Can Qualitative Research Rigorously Evaluate Programme Impact? Evidence from a Randomised Controlled Trial of an Adolescent Sexual Health Programme in Tanzania Mary Louisa Plummer

Stephen Bell is a senior research fellow at the Kirby Institute, UNSW Australia, where he undertakes qualitative and ethnographic sexual health research with young people and other marginalised populations in rural and remote settings. His current interests involve examining how youth-led design of culturally and socially attuned sexual health programmes might evolve from, and be centred on, young people’s own everyday strategies of sexual health risk assessment and harm reduction. Peter Aggleton is Scientia Professor in Education and Health in the Centre for Social Research in Health at UNSW Australia, where he is also Director of the Arts and Social Sciences Practical Justice Initiative. He has worked internationally in health and development for over 30 years, with a focus on health education and health promotion. He is an adjunct professor in the Australian Research Centre in Sex, Health and Society at La Trobe University, Australia, and holds visiting professorial positions at the UCL Institute of Education in London, UK,and at the University of Sussex, UK. Alongside his academic work, Peter has served as a senior adviser to numerous international agencies including UNAIDS, UNESCO, UNICEF and WHO.