Evaluation of public policy advocacy: challenges, principles and BEST-AC case study

Purpose – The purpose of this paper is to demonstrate that both the processes and outcomes of advocacy can be evaluated in ways that can help with learning and accountability. The paper reviews the literature on evaluating advocacy, with a particular focus on development work, and describes an example of the systematic evaluation of the Business Environment Strengthening in Tanzania-Advocacy Component business advocacy programme in Tanzania. Design/methodology/approach – The evaluation uses a Scientific Realist methodology to give a disaggregated, contextual analysis of advocacy, asking the typically Scientific Realist question: “What works for whom in what circumstances?” Complementary methods are being applied longitudinally over a five-year period and include stakeholder interviews, business surveys, diagnostic tools and learning seminars. Findings – The paper argues that advocacy evaluation is no more complex or difficult than other aspects of development. Rigorous, cost-effective methods can be developed, so long as clear conceptualisation is carried out as an initial step. Systematic analysis of influencing tactics and capacity building demonstrates the relative skill of the advocacy organisations and allows the funder to see intermediate indicators of progress which are otherwise invisible. Practical implications – Consistent conceptualisation and measurement allow comparison over time, and between different types of projects and organisations. Integrating methods with the operation of campaigns or programmes allows the evaluator to give feedback in real time and minimise the burden on evaluands. Originality/value – The paper is based on original research/evaluation. The field is heavily concentrated on social change. The paper makes a contribution by providing an example of advocacy evaluation in the field of business advocacy and economic development. In addition, the example extends the field of advocacy evaluation by considering the systematic evaluation of a whole programme of individual advocacy projects.