Methods to measure the impact of eInclusion actors : exploratory study on methods used to measure the ICT-mediated social impact of grassroots

This report summarises the results of the research project 'Exploratory Study on Methods used to measure the ICT‐mediated Social Impact of Grassroots Organisations'. This study was commissioned by IPTS to feed into a forthcoming 2‐ year research project: Measuring the Impact of eInclusion Actors on Digital Literacy, Skills and Inclusion Goals (MIREIA). The report maps and reviews evaluation and impact assessment methods that have been developed and used to understand the social and economic impact of eInclusion actors, with a focus on quantitative approaches and production of measures that relate to policy goals. The first step was the compilation and preliminary profiling of a list of 81 examples of impact assessment approaches, identified through a literature and practice review. Following a process of evaluation, eleven approaches were documented and analysed in more depth. After that, the three 'most relevant' approaches were then selected for further analysis with particular reference to their feasibility as inputs to developing the MIREIA framework, and with reference to illustrative case studies of their use by grassroots organisations. Finally,this report includes additional analysis of case studies of the use of impact assessment methods in real‐world 'grassroots' interventions,based on the results of the validation workshop. The overall conclusion of the study is that the main purpose of the MIRIEA framework and indicators should be to support impact assessment as a 'process' - the process of creating the conditions to enable the embedding and implementation of concepts, methods, tools and practices, and their subsequent adaptation and evolution through use. In other words, the main purpose of the framework and tools is to support 'praxis'.