Monitoring citizen science performance : methodological guidelines

This research paper aims to co-design a theoretical framework and methodological guidelines to monitor the performance, outcomes, and impact of Citizen Science projects. Hence, the proposed methodology com- bines the previous research efforts on the engagement of external stakeholders into a composite monitoring tool, which allows measuring and comparing CS project progress towards defined objectives. The develop- ment of methodology adopted a pragmatic mixed-method research design. Firstly, analysis of the theoretical sources and available monitoring tools provided the basis for a conceptual framework and identification of measurement indicators. The rationale of the conceptual framework was based on the co-creation workshop and stakeholders' interviews. In addition, the aggregation of indicators during the expert Focus group re- search resulted in a meaningful design of the composite CS Performance Index. The designed methodology is a part of the three-year Horizon 2020 "Science with and for Society" project INCENTIVE (Grant Agreement No. 101005330) that brings on board four Research Performing and Funding Organizations: the University of Twente, the Autonomous University of Barcelona, the Aristotle University of Thessaloniki and the Vilnius Gedi- minas Technical University. Methodological guidelines set the structure for applying the monitoring in four national CS Hubs and support their coordination. In particular, the values of the indicators could be compared with the targets set, with the respective values of other Citizen Science Hubs, or to worldwide trends.