Description of evaluation process 

The Young Citizens Assembly on Pollinators is a pilot project, serving as a learning and support process for potential permanent youth engagement mechanism at the EU level. The exploration of modalities and conditions for such a mechanism requires an in-depth evaluation process that can identify best design elements and generate recommendations for future implementation. Recognizing the Assembly’s role as a testing ground motivated the development of an extensive evaluation approach.  

First, a responsive approach is adopted, offering continuous feedback and ongoing improvements. This allows for testing of alternative elements and adjustments already during the pilot. 

The evaluation is also an opportunity for testing and further elaboration of the evaluation framework developed by CC-DEMOS. The framework proposes a set of criteria and categories (see the image below) to orientate the evaluation process. Importantly, the framework does not prescribe normative standards against which the assessment should be carried out. Rather, it promotes a more reflexive and exploratory type of process – in this sense the responsive approach for the evaluation of the pilot process is a perfect case of application.  

Finally, to ensure a comprehensive assessment, the Assembly evaluation follows a triangulation approach, combining three complementary strands. The complementarity refers both to the scope of the different strands described below, and to the approaches they take.  

• External evaluation is carried out by an independent, unbiased contractor, who is not involved in the design or the implementation of the process. Following a strict methodology, including interviews, surveys, observations and desk research, this strand ensures an impartial assessment of the deliberative process. The key questions addressed cover the following aspects: 
  • Institutional and external stakeholders' expectations of the Assembly. 
  • The impact of digital and physical spaces on deliberations. 
  • The effectiveness of creative methods in facilitating discussions. 
  • Knowledge presentation strategies. 
  • Strategies for participant engagement and retention. 
  • Empowerment mechanisms for Assembly members. 
  • Barriers to participation and strategies to address them.
• Participant evaluation is embedded within the Assembly, allowing its members to influence the design and methods by suggesting improvements based on their collective insights and growing experience of the process. In practice, this strand is implemented as a form of co-creative ‘empowerment evaluation’ - Assembly members are invited to join the evaluation ‘task force’ supported by facilitators and experts. The task force concept aims to enhance participants’ autonomy and agency, ensuring they have a stronger sense of ownership over the process. The task force meets both in-person and online, focusing on: 
  • Assembly design, including methods, activities, facilitation and program. 
  • Knowledge curation and the learning strategy. 
  • Support needs of Assembly members to enable full participation. 
• Observer evaluation is caried out by a diverse group of individual observers, including thematic or methodological experts, stakeholders, representatives of civil society organisations, and staff from public bodies, including EU institutions. While the importance of such broad participation primarily contributes to ensure integrity and legitimacy of the process, it can also reveal new insights about the Assembly, complementing the information gathered through other components of the evaluation. To make the best use of the diversity of backgrounds, observers are encouraged to reflect on the process from their unique standpoint, drawing on their expertise and interests. Observers receive basic guidelines, including suggested evaluation questions and a reporting template ensuring consistency across reporting. Additionally, observers are required to follow a strict code of conduct to prevent interference and safeguard the process integrity.