Evaluation case study

Delivered in collaboration with Catherine Brys

Evaluation of specialist equality, diversity and inclusion (EDI) training

Client: National Library of Scotland (NLS)

Situation

The National Library of Scotland (NLS) was awarded funding from The National Lottery Heritage Innovation Fund for the Test phase of the Scottish heritage Workforce Challenge project to help diversify the heritage workforce in Scotland. 

Specialist Equality, Diversity and Inclusion (EDI) training and support was provided for managers and HR professionals to better recruit, support and retain marginalised workers and develop managerial confidence, attitude, awareness and skills. 

The specialist training was tailored to three cohorts: the Library Leadership Team (LLT), managers (including LLT) and HR professionals from NLS and other heritage organisations in Scotland. 

Challenge

Our evaluation had to assess the impact of the training on each cohort’s EDI knowledge, attitudes, confidence and readiness to engage with EDI issues using cohort-specific learning and development indicators.

Our work and approach

Our Hallmark of Inclusion methodology formed the basis for a structured evaluation framework. 

Quantitative and qualitative data was gathered via baseline and follow-up surveys and semi-structured interviews. Together with additional data sources, e.g. training uptake amongst cohorts, this allowed us to gain rich insights across the cohorts. 

Addressing the challenge

Given that the conversations were likely to be more emotional for people from target audience 1, they were offered the choice of a small-group session or an individual conversation with the facilitators. 

For all focus group sessions and conversations, we created a safe environment by:

• Setting ground rules and making agreements with participants about confidentiality during the sessions (including no sharing on social media). 
• Reassuring participants about anonymised reporting to the client. 
• Making space for all voices and prioritising access needs.
• Encouraging participants to engage in the way that best suited them, for example verbally, via the chat or anonymously via a whiteboard. 

Impact

Our evaluation led to recommendations for replicating the EDI training in other heritage organisations and for next steps in NLS on their EDI journey. 

Client quote

"Amanda and Catherine carried out an independent evaluation of specialist EDI (equality, diversity and inclusion) training delivered by the National Library of Scotland (NLS). The Library was awarded funding from The National Lottery Heritage Innovation Fund for this EDI project. The training was delivered to senior and line managers within NLS, and HR staff both within NLS and across the heritage sector.

Amanda and Catherine brought an in-depth understanding of this complex type of EDI work that aims to make a meaningful impact by increasing people’s EDI awareness, confidence and skills. They also have a proven understanding of EDI challenges in the heritage sector.

I found Amanda and Catherine easy to work with, supportive and well-organised. 

They used a structured evaluation framework based on the Hallmark of Inclusion methodology and their evaluation report was well-structured and impactful."

Ellie Muniandy | Equality, Diversity and Inclusion Officer 

National Library of Scotland