Tag Archive for: evaluation arts projects

Process evaluation

Process Evaluation

At The Evaluator, we specialise in process evaluations that provide organisations with a clear understanding of how their work is being delivered and where it can be optimised. Our approach focuses on uncovering what’s working well, identifying challenges, and refining processes to maximise effectiveness. By examining implementation, decision-making, and operational dynamics, we help organisations strengthen their approach in real-time rather than waiting until a project’s end. Our evaluations are designed to be practical and insightful, offering clear recommendations that enhance efficiency, improve delivery, and ensure resources are being used to their full potential.

What makes our process evaluations stand out is our commitment to making them both reflective and action-driven. We don’t just map out workflows—we identify opportunities for streamlining, innovation, and growth. We work closely with organisations to ensure that their processes are not only effective but also sustainable and scalable. By embedding evaluation within delivery, we enable teams to adapt quickly, build resilience, and drive continuous improvement. Our evaluations turn operational insights into strategic advantages, helping organisations refine their work, strengthen their impact, and deliver with even greater confidence.

We know that setting up new teams can be tricky at first, and have developed tools which not only evaluate projects, but also help you during the project itself. We offer the following, in larger projects, to keep you on track:

Monitoring support and tools

Monitoring your activity is essential because it ensures that your efforts are making an impact and that you’re using your resources effectively. Without a clear way to track progress, it’s easy to lose sight of what’s working well and where adjustments are needed. That’s why we provide monitoring spreadsheets that offer a quick, at-a-glance overview of key metrics, making it simple to see trends, spot challenges, and identify opportunities for growth. These tools help you stay focused, prioritise your time and energy, and make informed decisions based on real data. Whether it’s tracking outputs, engagement, or project milestones, our monitoring systems empower you to stay on course, adapt when needed, and ultimately achieve greater success.

Innovative process measurement

The Reflex Survey system designed by The Evaluator is a brilliantly simple yet highly effective way to track team progress in real-time. By implementing regular self-assessment measures, the programme team can quickly reflect on their work, providing a gut-reaction assessment rather than an over-analysed response. This allows for a more accurate and honest snapshot of how the project is evolving. The inclusion of the Forming, Storming, Norming, and Performing (FSNP) framework ensures that team dynamics and project challenges are recognised, allowing leadership to identify patterns, pinpoint challenges, and celebrate progress. By aligning these team insights with feedback from the board and steering group, the Reflex Survey ensures a balanced, multi-level perspective on the programme’s development.

One of the most powerful aspects of this system is its flexibility and responsiveness. Unlike traditional assessments that assume linear progress, the Reflex Survey acknowledges that teams may move back and forth between phases, adapting to new challenges as they arise. The data from the team’s assessments demonstrates this in action – here is an example “an initial dip in scores reflects the complexity of external challenges, while the sharp rise to ‘norming’ in January highlights the team’s resilience and adaptability.” This real-time insight allows for targeted support, proactive problem-solving, and a deeper understanding of team dynamics, making it an invaluable tool for monitoring project health and guiding strategic decisions.

 

 

Whether you’re just starting out or looking to strengthen an existing project, our process evaluation tools are designed to support you every step of the way. We bring clarity, insight, and momentum—helping your team stay aligned, adapt quickly, and deliver impact with confidence. If you’re ready to gain a deeper understanding of how your work is unfolding and how it can be even more effective, we’d love to talk. Get in touch with us today – info@theevaluator.co.uk or call 01756 532 538, to explore how we can tailor our approach to fit your needs and elevate your project from the inside out.

 

New client: We Invented the Weekend

The Evaluator is delighted to be working with a new client, We Invented the Weekend. You can see more about them on this link. 

We Invented the Weekend is ‘The festival of free time’ and we are looking forward to working together at this high profile and exciting event. The festival is taking place on Saturday 15 & Sunday 16 June and is happening at Media City and Salford Quays. There is an amazing line up including live music, family fun, wellness workshops and sports activities – all for free!

Thousands of people will be making their way there, and we’ll be on hand during the festival with a team of volunteers to understand their experiences. This will include audience profiles, demographic segmentation, economic impact, quality of experience and more. We will be providing a full festival evaluation.

Capturing impact in people’s own words

At The Evaluator we recognise the value of collecting qualitative information for our evaluations. We take pride in capturing the genuine impact our projects or organisations have on individuals through hearing about their experiences in their own words.

The questions we ask are often simple and open to encourage individuals to speak honestly and let their stories unfold naturally. We feel privileged to get to hear about the amazing feedback and stories from people, and we love to share these stories with our clients.

We would also like to share some genuine quotes with you, spoken by real people who have experienced the impact from some of our clients:

We have heard from volunteers

“I truly appreciate everything the team does throughout the year to keep things moving forward. Thank you for helping to make so many people feel empowered, and seeing all of the work being done leaves me feeling so much hope for the future. Thank you for shining a light on all that can be done to make live music more accessible and equitable!” – Volunteer

“That was the biggest opportunity I’ve been given and that changed my life” – Volunteer

“It is such a joy and has made a really positive impact on my life. It has even changed the direction of my career” – Volunteer

 

We have also heard from participants

 

“For my general health I consider [client] more important than the NHS” – Participant of a wellbeing service

“[Client] has just been a godsend for me. Absolute Godsend” – Participant of a wellbeing service

“I really enjoyed the course as I love art and it also gave me a push to get out of the home and socialise more thus contributing to my wellbeing. Thank you”  – Participant of an Arts project

Thank you for the opportunity. Since starting with [project] I’m growing in self confidence and feel like I’m getting my life in order again. I’m putting plans in place and I’m more optimistic for my future.” – Participant of an Arts project

 

If you’re interested in learning more about our evaluation processes or exploring how we can help your organisation measure its impact, don’t hesitate to reach out. We’d love to chat!

Cheers to a Festive Break: Wrapping Up a Year of Amazing Projects!

As the year draws to a close, we reflect on how grateful we are to work with such outstanding clients, providing evaluation and data analysis services throughout the year. It has been our pleasure to have been involved in some of the world-changing positive projects our clients have been working on.

In the spirit of the festive season, the Evaluator team will be taking a break to refresh and recharge during Christmas. Therefore, we would like to inform you that our office will be closed for the holiday period starting from the 22nd of December and will resume operations on the 8th of January.

We appreciate your understanding, and we assure you that we will return in the new year fully revitalised and ready to continue delivering our exceptional service.

 

Below are some of the clients we’ve had the pleasure of working with this year:

 

Wishing you a Merry Christmas and a Happy New Year!

New client: Community Arts by ZK

The Evaluator is delighted to be working on a new project, Healing Arts for All (HAFA) from Community Arts by ZK.

This project is place focused and based in Pendle, on our doorstep!

HAFA describes itself as a “3-year people powered art and heritage project”, funded jointly by the National Lottery Heritage Fund and the Paul Hamlyn Foundation.  The project will include participants working with professional artists as well as gaining an understanding of working within heritage.  Heritage will focus on understanding the history and impact of Pendle’s Brierfield Mill, an iconic grade II listed former cotton mill built in 1931.  This mill originally attracted the South Asian community to move to the area to work in the textile industry.

You can see more about  Community Arts by ZK on their website here. 

We are particularly looking forward to evaluating the personal impact that this project, blending creativity and heritage, has on the participants from the South Asian community.

 

New client: The Bureau for the Arts, Blackburn

The Evaluator is delighted to be starting a new evaluation; Chip In. Isn’t that a great name? Northern, does what it says, and everyone loves chips!

Helping people, building community, changing lives!

Chip In is a place- based project which aims to engage and mentor young people aged 16-30 in volunteer opportunities across Blackburn with Darwen’s arts, culture, sport, heritage and environment sectors over the next two years. The Project aims to break down barriers which young people face in volunteering, bring together opportunities and build skills, confidence and community.

The Bureau Centre for the Arts is among over 160 organisations across arts, culture, sport, civil society, youth, and heritage sectors to benefit from the £4.6 million Volunteering Futures Fund.

Chip In (formerly Volunteering Now) is our two year volunteer partnership programme for young people aged 16-30. We have teamed up with a range of local partners in the borough to provide opportunities for volunteering in a range of areas such as events, music, project development, admin, exhibition invigilation, workshop support, stewarding, curation, collection handling, supporting youth sessions, social media and blogging, food growing and much more!

You can see more about the project here or read more about Volunteering Futures here. 

Learning about data; Working with qualitative data

From time to time, we share a director’s blog post, where we share some learning about how to use your data (information) better. This is a post all about how to use qualitative data, that’s the information that is made up of words rather than numbers.

The chances are that your organisation already has a bank of this data but it may not be well organised and easily accessible. Below is a list of some of the many ways you might have collected qualitative data, possibly without realising it.

How credible is your qualitative data?

There is a distinction between primary and secondary data and it’s important to understand what you have collected as the credibility differs between the two.  Primary data is more credible and robust.  It is the data that people told you or have written themselves.  Secondary data is that which is overheard in discussion or something that someone has heard and told you about.

To check the credibility of your secondary data, you can apply the Rule of 3. If you’ve heard it from 3 different places or if it’s come from 3 different people independently then it can be considered as credible and representative of a thought or opinion.

How to make the qualitative data more usable? 

We use word or phrase frequency analysis to evaluate our qualitative data to look for patterns of frequency of words to identify common themes.  This can be done online using free tools, like this one,  and they just count the words for you.  We often use the top 10 words or phrases.  You can also use the ratio of positive to negative words that are used or how far down the feedback the first negative word appears.  Using these methods helps to quantify data and make it more digestible and can be used in marketing or to track changes over time.

Mind maps can be useful to illustrate and develop on the themes identified. You can just draw these freehand to have a look at what the main themes are.

Word clouds provide a visual representation at a glance of the qualitative data and this is also a resource that can be sourced freely online.  The most common words appear the biggest in the cloud, making this data easier for the reader to understand visually.

Top tip – try to be objective, it can be hard to hear negative comments but it is how we improve and know what to fix, and they’re often in the minority compared to positive comments.

How to use and share qualitative data?

This data can be used in many different ways:

We also use qualitative data to create case studies which illustrate people’s journeys and direct engagement.  Case studies can be shared at board level and to show case your project’s work for marketing purposes.  Case studies appeal to a wide audience and are particularly useful in attracting funders as voices are recorded and reflected in these studies.

In our experience as evaluators, a case study from a project that we evaluated got shared with funders (Green Recovery) who sent it on to The National Lottery Heritage Fund who then sent it on to the Department of Work and Pensions.  Case studies are impactful in that they record real voices and can attract publicity and raise awareness of change.

 

If all of this sounds like too much work and you don’t have time, get in touch. We are happy to have a chat about your individual requirements and to see how we could help.

New Evaluation: Green Loop

The Evaluator is delighted to be working with a new client, Fylde Borough Council on their arts and environment project; Green Loop. Based around Lytham St Anne’s, Green Loop as a name was inspired by the idea of creatively re-using the waste products which wash up on the shore.

There are three parts to this project including a new Eco-Market taking place at Fairhaven Lake, running with eco-friendly makers and crafts people and curated by Hopeful & Glorious. It has been really nice to work with Heather from Hopeful & Glorious as we worked together many years ago when both of us were working in Arts Development in Lancashire. Hopeful & Glorious curate many high quality events, and you can see more about them on their website here. 

Environmental artist Nerissa Cargill Thompson, is both creating an artist commission and working with a group of volunteers to take part in a 12 week programme to learn how to become an environmental maker with a creative business. That’s a journey of discovery for sure! We will enjoy writing about that as creative business is one of our particular interests.

Nerissa describes her work as:

Exploring change over time, not just eroding or decaying but new layers of growth, giving juxtapositions of structure and colour. Recent mixed media sculptures combine embellished textiles and cement cast in plastic packaging to highlight the legacy of disposables. Naturally inspired textures emphasise the way our waste becomes subsumed into the natural world around us.

Images of recent works can be seen on her website here. 

This project is run by Fylde Borough Council whose website is here, and the project is funded by Arts Council England.

Client again Jazz North