Tag Archive for: evaluation arts projects

Seven Signs Your Project Needs an External Evaluator

Seven signs your project would benefit from external evaluation

 

You don’t always need an external evaluator. Sometimes a clear internal framework, a few well-designed tools and protected time for reflection are enough.

But there are points when evaluation becomes difficult to hold alongside delivery. The project may have grown more complex, several partners may need a shared view, or the findings may now carry real weight with funders, boards and future decision-makers.

At that point, external evaluation is not simply about producing a report. It can bring structure to a complicated programme, protect the quality of the evidence and take some of the analytical burden away from a busy team.

Here are seven signs that outside support could be useful.

1. Your funder, board or partners need independent evidence

Internal monitoring can tell you a great deal, and delivery teams often hold vital knowledge about what is changing. But sometimes the people using the findings need a degree of independence too.

That may be because a funder expects an external view, a board will use the evidence to make a significant decision, or several partners need confidence that the findings do not reflect one organisation’s perspective alone.

An external evaluator can examine positive, negative and unexpected evidence, make limitations visible and distinguish what the project contributed from changes it cannot reasonably claim. Independence does not mean standing at a distance from the work. It means being close enough to understand it while retaining enough separation to test the story fairly.

2. The project has several strands, audiences or partners

Complex projects rarely arrive in one tidy shape. There may be different activities, places, audiences, delivery models and funding requirements. Partners may describe success differently or collect information in ways that do not easily fit together.

When that happens, the first value of evaluation is often clarity. An external evaluator can help the partnership agree the important questions, identify how the different strands connect and create a shared framework without flattening meaningful differences.

This is particularly useful in place-based, cultural, heritage, nature and community programmes, where outcomes develop through relationships and context as well as individual activities. The evaluator holds the overall picture while helping each partner understand their role within it.

3. You are collecting plenty of information but still cannot see the answer

Many organisations do not have a data shortage. They have attendance figures, spreadsheets, survey responses, case studies, meeting notes, photographs, analytics and informal feedback. What they lack is the time and structure to turn all of that into a clear judgement.

More collection will not necessarily solve that problem.

An evaluator can work backwards from what you genuinely need to know, assess what the existing evidence can answer and identify the important gaps. They can compare sources, look for patterns and differences, and test whether an appealing explanation is actually supported.

That process reduces noise. It helps teams move from ‘we have a lot of information’ to ‘we understand what this is telling us and what we need to do next.’

4. Evaluation keeps slipping behind delivery

This is extremely common. Delivery deadlines are immediate. Evaluation tasks feel as though they could happen next week, so next week becomes next month and important evidence is missed.

It is not usually because the team does not care. It is because the same people are managing activities, participants, partners, finances, communications and funder requirements. Evaluation becomes one more responsibility competing for attention.

External support creates ownership and rhythm. A good evaluator agrees responsibilities, introduces manageable tools, checks what is coming in and raises gaps while there is still time to respond. They do not expect delivery staff to become researchers. They create a process that fits around the work and keep hold of the parts that need specialist time.

This can bring a real sense of calm. Somebody is maintaining the framework, watching the evidence and keeping the final questions in view, rather than leaving the whole evaluation in an unfinished loop in the team’s heads.

5. You need to understand change, not simply count activity

Outputs matter. You need to know how many people participated, what was delivered and whether the intended audiences were reached. But those figures do not tell you, on their own, what difference the work made.

If the important questions involve confidence, wellbeing, belonging, skills, behaviour, organisational practice, environmental action or community change, you need evidence that can explore outcomes as well as activity.

An evaluator can help establish realistic baselines or comparison points, choose appropriate qualitative and quantitative methods, and consider change across different groups. They can also investigate how and why outcomes developed, including the conditions that helped or hindered them.

That prevents the final evaluation becoming either a list of impressive numbers or a collection of positive stories. Both can be valuable, but neither is enough on its own.

6. The findings will shape future funding or important decisions

Evaluation becomes especially valuable when the organisation needs to decide what to continue, change, scale or stop.

Perhaps a pilot is approaching its next funding stage. A successful model could be expanded. A partnership needs to agree its future direction. Or the organisation wants to make a stronger case for investment without overstating what the current evidence proves.

An external evaluator can help identify which elements are doing the most useful work, where outcomes are strongest, what remains uncertain and what would need to be in place for the approach to work elsewhere.

The aim is not to make every project look successful. It is to give decision-makers a credible account of what has been learned. Honest findings are often more reassuring than a report in which everything appears to have gone perfectly, because they show that the organisation is paying attention and knows how to improve.

7. The final evaluation needs to withstand scrutiny

A clear, attractive report is important, but reassurance comes from what sits underneath it.

Can each conclusion be traced to evidence? Have different sources been compared? Are sample limitations explained? Have differences between groups been examined where they matter? Are recommendations proportionate to what the findings can genuinely support? Has someone challenged the emerging interpretation before it becomes the final story?

External evaluation can provide analytical discipline and quality assurance. It also helps translate a complicated body of evidence into conclusions that funders, boards, partners and delivery teams can all understand.

The simplicity clients see at the end should be the result of difficult thinking being handled well—not difficult questions being avoided.

What does an external evaluator actually take on?

The answer depends on the project. External support could include refining a theory of change, developing an evaluation framework and practical tools, training delivery teams, undertaking selected interviews or fieldwork, checking data quality, analysing existing evidence, facilitating learning sessions and producing an independent report.

The evaluator does not necessarily need to collect everything. Often the strongest arrangement is a partnership: the delivery team gathers routine information at natural points, while the evaluator focuses on design, deeper enquiry, analysis, challenge and interpretation.

A good evaluator will help you decide what is proportionate rather than adding methods for the sake of making the evaluation look substantial.

You may not need a finished brief to get started with evaluation. Organisations sometimes wait to approach an evaluator because they think they need to specify the entire methodology first. You do not.

It is useful to know what the project is trying to change, who needs the findings, what evidence already exists and when important decisions or reports are due. The evaluator can then help shape the questions and recommend a realistic route.

At The Evaluator, we specialise in holding complexity without passing it back to the client. We create robust evaluation underneath and a process that feels straightforward on the surface. Our role is to bring clarity, honest independent judgement and evidence that people can confidently use.

If several of these signs feel familiar, send us your project outline or an early version of your brief. We can help you work out whether external evaluation would add value—and what level of support would be genuinely useful.

Often we can design a detailed evaluation quote in a 20 minute scoping call, and we are happy to do those. Why not reach out on info@theevaluator.co.uk ?

 

Process evaluation

Process Evaluation

At The Evaluator, we specialise in process evaluations that provide organisations with a clear understanding of how their work is being delivered and where it can be optimised. Our approach focuses on uncovering what’s working well, identifying challenges, and refining processes to maximise effectiveness. By examining implementation, decision-making, and operational dynamics, we help organisations strengthen their approach in real-time rather than waiting until a project’s end. Our evaluations are designed to be practical and insightful, offering clear recommendations that enhance efficiency, improve delivery, and ensure resources are being used to their full potential.

What makes our process evaluations stand out is our commitment to making them both reflective and action-driven. We don’t just map out workflows—we identify opportunities for streamlining, innovation, and growth. We work closely with organisations to ensure that their processes are not only effective but also sustainable and scalable. By embedding evaluation within delivery, we enable teams to adapt quickly, build resilience, and drive continuous improvement. Our evaluations turn operational insights into strategic advantages, helping organisations refine their work, strengthen their impact, and deliver with even greater confidence.

We know that setting up new teams can be tricky at first, and have developed tools which not only evaluate projects, but also help you during the project itself. We offer the following, in larger projects, to keep you on track:

Monitoring support and tools

Monitoring your activity is essential because it ensures that your efforts are making an impact and that you’re using your resources effectively. Without a clear way to track progress, it’s easy to lose sight of what’s working well and where adjustments are needed. That’s why we provide monitoring spreadsheets that offer a quick, at-a-glance overview of key metrics, making it simple to see trends, spot challenges, and identify opportunities for growth. These tools help you stay focused, prioritise your time and energy, and make informed decisions based on real data. Whether it’s tracking outputs, engagement, or project milestones, our monitoring systems empower you to stay on course, adapt when needed, and ultimately achieve greater success.

Innovative process measurement

The Reflex Survey system designed by The Evaluator is a brilliantly simple yet highly effective way to track team progress in real-time. By implementing regular self-assessment measures, the programme team can quickly reflect on their work, providing a gut-reaction assessment rather than an over-analysed response. This allows for a more accurate and honest snapshot of how the project is evolving. The inclusion of the Forming, Storming, Norming, and Performing (FSNP) framework ensures that team dynamics and project challenges are recognised, allowing leadership to identify patterns, pinpoint challenges, and celebrate progress. By aligning these team insights with feedback from the board and steering group, the Reflex Survey ensures a balanced, multi-level perspective on the programme’s development.

One of the most powerful aspects of this system is its flexibility and responsiveness. Unlike traditional assessments that assume linear progress, the Reflex Survey acknowledges that teams may move back and forth between phases, adapting to new challenges as they arise. The data from the team’s assessments demonstrates this in action – here is an example “an initial dip in scores reflects the complexity of external challenges, while the sharp rise to ‘norming’ in January highlights the team’s resilience and adaptability.” This real-time insight allows for targeted support, proactive problem-solving, and a deeper understanding of team dynamics, making it an invaluable tool for monitoring project health and guiding strategic decisions.

 

 

Whether you’re just starting out or looking to strengthen an existing project, our process evaluation tools are designed to support you every step of the way. We bring clarity, insight, and momentum—helping your team stay aligned, adapt quickly, and deliver impact with confidence. If you’re ready to gain a deeper understanding of how your work is unfolding and how it can be even more effective, we’d love to talk. Get in touch with us today – info@theevaluator.co.uk or call 01756 532 538, to explore how we can tailor our approach to fit your needs and elevate your project from the inside out.

 

New client: We Invented the Weekend

The Evaluator is delighted to be working with a new client, We Invented the Weekend. You can see more about them on this link. 

We Invented the Weekend is ‘The festival of free time’ and we are looking forward to working together at this high profile and exciting event. The festival is taking place on Saturday 15 & Sunday 16 June and is happening at Media City and Salford Quays. There is an amazing line up including live music, family fun, wellness workshops and sports activities – all for free!

Thousands of people will be making their way there, and we’ll be on hand during the festival with a team of volunteers to understand their experiences. This will include audience profiles, demographic segmentation, economic impact, quality of experience and more. We will be providing a full festival evaluation.

Capturing impact in people’s own words

At The Evaluator we recognise the value of collecting qualitative information for our evaluations. We take pride in capturing the genuine impact our projects or organisations have on individuals through hearing about their experiences in their own words.

The questions we ask are often simple and open to encourage individuals to speak honestly and let their stories unfold naturally. We feel privileged to get to hear about the amazing feedback and stories from people, and we love to share these stories with our clients.

We would also like to share some genuine quotes with you, spoken by real people who have experienced the impact from some of our clients:

We have heard from volunteers

“I truly appreciate everything the team does throughout the year to keep things moving forward. Thank you for helping to make so many people feel empowered, and seeing all of the work being done leaves me feeling so much hope for the future. Thank you for shining a light on all that can be done to make live music more accessible and equitable!” – Volunteer

“That was the biggest opportunity I’ve been given and that changed my life” – Volunteer

“It is such a joy and has made a really positive impact on my life. It has even changed the direction of my career” – Volunteer

 

We have also heard from participants

 

“For my general health I consider [client] more important than the NHS” – Participant of a wellbeing service

“[Client] has just been a godsend for me. Absolute Godsend” – Participant of a wellbeing service

“I really enjoyed the course as I love art and it also gave me a push to get out of the home and socialise more thus contributing to my wellbeing. Thank you”  – Participant of an Arts project

Thank you for the opportunity. Since starting with [project] I’m growing in self confidence and feel like I’m getting my life in order again. I’m putting plans in place and I’m more optimistic for my future.” – Participant of an Arts project

 

If you’re interested in learning more about our evaluation processes or exploring how we can help your organisation measure its impact, don’t hesitate to reach out. We’d love to chat!

Cheers to a Festive Break: Wrapping Up a Year of Amazing Projects!

As the year draws to a close, we reflect on how grateful we are to work with such outstanding clients, providing evaluation and data analysis services throughout the year. It has been our pleasure to have been involved in some of the world-changing positive projects our clients have been working on.

In the spirit of the festive season, the Evaluator team will be taking a break to refresh and recharge during Christmas. Therefore, we would like to inform you that our office will be closed for the holiday period starting from the 22nd of December and will resume operations on the 8th of January.

We appreciate your understanding, and we assure you that we will return in the new year fully revitalised and ready to continue delivering our exceptional service.

 

Below are some of the clients we’ve had the pleasure of working with this year:

 

Wishing you a Merry Christmas and a Happy New Year!

New client: Community Arts by ZK

The Evaluator is delighted to be working on a new project, Healing Arts for All (HAFA) from Community Arts by ZK.

This project is place focused and based in Pendle, on our doorstep!

HAFA describes itself as a “3-year people powered art and heritage project”, funded jointly by the National Lottery Heritage Fund and the Paul Hamlyn Foundation.  The project will include participants working with professional artists as well as gaining an understanding of working within heritage.  Heritage will focus on understanding the history and impact of Pendle’s Brierfield Mill, an iconic grade II listed former cotton mill built in 1931.  This mill originally attracted the South Asian community to move to the area to work in the textile industry.

You can see more about  Community Arts by ZK on their website here. 

We are particularly looking forward to evaluating the personal impact that this project, blending creativity and heritage, has on the participants from the South Asian community.

 

New client: The Bureau for the Arts, Blackburn

The Evaluator is delighted to be starting a new evaluation; Chip In. Isn’t that a great name? Northern, does what it says, and everyone loves chips!

Helping people, building community, changing lives!

Chip In is a place- based project which aims to engage and mentor young people aged 16-30 in volunteer opportunities across Blackburn with Darwen’s arts, culture, sport, heritage and environment sectors over the next two years. The Project aims to break down barriers which young people face in volunteering, bring together opportunities and build skills, confidence and community.

The Bureau Centre for the Arts is among over 160 organisations across arts, culture, sport, civil society, youth, and heritage sectors to benefit from the £4.6 million Volunteering Futures Fund.

Chip In (formerly Volunteering Now) is our two year volunteer partnership programme for young people aged 16-30. We have teamed up with a range of local partners in the borough to provide opportunities for volunteering in a range of areas such as events, music, project development, admin, exhibition invigilation, workshop support, stewarding, curation, collection handling, supporting youth sessions, social media and blogging, food growing and much more!

You can see more about the project here or read more about Volunteering Futures here. 

Learning about data; Working with qualitative data

From time to time, we share a director’s blog post, where we share some learning about how to use your data (information) better. This is a post all about how to use qualitative data, that’s the information that is made up of words rather than numbers.

The chances are that your organisation already has a bank of this data but it may not be well organised and easily accessible. Below is a list of some of the many ways you might have collected qualitative data, possibly without realising it.

How credible is your qualitative data?

There is a distinction between primary and secondary data and it’s important to understand what you have collected as the credibility differs between the two.  Primary data is more credible and robust.  It is the data that people told you or have written themselves.  Secondary data is that which is overheard in discussion or something that someone has heard and told you about.

To check the credibility of your secondary data, you can apply the Rule of 3. If you’ve heard it from 3 different places or if it’s come from 3 different people independently then it can be considered as credible and representative of a thought or opinion.

How to make the qualitative data more usable? 

We use word or phrase frequency analysis to evaluate our qualitative data to look for patterns of frequency of words to identify common themes.  This can be done online using free tools, like this one,  and they just count the words for you.  We often use the top 10 words or phrases.  You can also use the ratio of positive to negative words that are used or how far down the feedback the first negative word appears.  Using these methods helps to quantify data and make it more digestible and can be used in marketing or to track changes over time.

Mind maps can be useful to illustrate and develop on the themes identified. You can just draw these freehand to have a look at what the main themes are.

Word clouds provide a visual representation at a glance of the qualitative data and this is also a resource that can be sourced freely online.  The most common words appear the biggest in the cloud, making this data easier for the reader to understand visually.

Top tip – try to be objective, it can be hard to hear negative comments but it is how we improve and know what to fix, and they’re often in the minority compared to positive comments.

How to use and share qualitative data?

This data can be used in many different ways:

We also use qualitative data to create case studies which illustrate people’s journeys and direct engagement.  Case studies can be shared at board level and to show case your project’s work for marketing purposes.  Case studies appeal to a wide audience and are particularly useful in attracting funders as voices are recorded and reflected in these studies.

In our experience as evaluators, a case study from a project that we evaluated got shared with funders (Green Recovery) who sent it on to The National Lottery Heritage Fund who then sent it on to the Department of Work and Pensions.  Case studies are impactful in that they record real voices and can attract publicity and raise awareness of change.

 

If all of this sounds like too much work and you don’t have time, get in touch. We are happy to have a chat about your individual requirements and to see how we could help.

New Evaluation: Green Loop

The Evaluator is delighted to be working with a new client, Fylde Borough Council on their arts and environment project; Green Loop. Based around Lytham St Anne’s, Green Loop as a name was inspired by the idea of creatively re-using the waste products which wash up on the shore.

There are three parts to this project including a new Eco-Market taking place at Fairhaven Lake, running with eco-friendly makers and crafts people and curated by Hopeful & Glorious. It has been really nice to work with Heather from Hopeful & Glorious as we worked together many years ago when both of us were working in Arts Development in Lancashire. Hopeful & Glorious curate many high quality events, and you can see more about them on their website here. 

Environmental artist Nerissa Cargill Thompson, is both creating an artist commission and working with a group of volunteers to take part in a 12 week programme to learn how to become an environmental maker with a creative business. That’s a journey of discovery for sure! We will enjoy writing about that as creative business is one of our particular interests.

Nerissa describes her work as:

Exploring change over time, not just eroding or decaying but new layers of growth, giving juxtapositions of structure and colour. Recent mixed media sculptures combine embellished textiles and cement cast in plastic packaging to highlight the legacy of disposables. Naturally inspired textures emphasise the way our waste becomes subsumed into the natural world around us.

Images of recent works can be seen on her website here. 

This project is run by Fylde Borough Council whose website is here, and the project is funded by Arts Council England.