Tag Archive for: Festival evaluation

Seven Signs Your Project Needs an External Evaluator

29th August 2026/in Blog, News/by Kirsty Rose

Seven signs your project would benefit from external evaluation

You don’t always need an external evaluator. Sometimes a clear internal framework, a few well-designed tools and protected time for reflection are enough.

But there are points when evaluation becomes difficult to hold alongside delivery. The project may have grown more complex, several partners may need a shared view, or the findings may now carry real weight with funders, boards and future decision-makers.

At that point, external evaluation is not simply about producing a report. It can bring structure to a complicated programme, protect the quality of the evidence and take some of the analytical burden away from a busy team.

Here are seven signs that outside support could be useful.

1. Your funder, board or partners need independent evidence

Internal monitoring can tell you a great deal, and delivery teams often hold vital knowledge about what is changing. But sometimes the people using the findings need a degree of independence too.

That may be because a funder expects an external view, a board will use the evidence to make a significant decision, or several partners need confidence that the findings do not reflect one organisation’s perspective alone.

An external evaluator can examine positive, negative and unexpected evidence, make limitations visible and distinguish what the project contributed from changes it cannot reasonably claim. Independence does not mean standing at a distance from the work. It means being close enough to understand it while retaining enough separation to test the story fairly.

2. The project has several strands, audiences or partners

Complex projects rarely arrive in one tidy shape. There may be different activities, places, audiences, delivery models and funding requirements. Partners may describe success differently or collect information in ways that do not easily fit together.

When that happens, the first value of evaluation is often clarity. An external evaluator can help the partnership agree the important questions, identify how the different strands connect and create a shared framework without flattening meaningful differences.

This is particularly useful in place-based, cultural, heritage, nature and community programmes, where outcomes develop through relationships and context as well as individual activities. The evaluator holds the overall picture while helping each partner understand their role within it.

3. You are collecting plenty of information but still cannot see the answer

Many organisations do not have a data shortage. They have attendance figures, spreadsheets, survey responses, case studies, meeting notes, photographs, analytics and informal feedback. What they lack is the time and structure to turn all of that into a clear judgement.

More collection will not necessarily solve that problem.

An evaluator can work backwards from what you genuinely need to know, assess what the existing evidence can answer and identify the important gaps. They can compare sources, look for patterns and differences, and test whether an appealing explanation is actually supported.

That process reduces noise. It helps teams move from ‘we have a lot of information’ to ‘we understand what this is telling us and what we need to do next.’

4. Evaluation keeps slipping behind delivery

This is extremely common. Delivery deadlines are immediate. Evaluation tasks feel as though they could happen next week, so next week becomes next month and important evidence is missed.

It is not usually because the team does not care. It is because the same people are managing activities, participants, partners, finances, communications and funder requirements. Evaluation becomes one more responsibility competing for attention.

External support creates ownership and rhythm. A good evaluator agrees responsibilities, introduces manageable tools, checks what is coming in and raises gaps while there is still time to respond. They do not expect delivery staff to become researchers. They create a process that fits around the work and keep hold of the parts that need specialist time.

This can bring a real sense of calm. Somebody is maintaining the framework, watching the evidence and keeping the final questions in view, rather than leaving the whole evaluation in an unfinished loop in the team’s heads.

5. You need to understand change, not simply count activity

Outputs matter. You need to know how many people participated, what was delivered and whether the intended audiences were reached. But those figures do not tell you, on their own, what difference the work made.

If the important questions involve confidence, wellbeing, belonging, skills, behaviour, organisational practice, environmental action or community change, you need evidence that can explore outcomes as well as activity.

An evaluator can help establish realistic baselines or comparison points, choose appropriate qualitative and quantitative methods, and consider change across different groups. They can also investigate how and why outcomes developed, including the conditions that helped or hindered them.

That prevents the final evaluation becoming either a list of impressive numbers or a collection of positive stories. Both can be valuable, but neither is enough on its own.

6. The findings will shape future funding or important decisions

Evaluation becomes especially valuable when the organisation needs to decide what to continue, change, scale or stop.

Perhaps a pilot is approaching its next funding stage. A successful model could be expanded. A partnership needs to agree its future direction. Or the organisation wants to make a stronger case for investment without overstating what the current evidence proves.

An external evaluator can help identify which elements are doing the most useful work, where outcomes are strongest, what remains uncertain and what would need to be in place for the approach to work elsewhere.

The aim is not to make every project look successful. It is to give decision-makers a credible account of what has been learned. Honest findings are often more reassuring than a report in which everything appears to have gone perfectly, because they show that the organisation is paying attention and knows how to improve.

7. The final evaluation needs to withstand scrutiny

A clear, attractive report is important, but reassurance comes from what sits underneath it.

Can each conclusion be traced to evidence? Have different sources been compared? Are sample limitations explained? Have differences between groups been examined where they matter? Are recommendations proportionate to what the findings can genuinely support? Has someone challenged the emerging interpretation before it becomes the final story?

External evaluation can provide analytical discipline and quality assurance. It also helps translate a complicated body of evidence into conclusions that funders, boards, partners and delivery teams can all understand.

The simplicity clients see at the end should be the result of difficult thinking being handled well—not difficult questions being avoided.

What does an external evaluator actually take on?

The answer depends on the project. External support could include refining a theory of change, developing an evaluation framework and practical tools, training delivery teams, undertaking selected interviews or fieldwork, checking data quality, analysing existing evidence, facilitating learning sessions and producing an independent report.

The evaluator does not necessarily need to collect everything. Often the strongest arrangement is a partnership: the delivery team gathers routine information at natural points, while the evaluator focuses on design, deeper enquiry, analysis, challenge and interpretation.

A good evaluator will help you decide what is proportionate rather than adding methods for the sake of making the evaluation look substantial.

You may not need a finished brief to get started with evaluation. Organisations sometimes wait to approach an evaluator because they think they need to specify the entire methodology first. You do not.

It is useful to know what the project is trying to change, who needs the findings, what evidence already exists and when important decisions or reports are due. The evaluator can then help shape the questions and recommend a realistic route.

At The Evaluator, we specialise in holding complexity without passing it back to the client. We create robust evaluation underneath and a process that feels straightforward on the surface. Our role is to bring clarity, honest independent judgement and evidence that people can confidently use.

If several of these signs feel familiar, send us your project outline or an early version of your brief. We can help you work out whether external evaluation would add value—and what level of support would be genuinely useful.

Often we can design a detailed evaluation quote in a 20 minute scoping call, and we are happy to do those. Why not reach out on info@theevaluator.co.uk ?

Measure the Experience is The Evaluator’s pop-up evaluation booth for festivals, outdoor events and public programmes, designed to make audience feedback more human, welcoming and useful.

16th July 2026/in Blog, Evaluation, Feedback, Meet the Team, News/by Kirsty Rose

Introducing Measure the Experience: A More Human Way to Evaluate In Person

If you are organising a festival, outdoor arts event, public programme or community celebration, gathering useful feedback can be harder than it looks.

People are tired of surveys.

They are asked to rate everything now: a delivery, a phone call, a chatbot, a button they pressed in an app. Even tiny interactions generate a request for feedback. So by the time someone gets to a genuinely brilliant free festival, family event or public programme, the word “survey” can already feel like a burden.

That is a problem for organisations doing good work.

Many of our clients put huge amounts of time, care and money into creating something generous, joyful and memorable for the public. They deserve feedback that helps them understand what worked, what it meant and what to do next. But at busy events, standard evaluation methods can sometimes feel like part of the problem rather than the answer.

That is why we created Measure the Experience.

Measure the Experience is our pop-up evaluation booth for festivals and events. It is designed to make feedback feel fun, welcoming and adaptable, with a giant dice, a mock vocal booth, a quick visual “perspective point,” a quieter seated survey option, stickers, and a self-contained setup that can sit alongside structured footfall counts.

Two blue banners say Measure The Experience next to a table and a sofa

Measure the Experience is designed to feel visible, approachable and part of the event atmosphere.

Why we made it

We created Measure the Experience to tackle survey fatigue.

The issue was not that people had nothing to say. It was that they were fed up with being asked in dull, repetitive ways. Traditional in-person evaluation can feel like interruption. A clipboard appears, someone braces themselves, and the interaction starts to feel like admin.

That is the exact opposite of what you want at a festival.

At a good event, people are already full of impressions, feelings, memories and reactions. The challenge is not whether insight exists. The challenge is how to gather it in a way that feels proportionate to the setting and appealing enough that people actually want to take part.

So we built something different.

What makes it work

The reason Measure the Experience works is simple: we go to people, and we make the process enjoyable.

Instead of asking festival-goers to stop what they are doing and complete something worthy but boring, we create a small invitation that feels like part of the atmosphere. It is playful. It is visible. It is easy to understand. It gives people a chance to chat, reflect or react without feeling they have signed up to “do evaluation.”

That matters because once the interaction feels lighter and more human, people engage much more naturally.

They can roll the dice, answer a prompt, speak into the booth, react visually, or choose a quieter survey route instead. The setup is flexible because people are different. Some want to talk. Some want to write. Some want a very quick interaction. Some are drawn in by the playfulness. Some are relieved that there is a quieter option where they can sit and take their time.

That mix is built into the design.

Two people are looking at a busy festival, wearing blue capes

Measure the Experience is designed to feel visible, approachable and part of the event atmosphere.

A more human way to gather better data

Public events are mixed by nature.

You are dealing with families, older people, people in a rush, people who are curious, people who are shy, and people who would never stop for a formal questionnaire but will happily roll a giant dice and tell you something honest.

That is exactly the point.

We are not trying to make evaluation look serious. We are trying to make it easy enough, warm enough and interesting enough that people give us better information.

One of the things we noticed early on was that people wanted to engage more than we first expected. We originally kept parts of the interaction very short. But once people got involved, many wanted to talk for longer. They enjoyed the process. So we created more room for responses, because the playful format was unlocking richer reflection than a standard tick-box approach would have done.

When people do not feel cornered by evaluation, they often become much more generous with their thoughts.

We also developed tearing-paper demographic tools alongside it. These work almost like a tiny piece of origami in the middle of a busy day: very fast, very light, but still giving us the key profile information we need. That helps us gather useful audience data without making people feel they are filling in a form.

Built for real events

Measure the Experience is especially well suited to festivals, fireworks, outdoor arts, public realm events and busy community celebrations. It also works indoors anywhere there is a lot happening and people are moving through a shared experience.

It has been designed for real event conditions: a small footprint, battery lighting, no need for mains power, and enough flexibility to gather experiential feedback alongside structured footfall counts.

That practicality matters just as much as the creativity. A good evaluation tool has to work in the real world.

Caption: A self-contained event evaluation setup that can gather audience feedback and support structured footfall counts.

What it captures that standard surveys miss

Standard surveys are good at some things. They can be tidy. They can be efficient. They can help with consistent measures.

But what they often miss at public events is tone, texture and meaning.

What made someone come along?
What surprised them?
What felt important?
What was interesting enough that they remembered it in the middle of a busy day?
Why does an event like this matter in a place like this?

Those are exactly the kinds of prompts Measure the Experience is built to unlock, through open questions, voice recording and simple guided reflection. The prompt set can include questions about what brought people there, what interested them, why events matter, how long they stayed and what they spent.

That kind of feedback is often much more useful than another set of flat satisfaction scores on their own.

Why this matters to us

We do not think in-person evaluation should feel like being cornered by a clipboard.

We think it should feel proportionate to the experience people are having. If someone is at a lively public event, the feedback method should have some life in it too. It should meet people where they are. It should feel welcoming. And it should be good enough to produce insight that clients can actually use.

That is what Measure the Experience is for.

It takes human beings to the place, makes feedback enjoyable again, and helps us capture the stories, reflections and reactions that explain what an event really meant.

Because if the experience was memorable, the evaluation should not be forgettable.

Planning a festival, outdoor event or public programme?

Measure the Experience helps you gather useful feedback without making evaluation feel like an interruption. If you want a more human way to understand what your audience experienced, we would be happy to talk.

VISIT IN PERSON: WE INVENTED THE WEEKEND

4th July 2024/in Blog, Uncategorised/by Kirsty Rose

We were lucky enough to be invited to evaluate the ‘We Invented the Weekend’ festival at Salford Quays in June 2024. The festival is busy! It attracts thousands of visitors and has; performances, tents, music, shopping, sports, boats, cyclists, dancers, parades, talks – you name it and it is probably taking place across the site. Evaluating something like this requires a lot of energy and luckily The Evaluator has been honing its festival approach for many years now. We don’t often get to work next to celebrities like Bluey and Supertato though! Not forgetting the Gladiators and Mr Motivator!

You can read more about the We Invented The Weekend festival here.

We worked with an amazing team of volunteers and two giant dice to collect feedback at the weekend festival. We are very proud to say that across two sites, with a really small evaluation team, we were able to collect almost 500 completed feedback surveys during the weekend itself. We also created a brand-new game which worked really well, involving a giant dice and questions which aligned to the dice roll. This means that we have really good results across a wide cross section of people, great sample sizes and very good data.

Whilst there, we also carried out extensive footfall counting, to allow us to create a robust estimate of footfall over the whole weekend.

Our surveys are still live for this project and we are looking forward to collecting and analysing all the data over the summer months.

You might spot us at the next couple of festivals we are working on; these are ‘The Festival of Culture’ in Nelson in June and also ‘The National Festival of Making’ in July.

You can see more about The Festival of Culture here, and you can see more about The National Festival of Making here.

We actually evaluate the number of festivals and are happy to come along and support data collection if needed. Our festival analysis includes audience profiles, quality measures, practical experience and ways to improve, alongside footfall and economic impact. We would be happy to have a chat if you have a festival, that you would like to know more about, evaluating. You can call us on 01756 532 538 or email: info@theevaluator.co.uk

New client: We Invented the Weekend

22nd May 2024/in Blog, Uncategorised/by Kirsty Rose

The Evaluator is delighted to be working with a new client, We Invented the Weekend. You can see more about them on this link.

We Invented the Weekend is ‘The festival of free time’ and we are looking forward to working together at this high profile and exciting event. The festival is taking place on Saturday 15 & Sunday 16 June and is happening at Media City and Salford Quays. There is an amazing line up including live music, family fun, wellness workshops and sports activities – all for free!

Thousands of people will be making their way there, and we’ll be on hand during the festival with a team of volunteers to understand their experiences. This will include audience profiles, demographic segmentation, economic impact, quality of experience and more. We will be providing a full festival evaluation.