Tag Archive for: Independent Evaluation UK

Seven Signs Your Project Needs an External Evaluator

Seven signs your project would benefit from external evaluation

 

You don’t always need an external evaluator. Sometimes a clear internal framework, a few well-designed tools and protected time for reflection are enough.

But there are points when evaluation becomes difficult to hold alongside delivery. The project may have grown more complex, several partners may need a shared view, or the findings may now carry real weight with funders, boards and future decision-makers.

At that point, external evaluation is not simply about producing a report. It can bring structure to a complicated programme, protect the quality of the evidence and take some of the analytical burden away from a busy team.

Here are seven signs that outside support could be useful.

1. Your funder, board or partners need independent evidence

Internal monitoring can tell you a great deal, and delivery teams often hold vital knowledge about what is changing. But sometimes the people using the findings need a degree of independence too.

That may be because a funder expects an external view, a board will use the evidence to make a significant decision, or several partners need confidence that the findings do not reflect one organisation’s perspective alone.

An external evaluator can examine positive, negative and unexpected evidence, make limitations visible and distinguish what the project contributed from changes it cannot reasonably claim. Independence does not mean standing at a distance from the work. It means being close enough to understand it while retaining enough separation to test the story fairly.

2. The project has several strands, audiences or partners

Complex projects rarely arrive in one tidy shape. There may be different activities, places, audiences, delivery models and funding requirements. Partners may describe success differently or collect information in ways that do not easily fit together.

When that happens, the first value of evaluation is often clarity. An external evaluator can help the partnership agree the important questions, identify how the different strands connect and create a shared framework without flattening meaningful differences.

This is particularly useful in place-based, cultural, heritage, nature and community programmes, where outcomes develop through relationships and context as well as individual activities. The evaluator holds the overall picture while helping each partner understand their role within it.

3. You are collecting plenty of information but still cannot see the answer

Many organisations do not have a data shortage. They have attendance figures, spreadsheets, survey responses, case studies, meeting notes, photographs, analytics and informal feedback. What they lack is the time and structure to turn all of that into a clear judgement.

More collection will not necessarily solve that problem.

An evaluator can work backwards from what you genuinely need to know, assess what the existing evidence can answer and identify the important gaps. They can compare sources, look for patterns and differences, and test whether an appealing explanation is actually supported.

That process reduces noise. It helps teams move from ‘we have a lot of information’ to ‘we understand what this is telling us and what we need to do next.’

4. Evaluation keeps slipping behind delivery

This is extremely common. Delivery deadlines are immediate. Evaluation tasks feel as though they could happen next week, so next week becomes next month and important evidence is missed.

It is not usually because the team does not care. It is because the same people are managing activities, participants, partners, finances, communications and funder requirements. Evaluation becomes one more responsibility competing for attention.

External support creates ownership and rhythm. A good evaluator agrees responsibilities, introduces manageable tools, checks what is coming in and raises gaps while there is still time to respond. They do not expect delivery staff to become researchers. They create a process that fits around the work and keep hold of the parts that need specialist time.

This can bring a real sense of calm. Somebody is maintaining the framework, watching the evidence and keeping the final questions in view, rather than leaving the whole evaluation in an unfinished loop in the team’s heads.

5. You need to understand change, not simply count activity

Outputs matter. You need to know how many people participated, what was delivered and whether the intended audiences were reached. But those figures do not tell you, on their own, what difference the work made.

If the important questions involve confidence, wellbeing, belonging, skills, behaviour, organisational practice, environmental action or community change, you need evidence that can explore outcomes as well as activity.

An evaluator can help establish realistic baselines or comparison points, choose appropriate qualitative and quantitative methods, and consider change across different groups. They can also investigate how and why outcomes developed, including the conditions that helped or hindered them.

That prevents the final evaluation becoming either a list of impressive numbers or a collection of positive stories. Both can be valuable, but neither is enough on its own.

6. The findings will shape future funding or important decisions

Evaluation becomes especially valuable when the organisation needs to decide what to continue, change, scale or stop.

Perhaps a pilot is approaching its next funding stage. A successful model could be expanded. A partnership needs to agree its future direction. Or the organisation wants to make a stronger case for investment without overstating what the current evidence proves.

An external evaluator can help identify which elements are doing the most useful work, where outcomes are strongest, what remains uncertain and what would need to be in place for the approach to work elsewhere.

The aim is not to make every project look successful. It is to give decision-makers a credible account of what has been learned. Honest findings are often more reassuring than a report in which everything appears to have gone perfectly, because they show that the organisation is paying attention and knows how to improve.

7. The final evaluation needs to withstand scrutiny

A clear, attractive report is important, but reassurance comes from what sits underneath it.

Can each conclusion be traced to evidence? Have different sources been compared? Are sample limitations explained? Have differences between groups been examined where they matter? Are recommendations proportionate to what the findings can genuinely support? Has someone challenged the emerging interpretation before it becomes the final story?

External evaluation can provide analytical discipline and quality assurance. It also helps translate a complicated body of evidence into conclusions that funders, boards, partners and delivery teams can all understand.

The simplicity clients see at the end should be the result of difficult thinking being handled well—not difficult questions being avoided.

What does an external evaluator actually take on?

The answer depends on the project. External support could include refining a theory of change, developing an evaluation framework and practical tools, training delivery teams, undertaking selected interviews or fieldwork, checking data quality, analysing existing evidence, facilitating learning sessions and producing an independent report.

The evaluator does not necessarily need to collect everything. Often the strongest arrangement is a partnership: the delivery team gathers routine information at natural points, while the evaluator focuses on design, deeper enquiry, analysis, challenge and interpretation.

A good evaluator will help you decide what is proportionate rather than adding methods for the sake of making the evaluation look substantial.

You may not need a finished brief to get started with evaluation. Organisations sometimes wait to approach an evaluator because they think they need to specify the entire methodology first. You do not.

It is useful to know what the project is trying to change, who needs the findings, what evidence already exists and when important decisions or reports are due. The evaluator can then help shape the questions and recommend a realistic route.

At The Evaluator, we specialise in holding complexity without passing it back to the client. We create robust evaluation underneath and a process that feels straightforward on the surface. Our role is to bring clarity, honest independent judgement and evidence that people can confidently use.

If several of these signs feel familiar, send us your project outline or an early version of your brief. We can help you work out whether external evaluation would add value—and what level of support would be genuinely useful.

Often we can design a detailed evaluation quote in a 20 minute scoping call, and we are happy to do those. Why not reach out on info@theevaluator.co.uk ?

 

New Client: Derbyshire Makes

New Client: Derbyshire Makes & Derbyshire Makes History

We’re thrilled to be partnering with Derbyshire Makes and Derbyshire Makes History — two interlinked programmes that celebrate and strengthen Derbyshire’s proud tradition of making, from past to present.

A county built by makers

Derbyshire has always been a place of ingenuity. From Cromford’s water-powered mills to the industrial heart of the Derwent Valley, this landscape is woven with stories of craftsmanship, materials, and communities shaping each other. You can read more here.

Derbyshire Makes is a three-year cultural programme supporting creative expression and community making across the county.

In parallel, Derbyshire Makes History is a two-year heritage-led initiative, funded by The National Lottery Heritage Fund, that digs deeper into the industrial legacies of textiles, ceramics, mining and more.

Together, the programmes aim to connect past and present: giving space for both innovation and inheritance, fresh voices and rooted traditions.

What we’ll be doing

We come in as evaluators (aka “we’ll figure it out for you”) — supporting both programmes to learn, adapt and amplify impact.

  • Designing a learning framework that marries creative outcomes with heritage goals
  • Tracking outputs & outcomes (community participation, skills development, audience reach)
  • Gathering stories & voices from makers, volunteers, heritage organisations and local people
  • Reflecting on “what works where” — drawing out lessons for future creative-heritage programmes
  • Supporting evaluation capacity in local partners, so the learning doesn’t stay just with us

Our aim is to keep evaluation light, meaningful and usable — never ivory-tower, always in service of place, people, creativity.

A lens of reciprocity

What excites us most is the chance to help the programme stay curious, responsive and anchored in Derbyshire’s communities. With heritage and creativity in conversation, there’s real potential to:

  • revive crafts and materials that risk being lost
  • spark new making practices in places with fewer arts resources
  • foster pride in place and intergenerational connection
  • build sustainability: for organisations, for makers, and for heritage

We’ll be listening a lot — but also helping the programmes iterate, pivot and grow in line with what’s emerging on the ground.

What this means for Derbyshire

Over time, the evaluation will help tell a fuller story: how creative making and heritage can reinforce each other; where to target investment; and how to ensure accessibility, equity and resonance across Derbyshire’s diverse towns and communities.

We’re honoured to be on this journey. If you’re a heritage group, maker, community organiser or just curious — we’d love to hear your voice as the programmes unfold.

📧 info@theevaluator.co.uk | 📞 01756 532 538

Recent Client Feedback: Social Return On Investment

Recent Client Feedback: Social Return On Investment

Client testimonial: The Evaluator’s Impact on Our Social Return on Investment Study

“Working with The Evaluator on our Social Return on Investment for the Love to Move programme was a truly enjoyable experience. They brought the perfect balance of professionalism and warmth, making the entire process seamless and engaging. Their empathy and understanding of our demographic—older people—stood out, as they took the time to create a kind, fun, and motivational approach to data collection. This ensured that the insights gathered were not only robust but also reflective of the real experiences of those we support.

What makes The Evaluator truly unique is their attention to detail and commitment to delivering exactly what is needed. They take the time to fully understand the brief, ensuring that the evaluation process is both meaningful and impactful. Their work on our Social Return on Investment study has been invaluable in demonstrating the impact of our Love to Move programme to major partners, potential funders, and health and social care organisations. Their findings have given us strong, evidence-based insights that continue to shape our conversations and drive our programme forward.”

Louise Roberts, Head of Programmes, British Gymnastics Foundation

You can see more about British Gymnastics Foundation here 

 

Process evaluation

Process Evaluation

At The Evaluator, we specialise in process evaluations that provide organisations with a clear understanding of how their work is being delivered and where it can be optimised. Our approach focuses on uncovering what’s working well, identifying challenges, and refining processes to maximise effectiveness. By examining implementation, decision-making, and operational dynamics, we help organisations strengthen their approach in real-time rather than waiting until a project’s end. Our evaluations are designed to be practical and insightful, offering clear recommendations that enhance efficiency, improve delivery, and ensure resources are being used to their full potential.

What makes our process evaluations stand out is our commitment to making them both reflective and action-driven. We don’t just map out workflows—we identify opportunities for streamlining, innovation, and growth. We work closely with organisations to ensure that their processes are not only effective but also sustainable and scalable. By embedding evaluation within delivery, we enable teams to adapt quickly, build resilience, and drive continuous improvement. Our evaluations turn operational insights into strategic advantages, helping organisations refine their work, strengthen their impact, and deliver with even greater confidence.

We know that setting up new teams can be tricky at first, and have developed tools which not only evaluate projects, but also help you during the project itself. We offer the following, in larger projects, to keep you on track:

Monitoring support and tools

Monitoring your activity is essential because it ensures that your efforts are making an impact and that you’re using your resources effectively. Without a clear way to track progress, it’s easy to lose sight of what’s working well and where adjustments are needed. That’s why we provide monitoring spreadsheets that offer a quick, at-a-glance overview of key metrics, making it simple to see trends, spot challenges, and identify opportunities for growth. These tools help you stay focused, prioritise your time and energy, and make informed decisions based on real data. Whether it’s tracking outputs, engagement, or project milestones, our monitoring systems empower you to stay on course, adapt when needed, and ultimately achieve greater success.

Innovative process measurement

The Reflex Survey system designed by The Evaluator is a brilliantly simple yet highly effective way to track team progress in real-time. By implementing regular self-assessment measures, the programme team can quickly reflect on their work, providing a gut-reaction assessment rather than an over-analysed response. This allows for a more accurate and honest snapshot of how the project is evolving. The inclusion of the Forming, Storming, Norming, and Performing (FSNP) framework ensures that team dynamics and project challenges are recognised, allowing leadership to identify patterns, pinpoint challenges, and celebrate progress. By aligning these team insights with feedback from the board and steering group, the Reflex Survey ensures a balanced, multi-level perspective on the programme’s development.

One of the most powerful aspects of this system is its flexibility and responsiveness. Unlike traditional assessments that assume linear progress, the Reflex Survey acknowledges that teams may move back and forth between phases, adapting to new challenges as they arise. The data from the team’s assessments demonstrates this in action – here is an example “an initial dip in scores reflects the complexity of external challenges, while the sharp rise to ‘norming’ in January highlights the team’s resilience and adaptability.” This real-time insight allows for targeted support, proactive problem-solving, and a deeper understanding of team dynamics, making it an invaluable tool for monitoring project health and guiding strategic decisions.

 

 

Whether you’re just starting out or looking to strengthen an existing project, our process evaluation tools are designed to support you every step of the way. We bring clarity, insight, and momentum—helping your team stay aligned, adapt quickly, and deliver impact with confidence. If you’re ready to gain a deeper understanding of how your work is unfolding and how it can be even more effective, we’d love to talk. Get in touch with us today – info@theevaluator.co.uk or call 01756 532 538, to explore how we can tailor our approach to fit your needs and elevate your project from the inside out.

 

New Client: Heritage Crafts

The Evaluator is delighted to be working with a new client, Heritage Crafts.

Heritage Crafts is the national charity for traditional heritage crafts in the UK. Working in partnership with the government and key agencies, they provide a focus for craftspeople, groups, societies and guilds – as well as individuals who care about the loss of traditional crafts skills. They work towards a healthy and sustainable framework for the future.

Heritage Craft’s charitable purpose is to advance public knowledge and appreciation of traditional and heritage crafts in particular, but not exclusively, through education, advice and training.

They describe themselves as:

“Heritage Crafts is the national charity for traditional heritage crafts. Working in partnership with Government and key agencies, we provide a focus for craftspeople, groups, societies and guilds, as well as individuals who care about the loss of traditional crafts skills, and work towards a healthy and sustainable framework for the future.

We are a UNESCO accredited NGO for Intangible Cultural Heritage and advocated for UK ratification of the 2003 UNESCO Convention of the Safeguarding of Intangible Cultural Heritage, which was announced by the UK Government in December 2023.”

Shaping a Resilient Future for Heritage Crafts is a project designed to build the resilience of the organisation. Heritage Crafts has grown rapidly over the last four years and is also at the end of a period of change – moving from trustee led to having paid staff.

This project will run for two years and is funded through the National Lottery Heritage Fund. It will focus on governance, fundraising and broadening the offer of support to a wider range of people, including under-represented communities.

The Evaluator is looking forward to working with and evaluating the Shaping a Resilient Future for Heritage Crafts project.

You can find out more about the organisation here https://www.heritagecrafts.org.uk/

New Client: Hurst Farm

The Evaluator is delighted to be working with a new client, Hurst Farm.

Based in the Darbyshire Dales, this project is funded by The National Lottery Heritage Fund. The project has a focus on improving the natural assets of the Hurst Farm woodland and will connect together the known heritage features for the benefit of local communities within easy access of the estate. The proposed activities will help to improve opportunities for inclusion, promote well-being and begin to offer an improvement of the life chances for those people actively engaged through the Hurst Farm Heritage Trail.

We are also delighted to be working in partnership to evaluate this project with Simon Lees from Countryside Training Partnership. This is the third time we have pooled skills to work together and it’s always a good fit. We enjoy working with other consultants and also enjoy how the conversations and multi-disciplinary approaches mean we can be creative, as well as  offering a really wide range of experiences to project challenges.

This funded project is part of a bigger suite of projects, and you can read more about them here. Hurst Farm Projects.

You can see more about Hurst Farm on this link.

 

The Evaluator Values 

At The Evaluator, we have always had a clear idea of what we do and why we do it. In 2024, we have clearly defined that with a statement of values.

The values represent who we are at heart, and what we do for our clients, as well as underpinning all of our work.

What are business values?

Business values are described as the core principles and standards that guide a company’s actions, decisions, and behaviours. They represent what a company stands for and are essential in shaping its culture, brand identity, and strategic direction. These values influence how a company interacts with its employees, clients, funders, and the community in general.

By clearly defining and consistently using values, organisations can create a strong, positive culture and a sustainable competitive advantage.

The Evaluator Business Values

 

Image of the evaluator ruler branding and the words creatively simple honest and useful

Our values are shown on the image above and are; Honest, Useful and Creatively Simple.

Core Value for The Evaluator: Honest

Honesty matters to us. When decisions are to be made about data – people need to feel that the results are honest. We need to be honest about how we have collected data – what questions did we ask, and where did we ask them. We are by nature, honest people, who say the truth, and that is the secret to our success. Honesty builds trust, and our clients know we will tell the truth. That means funders can trust our impartial evaluation too, and that has many benefits for our clients when it comes to applying for funding in the future.

Core Value for The Evaluator: Useful

What we are really passionate about is getting our clients to use data to make decisions! We want people to be inspired and enthusiastic about data, and what it can do for organisations. That means, we spend a lot of time focussing on what data people need and how they can use it. We train clients and the organisations we work with on how to collect the correct data, and how to understand the data. We often collect data for people too. What is essential to this value (usefulness), is that we collect the right amount of data which we can use. We do not collect large amounts of data that is stored and never looked at. We collect the right amount of data, which is often less than people expect, and use what we have collected. The secret to powerful data is about how it is analysed and used, not how much of it there is!

Core Value for The Evaluator: Creatively Simple

Data can be complex. We spend a lot of time and energy making it creatively simple for people to work with us. Examples of creatively simple ways to collect data are things like – sticker boards, marbles, hula hoops and giant dice. These have all featured in our work! There can also be creatively simple ways to demonstrate complex results and personal experiences to clients. This is a value that we are always working on in order to improve.

Why did we choose these values?

Founder and Director, Kirsty Rose Parker, explains “We have been working hard behind the scenes on articulating what it is that makes us stand out. Sharing our core values is the first step of this. We have looked carefully at all the steps that make up an evaluation with us. From listening to people at the beginning, to being creative with our methods at evaluation design time. We regularly challenge ourselves on how to be simpler, how to be more creative and also on how our work can be honest and useful. These values are now an everyday part of The Evaluator – helping us to grow as a team, whilst retaining our quality service and products.”

Why do values matter in evaluation?

These are our values, but we also often include client’s values in the evaluations we plan. We have helped clients decide what values work for new projects in the past, and then used those values to form the materials we create for clients. Having a short and memorable set of values is a great way to give new teams a frame of reference for their work. We look forward to a value-driven future creating great partnerships and measuring even more values.

 

If you are interested in measuring your values or helping to define them, then please get in touch on info@theevaluator.co.uk or call 01756 532 538 to book an informal discussion.

If you like what you have read here, but are not yet ready for a discussion, you can keep in touch with us by joining our mailing list or connecting with Kirsty on Linked In.

The link for our mailing list can be found here.

The link for connecting with Kirsty on Linked In can be found here.

New Client: Creative Vision

New Client: Creative Vision

We are excited to announce we’re evaluating a project with Creative Vision that delves into the rich oral history and heritage of Indian restaurants and the vibrant Bangladeshi community in the UK. Working in Luton, the project aims to capture the experiences of chefs, owners and community members who contributed to Indian Cuisine and culture in the UK.

These experiences will be brought together to create a book, containing real stories and interviews of Indian heritage in the UK.

We’re working with the project to evaluate and measure the impact on audiences, volunteers and participants and share our expertise in working with a wide range of communities.

Capturing impact in people’s own words

At The Evaluator we recognise the value of collecting qualitative information for our evaluations. We take pride in capturing the genuine impact our projects or organisations have on individuals through hearing about their experiences in their own words.

The questions we ask are often simple and open to encourage individuals to speak honestly and let their stories unfold naturally. We feel privileged to get to hear about the amazing feedback and stories from people, and we love to share these stories with our clients.

We would also like to share some genuine quotes with you, spoken by real people who have experienced the impact from some of our clients:

We have heard from volunteers

“I truly appreciate everything the team does throughout the year to keep things moving forward. Thank you for helping to make so many people feel empowered, and seeing all of the work being done leaves me feeling so much hope for the future. Thank you for shining a light on all that can be done to make live music more accessible and equitable!” – Volunteer

“That was the biggest opportunity I’ve been given and that changed my life” – Volunteer

“It is such a joy and has made a really positive impact on my life. It has even changed the direction of my career” – Volunteer

 

We have also heard from participants

 

“For my general health I consider [client] more important than the NHS” – Participant of a wellbeing service

“[Client] has just been a godsend for me. Absolute Godsend” – Participant of a wellbeing service

“I really enjoyed the course as I love art and it also gave me a push to get out of the home and socialise more thus contributing to my wellbeing. Thank you”  – Participant of an Arts project

Thank you for the opportunity. Since starting with [project] I’m growing in self confidence and feel like I’m getting my life in order again. I’m putting plans in place and I’m more optimistic for my future.” – Participant of an Arts project

 

If you’re interested in learning more about our evaluation processes or exploring how we can help your organisation measure its impact, don’t hesitate to reach out. We’d love to chat!

What are the Indices of Multiple Deprivation?

What are the Indices of Multiple Deprivation?

If you have ever read one of our reports, you’ll likely see reference to something called the Indices of Multiple Deprivation, or ‘IMD’.

We use the IMD as a powerful tool to analyse and understand the barriers and socio-economic status of audiences, participants, and volunteers. We use postcodes to measure the IMD status, and this means that people find it easy to answer. This does mean that we are looking at the household status too.
The results give our clients an idea of which people they are attracting to their projects and what barriers they may be facing in life.

Statistically, people who live within areas of greater deprivation have more barriers in their lives and are less likely to engage with the arts and nature and are more likely to have greater issues with their wellbeing. That’s one of the reasons funders do like to understand if projects and organisations are reaching people from the most deprived areas.
How are the indices of multiple deprivation worked out?
The IMD is worked out using a range of factors which are assessed across the UK and given a score. The factors are listed below:

  • Income deprivation: how many people in the area are experiencing low-income levels.
  • Employment deprivation: what is the rate of unemployment in the area?
  • Education deprivation: what are the average qualifications within the area, and how easy is it to access quality education?
  • Health deprivation and disability: what is the average life expectancy and disability prevalence in the area?
  • Crime: how much crime occurs within the area
  • Housing deprivation: how affordable is housing within the area, and are there other barriers to people accessing housing
  • Living environment: what is the air quality like in the area, and are there green spaces?

These scores are compiled to give a ranking, which are then categorised into ten deciles. The entirety of England falls equally into one of ten deciles, with decile 1 indicating the most deprivation, and area 10 having the least deprivation.
If you were targeting deprived areas, you might want to reach 50% of people living in IMD1 and 2 for example. Or if you wanted a perfect section of the UK represented in your project, you might want to see 10% of your audience from each decile.

We think the IMD is a useful tool and aim to use it in every evaluation where relevant.