Tag Archive for: proportionate evaluation

Choosing an evaluation consultant? Learn what charities, not-for-profits and public sector teams could look for when appointing an external evaluator.

How to Choose the Right Evaluation Consultant for Your Project

If you are a charity, not-for-profit or public sector organisation looking for an evaluation consultant in the UK, it can be hard to know who to appoint.

From the outside, evaluators can look quite similar. Most will talk about impact, evidence, methods and reporting. Most can write a proposal that sounds credible. But the real question is not simply who writes the most polished tender.

The real question is: who will help you understand your project clearly, collect the right evidence, and turn that evidence into something you can actually use?

That matters because evaluation is often commissioned at an important moment. You might be preparing for a major grant, working through a development stage, or starting delivery after a significant funding award. There is usually a lot at stake. You need confidence that the evaluation will satisfy funders, support learning and help your team make better decisions.

So how do you choose the right evaluation consultant?

Start by asking people you trust

One of the best ways to find a good evaluator is still the simplest: ask around.

Ask your peers. Ask partner organisations. Ask funders, advisers, trustees or other senior leaders who have commissioned evaluation before. If someone has had a good experience with an evaluator, they will usually be able to tell you what made the process work.

This is useful because evaluation is not just a technical service. It is a working relationship.

You need someone who can understand the project, work well with senior leaders and delivery teams, ask good questions, make sense of complexity and communicate findings clearly. A recommendation from someone who has already worked with an evaluator can tell you a lot more than a website or proposal alone.

Look for relevant experience and previous work

Track record matters.

If your project involves community engagement, arts and culture, heritage, nature, health, wellbeing or place-based work, it helps to appoint someone who understands those settings. They do not need to have evaluated an identical project, but they should understand the reality of delivery.

Good evaluators know that participation can be uneven, delivery teams are busy, and community work does not always fit neatly into a spreadsheet. They know how to gather evidence without creating unnecessary work.

Ask to see examples of previous reports or outputs. A useful evaluation report should not just look impressive. It should be readable, honest and practical. You should be able to imagine giving it to trustees, funders, partners or senior colleagues and seeing how it would support decisions.

Ask how they would approach the project

Before asking for a full quote, it is worth having an informal conversation.

Look for evaluators who are willing to offer a 20 to 30 minute chat before they write a proposal. This gives you a much better feel for how they think. What questions do they ask? Do they understand the project quickly? Do they spot the right challenges? Do they make the process feel clearer or more complicated?

It also helps you work out whether you would enjoy working with them.

At The Evaluator, we usually try to have this kind of conversation before writing a quote. It helps us understand the client as well as the project. A tender brief can tell us what the work is, but a conversation often tells us how the organisation thinks, what they are worried about, and where evaluation could be most useful.

That matters because a good evaluator should not just price a list of pre-decided outputs. They should help you work out what level of evaluation is proportionate.

Sometimes organisations ask for more than they need. Three reports might sound thorough, but they may not be the best use of the budget. In some projects, one strong evaluation framework, a small number of well-designed tools and good support with data collection will be far more useful.

Do not judge only by the polish of the tender

A clear proposal matters. But the best evaluation partner is not always the organisation with the glossiest tender.

A larger consultancy may have a dedicated tender writer or more capacity to produce a very polished document. A smaller specialist team may not be able to spend a full week making a proposal look beautiful, because the senior people writing the quote are also the people designing, managing and delivering the work.

That difference matters.

A polished tender does not always tell you who will actually do the evaluation, how involved senior people will be, or whether the evaluator will stay close to the reality of the project once delivery begins.

So look beyond the procurement document. Ask who will lead the work, who will analyse the evidence and who will write the report.

Good evaluation depends on judgement, not just process.

Choose someone who makes evaluation useful

Good evaluation is not about collecting as much data as possible. It is about collecting the right amount of data, in the right way, and using it well.

That is where the best evaluation consultants add value. They help you avoid wasted effort. They design tools that work in real settings. They reduce duplicated requests. They make the process manageable for staff, volunteers, partners and participants.

At The Evaluator, we describe this as being creatively simple.

The process should feel simple for the people taking part. A survey should be easy to complete. A feedback activity should feel welcoming. A workshop should generate useful insight without feeling over-engineered.

Behind the scenes, the analysis may be complex. But that complexity should not be passed on to the client. The evaluator’s job is to do the hard thinking, make sense of the evidence, and present it back clearly.

A good evaluation consultant should bring relevant sector experience, proportionate methods, clear communication, honest analysis and practical recommendations that help funders, boards and delivery teams understand what the evidence means.

Look for honesty, not just positive findings

Evaluation is not marketing.

A good evaluator should recognise success, but they should also tell you what the evidence does and does not show. That kind of honesty is what makes evaluation credible.

A useful report explains what worked, for whom and why. It notices where outcomes were weaker or where delivery changed. It recognises the limits of the evidence. It helps you understand what is worth continuing, what needs adapting and what questions remain.

That should not feel threatening. Done well, honest evaluation gives organisations more confidence, not less.

Three questions to ask before appointing an evaluator

If you are choosing an external evaluator, these three questions will tell you a lot.

  1. Can you show us relevant previous work or connect us with a past client? This helps you understand both the quality of their outputs and what they are like to work with.
  1. How would you approach this project? This shows whether they can think strategically, not just respond to a brief.
  1. Who will actually deliver the evaluation? This helps you understand whether the people writing the proposal will be close to the work itself.

What a good evaluator should leave behind

A good evaluation should leave you with more than a report.

It should leave you with knowledge and a clearer sense of where you are going.

When organisations do not have good evidence, they can end up worrying about everything. Every issue feels equally urgent. Every decision feels uncertain. But when you look carefully at the numbers, the stories, the feedback and the wider context, priorities often become much clearer.

Good evidence helps you make decisions with more confidence.

It can show you what to scale, what to adapt, what to stop, what to explain to funders and what to focus on next.

So when you are choosing an evaluation consultant, do not only ask who has written the most polished tender.

  • Ask who will understand your project.
  • Ask who will make the work proportionate.
  • Ask who will be honest with you.
  • And ask who will turn complex evidence into clear learning you can actually use.

Planning to appoint an evaluator?

If you are preparing a brief, developing a funding bid or starting a newly funded project, we are happy to have an initial conversation about what level of evaluation would be proportionate, useful and manageable for your team.

How to make evaluation useful in complex projects

Good evaluation in complex projects should bring clarity, not confusion. When projects are collaborative, fast-moving or evolving as they go, evaluation can quickly become heavier than it needs to be.

 

When projects are collaborative, fast-moving or evolving as they go, evaluation can sometimes become heavier than it needs to be.

People worry because the work is complex, the evaluation has to be too. They are concerned that they need to measure everything, hear from everyone and produce huge amounts of data to prove value.

Good evaluation in real-world projects does not work like that.

It is not about collecting the maximum possible amount of information. It is about collecting the right evidence, in the right way, at the right level, so it fits delivery and actually gets used. That’s what makes for good evaluation in complex projects.

Complex does not mean measuring everything

One of the most common mistakes we see is the assumption that every participant needs to fill something in, and every part of the project needs to be measured in detail.

Usually, that is neither realistic nor useful.

A good sample is a good sample. If it is worked out carefully, it can give you robust insight without requiring every single person to complete a survey. That matters especially in busy, public or time-limited settings, where asking too much can damage the experience rather than improve the evidence.

Good evaluation is not about exhausting your audience. It is about making sensible choices.

Proportion matters

This is where proportionate evaluation really comes in.

If someone has volunteered on a project every week for almost a year, has given a lot of time and built a meaningful relationship with an activity, then a 20 or 30 minute conversation may be entirely proportionate. In fact, that kind of deeper reflection can be exactly what helps you understand change, value and learning.

But if someone is attending a one-off training session, festival or short event, the right ask may be only a few seconds. A quick question, a simple rating, a brief reaction. In that context, a long survey is not good evaluation. It is a bad fit.

The method should match the nature of the participation.

The real problem is often not too little data, but too little focus

Sometimes organisations have not had enough time to get clear on what they are really trying to achieve.

When that happens, evaluation spreads too thin. People try to measure too many things, worry about every target at once, and collect information without a clear sense of what matters most. The result is often lots of data, but not much insight.

We also regularly see organisations holding pages of analytics, reporting dashboards or monitoring returns that they do not really know how to interpret. The challenge is not always collecting the data. More often, it is understanding what it means and how to use it.

Data becomes powerful when it has context

A single big number is rarely enough on its own.

Data starts to become useful when it is compared to something else: a baseline, a previous month, a different group, a previous phase of delivery, or the change a project was actually trying to create.

For example, knowing what result you got in April may be mildly interesting. Knowing how April compares to March is often much more helpful. That is what begins to show direction, pattern and change.

This is where evaluation becomes practical. It helps people make sense of what is happening, not just record that something happened.

Good evaluation should help people use their limited time well

At its best, evaluation is not just there to satisfy a funder or complete a report. It should help delivery teams think more clearly, focus their energy and improve what they do.

That is why we put so much emphasis on proportional evaluation. We want it to feel reasonable for participants, manageable for staff and suited to the scale of the work. We want to collect less, but use it better.

If we come in early enough, we can often help sharpen that focus from the start: what matters most, what is realistic to gather, and where evidence will actually help people make decisions. If we come in later, we can still help make sense of what exists. But the strongest evaluation is usually built in early, with enough structure to be credible and enough flexibility to work in the real world.

  • Complex projects do not need evaluation that is heavier, louder or more complicated.
  • They need evaluation that is thoughtful, proportionate and useful.
  • Because messy does not mean unmeasurable. It just means the approach needs to be smarter.

Working on something complex, collaborative or still evolving? We help charities, cultural organisations and partnerships build evaluation that is proportionate, credible and genuinely useful.