Tag Archive for: Theory of change

What Happens After You Appoint an External Evaluator?

/in , , /by

What happens after you appoint The Evaluator?

Appointing an external evaluator can feel like handing an important part of your project to people you do not yet know very well. You may be wondering how much time the process will take, what your team will be expected to do, whether the evaluator will understand the work quickly enough, and whether problems will be spotted before the final report.

Those are reasonable concerns. A strong proposal matters, but clients also need confidence in what happens after the contract is signed.

Our job is to make evaluation feel held: clear responsibilities, sensible tools, regular contact and enough challenge behind the scenes to produce findings that stand up to scrutiny. This is the process you can expect from us.

1. We begin by getting the important things out of people’s heads

The first stage is inception. We review the brief, funding requirements, project plans, existing monitoring and any previous research. Then we talk through what the project is really trying to achieve, what is already happening and where the uncertainties sit.

This is often where different strands begin to join up. Projects can involve several partners, audiences, activities, outcomes and reporting requirements. We create a shared picture, agree priorities and make decisions about what the evaluation can realistically answer.

This is often the point when people start to feel excited about the evaluation: the project becomes clearer, the possibilities begin to emerge, and the team can see how the process will support their work. We also begin agreeing the practical arrangements and responsibilities, building these out as the evaluation develops.

2. We turn ambition into answerable questions

Funding applications often contain broad and overlapping ambitions. Our role is to translate those into a focused set of evaluation questions and, where useful, a theory of change.

That means identifying the route from activity to outcomes, the assumptions underneath it and the evidence that will help us judge progress. We also review your targets and deliverables, checking that everyone understands what needs to be counted, how it will be recorded and who will be responsible. Where possible, we establish baselines or sensible comparison points and make clear where evidence will be indicative rather than conclusive.

This work creates the spine of the evaluation. Without it, projects can collect a great deal of information and still struggle to demonstrate what they delivered or answer the questions that matter.

3. We build tools that work in the real world

Next, we develop the evaluation framework and practical toolkit. This could include monitoring templates, surveys, interview guides, observation tools, participant reflection, demographic questions or creative in-person methods.

The right tool depends on the setting. A short community activity, an outdoor festival, a long-term volunteer programme and a strategic partnership cannot all be evaluated in the same way.

We design first for the people who will actually use and respond to the tools, as well as for the evidence the evaluation needs. If you are working with people experiencing deprivation, people facing language barriers, children or people with complex disabilities, we will adapt both the method and the way it is delivered so that participation is practical, appropriate and meaningful.

That might mean using simpler language, visual or creative approaches, supported conversations, shorter questions or accessible alternatives to a conventional survey. We aim to create methods that work in real settings—not polished, bureaucratic tools that look impressive on paper but place unnecessary demands on participants or delivery teams.

4. We make responsibilities manageable

External evaluation works best as a clear partnership. Your team may hold attendance records, capture routine feedback or introduce us to participants. We may lead deeper interviews, focus groups, observation, analysis and independent reporting.

We agree that division early and provide support where needed. This might include a short training session, written guidance, worked examples or a regular check-in. The aim is not to turn delivery staff into researchers. It is to make the information they gather consistent and useful without adding unnecessary weight to their jobs.

5. We check the evidence while the project is live

One of the biggest risks in evaluation is waiting until the end to discover that an important question was not asked or that data has been recorded inconsistently.

We build in proportionate progress and data-quality checks. We look at what is coming in, whether different groups are being heard, where response rates are weak and whether delivery changes affect the original framework. If something is not working, we raise it while there is still time to adapt.

These conversations are not about catching clients out. They are about protecting the final evaluation and helping the project learn during delivery.

6. We analyse, compare and challenge

Analysis is more than summarising a spreadsheet or selecting good quotations. We look for patterns, differences between groups, changes over time and explanations for what we are seeing. We compare monitoring data, surveys, interviews, observation and other sources rather than treating each in isolation.

We also look for evidence that complicates the emerging story. Where samples are limited, baselines are missing or other factors may have contributed to change, we say so. Conclusions are tested within the wider team before they become part of the report.

That internal challenge is a core part of our quality assurance. Accessible writing is the final layer; underneath it sits careful analysis and professional judgement.

7. We turn findings into something people can use

The report should give funders and boards confidence, but it should also help the people delivering the work. We structure findings around the questions and outcomes that matter, show how conclusions were reached, and make limitations clear without allowing them to obscure useful learning.

Recommendations are grounded in the evidence and proportionate to the organisation’s capacity. Depending on the commission, we may also present findings, run a learning session or produce concise visual material for wider audiences.

Our aim is not to leave a large document behind and disappear. It is to help the right people understand what the evidence means and what to do next.

What happens when projects change?

Projects change because funding is delayed, staff move, activities evolve, partners join or audiences respond differently from expected. Evaluation has to be structured without becoming rigid.

We keep the central questions in view, record agreed changes and adapt tools or timing where that protects the usefulness of the work. If a change affects scope or budget, we explain that early rather than allowing a surprise to appear at the end.

What about capacity and continuity?

Clients appoint The Evaluator as a consultancy, not an isolated individual. Each project has clear leadership and project management, with wider team involvement in delivery, analysis, review and cover. Our systems hold actions, deadlines and decisions so that continuity does not rely on one person remembering everything.

That team structure matters. It gives clients consistent contact while bringing more than one perspective to important findings. It also means quality and progress can be protected through busy periods, leave and the ordinary realities of working life.

What we need from you

Good evaluation does require collaboration. We will need timely access to relevant documents and data, honest conversations about delivery, help reaching participants or stakeholders, and enough notice of key events and changes.

In return, we take responsibility for holding the evaluation: keeping the framework coherent, making sense of evidence, identifying risks, asking the difficult questions and turning complexity into clear, useful findings.

If you are planning an evaluation and want to understand what the process would look like for your project, send us your brief—or talk to us before the brief is finished. We will help you work out a proportionate route from the questions you have now to evidence you can confidently use.

How to make evaluation useful in complex projects

/in , /by

Good evaluation in complex projects should bring clarity, not confusion. When projects are collaborative, fast-moving or evolving as they go, evaluation can quickly become heavier than it needs to be.

 

When projects are collaborative, fast-moving or evolving as they go, evaluation can sometimes become heavier than it needs to be.

People worry because the work is complex, the evaluation has to be too. They are concerned that they need to measure everything, hear from everyone and produce huge amounts of data to prove value.

Good evaluation in real-world projects does not work like that.

It is not about collecting the maximum possible amount of information. It is about collecting the right evidence, in the right way, at the right level, so it fits delivery and actually gets used. That’s what makes for good evaluation in complex projects.

Complex does not mean measuring everything

One of the most common mistakes we see is the assumption that every participant needs to fill something in, and every part of the project needs to be measured in detail.

Usually, that is neither realistic nor useful.

A good sample is a good sample. If it is worked out carefully, it can give you robust insight without requiring every single person to complete a survey. That matters especially in busy, public or time-limited settings, where asking too much can damage the experience rather than improve the evidence.

Good evaluation is not about exhausting your audience. It is about making sensible choices.

Proportion matters

This is where proportionate evaluation really comes in.

If someone has volunteered on a project every week for almost a year, has given a lot of time and built a meaningful relationship with an activity, then a 20 or 30 minute conversation may be entirely proportionate. In fact, that kind of deeper reflection can be exactly what helps you understand change, value and learning.

But if someone is attending a one-off training session, festival or short event, the right ask may be only a few seconds. A quick question, a simple rating, a brief reaction. In that context, a long survey is not good evaluation. It is a bad fit.

The method should match the nature of the participation.

The real problem is often not too little data, but too little focus

Sometimes organisations have not had enough time to get clear on what they are really trying to achieve.

When that happens, evaluation spreads too thin. People try to measure too many things, worry about every target at once, and collect information without a clear sense of what matters most. The result is often lots of data, but not much insight.

We also regularly see organisations holding pages of analytics, reporting dashboards or monitoring returns that they do not really know how to interpret. The challenge is not always collecting the data. More often, it is understanding what it means and how to use it.

Data becomes powerful when it has context

A single big number is rarely enough on its own.

Data starts to become useful when it is compared to something else: a baseline, a previous month, a different group, a previous phase of delivery, or the change a project was actually trying to create.

For example, knowing what result you got in April may be mildly interesting. Knowing how April compares to March is often much more helpful. That is what begins to show direction, pattern and change.

This is where evaluation becomes practical. It helps people make sense of what is happening, not just record that something happened.

Good evaluation should help people use their limited time well

At its best, evaluation is not just there to satisfy a funder or complete a report. It should help delivery teams think more clearly, focus their energy and improve what they do.

That is why we put so much emphasis on proportional evaluation. We want it to feel reasonable for participants, manageable for staff and suited to the scale of the work. We want to collect less, but use it better.

If we come in early enough, we can often help sharpen that focus from the start: what matters most, what is realistic to gather, and where evidence will actually help people make decisions. If we come in later, we can still help make sense of what exists. But the strongest evaluation is usually built in early, with enough structure to be credible and enough flexibility to work in the real world.

  • Complex projects do not need evaluation that is heavier, louder or more complicated.
  • They need evaluation that is thoughtful, proportionate and useful.
  • Because messy does not mean unmeasurable. It just means the approach needs to be smarter.

Working on something complex, collaborative or still evolving? We help charities, cultural organisations and partnerships build evaluation that is proportionate, credible and genuinely useful.

 

What Is Evaluation? A Practical Guide for Funders and Delivery Teams

/in /by

Evaluation Explained

What Is Evaluation and Do You Need It?

Evaluation turns delivery into decision-grade evidence. It helps you understand what changed, who benefited, why it worked (or didn’t), and what to do next.

If you’re delivering public-facing work, seeking funding, or managing multiple partners, evaluation is how you stay credible and in control.

What Evaluation Does

  • Measures: converts activity into insight so you can see what’s working and where to improve.
  • Proves impact: backs up your story with evidence funders can trust.
  • Strengthens funding: increases confidence that investment will lead to real outcomes.

What Funders Look For

Funders need to justify every pound. What gives them confidence:

  • Evidence, not anecdotes: stories land better when backed by data.
  • A clear Theory of Change: a believable pathway from activities to outcomes.
  • A learning mindset: reflection, adaptation, and improvement.
  • Transparency: honesty about challenges builds trust.
  • Alignment: wellbeing, heritage, environment, inclusion and other strategic outcomes.
  • Value for money: impact delivered efficiently and sustainably.
  • Proportionate methods: rigorous enough to be credible, realistic enough to deliver.

How Evaluation Builds Credibility

  • Focus effort where it matters: evidence shows what delivers results.
  • Prove and improve: demonstrate outcomes and strengthen delivery over time.
  • Stand out in bids: funders back organisations that can show learning and results.

When You Should Invest

For smaller projects, a light in-house approach can be sufficient — surveys, reflections and basic outcome tracking.

Once a project reaches roughly £50k–£100k+, independent evaluation often represents better value: more stakeholders, greater scrutiny, and more upside from credible evidence.

Need Practical, Funder-Ready Evaluation?

We help organisations measure what matters and turn findings into better decisions — without overcomplicating delivery.

Evaluation. Measurement. Impact.

New Client: Durham County Council – Heritage Places

/in /by

New Client: Shildon & Newton Aycliffe – Shaping the Future Through Heritage

We’re delighted to be working with Durham County Council on an exciting new project that’s putting heritage at the heart of regeneration across Shildon and Newton Aycliffe – two County Durham towns with proud industrial roots, strong communities, and huge potential for renewal.

Building futures from proud pasts

As part of the National Lottery Heritage Fund’s Heritage Places programme, the Shildon and Newton Aycliffe initiative aims to show how local heritage can power skills, creativity, and pride in place. From railways and engineering to community stories, this project is all about connecting people with the heritage that built their towns – and inspiring the next generation to shape what comes next.

What we’ll be doing

At The Evaluator, we’re leading on data analysis and project evaluation, helping the partnership to understand what works, why it works, and how heritage can drive positive, measurable change.

Our role will include:

  • Bringing together heritage, community and demographic data into a single evidence base – spotlighting where activity is strong and where there are gaps to fill.
  • Designing and running a population survey to capture voices from across both towns – with a special focus on children and young people as heritage champions.
  • Facilitating creative engagement sessions with residents who are often under-represented in consultations, so that everyone can contribute to the future of their place.
  • Co-creating a Theory of Change and a practical evaluation toolkit for partners to use long after the project ends – making evaluation simple, useful and built to last.

By combining robust analysis with real stories, we’ll help Durham County Council and partners to turn data into action – informing future investment and keeping heritage at the heart of local development.

Why it matters

This commission isn’t just about measuring outputs. It’s about understanding how heritage strengthens places and people – from boosting local economies to nurturing confidence and belonging. Our work will:

  • Map heritage assets and skills across both towns, highlighting opportunities for learning and employment.
  • Evidence how heritage engagement supports wellbeing, community cohesion and pride in place.
  • Identify investable propositions – clear, evidence-based opportunities to attract future funding and partnerships.
  • Celebrate the voices of local people – especially children and young people – so that they can see themselves as part of their town’s story and future.

A collaborative approach

Our methodology will align with the Heritage Places initiative at national level, ensuring local findings feed into wider learning about how heritage can transform communities. The evaluation will be co-created with partners and participants, grounded in both data and lived experience – because we believe the best insights come from listening as well as measuring.

We’re proud to be part of this next chapter for Shildon and Newton Aycliffe – towns that have always led the way in making and movement, and now stand ready to shape the future through heritage.

If you’re involved in heritage, education, or community work in County Durham and would like to learn more about how to get involved, we’d love to hear from you.

📧 info@theevaluator.co.uk | 📞 01756 532 538