How to make evaluation useful in complex projects

Good evaluation in complex projects should bring clarity, not confusion. When projects are collaborative, fast-moving or evolving as they go, evaluation can quickly become heavier than it needs to be.

 

When projects are collaborative, fast-moving or evolving as they go, evaluation can sometimes become heavier than it needs to be.

People worry because the work is complex, the evaluation has to be too. They are concerned that they need to measure everything, hear from everyone and produce huge amounts of data to prove value.

Good evaluation in real-world projects does not work like that.

It is not about collecting the maximum possible amount of information. It is about collecting the right evidence, in the right way, at the right level, so it fits delivery and actually gets used. That’s what makes for good evaluation in complex projects.

Complex does not mean measuring everything

One of the most common mistakes we see is the assumption that every participant needs to fill something in, and every part of the project needs to be measured in detail.

Usually, that is neither realistic nor useful.

A good sample is a good sample. If it is worked out carefully, it can give you robust insight without requiring every single person to complete a survey. That matters especially in busy, public or time-limited settings, where asking too much can damage the experience rather than improve the evidence.

Good evaluation is not about exhausting your audience. It is about making sensible choices.

Proportion matters

This is where proportionate evaluation really comes in.

If someone has volunteered on a project every week for almost a year, has given a lot of time and built a meaningful relationship with an activity, then a 20 or 30 minute conversation may be entirely proportionate. In fact, that kind of deeper reflection can be exactly what helps you understand change, value and learning.

But if someone is attending a one-off training session, festival or short event, the right ask may be only a few seconds. A quick question, a simple rating, a brief reaction. In that context, a long survey is not good evaluation. It is a bad fit.

The method should match the nature of the participation.

The real problem is often not too little data, but too little focus

Sometimes organisations have not had enough time to get clear on what they are really trying to achieve.

When that happens, evaluation spreads too thin. People try to measure too many things, worry about every target at once, and collect information without a clear sense of what matters most. The result is often lots of data, but not much insight.

We also regularly see organisations holding pages of analytics, reporting dashboards or monitoring returns that they do not really know how to interpret. The challenge is not always collecting the data. More often, it is understanding what it means and how to use it.

Data becomes powerful when it has context

A single big number is rarely enough on its own.

Data starts to become useful when it is compared to something else: a baseline, a previous month, a different group, a previous phase of delivery, or the change a project was actually trying to create.

For example, knowing what result you got in April may be mildly interesting. Knowing how April compares to March is often much more helpful. That is what begins to show direction, pattern and change.

This is where evaluation becomes practical. It helps people make sense of what is happening, not just record that something happened.

Good evaluation should help people use their limited time well

At its best, evaluation is not just there to satisfy a funder or complete a report. It should help delivery teams think more clearly, focus their energy and improve what they do.

That is why we put so much emphasis on proportional evaluation. We want it to feel reasonable for participants, manageable for staff and suited to the scale of the work. We want to collect less, but use it better.

If we come in early enough, we can often help sharpen that focus from the start: what matters most, what is realistic to gather, and where evidence will actually help people make decisions. If we come in later, we can still help make sense of what exists. But the strongest evaluation is usually built in early, with enough structure to be credible and enough flexibility to work in the real world.

• Complex projects do not need evaluation that is heavier, louder or more complicated.
• They need evaluation that is thoughtful, proportionate and useful.
• Because messy does not mean unmeasurable. It just means the approach needs to be smarter.

Working on something complex, collaborative or still evolving? We help charities, cultural organisations and partnerships build evaluation that is proportionate, credible and genuinely useful.