What Happens After You Appoint an External Evaluator?

/in , , /by

What happens after you appoint The Evaluator?

Appointing an external evaluator can feel like handing an important part of your project to people you do not yet know very well. You may be wondering how much time the process will take, what your team will be expected to do, whether the evaluator will understand the work quickly enough, and whether problems will be spotted before the final report.

Those are reasonable concerns. A strong proposal matters, but clients also need confidence in what happens after the contract is signed.

Our job is to make evaluation feel held: clear responsibilities, sensible tools, regular contact and enough challenge behind the scenes to produce findings that stand up to scrutiny. This is the process you can expect from us.

1. We begin by getting the important things out of people’s heads

The first stage is inception. We review the brief, funding requirements, project plans, existing monitoring and any previous research. Then we talk through what the project is really trying to achieve, what is already happening and where the uncertainties sit.

This is often where different strands begin to join up. Projects can involve several partners, audiences, activities, outcomes and reporting requirements. We create a shared picture, agree priorities and make decisions about what the evaluation can realistically answer.

This is often the point when people start to feel excited about the evaluation: the project becomes clearer, the possibilities begin to emerge, and the team can see how the process will support their work. We also begin agreeing the practical arrangements and responsibilities, building these out as the evaluation develops.

2. We turn ambition into answerable questions

Funding applications often contain broad and overlapping ambitions. Our role is to translate those into a focused set of evaluation questions and, where useful, a theory of change.

That means identifying the route from activity to outcomes, the assumptions underneath it and the evidence that will help us judge progress. We also review your targets and deliverables, checking that everyone understands what needs to be counted, how it will be recorded and who will be responsible. Where possible, we establish baselines or sensible comparison points and make clear where evidence will be indicative rather than conclusive.

This work creates the spine of the evaluation. Without it, projects can collect a great deal of information and still struggle to demonstrate what they delivered or answer the questions that matter.

3. We build tools that work in the real world

Next, we develop the evaluation framework and practical toolkit. This could include monitoring templates, surveys, interview guides, observation tools, participant reflection, demographic questions or creative in-person methods.

The right tool depends on the setting. A short community activity, an outdoor festival, a long-term volunteer programme and a strategic partnership cannot all be evaluated in the same way.

We design first for the people who will actually use and respond to the tools, as well as for the evidence the evaluation needs. If you are working with people experiencing deprivation, people facing language barriers, children or people with complex disabilities, we will adapt both the method and the way it is delivered so that participation is practical, appropriate and meaningful.

That might mean using simpler language, visual or creative approaches, supported conversations, shorter questions or accessible alternatives to a conventional survey. We aim to create methods that work in real settings—not polished, bureaucratic tools that look impressive on paper but place unnecessary demands on participants or delivery teams.

4. We make responsibilities manageable

External evaluation works best as a clear partnership. Your team may hold attendance records, capture routine feedback or introduce us to participants. We may lead deeper interviews, focus groups, observation, analysis and independent reporting.

We agree that division early and provide support where needed. This might include a short training session, written guidance, worked examples or a regular check-in. The aim is not to turn delivery staff into researchers. It is to make the information they gather consistent and useful without adding unnecessary weight to their jobs.

5. We check the evidence while the project is live

One of the biggest risks in evaluation is waiting until the end to discover that an important question was not asked or that data has been recorded inconsistently.

We build in proportionate progress and data-quality checks. We look at what is coming in, whether different groups are being heard, where response rates are weak and whether delivery changes affect the original framework. If something is not working, we raise it while there is still time to adapt.

These conversations are not about catching clients out. They are about protecting the final evaluation and helping the project learn during delivery.

6. We analyse, compare and challenge

Analysis is more than summarising a spreadsheet or selecting good quotations. We look for patterns, differences between groups, changes over time and explanations for what we are seeing. We compare monitoring data, surveys, interviews, observation and other sources rather than treating each in isolation.

We also look for evidence that complicates the emerging story. Where samples are limited, baselines are missing or other factors may have contributed to change, we say so. Conclusions are tested within the wider team before they become part of the report.

That internal challenge is a core part of our quality assurance. Accessible writing is the final layer; underneath it sits careful analysis and professional judgement.

7. We turn findings into something people can use

The report should give funders and boards confidence, but it should also help the people delivering the work. We structure findings around the questions and outcomes that matter, show how conclusions were reached, and make limitations clear without allowing them to obscure useful learning.

Recommendations are grounded in the evidence and proportionate to the organisation’s capacity. Depending on the commission, we may also present findings, run a learning session or produce concise visual material for wider audiences.

Our aim is not to leave a large document behind and disappear. It is to help the right people understand what the evidence means and what to do next.

What happens when projects change?

Projects change because funding is delayed, staff move, activities evolve, partners join or audiences respond differently from expected. Evaluation has to be structured without becoming rigid.

We keep the central questions in view, record agreed changes and adapt tools or timing where that protects the usefulness of the work. If a change affects scope or budget, we explain that early rather than allowing a surprise to appear at the end.

What about capacity and continuity?

Clients appoint The Evaluator as a consultancy, not an isolated individual. Each project has clear leadership and project management, with wider team involvement in delivery, analysis, review and cover. Our systems hold actions, deadlines and decisions so that continuity does not rely on one person remembering everything.

That team structure matters. It gives clients consistent contact while bringing more than one perspective to important findings. It also means quality and progress can be protected through busy periods, leave and the ordinary realities of working life.

What we need from you

Good evaluation does require collaboration. We will need timely access to relevant documents and data, honest conversations about delivery, help reaching participants or stakeholders, and enough notice of key events and changes.

In return, we take responsibility for holding the evaluation: keeping the framework coherent, making sense of evidence, identifying risks, asking the difficult questions and turning complexity into clear, useful findings.

If you are planning an evaluation and want to understand what the process would look like for your project, send us your brief—or talk to us before the brief is finished. We will help you work out a proportionate route from the questions you have now to evidence you can confidently use.

Arts Evaluation UK, Capturing Creative Impact, Process and Place

/in /by

Arts and Culture Evaluation

Thoughtful Evaluation for Arts and Culture Work

Arts and culture programmes often explore complex ideas, identity, heritage, place, power and social change. They are rarely linear, often experimental, and frequently shaped by artists working in close relationship with communities.

At The Evaluator, we love working with artists, creatives and organisations exploring ambitious ideas. We bring rigour to creative and sometimes challenging environments, designing evaluation that keeps pace with inventive work while staying simple, honest and useful.

What makes us different is not just our technical expertise, but the way we work. We are guided by values that are creatively simple, honest and useful, which means we design evaluation that respects artistic process as well as accountability. Clients trust us to bring clarity without flattening complexity, helping creative projects capture what matters in ways that are credible, proportionate and genuinely helpful.

If you are pushing boundaries and want evaluation that supports your ambition rather than slowing it down, we will figure it out with you.

Client Highlights, Creative Thinking, Challenging Themes, Artist Led

Our arts evaluation work spans place based programmes, artist led organisations and long term cultural strategies. Here are five examples.

Salford Place Partnership Fund, Culture and Place

Salford, Greater Manchester. This partnership focuses on unlocking grassroots led cultural activity, enabling communities and artists to shape Salford’s cultural future.

  • Co creation processes and power sharing
  • Community and artist relationships
  • How culture shifts when decision making sits with communities, not only institutions

Derbyshire Makes

A county wide, three year programme celebrating making in all its forms, artists, craftspeople, designers and communities across Derbyshire, connecting heritage with new creative futures.

  • How artist led workshops and commissions embed creativity in everyday life
  • Shifts in audience relationships to making, craft and heritage
  • Links between creative practice, innovation, sustainability and community identity

In Situ

Brierfield, Pendle, East Lancashire. An embedded arts organisation working at the intersection of art, community and ecology, collaborating closely with artists and local people.

  • How art, community and environment relationships develop over time
  • Impact of creative residencies on everyday life
  • How complex themes become accessible through artistic practice

Super Slow Way

East Lancashire. A long running place based arts programme working alongside artists and communities, drawing on heritage, environment and local identity.

  • Artist and community dynamics
  • How ambitious creative work reaches new audiences in non traditional settings
  • How the arts shift perceptions of place and belonging

What This Means for Your Arts Project

  • Artist led, experimental work supported by evaluation designed for fluidity, not rigid checklists
  • Process and outcomes both captured, the creative journey is part of the impact
  • Clear focus on who is involved, how they are involved, and what shifts for people, practice and place
  • Space to capture the unexpected, emergent outcomes, stories and insight alongside numbers
  • Useful outputs that strengthen narrative, improve delivery and support future funding

Supporting Arts Organisations With Evidence and Reporting

Alongside independent evaluation, we support arts and cultural organisations with the practical side of gathering, understanding and using their evidence. This includes Arts Council England Illuminate returns, audience and participant research, data analysis and reporting, and the Impact & Insight Toolkit. We regularly work with Arts Council England funded organisations and understand the reporting and evaluation requirements facing NPOs and other funded programmes. We can work with the evaluation approaches and data you already have, or help develop proportionate new methods where needed.

Ready to Build Evaluation That Keeps Pace With Your Work?

If you are an arts organisation working with artists, communities and big ideas, and you want evaluation that is credible, funder ready and creatively appropriate, we can help. We will figure it out with you.

Evaluation, Measurement, Impact.

How to Choose an Evaluation Consultant in the UK

/in , , /by

How to choose the right evaluation consultant for your project

 

Evaluation proposals often share several positive features, including mixed methods, stakeholder engagement, opportunities for learning and a final report. If you are comparing quotes, the difficult question is not whether the right words appear. It is whether the proposed work will produce evidence you can trust—and whether the process will be manageable for your team.

The best evaluator for your project is not necessarily the biggest provider, the cheapest bidder or the proposal containing the highest number of interviews, workshops and site visits. More data collection can sound reassuring, but it may also create a significant workload for your team—particularly if you are expected to recruit participants, coordinate visits or gather the data yourselves. The right evaluator will understand what you need to learn, propose a credible and manageable approach, and have the systems and experience to turn the evidence into useful conclusions.

Here are the things we would look for—even if you are considering somebody else.

1. They understand the purpose, not just the specification

A good proposal shows that the evaluator has understood the project, its context and the decisions the findings need to support. It does more than repeat your brief back to you.

Look for a clear line between your aims, the evaluation questions, the proposed evidence and the outputs. If the method could be copied unchanged into almost any tender, it may not yet be tailored enough.

2. The scope is deliverable — not simply impressive

A long list of interviews, workshops, surveys and site visits can look reassuring. However, every activity requires recruitment, preparation, delivery, recording, analysis and interpretation. When comparing proposals, consider whether the available days and fee genuinely cover the work being promised.

You could also ask bidders to show how their time is divided between project management, data collection, analysis and reporting. This can reveal whether an apparently generous methodology leaves enough time to make sense of the evidence.

An experienced evaluator will make deliberate choices. They may focus interviews on the stakeholders with the clearest view of change, use existing evidence more intelligently or sample activity instead of attending everything. This is not a reduction in quality. It is what makes the work deliverable and protects the quality of the analysis.

3. The methods answer different questions

‘Mixed methods’ is valuable only when the mix has a purpose. Monitoring data might show reach. Surveys might show patterns. Interviews might explain how or why change happened. Observation might reveal something participants do not easily put into words.

The proposal should explain what each source contributes and how they will be considered together. Collecting several types of evidence without a plan for comparison can create more data without creating more confidence.

4. They distinguish contribution from attribution

Real-world projects rarely operate in isolation. People, places and organisations are influenced by many factors. An evaluator should be able to explore how your work contributed to change without automatically claiming it caused everything that followed.

That honesty does not weaken a report. It makes the findings more believable to funders, boards and partners.

5. They make limitations visible

Every evaluation has limitations: incomplete baselines, small samples, uneven monitoring, selection bias or changes to delivery. The question is whether those limits are understood and handled.

Ask how the evaluator will assess data quality, record gaps and test alternative explanations. Be cautious of anyone who appears to guarantee strong impact findings before seeing the evidence.

6. They understand delivery teams

An evaluation framework can be technically excellent and still fail because nobody has time to use it. A good evaluator will ask about capacity, existing systems and the moments when feedback can naturally be collected.

They should be able to simplify tools, provide training, check progress and adapt when delivery changes—without losing sight of the core questions. Evaluation has to survive contact with real life.

7. They can communicate clearly

Evaluation is not finished when the analysis is correct. Findings need to be understood and used. They should also create opportunities to discuss emerging findings while the project is still running. This allows teams to respond to evidence, strengthen delivery and address gaps before the final report. A good evaluation creates useful learning throughout the process—not only at the end.

Look at sample reports if they are available. Can you follow the argument? Can conclusions be traced to evidence? Are charts and case examples doing useful work? Are recommendations specific and proportionate? A polished report is valuable, but clarity matters more than decoration.

8. Quality assurance is more than proofreading

Ask who will challenge the analysis before it reaches you. Strong quality assurance includes checking calculations, testing interpretations, comparing sources, looking for contradictory evidence and making sure conclusions do not run ahead of the data.

It is also worth understanding who will actually undertake the work. Who will design the tools, conduct the fieldwork, analyse the evidence and write the report? How involved will the named senior evaluator remain?

A senior name on the front of a proposal offers limited reassurance if most of the work is delegated without clear oversight. Equally, relying entirely on one consultant can create risks around continuity and internal challenge. Look for a clear delivery team, defined responsibilities and meaningful senior involvement throughout.

9. You know how the relationship will work

A good quote should make the practicalities visible: named contacts, responsibilities, meeting rhythm, milestones, outputs, assumptions and what the client needs to provide. It should explain how changes will be handled and how continuity will be maintained if somebody is unavailable.

You are not only buying a methodology. You are choosing people who will work alongside your team, speak to participants and represent the evaluation with partners. Calm, clarity and responsiveness matter.

Questions worth asking before you appoint

  • Can you show how the proposed days realistically cover recruitment, fieldwork, analysis, project management and reporting?
  • What is/are the most important evaluation question(s) here?
  • What choices have you made to keep the evaluation proportionate and deliverable?
  • How much data collection will our team need to do?
  • How will you know whether the evidence is strong enough?
  • How will you compare different sources and deal with contradictions?
  • Who will conduct the fieldwork, analysis and writing?
  • What happens if delivery or timescales change?
  • How will findings be shared so that people actually use them?

The answers will often tell you more than an extra page of methodology.

What choosing well feels like

The right evaluator will not make every uncertainty disappear at procurement stage. Good evaluation involves learning. But they will make the route feel clearer. You should understand what they are trying to find out, why the approach is proportionate, what your team will need to do and how quality will be protected.

At The Evaluator, our role is to hold the complexity without passing it back to the client. We design rigorous evaluation underneath while keeping the experience straightforward for delivery teams and participants.

Our proposals set out what we will do, who will do it and how the available time will be used. We do not inflate the methodology to make a tender appear more impressive. We propose the work we believe can be delivered properly, with sufficient time for thoughtful analysis, internal challenge and clear reporting.

Our team works together across project management, data quality, fieldwork, analysis and quality assurance. Clients receive a managed consultancy service, with senior oversight and continuity built in, rather than depending on one person holding everything in their head.

If you are preparing an evaluation brief or comparing possible approaches, send us your project outline. We will give you an honest view of what the evaluation needs, what is achievable within the available budget and where we could add the most value.