Tag Archive for: Evaluation Tools

Simple evaluation you can do yourself – Three tips to do your own evaluation

/in , /by

Sometimes we get asked to quote for projects and the project is quite small, or the project team is quite small. They don’t have a large budget and although we’re always great value for money, sometimes it’s better to spend the money on delivery.

Our Director, Kirsty, used to run small projects like this and always carried out her own evaluation. She used this knowledge to create ‘The Evaluator’ and wanted to put together a guide for someone who has got a bit of public funding and a small project (maybe £50,000 or less).

If your project is small we recommend you do your own evaluation. There are always exceptions to the rule however and sometimes the project has a strong learning objective, which makes an evaluation particularly appropriate, but as a guide – that’s what we’d recommend.

Say you are running a project and you’ve got, for example  £35,000 worth of funding -how would you attempt to evaluate that? There are some really very simple things that you could do, as follows:

Idea 1: Have an internal focus group.

For example, you might put a meeting together and the three or four people who have been running the project and working on most of the tasks, might sit down and answer these three questions:

What went really well?

What surprised you about the people taking part?

What would you do differently?

Just that alone – having a discussion and applying it, is a really good start.

Idea 2: Mini data analysis.

You keep a note of attendance at events and look to see which days are busiest and do more of them.

Idea 3: Mini research interviews.

Ask the people taking part what they have enjoyed the most – then plan to repeat that for new people.

The important thing is to not see ‘evaluation’ as a big scary thing, but to see it as ‘how can we use the knowledge or information we have to improve’.

Good luck!

VISIT IN PERSON: WE INVENTED THE WEEKEND

/in , /by

We were lucky enough to be invited to evaluate the ‘We Invented the Weekend’ festival at Salford Quays in June 2024. The festival is busy! It attracts thousands of visitors and has; performances, tents, music, shopping, sports, boats, cyclists, dancers, parades, talks – you name it and it is probably taking place across the site. Evaluating something like this requires a lot of energy and luckily The Evaluator has been honing its festival approach for many years now. We don’t often get to work next to celebrities like Bluey and Supertato though! Not forgetting the Gladiators and Mr Motivator!

You can read more about the We Invented The Weekend festival here.

four colourful textiles with the letters W I T W in a grid

We worked with an amazing team of volunteers and two giant dice to collect feedback at the weekend festival. We are very proud to say that across two sites, with a really small evaluation team, we were able to collect almost 500 completed feedback surveys during the weekend itself. We also created a brand-new game which worked really well, involving a giant dice and questions which aligned to the dice roll. This means that we have really good results across a wide cross section of people, great sample sizes and very good data.

 

photogragh of Salford Quays which shows tall buildings and blue skies next to water with people walking

Whilst there, we also carried out extensive footfall counting, to allow us to create a robust estimate of footfall over the whole weekend.

Our surveys are still live for this project and we are looking forward to collecting and analysing all the data over the summer months.

You might spot us at the next couple of festivals we are working on; these are ‘The Festival of Culture’ in Nelson in June and also ‘The National Festival of Making’ in July.

You can see more about The Festival of Culture here, and you can see more about The National Festival of Making here.

We actually evaluate the number of festivals and are happy to come along and support data collection if needed. Our festival analysis includes audience profiles, quality measures, practical experience and ways to improve, alongside footfall and economic impact. We would be happy to have a chat if you have a festival, that you would like to know more about, evaluating. You can call us on 01756 532 538 or email: info@theevaluator.co.uk

What are the Indices of Multiple Deprivation?

/in , /by

What are the Indices of Multiple Deprivation?

If you have ever read one of our reports, you’ll likely see reference to something called the Indices of Multiple Deprivation, or ‘IMD’.

We use the IMD as a powerful tool to analyse and understand the barriers and socio-economic status of audiences, participants, and volunteers. We use postcodes to measure the IMD status, and this means that people find it easy to answer. This does mean that we are looking at the household status too.
The results give our clients an idea of which people they are attracting to their projects and what barriers they may be facing in life.

Statistically, people who live within areas of greater deprivation have more barriers in their lives and are less likely to engage with the arts and nature and are more likely to have greater issues with their wellbeing. That’s one of the reasons funders do like to understand if projects and organisations are reaching people from the most deprived areas.
How are the indices of multiple deprivation worked out?
The IMD is worked out using a range of factors which are assessed across the UK and given a score. The factors are listed below:

  • Income deprivation: how many people in the area are experiencing low-income levels.
  • Employment deprivation: what is the rate of unemployment in the area?
  • Education deprivation: what are the average qualifications within the area, and how easy is it to access quality education?
  • Health deprivation and disability: what is the average life expectancy and disability prevalence in the area?
  • Crime: how much crime occurs within the area
  • Housing deprivation: how affordable is housing within the area, and are there other barriers to people accessing housing
  • Living environment: what is the air quality like in the area, and are there green spaces?

These scores are compiled to give a ranking, which are then categorised into ten deciles. The entirety of England falls equally into one of ten deciles, with decile 1 indicating the most deprivation, and area 10 having the least deprivation.
If you were targeting deprived areas, you might want to reach 50% of people living in IMD1 and 2 for example. Or if you wanted a perfect section of the UK represented in your project, you might want to see 10% of your audience from each decile.

We think the IMD is a useful tool and aim to use it in every evaluation where relevant.