Main Menu


In-house Training

Consultancy

Courses

Courses by Subject

Courses by Role

Courses by Phase

Courses by Country

Courses by Focus Area

Developing School Questionnaires – The 7 Steps to Success

Maths Teaching Ideas: 10 Great Maths Games SitesRegular readers will know that I have a keen interest in student voice, and to get student voice really right you’ve got to know what you’re doing when you come to questionnaire design.

With student, parent and staff voice you’ll get really important feedback from your questionnaire if it’s done right – but you’ve got to really careful in your design otherwise you’ll get bad results that will set you on the wrong track.

To avoid yourself falling into this trap, here’s a brief guide for how to put together effective questionnaires.

 

 

Step 1 – Do You Really Want a Questionnaire?

A questionnaire is a powerful tool, but it’s not the only tool to get meaningful feedback on things. Structured interviews, focus groups and data analysis can also provide many meaningful insights – you need to pick the right tool for the job. Generally data analysis is best when the data is reliable – it shows what people actually do rather than what they say they do. But data isn’t always available. Structured interviews can be a really interesting way of exploring a topic, and focus groups work well if there’s a strong social dimension to the question you’re asking.

 

Step 2 – Don’t Over Specify

Let’s take an example. You want to know what activities your students would like to do during lunch break. A classic question would then be to ask if they wanted to do Football, Basketball, Rounders or Cricket. Classic, but also potentially misleading. Those might be the only options we could think of, but it’s certain that the students will have other things they’d like to do as well. You can get around this by having an Other box (and I’d recommend you do this anyway). But to some extent that destroys the power of questionnaires – to give you the actual numbers of people who think certain things. Much better to do a bit of research before you write your questionnaire – chat to a few students and make sure you have an idea of the options they’d like, then make it scientific by getting exact data on how many people want what. Then you don’t fall into the trap of You don’t know what you don’t know.

 

Step 3 – Don’t Lead, and Don’t Allow People to Hedge

Most people will know not to write leading questions like “Don’t you think homework’s rubbish?”, but it’s equally important to force people into making a choice. Otherwise you’ll just have hordes of people plumping for the middle option. If you use a point scale in your questions make it 1 to 4 rather than 1 to 5 so there’s no middle ground.

 

Step 4 – Allow Plenty of Opportunity for Long Answers

Longer answers are often neglected on questionnaires, and while they don’t provide easily analysable data they do give you an insight into why people think things, rather than just what they think. So only 80% of people hand in their homework. That’s interesting in and of itself, but it becomes actionable by senior management when you start to understand why that 20% don’t. Once you know it’s because they forget, or because they do too much outside school, or there isn’t a comfortable place to work it becomes something you can actually fix.

 

Step 5 – Ask Enough People

The classic technique of cosmetics firms “90% of women thought Pantene gave them shinier hair” … based on a survey of 20. You find me enough sets of 20 or 30 people and I reckon I can get the questionnaire to say pretty much anything. The data gets more reliable the more people you ask. If you don’t get many responses it will still give you valuable information on the kinds of things people can think, but not what they actually do think and in what proportions.

 

Step 6 – Make Sure The Group Isn’t Disporportionate

I remember overhearing at a governing training session about a governor from a primary school who was trying to find out the best time for their parents evening. So they interviewed parents at the school gates, and they found the best time was during the day. They scheduled it for then and had a small revolt on their hands. The working parents who perhaps picked their children up a little later or had siblings walk them home weren’t present, the school got a skewed result and ended up drawing the wrong conclusion. You can never quite rule out a biased sample (and there’s so many ways to be biased – can all the parents even speak enough English to take part?) but you just have to try and to avoid it wherever possible.

 

Step 7 – Test It First

Who would have thought a questionnaire could be so complicated? But even after all this work people can still interpret questions in unexpected ways. The best way to go is to test the questionnaire on a small sample first (say 10 or 20 people) just to make sure you’re getting the kinds of answers you were looking for.

That’s it! Questionnaire nirvana!

For those looking for a bit more information there’s a really good (and short) book on the topic you can get here.

4 responses to “Developing School Questionnaires – The 7 Steps to Success”

  1. Avatar Peter Hirst says:

    Thanks for the post Tom! For me, the problem with a questionairre is that it’s inherently one-way and really dull to complete. There’s generally no opportunity to deviate from the questions, propose new questions, see and interact with other people’s answers – basically everything good student voice should be about. Questionairres have their place for stats – but as you say, you can provide any stat you like if you try hard enough ;) People use a questionairre when they want to include lots of people in a conversation but can’t fit them all in the same room – but by doing so limit the conversation suggesting that your opinion, on one day, written on your own in isolation (regardless of mood) is what they’re basing decisions about you on… The interesting point for me is 3 – not allowing someone to ‘hedge’ masks the fact that they may not care about the outcome of your question either way. By forcing them to answer you effectively fabricate answers don’t you?

    • Avatar Peter Hirst says:

      Oops… two ‘n’s’ and one ‘r’ in Questionnaire….!

    • Avatar Tom Hesmondhalgh says:

      Thanks Peter – some really good points there. I think isn’t it a question about at what stage the questionnaire is used? You’re right that a questionnaire on its own isn’t much of a conversation. But equally you can only have a conversation with one person – you can’t have it with a year group or a school and if you just come to answers by interacting with the students alone then you may only hear the loudest voices – rather than the majority opinion. That said, that initial interaction is crucial – you have to work out all of the options (as far as you can)) first to make sure you have a complete universe of choices for each question.

      I suppose the process is Interact (find out options), Survey (find out how many have each option), Interact (find out why that’s the case).

      Ultimately it’s a little how democracry ought to work – you debate and then you survey – except that in schools that voting may be done through a questionnaire (or equally a school council)

      • Avatar Peter Hirst says:

        Apologies, horrifically slow at responding!! Stumbled back across this post and realised you’d replied…

        Can you only have a conversation with 1 person? I totally agree that conventional, verbal conversations do certainly favour the loudest not the ones with the best ideas. We have tried to create an opportunity for everyone in the school to engage in conversations from the outset the – gathering of ideas, find out who agrees, find out why – process you identify happens at the same time at http://www.every1speaks.com. Please sign up for a free trial and see how it’s an alternative to surveys….

Leave a Reply

Tom Hesmondhalgh

< Back