Lisa works in the human resources department at Widgets For All, Ltd. Recently, she’s been hearing rumblings that employees are not happy with their supervisors, but she’s not sure why. Determined to find out what’s going wrong, she sets up one-on-one meetings with every single employee. Unfortunately, none of the meetings are helpful, because no one is willing to say anything negative about their supervisor in this setting.
Frustrated, Lisa decides to send a survey instead, hoping that the anonymity of a survey will make employees feel more comfortable about sharing what they really think. She sits down to create her survey but feels a little stuck and overwhelmed.
Ready to collect quantitative and qualitative feedback?
Build a survey that asks open and closed-ended questions so you can collect a diverse set of data.
Okay, thinks Lisa, let’s start with the basics…
This type of question is known as an ‘open-ended’ or ‘qualitative’ question. It is called ‘open-ended’ because the person responding to it is free to answer in any manner they choose.
There are no response options specified. It is known as ‘qualitative’ because responses are judged and measured by feel rather than by mathematics.
Lisa, anxious for her survey to be a success, thinks about how she’d answer this question about her own supervisor…
The great thing about this data is that if Lisa has no idea why people are upset with their supervisors, it gives them free reign to answer. For example, although Lisa might not have thought to ask specifically about whether a supervisor cultivates a good work-life balance, this might emerge as a theme among responses.
There are, however, some problems associated with open-ended, qualitative questions…
1. What do you mean by that? Qualitative questions can be vague. What do I think about my supervisor? Are you referring to his management style? His fashion sense? His punctuality? His credentials? Re-writing open-ended questions to be more specific can help with that. For example: Please describe your supervisor’s management style.
However, questions may still linger when specific responses are not provided. It would be much easier to answer the following question about supervisor management style:
This type of question is known as a ‘closed-ended’ or ‘quantitative’ question. It is called ‘closed-ended’ because the person responding to it is constricted in the range of options they have to choose from as answers. It is known as ‘quantitative’ because the response options can be converted to numbers. Why does that matter?
2. What on earth should I do with all this data? Working out which questions to ask is tricky, but working out what to do with the answers you get can be even trickier. With qualitative questions, you need to read all of the responses carefully in order to extract common themes. However, this process can be riddled with bias, as you often see only what you want to see in open-ended response answers. That’s why quantitative questions can be so great!
All you have to do is calculate an average of the responses you get; a simple calculation in a spreadsheet with no hours of reading required. This also makes more complex analyses, such as group comparisons, lightning fast. Simply calculate an average for each group, compare them and you’re done!
3. What else is in it for me? The other thing to know about qualitative questions is that they take a really long time to answer. As a survey respondent, it’s much faster to choose one of five preformulated options than to have to take the time to write your own response. And, as we’ve mentioned before, keeping surveys short ensures that respondents remain focused and interested. So not only will you get to ask more questions when you use quantitative questions, but it will also get you better data. Getting the most accurate data possible means that you’ll make the right decision every time.
So what’s the bottom line? Qualitative questions are a fantastic first step towards exploring the minds of the people you want to survey, but they shouldn’t be the only type of questions you ask. Using quantitative questions makes questions clearer, analysis simpler and data quality better.
Take the time now to think of some specific quantitative questions to ask. Trust us, you’ll be glad that you did! As for Lisa, here’s hoping she worked out the right quantitative questions to ask to get the answers she needed.
