How many survey responses do I need to be statistically valid? Find your sample size.

As you look to run a research project, you’ll inevitably be tasked with determining a statistically significant sample size of respondents.

Fear not, because we have an easy method for you to use in defining the appropriate sample size.

In technical terms, the question of how many responses you need for your survey to be valid goes straight to the concept of survey sample size. (Read all about it by following that link.) For now, you’re OK knowing that there’s a certain number of survey respondents you need to ensure that your survey is big enough to be reliable or ‘statistically significant’.

To get to this number, use our sample size calculator or use the convenient table below, which will help you understand the maths behind the concept.

The first steps in determining the sample size depend on the following factors:

1. How many people are in your population?

This is fairly simple. Your population is the total target audience or market whose views you’re interested in. It could be anything from the total U.K. adult population, to executive women between 25 and 35 years old who hold graduate degrees, to homeowners in the Leeds metropolitan area.

2. How representative do your survey results need to be?

This one is a bit trickier. The more straightforward way to look at it is like this: The closer your sample is in relation to the total population, the more representative your results are likely to be. Of course, if you surveyed every single homeowner in Leeds, you’d be fairly certain that your results represented the views of the whole home-owning population, wouldn't you? However, since it’s almost impossible to survey 100% of any particular population, the next best thing is a well-designed survey where you have an acceptable level of tolerance for inaccuracy.

Let’s have a look at the table to understand this last point. You’ll notice that if you allow for greater inaccuracy – or margin of error – the recommended sample size (how many responses are needed) gets smaller. If you can live with a 10% margin of error, you'll only need responses from 80 out of 500 people, as opposed to 220 for a 5% margin or 345 for a 3% margin.

Respondents Needed at Error of ±3%, ±5% and ±10%

The level of tolerance for inaccuracy will depend on your confidence in being able to make decisions based on the data you obtain and, of course, on the importance of the decisions you’re making. Are you surveying your university friends about where to hold the alumni annual meetup this year? Perhaps you can afford to have a greater margin of error. On the other hand, if you are in charge of divvying up your company’s annual marketing budget, it’s best to keep the margin of error relatively low so that you can be confident that you’re making the best decisions for your team.

Are you running an AB test? If so, calculate the statistical significance of your results in seconds using our calculator.

Let’s say you want to find out how many people in your region of 10,000 inhabitants favour a longer school day for children. Let’s also assume that you’re willing to accept an error of plus or minus 10%.

You use a sample size of 100 people, as the table recommends, and find that 70% of your respondents are in favour of a longer school day. Given your 10% acceptable error rate, you can assume that if you’d asked every person in your region to take your survey, the actual proportion in favour of the longer school day would range from 60% to 80%.

But what if that range is too big? What if you need to be more precise? If this is the case, consider surveying more people. For example, assuming a population size of 10,000, you can see that you would need 385 survey respondents for a 5% margin of error.

Related: How to use screening questions in your survey

The table recommends the sample size you’ll need. However, this means completed questionnaires: You need to get survey respondents – not just people you invited to take the survey – until you have enough to match that number.

For example, assume you need 100 respondents and you expect that 20% of the people invited will actually respond. You would then need to invite 500 people (100 respondents ÷ .20 response rate = 500 invitations).

Even if you don’t feel comfortable estimating your response rate, we recommend starting with a relatively high figure. This is because you can normally send the survey to additional recipients in the future if necessary.

Even if you don’t hold a PhD in statistics, you now have a handy tool to estimate how many people you need to respond to your questionnaire and have a statistically significant data set.

We have a lot more knowledge for you. Read our pages to learn more about: sample size, our sample size calculator and our margin of error calculator.

By reading these pages, you’ll always know how many respondents you need to make decisions with confidence, whether it’s based on your marketing budget or, more importantly, the best pub to go to for happy hour!