What Is Margin of Error?
Every time you see a poll result reported as "52% ± 3%," that ±3% is the margin of error. It quantifies the uncertainty inherent in using a sample to estimate a population parameter. The margin of error tells you how much the sample result might differ from the true population value due to random sampling variation.
Formally, the margin of error defines a confidence interval — a range of values within which the true population parameter is likely to fall. If a poll finds 52% support with a ±3% margin of error at the 95% confidence level, we can say we're 95% confident that the true level of support is between 49% and 55%.
Understanding margin of error is essential for anyone who consumes research, polling data, or scientific findings. Without it, you can't distinguish between a meaningful lead and statistical noise. A candidate leading 51% to 49% with a ±4% margin of error is essentially tied, despite appearing to be "ahead."
The Margin of Error Formula
For a proportion (the most common use case), the margin of error formula is:
Where:
- z = z-score corresponding to your desired confidence level (see table below)
- p̂ = sample proportion (the estimated proportion)
- n = sample size
Z-Scores by Confidence Level
| Confidence Level | Z-Score |
|---|---|
| 80% | 1.282 |
| 90% | 1.645 |
| 95% | 1.960 |
| 98% | 2.326 |
| 99% | 2.576 |
| 99.9% | 3.291 |
For Means
When estimating a population mean instead of a proportion, use:
Where s is the sample standard deviation. For small samples (n < 30), replace z with the appropriate t-value from the t-distribution with n-1 degrees of freedom.
MOE = 1.96 × √[0.54 × 0.46 / 1000]
MOE = 1.96 × √[0.2484 / 1000]
MOE = 1.96 × √0.0002484
MOE = 1.96 × 0.01576
MOE = ±3.09%
So we're 95% confident that true support for Candidate A is between 50.91% and 57.09%.
Understanding Confidence Levels
The confidence level (typically 90%, 95%, or 99%) defines how certain you are that the true population parameter falls within your confidence interval. But there's a common misunderstanding worth clarifying.
A 95% confidence level does not mean there's a 95% probability that the true value is in your interval. The true value is fixed — it either is or isn't in the interval. Instead, it means that if you repeated the sampling procedure 100 times, approximately 95 of those intervals would contain the true population parameter.
This distinction matters. Think of it like a basketball player who makes 95% of their free throws. Any single shot either goes in or doesn't — there's no "95% chance" for a specific shot. But over many shots, about 95% will go in. Similarly, any specific confidence interval either contains the true value or doesn't, but 95% of such intervals constructed using this method will succeed.
Choosing a Confidence Level
Higher confidence levels produce wider intervals. The tradeoff is between certainty and precision:
- 90% — Used in quick exploratory analysis and business applications where a balance of speed and reliability is needed.
- 95% — The standard in most scientific research, polling, and academic publications. It's the default for a reason: it provides a good balance between confidence and interval width.
- 99% — Used in high-stakes situations like pharmaceutical testing, aerospace engineering, and quality control where the cost of being wrong is very high.
How to Calculate Sample Size
Often, you need to work backward: given a desired margin of error and confidence level, how large does your sample need to be? The sample size formula for proportions is:
If you don't have an estimate for p̂, use p̂ = 0.5, which maximizes the product p̂(1 - p̂) and gives the most conservative (largest) sample size estimate.
n = 1.96² × 0.5 × 0.5 / 0.03²
n = 3.8416 × 0.25 / 0.0009
n = 0.9604 / 0.0009
n = 1,067
This is why you often see national polls with sample sizes around 1,000-1,100.
Sample Size Reference Table
| Desired MOE | 95% Confidence Sample Size |
|---|---|
| ±1% | 9,604 |
| ±2% | 2,401 |
| ±3% | 1,067 |
| ±4% | 600 |
| ±5% | 385 |
| ±10% | 96 |
Margin of Error in Polling
Political polling is where most people encounter margin of error, and it's also where it's most commonly misunderstood. Here are the key nuances:
The "Statistical Tie"
When two candidates are within the margin of error of each other, the race is effectively a statistical tie. If Candidate A leads 51% to 49% with a ±3% margin of error, Candidate A's true support could be as low as 48% and Candidate B's could be as high as 52%. The apparent lead may be entirely due to sampling variation.
Margin of Error Applies to Each Candidate
The margin of error applies to each individual estimate, not to the difference between them. If each candidate's support has a ±3% margin of error, the difference between them has a margin of error of approximately ±4.2% (calculated as √(3² + 3²) ≈ 4.24%). This means a 4-point lead in a poll with ±3% MOE is actually within the combined margin of error.
Non-Sampling Error
Margin of error only accounts for random sampling variation. It does not capture systematic errors like:
- Selection bias: If certain groups are less likely to respond (e.g., young voters who only use cell phones in landline polls)
- Question wording: "Do you support the Affordable Care Act?" vs. "Do you support Obamacare?" can produce dramatically different results
- Social desirability bias: Respondents may give socially acceptable answers rather than honest ones
- Non-response bias: When people who refuse to participate differ systematically from those who do
In practice, non-sampling errors often exceed the reported margin of error, meaning polls may be less accurate than their MOE suggests.
Factors That Affect Margin of Error
Sample Size
The margin of error decreases with the square root of the sample size. Doubling your sample size doesn't halve the margin of error — it only reduces it by a factor of √2 ≈ 1.41. To halve the margin of error, you need to quadruple your sample size. This diminishing return means there's a practical limit to how much precision you can buy with more data.
Population Proportion
The margin of error is largest when p̂ = 0.5 (a 50/50 split). As the proportion moves toward 0 or 1, the margin of error shrinks. A poll finding 95% approval will have a smaller margin of error than one finding 50% approval, all else being equal. This is why the conservative approach of using p̂ = 0.5 for sample size planning is safe — it overestimates the MOE you'll actually get.
Confidence Level
Higher confidence requires wider intervals. Moving from 95% to 99% confidence increases the z-score from 1.96 to 2.576 — about a 31% wider margin of error for the same sample size. The choice of confidence level should reflect the consequences of being wrong, not a desire for an impressive-looking number.
Common Misconceptions
- "A small margin of error means the poll is accurate." Not necessarily. A perfectly conducted poll of 10,000 people could still be wrong if its methodology introduces systematic bias. The 1936 Literary Digest poll had over 2 million respondents but incorrectly predicted Alf Landon would defeat FDR, because its sample was drawn from car registrations and telephone directories — skewing toward wealthier, Republican-leaning voters.
- "The margin of error means the true value is definitely within this range." The margin of error defines a confidence interval, not a certainty. At the 95% level, approximately 1 in 20 intervals will miss the true value.
- "Larger populations require larger samples." Surprisingly, the population size barely matters for large populations. A sample of 1,067 gives roughly the same margin of error whether you're polling a city of 100,000 or a country of 330 million. The sample size needed is almost entirely determined by the desired margin of error and confidence level, not the population size.
- "A 3% margin of error means the result could be off by 3% in either direction." It means the interval extends 3% in each direction from the estimate, so the total width is 6%. This is a subtle but important distinction.
Conclusion
Margin of error and confidence intervals are essential tools for interpreting statistical results. They provide a quantitative measure of uncertainty that allows consumers of research to make informed judgments about the reliability of findings. Whether you're reading political polls, scientific studies, or market research, understanding margin of error helps you distinguish meaningful results from statistical noise. The key is remembering that margin of error captures only random sampling variation — critical thinking about methodology, bias, and context remains indispensable.
📐 Calculate Margin of Error Instantly
Our free Margin of Error Calculator computes confidence intervals and determines the sample size you need. Works for proportions and means.
Try the Calculator →Frequently Asked Questions
What margin of error is acceptable for surveys?
For most business and research surveys, a margin of error of 3-5% is considered acceptable. Political polls typically aim for 3%. A lower margin of error requires a larger sample size, which increases cost.
How does sample size affect margin of error?
Larger sample sizes produce smaller margins of error, but the relationship is not linear. Doubling your sample size reduces the margin of error by roughly 30%. Beyond a certain point, increasing sample size yields diminishing returns.
What confidence level should I use?
The standard is 95% confidence, meaning if you repeated the survey 100 times, the results would fall within the margin of error 95 times. Use 99% confidence for critical decisions, but expect a wider margin of error.