Module S03

Z-Scores

Standardizing values for comparison

Standardization

  • 01

    The Formula

    z = (x - μ) / σ

  • 02

    Interpretation

    How many SDs from the mean

  • 03

    Standard Normal

    N(0, 1) distribution

  • 04

    Applications

    Comparing apples to oranges

01

The Z-Score Formula

Standardization

z = (x - μ) / σ
x
Your value
μ
Mean
σ
Standard Deviation

The z-score transforms any value into 'number of standard deviations from the mean.' Subtract the mean (center it at 0), then divide by SD (scale it to unit variance).

Before and After

Original Scale
μ = 10070130
→
Z-Score Scale
0-3+3

Standardization shifts the distribution so the mean is 0 and rescales so the SD is 1. The shape stays the same - only the axis labels change.

Calculate a Z-Score

IQ Score Example
Population: μ = 100, σ = 15
Your score: x = 130
z = (130 - 100) / 15 = 30 / 15 = +2.0
Interpretation: 2 standard deviations above the mean

An IQ of 130 is 2 standard deviations above average. This is easier to interpret than '30 points above average' because we know what ±2 SD means in a normal distribution.

02

Interpreting Z-Scores

What Z-Scores Tell You

z < -2
Unusually LOW (bottom ~2.5%)
-2 to -1
Below average
-1 to +1
Typical range (68% of data)
+1 to +2
Above average
z > +2
Unusually HIGH (top ~2.5%)

Z-scores have intuitive interpretations: within ±1 is typical, ±2 is unusual, ±3 is rare. For normal distributions, we know exactly what percentile each z-score corresponds to.

The Empirical Rule

68%within ±1σ-10+1
68% within ±1 | 95% within ±2 | 99.7% within ±3

For normal distributions: 68% of values fall within z = ±1, 95% within z = ±2, and 99.7% within z = ±3. This is the famous 68-95-99.7 rule.

Z-Scores to Percentiles

Z-ScorePercentileInterpretation
-3.00.1%Extremely low
-2.02.3%Very low
-1.015.9%Below average
050%Average
+1.084.1%Above average
+2.097.7%Very high
+3.099.9%Extremely high

Each z-score corresponds to a percentile. z = 0 is the 50th percentile (median). z = +1.645 is the 95th percentile. These conversions are found in z-tables or calculators.

03

Comparing Different Scales

Apples vs Oranges

The Problem
Student A: 85 on Math (out of 100)
Student B: 680 on SAT Math (out of 800)

Who did better? We can't compare directly!
The Solution: Standardize!
Convert both to z-scores, then compare.

Raw scores on different scales can't be compared directly. An 85 out of 100 might be average while 680 out of 800 might be exceptional. Z-scores put everything on the same scale.

Worked Comparison

Class TestSAT Math
Score85680
Mean (μ)75500
SD (σ)10100
Z-Score(85-75)/10 = +1.0(680-500)/100 = +1.8
SAT score (z=1.8) is relatively better than class test (z=1.0)

The class test score of 85 is 1 SD above average (z=1.0). The SAT of 680 is 1.8 SDs above average (z=1.8). The SAT performance is relatively stronger.

Where Z-Scores Are Used

Education
Comparing test scores across different exams
Finance
Risk assessment, unusual returns detection
Medicine
Growth charts, lab value interpretation
Quality Control
Process monitoring, defect detection

Z-scores appear everywhere: standardized tests use them, doctors interpret lab values with them, financial analysts detect outliers with them, and engineers monitor processes with them.

04

Detecting Outliers

The |z| > 3 Rule

|z| > 3
Potential Outlier
In a normal distribution, only 0.3% of values have |z| > 3.

If you find one, it's either:
• A genuine extreme value
• A data entry error
• Evidence the data isn't normal

Values with |z| > 3 are more than 3 standard deviations from the mean - extremely rare in normal data. They warrant investigation as potential outliers or errors.

Finding Outliers

Dataset: Employee salaries (μ = $50,000, σ = $15,000)
$65,000z = +1.0 ✓ Normal
$35,000z = -1.0 ✓ Normal
$85,000z = +2.3 Unusual but OK
$150,000z = +6.7 Outlier!

$150,000 is 6.7 standard deviations above the mean - almost certainly an outlier. Could be an executive, data error, or sign that salary data isn't normal (it's often right-skewed).

★

Real-World Examples

Apply your knowledge to practical scenarios

01

Pediatric Growth Charts

A pediatrician measures a 2-year-old's height at 88 cm. The mean for 2-year-olds is 86 cm with SD = 3 cm. Is this child's height normal?

Q What is the z-score for this child's height? +
A z = (88 - 86) / 3 = +0.67. The child is about two-thirds of a standard deviation above average.
Q What percentile is this? +
A z = +0.67 corresponds to approximately the 75th percentile. The child is taller than about 75% of 2-year-olds.
Q At what height would a doctor be concerned? +
A Typically |z| > 2 triggers concern. That's below 80 cm (z < -2) or above 92 cm (z > +2). This child at 88 cm is well within normal range.
Key Insights
  • Medical charts typically show z-score bands (-2, -1, 0, +1, +2)
  • A single measurement matters less than the trend over time
  • Different populations have different norms - context matters
02

Comparing Athletes Across Eras

Who had the better batting season: Ted Williams (.406 in 1941) or Tony Gwynn (.394 in 1994)?

Q Why can't we compare the raw averages directly? +
A The context changed dramatically. In 1941, the league average was .266 with SD = .032. In 1994, it was .270 with SD = .028. The eras had different baselines.
Q What are the z-scores? +
A Williams: z = (.406 - .266) / .032 = 4.38. Gwynn: z = (.394 - .270) / .028 = 4.43. Gwynn's season was slightly more exceptional relative to his era!
Q Does this settle the debate? +
A Not entirely - z-scores compare to peers, not absolute skill. But it's a fair way to compare across different contexts. Both were ~4.4 SDs above average.
Key Insights
  • Z-scores enable fair comparison across different contexts
  • Being 4+ SDs above mean is extraordinary in any era
  • Statistics must account for changing baselines
?

Z-Scores Quiz

Test your understanding • Passing score: 70%

0 of 6 answered
Q1 multiple-choice

A z-score of +2.0 means the value is:

Explanation: Z-scores measure distance from the mean in standard deviation units. z = +2.0 means exactly 2 standard deviations above the mean.
Q2 calculation

If μ = 50 and σ = 8, what is the z-score for x = 66?

Explanation: z = (x - μ) / σ = (66 - 50) / 8 = 16 / 8 = +2.0
Q3 multiple-choice

In a normal distribution, approximately what percentage falls between z = -1 and z = +1?

Explanation: The 68-95-99.7 rule: 68% within ±1 SD, 95% within ±2 SD, 99.7% within ±3 SD.
Q4 multiple-choice

A negative z-score means:

Explanation: A negative z-score simply means the value is below the mean. z = -1 means 1 SD below average.
Q5 multiple-choice

Why are z-scores useful for comparing scores from different tests?

Explanation: Z-scores standardize different scales to a common metric (mean=0, SD=1), allowing direct comparison of relative standing.
Q6 multiple-choice

A value with z = +3.5 should be:

Explanation: |z| > 3 is rare (<0.3% in normal data) and warrants investigation. Don't delete automatically - it could be genuine or an error.

Quiz Results

0 %

← Central Limit Theorem Next: Standard Error vs SD →