Skip to content

Diagnostic Testing: Do the stats tell you what you need to know?

April 6, 2026 · 1 h 7 min

Show notes

Diagnostic testing: what do those statistics actually tell you? Sensitivity, specificity, positive predictive value . . . you’ve probably seen these terms before. Maybe you memorized them for a test. But do you actually know what they mean? In this episode, we take a closer look at how diagnostic tests are evaluated—and how they’re often misinterpreted. From a genetic test for cellulite to a blood test for autism, we explore how “statistically significant” findings can turn into tests that don’t actually help anyone. Along the way we meet the freckle gene, the wanderlust gene, and infidelity gene.


Statistical topics

  • Base Rate
  • Bayes Rule
  • Case-Control Study
  • Matching
  • Conditional Probability
  • Sensitivity
  • Specificity
  • Positive Predictive Value
  • Prevalence
  • Negative Predictive Value
  • False Positives and Negatives
  • True Positives and Negatives


Methodological morals

  • “A biomarker paper is not the same thing as a biomarker test.”
  • “If your sample doesn't match the real world, then for all of your positive predictive value needs, call on Bayes' theorem.”


Detailed Show Notes with calculations


References

Kristin and Regina’s online courses


Find us on:

Kristin - LinkedIn & Twitter/X

Regina - LinkedIn & ReginaNuzzo.com


  • (00:00) - Introduction
  • (02:24) - The Cellulite Test
  • (06:41) - Understanding Sensitivity and Specificity
  • (12:50) - Enter Positive Predictive Value
  • (18:40) - Why Base Rates Matter
  • (24:06) - More Ridiculous Tests
  • (33:30) - The Wanderlust Gene Deep Dive
  • (41:27) - The NeuroPoint Autism Test
  • (53:34) - Trying to Set the Record Straight
  • (01:02:39) - Personal Stories
  • (01:05:54) - Wrap-up


All episodes of Normal Curves: Sexy Science, Serious Statistics

Settings

Display

Language

Decides which stations you see first on the home page.

History

Recently played stations and episodes and your latest searches are only stored in this browser.

Notifications

A short notice when a podcast you follow has a new episode. Turn off single podcasts with the bell on their page.

Account

Save favorites – in the app and on the website.

Keyboard shortcuts

/
Open search
Space
Play or pause
← →
In the player: back 15 s, forward 30 s (episodes) · in a row: next tile
↑ ↓
In a row: target within the tile
Home / End
In a row: first or last tile
Esc
Close window or menu
?
This overview
Now playing

Go to station page

Play next

    Add episodes with “Play next” – they play after the current episode.