Sample

Sample taught the first Advanced idea with a coin, not a chart.

"Flip a coin four times and you might get three heads," Sample said. "Does that prove the coin is unfair? Of course not — with only four flips, three heads is ordinary luck. But flip it a thousand times and get seven hundred heads, and now something's genuinely strange." Sample let that land. "That's the whole idea. With a small sample, luck can swing the result wildly — a couple of extra chance-clicks and one version looks like a winner. With a big sample, luck averages out and the true number shows through. Small samples are noisy; big samples are steady. The number doesn't change its nature — it just gets quieter as more data arrives."

"This has a name worth keeping," Sample went on. "The law of large numbers. As your sample grows, your measured result gets closer and closer to the true rate underneath. Ten viewers tell you almost nothing. A hundred start to whisper. A thousand speak clearly. So the size of the sample isn't a boring detail — it's the difference between a rumour and a fact."

The young creators started asking a new question about every result they saw online: not just "what did it find?" but "how many people was that based on?" A shocking claim from a handful of people, they learned, was a rumour wearing a lab coat.

Then Sample taught the trap that catches the impatient — stopping early.

"Here is the sneaky one," Sample said. "Early in a test, the numbers swing the most, because the sample is smallest. So if you watch a test and stop it the instant it looks good, you are basically stopping on a lucky swing — you've chosen the noise. That's called stopping early, and it's a way of fooling yourself that feels like being decisive." Sample's patient eyes were firm. "Decide how much data is enough before you start. Then wait for it. A result you grabbed because it looked good early is a result you can't trust — you didn't measure the world, you measured your own impatience."