Split

A FAIR TEST CHANGES ONLY ONE THING — to know what caused a difference, hold everything constant except the single variable you test (control vs treatment); change two things and you have a CONFOUND you can never untangle, and a difference that just happened alongside another is CORRELATION, not proof of CAUSE

Loading audio…

Press play to listen along. The line being read lights up as you go.

Show full transcript

Loading transcript…

01 Opening
Split beat 1 of 5

Split loved a clean experiment the way some people love a tidy room. When the young creators wanted to know why one version of a post did better, Split didn't guess — Split set up a fair test, and a fair test had exactly one rule.

"Change one thing," Split said, laying two nearly-identical cards side by side. "These two are the same in every way — same story, same length, same everything — except one difference I chose on purpose. If one wins, I know exactly why, because only one thing was different. That's a fair test. That's the whole game."

02 Split
Split beat 2 of 5

Split taught the first Advanced idea by breaking the rule on purpose, to show the wreck.

"Watch what happens if I get greedy," Split said, and made a second pair — but this time changed two things at once, a new title and a new picture. One card won. "Now tell me why it won." The young creators opened their mouths and stopped. "Exactly. You can't. Was it the title? The picture? Both? Neither, and just luck? You changed two things, so the credit is tangled between them forever. That tangle has a name — a confound — and it ruins the test. Two changes at once don't give you two answers. They give you zero."

The young creators felt the trap close. It was so tempting to improve two things at once — and that temptation was exactly what made the result meaningless.

03 Split
Split beat 3 of 5

Split named the two sides of a fair test.

"The card you leave alone is the control," Split said. "The card with the one deliberate change is the treatment. The control is your ruler — without something held steady to compare against, a change tells you nothing, because you don't know what would have happened anyway. Maybe both versions would have done better today for some outside reason. The control catches that. Always keep one thing steady to measure the other against."

04 Split
Split beat 4 of 5

Then Split taught the deepest idea, the one that outlives any single test.

"Even in the wild, without an experiment, remember this," Split said. "When two things happen together, that is correlation — they moved alongside each other. It does not prove one caused the other. Ice cream sales and sunburns rise together, but ice cream doesn't cause sunburns — the sun causes both. A fair test is precious because it's the one way to turn 'these happened together' into 'this actually caused that.' Outside a fair test, hold your conclusions loosely: alongside is not the same as because."

05 Closing
Split beat 5 of 5

The test came when Devi swore a new thumbnail and a new posting time had doubled a video's reach.

"So which one did it?" Split asked.

Devi paused, then grinned ruefully. "I changed both. I can't actually tell."

"Then you've got a confound, not a finding," Split said, not unkindly. "Run it again — new thumbnail, same time. Then you'll know. Change one thing, keep the rest the same. That is the only way to know what actually made the difference — everything else is just two things that happened to show up together."

The SignalForge ensemble

Split is part of SignalForge's distributed-narrative cast. Each character embodies a different curricular primitive; together they teach the full subject.