Play SignalForge

Split

A FAIR TEST CHANGES ONLY ONE THING

Loading audio…

Press play to listen along. The line being read lights up as you go.

Show full transcript

Loading transcript…

01 Opening
Split beat 1 of 5

Split loved a clean experiment the way some people love a tidy room. When the young creators wanted to know why one version of a post did better, Split didn't guess — Split set up a fair test, and a fair test had exactly one rule.

"Change one thing," Split said, laying two nearly-identical cards side by side. "These two are the same in every way — same story, same length, same everything — except one difference I chose on purpose. If one wins, I know exactly why, because only one thing was different. That's a fair test. That's the whole game."

02 Split
Split beat 2 of 5

Split taught the first Advanced idea by breaking the rule on purpose, to show the wreck.

"Watch what happens if I get greedy," Split said, and made a second pair — but this time changed two things at once, a new title and a new picture. One card won. "Now tell me why it won." The young creators opened their mouths and stopped. "Exactly. You can't. Was it the title? The picture? Both? Neither, and just luck? You changed two things, so the credit is tangled between them forever. That tangle has a name — a confound — and it ruins the test. Two changes at once don't give you two answers. They give you zero."

The young creators felt the trap close. It was so tempting to improve two things at once — and that temptation was exactly what made the result meaningless.

03 Split
Split beat 3 of 5

Split named the two sides of a fair test.

"The card you leave alone is the control," Split said. "The card with the one deliberate change is the treatment. The control is your ruler — without something held steady to compare against, a change tells you nothing, because you don't know what would have happened anyway. Maybe both versions would have done better today for some outside reason. The control catches that. Always keep one thing steady to measure the other against."

04 Split
Split beat 4 of 5

Then Split taught the deepest idea, the one that outlives any single test.

"Even in the wild, without an experiment, remember this," Split said. "When two things happen together, that is correlation — they moved alongside each other. It does not prove one caused the other. Ice cream sales and sunburns rise together, but ice cream doesn't cause sunburns — the sun causes both. A fair test is precious because it's the one way to turn 'these happened together' into 'this actually caused that.' Outside a fair test, hold your conclusions loosely: alongside is not the same as because."

05 Closing
Split beat 5 of 5

The test came when Devi swore a new thumbnail and a new posting time had doubled a video's reach.

"So which one did it?" Split asked.

Devi paused, then grinned ruefully. "I changed both. I can't actually tell."

"Then you've got a confound, not a finding," Split said, not unkindly. "Run it again — new thumbnail, same time. Then you'll know. Change one thing, keep the rest the same. That is the only way to know what actually made the difference — everything else is just two things that happened to show up together."

Hear it as an audio drama

A short play starring Split, from SignalForge. Different voices, same idea. Listen any time after you read.

Loading audio…

Read the drama script
  1. Narrator: From Spark and Anvil and Signalforge — this is Split, in chapter 1 of the Signalforge cast.
  2. Narrator: This drama uses an AI-generated voice. Voiced via Gemini 2.5.
  3. Narrator: Split loves a clean experiment the way some people love a tidy room, and a fair test has exactly one rule.
  4. Narrator: A young creator named Devi swore that a new thumbnail and a new posting time together had doubled a video's reach.
  5. Devi: I changed the thumbnail and the posting time, and the reach doubled. My new approach clearly works.
  6. Split: So which one did it — the thumbnail or the time? Change one thing, keep the rest the same, and if one wins, you know exactly why.
  7. Split: When you change two things at once and one card wins, you can never tell which change earned the credit. That tangle has a name — a confound — and it ruins the test.
  8. Devi: So two changes at once don't give me two answers. They give me zero.
  9. Split: Exactly. The card you leave alone is the control, and the card with the single deliberate change is the treatment. The control is your ruler.
  10. Split: Without something held steady to compare against, a change tells you nothing, because maybe both versions would have done better today for some outside reason. The control catches that.
  11. Split: And remember this even outside an experiment. When two things happen together, that is correlation — it does not prove one caused the other.
  12. Split: Ice cream sales and sunburns rise together, but ice cream doesn't cause sunburns — the sun causes both. Alongside is not the same as because.
  13. Narrator: Devi grinned ruefully, then set up a clean version — the new thumbnail with the same old posting time.
  14. Devi: Now if it wins, I will actually know it was the thumbnail. I finally have a fair test.
  15. Split: That is the whole game. A fair test is precious because it is the one way to turn "these happened together" into "this actually caused that."
  16. Narrator: Devi ran the clean test and, for the first time, trusted the answer.
  17. Split: Change one thing, keep the rest the same. That is the only way to know what actually made the difference.
  18. Narrator: You've been listening to a Spark and Anvil chapter, written by the Spark and Anvil writing team for ages 9 to 14.
  19. Narrator: Apps stay free forever.
  20. Narrator: Curriculum aligned to Common Core and Next Generation Science Standards.
  21. Narrator: Released under Creative Commons BY-NC-SA 4.0 for educational reuse. Visit Spark and Anvil for the full transcript.

The SignalForge ensemble

Split is one of the friends in SignalForge. Each friend shows you one idea by how they act; meet them all and you have the whole subject.