Tidy
DATA CLEANING
Loading audio…
Press play to listen along. The line being read lights up as you go.
Show full transcript
Loading transcript…
Tidy is a raccoon-tween — warm grey, cream, and soft black, with chunky face-markings that read like a friendly mask, not a spooky one. Her hands are quick and gentle, and she is careful with everything she touches.
Tidy always keeps a small pale-grey notebook open on her workbench: her cleaning-log, "CLEANING LOG" printed neat on the cover. That log is her whole craft: data cleaning. Real data arrives a mess — missing numbers, repeated lines, typos, wild too-big-or-too-small outliers, mismatched formats and units. Cleaning it up is necessary before you can make any sense of it. But here's the thing most people miss, and the thing Tidy will never let a kid forget: "Cleaning is not housekeeping," she says. "Every cleaning choice changes what the data means. Drop the rows with missing numbers and you might see only half the story. Fill them with an average and you hide the real differences. Toss the outliers and you might throw away the most important fact." The craft isn't to avoid cleaning — that's impossible — it's to make every choice visible, written down in the log.
Tidy learned that sorting is never neutral in a small village, where her family were the grain-sorters.
Every harvest, the grain had to be split — some for cooking, some for the mill, some saved to plant next year — and every split was a choice. "If a sorter couldn't explain her choices," Tidy says, "people stopped trusting her, and the millers took their grain elsewhere." She watched a careless sorter lose the whole village's trust by sorting quietly, by feel, with no way to say why.
"By the time I was six," Tidy says, "I understood: sorting is always a choice, and the choice has to be shown to be trusted." That was the seed of the cleaning-log — the idea that the honest move isn't to pretend you didn't change anything, but to write down exactly what you changed, and why, so anyone can check.
When Tidy was twenty-two, she walked to the DataForge academy, where a young apprentice met her at the door.
"What is data cleaning?" the apprentice asked.
Tidy answered right away. "Getting the data ready — but doing it honestly. Every cleaning choice changes the meaning, so you write the choices down. The log is the data's memory. Without it, the whole analysis is built on secret choices."
The apprentice smiled. "Will you teach us that?"
In her workshop, Tidy opens the cleaning-log flat on the bench, writes the data's name at the top of a fresh page, and teaches the discipline as one honest habit. First, read the collector's notes — you need to know how the data was gathered before you touch it. Then look closely before you clean — the first twenty rows, the quick spread of the numbers — so you know what you started with. Find the problems — the gaps, the duplicates, the typos, the outliers, the mismatched formats. Then, for each problem, list the different ways to fix it — a missing number could be dropped, or filled with an average, or a middle value, or a careful guess, or simply left missing; each way has a good side and a bad side. Choose on purpose, knowing why — never just grab the first fix. Then write the choice in the log: the date, what you did, why, what the data looked like before, and after. Never overwrite the raw data — always work on a copy, so you can always go back. And share the log — the next person, and future-you, will need it; the log is part of the data. "And when I get a choice wrong," Tidy adds, "and I find out later — that's not failing. That's exactly why the log is here. I go back, I change the choice, I update the log. Being clear about it is the whole point."
"So the honest move isn't to hide that I changed things," a kid said slowly, "it's to write down that I did?"
"That's the whole craft," Tidy said warmly. And she watched the kid open a fresh page and record their first real cleaning choice — what they did, and why — instead of quietly changing a number and hoping no one would ask. Something eased in the kid's shoulders as they wrote: not the small, uneasy weight of a secret change carried alone, but the calm, clean, standing-behind-your-work feeling of a choice made out in the open, where anyone could check it and trust it. That calm, nothing-to-hide, owned-out-loud feeling — steadier than any tidy-looking secret — was, to Tidy, the real reward of the craft. She closed the cleaning-log gently. The next set of data was waiting for her careful hands.
Hear it as an audio drama
A short play starring Tidy, from DataForge. Different voices, same idea. Listen any time after you read.
Loading audio…
Read the drama script
- Narrator: From Spark and Anvil and DataForge — this is Tidy, in chapter 1 of the DataForge cast.
- Narrator: This drama uses an AI-generated voice. Voiced via Gemini 2.5.
- Narrator: Tidy is a small raccoon-tween character. She has warm-coded chunky-cartoon black-and-white markings — softly rounded, friendly, never sinister. She carries a small bound cleaning-log notebook strapped to her side.
- Narrator: She is small. Warm-grey and cream and soft-black. Quick-handed. Meticulous. The cleaning-log notebook is bound in pale-grey cloth and labeled CLEANING LOG in tidy block letters.
- Tidy: My cleaning-log is open on my workbench whenever I'm working a dataset. The log records what cleaning choices I made. Why. What the data looked like before. What it looks like after.
- Narrator: Tidy is all about data cleaning. The data-pipeline skill of preparing data without pretending the preparation is neutral.
- Tidy: Real datasets are messy. Missing values. Duplicate rows. Typos. Outliers. Mismatched formats. Inconsistent units.
- Tidy: Cleaning is required to make most analyses possible. But every cleaning choice changes the dataset's meaning.
- Tidy: Dropping rows with missing values can bias the data toward complete-records-only. Imputing missing values with the average smooths over real variation. Removing outliers can remove the most-important data points. Renaming categories to standard labels sometimes loses information.
- Tidy: The skill is not avoiding cleaning. That is impossible. The skill is making every cleaning choice visible in the cleaning-log.
- Tidy: Cleaning is not neutral. Every cleaning choice changes the meaning. Document the choices. The next analyst — or future-you — needs to know what you did, why, and what the data looked like before. Without the cleaning-log, the analysis is unreproducible.
- Narrator: Tidy teaches the cleaning scaffolds.
- Tidy: Read the collection notes first. Cleaning depends on knowing how the data was collected.
- Tidy: Inspect the data before cleaning. Look at the first twenty rows. Look at the summary statistics. Look at the distribution of each variable. Know what you're starting with.
- Tidy: Identify the cleaning issues. Missing values? Duplicates? Typos? Outliers? Mismatched formats?
- Tidy: For each issue, list the alternatives. For missing values — drop the row, impute with average, impute with median, impute with prediction, leave as missing. Each alternative has trade-offs.
- Tidy: Choose deliberately. Don't choose by default. Choose with awareness.
- Tidy: Document the choice in the cleaning-log. Date. Dataset. What you did. Why you did it. What the data looked like before. What it looks like after.
- Tidy: Preserve the original. Never overwrite the raw data. Always work on a copy.
- Tidy: Make the cleaning-log available to downstream analysts. Including future-you. The log is part of the dataset.
- Narrator: When Tidy walked into the DataForge academy, a young apprentice at the door asked her a careful question.
- Apprentice: What is data cleaning?
- Tidy: It is preparation-with-integrity. Every cleaning choice changes the meaning. Document the choices. The cleaning-log is the conscience of the pipeline. Without it, the analysis is built on invisible decisions.
- Apprentice: Will you teach us that?
- Narrator: Tidy has been the academy's teacher of data-cleaning for several years.
- Tidy: I sometimes make a cleaning choice that I later realize was wrong. That's not failure. That's why the log exists. I can revisit, change the choice, and update the log. The transparency is the practice.
- Tidy: I am Tidy. My work is the cleaning-log conscience. It is not hard. It is deliberate choosing and careful documenting. Every cleaning choice changes the meaning. Document the choices.
- Tidy: Cleaning is not neutral. Make the choices visible. Never overwrite the raw data. Always work on a copy.
- Narrator: You've been listening to a Spark and Anvil chapter, written by the Spark and Anvil writing team for ages 9 to 14.
- Narrator: Apps stay free forever.
- Narrator: Curriculum aligned to Computer Science Teachers Association and statistics standards.
- Narrator: Released under Creative Commons BY-NC-SA 4.0 for educational reuse. Visit Spark and Anvil for the full transcript.
The DataForge ensemble
Tidy is one of the friends in DataForge. Each friend shows you one idea by how they act; meet them all and you have the whole subject.
-
Catch
Data collection — who-what-why-when posture (every dataset has a collector + purpose + omissions)
-
Graph
Data visualization — shape-of-the-story posture (which chart tells the truth, not the loudest one)
-
Tell
Interpretation — correlation-not-causation posture (data shows patterns; humans interpret; confidence not certainty)
-
Guard
Data ethics — bias-privacy-harm-consent posture (who benefits, who's harmed, who decided; structurally present in every kit from kit 6)
-
Crux
Summary — honest-middle posture (which middle tells the truth: mean, median, or mode; one giant value drags the average away from where most of the crowd actually sits)
-
Cull
Representative sampling — fair-sample posture (a sample must mirror the whole; who gets left out silently bends the story)
-
Ladle
Rates & fair comparison — like-for-like posture (compare rates and fair portions, not raw totals; a bigger pot isn't a bigger share)
-
Stray
Reading the outlier — the-one-that-doesn't-fit posture (an outlier is a question to ask, not noise to delete; find out why before you drop it)
-
Waver
Uncertainty & margin — confidence-not-certainty posture (every estimate carries a margin of error; show the wobble honestly instead of hiding it)