BFCBrilliance

How to Clean Up a Messy List

Six text tools, one order — trim before you de-duplicate, because "apple" and "apple " are two different things to every computer that has ever existed.

·3 min read·6 free tools

The tools in this guide

All free, no signup. Each one has a printable sheet too.

A list that has been through a spreadsheet, an email and a web form arrives full of invisible damage: trailing spaces, blank lines, inconsistent capitals, near-duplicates that are not quite duplicates.

These six tools fix that, and the order you use them in decides whether it works.

Everything here runs in your browser. Nothing is uploaded, which matters when the list is customer names or anything else you should not be pasting into a random website.

The order that matters

Trim first, de-duplicate second. Always.

The Line Sorter & Deduplicator says why: raw de-duplication misses "apple" and "apple " and always will. A trailing space makes two identical-looking entries into two different strings, and every de-duplicator that has ever existed will keep both. You end up with a "cleaned" list that still has duplicates in it, and they are invisible because the difference is whitespace.

So: clean the whitespace, then remove duplicates. The other way round does half a job and looks like a whole one.

The tools, in working order

Text Cleaner is the first pass — it trims every line, drops the blanks and removes duplicates, showing all four results at once. For most messy lists this one tool is the entire job. It exists precisely for lists "that have been through three programs."

Line Sorter & Deduplicator is the more deliberate version, and it shows the cleaned version alongside the raw one so you can see what the whitespace was hiding.

Find and Replace is deliberately not regex — a pattern can never hang your browser, and what you type means itself. If you have ever pasted a regex into an online tool and had the tab freeze, that is catastrophic backtracking, and it is a real risk on someone else's machine. Literal replacement cannot do it.

Case Converter gives UPPERCASE, lowercase, Title Case and Sentence case together, with no mode to pick. Useful once the list is clean and you want it consistent.

Word & Character Counter gives word, character and line counts at once — the fastest way to confirm a de-duplication actually removed what you expected.

URL Slug Generator turns a headline into a clean URL slug, and shows a shortened version too, because the best slug is usually not the whole title.

A working sequence

  1. Paste into Text Cleaner — trims, drops blanks, de-duplicates.
  2. Find and Replace for anything structural still wrong.
  3. Case Converter to make it consistent.
  4. Word & Character Counter to confirm the count is what you expect.

Steps 1 and 4 together are the quality check: if the line count did not drop as much as you thought it would, the whitespace is still there.

The short version

  • Trim before you de-duplicate. This is the whole guide.
  • Literal find-and-replace, not regex — a pattern can hang the tab it runs in.
  • Count the lines before and after. That is how you know it worked.
  • Everything here stays in your browser.

Each tool has a printable, though for this group the browser is the point — nothing needs to leave your machine for any of it.

Get the next guide.

New tools and guides straight to your inbox. No spam, ever.