Remove Duplicate Lines: Why Some Duplicates Stay and Other Questions

What is it?

Remove Duplicate Lines deletes repeated lines from a list and keeps the first copy of each, in the original order.

Who is it for?

Teachers and office staff cleaning name and email lists, marketers de-duplicating contact lists, SEO writers cleaning keyword lists, and anyone merging lists from two sources.

How to use it

  1. Paste your list, one item per line. A column copied from Excel or Google Sheets works.
  2. Tick the options you need: Ignore UPPER/lower case, Ignore spaces at the ends, Remove empty lines.
  3. Copy or download the clean list.

Some duplicates were not removed

  • Different capitals: “Ravi@gmail.com” and “ravi@gmail.com” count as different until you tick Ignore UPPER/lower case.
  • Hidden spaces: a space at the end of a line makes it different. Tick Ignore spaces at the ends.
  • Different formats: “98765 43210” and “+91 9876543210” are the same number written differently. Clean phone numbers with the Phone Number Formatter first.
  • Invisible characters from copied web text: run the list through Text Cleaner with Remove invisible characters.

Good to know

  • To also sort the list, use Sort Lines afterwards.
  • In Excel, Data → Remove Duplicates does the same on a sheet; this tool is quicker for a pasted list on a phone.

Is my text uploaded?

No. Everything happens inside your browser. Your text is kept in this browser only so it is still there if you reload, and Clear removes it.

Open the tool: Remove Duplicate Lines

Still stuck?

Contact support. Tell us which tool or page you were using, what you tapped, what you saw, and your phone or computer and browser (for example: Android phone, Chrome). We reply by email.

Questions, or an error not listed here?

Tell us in the comments: what you were doing, the exact message you saw, and your device and browser. We read every comment and add new fixes to this article.