Home › Text Tools › Remove Duplicate Lines

Remove Duplicate Lines

Paste a list and every repeated line is removed instantly. Ignore case, extra spaces or accents, keep the first or last copy, sort the result, and see exactly which lines were duplicates.

Your list (one item per line)0 lines

0 lines

Result without duplicates

Duplicates

Sort result

Items are separated by

Ignore upper/lower case Trim spaces at line ends Ignore extra spaces inside lines Remove empty lines Ignore accents (é = e) Add counts (3 × item)

Results update live. Everything runs in your browser, so even lists of 100,000+ lines are processed instantly and never uploaded.

How to use the Remove Duplicate Lines

Paste your list into the left box, one item per line (or choose commas, tabs or another separator).
Choose how to match: ignore case, trim spaces, ignore extra spaces inside lines or ignore accents.
Pick what to keep: the first copy, the last copy, only lines that never repeat, or only the repeated lines.
Sort the result if you like, then check the counts and the Removed tab.
Copy or download the unique lines, or press Use result as input to keep working on them.

What each option does

Option	Example input	Treated as
Ignore upper/lower case	Apple, apple, APPLE	one line
Trim spaces at line ends	"apple" and " apple "	one line
Ignore extra spaces inside lines	"New York" and "New York"	one line
Ignore accents	café, cafe	one line
Remove empty lines	blank or space-only lines	deleted from the result

The line that is kept is shown exactly as you typed it (after trimming), so the matching options never change your text, only which lines count as the same.

Keep first, keep last, unique only, or duplicates only

For the list a, b, a, c, b, a:

Keep the first copy gives a, b, c (3 duplicates removed).
Keep the last copy gives c, b, a, the order in which each item last appears.
Remove every line that repeats gives c, the only item that appears once.
Show only lines that repeat gives a, b, handy for spotting double entries.

Tip: to find lines that two lists have in common, paste both lists together and choose Show only lines that repeat (make sure neither list has internal duplicates first).

Frequently asked questions

How do I remove duplicate lines from a list?

Paste the list into the input box. Duplicate lines are removed immediately and the unique lines appear on the right, in their original order. Press Copy result or Download .txt to save them.

Is the comparison case-sensitive?

By default no: Apple, APPLE and apple count as the same line and the first one you wrote is kept. Untick Ignore upper/lower case to treat them as different lines.

What is the difference between keep first and keep last?

Both leave one copy of every line. Keep the first copy keeps each line at the position where it first appears; keep the last copy keeps it where it appears last, which is useful when later entries are newer.

Can I remove both copies of a duplicated line?

Yes. Choose Remove every line that repeats. Only lines that appear exactly once are kept, which is handy for finding unique entries between two merged lists.

Can it remove duplicate words or comma-separated values?

Yes. Set Items are separated by to Commas, Semicolons, Tabs or Spaces. The result is joined with the same separator.

How many lines can it handle?

Hundreds of thousands. It uses a hash map, so even very long lists are processed in a fraction of a second, all inside your browser with nothing uploaded.

Related tools