About Remove Duplicate Lines
Mailing lists with repeated addresses, keyword lists, URL exports, inventory codes and log extracts often contain the same line many times. Paste the list or open a text file, and every duplicate is removed as you type, keeping the first occurrence in its original position. Choose to ignore differences in upper and lower case or stray spaces, keep blank lines as separators, or sort the result alphabetically. The counter shows how many duplicates were removed. Large lists of hundreds of thousands of lines work fine.
How to Use It
- 01
Paste your list
Paste text with one item per line, or open a .txt or .csv file.
- 02
Choose options
Ignore case or spaces, keep blank lines, or sort the result.
- 03
Copy or download
Copy the de-duplicated list, or download it.
Questions
Which copy of a duplicate is kept?
The first one, in its original position. Later copies are removed.
Can it treat "Apple" and "apple" as the same?
Yes. Tick Ignore upper and lower case. The first spelling found is kept.
Does it work on CSV files?
Yes, line by line: whole rows that are identical are removed. It doesn't compare individual columns.
Is my list uploaded?
No. Everything happens in your browser.