Remove Duplicate Lines
Keeps one copy of each line and tells you how many lines were removed.
Find repeated lines, sentences, paragraphs, or words without changing the original text. The duplicate text checker lists each repeated item with its count and the positions where it appears.
Updates as you type for smaller inputs. The original text is never changed.
| Text | Repeats | Positions |
|---|
The text is split into items based on the unit you choose. Each item is then normalized with your options before comparison. For example, with Ignore case turned on, Hello and hello are treated as the same item. With Ignore surrounding whitespace, leading and trailing spaces are removed before matching.
The tool keeps the original item text for display, counts how many times each normalized value appears, and records the position of every match. Positions start at 1, so line 1 means the first line in the text.
apple, pear, apple reports apple with count 2 at positions 1, 3.Hello and hello are counted together.Dr. can occasionally split in ways you would not expect.This page only reports repeats and shows where they are. Remove Duplicate Lines actually rewrites the text and keeps one copy of each line.
Yes. Change the unit from lines to sentences, paragraphs, or words depending on what you want to compare.
Positions are the item numbers in the chosen unit. In line mode they are line numbers. In word mode they are word positions.
Often used together with the Text Duplicate Checker.
Keeps one copy of each line and tells you how many lines were removed.
Sorts lines A to Z, Z to A, naturally, numerically, by length, or randomly.
Compares two texts or code files and highlights added, removed, and changed lines.