ToolBrivo

Press slash to focus search.

Text

Remove duplicate lines

Keep the first copy of each line and drop later repeats.

Lines are split on a line feed, a carriage return, or both. The ending itself is not compared. The first copy of a line stays, and later copies are removed, so the original order remains. A blank line is a line: the first blank line stays and later blank lines are removed. Case-insensitive matching uses the default Unicode lowercase mapping and keeps the casing of the first line. Trim removes spaces at both ends before comparing and writes the trimmed line.

Up to 200,000 characters.

The first copy of each line is kept, in the original order. A blank line counts as a line, so later blank lines are removed. Trimmed lines are compared and written without the surrounding spaces.

Paste lines to remove later repeats.

How to use it

  1. Paste the lines.
  2. Choose case-sensitive matching, trimmed matching, or both.
  3. Copy the result or download deduplicated.txt. Reset clears the box.

Examples

A repeated heading

The lines alpha, alpha, beta become alpha and beta. One repeat is removed. The blank line in alpha, a blank line, alpha, a blank line is kept once.

Limits

  • The result uses a line feed between lines and does not add a final newline.
  • Trim changes the kept line. It does not keep the original spaces while matching the trimmed text.
  • Case folding is not locale-specific. Turkish I and similar letters follow the default Unicode mapping.
  • The box stops at 200,000 characters.

Privacy

The text stays in this browser. It is not sent to a server and it is not written to local storage.

Questions