Skip to content
Toolbench

Sort & Deduplicate Lines

Clean up a list: sort it, remove repeats, drop blanks — with alphabets that sort correctly.

Runs entirely in your browser

Loading tool...

How to use

  1. Paste your list, one item per line.
  2. Pick the order, and the alphabet it should follow — Vietnamese sorts differently from English.
  3. Choose whether to remove duplicates, trim spaces and drop blank lines.
  4. Copy the result, or check the panel showing exactly what repeated.

Features

  • Sorting by a real alphabet, so Đà Nẵng lands under D rather than after Z.
  • Natural number order, so file2 comes before file10.
  • De-duplication that keeps the first occurrence, including its casing.
  • A count of what was removed, and a list of exactly which lines repeated.
  • Runs in your browser — a customer list never leaves the device.

Frequently asked questions

Why does the alphabet setting matter?
Because sorting by character code is not sorting alphabetically. Đ is at code point U+0111, nowhere near D, so a naive sort puts Đà Nẵng after Yên Bái — at the end of a list of provinces, where nobody would look. Choosing Vietnamese uses the collation the language actually has, which puts it where a reader expects.
Does ignoring case also ignore accents?
No, deliberately. Ma, mà and má are different words, and folding accents together would merge them into one line and quietly lose two. Ignoring case affects only case.
Which duplicate is kept?
The first, with its original casing. If your list has Apple then apple, Apple survives — the earlier line usually reflects how the item was first written, and keeping it makes the result stable if you run the tool twice.
What is natural order?
Ordering embedded numbers by value rather than by character: file2 before file10. Strict character order does the opposite, because "1" sorts before "2". Natural is what people expect for filenames and versions; strict is what a computer means by sorted.

What is in both lists, what is only in one — matched properly, so a trailing space does not hide a row.

Pull every email address, phone number and link out of a messy paste — deduplicated, and without the trailing full stops.

Fix text that has been through a PDF, an email client or a word processor — one decision per switch.

Compare two blocks of text and see exactly which lines were added, removed or changed.

Sort and Deduplicate Lines — With Correct Alphabets