Near-Duplicate Page Finder

Business

Compares the real text of every page it reads, so pages that differ only by a parameter or a heading still match. Groups are checked against canonical tags.

Text similarityDuplicate titles and H1sCanonical awareGroup exportFree, Pro and Business
Heavy tool, open to everyoneOn your Free plan a run reads up to 15 pages and uses 2 of your 2 daily heavy runs. Business reads up to 250 pages per run.
Sign in for more

About this tool

Duplicate content rarely means copied text. Usually it is the same product at two addresses, a category printed in several sorts, or location pages with the city name swapped. Google picks one version and ignores the rest, and it may not pick the one you want.

How similarity is measured

Each page is cut into overlapping word sequences and compared with every other page. Two pages that share most of their sequences land in the same group. Menus and other repeated blocks are mostly ignored because the main content is compared.

Reading the groups

A group marked Canonical set already points its canonical tags at one page. A group that competes with itself needs a decision: keep one, merge them or rewrite.

Why use this tool

Groups, not pairs

Pages that match each other are grouped, with an average similarity.

Knows your canonicals

Groups that are already consolidated are marked, so you only chase the real problems.

Titles, descriptions, H1s

Exact duplicates of the on-page fields across the crawl.

Adjustable

Choose almost identical, very similar or similar.

How it works

  1. Enter the site address and how many pages to read.
  2. Pick how alike pages must be to count.
  3. Review each group and decide which page to keep.

Frequently asked questions

Is this the same as a plagiarism checker?
No. It compares the pages of one site with each other, not with the rest of the web.
Why are short pages left out?
Pages with under 30 words give a meaningless similarity score. They still count for the title and description checks.
Who can use this tool, and what are the limits?
Everyone can. It is a Business tool because it crawls many pages, so the limits grow with the plan: Free reads up to 15 pages per run, Pro 100 and Business 250. One run uses 2 of your daily heavy runs (2 on Free, 25 on Pro, 100 on Business). Runs that fail before reading anything are not counted.
Is it safe to scan my site?
Requests are rate limited per site, identify themselves as ToolsCrowBot, and only public web addresses can be scanned. We do not store the content we fetch. The report is built in your browser.

More site audit tools

User Reviews

–
No ratings yet
Write a review
Your rating *

Your email is never published. Reviews are moderated, and links aren't allowed.

What users are saying

No reviews yet

Be the first to share your experience with this tool — your feedback helps others.