Free Duplicate Content Checker Tool

Sufyan created a free tool which checks page similarity. You can set it to check sitewide on small sites, or enter in a couple URLs manually to cross check them for how similar the pages are to one another.

This tool doesn't test if a site has canonicalization issues, but it is plenty cool for free.

update: link to seojunkie.com/2006/05/24/site-wide-duplicate-content-analyzer/ removed as it is now a domain lander page

Published: May 25, 2006 by Aaron Wall in seo tools

Comments

May 25, 2006 - 4:08pm

What is an acceptable percentage?

May 25, 2006 - 5:12pm

No exact answer really. There are so many factors...there isn't just a hit yes or no exact # answer.

Depending how a site is configured, what external links a site has, the size of the site, etc etc etc a bad number might range anywhere from 70 to 85% on up or so.

May 25, 2006 - 6:33pm

Aaron, thanks for letting us know about this tool. Gives a whole different perspective on how my site might appear to the search engines in regards to duplicate content issues.

Don't know why I got a runtime error - but maybe I need to download it and do a reinstall.

It is extremely helpful.

Brian - the lower the percentage of duplication/similiarity, the better.

November 7, 2006 - 1:58am

Cool. Thanks Aaron for this usefull information. Frankly I still bother thinking about duplication/similiarity content.
Now it is time to proove it. I will try this. And see the traffic result. Also Thanks to Sufyan the creator

Careyafsmith
August 22, 2008 - 7:31pm

Hey Aaron,

This tool isn't working... do you know of any others?

Is there anything in the marketplace (whether free or paid) that will look at my site, and comb the internet to determine pages with my articles/content on them? This would be most valuable than comparing one site to another... I'd have to know the site before for most of these to work!

August 22, 2008 - 11:54pm

Attributor is good stuff. And there is also Copyscape.

listbots
December 24, 2008 - 8:11am

Hello
I first have to tell you that I love this site, Ok on to business, I wanted to check my site for duplicate content and found your link is not working. Just a little heads up!!

Thanks,
Jimmy Bone
www.ListBotsPro.com

jonallen
February 2, 2009 - 6:31pm

Thanks for the info about Attributor. I see that there is an enterprise solution available. Is this something that you've tried? I'm after something to use commercially but not sure which product to go for?

Regards,

Jon

February 2, 2009 - 8:04pm

I got a trial use of it Jon. It looked interesting...but I did not give it as much attention as I could have/should have because I am always doing way too much work and have my attention pulled in 10 different directions at any point in time.

Add new comment

(If you're a human, don't change the following field)
Your first name.
(If you're a human, don't change the following field)
Your first name.
(If you're a human, don't change the following field)
Your first name.