Site Wide Duplicate Content Analyzer

[seojunkie]

This tool crawls your entire site and then analyzes all your pages for duplicate content. It shows similarity percentage among all pages on your site, so you can see what pages are similar enough to trigger a flag in major search engines and consequently they can penalize your site for duplicate content.

The higher the similarity, the more likely that you will zapped by them

Below is its screenshot and I think the tool doesn’t require any how-to as it is quite simple.

http://www.seojunkie.com/images/thumb_dca.gif

If you have any comment, questions or anything else, please let me know.

You can download it here (http://www.seojunkie.com/2006/05/24/site-wide-duplicate-content-analyzer/).

P.S – This tool is NOT intended for large websites and has a lot that can be improved.

[Mike]

I'm a bit confused on this one. Why would you be penalized for duplicating your own content? I can see Google dropping one of your pages that looks like a duplicate of another, but to me that's not a penalty, it's just Google choosing which page (out of two that are identical) that it wants to show people.

[seojunkie]

I'm a bit confused on this one. Why would you be penalized for duplicating your own content? I can see Google dropping one of your pages that looks like a duplicate of another, but to me that's not a penalty, it's just Google choosing which page (out of two that are identical) that it wants to show people.

http://www.webmasterradio.fm/episodes/audio/2005/MW120205.mp3

[kapsat]

a cool tool..... but while checking one of my sites it tells me "unknown" and i tried multiple pages.

Any idea?