A while ago, I read a post at SEOChat about http://www.orkut.com not appearing in Google results. I ran these queries at Google - www.orkut.com & site:www.orkut.com Surprisingly enough, it returned no results. I thought they might have banned search engine bots from crawling much like WMW. So, I probed into their robots.txt file at http://www.orkut.com/robots.txt
Http Header for http://www.orkut.com/robots.txt:
HTTP/1.0 200 OK =>
Content-Type => text/plain
Cache-control => private
Content-Length => 23
Date => Mon, 12 Dec 2005 16:53:45 GMT
Server => GFE/1.3
Connection => Keep-Alive
As far as I know, all of the facts above are enough to believe that they have been banned by Google. But I don’t think Orkut people (that are themselves part of Google) would do anything bad to get banned like that. Plus, there is a possibility of Google removing it from its index manually for bandwidth issue.
What is your take?