To subscribe to the Search Engine Roundtable, click here
|
#1
|
|||
|
|||
|
A while ago, I read a post at SEOChat about http://www.orkut.com not appearing in Google results. I ran these queries at Google - www.orkut.com & site:www.orkut.com Surprisingly enough, it returned no results. I thought they might have banned search engine bots from crawling much like WMW. So, I probed into their robots.txt file at http://www.orkut.com/robots.txt
Http Header for http://www.orkut.com/robots.txt: HTTP/1.0 200 OK => Content-Type => text/plain Cache-control => private Content-Length => 23 Date => Mon, 12 Dec 2005 16:53:45 GMT Server => GFE/1.3 Connection => Keep-Alive Robots.txt Code: User-agent: * Allow: / As far as I know, all of the facts above are enough to believe that they have been banned by Google. But I don’t think Orkut people (that are themselves part of Google) would do anything bad to get banned like that. Plus, there is a possibility of Google removing it from its index manually for bandwidth issue. What is your take? ![]() |
|
#2
|
||||
|
||||
|
The only reason I can think why they would do this is for privacy reasons. Seems a bit drastic though.
__________________
http://www.gardenstew.com/ |
|
#3
|
||||
|
||||
|
Maybe too many "low quality" links.
![]()
__________________
Barry Schwartz, CEO of RustyBrick, Inc. & Editor of the Search Engine Roundtable. |
![]() |
| ||||||
| Bookmarks |
| Thread Tools | |
| Display Modes | |
|
|