Results 1 to 3 of 3

Thread: MSNBot disobeying robots.txt

  1. 07-10-2006, 09:30 PM #1
    OrganicSEO
    OrganicSEO is offline Farmboy
    Join Date
    Mar 2006
    Location
    Chennai
    Posts
    64

    Default MSNBot disobeying robots.txt

    MSNBot is disobeying google's http://api.google.com/robots.txt

    http://search.msn.com/results.aspx?q...api.google.com
    Spare a few minutes! Have a glance!
    Reply With Quote Reply With Quote
  2. 07-11-2006, 06:26 AM #2
    rustybrick's Avatar
    rustybrick
    rustybrick is offline Administrator
    Join Date
    Nov 2005
    Location
    New York
    Posts
    2,199

    Default

    Sorry but this one you got wrong.

    Answered http://www.seroundtable.com/archives/004096.html

    Decided to feature it.
    Barry Schwartz, CEO of RustyBrick, Inc. & Editor of the Search Engine Roundtable.
    Reply With Quote Reply With Quote
  3. 07-13-2006, 03:21 PM #3
    OrganicSEO
    OrganicSEO is offline Farmboy
    Join Date
    Mar 2006
    Location
    Chennai
    Posts
    64

    Default

    yes; you are right. i didnt check yahoo and google.
    Spare a few minutes! Have a glance!
    Reply With Quote Reply With Quote
« Previous Thread | Next Thread »

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

Forum Rules