MSNBot disobeying robots.txt - Search Engine Roundtable Forums

Search Engine Roundtable Forums > Search Engines Forums > MSN Roundtable > MSN Web Search
MSNBot disobeying robots.txt

Mark Forums Read

MSN Web Search Discuss MSN search topics; including optimization strategies, updates, technology and other Web search related to MSN.

Reply

#1

Old

07-10-2006, 10:30 PM

OrganicSEO OrganicSEO is offline

OrganicSEO is offline

Farmboy

Join Date: Mar 2006

Location: Chennai

Posts: 64

OrganicSEO is on a distinguished road

Default

MSNBot disobeying robots.txt

MSNBot is disobeying google's http://api.google.com/robots.txt

http://search.msn.com/results.aspx?q...api.google.com

__________________
Spare a few minutes! Have a glance!

Reply With Quote

#2

Old

07-11-2006, 07:26 AM

rustybrick rustybrick is offline

rustybrick is offline

Administrator

Join Date: Nov 2005

Location: New York

Posts: 2,022

rustybrick is on a distinguished road

Default

Sorry but this one you got wrong.

Answered http://www.seroundtable.com/archives/004096.html

Decided to feature it.

__________________
Barry Schwartz, CEO of RustyBrick, Inc. & Editor of the Search Engine Roundtable.

Reply With Quote

#3

Old

07-13-2006, 04:21 PM

OrganicSEO OrganicSEO is offline

OrganicSEO is offline

Farmboy

Join Date: Mar 2006

Location: Chennai

Posts: 64

OrganicSEO is on a distinguished road

Default

yes; you are right. i didnt check yahoo and google.

Reply With Quote

Reply

		Search Engine Roundtable Forums > Search Engines Forums > MSN Roundtable > MSN Web Search
MSNBot disobeying robots.txt

« Previous Thread | Next Thread »

Bookmarks

« Previous Thread | Next Thread »

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Posting Rules
You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off

Forum Jump

All times are GMT -5. The time now is 05:22 AM.

Premium Sponsors + advertise

All Out on the Table

SEM Forum Threads

Recent Blog Entries

Syndicate Our Forums

Forum Credits

Sponsored by RustyBrick, Inc.
Moderated by RankSmart
Moderated by SEOMoz
Moderated by SEO Scoop
Moderated by SEO Home

Sponsored Links

Web Development

Rustybrick, INC

Home | Authors | OUR Forums | THE Forums | Forum Search | Awards | Seals | Advertise | Contact

The content at the Search Engine Roundtable are the sole opinion of the authors and in no way reflect views of RustyBrick ®, Inc

Copyright © 1994-2008 RustyBrick ®, Inc. Web Development All Rights Reserved.

Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2009, Jelsoft Enterprises Ltd.