Thread: Yahoo Slurp Crawler.... not playing by the rules?
View Single Post
Old 03-09-2006, 12:46 AM   #5
komodo
 
komodo's Avatar

Name: komodo
Title: Administrator
Status: Offline
Join Date: Apr 2005
Location: Athens, GA
Rate My Car: 68 / 340
Your Ride: 1995 M3
Wow, stupid mistake.

Notice how in the robots.txt file I restricted "printhread.php"? Wouldn't it make more sense if I restricted "printthread.php"? haha
__________________
  Reply With Quote