Stop Bots from hitting my site

FantasyDraftKit

• February 27, 2015 08:01

Is there a way to block bots from hitting my site? I have a limited amount of bandwidth before I start paying extra, and it appears that Bots are taking up a good chuck of it each month. I don't want to block google or bing spiders, but does anybody know how to identify / block a certain IP?

• 

  Infopro

  • February 27, 2015 16:12

  This should be of use to you: [url=http://www.robotstxt.org/]The Web Robots Pages

  0
• 

  edigest

  • February 27, 2015 17:33

  Can you be more specific about which bots? Many "bad" or useless bots use multiple IPs -- MJ12, for example -- and many ignore robots.txt. When robots.txt doesn't work, you can use mod_security or code in htaccess to block useragents.

  0

Please sign in to leave a comment.