Awstats robots reports

Patrickintheforest

• August 03, 2018 10:14

In my robots.txt file I have denied Yandexbot Under robots spider visitors, hits, I see for example Yandexbot 0/2 Does this mean that the bot tried twice but was blocked. If so I know my Yandexbot deny has worked Patrick

• 

  cPanelMichael

  • August 03, 2018 16:39

  Hello @Patrickintheforest, The access attempt itself from the bot/crawler is still logged, and that's what Awstats is showing you. Note the robots.txt file won't technically prevent a crawler/bot from accessing your website files. There's some useful information on this topic at: Thank you.

  0
• 

  Patrickintheforest

  • August 03, 2018 17:11

  Thank you cpanelmichael. My bandwidth has been drastically reduced since the deny.

  0

Please sign in to leave a comment.