Bot limiter on cpanel?

Answered

loccom

• August 11, 2025 14:38

Hi guys

I have been having issues with a good bot that i need them access to crawl my websites, seems some of the bots get a 200 code and the other half get 403 errors. I have whitelisted user agents and IP's blocks with cloudflare and I am not getting error that end, all looks dandy there. Also added the IP blocks to the firewall as well on the server.

According to the Visitors interface on cpanel there seems to be a 50/50 split for this particular bot user agent.

Does anyone know if Cpanel would be set up in a way to restrict these? just cannot work it out.

• 

  quietFinn

  • August 11, 2025 15:02

  Check in
  /etc/apache2/logs/error_log
  you should be able to see what is the reason of that 403 error.

   

  0
• 

  loccom

  • August 11, 2025 15:13
  • Edited

  downloaded the error log, did a search for the IP's that got the 403... nothing.

  weird.. i get it with another bot, these are friendly bots which are needed but weird 50/50 split. All have different ip's but all fit within the IP range.

  0
• 

  loccom

  • August 11, 2025 15:12

  

  0
• 

  loccom

  • August 11, 2025 15:29

  I think i solved the issue. i had cleantalk app installed and i disabled on one site and the 403 for that site went away, while they were still there on other sites.

  i think thats the solved it. thanks 

  1

Please sign in to leave a comment.