AWStats bots database outdated
Hi,
The robots.pm file used by AWStats in cPanel (/usr/local/cpanel/3rdparty/bin/lib/robots.pm) appears to be severely outdated — it hasn't been updated since around 2021.
As a result, most modern crawlers, especially AI-related bots like ChatGPT, Perplexity, and others, are incorrectly classified as "Unknown robot identified by bot*" in AWStats reports. This significantly reduces the usefulness of AWStats when analyzing traffic sources.
It would be nice to update the database.
For reference, there's an actively maintained version of the file available here:
🔗 https://raw.githubusercontent.com/eldy/AWStats/refs/heads/develop/wwwroot/cgi-bin/lib/robots.pm
-
Hey there! Great catch! It does seem like there are some things in use now that are missing from that file. I've created case CPANEL-48317 for our developers to review this and I've linked them this thread as well, so I'll be sure to post updates if I hear anything on my end!
0 -
Update - our team has resolved this and it will be included in future versions of 126 and 134!
0 -
Great!
0 -
As of this time, we're unsure what our plan is with AWstats as they have stopped development as of their last release. You can see the release statement here saying this:
https://github.com/eldy/AWStats/commit/a2ab5339b7d113348390f0c376efa65f10cbf528
I don't yet know what our plans are as we're still evaluating how we want to proceed.
0
Please sign in to leave a comment.
Comments
4 comments