Hosted Web Server Keeps Timing Out Everyday Assistance
We have a client reach out to us about their hosted web server over at hostwind.com where their websites would time out for 20 minutes to over 2-3 hours sometimes almost daily according to them.
When this happens, I am unable to access WHM panel.
Disk usage is below 20%, memory seems to be about 50%.
Host support have been unable to provide any assistance. They did say they don't see any abuse happening with their server on their end and that about it.
Support did say their were cron scripts running but not sure what these scripts are doing.
47 0 * * * (/usr/local/cpanel/scripts/fix-cpanel-perl; /usr/local/cpanel/scripts/upcp --cron > /dev/null)
0 2 * * * /usr/local/cpanel/bin/backup
35 * * * * /usr/bin/test -x /usr/local/cpanel/bin/tail-check && /usr/local/cpanel/bin/tail-check
0 6 * * * /usr/local/cpanel/scripts/exim_tidydb > /dev/null 2>&1
30 5 * * * /usr/local/cpanel/scripts/optimize_eximstats > /dev/null 2>&1
5,20,35,50 * * * * /usr/local/cpanel/scripts/eximstats_spam_check 2>&1
45 */4 * * * /usr/bin/test -x /usr/local/cpanel/scripts/update_mailman_cache && /usr/local/cpanel/scripts/update_mailman_cache
15 */6 * * * /usr/local/cpanel/scripts/autorepair recoverymgmt >/dev/null 2>&1
*/5 * * * * /usr/local/cpanel/scripts/dcpumon-wrapper >/dev/null 2>&1
0 */2 * * * /usr/local/cpanel/scripts/shrink_modsec_ip_database -x 2>&1
26 4 * * * /usr/local/cpanel/whostmgr/docroot/cgi/cpaddons_report.pl --notify
30 */4 * * * /usr/bin/test -x /usr/local/cpanel/scripts/update_db_cache && /usr/local/cpanel/scripts/update_db_cache
25 */2 * * * /usr/local/cpanel/bin/mysqluserstore >/dev/null 2>&1
15 */2 * * * /usr/local/cpanel/bin/dbindex >/dev/null 2>&1
0,15,30,45 * * * * /usr/local/cpanel/whostmgr/bin/dnsqueue > /dev/null 2>&1
@reboot /usr/local/cpanel/bin/onboot_handler
40 1 * * * /usr/sbin/hwagent backups run # Hostwinds Cloud Backups
6 11 * * * /bin/bash /etc/hwautomate/hostwinds_backups.sh > /dev/null 2>&1
09,39 * * * * /usr/local/cpanel/scripts/clean_user_php_sessions > /dev/null 2>&1
We are running PHP 8.1 from the looks of it from looking at phpmyadmin through WHM.
error_logs show this around the time we got notified it went down:
[2023-11-12 14:11:05 -0500] info [cpsrvd] Request Timeout: "-" 408 Timeout while creating a secure connection[2023-11-12 14:11:04 -0500] info [cpsrvd] Request Timeout: "-" 408 Timeout while creating a secure connection
When I did tail of the apache logs, I did notice this which seems to be pointing to PHP 7.4 for some reason. The IP is pointing to amazon AWS.
[cgi:warn] [pid 25974] [client 44.192.62.73:38680] AH01220: Timeout waiting for output from CGI script /usr/local/cpanel/cgi-sys/ea-php74
When I do tail for ea-php81, their nothing.
When I do tail for ea-php73 and ea-php74, i get the below:
[root@23-238-21-74 ~]# tail -f /opt/cpanel/ea-php73/root/usr/var/log/php-fpm/error.log[12-Nov-2023 03:08:05] NOTICE: error log file re-opened
[root@23-238-21-74 ~]# tail -f /opt/cpanel/ea-php74/root/usr/var/log/php-fpm/error.log[12-Nov-2023 15:27:32] NOTICE: [pool express-inform_com] child 3884 exited with code 0 after 18.261670 seconds from start[12-Nov-2023 15:27:32] NOTICE: [pool express-inform_com] child 4049 started[12-Nov-2023 15:27:33] NOTICE: [pool express-inform_com] child 3887 exited with code 0 after 18.729924 seconds from start[12-Nov-2023 15:27:33] NOTICE: [pool express-inform_com] child 4057 started[12-Nov-2023 15:27:33] NOTICE: [pool express-inform_com] child 3886 exited with code 0 after 19.119946 seconds from start[12-Nov-2023 15:27:33] NOTICE: [pool express-inform_com] child 4058 started[12-Nov-2023 15:27:33] NOTICE: [pool express-inform_com] child 3885 exited with code 0 after 19.181697 seconds from start[12-Nov-2023 15:27:33] NOTICE: [pool express-inform_com] child 4059 started[12-Nov-2023 15:27:35] NOTICE: [pool express-inform_com] child 3883 exited with code 0 after 20.936874 seconds from start[12-Nov-2023 15:27:35] NOTICE: [pool express-inform_com] child 4060 started
Note: I am not a web developer/web designer but rather a IT Consultant. I was not the one that setup this server or done any maintenance of it. I am trying to help this client to see if their anything we can do to assist them with.
-
The mentioned cronjobs are responsible for executing tasks such as running the backup process, updating cPanel,etc. Have you observed any spikes in server load during the website's downtime? Provide the results of the 'sar -q' command. Additionally, inform me of any out-of-memory error messages found in the system logs and let me know the uptime of the web servers. 0 -
Issues with the website timing out would need to be severe in order to also cause problems with the cPanel & WHM interfaces. This would point to a more global issue with the server itself than a problem with just Apache or PHP. Do you see anything interesting in /var/log/messages around the time one of these issues happened? 0
Please sign in to leave a comment.
Comments
2 comments