spamd hung issue server was unresponsive

Please advise on how to go about..? Thanks! Note: #8345445 from the CPANEL support center

Server hung - /usr/local/cpanel/logs/tailwatchd_log for 31 March logs

[66910] [2017-03-31 00:00:01 -0600] [Cpanel::TailWatch::Eximstats] Resetting email limits to new starttime of 1490940000
Waiting for "spamd" to restart ""failed.

Service Error
(XID bmmgyz) The "spamd" service failed to start.

Log Messages
Mar 31 00:00:11 int spamd[189076]: spamd: server killed by SIGTERM, shutting down

spamd has failed. Contact your system administrator if the service does not automagically recover.
Waiting for "spamd" to restart ""Gracefully Terminating processes: perl with pids 237564 and owner root.......waited 1 second(
s) for 1 process(es) to terminate.......waited 2 second(s) for 1 process(es) to terminate.......waited 3 second(s) for 1 process(es) to
terminate.......waited 4 second(s) for 1 process(es) to terminate.......waited 5 second(s) for 1 process(es) to terminate.......waited
6 second(s) for 1 process(es) to terminate.......forcefully killing processes....Done
"Gracefully Terminating processes: perl with pids 237564 and owner root.......waited 1 second(s) for 1 process(es) to terminat
e.......waited 2 second(s) for 1 process(es) to terminate.......waited 3 second(s) for 1 process(es) to terminate.......waited 4 second
(s) for 1 process(es) to terminate.......waited 5 second(s) for 1 process(es) to terminate.......waited 6 second(s) for 1 process(es) t
o terminate.......forcefully killing processes....Done
"failed.

Service Error
(XID stvsmn) The "spamd" service failed to start.

Startup Log
spamd: could not create IO::Socket::IP socket on [::1]:783: Address already in use
server socket setup failed, retry 1: spamd: could not create IO::Socket::IP socket on [127.0.0.1]:783: Address already in use
spamd: could not create IO::Socket::IP socket on [::1]:783: Address already in use
server socket setup failed, retry 2: spamd: could not create IO::Socket::IP socket on [127.0.0.1]:783: Address already in use
spamd: could not create IO::Socket::IP socket on [::1]:783: Address already in use
server socket setup failed, retry 3: spamd: could not create IO::Socket::IP socket on [127.0.0.1]:783: Address already in use
spamd: could not create IO::Socket::IP socket on [::1]:783: Address already in use
server socket setup failed, retry 4: spamd: could not create IO::Socket::IP socket on [127.0.0.1]:783: Address already in use
spamd: could not create IO::Socket::IP socket on [::1]:783: Address already in use
server socket setup failed, retry 5: spamd: could not create IO::Socket::IP socket on [127.0.0.1]:783: Address already in use
spamd: could not create IO::Socket::IP socket on [::1]:783: Address already in use
server socket setup failed, retry 6: spamd: could not create IO::Socket::IP socket on [127.0.0.1]:783: Address already in use
spamd: could not create IO::Socket::IP socket on [::1]:783: Address already in use
server socket setup failed, retry 7: spamd: could not create IO::Socket::IP socket on [127.0.0.1]:783: Address already in use
spamd: could not create IO::Socket::IP socket on [::1]:783: Address already in use
server socket setup failed, retry 8: spamd: could not create IO::Socket::IP socket on [127.0.0.1]:783: Address already in use
spamd: could not create IO::Socket::IP socket on [::1]:783: Address already in use
server socket setup failed, retry 9: spamd: could not create IO::Socket::IP socket on [127.0.0.1]:783: Address already in use
spamd: could not create IO::Socket::IP socket on [::1]:783: Address already in use
spamd: could not create IO::Socket::IP socket on [127.0.0.1]:783: Address already in use

spamd has failed. Contact your system administrator if the service does not automagically recover.
DBD::mysql::db ping failed: Too many connections at /usr/local/cpanel/Cpanel/TailWatch/Eximstats.pm line 906,  line 17934.
Cpanel::DBI::Mysql connect('','eximstats',...) failed: Too many connections at /usr/local/cpanel/Cpanel/DBI.pm line 105.
[66910] [2017-03-31 00:26:34 -0600] [Cpanel::TailWatch::Eximstats] [SQLERR] Could not prepare query, logging SQL to /var/cpanel/sql
[66910] [2017-03-31 00:26:34 -0600] [Cpanel::TailWatch] [INFO] Opened /var/cpanel/sql/eximstats.sql in append mode
Cpanel::DBI::Mysql connect('','eximstats',...) failed: Too many connections at /usr/local/cpanel/Cpanel/DBI.pm line 105.
[66910] [2017-03-31 00:27:13 -0600] [Cpanel::TailWatch::Eximstats] [SQLERR] Could not prepare query, logging SQL to /var/cpanel/sql
Cpanel::DBI::Mysql connect('','eximstats',...) failed: Too many connections at /usr/local/cpanel/Cpanel/DBI.pm line 105.
[66910] [2017-03-31 00:27:13 -0600] [Cpanel::TailWatch::Eximstats] [SQLERR] Could not prepare query, logging SQL to /var/cpanel/sql
Cpanel::DBI::Mysql connect('','eximstats',...) failed: Too many connections at /usr/local/cpanel/Cpanel/DBI.pm line 105.
[66910] [2017-03-31 00:28:36 -0600] [Cpanel::TailWatch::Eximstats] [SQLERR] Could not prepare query, logging SQL to /var/cpanel/sql
Cpanel::DBI::Mysql connect('','eximstats',...) failed: Too many connections at /usr/local/cpanel/Cpanel/DBI.pm line 105.
[66910] [2017-03-31 00:29:11 -0600] [Cpanel::TailWatch::Eximstats] [SQLERR] Could not prepare query, logging SQL to /var/cpanel/sql
Cpanel::DBI::Mysql connect('','eximstats',...) failed: Too many connections at /usr/local/cpanel/Cpanel/DBI.pm line 105.
[66910] [2017-03-31 00:31:58 -0600] [Cpanel::TailWatch::Eximstats] [SQLERR] Could not prepare query, logging SQL to /var/cpanel/sql
Cpanel::DBI::Mysql connect('','eximstats',...) failed: Too many connections at /usr/local/cpanel/Cpanel/DBI.pm line 105.
[66910] [2017-03-31 00:32:04 -0600] [Cpanel::TailWatch::Eximstats] [SQLERR] Could not prepare query, logging SQL to /var/cpanel/sql
Cpanel::DBI::Mysql connect('','eximstats',...) failed: Too many connections at /usr/local/cpanel/Cpanel/DBI.pm line 105.
[66910] [2017-03-31 00:33:13 -0600] [Cpanel::TailWatch::Eximstats] [SQLERR] Could not prepare query, logging SQL to /var/cpanel/sql
Cpanel::DBI::Mysql connect('','eximstats',...) failed: Too many connections at /usr/local/cpanel/Cpanel/DBI.pm line 105.
[66910] [2017-03-31 00:33:57 -0600] [Cpanel::TailWatch::Eximstats] [SQLERR] Could not prepare query, logging SQL to /var/cpanel/sql
Cpanel::DBI::Mysql connect('','eximstats',...) failed: Too many connections at /usr/local/cpanel/Cpanel/DBI.pm line 105.
[66910] [2017-03-31 00:34:01 -0600] [Cpanel::TailWatch::Eximstats] [SQLERR] Could not prepare query, logging SQL to /var/cpanel/sql
Cpanel::DBI::Mysql connect('','eximstats',...) failed: Too many connections at /usr/local/cpanel/Cpanel/DBI.pm line 105.
[66910] [2017-03-31 00:34:03 -0600] [Cpanel::TailWatch::Eximstats] [SQLERR] Could not prepare query, logging SQL to /var/cpanel/sql
Cpanel::DBI::Mysql connect('','eximstats',...) failed: Too many connections at /usr/local/cpanel/Cpanel/DBI.pm line 105.
[66910] [2017-03-31 00:34:03 -0600] [Cpanel::TailWatch::Eximstats] [SQLERR] Could not prepare query, logging SQL to /var/cpanel/sql
Cpanel::DBI::Mysql connect('','eximstats',...) failed: Too many connections at /usr/local/cpanel/Cpanel/DBI.pm line 105.
[66910] [2017-03-31 00:34:03 -0600] [Cpanel::TailWatch::Eximstats] [SQLERR] Could not prepare query, logging SQL to /var/cpanel/sql
Waiting for "spamd" to start "failed.

Service Error
(XID 99wthv) The "spamd" service failed to start.

spamd has failed. Contact your system administrator if the service does not automagically recover.
Waiting for "httpd" to restart gracefully "waiting for "httpd" to initialize "finished.

Service Status
httpd (/usr/local/apache/bin/httpd -k start) is running as root with PID 258819 (pidfile check method).

Startup Log
[Mon Mar 27 23:47:07 2017] [warn] ModPagespeedGeneratedFilePrefix is deprecated. Please remove it from your configuration.

httpd restarted successfully.
DBD::mysql::db ping failed: Too many connections at /usr/local/cpanel/Cpanel/TailWatch/Eximstats.pm line 906,  line 18196.
Cpanel::DBI::Mysql connect('','eximstats',...) failed: Too many connections at /usr/local/cpanel/Cpanel/DBI.pm line 105.
[66910] [2017-03-31 00:41:15 -0600] [Cpanel::TailWatch::Eximstats] [SQLERR] Could not prepare query, logging SQL to /var/cpanel/sql
Waiting for "spamd" to restart ""Terminating process: spamd child with pid 245108 and owner interac....Done
""failed.

Service Error
(XID zqrsmz) The "spamd" service failed to start.

Log Messages
Mar 31 00:50:42 int spamd[243037]: spamd: server killed by SIGTERM, shutting down

spamd has failed. Contact your system administrator if the service does not automagically recover.
DBD::mysql::db ping failed: Too many connections at /usr/local/cpanel/Cpanel/TailWatch/Eximstats.pm line 906,  line 18464.
Cpanel::DBI::Mysql connect('','eximstats',...) failed: Too many connections at /usr/local/cpanel/Cpanel/DBI.pm line 105.
[66910] [2017-03-31 00:54:02 -0600] [Cpanel::TailWatch::Eximstats] [SQLERR] Could not prepare query, logging SQL to /var/cpanel/sql
Cpanel::DBI::Mysql connect('','eximstats',...) failed: Too many connections at /usr/local/cpanel/Cpanel/DBI.pm line 105.

SysSachin

April 01, 2017 08:27

Hi, Can you please run the following command and paste the output.


netstat -lpn | grep 783

ashok_iw

April 01, 2017 08:30

# netstat -lpn | grep 783
tcp        0      0 127.0.0.1:783               0.0.0.0:*                   LISTEN      8693/perl           
tcp        0      0 ::1:783                     :::*                        LISTEN      8693/perl

cPanelMichael

April 03, 2017 15:22

Hello, To update, it looks like this was the result of a high load average on the system. The following thread is useful when troubleshooting high load averages: Troubleshooting high server loads on Linux servers Thank you.

spamd hung issue server was unresponsive

Comments

Didn't find what you were looking for?