Skip to main content

Failed to perform action "restart" for php-fpm

Answered
Metro2
  • Edited

I'm in a real bad spot and hoping someone here can help, since this is related to an older server at an older data center, and I've spent the past 2 hours trying to sort it myself / reading cPanel docs / other related posts here.

Environment - cPanel/WHM 110.0.24 LTS, CloudLinux 6.1.0 ELS. ea-php74 (I've been trying to get everything migrated to new servers, but it's been on roadblock after another, so for the moment I'm stuck with this box in a live production environment with many important customers on it).

I had to create a new account on this server today, and while trying to install WordPress for the customer I got:

Service Unavailable
The server is temporarily unable to service your request due to maintenance downtime or capacity problems. Please try again later.
Additionally, a 503 Service Unavailable error was encountered while trying to use an ErrorDocument to handle the request.

I quickly visited some other customer's sites and all old / existing sites are (at the moment) working fine, but I can also see that  the /opt/cpanel/ea-php74/root/usr/var/run/php-fpm directory is missing its php-fpm.pid file.

So I tried:

1. Checked WHM > Service Information - says cpanel_php_fpm is UP

2. Restarting php-fpm from WHM

3. /scripts/php_fpm_config --rebuild

4. /scripts/restartsrv_apache_php_fpm

All of restart attempts result in basically this repeatedly:

---------------------

[ERROR] Failed to perform action “restart” for php-fpm “74”: The “/etc/init.d/ea-php74-php-fpm restart” command (process 1513030) reported error number 1 when it ended. Stopping php-fpm: [FAILED] Starting php-fpm: [FAILED] [29-Mar-2024 14:25:05] ERROR: Another FPM instance seems to already listen on /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/82d6741e861f16044dbd921e967176e84070d4b5.sock [29-Mar-2024 14:25:05] ERROR: FPM initialization failed Cpanel::Exception::Services::RestartError Service Status
Found 1 versions of PHP-FPM: 74

Service Error
(XID z6zq95) The “apache_php_fpm” service failed to restart because the restart script exited with an error:

apache_php_fpm has failed. Contact your system administrator if the service does not automagically recover.

---------------------

I also tried running upcp (without --force , since I can see my version of cPanel is no longer in the LTS update slot and am unsure of what would / could happen if I do --force). Regular upcp log seems to be normal, other than the "Newer releases of cPanel & WHM are not compatible with your operating system".

cPRex - I'm sorry to tag you in this post, but if anyone can help point me in the right direction I think it's you.

But please, anyone with input / suggestions, please chime-in.

Thank you!

Comments

21 comments

Date Votes
  • cPRex Jurassic Moderator

    Hey hey!  You never need to be sorry for tagging me.  I'm looking into this now.

    1
  • Metro2

    PS - in /usr/local/apache/logs/error_log I see this kind of message repeatedly:

    [proxy:error] [pid 1476606:tid 47655419913984] (2)No such file or directory: AH02454: FCGI: attempt to connect to Unix domain socket /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/6529a39470a5400e6b374b001e95cf13af06c221.sock (*:80) failed

     

    0
  • Metro2

    cPRex THANK YOU for taking a look / trying to help!

    0
  • cPRex Jurassic Moderator

    Here is the best idea I have - believe it or not, I am only seeing this issue come up on Plesk machines so far, so I don't have much to go on with cPanel.

    -Perform your restart so you can see one of those error messages
    -get that weird number string from the error - we want to use that
    -run this command:

    lsof | grep #####weirdnumberstring########

    That should show you a process ID.  Here's an example using Exim:

    exim      1217349                               mailnull  cwd       DIR                8,0      4096    1183067 /var/spool/exim

    We want that first number, 1217349, which is the PID.  Then we can run this:

    lsof -p PID

    Obviously your numbers will be different, but that should show us what process is holding open that PHP-FPM file.  You can then kill or restart that as necessary, and go from there.

    Let me know!

    1
  • Metro2

    Additionally, based on an old post from the old forum here, I tried removing one .sock file from /opt/cpanel/ea-php74/root/usr/var/run/php-fpm  and disabling php-fpm for just one user account that's not important / will be terminated tomorrow, and then re-enabled php-fpm for it, and now that account / site gives:

    Service Unavailable
    The server is temporarily unable to service your request due to maintenance downtime or capacity problems. Please try again later.
    Additionally, a 503 Service Unavailable error was encountered while trying to use an ErrorDocument to handle the request.

    This has me concerned that all of the currently functional accounts / sites that don't have the problem will develop it within the coming hours, and fear that I'm facing a train-wreck.

    0
  • cPRex Jurassic Moderator

    Did the above plan not help find anything?  If not, does just disabling PHP-FPM globally get things working again?

    0
  • Metro2

    OK, in a bit of tizzy, trying to figure out which "weird number string" you are referring to...

    0
  • Metro2

    In the meantime, to answer the other part of your question - I'm very afraid to disable php-fpm globally - because there are at least 250 other sites on the server that are currently running fine. I'm worried that if I disable / re-enable php-fpm globally, I could be facing a huge Friday evening backlash and tons of sites down.

    0
  • cPRex Jurassic Moderator

    For the weird number string, this guy, in bold:

    [proxy:error] [pid 1476606:tid 47655419913984] (2)No such file or directory: AH02454: FCGI: attempt to connect to Unix domain socket /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/6529a39470a5400e6b374b001e95cf13af06c221.sock (*:80) failed

    1
  • cPRex Jurassic Moderator

    (although that one is just an example - you'll want the most recent error message to get the most recent number)

    0
  • Metro2

    [/opt/cpanel/ea-php74/root/usr/var/run/php-fpm]# lsof | grep 6529a39470a5400e6b374b001e95cf13af06c221
    php-fpm   4112570             root   81u     unix 0xffff88071d7a0c00        0t0      66871 /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/6529a39470a5400e6b374b001e95cf13af06c221.sock

     

    [/opt/cpanel/ea-php74/root/usr/var/run/php-fpm]# lsof -p 4112570 |more


    COMMAND     PID USER   FD   TYPE             DEVICE SIZE/OFF      NODE NAME
    php-fpm 4112570 root  cwd    DIR                8,5     4096         2 /
    php-fpm 4112570 root  rtd    DIR                8,5     4096         2 /
    php-fpm 4112570 root  txt    REG                8,5  6307864   4985181 /opt/cpanel/ea-php74/root/usr/sbin/php-fpm
    php-fpm 4112570 root  mem    REG                8,5    18712   7471164 /lib64/libattr.so.1.1.0
    php-fpm 4112570 root  mem    REG                8,5    16600   7471167 /lib64/libcap.so.2.16
    php-fpm 4112570 root  mem    REG                8,5     9712  49545319 /opt/liblve/libsecureio.so.0.9.0
    php-fpm 4112570 root  mem    REG                8,5   111288  49545316 /opt/liblve/liblve.so.0.9.0
    php-fpm 4112570 root  mem    REG                0,4          127098987 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098986 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098985 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098984 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098983 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098982 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098981 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098980 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098979 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098978 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098977 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098976 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098975 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098974 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098973 (deleted)/dev/zero (stat: No such file or directory)

    <snip - lots of those>

    Then:

    php-fpm 4112570 root  mem    REG                8,5    16304   7471662 /lib64/libuuid.so.1.3.0
    php-fpm 4112570 root  mem    REG                8,5   166928   7484688 /lib64/libexpat.so.1.5.2
    php-fpm 4112570 root  mem    REG                8,5    85264  13634387 /usr/lib64/libgomp.so.1.0.0
    php-fpm 4112570 root  mem    REG                8,5    99224  13633682 /usr/lib64/libICE.so.6.3.0
    php-fpm 4112570 root  mem    REG                8,5    31576  13633684 /usr/lib64/libSM.so.6.0.1
    php-fpm 4112570 root  mem    REG                8,5   410352  13633893 /usr/lib64/libXt.so.6.0.0
    php-fpm 4112570 root  mem    REG                8,5    74336  13633845 /usr/lib64/libXext.so.6.4.0
    php-fpm 4112570 root  mem    REG                8,5   220584  13633669 /usr/lib64/libfontconfig.so.1.4.4
    php-fpm 4112570 root  mem    REG                8,5   412816  13633707 /usr/lib64/libtiff.so.3.9.4
    php-fpm 4112570 root  mem    REG                8,5   224136  13633932 /usr/lib64/liblcms.so.1.0.19
    php-fpm 4112570 root  mem    REG                8,5  2488880  13640666 /usr/lib64/libMagickCore.so.5.0.0
    php-fpm 4112570 root  mem    REG                8,5  1164512  13640668 /usr/lib64/libMagickWand.so.5.0.0
    php-fpm 4112570 root  mem    REG                8,5  1116991  57540656 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/imagick.so
    php-fpm 4112570 root  mem    REG                8,5    15232  49284767 /opt/alt/libmemcached/usr/lib64/libmemcachedutil.so.2.0.0
    php-fpm 4112570 root  mem    REG                8,5   205568  49284762 /opt/alt/libmemcached/usr/lib64/libmemcached.so.11.0.0
    php-fpm 4112570 root  mem    REG                8,5   106456  57540647 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/memcached.so
    php-fpm 4112570 root  mem    REG                8,5   635184  13635010 /usr/lib64/libzstd.so.1.4.5
    php-fpm 4112570 root  mem    REG                8,5   626848  57549791 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/redis.so
    php-fpm 4112570 root  mem    REG                8,5    81008  57544007 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/xmlrpc.so
    php-fpm 4112570 root  mem    REG                8,5    31448  57544036 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/xmlreader.so
    php-fpm 4112570 root  mem    REG                8,5    27416  57544005 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/pdo_odbc.so
    php-fpm 4112570 root  mem    REG                8,5    31288  57543981 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/pdo_mysql.so
    php-fpm 4112570 root  mem    REG                8,5   134128  57543979 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/mysqli.so
    php-fpm 4112570 root  mem    REG                8,5   140080   4987026 /opt/cpanel/ea-libzip/lib64/libzip.so.5.5
    php-fpm 4112570 root  mem    REG                8,5    60528  57544553 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/zip.so
    php-fpm 4112570 root  mem    REG                8,5    14288   7471202 /lib64/libgpg-error.so.0.5.0
    php-fpm 4112570 root  mem    REG                8,5   478496   7471210 /lib64/libgcrypt.so.11.5.3
    php-fpm 4112570 root  mem    REG                8,5   248072  13634582 /usr/lib64/libxslt.so.1.1.26
    php-fpm 4112570 root  mem    REG                8,5    81688  13634579 /usr/lib64/libexslt.so.0.8.15
    php-fpm 4112570 root  mem    REG                8,5    31632  57544038 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/xsl.so
    php-fpm 4112570 root  mem    REG                8,5    43608  57544037 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/xmlwriter.so
    php-fpm 4112570 root  mem    REG                8,5    47856  57544035 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/xml.so
    php-fpm 4112570 root  mem    REG                8,5    18808  57541417 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/tokenizer.so
    php-fpm 4112570 root  mem    REG                8,5   775248  54526274 /opt/cpanel/libtidy/lib64/libtidy.so.5.4.0
    php-fpm 4112570 root  mem    REG                8,5    52176  57544021 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/tidy.so
    php-fpm 4112570 root  mem    REG                8,5    14712  57544045 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/sysvshm.so
    php-fpm 4112570 root  mem    REG                8,5    10520  57544044 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/sysvsem.so
    php-fpm 4112570 root  mem    REG                8,5    18872  57544043 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/sysvmsg.so
    php-fpm 4112570 root  mem    REG                8,5    89208  57544039 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/sockets.so
    php-fpm 4112570 root  mem    REG                8,5   299096  57544032 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/soap.so
    php-fpm 4112570 root  mem    REG                8,5    52120  57544034 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/simplexml.so
    php-fpm 4112570 root  mem    REG                8,5    14640  57544042 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/shmop.so
    php-fpm 4112570 root  mem    REG                8,5    35504  57544018 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/posix.so
    php-fpm 4112570 root  mem    REG                8,5   265840  57541367 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/phar.so
    php-fpm 4112570 root  mem    REG                8,5   109904  57542798 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/pdo.so
    php-fpm 4112570 root  mem    REG                8,5    36880  13633913 /usr/lib64/libltdl.so.7.2.1
    php-fpm 4112570 root  mem    REG                8,5   417720  13637417 /usr/lib64/libodbc.so.2.0.0
    php-fpm 4112570 root  mem    REG                8,5    68592  57544004 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/odbc.so
    php-fpm 4112570 root  mem    REG                8,5   253000  57543980 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/mysqlnd.so
    php-fpm 4112570 root  mem    REG                8,5   609416   4984801 /opt/cpanel/ea-oniguruma/lib64/libonig.so.5.4.0
    php-fpm 4112570 root  mem    REG                8,5  1055344  57544025 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/mbstring.so
    php-fpm 4112570 root  mem    REG                8,5   244624   7494701 /lib64/libnspr4.so
    php-fpm 4112570 root  mem    REG                8,5    18720   7494702 /lib64/libplc4.so
    php-fpm 4112570 root  mem    REG                8,5    14528   7494703 /lib64/libplds4.so
    php-fpm 4112570 root  mem    REG                8,5   196056  13642567 /usr/lib64/libnssutil3.so
    php-fpm 4112570 root  mem    REG                8,5  1337200  13637880 /usr/lib64/libnss3.so
    php-fpm 4112570 root  mem    REG                8,5   185368  13645022 /usr/lib64/libsmime3.so
    php-fpm 4112570 root  mem    REG                8,5   361312  13645023 /usr/lib64/libssl3.so
    php-fpm 4112570 root  mem    REG                8,5   106160  13632479 /usr/lib64/libsasl2.so.2.0.23
    php-fpm 4112570 root  mem    REG                8,5    60512   7472537 /lib64/liblber-2.4.so.2.10.3
    php-fpm 4112570 root  mem    REG                8,5   330896   7472542 /lib64/libldap-2.4.so.2.10.3
    php-fpm 4112570 root  mem    REG                8,5    89392  57544031 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/ldap.so
    php-fpm 4112570 root  mem    REG                8,5    43568  57541363 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/json.so
    php-fpm 4112570 root  mem    REG                8,5    90912   7490566 /lib64/libgcc_s-4.4.7-20120601.so.1
    php-fpm 4112570 root  mem    REG                8,5   987096  13635160 /usr/lib64/libstdc++.so.6.0.13
    php-fpm 4112570 root  mem    REG                8,5 28668680   4997362 /opt/cpanel/ea-libicu/lib/libicudata.so.69.1
    php-fpm 4112570 root  mem    REG                8,5  1948248   4997402 /opt/cpanel/ea-libicu/lib/libicuuc.so.69.1
    php-fpm 4112570 root  mem    REG                8,5  3136512   4997364 /opt/cpanel/ea-libicu/lib/libicui18n.so.69.1
    php-fpm 4112570 root  mem    REG                8,5    55976   4997366 /opt/cpanel/ea-libicu/lib/libicuio.so.69.1
    php-fpm 4112570 root  mem    REG                8,5   477520  57544555 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/intl.so
    php-fpm 4112570 root  mem    REG                8,5   145864   7472227 /lib64/libaudit.so.1.0.0
    php-fpm 4112570 root  mem    REG                8,5    55848   7472315 /lib64/libpam.so.0.82.2
    php-fpm 4112570 root  mem    REG                8,5  1126992  57544024 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/imap.so
    php-fpm 4112570 root  mem    REG                8,5    43728  57544049 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/iconv.so
    php-fpm 4112570 root  mem    REG                8,5    14648  57544041 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/gettext.so
    php-fpm 4112570 root  mem    REG                8,5    10856  13633794 /usr/lib64/libXau.so.6.0.0
    php-fpm 4112570 root  mem    REG                8,5   151160  13633836 /usr/lib64/libxcb.so.1.1.0
    php-fpm 4112570 root  mem    REG                8,5   644072  13637657 /usr/lib64/libfreetype.so.6.3.22
    php-fpm 4112570 root  mem    REG                8,5  1297928  13633840 /usr/lib64/libX11.so.6.3.0
    php-fpm 4112570 root  mem    REG                8,5    70320  13633373 /usr/lib64/libXpm.so.4.11.0
    php-fpm 4112570 root  mem    REG                8,5   262896  13633680 /usr/lib64/libjpeg.so.62.0.0
    php-fpm 4112570 root  mem    REG                8,5   155456  13633673 /usr/lib64/libpng12.so.0.49.0
    php-fpm 4112570 root  mem    REG                8,5   380800  57544023 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/gd.so
    php-fpm 4112570 root  mem    REG                8,5    60272  57544020 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/ftp.so
    php-fpm 4112570 root  mem    REG                8,5  5737464  57544017 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/fileinfo.so
    php-fpm 4112570 root  mem    REG                8,5    84688  57544019 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/exif.so
    php-fpm 4112570 root  mem    REG                8,5  1140496   7489845 /lib64/libglib-2.0.so.0.2800.8
    php-fpm 4112570 root  mem    REG                8,5    11832   7490600 /lib64/libgmodule-2.0.so.0.2800.8
    php-fpm 4112570 root  mem    REG                8,5    44272  13637492 /usr/lib64/libenchant.so.1.5.0
    php-fpm 4112570 root  mem    REG                8,5    23064  57544040 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/enchant.so
    php-fpm 4112570 root  mem    REG                8,5   159824  57544033 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/dom.so
    php-fpm 4112570 root  mem    REG                8,5   515304  13652499 /usr/lib64/libtokyocabinet.so.8.24.0
    php-fpm 4112570 root  mem    REG                8,5  1525560   7471324 /lib64/libdb-4.7.so
    php-fpm 4112570 root  mem    REG                8,5    52848  57544187 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/dba.so
    php-fpm 4112570 root  mem    REG                8,5   122056   7471155 /lib64/libselinux.so.1
    php-fpm 4112570 root  mem    REG                8,5    10192   7471288 /lib64/libkeyutils.so.1.3
    php-fpm 4112570 root  mem    REG                8,5    43728   7492352 /lib64/libkrb5support.so.0.1
    php-fpm 4112570 root  mem    REG                8,5  1971552  13637874 /usr/lib64/libcrypto.so.1.0.1e
    php-fpm 4112570 root  mem    REG                8,5   443416  13647665 /usr/lib64/libssl.so.1.0.1e
    php-fpm 4112570 root  mem    REG                8,5   132696   2098979 /opt/cpanel/ea-brotli/lib/libbrotlicommon.so.1.0.9
    php-fpm 4112570 root  mem    REG                8,5   131952   2098983 /opt/cpanel/ea-brotli/lib/libbrotlidec.so.1.0.9
    php-fpm 4112570 root  mem    REG                8,5    14664   7471153 /lib64/libcom_err.so.2.1
    php-fpm 4112570 root  mem    REG                8,5   174840   7471126 /lib64/libk5crypto.so.3.1
    php-fpm 4112570 root  mem    REG                8,5   946048   7492188 /lib64/libkrb5.so.3.3
    php-fpm 4112570 root  mem    REG                8,5   277704   7484189 /lib64/libgssapi_krb5.so.2.2
    php-fpm 4112570 root  mem    REG                8,5   162080  13644783 /usr/lib64/libssh2.so.1.0.1
    php-fpm 4112570 root  mem    REG                8,5   178776  51380273 /opt/cpanel/nghttp2/lib/libnghttp2.so.14.26.0
    php-fpm 4112570 root  mem    REG                8,5  5557360  53872168 /opt/cpanel/libcurl/lib64/libcurl.so.4.8.0
    php-fpm 4112570 root  mem    REG                8,5   101488  57545791 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/curl.so
    php-fpm 4112570 root  mem    REG                8,5    14512  57540624 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/ctype.so
    php-fpm 4112570 root  mem    REG                8,5    31064  57544386 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/calendar.so
    php-fpm 4112570 root  mem    REG                8,5    67592   7471183 /lib64/libbz2.so.1.0.4
    php-fpm 4112570 root  mem    REG                8,5    23184  57544022 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/bz2.so
    php-fpm 4112570 root  mem    REG                8,5    35192  57544030 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/bcmath.so
    php-fpm 4112570 root  mem    REG                8,5  1380720  57549440 /opt/cpanel/ea-php74/root/usr/lib64/php/modules/ioncube_loader_lin_7.4.so
    php-fpm 4112570 root  mem    REG                8,5 99170352  13648135 /usr/lib/locale/locale-archive

    then more

    php-fpm 4112570 root  mem    REG                0,4          127098777 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098776 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098775 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098774 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098773 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098772 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098771 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098770 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098769 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098768 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098767 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098766 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098765 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098764 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098763 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098762 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098761 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098760 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098759 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098758 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098757 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098756 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098755 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098754 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098753 (deleted)/dev/zero (stat: No such file or directory)

    <snip - lots>

    php-fpm 4112570 root  mem    REG                8,5  1265299  34996485 /var/db/nscd/hosts
    php-fpm 4112570 root  mem    REG                8,5   134920  13632448 /usr/lib64/liblzma.so.0.0.0
    php-fpm 4112570 root  mem    REG                8,5   143368   7475062 /lib64/libpthread-2.12.so
    php-fpm 4112570 root  mem    REG                8,5    10304   7493708 /lib64/libfreebl3.so
    php-fpm 4112570 root  mem    REG                8,5  1924768   7474921 /lib64/libc-2.12.so
    php-fpm 4112570 root  mem    REG                8,5    88600   7472439 /lib64/libz.so.1.2.3
    php-fpm 4112570 root  mem    REG                8,5   111440   7486307 /lib64/libresolv-2.12.so
    php-fpm 4112570 root  mem    REG                8,5  3255038  51909541 /opt/cpanel/ea-openssl11/lib/libcrypto-ea.so.1.1
    php-fpm 4112570 root  mem    REG                8,5   687486  51904594 /opt/cpanel/ea-openssl11/lib/libssl-ea.so.1.1
    php-fpm 4112570 root  mem    REG                8,5  1421696  51121442 /opt/cpanel/ea-libxml2/lib64/libxml2.so.2.9.7
    php-fpm 4112570 root  mem    REG                8,5    20024   7480815 /lib64/libdl-2.12.so
    php-fpm 4112570 root  mem    REG                8,5   596864   7480843 /lib64/libm-2.12.so
    php-fpm 4112570 root  mem    REG                8,5    44528   7486309 /lib64/librt-2.12.so
    php-fpm 4112570 root  mem    REG                8,5    26168  50999776 /opt/cpanel/libargon2/lib64/libargon2.so.0
    php-fpm 4112570 root  mem    REG                8,5    40872   7474929 /lib64/libcrypt-2.12.so
    php-fpm 4112570 root  mem    REG                8,5   159312   7486098 /lib64/ld-2.12.so
    php-fpm 4112570 root  mem    REG                0,4          127098683 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098682 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                8,5   493726  34997816 /var/db/nscd/passwd
    php-fpm 4112570 root  mem    REG                0,4          127098681 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098680 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098679 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098678 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098677 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098676 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098675 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098674 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098673 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098672 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                8,5   217016  34997817 /var/db/nscd/group
    php-fpm 4112570 root  mem    REG                8,5    26060  13634140 /usr/lib64/gconv/gconv-modules.cache
    php-fpm 4112570 root  mem    REG                0,4          127098671 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098670 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098669 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098668 (deleted)/dev/zero (stat: No such file or directory)
    php-fpm 4112570 root  mem    REG                0,4          127098667 (deleted)/dev/zero (stat: No such file or directory)

    then:

    php-fpm 4112570 root    0u   CHR                1,3      0t0      4197 /dev/null
    php-fpm 4112570 root    1u   CHR                1,3      0t0      4197 /dev/null
    php-fpm 4112570 root    2w   REG                8,5 18495487   4985216  (deleted)/opt/cpanel/ea-php74/root/usr/var/log/php-fpm/error.log-20240317
    php-fpm 4112570 root    3r   CHR                1,9      0t0      4202 /dev/urandom
    php-fpm 4112570 root    4w   REG                8,5 18495487   4985216  (deleted)/opt/cpanel/ea-php74/root/usr/var/log/php-fpm/error.log-20240317
    php-fpm 4112570 root    5u  unix 0xffff8806348cc880      0t0 127098988 socket
    php-fpm 4112570 root    6r  FIFO                0,8      0t0 312007055 pipe
    php-fpm 4112570 root    7u  unix 0xffff8806348ccc00      0t0 127098989 socket
    php-fpm 4112570 root    8r   CHR              10,57      0t0     15767 /dev/lve
    php-fpm 4112570 root    9u  unix 0xffff88087a5548c0      0t0     66655 /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/82d6741e861f16044dbd921e967176e84070d4b5.sock
    php-fpm 4112570 root   10u  unix 0xffff8807e1cd94c0      0t0     66658 /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/a4659fdcfd9720c234ae9a3f7c2e6e8e2829db0b.sock
    php-fpm 4112570 root   11u  unix 0xffff8807e1cd9140      0t0     66661 /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/3cc209084b6b06c0dbd468cc2c01010a1d3eb0d1.sock
    php-fpm 4112570 root   12u  unix 0xffff880745519b80      0t0     66664 /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/b1df5d2a67517707233af79f339af0b822e75d3e.sock
    php-fpm 4112570 root   13u  unix 0xffff880745519480      0t0     66667 /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/5dfac87510244b5ed90313f7e09b5c2ad76808e4.sock
    php-fpm 4112570 root   14u  unix 0xffff8807fecbc100      0t0     66670 /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/eea22387dbd7bd59b731b3195de6d15458f3a1db.sock
    php-fpm 4112570 root   15u  unix 0xffff8807fecbc800      0t0     66673 /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/815cc283e2c96d24407128f8f9c73d9e1c61243c.sock
    php-fpm 4112570 root   16u  unix 0xffff8807fecbc480      0t0     66676 /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/9edb379bf39047299e2da37eb71236d9bb2ed1db.sock
    php-fpm 4112570 root   17u  unix 0xffff8807457a4800      0t0     66679 /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/8c4ccd8b09c5bac42fafed36c3dc257a54d5253d.sock
    php-fpm 4112570 root   18u  unix 0xffff8807457a4480      0t0     66682 /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/50426273dba93d7d00821e32f7ba8f6e55da8f31.sock
    php-fpm 4112570 root   19u  unix 0xffff8807457a4100      0t0     66685 /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/8213b4ceb102f8eb4f65653d913d51ce671d42e4.sock
    php-fpm 4112570 root   20u  unix 0xffff8807fec2c7c0      0t0     66688 /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/324612f2716c5e6a4f8b32b35aa4adb3cb866622.sock
    php-fpm 4112570 root   21u  unix 0xffff8808384aab40      0t0     66691 /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/df9f84e99d9bfff2b3398ab74276534f6ee5b7ab.sock
    php-fpm 4112570 root   22u  unix 0xffff8808384aa7c0      0t0     66694 /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/803278a0c88061284ac77474a88582954fcd8a49.sock
    php-fpm 4112570 root   23u  unix 0xffff8808384aa440      0t0     66697 /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/742790f18a09796b79177ef1b06374b5823b1fe1.sock
    php-fpm 4112570 root   24u  unix 0xffff8808384aa0c0      0t0     66700 /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/449f5d0747407af86888b6ade412ea5232376b21.sock

    <snip - lots of .sock like that, one for every account / site it would seem>

    then:

    php-fpm 4112570 root  347u  0000                0,9        0      4193 [eventpoll]
    php-fpm 4112570 root  348r  FIFO                0,8      0t0 312006226 pipe
    php-fpm 4112570 root  349r  FIFO                0,8      0t0 312006388 pipe
    php-fpm 4112570 root  350r  FIFO                0,8      0t0 312006087 pipe
    php-fpm 4112570 root  351r  FIFO                0,8      0t0 312006697 pipe
    php-fpm 4112570 root  352r  FIFO                0,8      0t0 312006347 pipe
    php-fpm 4112570 root  353r  FIFO                0,8      0t0 312006986 pipe
    php-fpm 4112570 root  354r  FIFO                0,8      0t0 312006589 pipe
    php-fpm 4112570 root  355r  FIFO                0,8      0t0 312006790 pipe
    php-fpm 4112570 root  356r  FIFO                0,8      0t0 312007082 pipe
    php-fpm 4112570 root  357r  FIFO                0,8      0t0 312005614 pipe
    php-fpm 4112570 root  358r  FIFO                0,8      0t0 312006698 pipe
    php-fpm 4112570 root  359r  FIFO                0,8      0t0 312006100 pipe
    php-fpm 4112570 root  360r  FIFO                0,8      0t0 312006808 pipe
    php-fpm 4112570 root  361r  FIFO                0,8      0t0 312001840 pipe
    php-fpm 4112570 root  362r  FIFO                0,8      0t0 312006590 pipe
    php-fpm 4112570 root  363r  FIFO                0,8      0t0 312007056 pipe
    php-fpm 4112570 root  364r  FIFO                0,8      0t0 312005641 pipe
    php-fpm 4112570 root  365r  FIFO                0,8      0t0 312005615 pipe
    php-fpm 4112570 root  366r  FIFO                0,8      0t0 312006791 pipe
    php-fpm 4112570 root  367r  FIFO                0,8      0t0 312005642 pipe
    php-fpm 4112570 root  368r  FIFO                0,8      0t0 312006088 pipe
    php-fpm 4112570 root  369r  FIFO                0,8      0t0 312001841 pipe
    php-fpm 4112570 root  370r  FIFO                0,8      0t0 312006987 pipe
    php-fpm 4112570 root  371r  FIFO                0,8      0t0 312006809 pipe
    php-fpm 4112570 root  372r  FIFO                0,8      0t0 312006118 pipe
    php-fpm 4112570 root  374r  FIFO                0,8      0t0 312007083 pipe
    php-fpm 4112570 root  377r  FIFO                0,8      0t0 312006101 pipe
    php-fpm 4112570 root  378r  FIFO                0,8      0t0 312006124 pipe
    php-fpm 4112570 root  379r  FIFO                0,8      0t0 312006119 pipe
    php-fpm 4112570 root  380r  FIFO                0,8      0t0 312006163 pipe
    php-fpm 4112570 root  381r  FIFO                0,8      0t0 312006125 pipe
    php-fpm 4112570 root  382r  FIFO                0,8      0t0 312006174 pipe
    php-fpm 4112570 root  383r  FIFO                0,8      0t0 312006164 pipe
    php-fpm 4112570 root  384r  FIFO                0,8      0t0 312006191 pipe
    php-fpm 4112570 root  385r  FIFO                0,8      0t0 312006175 pipe
    php-fpm 4112570 root  386r  FIFO                0,8      0t0 312006227 pipe
    php-fpm 4112570 root  387r  FIFO                0,8      0t0 312006192 pipe
    php-fpm 4112570 root  388r  FIFO                0,8      0t0 312006364 pipe
    php-fpm 4112570 root  389r  FIFO                0,8      0t0 312006348 pipe
    php-fpm 4112570 root  390r  FIFO                0,8      0t0 312006389 pipe
    php-fpm 4112570 root  391r  FIFO                0,8      0t0 312006365 pipe

    0
  • cPRex Jurassic Moderator

    That is unfortunately not what I was hoping for.  I was hoping the issue would be tied to one specific user and we could fix that.  This seems like something is broken within FPM itself.

    Is there any way the DC could open a ticket with us? 

    0
  • Metro2

    Server is not maxed-out:

    top - 15:34:33 up 22 days, 17:09,  1 user,  load average: 2.42, 2.70, 3.24
    Tasks: 609 total,   2 running, 606 sleeping,   0 stopped,   1 zombie
    Cpu(s):  5.1%us,  1.3%sy,  0.1%ni, 86.4%id,  7.1%wa,  0.0%hi,  0.0%si,  0.0%st
    Mem:  65709624k total, 60101056k used,  5608568k free,  6577928k buffers
    Swap: 16777212k total,    69764k used, 16707448k free, 35016076k cached

    0
  • Metro2
    • Edited

    I can try to get DC to open a ticket.

    0
  • Metro2

    I managed to get ahold of DC, and I'm on hold right now while agent submits ticket. I've requested to hold so that I can get the ticket number and post it here for you. Thank you Rex!

    0
  • Metro2

    cPanel ticket #95237236

    0
  • Metro2
    • Edited

    cPRex - and I know you've heard enough gripes about the "change" of how cPanel Support only allows tickets from DC's for us dedicated leasers, but here's a perfect example of just how inefficient and costly that change is - here's the most recent update from my DC:

    "I am not sure if you can see the ticket update from cPanel. cPanel is requesting for one of the domains which is having this issue? If you do not see the ticket update, can you provide the example domain that I can pass it to cPanel support?"

    And that was from a Dedicated Server Engineer at the DC. The support process is difficult now since the change in late 2023.

    0
  • Metro2

    And in the end - this was resolved quite readily by a cPanel analyst (I don't know who you are, but THANK YOU!) and here is what the cPanel technician did / sent to the DC ticket after I explained to the DC tech that the issue was not for a single domain or account, but the fact that php-fpm would not restart and would not work for new accounts:

    Thank you for the extra information, attemping to restart FPM was reporting and already running instance:
     [29-Mar-2024 18:03:48] ERROR: Another FPM instance seems to already listen on /opt/cpanel/ea-php74/root/usr/var/run/php-fpm/82d6741e861f16044dbd921e967176e84070d4b5.sock

    This was caused by an older stale process:
    root     4112570  0.4  0.0 465800  9060 ?        Ss   Mar16  79:31 php-fpm: master process (/opt/cpanel/ea-php74/root/etc/php-fpm.conf)

    I killed this process then was able to restart without issue:
    [18:09:36 (hostname) root@95237236 ~]cPs# /scripts/restartsrv_apache_php_fpm --hard

    Service Status
     Found 1 versions of PHP-FPM: 74

    Apache PHP-FPM 74(php-fpm: master process (/opt/cpanel/ea-php74/root/etc/php-fpm.conf)) is running as root with PID “1647867” (process table check method)

    apache_php_fpm restarted successfull

    So in the end - we don't know why it happened, but the solution was to kill the original php-fpm   process id 4112570 that I posted from the logs earlier, and then php-fpm was able to restart without issue.

    Earlier on when I posted that process, I had thought about killing and trying the restart, but admittedly I was simply too scared to do that, as I have never encountered this before (and I've had php-fpm running on all servers / accounts for many years now). I was worried that I might break everything by doing so. And so while I did not submit cPanel support tickets too often over the decades that we were able to before the change in late 2023, this was one of those rare occasions where it would have been really helpful to just pay the fee for a priority ticket and save 6 hours of time.

    Thank you cPRex for your unrelenting efforts to help us mere mortals, and thank you to whomever the cPanel analyst was who jumped on the DC ticket right away / solved the problem / explained how they resolved it. I am extremely relieved after being extremely stressed-out!

    I'm relieved to say that this is solved and that I'm glad to know that I could have just safely killed that process and restarted php-fpm. One for the books.

    Maybe this thread will help someone else someday. We live to fight another day! (yes, Maiden reference).

    Cheers.

    0
  • cPRex Jurassic Moderator

    I'm so glad that's all it was, and we were pretty close with the PID check!  Let us know if you need anything else!

    1
  • Metro2

    Indeed! You were absolutely key in getting me in the right direction, thank you Rex! Appreciate you very much!

    0
  • cPRex Jurassic Moderator

    You're very welcome!!!

    0

Please sign in to leave a comment.

Didn't find what you were looking for?

New post