CentOS -> AlmaLinux 8 Issue
Hi,
Attempted to upgrade to AlmaLinux 8 as instructed by WHM when I signed in today. Went through the process with no issues until I got to the reboot stage. Did that and now my server seems to have closed down.
I use AWS, so I've restarted the instance to see if that will push things along, but nothing. I cannot access WHM and I don't seem to be able to SSH into it either.
This is the last part of the system logs for the instance:
----
[[0;32m OK [0m] Started memcached daemon.
[[0;32m OK [0m] Started GSSAPI Proxy Daemon.
[[0;32m OK [0m] Reached target NFS client services.
[[0;32m OK [0m] Reached target Remote File Systems (Pre).
[[0;32m OK [0m] Reached target Remote File Systems.
[[0;32m OK [0m] Started Dynamic System Tuning Daemon.
[ 12.685182] cloud-init[1197]: Cloud-init v. 22.1-6.el8_7.2.alma running 'init' at Mon, 17 Apr 2023 14:20:43 +0000. Up 12.38 seconds.
[ 12.698843] cloud-init[1197]: ci-info: +++++++++++++++++++++++++++++++++++++++Net device info+++++++++++++++++++++++++++++++++++++++
[ 12.718237] cloud-init[1197]: ci-info: +--------+------+------------------------------+---------------+--------+-------------------+
[ 12.727786] cloud-init[1197]: ci-info: | Device | Up | Address | Mask | Scope | Hw-Address |
[ 12.740113] cloud-init[1197]: ci-info: +--------+------+------------------------------+---------------+--------+-------------------+
[ 12.750531] cloud-init[1197]: ci-info: | eth0 | True | 10.0.3.37 | 255.255.240.0 | global | 12:55:2c:64:76:eb |
[ 12.761912] cloud-init[1197]: ci-info: | eth0 | True | fe80::1055:2cff:fe64:76eb/64 | . | link | 12:55:2c:64:76:eb |
[ 12.771550] cloud-init[1197]: ci-info: | lo | True | 127.0.0.1 | 255.0.0.0 | host | . |
[ 12.779673] cloud-init[1197]: ci-info: | lo | True | ::1/128 | . | host | . |
[ 12.788089] cloud-init[1197]: ci-info: +--------+------+------------------------------+---------------+--------+-------------------+
[ 12.796512] cloud-init[1197]: ci-info: +++++++++++++++++++++++++++Route IPv4 info++++++++++++++++++++++++++++
[ 12.803863] cloud-init[1197]: ci-info: +-------+-------------+----------+---------------+-----------+-------+
[ 12.813760] cloud-init[1197]: ci-info: | Route | Destination | Gateway | Genmask | Interface | Flags |
[ 12.824910] cloud-init[1197]: ci-info: +-------+-------------+----------+---------------+-----------+-------+
[ 12.836346] cloud-init[1197]: ci-info: | 0 | 0.0.0.0 | 10.0.0.1 | 0.0.0.0 | eth0 | UG |
[ 12.847567] cloud-init[1197]: ci-info: | 1 | 10.0.0.0 | 0.0.0.0 | 255.255.240.0 | eth0 | U |
[ 12.858661] cloud-init[1197]: ci-info: +-------+-------------+----------+---------------+-----------+-------+
[ 12.868250] cloud-init[1197]: ci-info: +++++++++++++++++++Route IPv6 info+++++++++++++++++++
[ 12.874838] cloud-init[1197]: ci-info: +-------+-------------+---------+-----------+-------+
[ 12.884567] cloud-init[1197]: ci-info: | Route | Destination | Gateway | Interface | Flags |
[ 12.894282] cloud-init[1197]: ci-info: +-------+-------------+---------+-----------+-------+
[ 12.902525] cloud-init[1197]: ci-info: | 10 | fe80::/64 | :: | eth0 | U |
[ 12.911290] cloud-init[1197]: ci-info: | 12 | local | :: | eth0 | U |
[ 12.919387] cloud-init[1197]: ci-info: | 13 | multicast | :: | eth0 | U |
[ 12.929408] cloud-init[1197]: ci-info: +-------+-------------+---------+-----------+-------+
[[0;32m OK [0m] Started Initial cloud-init job (metadata service crawler).
Starting Permit User Sessions...
Starting OpenSSH server daemon...
[[0;32m OK [0m] Reached target Network is Online.
Starting System Logging Service...
Starting p0f passive fingerprinter...
Starting cPanel IP aliases service...
Starting Fastmail Services...
Starting cPanel services...
Starting SMTP Tweak...
Starting cPanel fix quotas on boot...
Starting Crash recovery kernel arming...
Starting Notify NFS peers of a restart...
Starting cPanel IPv6 service...
[[0;32m OK [0m] Reached target Cloud-config availability.
Starting Apply the settings specified in cloud-config...
[[0;32m OK [0m] Started OpenSSH server daemon.
[[0;32m OK [0m] Started System Logging Service.
[[0;32m OK [0m] Started Permit User Sessions.
[[0;32m OK [0m] Started Notify NFS peers of a restart.
[[0;32m OK [0m] Started Serial Getty on ttyS0.
[[0;32m OK [0m] Started Job spooling tools.
[[0;32m OK [0m] Started Command Scheduler.
[[0;32m OK [0m] Started Getty on tty1.
[[0;32m OK [0m] Reached target Login Prompts.
[[0;32m OK [0m] Started p0f passive fingerprinter.
[[0;32m OK [0m] Started cPanel IP aliases service.
[[0;32m OK [0m] Created slice User Slice of UID 0.
Starting User runtime directory /run/user/0...
[[0;32m OK [0m] Started User runtime directory /run/user/0.
Starting User Manager for UID 0...
[[0;32m OK [0m] Started Fastmail Services.
[[ 13.986438] cloud-init[1480]: Cloud-init v. 22.1-6.el8_7.2.alma running 'modules:config' at Mon, 17 Apr 2023 14:20:44 +0000. Up 13.83 seconds.
[0;32m OK [0m] Started cPanel services.
Starting cPanel Greylisting Daemon...
Starting cPanel dav services...
Starting tailwatchd...
Starting FPM service for cPanel Daemons...
Starting cPanel brute force detector services...
Starting cPanel Log services...
Starting cPanel DNS admin service...
[[0;32m OK [0m] Started User Manager for UID 0.
[[0;32m OK [0m] Started Session 1 of user root.
[[0;32m OK [0m] Started Apply the settings specified in cloud-config.
Starting Execute cloud user/final scripts...
[[0;32m OK [0m] Started cPanel Log services.
[[0;32m OK [0m] Started cPanel IPv6 service.
[[0;1;31mFAILED[0m] Failed to start cPanel Greylisting Daemon.
See 'systemctl status cpgreylistd.service' for details.
[[0;32m OK [0m] Started cPanel brute force detector services.
[[0;32m OK [0m] Started cPanel DNS admin service.
[[0;32m OK [0m] Started cPanel dav services.
[ 15.207193] cloud-init[1636]: Cloud-init v. 22.1-6.el8_7.2.alma running 'modules:final' at Mon, 17 Apr 2023 14:20:46 +0000. Up 15.00 seconds.
[ 15.229568] cloud-init[1636]: Cloud-init v. 22.1-6.el8_7.2.alma finished at Mon, 17 Apr 2023 14:20:46 +0000. Datasource DataSourceEc2Local. Up 15.19 seconds
[[0;32m OK [0m] Started Execute cloud user/final scripts.
[[0;32m OK [0m] Started SMTP Tweak.
[[0;1;31mFAILED[0m] Failed to start FPM service for cPanel Daemons.
See 'systemctl status cpanel_php_fpm.service' for details.
[[0;32m OK [0m] Started tailwatchd.
[[0;32m OK [0m] Started cPanel fix quotas on boot.
[[0;32m OK [0m] Reached target Multi-User System.
[[0;32m OK [0m] Reached target Cloud-init target.
Starting Update UTMP about System Runlevel Changes...
[[0;32m OK [0m] Started Update UTMP about System Runlevel Changes.
[[0;32m OK [0m] Started Crash recovery kernel arming.
AlmaLinux 8.7 (Stone Smilodon)
Kernel 4.18.0-425.19.2.el8_7.x86_64 on an x86_64
server login:
----
Any idea on what I'm supposed to do next or fix it?
-
Hey there! There will be multiple reboots during the update process, with some of them taking a long time - up to 30 minutes or more. It's possible that you're just in one of those reboot periods. If you have a console provided by your host you could watch the server status there, but if it's still not reachable after 30-45 minutes, you'll want to contact your host to have them investigate the system. 0 -
I manage the the AWS Instances, so it would be myself. I think I started running it about 12, so nearly 4 hours ago now. 0 -
That does seem too long for sure. I'd check the console if you can access that, and if not, you'll need to reach out to their support to have them check the machine. 0 -
Unfortunately AWS aren't that forth coming. Does the log file make sense? It's just ended with 'server login' as if waiting for something? 0 -
No, I haven't seen exactly that output before. Are you able to access the system over SSH at this time? If so, it would be best to submit a ticket to our support team so we can review that update. 0 -
No I can't access SSH at the moment. And I can't generate a support ticket with cPanel because it required support id, which is generated via WHM! So I'm a little stuck! 0 -
If there's no SSH access you'll have to reach out to the host as there isn't anything we could do on our side. You can always email cs@cpanel.net to start a ticket without having your ID ready. 0 -
So good news, I can now access the SSH. Not really sure where I am to go from here! 0 -
Hey that's progress! If SSH works, you can submit that ticket and we can take a look. 0 -
Done and done :) 0 -
Great - once you have the ticket number, please share it here so I can follow along. 0 -
Ticket Number: 95045506 0 -
Thanks for that - I'm following along now, and I've given it some priority since the system isn't responding properly. 0 -
Not sure if this helps narrow things down, but when I try and do anything on SSH, I get this: --- Traceback (most recent call last): File "/usr/lib64/python3.6/site-packages/libdnf/error.py", line 14, in swig_import_helper return importlib.import_module(mname) File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "", line 994, in _gcd_import File "", line 971, in _find_and_load File "", line 955, in _find_and_load_unlocked File "", line 658, in _load_unlocked File "", line 571, in module_from_spec File "", line 922, in create_module File "", line 219, in _call_with_frames_removed ImportError: libbrotlidec.so.1: cannot open shared object file: No such file or directory During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/bin/dnf", line 57, in from dnf.cli import main File "/usr/lib/python3.6/site-packages/dnf/__init__.py", line 30, in import dnf.base File "/usr/lib/python3.6/site-packages/dnf/base.py", line 29, in import libdnf.transaction File "/usr/lib64/python3.6/site-packages/libdnf/__init__.py", line 8, in from . import error File "/usr/lib64/python3.6/site-packages/libdnf/error.py", line 17, in _error = swig_import_helper() File "/usr/lib64/python3.6/site-packages/libdnf/error.py", line 16, in swig_import_helper return importlib.import_module('_error') File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) ModuleNotFoundError: No module named '_error' --- Any ideas? 0 -
Thanks for that - it doesn't look good, but I've added it to the ticket so our team can see that. 0 -
Our team was able to find an issue with the ImageMagick installer that was keeping the update from completing. After enabling the EPEL repository to get that installed, things are working well and the update was able to complete. yum -y install ImageMagick ImageMagick-libs
0 -
Many thanks - I can now see the WHM. With all the issues of restarting, it's knocked out my subscription " To access the interface, you must install the license and ensure that the license is active. " - so I'm waiting for the Customer Services team to refresh or re-establish this. 0 -
Yup - it looks like Mae in our CS team is taking care of that now! 0 -
Hello: I"m getting the same error that @Innosonian mentioned: ===================== Traceback (most recent call last): File "/usr/lib64/python3.6/site-packages/libdnf/error.py", line 14, in swig_import_helper return importlib.import_module(mname) File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "", line 994, in _gcd_import File "", line 971, in _find_and_load File "", line 955, in _find_and_load_unlocked File "", line 658, in _load_unlocked File "", line 571, in module_from_spec File "", line 922, in create_module File "", line 219, in _call_with_frames_removed ImportError: libbrotlidec.so.1: cannot open shared object file: No such file or directory During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/bin/yum", line 57, in from dnf.cli import main File "/usr/lib/python3.6/site-packages/dnf/__init__.py", line 30, in import dnf.base File "/usr/lib/python3.6/site-packages/dnf/base.py", line 29, in import libdnf.transaction File "/usr/lib64/python3.6/site-packages/libdnf/__init__.py", line 8, in from . import error File "/usr/lib64/python3.6/site-packages/libdnf/error.py", line 17, in _error = swig_import_helper() File "/usr/lib64/python3.6/site-packages/libdnf/error.py", line 16, in swig_import_helper return importlib.import_module('_error') File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) ModuleNotFoundError: No module named '_error' ===================== I've tried to enable the EPEL repository, but I got the same error: ===================== root@server [~]# dnf install epel-release Traceback (most recent call last): File "/usr/lib64/python3.6/site-packages/libdnf/error.py", line 14, in swig_import_helper return importlib.import_module(mname) File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "", line 994, in _gcd_import . . . ===================== Any suggest @cPRex, I really appreciate your support. Thank you. 0 -
Thank you @cPRex Command "yum update" generate exactly the same error: =========================== root@server [~]# yum update Traceback (most recent call last): File "/usr/lib64/python3.6/site-packages/libdnf/error.py", line 14, in swig_import_helper return importlib.import_module(mname) File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "", line 994, in _gcd_import File "", line 971, in _find_and_load File "", line 955, in _find_and_load_unlocked File "", line 658, in _load_unlocked File "", line 571, in module_from_spec File "", line 922, in create_module File "", line 219, in _call_with_frames_removed ImportError: libbrotlidec.so.1: cannot open shared object file: No such file or directory During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/bin/yum", line 57, in from dnf.cli import main File "/usr/lib/python3.6/site-packages/dnf/__init__.py", line 30, in import dnf.base File "/usr/lib/python3.6/site-packages/dnf/base.py", line 29, in import libdnf.transaction File "/usr/lib64/python3.6/site-packages/libdnf/__init__.py", line 8, in from . import error File "/usr/lib64/python3.6/site-packages/libdnf/error.py", line 17, in _error = swig_import_helper() File "/usr/lib64/python3.6/site-packages/libdnf/error.py", line 16, in swig_import_helper return importlib.import_module('_error') File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) ModuleNotFoundError: No module named '_error' =========================== In the URL that you share in your last post "1940830 " yum and rpm become broken after installing module" mention that it is not a bug and doesn't share a clue to obtain a real/quick fix. Do you think a reinstall of the operating system might be the best or fastest way to resolve it? Does the cPanel team have a guide for handling it? Any suggestion that helps us solve the problem or gives us a clue at least is welcome. We really appreciate your support. 0 -
The best thing to do for this issue is to contact your hosting provider or datacenter. A reinstall of the operating system would wipe all data on the server, so you don't want to do that unless you absolutely have to. 0
Please sign in to leave a comment.
Comments
22 comments