High 5 minute load average alert

AladdinJ

• July 23, 2020 16:18

Hello I think there is something not normal in my server I receive this notification about 5 times a day anybody could help me determine what is the problem or what prosses using my server resource Time: Thu Jul 23 22:43:12 2020 +0200 1 Min Load Avg: 10.37 5 Min Load Avg: 6.25 15 Min Load Avg: 2.56 Running/Total Processes: 10/230 ps file Output from ps: USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND root 2 0.0 0.0 0 0 ? S 22:38 0:00 [kthreadd] root 3 1.4 0.0 0 0 ? S 22:38 0:03 \_ [kworker/0:0] root 4 0.0 0.0 0 0 ? S< 22:38 0:00 \_ [kworker/0:0H] root 5 0.2 0.0 0 0 ? S 22:38 0:00 \_ [kworker/u4:0] root 6 1.4 0.0 0 0 ? S 22:38 0:03 \_ [ksoftirqd/0] root 7 2.5 0.0 0 0 ? S 22:38 0:06 \_ [migration/0] root 8 0.0 0.0 0 0 ? S 22:38 0:00 \_ [rcu_bh] root 9 8.0 0.0 0 0 ? R 22:38 0:19 \_ [rcu_sched] root 10 0.0 0.0 0 0 ? S< 22:38 0:00 \_ [lru-add-drain] root 11 0.9 0.0 0 0 ? S 22:38 0:02 \_ [watchdog/0] root 12 1.2 0.0 0 0 ? S 22:38 0:03 \_ [watchdog/1] root 13 0.4 0.0 0 0 ? S 22:38 0:01 \_ [migration/1] root 14 1.1 0.0 0 0 ? S 22:38 0:02 \_ [ksoftirqd/1] root 15 1.3 0.0 0 0 ? S 22:38 0:03 \_ [kworker/1:0] root 16 0.0 0.0 0 0 ? S< 22:38 0:00 \_ [kworker/1:0H] root 18 0.0 0.0 0 0 ? S 22:38 0:00 \_ [kdevtmpfs] root 19 0.0 0.0 0 0 ? S< 22:38 0:00 \_ [netns] root 20 0.0 0.0 0 0 ? S 22:38 0:00 \_ [khungtaskd] root 21 0.0 0.0 0 0 ? S< 22:38 0:00 \_ [writeback] root 22 0.0 0.0 0 0 ? S< 22:38 0:00 \_ [kintegrityd] root 23 0.0 0.0 0 0 ? S< 22:38 0:00 \_ [bioset] root 24 0.0 0.0 0 0 ? S< 22:38 0:00 \_ [bioset] root 25 0.0 0.0 0 0 ? S< 22:38 0:00 \_ [bioset] root 26 0.0 0.0 0 0 ? S< 22:38 0:00 \_ [kblockd] root 27 0.0 0.0 0 0 ? S< 22:38 0:00 \_ [md] root 28 0.0 0.0 0 0 ? S< 22:38 0:00 \_ [edac-poller] root 29 0.0 0.0 0 0 ? S< 22:38 0:00 \_ [watchdogd] root 30 0.0 0.0 0 0 ? S 22:38 0:00 \_ [kworker/0:1] root 35 0.0 0.0 0 0 ? S 22:39 0:00 \_ [kswapd0] root 36 0.0 0.0 0 0 ? SN 22:39 0:00 \_ [ksmd] root 37 0.4 0.0 0 0 ? SN 22:39 0:01 \_ [khugepaged] root 38 0.0 0.0 0 0 ? S< 22:39 0:00 \_ [crypto] root 46 0.0 0.0 0 0 ? S< 22:39 0:00 \_ [kthrotld] root 47 0.0 0.0 0 0 ? S 22:39 0:00 \_ [kworker/u4:1] root 48 0.0 0.0 0 0 ? S< 22:39 0:00 \_ [kmpath_rdacd] root 49 0.0 0.0 0 0 ? S< 22:39 0:00 \_ [kaluad] root 50 0.0 0.0 0 0 ? S 22:39 0:00 \_ [kworker/1:1] root 51 0.0 0.0 0 0 ? S< 22:39 0:00 \_ [kpsmoused] root 52 0.0 0.0 0 0 ? S 22:39 0:00 \_ [kworker/1:2] root 53 0.0 0.0 0 0 ? S< 22:39 0:00 \_ [ipv6_addrconf] root 66 0.0 0.0 0 0 ? S< 22:39 0:00 \_ [deferwq] root 110 0.0 0.0 0 0 ? S 22:39 0:00 \_ [kauditd] root 225 0.0 0.0 0 0 ? S 22:39 0:00 \_ [kworker/u4:2] root 228 0.0 0.0 0 0 ? S< 22:39 0:00 \_ [ata_sff] root 235 0.0 0.0 0 0 ? S 22:39 0:00 \_ [scsi_eh_0] root 236 0.0 0.0 0 0 ? S< 22:39 0:00 \_ [scsi_tmf_0] root 237 0.0 0.0 0 0 ? S 22:39 0:00 \_ [scsi_eh_1] root 238 0.0 0.0 0 0 ? S< 22:39 0:00 \_ [scsi_tmf_1] root 239 0.1 0.0 0 0 ? S 22:39 0:00 \_ [kworker/u4:3] root 240 0.0 0.0 0 0 ? S< 22:39 0:00 \_ [virtscsi-scan] root 242 0.0 0.0 0 0 ? S 22:39 0:00 \_ [scsi_eh_2] root 243 0.0 0.0 0 0 ? S< 22:39 0:00 \_ [scsi_tmf_2] root 245 0.0 0.0 0 0 ? S 22:39 0:00 \_ [kworker/u4:4] root 254 0.0 0.0 0 0 ? S< 22:39 0:00 \_ [ttm_swap] root 260 2.4 0.0 0 0 ? S 22:39 0:05 \_ [kworker/0:2] root 269 1.0 0.0 0 0 ? S 22:39 0:02 \_ [jbd2/sda1-8] root 270 0.0 0.0 0 0 ? S< 22:39 0:00 \_ [ext4-rsv-conver] root 352 0.3 0.0 0 0 ? S< 22:39 0:00 \_ [kworker/1:1H] root 386 0.6 0.0 0 0 ? S< 22:39 0:01 \_ [kworker/0:1H] root 585 0.0 0.0 0 0 ? S< 22:39 0:00 \_ [kvm-irqfd-clean] root 739 0.3 0.0 0 0 ? S< 22:39 0:00 \_ [loop0] root 740 0.0 0.0 0 0 ? S 22:39 0:00 \_ [jbd2/loop0-8] root 741 0.0 0.0 0 0 ? S< 22:39 0:00 \_ [ext4-rsv-conver] root 1 9.5 0.0 44132 4452 ? Ss 22:38 0:23 /usr/lib/systemd/systemd --switched-root --system --deserialize 21 root 361 0.7 0.0 39240 3800 ? Ss 22:39 0:01 /usr/lib/systemd/systemd-journald root 395 0.4 0.0 45016 1976 ? Ss 22:39 0:00 /usr/lib/systemd/systemd-udevd root 412 0.0 0.0 55532 852 ? S
Thanks in Advance

• 

  cPAdminsMichael

  • July 24, 2020 16:18

  Hi, It's difficult giving a good diagnose with the ps output. I can see you have quite many WHM connections. Have you enabled and configured cPHulk? It would require further diagnostics to identify the reason for the load - it can also be that your server's specs are just too low for your load.. Can you paste in the values from top? And maybe also run sar and paste the output?

  0
• 

  AladdinJ

  • July 24, 2020 17:10

  Hi, It's difficult giving a good diagnose with the ps output. I can see you have quite many WHM connections. Have you enabled and configured cPHulk? It would require further diagnostics to identify the reason for the load - it can also be that your server's specs are just too low for your load.. Can you paste in the values from top? And maybe also run sar and paste the output?

  
  thanks for your replay Now for almost 18 hours I haven't received notification I don't know if the problem resolved cPHulk is enabled with default configuration top - 19:08:55 up 20:30, 0 users, load average: 0.03, 0.15, 0.52 Tasks: 129 total, 1 running, 128 sleeping, 0 stopped, 0 zombie %Cpu(s): 0.2 us, 0.0 sy, 0.0 ni, 99.8 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st KiB Mem : 7814388 total, 1775112 free, 813912 used, 5225364 buff/cache KiB Swap: 1048572 total, 1048572 free, 0 used. 6669748 avail Mem PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 1 root 20 0 44132 4452 2580 S 0.0 0.1 0:56.70 systemd 2 root 20 0 0 0 0 S 0.0 0.0 0:00.17 kthreadd 4 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 kworker/0:0H 6 root 20 0 0 0 0 S 0.0 0.0 0:07.00 ksoftirqd/0 7 root rt 0 0 0 0 S 0.0 0.0 0:13.59 migration/0 8 root 20 0 0 0 0 S 0.0 0.0 0:00.00 rcu_bh 9 root 20 0 0 0 0 S 0.0 0.0 1:38.88 rcu_sched 10 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 lru-add-drain 11 root rt 0 0 0 0 S 0.0 0.0 0:07.64 watchdog/0 12 root rt 0 0 0 0 S 0.0 0.0 0:08.28 watchdog/1 13 root rt 0 0 0 0 S 0.0 0.0 0:11.15 migration/1 14 root 20 0 0 0 0 S 0.0 0.0 0:07.69 ksoftirqd/1 16 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 kworker/1:0H 18 root 20 0 0 0 0 S 0.0 0.0 0:00.01 kdevtmpfs 19 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 netns 20 root 20 0 0 0 0 S 0.0 0.0 0:00.14 khungtaskd 21 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 writeback
[root@server ~]# sar Linux 3.10.0-1127.el7.x86_64 (server.th3p.com) 07/24/2020 _x86_64_ (2 CPU) 12:00:01 AM CPU %user %nice %system %iowait %steal %idle 12:10:01 AM all 2.43 0.03 0.69 0.09 0.01 96.75 12:20:01 AM all 1.15 0.03 0.42 0.22 0.01 98.17 12:30:01 AM all 2.05 0.03 0.66 0.10 0.01 97.15 12:40:01 AM all 2.05 0.06 0.84 0.73 0.01 96.30 12:50:01 AM all 2.98 0.03 2.12 0.73 0.02 94.12 01:00:01 AM all 1.80 0.03 0.62 0.13 0.01 97.41 01:10:01 AM all 3.42 0.04 1.38 0.49 0.02 94.65 01:20:01 AM all 2.42 0.03 0.69 0.13 0.01 96.73 01:30:01 AM all 4.22 0.06 11.46 0.68 0.07 83.51 01:40:01 AM all 1.13 0.03 3.53 0.19 0.02 95.09 01:50:01 AM all 1.20 0.04 0.44 0.06 0.01 98.27 02:00:01 AM all 1.34 0.04 0.47 0.08 0.01 98.07 02:10:02 AM all 2.14 4.99 26.51 22.17 0.15 44.04 02:20:01 AM all 1.10 5.08 24.80 10.04 0.12 58.85 02:30:01 AM all 1.29 0.34 0.64 0.09 0.01 97.63 02:40:01 AM all 1.45 0.03 0.95 0.12 0.01 97.43 02:50:01 AM all 0.72 0.03 0.33 0.06 0.00 98.86 03:00:01 AM all 1.34 0.03 0.69 0.13 0.01 97.80 03:10:01 AM all 1.81 0.07 0.59 0.17 0.01 97.35 03:20:01 AM all 1.18 0.03 0.78 0.08 0.01 97.93 03:30:01 AM all 0.72 0.03 0.32 0.08 0.01 98.84 03:40:01 AM all 2.03 0.44 0.83 0.52 0.01 96.17 03:40:01 AM CPU %user %nice %system %iowait %steal %idle 03:50:01 AM all 0.90 0.03 0.42 0.06 0.01 98.58 04:00:01 AM all 0.80 0.07 0.49 0.08 0.01 98.56 04:10:02 AM all 1.32 0.03 0.49 0.12 0.01 98.03 04:20:01 AM all 1.44 0.03 0.54 0.10 0.01 97.88 04:30:01 AM all 1.59 0.03 0.54 0.09 0.01 97.74 04:40:01 AM all 1.32 0.03 0.49 0.15 0.01 98.01 04:50:01 AM all 1.62 0.06 0.52 0.11 0.01 97.68 05:00:01 AM all 0.97 0.03 0.50 0.10 0.01 98.39 05:10:01 AM all 1.20 0.03 0.47 0.09 0.01 98.20 05:20:01 AM all 0.86 0.04 0.37 0.08 0.00 98.66 05:30:01 AM all 0.83 0.03 0.35 0.07 0.01 98.72 05:40:01 AM all 1.00 0.06 0.46 0.11 0.01 98.37 05:50:01 AM all 0.65 0.03 0.31 0.06 0.01 98.95 06:00:01 AM all 0.93 0.03 0.41 0.10 0.01 98.52 06:10:01 AM all 1.06 0.03 0.46 0.11 0.01 98.33 06:20:01 AM all 1.10 0.03 0.40 0.10 0.01 98.36 06:30:02 AM all 1.12 0.07 0.43 0.11 0.05 98.22 06:40:02 AM all 0.75 0.03 0.40 0.13 0.01 98.68 06:50:01 AM all 0.77 0.02 0.33 0.07 0.01 98.80 07:00:01 AM all 0.64 0.03 0.32 0.11 0.01 98.90 07:10:01 AM all 1.16 0.03 0.53 0.15 0.01 98.12 07:20:02 AM all 0.68 0.06 0.32 0.09 0.00 98.84 07:20:02 AM CPU %user %nice %system %iowait %steal %idle 07:30:01 AM all 1.33 0.03 0.49 0.11 0.01 98.03 07:40:01 AM all 1.03 0.03 0.48 0.07 0.01 98.38 07:50:01 AM all 1.20 0.04 1.19 0.08 0.01 97.49 08:00:01 AM all 0.99 0.04 0.95 0.08 0.01 97.93 08:10:02 AM all 1.92 0.06 0.60 0.13 0.01 97.28 08:20:01 AM all 1.00 0.03 0.39 0.11 0.01 98.47 08:30:01 AM all 1.90 0.03 0.58 0.09 0.01 97.38 08:40:01 AM all 2.29 0.04 1.33 0.12 0.01 96.21 08:50:01 AM all 0.61 0.04 0.33 0.06 0.01 98.95 09:00:02 AM all 0.97 0.06 0.44 0.09 0.01 98.43 09:10:01 AM all 2.87 0.04 0.88 0.58 0.03 95.62 09:20:01 AM all 1.21 0.04 0.50 0.08 0.01 98.17 09:30:01 AM all 1.18 0.04 0.48 0.09 0.01 98.21 09:40:01 AM all 1.58 0.04 0.58 0.09 0.01 97.71 09:50:01 AM all 1.14 0.06 0.48 0.13 0.01 98.18 10:00:01 AM all 1.04 0.03 0.81 0.11 0.01 98.00 10:10:01 AM all 2.09 0.03 0.78 0.14 0.01 96.94 10:20:01 AM all 1.51 0.03 0.77 0.08 0.01 97.60 10:30:01 AM all 1.25 0.03 0.46 0.11 0.01 98.14 10:40:01 AM all 0.87 0.06 0.46 0.06 0.01 98.54 10:50:01 AM all 1.33 0.03 0.49 0.07 0.01 98.07 11:00:01 AM all 0.76 0.03 0.41 0.09 0.01 98.70 11:00:01 AM CPU %user %nice %system %iowait %steal %idle 11:10:01 AM all 1.65 0.04 0.71 0.12 0.01 97.48 11:20:01 AM all 1.26 0.04 0.49 0.13 0.01 98.08 11:30:01 AM all 1.82 0.06 0.63 0.09 0.01 97.38 11:40:01 AM all 2.03 0.02 0.65 0.12 0.01 97.16 11:50:01 AM all 0.99 0.03 0.41 0.08 0.01 98.48 12:00:01 PM all 1.00 0.03 0.41 0.07 0.01 98.49 12:10:01 PM all 1.58 0.03 0.62 0.11 0.01 97.65 12:20:01 PM all 0.87 0.07 0.48 0.12 0.01 98.46 12:30:01 PM all 1.29 0.03 0.57 0.11 0.01 97.98 12:40:01 PM all 1.52 0.03 0.63 0.11 0.01 97.71 12:50:01 PM all 1.85 0.03 0.60 0.10 0.01 97.41 01:00:01 PM all 2.31 0.03 0.74 0.13 0.01 96.78 01:10:01 PM all 2.13 0.07 0.77 0.18 0.01 96.83 01:20:01 PM all 2.13 0.04 0.64 0.13 0.01 97.05 01:30:01 PM all 1.89 0.04 0.64 0.11 0.01 97.31 01:40:01 PM all 2.72 0.03 0.81 0.14 0.01 96.29 01:50:01 PM all 2.12 0.03 0.68 0.12 0.01 97.05 02:00:01 PM all 2.18 0.07 0.73 0.08 0.01 96.93 02:10:01 PM all 1.67 0.03 0.66 0.18 0.01 97.45 02:20:01 PM all 1.94 0.48 2.32 0.66 0.02 94.58 02:30:01 PM all 1.33 0.03 0.52 0.09 0.01 98.02 02:40:01 PM all 1.49 0.03 0.74 0.16 0.01 97.58 02:40:01 PM CPU %user %nice %system %iowait %steal %idle 02:50:01 PM all 1.14 0.03 0.44 0.06 0.01 98.32 03:00:01 PM all 1.19 0.06 0.50 0.10 0.01 98.14 03:10:01 PM all 2.15 0.03 0.72 0.13 0.01 96.96 03:20:01 PM all 1.71 0.03 0.55 0.11 0.01 97.59 03:30:01 PM all 0.96 0.03 0.47 0.08 0.01 98.45 03:40:01 PM all 2.66 0.03 0.79 0.08 0.01 96.43 03:50:01 PM all 0.82 0.04 0.38 0.07 0.01 98.68 04:00:02 PM all 2.93 0.06 0.78 0.10 0.02 96.11 04:10:01 PM all 2.30 0.02 0.71 0.14 0.02 96.81 04:20:01 PM all 1.98 0.03 0.66 0.11 0.01 97.21 04:30:02 PM all 1.46 0.03 0.53 0.08 0.01 97.89 04:40:01 PM all 3.38 0.03 0.91 0.18 0.01 95.48 04:50:01 PM all 3.68 0.06 0.93 0.14 0.02 95.17 05:00:02 PM all 5.13 0.03 1.45 0.15 0.03 93.21 05:10:01 PM all 3.07 0.03 0.85 0.17 0.02 95.86 05:20:01 PM all 2.10 0.04 0.63 0.13 0.01 97.10 05:30:01 PM all 1.08 0.03 0.47 0.07 0.01 98.34 05:40:02 PM all 1.25 0.06 0.52 0.09 0.01 98.07 05:50:01 PM all 1.24 0.03 0.53 0.06 0.01 98.13 06:00:01 PM all 2.21 0.04 0.66 0.16 0.01 96.93 06:10:01 PM all 1.79 0.02 0.64 0.11 0.01 97.42 06:20:01 PM all 1.30 0.03 0.54 0.13 0.01 98.00 06:20:01 PM CPU %user %nice %system %iowait %steal %idle 06:30:01 PM all 1.91 0.07 1.06 1.27 0.01 95.68 06:40:01 PM all 1.26 0.03 0.52 0.10 0.01 98.09 06:50:01 PM all 3.33 0.03 20.87 0.07 0.11 75.58 07:00:02 PM all 1.92 0.04 0.72 0.15 0.01 97.16 07:10:01 PM all 2.21 0.03 3.61 0.46 0.03 93.66 Average: all 1.62 0.13 1.37 0.42 0.01 96.45
  

  0
• 

  cPAdminsMichael

  • July 24, 2020 18:08

  Ok - the output don't give an explanation to your issue - some spikes here and there, but that's quite normal. More than welcome to reach out when/if you observe the issue again :)

  0
• 

  cPanelLauren

  • July 24, 2020 18:12

  Another thing you might want to look at is

  0
• 

  AladdinJ

  • July 25, 2020 23:45

  Michael Svendsen cPanelLauren Thanks

  0

Please sign in to leave a comment.