3am High Load spike

Cameron W

• December 28, 2016 09:31

Hi Guys, I got a strange issue going on and cannot figure out what's going on. Every morning at around 3:50am give or take 5 minutes which is waking me up every morning. I checked the cron job logs and nothing is scheduled to run around the time except our ticket retrieval cronjob which is run every 2 minutes for our ticket support system. My monitoring charts is showing me a big spike in the VM Swap, it rises sharply and falls sharply after 2 - 3 minutes then the rest of the day, the server is perfect. I get no high process emails and it is only happening at this time. We have r1soft backing up but usually this is finished by 2:30am. I checked also crontab -e and confirm that no tasks are running around this time.
Current Memory: Mem: 10GB Swap: 12GB Virtualization: kvm Operating System: CloudLinux 7.3 (Yury Malyshev) Kernel: Linux 3.10.0-427.18.2.lve1.4.24.el7.x86_64 Architecture: x86-64 CPU: Intel(R) Xeon(R) CPU E5-2697 v3 @ 2.60GHz (4 Core)

• 

  cPanelMichael

  • January 04, 2017 17:18

  Hello, The following thread is a good place to start: Troubleshooting high server loads on Linux servers There's a reference to a shell script you can run at the time the load issue occurs to help diagnose the problem. Thank you.

  0
• 

  Bazinga

  • January 05, 2017 12:45

  Hi Guys, I got a strange issue going on and cannot figure out what's going on. Every morning at around 3:50am give or take 5 minutes which is waking me up every morning. I checked the cron job logs and nothing is scheduled to run around the time except our ticket retrieval cronjob which is run every 2 minutes for our ticket support system. My monitoring charts is showing me a big spike in the VM Swap, it rises sharply and falls sharply after 2 - 3 minutes then the rest of the day, the server is perfect. I get no high process emails and it is only happening at this time. We have r1soft backing up but usually this is finished by 2:30am. I checked also crontab -e and confirm that no tasks are running around this time.
  Current Memory: Mem: 10GB Swap: 12GB Virtualization: kvm Operating System: CloudLinux 7.3 (Yury Malyshev) Kernel: Linux 3.10.0-427.18.2.lve1.4.24.el7.x86_64 Architecture: x86-64 CPU: Intel(R) Xeon(R) CPU E5-2697 v3 @ 2.60GHz (4 Core)
  

  
  hard to say what is the core of the issue, it should be checked right on a server with some tools like 'iotop' etc. Also, please check cache/slab memory usage in time when issue is happening, e.g.: egrep -i 'slab|cache' /proc/meminfo

  0

Please sign in to leave a comment.