Skip to main content

WHM Backups filling up disk

DWChrisG
Hello there guys, good evening I seem to have bumped into an issue bugging our server lately.. Our setup includes a FTP-backup(Backups are being saved properly) and of course a server(Running: cPanel & WHM 64.0 (build 36)) that we're backing it up from.. The actual issue we're facing is: WHM does not delete old backups from /backup, while the setting on the web-interface( Retain backups in the default backup directory. ) is unchecked.. Are there any available besides setting up a cronjob to rm the files?

Comments

20 comments

Date Votes
  • DWChrisG
    Wanted to edit the post above - got an error... - Removed - Anyway, what i wanted to edit is: "Are there any available fixes besides setting up a cronjob to rm the files?"
    0
  • Infopro
    New users are unable to edit posts, my apologies for the issue. If you just changed the backup settings, the old backups won't be removed until they cycle out.
    0
  • DWChrisG
    New users are unable to edit posts, my apologies for the issue. If you just changed the backup settings, the old backups won't be removed until they cycle out.

    Thanks for the clarification about edits! I am afraid that this is not our case here, no changes were made to that setting.. Besides, my Disk went full resulting in several of my webpages to go down through the night.
    0
  • Infopro
    You're not storing backups on the same HDD as your accounts are you? How many days of backups are you setup to store? If you're set for 7 days for example, you could set it for 6 and delete one entire set of backups for that day and clear out some space easy enough.
    0
  • DWChrisG
    Hey there, Good morning! Sadly I am, as secondary drive is not an option | not available at my plan.. I am currently backing-up 3 days a week, plus 1 weekly, since that's pretty much alright for my FTP storage.. According to the documentation, backups are being stored to HDD prior being copied to the FTP and deleted once copied away(right?).. Which brings up the question, Why do i still have older backups piling up on my local drive other than the last backup?
    0
  • cPanelMichael
    Which brings up the question, Why do i still have older backups piling up on my local drive other than the last backup?

    Hello, You can find the backup logs in the /usr/local/cpanel/logs/cpbackup/ directory. Could you review the most recent log and verify if any error messages occurred during the backup process? Thank you.
    0
  • DWChrisG
    Obviously on the latest one; The server did run out of space, as mentioned on the post above! The one before that, did not show any errors and everything was properly backed up to the FTP, yet it never got deleted(locally) after being copied away to the FTP? Bump - Still looking for a solution
    0
  • Infopro
    Hey there, Good morning! Sadly I am, as secondary drive is not an option | not available at my plan.. I am currently backing-up 3 days a week, plus 1 weekly, since that's pretty much alright for my FTP storage.. According to the documentation, backups are being stored to HDD prior being copied to the FTP and deleted once copied away(right?).. Which brings up the question, Why do i still have older backups piling up on my local drive other than the last backup?

    Could you clarify this post a bit more? You are backing up to the same drive, and do not have a secondary drive. But your files are being copied to the FTP? Please feel free to open a ticket directly to cPanel Technical Support about this if you wish.
    0
  • DWChrisG
    Could you clarify this post a bit more? You are backing up to the same drive, and do not have a secondary drive. But your files are being copied to the FTP? Please feel free to open a ticket directly to cPanel Technical Support about this if you wish.

    Hello there, As stated in my first post, my setup includes: [LIST]
  • A server | Running: cPanel & WHM 64.0 (build 36) (One HDD)
  • An FTP-Backup space Notably, backups are being copied onto the FTP BUT the files are not getting deleted from the local drive AFTER the transfer has been completed! As stated above: The option "Retain backups in the default backup directory." is unchecked, as well as the backup process is properly being executed according to the latest logs at "/usr/local/cpanel/logs/cpbackup/" Ideally, I only want to keep backups onto the FTP and NOT on the Local Drive Regarding opening a ticket, I would prefer this staying on the forum, just because it may help somebody with the same problem/issue in the future.
    • 0
  • Infopro
    Well, once the ticket is resolved you can update the thread with the outcome of course.
    0
  • rpvw
    Could you clarify if the files you are seeing retained in the default backup directory are system files or account files ? Retain backups in the default backup directory. Select this checkbox to retain each account backup in the /backup/ directory after the backups transfer to another destination. If you do not select this setting, your server deletes account backup files from the /backup/ directory only after the following events occur: [LIST]
  • The system successfully transfers the backup file to at least one additional destination.
  • The system attempts, successfully or unsuccessfully, to transfer the backup file to all of your additional destinations. Note: This setting does not cause the system to remove system backup files, directories, or other files.
    • 0
  • Infopro
    The one before that, did not show any errors and everything was properly backed up to the FTP, yet it never got deleted(locally) after being copied away to the FTP?

    Are you getting emails about backups completing? For example:
    [2017-08-16 02:24:59 -0400] Done [2017-08-16 02:24:59 -0400] Storing Addon Domains.... [2017-08-16 02:24:59 -0400] Copying password.......[2017-08-16 02:24:59 -0400] Done [2017-08-16 02:24:59 -0400] Copying shell.......[2017-08-16 02:24:59 -0400] Done [2017-08-16 02:24:59 -0400] Creating Archive .................................................................................... ................................................................................ ................................................................................ ................................................................................ ........................................ [2017-08-16 02:25:35 -0400] Done [2017-08-16 02:25:35 -0400] pkgacctfile is: /backup/2017-08-16/accounts/someusr.tar.gz [2017-08-16 02:25:35 -0400] [2017-08-16 02:25:35 -0400] size is: xxxxxxxxxxxx [2017-08-16 02:25:35 -0400] [2017-08-16 02:25:35 -0400] homesize is: xxxxxxxxxxxx [2017-08-16 02:25:35 -0400] [2017-08-16 02:25:35 -0400] homefiles is: xxxxxxx [2017-08-16 02:25:35 -0400] pkgacct completed [2017-08-16 02:25:36 -0400] info [backup] Queuing daily backup copy for transport [2017-08-16 02:25:36 -0400] info [backup] Queuing transport of file: /backup/2017-08-16/accounts/someusr.tar.gz [2017-08-16 02:25:49 -0400] info [backup] Pruning backup directory: /backup/2017-08-09 [2017-08-16 02:25:49 -0400] info [backup] Queuing prune operation for remote destination daily backups [2017-08-16 02:26:01 -0400] info [backup] Queuing transport reporter [2017-08-16 02:26:12 -0400] info [backup] Completed at Wed Aug 16 02:26:12 2017 [2017-08-16 02:26:12 -0400] info [backup] Final state is Backup::Success (0)
    Note the prune operation mentioned. What does your email or log say?
    0
  • DWChrisG
    Could you clarify if the files you are seeing retained in the default backup directory are system files or account files ?

    Those are indeed account backups.
    Are you getting emails about backups completing? For example:
    [2017-08-16 02:24:59 -0400] Done [2017-08-16 02:24:59 -0400] Storing Addon Domains.... [2017-08-16 02:24:59 -0400] Copying password.......[2017-08-16 02:24:59 -0400] Done [2017-08-16 02:24:59 -0400] Copying shell.......[2017-08-16 02:24:59 -0400] Done [2017-08-16 02:24:59 -0400] Creating Archive .................................................................................... ................................................................................ ................................................................................ ................................................................................ ........................................ [2017-08-16 02:25:35 -0400] Done [2017-08-16 02:25:35 -0400] pkgacctfile is: /backup/2017-08-16/accounts/someusr.tar.gz [2017-08-16 02:25:35 -0400] [2017-08-16 02:25:35 -0400] size is: xxxxxxxxxxxx [2017-08-16 02:25:35 -0400] [2017-08-16 02:25:35 -0400] homesize is: xxxxxxxxxxxx [2017-08-16 02:25:35 -0400] [2017-08-16 02:25:35 -0400] homefiles is: xxxxxxx [2017-08-16 02:25:35 -0400] pkgacct completed [2017-08-16 02:25:36 -0400] info [backup] Queuing daily backup copy for transport [2017-08-16 02:25:36 -0400] info [backup] Queuing transport of file: /backup/2017-08-16/accounts/someusr.tar.gz [2017-08-16 02:25:49 -0400] info [backup] Pruning backup directory: /backup/2017-08-09 [2017-08-16 02:25:49 -0400] info [backup] Queuing prune operation for remote destination daily backups [2017-08-16 02:26:01 -0400] info [backup] Queuing transport reporter [2017-08-16 02:26:12 -0400] info [backup] Completed at Wed Aug 16 02:26:12 2017 [2017-08-16 02:26:12 -0400] info [backup] Final state is Backup::Success (0)
    Note the prune operation mentioned. What does your email or log say?

    My part of the log:
    [2017-08-15 06:06:12 +0300] Done [2017-08-15 06:06:12 +0300] Storing Addon Domains.... [2017-08-15 06:06:12 +0300] Copying password.......[2017-08-15 06:06:12 +0300] Done [2017-08-15 06:06:12 +0300] Copying shell.......[2017-08-15 06:06:12 +0300] Done [2017-08-15 06:06:12 +0300] Creating Archive .................................................................................... ................................................................................ ................................................................................ ................................................................................ ................................................................................ ................................................................................ ................................................................................ ................................................................................ ................................................................................ ................................................................................ ................................................................................ ................................................................................ ................................................................................ ................................................................................ ................................................................................ ................................................................................ ................................................................................ ................................................................................ ................................................................................ ............................................................ [2017-08-15 06:08:50 +0300] Done [2017-08-15 06:08:50 +0300] pkgacctfile is: /backup/2017-08-15/accounts/.tar.gz [2017-08-15 06:08:50 +0300] [2017-08-15 06:08:50 +0300] size is: 3414584508 [2017-08-15 06:08:50 +0300] [2017-08-15 06:08:50 +0300] homesize is: 3877556224 [2017-08-15 06:08:50 +0300] [2017-08-15 06:08:50 +0300] homefiles is: 65646 [2017-08-15 06:08:50 +0300] pkgacct completed [2017-08-15 06:08:50 +0300] info [backup] Queuing daily backup copy for transport [2017-08-15 06:08:50 +0300] info [backup] Queuing transport of file: /backup/2017-08-15/accounts/.tar.gz [2017-08-15 06:08:56 +0300] info [backup] Queuing prune operation for remote destination daily backups [2017-08-15 06:08:56 +0300] info [backup] Queuing transport reporter [2017-08-15 06:08:56 +0300] info [backup] Completed at Tue Aug 15 06:08:56 2017 [2017-08-15 06:08:56 +0300] info [backup] Final state is Backup::Success (0) [2017-08-15 06:08:56 +0300] info [backup] Sent Backup::Success notification.
    As noted, I am indeed missing a prune job on my local backup directory (/backup).. I am afraid there are no other options to tweak besides: "Retain backups in the default backup directory." Right?
    0
  • Infopro
    You really should open a ticket about this for fastest resolution.
    0
  • DWChrisG
    You really should open a ticket about this for fastest resolution.

    Not really. As I don't want to provide Access Info. As stated above, I would prefer this staying on the forum.
    0
  • cPanelMichael
    Hello, Could you post the contents of the /var/cpanel/backups/config file on this system? Thank you.
    0
  • DWChrisG
    Hello, Could you post the contents of the /var/cpanel/backups/config file on this system? Thank you.

    That's for sure!
    --- BACKUPACCTS: 'yes' BACKUPBWDATA: 'no' BACKUPDAYS: 2,4,6 BACKUPDIR: /backup BACKUPENABLE: 'yes' BACKUPFILES: 'yes' BACKUPLOGS: 'no' BACKUPMOUNT: 'no' BACKUPSUSPENDEDACCTS: 'no' BACKUPTYPE: compressed BACKUP_DAILY_ENABLE: 'yes' BACKUP_DAILY_RETENTION: 3 BACKUP_MONTHLY_DATES: 1 BACKUP_MONTHLY_ENABLE: 'no' BACKUP_MONTHLY_RETENTION: 1 BACKUP_WEEKLY_DAY: 0 BACKUP_WEEKLY_ENABLE: 'yes' BACKUP_WEEKLY_RETENTION: 1 CHECK_MIN_FREE_SPACE: 1 ERRORTHRESHHOLD: 3 FORCE_PRUNE_DAILY: 0 FORCE_PRUNE_MONTHLY: 0 FORCE_PRUNE_WEEKLY: 0 GZIPRSYNCOPTS: --rsyncable KEEPLOCAL: 0 LINKDEST: 0 LOCALZONESONLY: 'no' MAXIMUM_RESTORE_TIMEOUT: 21600 MAXIMUM_TIMEOUT: 7200 MIN_FREE_SPACE: 25 MIN_FREE_SPACE_UNIT: percent MYSQLBACKUP: both POSTBACKUP: 'no' PREBACKUP: -1 PSQLBACKUP: 'no'
    These 3 vars look quite strange to be 0, am I right?
    FORCE_PRUNE_DAILY: 0 FORCE_PRUNE_MONTHLY: 0 FORCE_PRUNE_WEEKLY: 0
    0
  • cPanelMichael
    FORCE_PRUNE_DAILY: 0 FORCE_PRUNE_MONTHLY: 0 FORCE_PRUNE_WEEKLY: 0

    Hello, When backups partially complete (e.g. one or more account fails to successfully backup), the system will not prune the backups by default. You can configure backups to prune even when backups fail by enabling the "Strictly enforce retention, regardless of backup success" option in "WHM >> Backup Configuration". You can read more about how this feature works at:
    0
  • DWChrisG
    Hello, When backups partially complete (e.g. one or more account fails to successfully backup), the system will not prune the backups by default. You can configure backups to prune even when backups fail by enabling the "Strictly enforce retention, regardless of backup success" option in "WHM >> Backup Configuration". You can read more about how this feature works at: on the local backup directory.. Right?
    0
  • cPanelMichael
    I went through the logs again.. Yet, I was unable to find any backups that had failed.. According to the documentation that was linked on the quoted post above, this would still keep on the local backup directory.. Right?

    Hello, You actually shouldn't have any backups retained in the local backup directory because you have the "Retain backups in the default backup directory." option disabled. When this option is disabled, your server should delete account backup files from the local /backup/ directory after backups are successfully transferred to at least one additional destination. Thus, it seems like either the backups are failing to complete, or they are not successfully transferring to the remote destination. Do you notice any error messages in the recent logs under the /usr/local/cpanel/logs/cpbackup_transporter/ directory? Thank you.
    0

Please sign in to leave a comment.

Didn't find what you were looking for?

New post