Deduplication not working?

brt

• December 06, 2017 01:22

Does anyone else feel that deduplication on remote server (rsync via ssh) isn't working properly? For example, I've got one cPanel server that's backing up locally to /backup and /backup is right around ~500GB but the same server's off-site (supposedly deduped) backup uses a full ~1TB. I realize that checking utilization when deduplicating is different, but the 1TB drive this server is backing up to reports full and backups fail, so I presume it's using the full 1TB. Does anyone else have similar happening? Any insight?

• 

  cPanelMichael

  • December 06, 2017 16:48

  Hello, Could you let us know the contents of your /var/cpanel/backups/config file? Thank you.

  0
• 

  hicom

  • December 07, 2017 02:44

  Hi, we noticed the same thing. When using Incremental Backup option, it seems RSYNC is copying all data: On Local Server: du -sh * 11G 2017-12-03 22G 2017-12-05 575M 2017-12-06 16K lost+found 11G monthly 11G weekly On RSYNC Server: du -sh * 22G 2017-12-05 22G 2017-12-06 /var/cpanel/backups/config:
  BACKUPACCTS: 'yes' BACKUPBWDATA: 'yes' BACKUPDAYS: 0,2,3,4,5,6 BACKUPDIR: /backup BACKUPENABLE: 'yes' BACKUPFILES: 'yes' BACKUPLOGS: 'no' BACKUPMOUNT: 'no' BACKUPSUSPENDEDACCTS: 'no' BACKUPTYPE: incremental BACKUP_DAILY_ENABLE: 'yes' BACKUP_DAILY_RETENTION: 3 BACKUP_MONTHLY_DATES: 1 BACKUP_MONTHLY_ENABLE: 'yes' BACKUP_MONTHLY_RETENTION: 3 BACKUP_WEEKLY_DAY: 0 BACKUP_WEEKLY_ENABLE: 'yes' BACKUP_WEEKLY_RETENTION: 3 CHECK_MIN_FREE_SPACE: 1 ERRORTHRESHHOLD: 3 FORCE_PRUNE_DAILY: 0 FORCE_PRUNE_MONTHLY: 0 FORCE_PRUNE_WEEKLY: 0 GZIPRSYNCOPTS: --rsyncable KEEPLOCAL: 1 LINKDEST: 0 LOCALZONESONLY: 'no' MAXIMUM_RESTORE_TIMEOUT: 21600 MAXIMUM_TIMEOUT: 7200 MIN_FREE_SPACE: 5 MIN_FREE_SPACE_UNIT: percent MYSQLBACKUP: accounts POSTBACKUP: 'no' PREBACKUP: -1 PSQLBACKUP: 'no'
  

  0
• 

  cPanelMichael

  • December 08, 2017 19:51

  Hello, Remote incremental backups make use of hard links, so it might seem like disk space is utilized when it's actually not: How do the backups work exactly? That said, feel free to open a support ticket using the link in my signature so we can take a closer look if you're sure the files are duplicated. Thank you.

  0

Please sign in to leave a comment.