Remote incremental backup error

tui

• September 11, 2017 20:09

Hello, i want to change the backups of my servers from Uncompressed to incremental, unfortunately there is very little or no information about this new method (very badly by cpanel).. However, im trying to change it, i found (in another forum post, something that it should be on documentation) that the only way to use remote incremental is using Rsync as a destination type, when i use rsync i got this error: bad password or master process exited unexpectedly at /usr/local/cpanel/Cpanel/Transport/Files/Rsync.pm line 256. Password is correct... Can somebody help on this? P.S. I suggest detailed information about this new method of backup type on documentation

• 

  cPanelMichael

  • September 12, 2017 17:32

  Hello, The following entry is part of the documentation.
  You can review the "Rsync" tab under "Additional Destinations" on the following document for information on how to setup the rsync destination: Backup Configuration - Version 66 Documentation - cPanel Documentation Can you verify that you setup the destination per the information listed in that document? Thank you.

  0
• 

  tui

  • September 12, 2017 17:43

  My destination setup is correct, but i got that error

  0
• 

  cPanelMichael

  • September 12, 2017 17:50

  Hello, Could you open a support ticket using the link in my signature so we can take a closer look? Thank you.

  0
• 

  tui

  • September 12, 2017 18:33

  Hello Michael, opened: ID: 8862205

  0
• 

  tui

  • September 14, 2017 14:42

  Hello, my problem was the outgoing port (what a shame :oops:) Now, that i already activate the remote incremental backups on 3 on my servers i noticed something strange: 1) I noticed that transport do not delete backup directory on cPanel server, i found this error on transport log:
  [2017-09-14 06:54:56 -0500] warn [cpbackup_transporter] Unable to delete /home/backup/2017-09-14/accounts/xxxxx14: Is a directory at /usr/local/cpanel/Cpanel/LoggerAdapter.pm line 27.
  So do i need to delete my cPanel servers backups manually? 2) the size of my backup on the backup server does not match the size of the backup on the cPanel server or the size of the previous backup files (not incremental, not compressed): cPanel Server 1, accounts folder and one account folder:
  root@server1 [/home/backup/2017-09-14]# du -sh * 26G accounts 3.4G system root@server1 [/home/backup/2017-09-14]# cd accounts root@server1 [/home/backup/2017-09-14/accounts]# du -sh account1 15G account1
  Backup Server, accounts folder of Server1 and account1 folder:
  root@backupserver:/home/server1# cd 2017-09-14 root@backupserver:/home/server1/2017-09-14# du -sh * 15G accounts root@backupserver:/home/server1/2017-09-14# cd accounts root@backupserver:/home/server1/2017-09-14/accounts# du -sh account1 3.1G account1
  Backup Server, old accounts folder of Server1 and account1 file (not incremental, not compressed):
  root@backupserver:/home/server1/2017-09-08# du -sh * 30G accounts root@backupserver:/home/server1/2017-09-08# cd accounts root@backupsserver:/home/server1/2017-09-08/accounts# du -sh account1.tar 15G account1.tar
  As you can see, the size of folders in backup server does not match the size of the cPanel server backup folder or the older backups on backup server when they where not compressed and not incremental, as this was the first incremental backup, it is assumed that the size must be equal I noticed this same behaivor on the other server that i changed from uncompressed backups to incremental backups, same behaivor on a 3rd server that i enabled the backup system for first time. 3) Now that we have this remote-incremental backups, how can we restore an account when we need to? with no-compressed backup is easy to move the .tar file to server in order to restore it, but what about with this type of backup? is there a way to allow end-user to restore a single file, database or something he wants directly from backup server? Thanks in advice

  0
• 

  cPanelMichael

  • September 14, 2017 17:18

  ) I noticed that transport do not delete backup directory on cPanel server, i found this error on transport log:

  
  This is discussed on the following post: Incremental Backups taking up too much space

  ) the size of my backup on the backup server does not match the size of the backup on the cPanel server or the size of the previous backup files (not incremental, not compressed):

  
  Do you notice any errors in the backup logs located in the /usr/local/cpanel/logs/cpbackup/ directory during the packaging of the accounts?

  ) Now that we have this remote-incremental backups, how can we restore an account when we need to? with no-compressed backup is easy to move the .tar file to server in order to restore it, but what about with this type of backup? is there a way to allow end-user to restore a single file, database or something he wants directly from backup server?

  
  This is not yet possible, we do have a feature request open that you can track at: Restore from remote backups In the meantime, you can review the following document for information about restoring backups from remote servers: Remote Restoration - Version 66 Documentation - cPanel Documentation Thank you.

  0
• 

  tui

  • September 14, 2017 19:02

  Do you notice any errors in the backup logs located in the /usr/local/cpanel/logs/cpbackup/ directory during the packaging of the accounts?

  
  Hello again, apart from the error that can not delete the folder there is no other error, here is my transport log:
  [2017-09-14 00:18:30 -0500] info [cpbackup_transporter] Initializing log file [2017-09-14 00:18:30 -0500] info [cpbackup_transporter] cPanel Backup Transporter Queue Daemon started. [2017-09-14 00:18:30 -0500] info [cpbackup_transporter] cpbackup_transporter - started [2017-09-14 00:18:30 -0500] info [cpbackup_transporter] cpbackup_transporter - Checking queue for tasks [2017-09-14 00:18:30 -0500] info [cpbackup_transporter] cpbackup_transporter - Processing next task [2017-09-14 00:18:31 -0500] info [cpbackup_transporter] Instantiating Object [2017-09-14 00:18:33 -0500] info [cpbackup_transporter] Starting a "copy" operation on the "Backup Server" destination ID "##########". [2017-09-14 00:18:33 -0500] info [cpbackup_transporter] Base path for destination is /home/server1 [2017-09-14 00:18:33 -0500] info [cpbackup_transporter] Validating destination path /home/server1/2017-09-14/accounts/account1 [2017-09-14 00:18:34 -0500] info [cpbackup_transporter] Making Path /home/server1/2017-09-14/accounts/account1 [2017-09-14 00:18:34 -0500] info [cpbackup_transporter] Path creation successful [2017-09-14 00:18:34 -0500] info [cpbackup_transporter] Uploading account backup /backup/2017-09-14/accounts/account1 to /home/server1/2017-09-14/accounts/account1 (from 2017-09-14/accounts/account1) [2017-09-14 00:18:34 -0500] info [cpbackup_transporter] Attempting to upload /backup/2017-09-14/accounts/account1 to /home/server1/2017-09-14/accounts/account1 for destination: Backup Server [2017-09-14 00:18:34 -0500] info [cpbackup_transporter] Upload attempt #1 starting for /backup/2017-09-14/accounts/account1 to /home/server1/2017-09-14/accounts/account1 for destination: Backup Server [2017-09-14 00:52:37 -0500] info [cpbackup_transporter] Successful incremental transfer of /backup/2017-09-14/accounts/account1 to /home/server1/2017-09-14/accounts/account1 for destination Backup Server [2017-09-14 00:52:37 -0500] warn [cpbackup_transporter] Unable to delete /backup/2017-09-14/accounts/account1: Is a directory at /usr/local/cpanel/Cpanel/LoggerAdapter.pm line 27. Cpanel::LoggerAdapter::warn(Cpanel::LoggerAdapter=HASH(0x169d3f8), "Unable to delete /backup/2017-09-14/accounts/account1"...) called at /usr/local/cpanel/Cpanel/Backup/Queue.pm line 294 Cpanel::Backup::Queue::transport_backup::process_task(Cpanel::Backup::Queue::transport_backup=HASH(0x1b22700), cPanel::TaskQueue::Task=HASH(0x2163318), Cpanel::LoggerAdapter=HASH(0x169d3f8)) called at /usr/local/cpanel/3rdparty/perl/524/lib64/perl5/cpanel_lib/cPanel/TaskQueue.pm line 629 eval {...} called at /usr/local/cpanel/3rdparty/perl/524/lib64/perl5/cpanel_lib/cPanel/TaskQueue.pm line 632 cPanel::TaskQueue::__ANON__() called at /usr/local/cpanel/3rdparty/perl/524/lib64/perl5/cpanel_lib/cPanel/StateFile.pm line 237 eval {...} called at /usr/local/cpanel/3rdparty/perl/524/lib64/perl5/cpanel_lib/cPanel/StateFile.pm line 237 cPanel::StateFile::Guard::call_unlocked(cPanel::StateFile::Guard=HASH(0x211fa68), CODE(0x1827760)) called at /usr/local/cpanel/3rdparty/perl/524/lib64/perl5/cpanel_lib/cPanel/TaskQueue.pm line 637 cPanel::TaskQueue::process_next_task(cPanel::TaskQueue=HASH(0x211f858)) called at /usr/local/cpanel/bin/cpbackup_transporter line 151 eval {...} called at /usr/local/cpanel/bin/cpbackup_transporter line 149 [2017-09-14 00:52:37 -0500] info [cpbackup_transporter] cpbackup_transporter - Checking queue for tasks [2017-09-14 00:52:37 -0500] info [cpbackup_transporter] cpbackup_transporter - Processing next task [2017-09-14 00:52:37 -0500] info [cpbackup_transporter] Instantiating Object [2017-09-14 00:52:39 -0500] info [cpbackup_transporter] Starting a "copy" operation on the "Backup Server" destination ID "##########". [2017-09-14 00:52:39 -0500] info [cpbackup_transporter] Base path for destination is /home/server1 [2017-09-14 00:52:39 -0500] info [cpbackup_transporter] Validating destination path /home/server1/2017-09-14/accounts [2017-09-14 00:52:40 -0500] info [cpbackup_transporter] Path exists [2017-09-14 00:52:40 -0500] info [cpbackup_transporter] Uploading account backup /backup/2017-09-14/accounts/account1-=-meta to /home/server1/2017-09-14/accounts/account1-=-meta (from 2017-09-14/accounts/account1-=-meta) [2017-09-14 00:52:40 -0500] info [cpbackup_transporter] Attempting to upload /backup/2017-09-14/accounts/account1-=-meta to /home/server1/2017-09-14/accounts/account1-=-meta for destination: Backup Server [2017-09-14 00:52:40 -0500] info [cpbackup_transporter] Upload attempt #1 starting for /backup/2017-09-14/accounts/account1-=-meta to /home/server1/2017-09-14/accounts/account1-=-meta for destination: Backup Server [2017-09-14 00:52:42 -0500] info [cpbackup_transporter] Successful incremental transfer of /backup/2017-09-14/accounts/account1-=-meta to /home/server1/2017-09-14/accounts/account1-=-meta for destination Backup Server [2017-09-14 00:52:42 -0500] info [cpbackup_transporter] cpbackup_transporter - Checking queue for tasks [2017-09-14 00:52:42 -0500] info [cpbackup_transporter] cpbackup_transporter - Processing next task [2017-09-14 00:52:42 -0500] info [cpbackup_transporter] Instantiating Object [2017-09-14 00:52:44 -0500] info [cpbackup_transporter] Starting a "prune" operation on the "Backup Server" destination ID "##########". [2017-09-14 00:52:44 -0500] info [cpbackup_transporter] Base path for destination is /home/server1 [2017-09-14 00:52:44 -0500] info [cpbackup_transporter] Performing prune operation, retaining 6 items on: Backup Server [2017-09-14 00:52:46 -0500] info [cpbackup_transporter] cpbackup_transporter - Checking queue for tasks [2017-09-14 00:52:46 -0500] info [cpbackup_transporter] cpbackup_transporter - Processing next task [2017-09-14 00:52:46 -0500] info [cpbackup_transporter] cpbackup_transporter - Checking queue for tasks [2017-09-14 00:52:46 -0500] info [cpbackup_transporter] cpbackup_transporter - Exiting - the queue has been emptied; no more work to do [2017-09-14 00:52:46 -0500] info [cpbackup_transporter] cPanel Backup Transporter Queue Daemon is being stopped.
  

  0
• 

  cPanelMichael

  • September 15, 2017 16:33

  Hello, Could you open a support ticket using the link in my signature so we can take a closer look? Thank you.

  0
• 

  tui

  • September 15, 2017 19:44

  Hello, Could you open a support ticket using the link in my signature so we can take a closer look? Thank you.

  
  Hello, Michael, I just found that today backups are more accurate, however I opened the ticket anyway so you can check: Your Support Request ID is: 8871073

  0

Please sign in to leave a comment.