Found corrupted backup metadata, scheduling backup metadata rebuild

Hi, I got a notification regarding partial backup completion from cpanel as follows. Why this error occurred while taking backup?. How can i fix this. ======================================================= The system started a separate transport process for remote backup destinations. When the transport completes, the system will send an additional notification with the status of the transport if any errors were encountered. The backup process encountered the following error: Some of the metadata database(s) appear corrupt. Scheduling a rebuild. Review the attached log "??/usr/local/cpanel/logs/cpbackup/1561394783..log"?" for further details. bin::backup::__ANON__() called at /usr/local/cpanel/bin/backup line 924 bin::backup::__ANON__() called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97 eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 88 Try::Tiny::try(CODE(0x35cb158), Try::Tiny::Catch=REF(0x3611de0)) called at /usr/local/cpanel/bin/backup line 934 bin::backup::_process_backups(HASH(0x335c9b0)) called at /usr/local/cpanel/bin/backup line 381 bin::backup::run("bin::backup") called at /usr/local/cpanel/bin/backup line 123 [2019-06-28 13:51:54 +0530] info [backup] Queuing daily backup copy of example?"1 for transport of "??/backup/2019-06-24/accounts/example?"1 to "??2019-06-24/accounts/example?"1 [2019-06-28 13:51:54 +0530] info [backup] This particular transport will be queued with keep_local = 1, based on the need to copy weekly () and/or monthly () copies as well. [2019-06-28 13:51:54 +0530] info [backup] Queuing transport of file: /backup/2019-06-24/accounts/example?"1 [2019-06-28 13:51:54 +0530] info [backup] no_transport = 0 .. and queueid = TQ:TaskQueue:1548 [2019-06-28 13:51:55 +0530] info [backup] leaving queue_backup_transport_item [2019-06-28 13:51:55 +0530] info [backup] Queuing transport of meta file: /backup/2019-06-24/accounts/.master.meta [2019-06-28 13:51:55 +0530] info [backup] no_transport = 0 .. and queueid = TQ:TaskQueue:1549 [2019-06-28 13:51:55 +0530] info [backup] leaving queue_backup_transport_item [2019-06-28 13:51:55 +0530] info [backup] Pruning backup directory: /backup/2019-06-16 [2019-06-29 03:34:25 +0530] info [backup] Pruning backup directory: /backup/2019-06-23 [2019-06-29 17:01:01 +0530] info [backup] Queuing prune operation for remote destination daily backups [2019-06-29 17:01:01 +0530] info [backup] no_transport = 0 .. and queueid = TQ:TaskQueue:1550 [2019-06-29 17:01:01 +0530] info [backup] leaving queue_backup_transport_item [2019-06-29 23:19:46 +0530] info [backup] Found corrupted backup metadata, scheduling backup metadata rebuild [2019-06-29 23:19:47 +0530] info [backup] Queuing transport reporter [2019-06-29 23:19:47 +0530] info [backup] no_transport = 0 .. and queueid = TQ:TaskQueue:1551 [2019-06-29 23:19:47 +0530] info [backup] leaving queue_backup_transport_item [2019-06-29 23:19:47 +0530] info [backup] Completed at Sat Jun 29 23:19:47 2019 [2019-06-29 23:19:47 +0530] info [backup] Final state is Backup::PartialFailure (0) ==========================================================
While checking the logs, we can find this. =========================================================== pkgacct completed [2019-06-28 12:44:41 +0530] info [backup] Successfully backed up account "example?"1" to "/backup/2019-06-24/accounts" [2019-06-28 12:44:41 +0530] info [backup] Adding metadata information for example?"1 to backup at /backup/2019-06-24 [2019-06-28 12:44:41 +0530] info [backup] Processing an incremental type backup for example?"1. [2019-06-28 13:51:54 +0530] warn [backup] Caught Error Cpanel::Exception::Backup::CorruptedBackupData/(XID 4yfx6x) The system was unable to interpret backup data. Error: "Cpanel::Exception::Database::Error/(XID tjm2sx) The system received an error from the "SQLite" database "/backup/.meta/example?"1.db": SQLITE_BUSY (database is locked) at /usr/local/cpanel/Cpanel/DBI.pm line 200. Cpanel::DBI::_create_exception(Cpanel::DBI::SQLite::db=HASH(0x2db0570), "DBD::SQLite::db selectall_arrayref failed: database is locked", undef) called at /usr/local/cpanel/Cpanel/DBI.pm line 188 Cpanel::DBI::_error_handler("DBD::SQLite::db selectall_arrayref failed: database is locked", Cpanel::DBI::SQLite::db=HASH(0x2db0570), undef) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 1705 Cpanel::Backup::Metadata::_backup_timestamp_exists(Cpanel::DBI::SQLite::db=HASH(0x2db0570), 1561334400) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 825 Cpanel::Backup::Metadata::__ANON__() called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97 eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 88 Try::Tiny::try(CODE(0x343d790), Try::Tiny::Catch=REF(0x36ca178)) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 928 Cpanel::Backup::Metadata::_do_process_metadata("user", "example?"1", "date", "2019-06-24", "path", "/backup/2019-06-24/accounts", "logger", Cpanel::Logger=HASH(0x354e780), ...) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 619 Cpanel::Backup::Metadata::process_metadata_from_incremental("example?"1", "2019-06-24", "/backup", Cpanel::Logger=HASH(0x354e780)) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 1064 Cpanel::Backup::Metadata::__ANON__() called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97 eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 88 Try::Tiny::try(CODE(0x337bb20), Try::Tiny::Catch=REF(0x3414be0)) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 1069 Cpanel::Backup::Metadata::create_metadata_for_backup_user("/backup/2019-06-24", "example?"1", Cpanel::Logger=HASH(0x354e780)) called at /usr/local/cpanel/bin/backup line 1757 bin::backup::__ANON__() called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97 eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 88 Try::Tiny::try(CODE(0x3616230), Try::Tiny::Catch=REF(0x343dfd0)) called at /usr/local/cpanel/bin/backup line 1753 bin::backup::backup_accounts("/backup/2019-06-24/accounts") called at /usr/local/cpanel/bin/backup line 917 bin::backup::__ANON__() called at /usr/local/cpanel/bin/backup line 924 bin::backup::__ANON__() called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97 eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 88 Try::Tiny::try(CODE(0x35cb158), Try::Tiny::Catch=REF(0x3611de0)) called at /usr/local/cpanel/bin/backup line 934 bin::backup::_process_backups(HASH(0x335c9b0)) called at /usr/local/cpanel/bin/backup line 381 bin::backup::run("bin::backup") called at /usr/local/cpanel/bin/backup line 123 ". at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 926. Cpanel::Backup::Metadata::__ANON__(Cpanel::Exception::Database::Error=HASH(0x35d6b28)) called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 118 Try::Tiny::try(CODE(0x343d790), Try::Tiny::Catch=REF(0x36ca178)) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 928 Cpanel::Backup::Metadata::_do_process_metadata("user", "example?"1", "date", "2019-06-24", "path", "/backup/2019-06-24/accounts", "logger", Cpanel::Logger=HASH(0x354e780), ...) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 619 Cpanel::Backup::Metadata::process_metadata_from_incremental("example?"1", "2019-06-24", "/backup", Cpanel::Logger=HASH(0x354e780)) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 1064 Cpanel::Backup::Metadata::__ANON__() called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97 eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 88 Try::Tiny::try(CODE(0x337bb20), Try::Tiny::Catch=REF(0x3414be0)) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 1069 Cpanel::Backup::Metadata::create_metadata_for_backup_user("/backup/2019-06-24", "example?"1", Cpanel::Logger=HASH(0x354e780)) called at /usr/local/cpanel/bin/backup line 1757 bin::backup::__ANON__() called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97 eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 88 Try::Tiny::try(CODE(0x3616230), Try::Tiny::Catch=REF(0x343dfd0)) called at /usr/local/cpanel/bin/backup line 1753 bin::backup::backup_accounts("/backup/2019-06-24/accounts") called at /usr/local/cpanel/bin/backup line 917 bin::backup::__ANON__() called at /usr/local/cpanel/bin/backup line 924 bin::backup::__ANON__() called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97 eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 88 Try::Tiny::try(CODE(0x35cb158), Try::Tiny::Catch=REF(0x3611de0)) called at /usr/local/cpanel/bin/backup line 934 bin::backup::_process_backups(HASH(0x335c9b0)) called at /usr/local/cpanel/bin/backup line 381 bin::backup::run("bin::backup") called at /usr/local/cpanel/bin/backup line 123 at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 1068. Cpanel::Backup::Metadata::__ANON__(Cpanel::Exception::Backup::CorruptedBackupData=HASH(0x3611cd8)) called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 118 Try::Tiny::try(CODE(0x337bb20), Try::Tiny::Catch=REF(0x3414be0)) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 1069 Cpanel::Backup::Metadata::create_metadata_for_backup_user("/backup/2019-06-24", "example?"1", Cpanel::Logger=HASH(0x354e780)) called at /usr/local/cpanel/bin/backup line 1757 bin::backup::__ANON__() called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97 eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 88 Try::Tiny::try(CODE(0x3616230), Try::Tiny::Catch=REF(0x343dfd0)) called at /usr/local/cpanel/bin/backup line 1753 bin::backup::backup_accounts("/backup/2019-06-24/accounts") called at /usr/local/cpanel/bin/backup line 917 bin::backup::__ANON__() called at /usr/local/cpanel/bin/backup line 924 bin::backup::__ANON__() called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97 eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 88 Try::Tiny::try(CODE(0x35cb158), Try::Tiny::Catch=REF(0x3611de0)) called at /usr/local/cpanel/bin/backup line 934 bin::backup::_process_backups(HASH(0x335c9b0)) called at /usr/local/cpanel/bin/backup line 381 bin::backup::run("bin::backup") called at /usr/local/cpanel/bin/backup line 123 [2019-06-28 13:51:54 +0530] info [backup] Queuing daily backup copy of "example?"1" for transport of "/backup/2019-06-24/accounts/example?"1" to "2019-06-24/accounts/example?"1" [2019-06-28 13:51:54 +0530] info [backup] This particular transport will be queued with keep_local = 1, based on the need to copy weekly () and/or monthly () copies as well. [2019-06-28 13:51:54 +0530] info [backup] Queuing transport of file: /backup/2019-06-24/accounts/example?"1 [2019-06-28 13:51:54 +0530] info [backup] no_transport = 0 .. and queueid = TQ:TaskQueue:1548 [2019-06-28 13:51:55 +0530] info [backup] leaving queue_backup_transport_item [2019-06-28 13:51:55 +0530] info [backup] Queuing transport of meta file: /backup/2019-06-24/accounts/.master.meta [2019-06-28 13:51:55 +0530] info [backup] no_transport = 0 .. and queueid = TQ:TaskQueue:1549 [2019-06-28 13:51:55 +0530] info [backup] leaving queue_backup_transport_item [2019-06-28 13:51:55 +0530] info [backup] Pruning backup directory: /backup/2019-06-16 [2019-06-29 03:34:25 +0530] info [backup] Pruning backup directory: /backup/2019-06-23 [2019-06-29 17:01:01 +0530] info [backup] Queuing prune operation for remote destination daily backups [2019-06-29 17:01:01 +0530] info [backup] no_transport = 0 .. and queueid = TQ:TaskQueue:1550 [2019-06-29 17:01:01 +0530] info [backup] leaving queue_backup_transport_item [2019-06-29 23:19:46 +0530] info [backup] Found corrupted backup metadata, scheduling backup metadata rebuild [2019-06-29 23:19:47 +0530] info [backup] Queuing transport reporter [2019-06-29 23:19:47 +0530] info [backup] no_transport = 0 .. and queueid = TQ:TaskQueue:1551 [2019-06-29 23:19:47 +0530] info [backup] leaving queue_backup_transport_item [2019-06-29 23:19:47 +0530] info [backup] Completed at Sat Jun 29 23:19:47 2019 [2019-06-29 23:19:47 +0530] info [backup] Final state is Backup::PartialFailure (0) [2019-06-29 23:19:47 +0530] info [backup] Sent Backup::PartialFailure notification. =========================================================