CPANEL-36050 - Backblaze B2: Backup transport errors
We have occasional problems when uploading to Backblaze B2, with backups failing to upload.
There are errors in cpbackup_transporter.log like the following example (actual account name has been replaced with "accountx"):
The backup software then immediately tries twice more:
After failing for a third time, it gives up and immediately moves onto the next account:
This carries on with a number of accounts failing to upload until there is a successful upload attempt 3 seconds later:
I'm assuming the "error: CODE :500" is the error code received from Backblaze. If so, then according to the Backblaze blog post below [1], an error code of 500 is to be expected. If the application receives an error 500 code, it should immediately try again after getting a new url. However, if it gets another 500 code, it should wait a few seconds before trying again. It would appear that the WHM backup software is not doing this. This has resulted in the failure to upload a number of accounts. [1]
[2021-02-23 05:03:19 +0000] info [cpbackup_transporter] Uploading account backup /backup_cpanel/2021-02-23/accounts/account1.tar.gz to backup_cpanel/2021-02-23/accounts/account1.tar.gz (from 2021-02-23/accounts/account1.tar.gz)
[2021-02-23 05:03:19 +0000] info [cpbackup_transporter] Attempting to upload /backup_cpanel/2021-02-23/accounts/account1.tar.gz to backup_cpanel/2021-02-23/accounts/account1.tar.gz for destination: Backblaze B2
[2021-02-23 05:03:19 +0000] info [cpbackup_transporter] Upload attempt #1 starting for /backup_cpanel/2021-02-23/accounts/account1.tar.gz to backup_cpanel/2021-02-23/accounts/account1.tar.gz for destination: Backblaze B2
[2021-02-23 05:03:19 +0000] warn [cpbackup_transporter] Upload attempt failed: Cpanel::Exception::HTTP::Network/(XID 4rn8t3) The system failed to send an HTTP "GET" request to "https://api.backblazeb2.com/b2api/v1/b2_authorize_account" because of an error: CODE :500: MSG :500 Can't connect to api.backblazeb2.com:443 (Name or service not known): Can't connect to api.backblazeb2.com:443 (Name or service not known)
Name or service not known at /usr/local/cpanel/3rdparty/perl/530/lib/perl5/cpanel_lib/LWP/Protocol/http.pm line 50.
at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 122.
Cpanel::Transport::Files::Backblaze::_error(Cpanel::Transport::Files::Backblaze=HASH(0x37befe8), "HTTP::Network", HASH(0x31660e8)) called at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 272
[Lots more perl stuff snipped]
The backup software then immediately tries twice more:
[2021-02-23 05:03:19 +0000] info [cpbackup_transporter] Upload attempt #2 starting for /backup_cpanel/2021-02-23/accounts/account1.tar.gz to backup_cpanel/2021-02-23/accounts/account1.tar.gz for destination: Backblaze B2
[2021-02-23 05:03:19 +0000] warn [cpbackup_transporter] Upload attempt failed: Cpanel::Exception::HTTP::Network/(XID 9ed6ug) The system failed to send an HTTP "GET" request to "https://api.backblazeb2.com/b2api/v1/b2_authorize_account" because of an error: CODE :500: MSG :500 Can't connect to api.backblazeb2.com:443 (Name or service not known): Can't connect to api.backblazeb2.com:443 (Name or service not known)
...
[2021-02-23 05:03:19 +0000] info [cpbackup_transporter] Upload attempt #3 starting for /backup_cpanel/2021-02-23/accounts/account1.tar.gz to backup_cpanel/2021-02-23/accounts/account1.tar.gz for destination: Backblaze B2
[2021-02-23 05:03:19 +0000] warn [cpbackup_transporter] Upload attempt failed: Cpanel::Exception::HTTP::Network/(XID 24zw5x) The system failed to send an HTTP "GET" request to "https://api.backblazeb2.com/b2api/v1/b2_authorize_account" because of an error: CODE :500: MSG :500 Can't connect to api.backblazeb2.com:443 (Name or service not known): Can't connect to api.backblazeb2.com:443 (Name or service not known)
After failing for a third time, it gives up and immediately moves onto the next account:
[2021-02-23 05:03:19 +0000] info [cpbackup_transporter] Upload attempt #1 starting for /backup_cpanel/2021-02-23/accounts/account2.tar.gz to backup_cpanel/2021-02-23/accounts/account2.tar.gz for destination: Backblaze B2
[2021-02-23 05:03:19 +0000] warn [cpbackup_transporter] Upload attempt failed: Cpanel::Exception::HTTP::Network/(XID amkjxg) The system failed to send an HTTP "GET" request to "https://api.backblazeb2.com/b2api/v1/b2_authorize_account" because of an error: CODE :500: MSG :500 Can't connect to api.backblazeb2.com:443 (Name or service not known): Can't connect to api.backblazeb2.com:443 (Name or service not known)
This carries on with a number of accounts failing to upload until there is a successful upload attempt 3 seconds later:
[2021-02-23 05:03:22 +0000] info [cpbackup_transporter] Upload attempt #1 starting for /backup_cpanel/2021-02-23/accounts/account3.tar.gz to backup_cpanel/2021-02-23/accounts/account3.tar.gz for destination: Backblaze B2
[2021-02-23 05:03:25 +0000] info [cpbackup_transporter] Successful transfer of /backup_cpanel/2021-02-23/accounts/account3.tar.gz to backup_cpanel/2021-02-23/accounts/account3.tar.gz for destination Backblaze B2
I'm assuming the "error: CODE :500" is the error code received from Backblaze. If so, then according to the Backblaze blog post below [1], an error code of 500 is to be expected. If the application receives an error 500 code, it should immediately try again after getting a new url. However, if it gets another 500 code, it should wait a few seconds before trying again. It would appear that the WHM backup software is not doing this. This has resulted in the failure to upload a number of accounts. [1]
-
Hey there! Thanks for bringing this to my attention. I've created case CPANEL-36050 to have our developer explore the possibility of introducing a delay in the Backblaze upload settings when an error is encountered. I'm following along with that case and I'll make sure to post an update here as soon as I hear something. 0 -
Thanks Rex. 0 -
Sure thing! 0 -
Update - we have a fix for this that will be included in version 96 when this gets released :D 0 -
Great, thanks. 0 -
Sorry, but still seeing this error in version v.96.0.9. Should be pausing for a few seconds after failure #2, but that's not happening. First few backups upload with no problem, and then B2 get's busy and the script does not pause. Here's an excerpt from my logs/transport_errors.txt [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] cpbackup_transporter - Processing next task [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Instantiating Object [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Starting a "copy" operation on the "Backblaze" destination ID "[[hidden]]". [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Validating destination path weekly/2021-06-06/accounts/ [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Making Path weekly/2021-06-06/accounts/ [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Path creation successful [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Uploading account backup /backup/2021-06-06/accounts/[[hidden]].tar.gz to weekly/2021-06-06/accounts/[[hidden]].tar.gz (from weekly/2021-06-06/accounts/[[hidden]].tar.gz) [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Attempting to upload /backup/2021-06-06/accounts/[[hidden]].tar.gz to weekly/2021-06-06/accounts/[[hidden]].tar.gz for destination: Backblaze [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Upload attempt #1 starting for /backup/2021-06-06/accounts/[[hidden]].tar.gz to weekly/2021-06-06/accounts/[[hidden]].tar.gz for destination: Backblaze [2021-06-06 04:50:53 -0700] warn [cpbackup_transporter] Upload attempt failed: Cpanel::Exception::HTTP::Network/(XID npjcr9) The system failed to send an HTTP "GET" request to " because of an error: CODE :500: MSG :500 Can't connect to api.backblazeb2.com:443 (Name or service not known): Can't connect to api.backblazeb2.com:443 (Name or service not known) Name or service not known at /usr/local/cpanel/3rdparty/perl/532/lib/perl5/cpanel_lib/LWP/Protocol/http.pm line 50. at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 122. [[DUMP]] [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Upload attempt #2 starting for /backup/2021-06-06/accounts/[[hidden]].tar.gz to weekly/2021-06-06/accounts/[[hidden]].tar.gz for destination: Backblaze [2021-06-06 04:50:53 -0700] warn [cpbackup_transporter] Upload attempt failed: Cpanel::Exception::HTTP::Network/(XID peybg9) The system failed to send an HTTP "GET" request to " because of an error: CODE :500: MSG :500 Can't connect to api.backblazeb2.com:443 (Name or service not known): Can't connect to api.backblazeb2.com:443 (Name or service not known) Name or service not known at /usr/local/cpanel/3rdparty/perl/532/lib/perl5/cpanel_lib/LWP/Protocol/http.pm line 50. at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 122. [[DUMP]] [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Upload attempt #3 starting for /backup/2021-06-06/accounts/[[hidden]].tar.gz to weekly/2021-06-06/accounts/[[hidden]].tar.gz for destination: Backblaze [2021-06-06 04:50:53 -0700] warn [cpbackup_transporter] Upload attempt failed: Cpanel::Exception::HTTP::Network/(XID cquwju) The system failed to send an HTTP "GET" request to " because of an error: CODE :500: MSG :500 Can't connect to api.backblazeb2.com:443 (Name or service not known): Can't connect to api.backblazeb2.com:443 (Name or service not known) Name or service not known at /usr/local/cpanel/3rdparty/perl/532/lib/perl5/cpanel_lib/LWP/Protocol/http.pm line 50. at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 122. [[DUMP]] [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] cpbackup_transporter - Processing next task [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Instantiating Object [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Starting a "copy" operation on the "Backblaze" destination ID "[[hidden]]". [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Validating destination path 2021-06-06/accounts/ [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Making Path 2021-06-06/accounts/ [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Path creation successful [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Uploading account backup /backup/2021-06-06/accounts/[[hidden]].tar.gz to 2021-06-06/accounts/[[hidden]].tar.gz (from 2021-06-06/accounts/[[hidden]].tar.gz) [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Attempting to upload /backup/2021-06-06/accounts/[[hidden]].tar.gz to 2021-06-06/accounts/[[hidden]].tar.gz for destination: Backblaze [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Upload attempt #1 starting for /backup/2021-06-06/accounts/[[hidden]].tar.gz to 2021-06-06/accounts/[[hidden]].tar.gz for destination: Backblaze [2021-06-06 04:50:53 -0700] warn [cpbackup_transporter] Upload attempt failed: Cpanel::Exception::HTTP::Network/(XID xnpbj9) The system failed to send an HTTP "GET" request to " because of an error: CODE :500: MSG :500 Can't connect to api.backblazeb2.com:443 (Name or service not known): Can't connect to api.backblazeb2.com:443 (Name or service not known) Name or service not known at /usr/local/cpanel/3rdparty/perl/532/lib/perl5/cpanel_lib/LWP/Protocol/http.pm line 50. at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 122. [[DUMP]] [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Upload attempt #2 starting for /backup/2021-06-06/accounts/[[hidden]].tar.gz to 2021-06-06/accounts/[[hidden]].tar.gz for destination: Backblaze [2021-06-06 04:50:53 -0700] warn [cpbackup_transporter] Upload attempt failed: Cpanel::Exception::HTTP::Network/(XID 7pygtp) The system failed to send an HTTP "GET" request to " because of an error: CODE :500: MSG :500 Can't connect to api.backblazeb2.com:443 (Name or service not known): Can't connect to api.backblazeb2.com:443 (Name or service not known) Name or service not known at /usr/local/cpanel/3rdparty/perl/532/lib/perl5/cpanel_lib/LWP/Protocol/http.pm line 50. at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 122. [[DUMP]] [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Upload attempt #3 starting for /backup/2021-06-06/accounts/[[hidden]].tar.gz to 2021-06-06/accounts/[[hidden]].tar.gz for destination: Backblaze [2021-06-06 04:50:53 -0700] warn [cpbackup_transporter] Upload attempt failed: Cpanel::Exception::HTTP::Network/(XID w73j6d) The system failed to send an HTTP "GET" request to " because of an error: CODE :500: MSG :500 Can't connect to api.backblazeb2.com:443 (Name or service not known): Can't connect to api.backblazeb2.com:443 (Name or service not known) Name or service not known at /usr/local/cpanel/3rdparty/perl/532/lib/perl5/cpanel_lib/LWP/Protocol/http.pm line 50. at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 122. [[DUMP]] [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] cpbackup_transporter - Processing next task [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Instantiating Object [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Starting a "copy" operation on the "Backblaze" destination ID "[[hidden]]". [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Validating destination path weekly/2021-06-06/accounts/ [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Making Path weekly/2021-06-06/accounts/ [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Path creation successful [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Uploading account backup /backup/2021-06-06/accounts/[[hidden]].tar.gz to weekly/2021-06-06/accounts/[[hidden]].tar.gz (from weekly/2021-06-06/accounts/[[hidden]].tar.gz) [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Attempting to upload /backup/2021-06-06/accounts/[[hidden]].tar.gz to weekly/2021-06-06/accounts/[[hidden]].tar.gz for destination: Backblaze [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Upload attempt #1 starting for /backup/2021-06-06/accounts/[[hidden]].tar.gz to weekly/2021-06-06/accounts/[[hidden]].tar.gz for destination: Backblaze [2021-06-06 04:50:53 -0700] warn [cpbackup_transporter] Upload attempt failed: Cpanel::Exception::HTTP::Network/(XID r9aur6) The system failed to send an HTTP "GET" request to " because of an error: CODE :500: MSG :500 Can't connect to api.backblazeb2.com:443 (Name or service not known): Can't connect to api.backblazeb2.com:443 (Name or service not known) Name or service not known at /usr/local/cpanel/3rdparty/perl/532/lib/perl5/cpanel_lib/LWP/Protocol/http.pm line 50. at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 122. [[DUMP]] [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Upload attempt #2 starting for /backup/2021-06-06/accounts/[[hidden]].tar.gz to weekly/2021-06-06/accounts/[[hidden]].tar.gz for destination: Backblaze [2021-06-06 04:50:53 -0700] warn [cpbackup_transporter] Upload attempt failed: Cpanel::Exception::HTTP::Network/(XID pmqg37) The system failed to send an HTTP "GET" request to " because of an error: CODE :500: MSG :500 Can't connect to api.backblazeb2.com:443 (Name or service not known): Can't connect to api.backblazeb2.com:443 (Name or service not known) Name or service not known at /usr/local/cpanel/3rdparty/perl/532/lib/perl5/cpanel_lib/LWP/Protocol/http.pm line 50. at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 122. [[DUMP]] [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Upload attempt #3 starting for /backup/2021-06-06/accounts/[[hidden]].tar.gz to weekly/2021-06-06/accounts/[[hidden]].tar.gz for destination: Backblaze [2021-06-06 04:50:53 -0700] warn [cpbackup_transporter] Upload attempt failed: Cpanel::Exception::HTTP::Network/(XID nxv2q7) The system failed to send an HTTP "GET" request to " because of an error: CODE :500: MSG :500 Can't connect to api.backblazeb2.com:443 (Name or service not known): Can't connect to api.backblazeb2.com:443 (Name or service not known) Name or service not known at /usr/local/cpanel/3rdparty/perl/532/lib/perl5/cpanel_lib/LWP/Protocol/http.pm line 50. at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 122. [[DUMP]] [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] cpbackup_transporter - Processing next task [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Instantiating Object [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Starting a "copy_backup_metadata" operation on the "Backblaze" destination ID "[[hidden]]". [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Uploading backup metadata file /backup/2021-06-06/accounts/.master.meta to Backblaze [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Validating destination path 2021-06-06/accounts/ [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Making Path 2021-06-06/accounts/ [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Path creation successful [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Uploading backup metadata /backup/2021-06-06/accounts/.master.meta to 2021-06-06/accounts/.master.meta (from 2021-06-06/accounts/.master.meta) [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Attempting to upload /backup/2021-06-06/accounts/.master.meta to 2021-06-06/accounts/.master.meta for destination: Backblaze [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Upload attempt #1 starting for /backup/2021-06-06/accounts/.master.meta to 2021-06-06/accounts/.master.meta for destination: Backblaze [2021-06-06 04:50:53 -0700] warn [cpbackup_transporter] Upload attempt failed: Cpanel::Exception::HTTP::Network/(XID zxfwpf) The system failed to send an HTTP "GET" request to " because of an error: CODE :500: MSG :500 Can't connect to api.backblazeb2.com:443 (Name or service not known): Can't connect to api.backblazeb2.com:443 (Name or service not known) Name or service not known at /usr/local/cpanel/3rdparty/perl/532/lib/perl5/cpanel_lib/LWP/Protocol/http.pm line 50. at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 122. [[DUMP]] [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Upload attempt #2 starting for /backup/2021-06-06/accounts/.master.meta to 2021-06-06/accounts/.master.meta for destination: Backblaze [2021-06-06 04:50:53 -0700] warn [cpbackup_transporter] Upload attempt failed: Cpanel::Exception::HTTP::Network/(XID qudqvq) The system failed to send an HTTP "GET" request to " because of an error: CODE :500: MSG :500 Can't connect to api.backblazeb2.com:443 (Name or service not known): Can't connect to api.backblazeb2.com:443 (Name or service not known) Name or service not known at /usr/local/cpanel/3rdparty/perl/532/lib/perl5/cpanel_lib/LWP/Protocol/http.pm line 50. at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 122. [[DUMP]] [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Upload attempt #3 starting for /backup/2021-06-06/accounts/.master.meta to 2021-06-06/accounts/.master.meta for destination: Backblaze [2021-06-06 04:50:53 -0700] warn [cpbackup_transporter] Upload attempt failed: Cpanel::Exception::HTTP::Network/(XID g2882n) The system failed to send an HTTP "GET" request to " because of an error: CODE :500: MSG :500 Can't connect to api.backblazeb2.com:443 (Name or service not known): Can't connect to api.backblazeb2.com:443 (Name or service not known) Name or service not known at /usr/local/cpanel/3rdparty/perl/532/lib/perl5/cpanel_lib/LWP/Protocol/http.pm line 50. at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 122. [[DUMP]] [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] cpbackup_transporter - Processing next task [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Instantiating Object [2021-06-06 04:50:53 -0700] info [cpbackup_transporter] Starting a "prune" operation on the "Backblaze" destination ID "[[hidden]]". 0 -
OP here. We also continued to see this. A cPanel Analyst has recently been working on our system and think they have identified a fix. There is a support article you can follow, but I'm not sure if I can link to this. May be cPRex can add more detail. 0 -
Hello phil99. Would you mind providing the ticket ID so that we can review the resolution information that was provided in the ticket? 0 -
Hi, ticket #94327364. 0 -
I am also seeing issues with Backblaze offsite backups since Version 96.0.9 The problems I am seeing are: 1. When transferring files, it is no longer creating a new folder on Backblaze It now always uses the same folder 2021-05-29/ and overwrites the backup from the day before. It should create a new folder for each day - 2021-06-09 etc. 2021-06-09 is being saved to 2021-05-29/ [2021-06-09 02:03:10 +0100] info [cpbackup_transporter] Initializing log file [2021-06-09 02:03:10 +0100] info [cpbackup_transporter] cpbackup_transporter - parent starting [2021-06-09 02:03:10 +0100] info [cpbackup_transporter] cpbackup_transporter - child starting [2021-06-09 02:03:10 +0100] info [cpbackup_transporter] cPanel Backup Transporter Queue Daemon started. [2021-06-09 02:03:10 +0100] info [cpbackup_transporter] cpbackup_transporter - started [2021-06-09 02:03:10 +0100] info [cpbackup_transporter] cpbackup_transporter - Checking queue for tasks [2021-06-09 02:03:10 +0100] info [cpbackup_transporter] cpbackup_transporter - Processing next task [2021-06-09 02:03:10 +0100] info [cpbackup_transporter] Instantiating Object [2021-06-09 02:03:10 +0100] info [cpbackup_transporter] Starting a "copy" operation on the "server3-v2" destination ID "6a8vXi_rRC0gbsB9MJJ6xRe5". [2021-06-09 02:03:10 +0100] info [cpbackup_transporter] Validating destination path 2021-05-29/accounts/ [2021-06-09 02:03:11 +0100] info [cpbackup_transporter] Path exists 2021-06-06 is being saved to 2021-05-29/ [2021-06-06 02:03:11 +0100] info [cpbackup_transporter] Base path for destination is server3 [2021-06-06 02:03:11 +0100] info [cpbackup_transporter] Validating destination path server3/2021-05-28/accounts/ [2021-06-06 02:03:13 +0100] info [cpbackup_transporter] Path exists All new backup are saved to 2021-05-29/ 2. It is also skipping some backups and the error is info [cpbackup_transporter] Deep recursion on subroutine "Cpanel::Transport::Files::Backblaze::_do_request" at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 269. 3. I am also seeing this error 2021-06-09 04:19:26 +0100] info [cpbackup_transporter] cpbackup_transporter - Processing next task [2021-06-09 04:19:26 +0100] info [cpbackup_transporter] Instantiating Object [2021-06-09 04:19:28 +0100] info [cpbackup_transporter] Starting a "copy" operation on the "backup06" destination ID "RXeICSEibtmSh81YlG0oFuEP". [2021-06-09 04:19:28 +0100] info [cpbackup_transporter] Base path for destination is server3 [2021-06-09 04:19:28 +0100] info [cpbackup_transporter] Validating destination path server3/2021-05-29/accounts/ [2021-06-09 04:19:29 +0100] info [cpbackup_transporter] Path exists [2021-06-09 04:19:29 +0100] info [cpbackup_transporter] Uploading account backup /backup/2021-05-29/accounts/[hidden].tar.gz to server3/2021-05-29/accounts/[hidden].tar.gz (from 2021-05-29/accounts/[hidden].tar.gz) [2021-06-09 04:19:29 +0100] info [cpbackup_transporter] Attempting to upload /backup/2021-05-29/accounts/[hidden].tar.gz to server3/2021-05-29/accounts/[hidden].tar.gz for destination: backup06 [2021-06-09 04:19:29 +0100] info [cpbackup_transporter] Upload attempt #1 starting for /backup/2021-05-29/accounts/[hidden].tar.gz to server3/2021-05-29/accounts/[hidden].tar.gz for destination: backup06 [2021-06-09 04:20:46 +0100] warn [cpbackup_transporter] Upload attempt failed: rsync failed: command exited with code 255: Unknown rsync error rsync: [sender] write error: Broken pipe (32) rsync error: unexplained error (code 255) at io.c(820) [sender=3.1.2] at /usr/local/cpanel/Cpanel/LoggerAdapter.pm line 27. Cpanel::LoggerAdapter::warn(Cpanel::LoggerAdapter=HASH(0x13af588), "Upload attempt failed: rsync failed: command exited with code"...) called at /usr/local/cpanel/Cpanel/Backup/Queue.pm line 633 Cpanel::Backup::Queue::transport_backup::attempt_to_upload_file(Cpanel::Backup::Queue::transport_backup=HASH(0x11916e8), Cpanel::Transport::Files::Rsync=HASH(0x242eb20), "/backup/2021-05-29/accounts/[hidden].tar.gz", "server3/2021-05-29/accounts/[hidden].tar.gz", Cpanel::LoggerAdapter=HASH(0x13af588)) called at /usr/local/cpanel/Cpanel/Backup/Queue.pm line 333 Cpanel::Backup::Queue::transport_backup::process_task(Cpanel::Backup::Queue::transport_backup=HASH(0x11916e8), Cpanel::TaskQueue::Task=HASH(0x390fac8), Cpanel::LoggerAdapter=HASH(0x13af588)) called at /usr/local/cpanel/Cpanel/TaskQueue.pm line 635 eval {...} called at /usr/local/cpanel/Cpanel/TaskQueue.pm line 638 Cpanel::TaskQueue::__ANON__() called at /usr/local/cpanel/Cpanel/StateFile.pm line 241 eval {...} called at /usr/local/cpanel/Cpanel/StateFile.pm line 241 Cpanel::StateFile::Guard::call_unlocked(Cpanel::StateFile::Guard=HASH(0x3bb6188), CODE(0x2404bc8)) called at /usr/local/cpanel/Cpanel/TaskQueue.pm line 643 Cpanel::TaskQueue::process_next_task(Cpanel::TaskQueue=HASH(0x2190298)) called at /usr/local/cpanel/bin/cpbackup_transporter line 168 eval {...} called at /usr/local/cpanel/bin/cpbackup_transporter line 166 [2021-06-09 04:20:48 +0100] info [cpbackup_transporter] Upload attempt #2 starting for /backup/2021-05-29/accounts/[hidden].tar.gz to server3/2021-05-29/accounts/[hidden].tar.gz for destination: backup06 [2021-06-09 04:21:29 +0100] warn [cpbackup_transporter] Upload attempt failed: rsync failed: command exited with code 255: Unknown rsync error rsync: [sender] write error: Broken pipe (32) rsync error: unexplained error (code 255) at io.c(820) [sender=3.1.2] at /usr/local/cpanel/Cpanel/LoggerAdapter.pm line 27. Cpanel::LoggerAdapter::warn(Cpanel::LoggerAdapter=HASH(0x13af588), "Upload attempt failed: rsync failed: command exited with code"...) called at /usr/local/cpanel/Cpanel/Backup/Queue.pm line 633 Cpanel::Backup::Queue::transport_backup::attempt_to_upload_file(Cpanel::Backup::Queue::transport_backup=HASH(0x11916e8), Cpanel::Transport::Files::Rsync=HASH(0x242eb20), "/backup/2021-05-29/accounts/[hidden].tar.gz", "server3/2021-05-29/accounts/[hidden].tar.gz", Cpanel::LoggerAdapter=HASH(0x13af588)) called at /usr/local/cpanel/Cpanel/Backup/Queue.pm line 333 Cpanel::Backup::Queue::transport_backup::process_task(Cpanel::Backup::Queue::transport_backup=HASH(0x11916e8), Cpanel::TaskQueue::Task=HASH(0x390fac8), Cpanel::LoggerAdapter=HASH(0x13af588)) called at /usr/local/cpanel/Cpanel/TaskQueue.pm line 635 eval {...} called at /usr/local/cpanel/Cpanel/TaskQueue.pm line 638 Cpanel::TaskQueue::__ANON__() called at /usr/local/cpanel/Cpanel/StateFile.pm line 241 eval {...} called at /usr/local/cpanel/Cpanel/StateFile.pm line 241 Cpanel::StateFile::Guard::call_unlocked(Cpanel::StateFile::Guard=HASH(0x3bb6188), CODE(0x2404bc8)) called at /usr/local/cpanel/Cpanel/TaskQueue.pm line 643 Cpanel::TaskQueue::process_next_task(Cpanel::TaskQueue=HASH(0x2190298)) called at /usr/local/cpanel/bin/cpbackup_transporter line 168 eval {...} called at /usr/local/cpanel/bin/cpbackup_transporter line 166 2021-06-06 02:09:28 +0100] info [cpbackup_transporter] cpbackup_transporter - Processing next task [2021-06-06 02:09:28 +0100] info [cpbackup_transporter] Instantiating Object [2021-06-06 02:09:29 +0100] info [cpbackup_transporter] Starting a "copy" operation on the "backup06" destination ID "RXeICSEibtmSh81YlG0oFuEP". [2021-06-06 02:09:29 +0100] info [cpbackup_transporter] Base path for destination is server3 [2021-06-06 02:09:29 +0100] info [cpbackup_transporter] Validating destination path server3/2021-05-28/accounts/ [2021-06-06 02:09:30 +0100] info [cpbackup_transporter] Path exists [2021-06-06 02:09:30 +0100] info [cpbackup_transporter] Uploading account backup /backup/2021-05-28/accounts/[hidden].tar.gz to server3/2021-05-28/accounts/[hidden].tar.gz (from 2021-05-28/accounts/[hidden].tar.gz) [2021-06-06 02:09:30 +0100] info [cpbackup_transporter] Attempting to upload /backup/2021-05-28/accounts/[hidden].tar.gz to server3/2021-05-28/accounts/[hidden].tar.gz for destination: backup06 [2021-06-06 02:09:30 +0100] info [cpbackup_transporter] Upload attempt #1 starting for /backup/2021-05-28/accounts/[hidden].tar.gz to server3/2021-05-28/accounts/[hidden].tar.gz for destination: backup06 [2021-06-06 02:09:30 +0100] warn [cpbackup_transporter] Upload attempt failed: rsync failed: command exited with code 23: partial transfer due to error rsync: change_dir "/backup/2021-05-28/accounts" failed: No such file or directory (2) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1179) [sender=3.1.2] at /usr/local/cpanel/Cpanel/LoggerAdapter.pm line 27. Cpanel::LoggerAdapter::warn(Cpanel::LoggerAdapter=HASH(0x20e5888), "Upload attempt failed: rsync failed: command exited with code"...) called at /usr/local/cpanel/Cpanel/Backup/Queue.pm line 633 Cpanel::Backup::Queue::transport_backup::attempt_to_upload_file(Cpanel::Backup::Queue::transport_backup=HASH(0x1ec76e8), Cpanel::Transport::Files::Rsync=HASH(0x3ea51e8), "/backup/2021-05-28/accounts/[hidden].tar.gz", "server3/2021-05-28/accounts/[hidden].tar.gz", Cpanel::LoggerAdapter=HASH(0x20e5888)) called at /usr/local/cpanel/Cpanel/Backup/Queue.pm line 333 Cpanel::Backup::Queue::transport_backup::process_task(Cpanel::Backup::Queue::transport_backup=HASH(0x1ec76e8), Cpanel::TaskQueue::Task=HASH(0x3e7bc90), Cpanel::LoggerAdapter=HASH(0x20e5888)) called at /usr/local/cpanel/Cpanel/TaskQueue.pm line 635 eval {...} called at /usr/local/cpanel/Cpanel/TaskQueue.pm line 638 Cpanel::TaskQueue::__ANON__() called at /usr/local/cpanel/Cpanel/StateFile.pm line 241 eval {...} called at /usr/local/cpanel/Cpanel/StateFile.pm line 241 Cpanel::StateFile::Guard::call_unlocked(Cpanel::StateFile::Guard=HASH(0x2f97350), CODE(0x325a1a8)) called at /usr/local/cpanel/Cpanel/TaskQueue.pm line 643 Cpanel::TaskQueue::process_next_task(Cpanel::TaskQueue=HASH(0x2ec65b8)) called at /usr/local/cpanel/bin/cpbackup_transporter line 168 eval {...} called at /usr/local/cpanel/bin/cpbackup_transporter line 166 [2021-06-06 02:09:32 +0100] info [cpbackup_transporter] Upload attempt #2 starting for /backup/2021-05-28/accounts/[hidden].tar.gz to server3/2021-05-28/accounts/[hidden].tar.gz for destination: backup06 4. and this error: SSL connect attempt failed because of handshake problems [2021-05-26 04:02:08 +0100] info [cpbackup_transporter] Attempting to upload /backup/2021-05-26/accounts/[hidden].tar.gz to 2021-05-26/accounts/[hidden].tar.gz for destination: Backblaze Backups [2021-05-26 04:02:08 +0100] info [cpbackup_transporter] Upload attempt #1 starting for /backup/2021-05-26/accounts/[hidden].tar.gz to 2021-05-26/accounts/[hidden].tar.gz for destination: Backblaze Backups [2021-05-26 04:50:53 +0100] info [cpbackup_transporter] Deep recursion on subroutine "Cpanel::Transport::Files::Backblaze::_do_request" at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 297. [2021-05-26 04:50:53 +0100] info [cpbackup_transporter] Deep recursion on subroutine "Cpanel::Transport::Files::Backblaze::_do_request" at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 269. [2021-05-30 00:31:57 +0100] warn [cpbackup_transporter] Upload attempt failed: Cpanel::Exception::HTTP::Network/(XID bfj2ry) The system failed to send an HTTP "GET" request to " because of an error: CODE :500: MSG :500 Can't connect to api.backblazeb2.com:443 (SSL connect attempt failed because of handshake problems): Can't connect to api.backblazeb2.com:443 (SSL connect attempt failed because of handshake problems) SSL connect attempt failed because of handshake problems at /usr/local/cpanel/3rdparty/perl/532/lib/perl5/cpanel_lib/LWP/Protocol/http.pm line 50. at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 122. Cpanel::Transport::Files::Backblaze::_error(Cpanel::Transport::Files::Backblaze=HASH(0x1c40e90), "HTTP::Network", HASH(0x2e6d8518)) called at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 273 Cpanel::Transport::Files::Backblaze::_do_request(Cpanel::Transport::Files::Backblaze=HASH(0x1c40e90), __CPANEL_HIDDEN__, __CPANEL_HIDDEN__, __CPANEL_HIDDEN__, __CPANEL_HIDDEN__, __CPANEL_HIDDEN__, __CPANEL_HIDDEN__, __CPANEL_HIDDEN__, ...) called at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 297 Cpanel::Transport::Files::Backblaze::_get_authorize_token(Cpanel::Transport::Files::Backblaze=HASH(0x1c40e90), 1) called at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 268 Cpanel::Transport::Files::Backblaze::_do_request(Cpanel::Transport::Files::Backblaze=HASH(0x1c40e90), "content_type", "application/octet-stream", "api_ver", "v1", "custom_url", "[[HIDDEN]]"..., "payload", ...) called at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 269 Cpanel::Transport::Files::Backblaze::_do_request(Cpanel::Transport::Files::Backblaze=HASH(0x1c40e90), "extra_headers", HASH(0x37e3770), "payload", CODE(0x3844800), "lives_on_error", 1, "request_type", ...) called at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 269 Cpanel::Transport::Files::Backblaze::_do_request(Cpanel::Transport::Files::Backblaze=HASH(0x1c40e90), __CPANEL_HIDDEN__, __CPANEL_HIDDEN__..., __CPANEL_HIDDEN__, __CPANEL_HIDDEN__, __CPANEL_HIDDEN__, __CPANEL_HIDDEN__, __CPANEL_HIDDEN__, ...) called at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 269 Cpanel::Transport::Files::Backblaze::_do_request(Cpanel::Transport::Files::Backblaze=HASH(0x1c40e90), "request_type", "POST", "lives_on_error", 1, "payload", CODE(0x3844800), "extra_headers", ...) called at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 269 0 -
Update - the fix is scheduled to be included in version 96.0.11. 0 -
Hi All our servers have all been upgraded to 96.0.11 The path creation issues seems to be resolved as the path is being created. The backups are not working due to the following error [2021-06-16 23:23:47 +0100] info [cpbackup_transporter] Upload attempt #1 starting for /backup/2021-06-16/accounts/[hidden].tar.gz to 2021-06-16/accounts/[hidden].tar.gz for destination: Backblaze Backups [2021-06-17 00:06:04 +0100] info [cpbackup_transporter] Deep recursion on subroutine "Cpanel::Transport::Files::Backblaze::_do_request" at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 297. [2021-06-17 00:06:04 +0100] info [cpbackup_transporter] Deep recursion on subroutine "Cpanel::Transport::Files::Backblaze::_do_request" at /usr/local/cpanel/Cpanel/Transport/Files/Backblaze.pm line 269. The servers are all crashing as a result and I have had to disable the offsite backups to Backblaze Can you review and provide a solution? Thanks 0 -
@dmart1n - could you submit a ticket to our team so we can check this on one of your affected machines? 0 -
I'm in the same boat as dmart1n with exactly the same errors affecting at least two of my servers, I have a ticket open #94335602 0 -
Our team has opened case CPANEL-37482 to track the issue on new tickets as this seems to be happening again after it was recently fixed. You'll be getting a reply to the ticket saying something similar most likely, but we are aware of the issue. 0 -
Hi, I have the version 94.0.12 and have the same problem: WHM/cPanel not finalize sending the backups to remote server: [QUOTE]Unable to send "/backup/2021-07-01/accounts/account71.tar.gz to destination "backup-server" Unable to send "/backup/2021-07-01/accounts/account72.tar.gz to destination "backup-server" Unable to send "/backup/2021-07-01/accounts/account73.tar.gz to destination "backup-server" Unable to send "/backup/2021-07-01/accounts/account74.tar.gz to destination "backup-server"
Thank you very much. Have a nice day.0 -
@MindServer - we aren't expecting the issue to be resolved on version 94. The case mentioned above is still being investigated at this time. 0 -
@MindServer - we aren't expecting the issue to be resolved on version 94. The case mentioned above is still being investigated at this time.
Ok, thank you very much. Please notify us in this post when the problem is solved. Have a nice day.0 -
Hi, We have a serious problem: when cPanel do backups sometimes block the server and we need reboot him. Where can I check the logs for send you?. Thank you. 0 -
Can you let me know what you mean when you say "block the server" ? Are you unable to access the cPanel machine at all? If so, the best place to look would be the error logs at /usr/local/cpanel/logs/error_log and the backup log at /usr/local/cpanel/logs/cpbackup/ for the most recent backup run. This doesn't sound like it is related to the Backblaze issue, so it might be best if this was in a separate thread. 0 -
Hi, When I says "block the server" I mean that not works any tool: WHM, cPanel, SSH, FTP, websites, emails, etc. The server are doing ping, but not works any tool. The datacenter checked this and told us that not is a hardware problem. This happens 2 times and in the both times WHM/cPanel are doing backups, in the logs the server have normal Load Averages: 1.00 - 2.00. Before appear this problem, every week we receive email that says cPanel not complete all the backups: only complete 110 - 115 accounts (this server have 121 cPanel accounts). Now we disabled cPanel backups (we are doing backups with JetBackup) and the problem not happens again. In the file "/usr/local/cpanel/logs/error_log" before the server are down appear this: [QUOTE][2021-07-03 06:16:03 +0200] warn [cpsrvd] lookup_mail_user() failed: You do not have a user named *****. at /usr/local/cpanel/Cpanel/Server.pm line 2385, line 2. Cpanel::Server::__ANON__(__CPANEL_HIDDEN__...) called at /usr/local/cpanel/Cpanel/Server/Dovecot.pm line 203 Cpanel::Server::Dovecot::_handle_dovecot_userdb(Cpanel::Server::Dovecot=HASH(0x31f22d0), "shared", "dovecot_userdb", "quota-status", "*****") called at /usr/local/cpanel/Cpanel/Server/Dovecot.pm line 150 Cpanel::Server::Dovecot::_dovecot_request_handler(Cpanel::Server::Dovecot=HASH(0x31f22d0), "Lshared/dovecot_userdb-quota-status/*****") called at /usr/local/cpanel/Cpanel/Server/Dovecot.pm line 90 eval {...} called at /usr/local/cpanel/Cpanel/Server/Dovecot.pm line 75 Cpanel::Server::Dovecot::handle_cpdoveauthd_request(Cpanel::Server::Dovecot=HASH(0x31f22d0)) called at /usr/local/cpanel/Cpanel/Server.pm line 2392 Cpanel::Server::handle_cpdoveauthd_connection(Cpanel::Server=HASH(0x326c208)) called at cpsrvd.pl line 1855 cpanel::cpsrvd::_handle_unix_socket_connection("handle_cpdoveauthd_connection") called at cpsrvd.pl line 1110 cpanel::cpsrvd::script() called at cpsrvd.pl line 432 [2021-07-03 06:16:07 +0200] info [autorepair] Successfully verified signature for cpanel (key types: release). [2021-07-03 06:42:05 +0200] warn [cpsrvd] lookup_mail_user() failed: You do not have a user named *****. at /usr/local/cpanel/Cpanel/Server.pm line 2385, line 2. Cpanel::Server::__ANON__(__CPANEL_HIDDEN__...) called at /usr/local/cpanel/Cpanel/Server/Dovecot.pm line 203 Cpanel::Server::Dovecot::_handle_dovecot_userdb(Cpanel::Server::Dovecot=HASH(0x31f22b8), "shared", "dovecot_userdb", "quota-status", "*****") called at /usr/local/cpanel/Cpanel/Server/Dovecot.pm line 150 Cpanel::Server::Dovecot::_dovecot_request_handler(Cpanel::Server::Dovecot=HASH(0x31f22b8), "Lshared/dovecot_userdb-quota-status/*****") called at /usr/local/cpanel/Cpanel/Server/Dovecot.pm line 90 eval {...} called at /usr/local/cpanel/Cpanel/Server/Dovecot.pm line 75 Cpanel::Server::Dovecot::handle_cpdoveauthd_request(Cpanel::Server::Dovecot=HASH(0x31f22b8)) called at /usr/local/cpanel/Cpanel/Server.pm line 2392 Cpanel::Server::handle_cpdoveauthd_connection(Cpanel::Server=HASH(0x326c208)) called at cpsrvd.pl line 1855 cpanel::cpsrvd::_handle_unix_socket_connection("handle_cpdoveauthd_connection") called at cpsrvd.pl line 1110 cpanel::cpsrvd::script() called at cpsrvd.pl line 432 [2021-07-03 06:47:25 +0200] info [whostmgrd] Successfully verified signature for cpanel (key types: release). -- RESTART MARKER (PID 1499 at Sat Jul 3 07:44:38 2021 - 1625291078)-- ==> cpsrvd 11.94.0.12 started ==> cpsrvd: loading security policy....Done ==> cpsrvd: Setting up SSL support ... Done ==> cpsrvd: transferred port bindings: 3,4,5,6,7,8,9,10,11,12 ==> cpsrvd: bound to ports
In the file " /usr/local/cpanel/logs/cpbackup/..." before the server are down appear this: [QUOTE] [2021-07-03 07:00:14 +0200] Completed "Integration" component. [2021-07-03 07:00:14 +0200] Performing "AuthnLinks" component.... [2021-07-03 07:00:14 +0200] Completed "AuthnLinks" component. [2021-07-03 07:00:14 +0200] Performing "APITokens" component.... [2021-07-03 07:00:14 +0200] Completed "APITokens" component. [2021-07-03 07:00:14 +0200] Performing "DNSSEC" component.... [2021-07-03 07:00:14 +0200] Completed "DNSSEC" component. [2021-07-03 07:00:14 +0200] Performing "Custom" component.... [2021-07-03 07:00:14 +0200] No custom components to perform. [2021-07-03 07:00:14 +0200] Completed "Custom" component. [2021-07-03 07:00:14 +0200] Performing "AutoSSL" component.... [2021-07-03 07:00:14 +0200] Completed "AutoSSL" component. [2021-07-03 07:00:14 +0200] Storing Subdomains.... [2021-07-03 07:00:14 +0200] Done [2021-07-03 07:00:14 +0200] Storing Parked Domains.... [2021-07-03 07:00:14 +0200] Done [2021-07-03 07:00:14 +0200] Storing Addon Domains.... [2021-07-03 07:00:14 +0200] Performing "Password" component.... [2021-07-03 07:00:14 +0200] Completed "Password" component. [2021-07-03 07:00:14 +0200] Performing "DigestShadow" component.... [2021-07-03 07:00:14 +0200] Completed "DigestShadow" component. [2021-07-03 07:00:14 +0200] Copying shell.......[2021-07-03 07:00:14 +0200] Done [2021-07-03 07:00:14 +0200] Performing "WebCalls" component.... [2021-07-03 07:00:14 +0200] Completed "WebCalls" component. [2021-07-03 07:00:14 +0200] Performing "PublicContact" component.... [2021-07-03 07:00:14 +0200] Completed "PublicContact" component. [2021-07-03 07:00:14 +0200] Performing "MailLimits" component.... [2021-07-03 07:00:14 +0200] Completed "MailLimits" component. [2021-07-03 07:00:14 +0200] Performing "LinkedNodes" component.... [2021-07-03 07:00:14 +0200] Completed "LinkedNodes" component. [2021-07-03 07:00:14 +0200] Creating Archive ........................ [2021-07-03 07:00:19 +0200] Done [2021-07-03 07:00:19 +0200] pkgacctfile is: /backup/2021-07-03/accounts/*****.tar.gz [2021-07-03 07:00:19 +0200] [2021-07-03 07:00:19 +0200] size is: 68444600 [2021-07-03 07:00:19 +0200] [2021-07-03 07:00:19 +0200] homesize is: 163880960 [2021-07-03 07:00:19 +0200] [2021-07-03 07:00:19 +0200] homefiles is: 5755 [2021-07-03 07:00:19 +0200] [2021-07-03 07:00:19 +0200] mysqlsize is: 2214709 [2021-07-03 07:00:19 +0200] pkgacct completed [2021-07-03 07:00:19 +0200] info [backup] Successfully backed up account "*****" to "/backup/2021-07-03/accounts" [2021-07-03 07:00:19 +0200] info [backup] Adding metadata information for ***** to backup at /backup/2021-07-03 [2021-07-03 07:00:19 +0200] info [backup] Queuing daily backup copy of "*****" for transport of "/backup/2021-07-03/accounts/*****.tar.gz" to "2021-07-03/accounts/*****.tar.gz" [2021-07-03 07:00:19 +0200] info [backup] This particular transport will be queued with keep_local = 0, based on the need to copy weekly () and/or monthly () copies as well. [2021-07-03 07:00:19 +0200] info [backup] Queuing transport of file: /backup/2021-07-03/accounts/*****.tar.gz [2021-07-03 07:00:19 +0200] info [backup] no_transport = 0 .. and queueid = TQ:TaskQueue:16000 [2021-07-03 07:00:19 +0200] info [backup] leaving queue_backup_transport_item [2021-07-03 07:00:19 +0200] info [backup] checking backup for ***** [2021-07-03 07:00:19 +0200] info [backup] Backups ARE enabled for ***** [2021-07-03 07:00:19 +0200] info [backup] Calling pkgacct under cpuwatch to backup user "*****" [2021-07-03 07:00:19 +0200] pkgacct started. [2021-07-03 07:00:19 +0200] pkgacct version 10 - user : ***** - tarball: 1 - target mysql : default - split: 0 - incremental: 0 - homedir: 1 - mailman: 1 - backup: 1 - archive version: 4 - running with uid 0 [2021-07-03 07:00:19 +0200] pkgacct using '/usr/local/cpanel/3rdparty/bin/pigz -6 --processes 1 --blocksize 4096 --rsyncable' to compress archives [2021-07-03 07:00:19 +0200] pkgacct working dir : /backup/2021-07-03/accounts/***** [2021-07-03 07:00:19 +0200] Copying Reseller Config...[2021-07-03 07:00:19 +0200] Done [2021-07-03 07:00:19 +0200] Copying Suspension Info (if needed)...[2021-07-03 07:00:19 +0200] Done [2021-07-03 07:00:19 +0200] Copying installed SSL certificates and keys...[2021-07-03 07:00:19 +0200] Performing "ApacheTLS" component.... [2021-07-03 07:00:19 +0200] Completed "ApacheTLS" component. [2021-07-03 07:00:19 +0200] Done [2021-07-03 07:00:19 +0200] Copying DKIM keys....[2021-07-03 07:00:19 +0200] Done [2021-07-03 07:00:19 +0200] Copying Bandwidth Data....[2021-07-03 07:00:19 +0200] Performing "Bandwidth" component.... Summary databases " done! [2021-07-03 07:00:19 +0200] Completed "Bandwidth" component. [2021-07-03 07:00:19 +0200] Done [2021-07-03 07:00:19 +0200] Copying Dns Zones.......*****.com...[2021-07-03 07:00:19 +0200] Done [2021-07-03 07:00:19 +0200] Copying Mail files....[2021-07-03 07:00:19 +0200] Performing "MailConfig" component.... [2021-07-03 07:00:19 +0200] Completed "MailConfig" component. [2021-07-03 07:00:19 +0200] Done [2021-07-03 07:00:19 +0200] Copying proftpd file....[2021-07-03 07:00:19 +0200] Done [2021-07-03 07:00:19 +0200] Copy userdata...[2021-07-03 07:00:19 +0200] Done [2021-07-03 07:00:19 +0200] Copy custom virtualhost templates...[2021-07-03 07:00:19 +0200] Done [2021-07-03 07:00:19 +0200] Copying mailman lists and archives....Done copying mailman lists and archives. [2021-07-03 07:00:19 +0200] Copying homedir............. [2021-07-03 07:00:19 +0200] Done [2021-07-03 07:00:19 +0200] Fixing up EA4 .htaccess blocks: /home/*****/public_html/.htaccess Done. [2021-07-03 07:00:19 +0200] Performing "Mysql" component.... Load watching suspended due to SIGUSR1 [2021-07-03 07:00:19 +0200] Determining mysql dbs...[2021-07-03 07:00:19 +0200] ...mysqldump version: 10.3.30...[2021-07-03 07:00:19 +0200] ...mysql version: 10.3...[2021-07-03 07:00:19 +0200] Saving mysql privs...[2021-07-03 07:00:19 +0200] Done [2021-07-03 07:00:19 +0200] Saving mysql authentication information...[2021-07-03 07:00:19 +0200] Done [2021-07-03 07:00:19 +0200] Storing MySQL databases...[2021-07-03 07:00:19 +0200] Storing database ***** [2021-07-03 07:00:19 +0200] Done [2021-07-03 07:00:19 +0200] ...Done [2021-07-03 07:00:19 +0200] ...Done [2021-07-03 07:00:19 +0200] Completed "Mysql" component. Load watching resumed due to SIGUSR2 [2021-07-03 07:00:19 +0200] Performing "MysqlRemoteNotes" component.... [2021-07-03 07:00:19 +0200] Completed "MysqlRemoteNotes" component. [2021-07-03 07:00:19 +0200] Performing "CpUserFile" component.... [2021-07-03 07:00:19 +0200] Completed "CpUserFile" component. [2021-07-03 07:00:19 +0200] Performing "Cron" component.... [2021-07-03 07:00:19 +0200] No readable crontab file found. [2021-07-03 07:00:19 +0200] Completed "Cron" component. [2021-07-03 07:00:19 +0200] Performing "Quota" component.... [2021-07-03 07:00:19 +0200] Completed "Quota" component. [2021-07-03 07:00:19 +0200] Performing "Integration" component.... [2021-07-03 07:00:19 +0200] Completed "Integration" component. [2021-07-03 07:00:19 +0200] Performing "AuthnLinks" component.... [2021-07-03 07:00:19 +0200] Completed "AuthnLinks" component. [2021-07-03 07:00:19 +0200] Performing "APITokens" component.... [2021-07-03 07:00:19 +0200] Completed "APITokens" component. [2021-07-03 07:00:19 +0200] Performing "DNSSEC" component.... [2021-07-03 07:00:19 +0200] Completed "DNSSEC" component. [2021-07-03 07:00:19 +0200] Performing "Custom" component.... [2021-07-03 07:00:19 +0200] No custom components to perform. [2021-07-03 07:00:19 +0200] Completed "Custom" component. [2021-07-03 07:00:19 +0200] Performing "AutoSSL" component.... [2021-07-03 07:00:19 +0200] Completed "AutoSSL" component. [2021-07-03 07:00:19 +0200] Storing Subdomains.... [2021-07-03 07:00:19 +0200] Done [2021-07-03 07:00:19 +0200] Storing Parked Domains.... [2021-07-03 07:00:19 +0200] Done [2021-07-03 07:00:19 +0200] Storing Addon Domains.... [2021-07-03 07:00:19 +0200] Performing "Password" component.... [2021-07-03 07:00:19 +0200] Completed "Password" component. [2021-07-03 07:00:19 +0200] Performing "DigestShadow" component.... [2021-07-03 07:00:19 +0200] Completed "DigestShadow" component. [2021-07-03 07:00:19 +0200] Copying shell.......[2021-07-03 07:00:19 +0200] Done [2021-07-03 07:00:19 +0200] Performing "WebCalls" component.... [2021-07-03 07:00:19 +0200] Completed "WebCalls" component. [2021-07-03 07:00:19 +0200] Performing "PublicContact" component.... [2021-07-03 07:00:19 +0200] Completed "PublicContact" component. [2021-07-03 07:00:19 +0200] Performing "MailLimits" component.... [2021-07-03 07:00:19 +0200] Completed "MailLimits" component. [2021-07-03 07:00:19 +0200] Performing "LinkedNodes" component.... [2021-07-03 07:00:19 +0200] Completed "LinkedNodes" component. [2021-07-03 07:00:19 +0200] Creating Archive .................................................................................... ........................................
You can see in the last line that not complete the backup. Thank you very much. Have a nice day. Note: sorry my bad english.0 -
You've posted many times and I've always thought your English is just fine! This is the type of issue we might just need a ticket to examine. If possible we could run the backup at a specific time and watch the server to see how it behaves and if the problem happens again, as those logs do not show anything that would be a problem, except the backup just stopping. It's possible there could be useful data in /var/log/messages on the system, as that file could report problems with the server itself. 0 -
You've posted many times and I've always thought your English is just fine! This is the type of issue we might just need a ticket to examine. If possible we could run the backup at a specific time and watch the server to see how it behaves and if the problem happens again, as those logs do not show anything that would be a problem, except the backup just stopping. It's possible there could be useful data in /var/log/messages on the system, as that file could report problems with the server itself.
Thank you very much. The sysadmin checked various file logs but not found relevant data, only have normal logs. I will copy you some logs here: [QUOTE] Jul 3 07:05:54 ***** kernel: Firewall: *TCP6IN Blocked* IN=eth0 OUT= MAC=***** SRC=***** DST=***** LEN=60 TC=0 HOPLIMIT=55 FLOWLBL=0 PROTO=TCP SPT=443 DPT=17668 WINDOW=0 RES=0x00 RST URGP=0 Jul 3 07:05:55 ***** kernel: Firewall: *TCP_IN Blocked* IN=eth0 OUT= MAC=***** SRC=***** LEN=40 TOS=0x00 PREC=0x00 TTL=51 ID=0 DF PROTO=TCP SPT=52222 DPT=443 WINDOW=0 RES=0x00 RST URGP=0 Jul 3 07:06:01 ***** systemd: Started Session c129074 of user root. Jul 3 07:06:01 ***** systemd: Started Session c129075 of user root. Jul 3 07:06:01 ***** systemd: Started Session c129076 of user root. Jul 3 07:06:01 ***** systemd: Started Session c129077 of user root. Jul 3 07:06:01 ***** systemd: Started Session c129078 of user root. Jul 3 07:06:01 ***** systemd: Started Session c129079 of user root. Jul 3 07:06:01 ***** systemd: Started Session c129080 of user root.
[QUOTE] Jun 27 03:48:48 ***** kernel: lsphp invoked oom-killer: gfp_mask=0xd0, order=0, oom_score_adj=0 Jun 27 03:48:48 ***** kernel: lsphp cpuset=/ mems_allowed=0 Jun 27 03:48:48 ***** kernel: CPU: 1 PID: 2767758 Comm: lsphp ve: 0 Kdump: loaded Tainted: G O ------------ 3.10.0-962.3.2.lve1.5.56.el7.x86_64 #1 61.16 Jun 27 03:48:48 ***** kernel: Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C246D4U2-2T, BIOS L2.02K 12/18/2019 Jun 27 03:48:48 ***** kernel: Call Trace: Jun 27 03:48:48 ***** kernel: [] dump_stack+0x19/0x1b Jun 27 03:48:48 ***** kernel: [] dump_header+0x90/0x229 Jun 27 03:48:48 ***** kernel: [] oom_kill_process+0x5e8/0x640 Jun 27 03:48:48 ***** kernel: [] ? get_task_oom_score_adj+0xee/0x100 Jun 27 03:48:48 ***** kernel: [] mem_cgroup_oom_synchronize+0x4a9/0x500 Jun 27 03:48:48 ***** kernel: [] pagefault_out_of_memory+0x13/0x50 Jun 27 03:48:48 ***** kernel: [] mm_fault_error+0x6a/0x157 Jun 27 03:48:48 ***** kernel: [] __do_page_fault+0x496/0x4f0 Jun 27 03:48:48 ***** kernel: [] do_page_fault+0x35/0x90 Jun 27 03:48:48 ***** kernel: [] page_fault+0x28/0x30 Jun 27 03:48:48 ***** kernel: Task in /lve1171 killed as a result of limit of /lve1171 Jun 27 03:48:48 ***** kernel: memory: usage 1048576kB, limit 1048576kB, failcnt 1200687 Jun 27 03:48:48 ***** kernel: memory+swap: usage 1048576kB, limit 9007199254740988kB, failcnt 0 Jun 27 03:48:48 ***** kernel: kmem: usage 0kB, limit 9007199254740988kB, failcnt 0 Jun 27 03:48:48 ***** kernel: Memory cgroup stats for /lve1171: rss_huge:0KB mapped_file:4KB shmem:4KB slab_unreclaimable:0KB swap:0KB cache:200KB rss:1048376KB slab_reclaimable:0KB inactive_anon:225924KB active_anon:822348KB inactive_file:56KB active_file:48KB unevictable:0KB Jun 27 03:48:48 ***** kernel: Memory cgroup out of memory: Kill process 2767264 (lsphp) score 170 or sacrifice child Jun 27 03:48:48 ***** kernel: Killed process 2767264 (lsphp) in VE "0" total-vm:551316kB, anon-rss:169860kB, file-rss:8464kB, shmem-rss:4kB
[QUOTE] Jun 27 04:00:09 ***** lfd[1344043]: SYSLOG check [YgKwh8bOQ9Cwv5qOIiks] Jun 27 04:00:18 ***** pure-ftpd: (?@127.0.0.1) [INFO] New connection from 127.0.0.1 Jun 27 04:00:18 ***** pure-ftpd: (?@127.0.0.1) [INFO] __cpanel__service__auth__ftpd__ReORUel6uXoEzg56 is now logged in Jun 27 04:00:18 ***** pure-ftpd: (__cpanel__service__auth__ftpd__ReORUel6uXoEzg56@127.0.0.1) [INFO] Logout.
[QUOTE] Jun 29 08:11:27 ***** kernel: Mem-Info: Jun 29 08:11:27 ***** kernel: active_anon:1218718 inactive_anon:225813 isolated_anon:0#012 active_file:15512559 inactive_file:14285582 isolated_file:0#012 unevictable:0 dirty:92148 writeback:32750 wbtmp:0 unstable:0#012 slab_reclaimable:1218529 slab_unreclaimable:38508#012 mapped:41772 shmem:108654 pagetables:10863 bounce:0#012 free:158855 free_pcp:4117 free_cma:0 Jun 29 08:11:27 ***** kernel: Node 0 DMA free:15816kB min:4kB low:4kB high:4kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15992kB managed:15900kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:84kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes Jun 29 08:11:27 ***** kernel: lowmem_reserve[]: 0 1541 128492 128492 Jun 29 08:11:27 ***** kernel: Node 0 DMA32 free:507932kB min:784kB low:980kB high:1176kB active_anon:24136kB inactive_anon:42612kB active_file:316948kB inactive_file:302936kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:1816760kB managed:1578576kB mlocked:0kB dirty:2116kB writeback:1520kB mapped:2028kB shmem:3656kB slab_reclaimable:364972kB slab_unreclaimable:4372kB kernel_stack:176kB pagetables:876kB unstable:0kB bounce:0kB free_pcp:8376kB local_pcp:224kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no Jun 29 08:11:27 ***** kernel: lowmem_reserve[]: 0 0 126950 126950 Jun 29 08:11:27 ***** kernel: Node 0 Normal free:111672kB min:64740kB low:80924kB high:97108kB active_anon:4850736kB inactive_anon:860640kB active_file:61733288kB inactive_file:56839392kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:132112384kB managed:129997652kB mlocked:0kB dirty:366476kB writeback:129480kB mapped:165060kB shmem:430960kB slab_reclaimable:4509144kB slab_unreclaimable:149576kB kernel_stack:10896kB pagetables:42576kB unstable:0kB bounce:0kB free_pcp:8084kB local_pcp:292kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no Jun 29 08:11:27 ***** kernel: lowmem_reserve[]: 0 0 0 0 Jun 29 08:11:27 ***** kernel: Node 0 DMA: 0*4kB 1*8kB (U) 0*16kB 0*32kB 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15816kB Jun 29 08:11:27 ***** kernel: Node 0 DMA32: 668*4kB (UEM) 8919*8kB (UEM) 3930*16kB (UEM) 2462*32kB (UEM) 1107*64kB (EM) 116*128kB (UEM) 18*256kB (UEM) 63*512kB (UE) 38*1024kB (UEM) 16*2048kB (UE) 24*4096kB (UEM) = 508232kB Jun 29 08:11:27 ***** kernel: Node 0 Normal: 19040*4kB (UEM) 4400*8kB (UEM) 1*16kB (U) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 111376kB Jun 29 08:11:27 ***** kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Jun 29 08:11:27 ***** kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Jun 29 08:11:27 ***** kernel: 29906802 total pagecache pages Jun 29 08:11:27 ***** kernel: 4 pages in swap cache Jun 29 08:11:27 ***** kernel: Swap cache stats: add 402, delete 398, find 8699/8767 Jun 29 08:11:27 ***** kernel: Free swap = 1043192kB Jun 29 08:11:27 ***** kernel: Total swap = 1046520kB Jun 29 08:11:27 ***** kernel: kworker/u32:0: page allocation failure: order:2, mode:0x4020 Jun 29 08:11:27 ***** kernel: CPU: 5 PID: 916186 Comm: kworker/u32:0 ve: 0 Kdump: loaded Tainted: G OE ------------ 3.10.0-962.3.2.lve1.5.56.el7.x86_64 #1 61.16 Jun 29 08:11:27 ***** kernel: Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C246D4U2-2T, BIOS L2.02K 12/18/2019 Jun 29 08:11:27 ***** kernel: Workqueue: writeback bdi_writeback_workfn (flush-9:2) Jun 29 08:11:27 ***** kernel: Call Trace: Jun 29 08:11:27 ***** kernel: [] dump_stack+0x19/0x1b Jun 29 08:11:27 ***** kernel: [] warn_alloc_failed+0x110/0x180 Jun 29 08:11:27 ***** kernel: [] ? update_curr+0x137/0x1f0 Jun 29 08:11:27 ***** kernel: [] __alloc_pages_slowpath+0x677/0x78c Jun 29 08:11:27 ***** kernel: [] ? ttwu_do_wakeup+0x19/0xe0 Jun 29 08:11:27 ***** kernel: [] __alloc_pages_nodemask+0x5d5/0x600 Jun 29 08:11:27 ***** kernel: [] alloc_pages_current+0x98/0x110 Jun 29 08:11:27 ***** kernel: [] kmalloc_order+0x18/0x40 Jun 29 08:11:27 ***** kernel: [] kmalloc_order_trace+0x26/0xa0 Jun 29 08:11:27 ***** kernel: [] __kmalloc+0x281/0x2a0 Jun 29 08:11:27 ***** kernel: [] nvme_queue_rq+0xb4/0x8d0 [nvme] Jun 29 08:11:27 ***** kernel: [] ? sbitmap_get+0x5d/0xb0 Jun 29 08:11:27 ***** kernel: [] ? __sbitmap_queue_get+0x2b/0xb0 Jun 29 08:11:27 ***** kernel: [] ? __blk_mq_get_tag+0x21/0x90 Jun 29 08:11:27 ***** kernel: [] ? blk_mq_get_tag+0xc3/0x2a0 Jun 29 08:11:27 ***** kernel: [] ? wake_up_atomic_t+0x30/0x30 Jun 29 08:11:27 ***** kernel: [] __blk_mq_try_issue_directly+0x196/0x1e0 Jun 29 08:11:27 ***** kernel: [] blk_mq_try_issue_directly+0x67/0x80 Jun 29 08:11:27 ***** kernel: [] blk_mq_make_request+0x434/0x5d0 Jun 29 08:11:27 ***** kernel: [] generic_make_request+0x10b/0x320 Jun 29 08:11:27 ***** kernel: [] raid1_unplug+0x11e/0x160 [raid1] Jun 29 08:11:27 ***** kernel: [] blk_flush_plug_list+0xa7/0x230 Jun 29 08:11:27 ***** kernel: [] ? bit_wait+0x50/0x50 Jun 29 08:11:27 ***** kernel: [] io_schedule_timeout+0x128/0x130 Jun 29 08:11:27 ***** kernel: [] io_schedule+0x18/0x20 Jun 29 08:11:27 ***** kernel: [] bit_wait_io+0x11/0x50 Jun 29 08:11:27 ***** kernel: [] __wait_on_bit+0x67/0x90 Jun 29 08:11:27 ***** kernel: [] ? bit_wait+0x50/0x50 Jun 29 08:11:27 ***** kernel: [] out_of_line_wait_on_bit+0x81/0xb0 Jun 29 08:11:27 ***** kernel: [] ? wake_bit_function+0x40/0x40 Jun 29 08:11:27 ***** kernel: [] __wait_on_buffer+0x2a/0x30 Jun 29 08:11:27 ***** kernel: [] ext4_wait_block_bitmap+0xd0/0xe0 [ext4] Jun 29 08:11:27 ***** kernel: [] ext4_mb_init_cache+0x226/0x6e0 [ext4] Jun 29 08:11:27 ***** kernel: [] ? lru_cache_add+0xe/0x10 Jun 29 08:11:27 ***** kernel: [] ext4_mb_load_buddy_gfp+0x2b1/0x340 [ext4] Jun 29 08:11:27 ***** kernel: [] ext4_mb_find_by_goal+0xb7/0x340 [ext4] Jun 29 08:11:27 ***** kernel: [] ? raid1_write_request+0x5de/0xa10 [raid1] Jun 29 08:11:27 ***** kernel: [] ext4_mb_regular_allocator+0x73/0x480 [ext4] Jun 29 08:11:27 ***** kernel: [] ? __find_get_block+0xbc/0x120 Jun 29 08:11:27 ***** kernel: [] ext4_mb_new_blocks+0x6b3/0xaf0 [ext4] Jun 29 08:11:27 ***** kernel: [] ? __kmalloc+0x24d/0x2a0 Jun 29 08:11:27 ***** kernel: [] ? ext4_ext_find_extent+0x12c/0x2e0 [ext4] Jun 29 08:11:27 ***** kernel: [] ext4_ext_map_blocks+0x4a6/0xfc0 [ext4] Jun 29 08:11:27 ***** kernel: [] ext4_map_blocks+0x136/0x6a0 [ext4] Jun 29 08:11:27 ***** kernel: [] ext4_writepages+0x6ca/0xd40 [ext4] Jun 29 08:11:27 ***** kernel: [] do_writepages+0x21/0x50 Jun 29 08:11:27 ***** kernel: [] __writeback_single_inode+0x7f/0x430 Jun 29 08:11:27 ***** kernel: [] writeback_sb_inodes+0x231/0x590 Jun 29 08:11:27 ***** kernel: [] __writeback_inodes_wb+0x9f/0xd0 Jun 29 08:11:27 ***** kernel: [] wb_writeback+0x263/0x320 Jun 29 08:11:27 ***** kernel: [] ? get_nr_inodes+0x4c/0x70 Jun 29 08:11:27 ***** kernel: [] bdi_writeback_workfn+0x2e2/0x430 Jun 29 08:11:27 ***** kernel: [] process_one_work+0x182/0x440 Jun 29 08:11:27 ***** kernel: [] worker_thread+0x126/0x3c0 Jun 29 08:11:27 ***** kernel: [] ? manage_workers.isra.24+0x2a0/0x2a0 Jun 29 08:11:27 ***** kernel: [] kthread+0xd1/0xe0 Jun 29 08:11:27 ***** kernel: [] ? create_kthread+0x60/0x60 Jun 29 08:11:27 ***** kernel: [] ret_from_fork_nospec_begin+0x7/0x21 Jun 29 08:11:27 ***** kernel: [] ? create_kthread+0x60/0x60
Note: this logs not are created while the problem happens, this logs appear in other days/hours but we not found nothing more. Note: the server have 128GB RAM, and normally we use 10%-20%, have many free RAM always. Thank you again. Have a nice day.0 -
The memory issues in the second paste are related to the CloudLinux LVE tools killing off a process using too much RAM, so that isn't an overall issue with the server. I don't see anything in there that would indicate an obvious issue. It might be best to have someone watch the machine while the backups run to see if there are any issues that can be seen during that time. 0
Please sign in to leave a comment.
Comments
25 comments