Skip to main content

Backup to S3 not fully working

Addam12

Hi All,

Started using a bucket for additional locations and having an issue. Everything validates fine and the system file backups are transferred fine, but the actual accounts are not transferring off the server for some reason.

All cPanel backup files are correct on the server default dir such as system  and all accounts. Just the accounts aren't pushed to the s3 bucket. Looking at another of our servers it works fine with the same details, with cPanel backups disabled and using Jetbackup 5 with no issues.

Any help is greatly helpful.

Comments

3 comments

Date Votes
  • cPRex Jurassic Moderator

    Hey there!  Is this server that is having issues also using JetBackup?  If you're just using the normal cPanel backups you'd want to check the logs in /usr/local/cpanel/logs/cpbackup_transporter/ to see if there are any issues reported there as that is where we log the transfer of the backups to a remote location.

     

    0
  • Addam12

    Hi, It just time outs although the server files are moved but accounts aren't. Here is the log. Thanks

     

    [2024-09-26 02:23:10 -0500] info [cpbackup_transporter] Initializing log file
    [2024-09-26 02:23:10 -0500] info [cpbackup_transporter] cpbackup_transporter - parent starting
    [2024-09-26 02:23:10 -0500] info [cpbackup_transporter] cpbackup_transporter - child starting
    [2024-09-26 02:23:10 -0500] info [cpbackup_transporter] cPanel Backup Transporter Queue Daemon started.
    [2024-09-26 02:23:10 -0500] info [cpbackup_transporter] cpbackup_transporter - started
    [2024-09-26 02:23:10 -0500] info [cpbackup_transporter] cpbackup_transporter - Checking queue for tasks
    [2024-09-26 02:23:10 -0500] info [cpbackup_transporter] cpbackup_transporter - Processing next task
    [2024-09-26 02:23:10 -0500] info [cpbackup_transporter] Instantiating Object
    [2024-09-26 02:23:11 -0500] info [cpbackup_transporter] Starting a "copy" operation on the "offsite" destination ID "VtK5BttFGn60Kc5MkY3PPntE".
    [2024-09-26 02:23:37 -0500] info [cpbackup_transporter] cpbackup_transporter - Processing next task
    [2024-09-26 02:23:37 -0500] info [cpbackup_transporter] Instantiating Object
    [2024-09-26 02:23:37 -0500] info [cpbackup_transporter] Starting a "copy" operation on the "offsite" destination ID "VtK5BttFGn60Kc5MkY3PPntE".
    [2024-09-26 02:24:06 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 270s for new tasks
    [2024-09-26 02:24:36 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 240s for new tasks
    [2024-09-26 02:25:06 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 210s for new tasks
    [2024-09-26 02:25:36 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 180s for new tasks
    [2024-09-26 02:26:06 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 150s for new tasks
    [2024-09-26 02:26:36 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 120s for new tasks
    [2024-09-26 02:27:06 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 90s for new tasks
    [2024-09-26 02:27:36 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 60s for new tasks
    [2024-09-26 02:28:06 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 30s for new tasks
    [2024-09-26 02:28:36 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 0s for new tasks
    [2024-09-26 02:28:37 -0500] info [cpbackup_transporter] cpbackup_transporter - Exiting - the queue has been emptied; no more work to do after waiting for 300s
    [2024-09-26 02:28:37 -0500] info [cpbackup_transporter] cPanel Backup Transporter Queue Daemon is being stopped.
    [2024-09-26 02:30:54 -0500] info [cpbackup_transporter] Initializing log file
    [2024-09-26 02:30:54 -0500] info [cpbackup_transporter] cpbackup_transporter - parent starting
    [2024-09-26 02:30:54 -0500] info [cpbackup_transporter] cpbackup_transporter - child starting
    [2024-09-26 02:30:54 -0500] info [cpbackup_transporter] cPanel Backup Transporter Queue Daemon started.
    [2024-09-26 02:30:54 -0500] info [cpbackup_transporter] cpbackup_transporter - started
    [2024-09-26 02:30:54 -0500] info [cpbackup_transporter] cpbackup_transporter - Checking queue for tasks
    [2024-09-26 02:30:54 -0500] info [cpbackup_transporter] cpbackup_transporter - Processing next task
    [2024-09-26 02:30:54 -0500] info [cpbackup_transporter] Instantiating Object
    [2024-09-26 02:30:54 -0500] info [cpbackup_transporter] Starting a "copy" operation on the "offsite" destination ID "VtK5BttFGn60Kc5MkY3PPntE".
    [2024-09-26 02:30:59 -0500] info [cpbackup_transporter] cpbackup_transporter - Processing next task
    [2024-09-26 02:30:59 -0500] info [cpbackup_transporter] Instantiating Object
    [2024-09-26 02:30:59 -0500] info [cpbackup_transporter] Starting a "copy" operation on the "offsite" destination ID "VtK5BttFGn60Kc5MkY3PPntE".
    [2024-09-26 02:31:04 -0500] info [cpbackup_transporter] cpbackup_transporter - Processing next task
    [2024-09-26 02:31:04 -0500] info [cpbackup_transporter] Instantiating Object
    [2024-09-26 02:31:04 -0500] info [cpbackup_transporter] Starting a "copy" operation on the "offsite" destination ID "VtK5BttFGn60Kc5MkY3PPntE".
    [2024-09-26 02:31:07 -0500] info [cpbackup_transporter] cpbackup_transporter - Processing next task
    [2024-09-26 02:31:07 -0500] info [cpbackup_transporter] Instantiating Object
    [2024-09-26 02:31:07 -0500] info [cpbackup_transporter] Starting a "copy" operation on the "offsite" destination ID "VtK5BttFGn60Kc5MkY3PPntE".
    [2024-09-26 02:31:36 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 270s for new tasks
    [2024-09-26 02:32:06 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 240s for new tasks
    [2024-09-26 02:32:22 -0500] info [cpbackup_transporter] cpbackup_transporter - Processing next task
    [2024-09-26 02:32:22 -0500] info [cpbackup_transporter] Instantiating Object
    [2024-09-26 02:32:22 -0500] info [cpbackup_transporter] Starting a "copy" operation on the "offsite" destination ID "VtK5BttFGn60Kc5MkY3PPntE".
    [2024-09-26 02:32:25 -0500] info [cpbackup_transporter] cpbackup_transporter - Processing next task
    [2024-09-26 02:32:25 -0500] info [cpbackup_transporter] Instantiating Object
    [2024-09-26 02:32:25 -0500] info [cpbackup_transporter] Starting a "copy" operation on the "offsite" destination ID "VtK5BttFGn60Kc5MkY3PPntE".
    [2024-09-26 02:32:28 -0500] info [cpbackup_transporter] cpbackup_transporter - Processing next task
    [2024-09-26 02:32:28 -0500] info [cpbackup_transporter] Instantiating Object
    [2024-09-26 02:32:28 -0500] info [cpbackup_transporter] Starting a "copy" operation on the "offsite" destination ID "VtK5BttFGn60Kc5MkY3PPntE".
    [2024-09-26 02:32:57 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 270s for new tasks
    [2024-09-26 02:33:27 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 240s for new tasks
    [2024-09-26 02:33:30 -0500] info [cpbackup_transporter] cpbackup_transporter - Processing next task
    [2024-09-26 02:33:30 -0500] info [cpbackup_transporter] Instantiating Object
    [2024-09-26 02:33:30 -0500] info [cpbackup_transporter] Starting a "copy" operation on the "offsite" destination ID "VtK5BttFGn60Kc5MkY3PPntE".
    [2024-09-26 02:33:30 -0500] info [cpbackup_transporter] cpbackup_transporter - Processing next task
    [2024-09-26 02:33:30 -0500] info [cpbackup_transporter] Instantiating Object
    [2024-09-26 02:33:30 -0500] info [cpbackup_transporter] Starting a "copy_backup_metadata" operation on the "offsite" destination ID "VtK5BttFGn60Kc5MkY3PPntE".
    [2024-09-26 02:33:30 -0500] info [cpbackup_transporter] Asked to upload backup metadata file /home1/backup/2024-09-26/accounts/.master.meta to offsite , however this transport does not support that backup type
    [2024-09-26 02:33:30 -0500] info [cpbackup_transporter] cpbackup_transporter - Processing next task
    [2024-09-26 02:33:30 -0500] info [cpbackup_transporter] Instantiating Object
    [2024-09-26 02:33:30 -0500] info [cpbackup_transporter] Starting a "prune" operation on the "offsite" destination ID "VtK5BttFGn60Kc5MkY3PPntE".
    [2024-09-26 02:33:30 -0500] info [cpbackup_transporter] Performing prune operation, retaining 5 items on:  offsite
    [2024-09-26 02:33:31 -0500] info [cpbackup_transporter] Pruning backup directory:  /cpback/2024-09-07, from offsite
    [2024-09-26 02:33:34 -0500] info [cpbackup_transporter] cpbackup_transporter - Processing next task
    [2024-09-26 02:34:03 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 270s for new tasks
    [2024-09-26 02:34:33 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 240s for new tasks
    [2024-09-26 02:35:03 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 210s for new tasks
    [2024-09-26 02:35:33 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 180s for new tasks
    [2024-09-26 02:36:03 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 150s for new tasks
    [2024-09-26 02:36:33 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 120s for new tasks
    [2024-09-26 02:37:03 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 90s for new tasks
    [2024-09-26 02:37:33 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 60s for new tasks
    [2024-09-26 02:38:04 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 30s for new tasks
    [2024-09-26 02:38:34 -0500] info [cpbackup_transporter] cpbackup_transporter - Waiting up to 0s for new tasks
    [2024-09-26 02:38:35 -0500] info [cpbackup_transporter] cpbackup_transporter - Exiting - the queue has been emptied; no more work to do after waiting for 300s
    [2024-09-26 02:38:35 -0500] info [cpbackup_transporter] cPanel Backup Transporter Queue Daemon is being stopped.

    0
  • cPRex Jurassic Moderator

    I'm not seeing any timeouts in that log unless I overlooked something, but I think this line is the key to the issue:

    [2024-09-26 02:33:30 -0500] info [cpbackup_transporter] Asked to upload backup metadata file /home1/backup/2024-09-26/accounts/.master.meta to offsite , however this transport does not support that backup type

    If the same configuration is working well on other systems we'll likely need to have you create a ticket so this can be investigated.

    0

Please sign in to leave a comment.

Didn't find what you were looking for?

New post