Skip to main content

Task order on a live transfer

Esquio
Hi. I need to know the order what a live transfer from server to server does. I explain: I need to transfer an account that have 350 GB of email files on 49 email accounts. I need to transfer all this data to another server, but without losing the service in part of client. My question is what is the order of the tasks that live transfer does with the email accounts? The possibilities are:
  • Create all email accounts, and then transfer the email files. or
  • Create one email account, transfer its email files, and repeat with the next account.
I need the first option, the second option can be harmful to the account because while I transfer all the data, the old server will receive new emails. My plan is to set the MX record to the new server and set the mail on remote exchange, but if the accounts are not created yet the emails will be lost. It's because this reason why I need the first option: create all accounts on the first steps of the transfer, and then transfer all the email files. Can you tell me what is the real order that a live transfer does the tasks? Thank you so much.

Comments

25 comments

Date Votes
  • cPRex Jurassic Moderator
    Hey there! Live Transfer, and the Transfer Tool in general, uses option 1, where the cPanel account details are created and then the data is streamed from the home directory of the user account to the new server. It's always possible there will be updates on the Source machine that won't get carried over to the Destination, even when using Live Transfer. The Live Transfer proxies do get configured quickly, but there is still that potential for something to happen. Just be careful with your timing and planning so this work happens during non-peak hours for the account, and you should have a good experience.
    0
  • Esquio
    Thank you cPRex! There are all good news. I love transfer tool because makes my life easier, but I have a trouble with this account due the big amount of data and the old server have a mechanic HDD, so it's slower than the SSD on our new servers. I will solve the problem (I guess) starting the transfer and in the same moment when the target server has all the email accounts in the list, in the old server I will point the MX record on the DNS to the new server, and setup the remote exchanger on the mail configuration. I think this allows the clients to send mails through old server and new emails will receive in the new server during the transfer, but clients will not see the new emails until the transfer ends and the proxy configured. I think it's the best possibility, because I think about the imap-sync possibility (this involves usernames and passwords from 49 users, that they don't have need to be disturbed), and take down the service during the copy, but i think that the MX record is the best thing here. If you have any suggestions, I will appreciate. Regards.
    0
  • cPRex Jurassic Moderator
    I don't think you'll need to do anything manually if you're using Live Transfer, since the traffic will get proxied over. You'll just update the DNS when the transfer is complete and everything will either point to the new machine through the proxies or through actual DNS changes.
    0
  • Esquio
    I don't think you'll need to do anything manually if you're using Live Transfer, since the traffic will get proxied over. You'll just update the DNS when the transfer is complete and everything will either point to the new machine through the proxies or through actual DNS changes.

    But the traffic will be proxied once the copy is finished. During the copy, the problem are the mails that can be received on the old server, but the transfer tool can ignore depending on the files copied, so these few emails are possible to find on the old server, but not on the new server. It's because I try to ensure that zero new received emails will stored only on old server. If you tell me that the transfer tool tries to resync the new possible files, then it's a perfect solution. If this is not sure, the MX record pointing to new server seems to be better.
    0
  • cPRex Jurassic Moderator
    The Transfer Tool doesn't have a final sync option just yet. It's something we've talked about adding, but haven't decided just yet.
    0
  • Esquio
    Ok, thank you. The resync could be fantastic. Thanks for all the information on this post, it's soooo useful for me to make a decision about the method. Regards
    0
  • jpenner
    It would also be good if the account wasn't pointed at the new server until AFTER content is moved. On large accounts, it can mean a total unnecessary outage of a website for a long period (especially if there are a lot of files and it spends a LOT of time doing the incremental file list). This would definitely be made better by a final sync.
    0
  • Esquio
    It would also be good if the account wasn't pointed at the new server until AFTER content is moved. On large accounts, it can mean a total unnecessary outage of a website for a long period (especially if there are a lot of files and it spends a LOT of time doing the incremental file list). This would definitely be made better by a final sync.

    It works as this. While the account is transfered, the old website server still serve the page. When the transfer it's totally done, cPanel suspend the old account and creates a proxy to redirect requests, so there's no outage of websites.
    0
  • jpenner
    It works as this. While the account is transfered, the old website server still serve the page. When the transfer it's totally done, cPanel suspend the old account and creates a proxy to redirect requests, so there's no outage of websites.

    Not as far as I can tell. I've just used the Transfer Tool to move a dozen accounts and each one of them started serving the website from the new server before any content was sent over. So, if the transfer took 20 minutes, the website was offline for most of that.
    0
  • cPRex Jurassic Moderator
    That's odd - normally I would expect to see what @Esquio outlined. I'm assuming you had the Live Transfer option enabled?
    0
  • jpenner
    Yes, absolutely. It begins the process and at 18% it starts getting the file list from the source server but everything's now pointing to the new server with no content. Had an ugly one yesterday that was down for nearly 12 hours because of this.
    0
  • cPRex Jurassic Moderator
    I wasn't able to reproduce this with a test transfer I performed just now. Here is the full log: Remote Root Account Transfer Home / Transfers / Transfer Tool [Documentation] Warning: This system is not authoritative for the zone "transfertest.com". Warning: Contact "transfertest.com""s registrar and set that domain"s nameservers to "ns1.cprapid.com" and "ns2.cprapid.com". (For registrar information, visit https://client.rdap.org/?object=transfertest.com&type=domain.) Warning: You must also make "ns1.cprapid.com" and "ns2.cprapid.com" resolve to this server. Starting "RESTORE" for "Account" "transfertest". Restore File: /home/cpmove-transfertest.tar.gz.part00001 Restore Reseller Privs: no Restricted mode: no Live transfer: yes Target "/home" on host "10-2-35-244.cprapid.com" has 10.8 GB free and requires at least 1.79 MB free, which includes space for temporary files. Target "/home" on host "10-2-35-244.cprapid.com" has 10,261,850 inodes free and requires at least 68 inodes free, which includes space for temporary files. The "Reseller" restore module has the following areas disabled by request: "all" ArchiveManager Preparing archive for restoration " Calculating disk space needed " Done. Target "/home/cpanelpkgrestore.TMP.work.71ffb3f4/unsafe_to_read_archive" on host "10-2-35-244.cprapid.com" has 10.8 GB free and requires at least 24.31 KB free, which includes space for temporary files. This archive"s payload appears to be in the archive"s "cpmove-transfertest" directory. ArchiveManager The system successfully prepared the archive for restoration. PreRestoreActions PreRestoreActions Account Force Mode: no Dedicated IP Address: no Checking input data...Forced Dns is enabled. Validating Username......Done Validating IP......Done Validating Contact Email......Done ...Done Checking for database conflicts......Done Checking for account enhancements......Done WWWAcct 12.6.0 (c) 2022 cPanel, L.L.C.... +===================================+ | New Account Info | +===================================+ | Domain: transfertest.com | Ip: 10.2.35.244 (n) | HasCgi: n | UserName: transfertest | PassWord: HIDDEN | CpanelMod: jupiter | HomeRoot: /home | Quota: 0 bytes | NameServer1: ns1.cprapid.com | NameServer2: ns2.cprapid.com | NameServer3: | NameServer4: | Contact Email: | Package: default | Feature List: default | Account Enhancements: None | Language: en +===================================+ ...Done Custom Account Data Provided: no Running pre creation script (/usr/local/cpanel/scripts/prewwwacct)......Done Adding User...Removing Shell Access (n) Success...Done Adding Entries to userdata......Done Copying skel files from /root/cpanel3-skel/ to /home/transfertest/......Done Setting up Mail & Local Domains...localdomains...valiases ...vdomainaliases ...vfilters ......Done Configuring DNS...Zone transfertest.com has been successfully added ...Done Verifying MX Records and Setting up Databases...Reconfiguring Mail Routing: LOCAL MAIL EXCHANGER: This server will serve as a primary mail exchanger for transfertest.com's mail.: This configuration has been manually selected. ...Done Updating Authentication Databases......Done Setting passwords......Done Updating the userdata cache......Done Setting up Horde database in the background.......Done Creating bandwidth datastore......Done Updating the dedicated IP address usage cache......Done Generating and installing DKIM keys......Done Enabling Apache SpamAssassin"......Done Enabling Apache SpamAssassin" Spam Box......Done Sending Account Information......Done Running post creation scripts (/usr/local/cpanel/scripts/legacypostwwwacct, /usr/local/cpanel/scripts/postwwwacct, /usr/local/cpanel/scripts/postwwwacctuser)......Done wwwacct creation finished Account Creation Complete!!!...Account Creation Ok...Done Account Account created CpUser Restoring cPanel user file. Updating Caches " CpUser CpUser data restored Homedir Streaming home directory from source server " receiving incremental file list "100 % " sent 8.26K bytes received 62.19K bytes 46.96K bytes/sec total size is 1.62M speedup is 23.04 Homedir Homedir restored IPAddress IPAddress Package Package The package exists on the system. FeatureList FeatureList Feature list exists. Domains Retrieving and sanitizing main userdata " Parsing domain databases " "Subdomains" "ParkedDomains" "AddonDomains" Restoring Domains " Updating internal databases" Domains Domains restored OldHomedirs Linking old home directories OldHomedirs BrandCustomizations Restoring customization data BrandCustomizations Roundcube Roundcube MysqlRemoteNotes MysqlRemoteNotes Mysql Preparing MySQL restore " Restoring MySQL databases Restoring MySQL database mappings Restoring MySQL privileges Restoring MySQL grants Restoring MySQL access hosts Storing MySQL Grants Mysql AutoSSL AutoSSL BackupConfig Restoring backup config " Updated backup config for "transfertest". Restoring legacy backup config " Updated legacy backup config for "transfertest". BackupConfig CustomLocale CustomLocale OK DKIM DKIM DKIM restored DigestShadow DigestShadow Horde Restoring Horde (if any) Updating the horde configuration. Running database checks for 1 account(s) " Starting update of 1 user in parallel " ------------------------------------------------------------------------ Summary: Ran database checks on 1 account(s). There were 0 accounts with failures during this process (see above): n/a There were 1 accounts successfully processed: transfertest There were 0 accounts that did not need any work done: n/a Fixing hostnames: source.domain.com => 10-2-35-244.cprapid.com. Horde Integration Integration LinkedNodesSubarchives LinkedNodesSubarchives Logs Logs Mail Restoring Mail files Resetting Quotas to sane values Mail MailFix Fixing mail permissions Converting to maildir if needed MailFix MailLimits Restoring mail limits (if any) MailLimits Mailman Restoring Mailman lists Mailman Mailman Restored NobodyFiles NobodyFiles Password Restoring password " Password for "transfertest" has been changed. Password Postgres Preparing PostgreSQL restore " This archive contains no PostgreSQL data. Postgres PublicContact PublicContact PublicHtmlSymlinks PublicHtmlSymlinks Shell Restoring shell Setting the user"s shell to "/bin/bash" " Shell SpamAssassin SpamAssassin Ran SpamAssassin check Subaccount Subaccount Ran Subaccount database checks Unsuspend Unsuspending .htaccess files for domains transfertest.com. Unsuspend VhostIncludes Restoring custom virtualhost templates" VhostIncludes WebCalls WebCalls WebDiskHomedir WebDiskHomedir userdata Restoring userdata" Restoring userdata for "transfertest.com" " userdata Cron Restoring crontab Cron Ftp Restoring ftp password file Resyncing FTP Passwords 0 Ftp Htaccess Looking for ".htaccess" files " Updating "transfertest""s ".htaccess" files " Updating the system"s web virtual host configuration cache and ".htaccess" files " Repairing "/home/transfertest/public_html/.htaccess" for EasyApache 4 " The system mapped "/home/transfertest/public_html/.htaccess" to the virtual host "transfertest.com" " Htaccess EasyApache4 was repaired in .htaccess files. SSL The SSL certificate is now installed onto the domain "transfertest.com" using the IP address "10.2.35.244". SSL LocalConfig LocalConfig Vhosts Refreshing vhosts and restarting apache Vhosts ZoneFile Restoring DNS zones Fetching existing zones. Restoring zone: "transfertest.com". Local Zone Updates: "transfertest.com" ZoneFile DNSSEC DNSSEC MailRouting Update mail routing LOCAL MAIL EXCHANGER: This server will serve as a primary mail exchanger for transfertest.com's mail.This configuration has been manually selected. MailRouting SPF Updating SPF Records SPF ProxySubdomains Update service subdomains for "transfertest". transfertest.com [REMOVE:A@autodiscover:10.2.35.244, REMOVE:SRV@_carddavs._tcp:0 0 2080 source.domain.com., REMOVE:TXT@_carddavs._tcp:path=/, REMOVE:A@autoconfig:10.2.35.244, REMOVE:SRV@_caldav._tcp:0 0 2079 source.domain.com., REMOVE:TXT@_caldav._tcp:path=/, REMOVE:SRV@_autodiscover._tcp:0 0 443 cpanelemaildiscovery.cpanel.net., REMOVE:SRV@_carddav._tcp:0 0 2079 source.domain.com., REMOVE:TXT@_carddav._tcp:path=/, REMOVE:SRV@_caldavs._tcp:0 0 2080 source.domain.com., REMOVE:TXT@_caldavs._tcp:path=/] ProxySubdomains PublishZones Altering sourcedomain.com"s "transfertest" account " Pointing "transfertest.com""s DNS records to the new server " " [xferpoint] server:source.domain.com user:transfertest [xferpoint] Per request, skipping creation of dynamic content block. [xferpoint] Updating IP addresses in DNS " The system updated "11" entries. [xferpoint] Setting nameservers (ns1.cprapid.com ns2.cprapid.com) " [xferpoint] complete Done Updating mail routing on the source server " " Setting mail handling for transfertest.com to : secondary Done Disabling logins on the source server " " Locking password for user transfertest. passwd: Success Updating FTP passwords for transfertest FTP password files updated. FTP vhost passwords synced Done Syncing zones to the dns cluster Cluster Zone Updates: "transfertest.com" Reloading zones PublishZones DNSAuthority This system is not authoritative for the zone "transfertest.com". Local zone"s nameservers: ns1.cprapid.com, ns2.cprapid.com "ns1.cprapid.com" does not resolve to the local server. "ns2.cprapid.com" does not resolve to the local server. "transfertest.com""s public nameservers: ns1.namebrightdns.com, ns2.namebrightdns.com Contact "transfertest.com""s registrar and set that domain"s nameservers to "ns1.cprapid.com" and "ns2.cprapid.com". (For registrar information, visit https://client.rdap.org/?object=transfertest.com&type=domain.) You must also make "ns1.cprapid.com" and "ns2.cprapid.com" resolve to this server. DNSAuthority ManualMX Configuring manual MX entries on the source server (sourcedomain.com) " ManualMX Manual MX entries configured. ResyncHomedir Streaming home directory from source server " receiving incremental file list "100 % " sent 7.99K bytes received 21.76K bytes 19.83K bytes/sec total size is 1.62M speedup is 54.57 ResyncHomedir Homedir restored ServiceProxy Configuring the source server (sourcedomain.com) to proxy services to the new account " Terminating "transfertest""s mailbox sessions on "sourcedomain.com" " ServiceProxy MailSync MailSync FileProtect FileProtect PostRestoreActions Updating Caches " Enabling IPv6 for account " Updating Nameserver IP Address Report Syncing contact information PostRestoreActions Quota Restoring quota Quota APITokens APITokens AuthnLinks AuthnLinks LinkedNodes LinkedNodes BandwidthData Restoring Bandwidth Data BandwidthData Suspend The user "transfertest" was not suspended. The system will not suspend the restored user. Suspend Removing copied archive "/home/cpmove-transfertest.tar.gz.part00001" from the local server " Success.
    The portion of the Live Transfer log that changes the service routing is PublishZone, and if you put all of that code into a text editor that happens in line 210. The Homedir section where the initial data is streamed between the two machines is line 41. If you could open a ticket with our team we'd be interested in reviewing the specific transfer on your system to see if something went wrong.
    0
  • jpenner
    Where can I find that logging? What I see running viewtransfer doesn't format that way.
    0
  • cPRex Jurassic Moderator
    If you visit WHM >> Review Transfers and Restores you should be able to click the log and see the full log entries from there.
    0
  • jpenner
    Thank you. Here is the log for the site I mentioned (names changed to protect the innocent). Right after pktacct completed, I am guessing is about 18% through the process and where it begins to receive the incremental file list (which takes a long time with a lot of files). At this point, the DNS is pointing to the new server. Perhaps I'm doing this wrong? I'm running the transfer tool from the destination server in WHM (and confirmed that Live Transfer is on). Also for clarification, the process after "pkgacct completed" took 19 hours (it should add a timestamp at completion for the logs) Now you have me wondering... All of my servers use the same nameservers on a DNS cluster. They are 3 nameservers running WHM cPanel only. Are they getting the update too soon perhaps? Starting "TRANSFER" for "Account" "accounttotransfer". Copy Destination: /home Remote server type: "WHM1164". Initiating a remote API (Application Programming Interface) connection in order to package the account in a background process " [2022-08-03 09:33:13 -0700] pkgacct started. [2022-08-03 09:33:13 -0700] pkgacct version 10 - user : accounttotransfer - tarball: 1 - target mysql : 5.7 - split: 1 - incremental: 0 - homedir: 0 - mailman: 1 - backup: 0 - archive version: 4 - running with uid 0 [2022-08-03 09:33:13 -0700] pkgacct using '/usr/local/cpanel/3rdparty/bin/pigz -6 --processes 1 --blocksize 128 --rsyncable' to compress archives [2022-08-03 09:33:13 -0700] pkgacct -- attempting to use daily backup to create an account package [2022-08-03 09:33:13 -0700] pkgacct -- could not use daily backup because no daily incremental backup for user accounttotransfer can be found ( check if daily incremental backups are enabled ) [2022-08-03 09:33:13 -0700] pkgacct working dir : /home/cpmove-accounttotransfer [2022-08-03 09:33:13 -0700] Copying Reseller Config... [2022-08-03 09:33:13 -0700] Done [2022-08-03 09:33:13 -0700] Copying Suspension Info (if needed)... [2022-08-03 09:33:13 -0700] Done [2022-08-03 09:33:13 -0700] Copying installed SSL certificates and keys... [2022-08-03 09:33:13 -0700] Performing "ApacheTLS" component.... [2022-08-03 09:33:13 -0700] Completed "ApacheTLS" component. [2022-08-03 09:33:13 -0700] Done [2022-08-03 09:33:13 -0700] Copying DKIM keys.... [2022-08-03 09:33:13 -0700] Done [2022-08-03 09:33:13 -0700] Copying Bandwidth Data.... [2022-08-03 09:33:13 -0700] Performing "Bandwidth" component.... [2022-08-03 09:33:13 -0700] Summary databases " [2022-08-03 09:33:15 -0700] done! [2022-08-03 09:33:15 -0700] Completed "Bandwidth" component. [2022-08-03 09:33:15 -0700] Done [2022-08-03 09:33:15 -0700] Copying Dns Zones.... [2022-08-03 09:33:15 -0700] ...sitetotransfer.com... [2022-08-03 09:33:15 -0700] Done [2022-08-03 09:33:15 -0700] Copying Mail files.... [2022-08-03 09:33:15 -0700] Performing "MailConfig" component.... [2022-08-03 09:33:15 -0700] Completed "MailConfig" component. [2022-08-03 09:33:15 -0700] Done [2022-08-03 09:33:15 -0700] Copying proftpd file.... [2022-08-03 09:33:15 -0700] Done [2022-08-03 09:33:15 -0700] Performing "Logs" component.... [2022-08-03 09:33:15 -0700] ...log file sizes [49500 byte(s)]... [2022-08-03 09:33:15 -0700] ...sitetotransfer.com-ssl_log... [2022-08-03 09:33:15 -0700] ...sitetotransfer.com-bytes_log... [2022-08-03 09:33:15 -0700] ...sitetotransfer.com... [2022-08-03 09:33:15 -0700] Completed "Logs" component. [2022-08-03 09:33:15 -0700] Copy userdata... [2022-08-03 09:33:15 -0700] Done [2022-08-03 09:33:15 -0700] Copy custom virtualhost templates... [2022-08-03 09:33:15 -0700] Done [2022-08-03 09:33:15 -0700] Copying mailman lists and archives.... [2022-08-03 09:33:15 -0700] Done copying mailman lists and archives. [2022-08-03 09:33:15 -0700] Performing "Postgresql" component.... [2022-08-03 09:33:15 -0700] Completed "Postgresql" component. [2022-08-03 09:33:15 -0700] Performing "Mysql" component.... [2022-08-03 09:33:15 -0700] Determining mysql dbs... [2022-08-03 09:33:15 -0700] ...mysqldump version: 5.6.51... [2022-08-03 09:33:15 -0700] ...mysql version: 5.6... [2022-08-03 09:33:15 -0700] Saving mysql privs... [2022-08-03 09:33:15 -0700] Done [2022-08-03 09:33:15 -0700] Saving mysql authentication information... [2022-08-03 09:33:15 -0700] Done [2022-08-03 09:33:15 -0700] Storing MySQL databases... [2022-08-03 09:33:15 -0700] Storing database accounttotransfer_blog [2022-08-03 09:33:15 -0700] Storing database accounttotransfer_webc593 [2022-08-03 09:33:15 -0700] Done [2022-08-03 09:33:15 -0700] ...Done [2022-08-03 09:33:15 -0700] ...Done [2022-08-03 09:33:15 -0700] Completed "Mysql" component. [2022-08-03 09:33:15 -0700] Performing "MysqlRemoteNotes" component.... [2022-08-03 09:33:15 -0700] Completed "MysqlRemoteNotes" component. [2022-08-03 09:33:15 -0700] Performing "CpUserFile" component.... [2022-08-03 09:33:15 -0700] Completed "CpUserFile" component. [2022-08-03 09:33:15 -0700] Performing "Cron" component.... [2022-08-03 09:33:15 -0700] Readable crontab file (/var/spool/cron/accounttotransfer) found; copying " [2022-08-03 09:33:15 -0700] Completed "Cron" component. [2022-08-03 09:33:15 -0700] Performing "Quota" component.... [2022-08-03 09:33:15 -0700] Completed "Quota" component. [2022-08-03 09:33:15 -0700] Performing "Integration" component.... [2022-08-03 09:33:15 -0700] Completed "Integration" component. [2022-08-03 09:33:15 -0700] Performing "AuthnLinks" component.... [2022-08-03 09:33:15 -0700] Completed "AuthnLinks" component. [2022-08-03 09:33:15 -0700] Performing "APITokens" component.... [2022-08-03 09:33:15 -0700] Completed "APITokens" component. [2022-08-03 09:33:15 -0700] Performing "DNSSEC" component.... [2022-08-03 09:33:15 -0700] Completed "DNSSEC" component. [2022-08-03 09:33:15 -0700] Performing "Custom" component.... [2022-08-03 09:33:15 -0700] No custom components to perform. [2022-08-03 09:33:15 -0700] Completed "Custom" component. [2022-08-03 09:33:15 -0700] Performing "AutoSSL" component.... [2022-08-03 09:33:15 -0700] Completed "AutoSSL" component. [2022-08-03 09:33:15 -0700] Storing Subdomains.... [2022-08-03 09:33:15 -0700] Done [2022-08-03 09:33:15 -0700] Storing Parked Domains.... [2022-08-03 09:33:15 -0700] Done [2022-08-03 09:33:15 -0700] Storing Addon Domains.... [2022-08-03 09:33:15 -0700] Performing "Password" component.... [2022-08-03 09:33:15 -0700] Completed "Password" component. [2022-08-03 09:33:15 -0700] Performing "DigestShadow" component.... [2022-08-03 09:33:15 -0700] Completed "DigestShadow" component. [2022-08-03 09:33:15 -0700] Copying shell....... [2022-08-03 09:33:15 -0700] Done [2022-08-03 09:33:15 -0700] Performing "WebCalls" component.... [2022-08-03 09:33:15 -0700] Completed "WebCalls" component. [2022-08-03 09:33:15 -0700] Performing "BrandCustomizations" component.... [2022-08-03 09:33:15 -0700] Completed "BrandCustomizations" component. [2022-08-03 09:33:15 -0700] Performing "PublicContact" component.... [2022-08-03 09:33:15 -0700] Completed "PublicContact" component. [2022-08-03 09:33:15 -0700] Performing "MailLimits" component.... [2022-08-03 09:33:15 -0700] Completed "MailLimits" component. [2022-08-03 09:33:15 -0700] Performing "LinkedNodes" component.... [2022-08-03 09:33:15 -0700] Completed "LinkedNodes" component. [2022-08-03 09:33:15 -0700] Creating Archive .... [2022-08-03 09:33:16 -0700] ......... [2022-08-03 09:33:17 -0700] [2022-08-03 09:33:17 -0700] splitpkgacctfile is: /home/cpmove-accounttotransfer-split/cpmove-accounttotransfer.tar.gz.part00001 [2022-08-03 09:33:17 -0700] splitmd5sum is: a8de7d35f437e866fa9a355333a1df4c [2022-08-03 09:33:17 -0700] splitsize is: 8339762 [2022-08-03 09:33:17 -0700] Done [2022-08-03 09:33:17 -0700] mysqlsize is: 151334840 [2022-08-03 09:33:17 -0700] pkgacct completed Target "/home" on host "destinationserver.com" has 81.35 GB free and requires at least 9.25 GB free, which includes space for temporary files. Target "/home" on host "destinationserver.com" has 11,062,920 inodes free and requires at least 17,981 inodes free, which includes space for temporary files. Using the archive split method! File #1: "/home/cpmove-accounttotransfer-split/cpmove-accounttotransfer.tar.gz.part00001" with md5sum: a8de7d35f437e866fa9a355333a1df4c Remote file is: "/home/cpmove-accounttotransfer-split/cpmove-accounttotransfer.tar.gz.part00001" with size: 8339762 Attempt #1 to transfer using "WHM" method. The system will fetch the stream through Remote WHM from host "sourceserver.com:2087" " "100% @ 0.1662 MiB/s " Done Verifying cpmove file checksum " Checksum Matches (Actual remote username is "accounttotransfer"). The remote file list contains: /home/cpmove-accounttotransfer-split/cpmove-accounttotransfer.tar.gz.part00001 The local file list contains: /home/cpmove-accounttotransfer.tar.gz.part00001 Copied cpmove file to: "/home/cpmove-accounttotransfer.tar.gz.part00001". Success.
    0
  • cPRex Jurassic Moderator
    There we go - it's the cluster. Once the account gets created that change will get pushed to the cluster so it updates everywhere. In general, it's best to disable the cluster for a bit while a migration happens or else you run into situations like this.
    0
  • jpenner
    Ahhh, that's good to know. That would be a good note at the time of transfer [or an option to "Disable cluster until transfer complete">. Thank you for walking through that with me. Hopefully this information helps someone else out. (and thanks Esquio for allowing me to augment your thread with more info) :)
    0
  • cPRex Jurassic Moderator
    Sure thing - you're very welcome! Do you think there is something we could do better in the interface? We can't really delay the account creation, because the DNS record will get propagated to the cluster as soon as the account exists. Would a "we detected a cluster and this could cause unintended behavior" type of warning help end users?
    0
  • jpenner
    I think that warning would be VERY useful. I'd never have though that it could be the problem and we've delayed moving large accounts for weeks/months because of that issue. If I'd know it was that simple, that could have saved me a lot of time and money. Is it possible to temporarily disable the cluster (or have an option to do so) if it was detected and then re-enable it after the transfer is complete if that that temporary disable was detected?
    0
  • cPRex Jurassic Moderator
    Are you asking for that temporary disable to happen inside Transfer Tool, maybe as part of that warning?
    0
  • jpenner
    Yes. My reasoning is that if I was to start a transfer that took more than a couple of minutes, it's likely I might forget to come back and turn it back on, or I might not be able to get to it upon completion of the transfer (say it ends in the middle of the night). That could cause issues if another user on the server made a DNS change. I can live with a short disconnection but forgetting it and dealing with a weird DNS support thing a couple of days later could be an issue.
    0
  • cPRex Jurassic Moderator
    Alrighty - let me run this by the team and we'll go from there!
    0
  • cPRex Jurassic Moderator
    I went ahead and created two improvement cases with our development team. One is to get a warning in the Transfer Tool that lets the admin know the Destination machine is connected to a DNS Cluster. The second is to explore the possibility of disabling the DNS Cluster connection while the transfer is running, but that will need some investigation as if we just sever the DNS Cluster connection it would cause DNS for all other domains not being transferred to stop working. Since these are new features/improvements that we'd be adding, I don't have any type of timeframe as to when we might have something. If I do hear something I will try my best to update this post with the details.
    0
  • Esquio
    There we go - it's the cluster. Once the account gets created that change will get pushed to the cluster so it updates everywhere. In general, it's best to disable the cluster for a bit while a migration happens or else you run into situations like this.

    That's good to know, thank you so much.
    0
  • cPRex Jurassic Moderator
    You're very welcome!
    0

Please sign in to leave a comment.

Didn't find what you were looking for?

New post