Skip to main content

CPANEL-42697 - Restore lost Roundcube canned responses

Comments

30 comments

  • cPRex Jurassic Moderator
    Hey there! Yes, I would expect these to be included in the Roundcube database, which would be stored in the backup files. Restoring the backup for the account should replace the missing data.
    0
  • gatewayhost
    Hey there! Yes, I would expect these to be included in the Roundcube database, which would be stored in the backup files. Restoring the backup for the account should replace the missing data.

    Thank you! This worked part of the way, but there is now an error "An error occured while saving." in red in the lower right corner when attempting to add any new Responses or edit existing ones.
    0
  • cPRex Jurassic Moderator
    That sounds like it could be a permissions issue. Do you see anything in the cPanel log (/usr/local/cpanel/logs/error_log) while performing that work?
    0
  • gatewayhost
    Nothing gets added to the log while performing the work, but I do have several of these in the past few days, coinciding with when this issue began: [2023-04-10 12:15:41 -0500] info [autorepair] Successfully verified signature for cpanel (key types: release). cpsrvd 286b2cc8c0f04: Cpanel::Exception::NetSSLeay/(XID 7ar9xp) Net::SSLeay::ssl_write_all(SCALAR(0x2eff8e8)) produced an operating system error (EPIPE, Broken pipe) and 1 [asis,OpenSSL] [numerate,_6,error,errors]: ARRAY(0x3000320) at /usr/local/cpanel/Cpanel/Server/Connection/SSL.pm line 64. Cpanel::Server::Connection::SSL::write_buffer(Cpanel::Server::Connection::SSL=HASH(0x2c9b658), SCALAR(0x2eff8e8)) called at /usr/local/cpanel/Cpanel/Server/Response.pm line 218 Cpanel::Server::Response::__ANON__(SCALAR(0x2eff8e8)) called at /usr/local/cpanel/Cpanel/Server/Responders/Stream/Gzip.pm line 92 Cpanel::Server::Responders::Stream::Gzip::write(Cpanel::Server::Responders::Stream::Gzip=HASH(0x2e7e010), 4) called at /usr/local/cpanel/Cpanel/Server/Responder.pm line 176 Cpanel::Server::Responder::finish(Cpanel::Server::Responders::Stream::Gzip=HASH(0x2e7e010), 4) called at /usr/local/cpanel/Cpanel/Server/Responders/Chunked/Gzip.pm line 29 Cpanel::Server::Responders::Chunked::Gzip::finish(Cpanel::Server::Responders::Stream::Gzip=HASH(0x2e7e010), 4) called at /usr/local/cpanel/Cpanel/Server/Responder.pm line 96 Cpanel::Server::Responder::blocking_read_from_input_and_send_response(Cpanel::Server::Responders::Stream::Gzip=HASH(0x2e7e010)) called at /usr/local/cpanel/Cpanel/Server/Response.pm line 142 Cpanel::Server::Response::send_response(Cpanel::Server::Response=HASH(0x2c9b838), Cpanel::Server::Response::Source::String=HASH(0x2cca550)) called at cpsrvd.pl line 3113 cpanel::cpsrvd::servcontent("document", "./3rdparty/roundcube/skins/elastic/images/logo.svg", "magic_parse", 1, "static", 1, "content_type", "image/svg+xml") called at cpsrvd.pl line 6348 cpanel::cpsrvd::dodoc_webmaild() called at cpsrvd.pl line 2116 cpanel::cpsrvd::dodoc(HASH(0x1c2ad48)) called at cpsrvd.pl line 1802 cpanel::cpsrvd::handle_one_connection(12) called at cpsrvd.pl line 1149 cpanel::cpsrvd::script() called at cpsrvd.pl line 448 Net::SSLeay error left in queue from previous call: "error:140E0197:SSL routines:SSL_shutdown:shutdown while in init" (336462231) at /usr/local/cpanel/Cpanel/NetSSLeay.pm line 28. Net::SSLeay error left in queue from previous call: "error:140E0197:SSL routines:SSL_shutdown:shutdown while in init" (336462231) at /usr/local/cpanel/Cpanel/NetSSLeay.pm line 28.
    0
  • cPRex Jurassic Moderator
    It might be best to open a ticket with our team so we can take a look at this issue directly, as there could be some underlying issues with the system that led to the Roundcube problems.
    0
  • InterServed
    Having the same problem on some servers. On server with roudcube mysql database, the table 'responses' is missing. I went ahead and manually created the table, taking the table creation schema from: /usr/local/cpanel/src/3rdparty/gpl/roundcube_schema/full/current/mysql Logs at : /var/cpanel/roundcube/log/errors.log : [28-Mar-2023 09:14:10 +0300]: <3a3e096f> DB Error: [1146] Table 'roundcube.responses' doesn't exist On server with roundcube and sqlite database, had to use this workaround:
    0
  • cPRex Jurassic Moderator
    We've identified an issue where this is happening that you can read about here:
    -1
  • plague
    Found this error on a server today. I was able to recreate the table from /usr/local/cpanel/src/3rdparty/gpl/roundcube_schema/full/current/mysql (thanks @InterServed) but all the backups from /var/cpanel/roundcube/roundcube.backup.sql* are missing this table. The error started on April 06, I have backups from March and December on that folder but all dumps are missing the "response" table so the clients old data is lost. I'm using Jetbackup and it seems that it does not include the roundcube data on the backup
    0
  • cPRex Jurassic Moderator
    Maybe @JetAppsAdam has more details on why that isn't included with their backups.
    0
  • filoucp
    Also lost all my responses from a server, today, does anybody found a way to recover the responses ?
    0
  • cPRex Jurassic Moderator
    @filoucp - you would need to restore the backup as outlined in the above posts.
    0
  • filoucp
    @filoucp - you would need to restore the backup as outlined in the above posts.

    The link above is saying a workaround isn't available to restore the responses. Also I've got no sql backups inside /var/cpanel/roundcube/, do I have to activate any option for that ?
    0
  • cPRex Jurassic Moderator
    There isn't anything you should have to do to get those backups created, but yes, there is not a way to restore the responses at this point.
    0
  • filoucp
    There isn't anything you should have to do to get those backups created, but yes, there is not a way to restore the responses at this point.

    In my /var/cpanel/roundcube/ directory I've got: log/ tmp/ version
    0
  • George_Fusioned
    I also have no sql backups inside /var/cpanel/roundcube/ which is probably normal since Roundcube is using sqlite in my case. That said, I tried to follow the instructions at
    0
  • mfigge
    We've identified an issue where this is happening that you can read about here:
    0
  • George_Fusioned
    Looks like there was a different article for sqlite Roundcube databases, so on affected customers who lost their responses I was able to restore a .rcube.db from a date before April 10th, and then run the command in
    0
  • cPRex Jurassic Moderator
    @mfigge here you go! Symptoms After the update, Roundcube is missing identities, contacts, and responses. This can be verified via webmail or manually in the Roundcube MySQL/SQLite databases. mysqlcheck roundcube roundcube.attachments OK roundcube.cache OK roundcube.calendars OK roundcube.carddav_addressbooks OK roundcube.carddav_contacts OK roundcube.carddav_group_user OK roundcube.carddav_groups OK roundcube.carddav_migrations OK roundcube.carddav_xsubtypes OK roundcube.cp_schema_version OK roundcube.events OK roundcube.itipinvitations OK roundcube.session OK roundcube.users OK An error occurs when accessing the Responses page in Roundcube. Screen_Shot_2023-04-14_at_3.57.14_PM.png Description During the cPanel update from 108 to 110, the Roundcube schema is updated. It was recently discovered that many servers have been failing to update the schema in Roundcube. The failure to update the schema successfully in version 110 could result in missing tables. We've opened an internal case for our development team to investigate this further. For reference, the case number is CPANEL-42697. Follow this article to receive an email notification when a solution is published in the product. Workaround Restore the backup from "/var/cpanel/roundcube/roundcube.backup.sql". mysql roundcube < /var/cpanel/roundcube/roundcube.backup.sql Note: Each backup contains a date at the end of the file name for example "1677800785". Restore the most recent copy of the backup where the contacts and identities were working successfully. Unfortunately, a workaround isn't available to restore the responses.
    0
  • filoucp
    Looks like there was a different article for sqlite Roundcube databases, so on affected customers who lost their responses I was able to restore a .rcube.db from a date before April 10th, and then run the command in
    0
  • Andy83
    I am facing the same issue with missing responses etc... Moreover, I could not save a new response. I tried to access
    0
  • cPRex Jurassic Moderator
    @Andy83 - those would be the same login details as our ticket system.
    0
  • Andy83
    Restore the backup from "/var/cpanel/roundcube/roundcube.backup.sql". mysql roundcube < /var/cpanel/roundcube/roundcube.backup.sql --- May I confirm that the above solution will NOT result in any loss of emails? Thanks.
    0
  • cPRex Jurassic Moderator
    The emails themselves are not stored in that area, so no email data will be altered.
    0
  • Andy83
    /usr/local/cpanel/bin/update-roundcube-sqlite-db --force I read that the above will run a current backup of your RoundCube databases. How long will it take? Does it backup the emails too? Is it a MUST to run the above command before I follow the below-mentioned instruction? -- for userdb in $(find /home/*/etc/*/ -name "*.rcube.db") do for stamp in $(sqlite3 $userdb "SELECT value FROM system WHERE name='roundcube-version'";) do for new_schema in $(find /usr/local/cpanel/base/3rdparty/roundcube/SQL/sqlite -newer /usr/local/cpanel/base/3rdparty/roundcube/SQL/sqlite/$stamp.sql|grep sql$|sort) do sqlite3 $userdb < $new_schema done done done -- I refer to the above taken from
    0
  • cPRex Jurassic Moderator
    The Roundcube databases are unrelated to the actual email content. Email content is stored in the /home directory for each user, and is backed up as part of normal cPanel backups. When you execute that command it will tell you it is running in the background: [root@10-2-32-52 ~]# /usr/local/cpanel/bin/update-roundcube-sqlite-db --force /usr/local/cpanel/bin/update-roundcube-sqlite-db: running in the background.
    A simple check with ps aux will confirm if it is still running: ps aux | grep update-roundcube
    There is no way to know precisely how long that command would take, but even on a busy server I would not expect it to be more than a few minutes. As far as the for loop, that can be pasted as-is into terminal and it will work properly.
    0
  • cPRex Jurassic Moderator
    Update - this issue is also being fixed in version 110.0.3, which is now in the Current tier.
    0
  • JetAppsAdam
    Maybe @JetAppsAdam has more details on why that isn't included with their backups.

    Hello, The roundcube data should be included in an account backup job in the "Home Dir" backup directory. To restore only the roundcube database, you can choose the affected account > View Backups > Show advanced settings > Home Dir > Change Files Selection > etc > {account}.rcube.db > Select Files > Restore > Remove all items except for "Home Dir Files". If this does not restore the roundcube responses, please do not hesitate to open a ticket with our 24/7/365 support team. To do this you can email support@jetapps.com! Thank you,
    0
  • simz8
    Update - this issue is also being fixed in version 110.0.3, which is now in the Current tier.

    @cPRex, i updated a couple of days ago from v104 to v110.0.7 . My roundcube installation is producing lots of errors with the following content : [10-Jul-2023 07:06:29 +0300]: <2e856074> DB Error: [1146] Table 'roundcube.collected_addresses' doesn't exist (SQL Query: SELECT COUNT(`address_id`) AS cnt FROM `collected_addresses` WHERE `user_id` = '735' AND `type` = '1' AND ((`email` LIKE 'censoredemail@gmail.com'))) in /usr/local/cpanel/base/3rdparty/roundcube/program/lib/Roundcube/rcube_db.php on line 564 (POST /cpsess5721959674/3rdparty/roundcube/index.php?_task=mail&_unlock=loading1688961989028&_framed=1&_action=send) [10-Jul-2023 07:06:29 +0300]: <2e856074> DB Error: [1146] Table 'roundcube.collected_addresses' doesn't exist (SQL Query: INSERT INTO `collected_addresses` (`user_id`, `changed`, `type`, `name`, `email`) VALUES ('735', now(), '1', 'censoredemail', 'censoredemail@gmail.com')) in /usr/local/cpanel/base/3rdparty/roundcube/program/lib/Roundcube/rcube_db.php on line 564 (POST /cpsess5721959674/3rdparty/roundcube/index.php?_task=mail&_unlock=loading1688961989028&_framed=1&_action=send) I am also attaching a screenshot to see the tables present in my currrent roundcube DB... I must also mention that inside the roundcube.system table the column roundcube-version has a value of 2015111100. I think it is quite old. Does it require update ? On the other hand the rpm -qa | grep -i roundcube command shows: cpanel-roundcubemail-1.6.0.10-1.cp110~el7.noarch Does this mean that roundcube db schema was not updated ? I have also raised a ticket for that and i am waiting for an answer....
    0
  • cPRex Jurassic Moderator
    @simz8 - I'm guessing the issue has been resolved in the ticket by this point?
    0
  • simz8
    @simz8 - I'm guessing the issue has been resolved in the ticket by this point?

    Well actually i was advised to use the /usr/local/cpanel/bin/update-roundcube-db "force command But before i did that i had already used the create table sql commands to rebuild these tables (collected_addresses and responses) that i've found inside /usr/local/cpanel/src/3rdparty/gpl/roundcube_schema/repair/mysql sql script. So i solved my problem that way. I also had errors coming from the Contacts and Calendars Server (when i installed it) because it was producing table not found errors (DB Error: [1146] Table 'roundcube.caldav_calendars_merged' doesn't exist) . For these errors, i was told that they are coming from the HORDE migration script and Logging out to roundcube and back in should solve the problem. But it was producing so many errors that i uninstalled CCS I will give it a try when i find some time
    0

Please sign in to leave a comment.