{"id":237,"date":"2021-07-23T12:26:12","date_gmt":"2021-07-23T12:26:12","guid":{"rendered":"https:\/\/ssdsunucum.com\/blog\/how-to-troubleshoot-a-remote-transport-pruning-failure\/"},"modified":"2021-07-23T12:26:12","modified_gmt":"2021-07-23T12:26:12","slug":"how-to-troubleshoot-a-remote-transport-pruning-failure","status":"publish","type":"post","link":"https:\/\/ssdsunucum.com\/blog\/how-to-troubleshoot-a-remote-transport-pruning-failure\/","title":{"rendered":"How to Troubleshoot a Remote Transport Pruning Failure"},"content":{"rendered":"<\/p>\n<div class=\"col-md-9\">\n<div class=\"flex-column flex-md-row article-header\"><\/div>\n<hr>\n<h2 id=\"overview\">Overview<\/h2>\n<p>Users who store remote backups may encounter an issue where the remote pruning process (deletion) does not complete within the system-allotted time limit. The maximum time limit is 300 seconds per transport process. This document offers solutions to troubleshoot the timeout problem.<\/p>\n<div class=\"callout callout-danger\">\n<div class=\"callout-heading\">Warning:<\/div>\n<div class=\"callout-content\">\n<ul>\n<li>\n<p>Make <strong>certain<\/strong> that your FTP server supports the MLSD (Machine List Directory) or LIST commands. If the FTP server does <strong>not<\/strong> support these commands, the backup system <strong>cannot<\/strong> use the FTP server as a remote FTP server.<\/p>\n<ul>\n<li>Unix-supported FTP servers, such as ProFTP and Pure-FTPd, support these commands.<\/li>\n<li>For more information about these commands, read Wikipedia\u2019s List of FTP commands documentation and itef.org\u2019s RCF 3659 documentation.<\/li>\n<\/ul>\n<\/li>\n<li>\n<p>Make certain that any hidden files (files that begin with a period (<code>.<\/code>)) on the FTP server have write permissions. The backup system can <strong>only<\/strong> prune data from files with these permissions.<\/p>\n<\/li>\n<li>\n<p>We <strong>strongly<\/strong> recommend that you use Pure-FTPd or ProFTPD on remote FTP servers. Unexpected results may occur with some FTP server software.<\/p>\n<ul>\n<li>If you use Pure-FTPd, ensure that the <code>DisplayDotFiles yes<\/code> statement resides in the <code>\/etc\/pure-ftpd.conf<\/code> file.<\/li>\n<li>If you use ProFTPD, ensure that the <code>ListOptions -a<\/code> statement resides in the <code>\/etc\/proftpd.conf<\/code> file<\/li>\n<\/ul>\n<\/li>\n<li>\n<p>If you use the Very Secure FTP daemon (<code>vsftpd<\/code>), ensure that you set the <code>force_dot_files<\/code> setting to <code>yes<\/code> in the <code>\/etc\/vsftpd.conf<\/code> file. For more information about <code>vsftpd<\/code>, read the vsftpd documentation.<\/p>\n<\/li>\n<\/ul><\/div>\n<\/div>\n<h2 id=\"transport-error\">Transport error<\/h2>\n<p>Based on your iNotify settings, the system will send an email notification when it encounters a transport error. The email notification shows a preview of the transport error log and includes an attached copy of the transport error log.<\/p>\n<p>The following examples represent transport error code messages in the transport error log, where the directory name <code>\/home\/username\/backups\/2018-05-24<\/code> represents the directory name:<\/p>\n<h4 id=\"cpanel-whm-version-76-and-later\">cPanel &#038; WHM version 76 and later<\/h4>\n<div class=\"highlight\">\n<pre style=\"color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4\"><code class=\"language-GO\" data-lang=\"GO\"><span style=\"color:#a6e22e\">The<\/span> <span style=\"color:#a6e22e\">system<\/span> <span style=\"color:#a6e22e\">could<\/span> <span style=\"color:#a6e22e\">not<\/span> <span style=\"color:#a6e22e\">prune<\/span> <span style=\"color:#a6e22e\">the<\/span> <span style=\"color:#e6db74\">\"home\/username\/backups\/2018-05-24\"<\/span> <span style=\"color:#a6e22e\">directory<\/span> <span style=\"color:#a6e22e\">due<\/span> <span style=\"color:#a6e22e\">to<\/span> <span style=\"color:#a6e22e\">an<\/span> <span style=\"color:#66d9ef\">error<\/span>. <span style=\"color:#a6e22e\">Read<\/span> <span style=\"color:#a6e22e\">the<\/span> <span style=\"color:#66d9ef\">go<\/span>.<span style=\"color:#a6e22e\">cpanel<\/span>.<span style=\"color:#a6e22e\">net<\/span><span style=\"color:#f92672\">\/<\/span><span style=\"color:#a6e22e\">directorypruning<\/span> <span style=\"color:#a6e22e\">documentation<\/span> <span style=\"color:#66d9ef\">for<\/span> <span style=\"color:#a6e22e\">solutions<\/span> <span style=\"color:#a6e22e\">to<\/span> <span style=\"color:#a6e22e\">successfully<\/span> <span style=\"color:#a6e22e\">prune<\/span> <span style=\"color:#a6e22e\">the<\/span> <span style=\"color:#a6e22e\">directory<\/span>.<\/code><\/pre>\n<\/div>\n<h4 id=\"cpanel-whm-version-74-and-earlier\">cPanel &#038; WHM version 74 and earlier<\/h4>\n<div class=\"highlight\">\n<pre style=\"color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4\"><code class=\"language-GO\" data-lang=\"GO\"><span style=\"color:#a6e22e\">If<\/span> <span style=\"color:#a6e22e\">the<\/span> <span style=\"color:#a6e22e\">directory<\/span> <span style=\"color:#a6e22e\">to<\/span> <span style=\"color:#a6e22e\">be<\/span> <span style=\"color:#a6e22e\">pruned<\/span> <span style=\"color:#e6db74\">\"home\/username\/backups\/2018-0524\"<\/span> <span style=\"color:#a6e22e\">contains<\/span> <span style=\"color:#a6e22e\">incremental<\/span> <span style=\"color:#a6e22e\">backups<\/span> <span style=\"color:#a6e22e\">with<\/span> <span style=\"color:#a6e22e\">large<\/span> <span style=\"color:#a6e22e\">numbers<\/span> <span style=\"color:#a6e22e\">of<\/span> <span style=\"color:#a6e22e\">files<\/span>, <span style=\"color:#a6e22e\">you<\/span> <span style=\"color:#a6e22e\">may<\/span> <span style=\"color:#a6e22e\">need<\/span> <span style=\"color:#a6e22e\">to<\/span> <span style=\"color:#a6e22e\">remove<\/span> <span style=\"color:#a6e22e\">it<\/span> <span style=\"color:#a6e22e\">manually<\/span>.<\/code><\/pre>\n<\/div>\n<p>The solutions shown in the next section will help you troubleshoot and fix these issues.<\/p>\n<h2 id=\"troubleshooting\">Troubleshooting<\/h2>\n<p>Several different situations may cause a transport error. You will have to diagnose your configuration to determine the appropriate solution.<\/p>\n<h3 id=\"the-directory-size-is-too-large\">The directory size is too large<\/h3>\n<p>The remote transport process may time out if it tries to prune a very large directory. The following options can help you to solve this issue:<\/p>\n<h3 id=\"manually-delete-the-directory-from-the-remote-destination\">Manually delete the directory from the remote destination<\/h3>\n<p>The transport may produce an error if it is unable to prune the directory due to its size. You can manually delete the directory from the remote backup location to troubleshoot this error.<\/p>\n<p>Use the <code>rm<\/code> command to delete the directory from the remote destination. For example, if you wanted to delete the <code>\/home\/username\/backups\/2018-05-24<\/code> directory run the following command:<\/p>\n<div class=\"highlight\">\n<pre style=\"color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4\"><code class=\"language-GO\" data-lang=\"GO\"><span style=\"color:#a6e22e\">rm<\/span> <span style=\"color:#f92672\">-<\/span><span style=\"color:#a6e22e\">rf<\/span> <span style=\"color:#a6e22e\">home<\/span><span style=\"color:#f92672\">\/<\/span><span style=\"color:#a6e22e\">username<\/span><span style=\"color:#f92672\">\/<\/span><span style=\"color:#a6e22e\">backups<\/span><span style=\"color:#f92672\">\/<\/span><span style=\"color:#ae81ff\">2018<\/span><span style=\"color:#f92672\">-<\/span><span style=\"color:#ae81ff\">05<\/span><span style=\"color:#f92672\">-<\/span><span style=\"color:#ae81ff\">24<\/span><\/code><\/pre>\n<\/div>\n<h3 id=\"disable-the-account-s-backup\">Disable the account\u2019s backup<\/h3>\n<p>Some accounts may be too large to back up to a remote backup location. You can disable an account\u2019s backup in WHM\u2019s <em>Backup User Selection<\/em> interface (<em>WHM<\/em> &gt;&gt; <em>Home<\/em> &gt;&gt; <em>Backup<\/em> &gt;&gt; <em>Backup User Selection<\/em>). You can also use the WHM API 1 <code>toggle_user_backup_state<\/code> function to disable the account\u2019s backup.<\/p>\n<h3 id=\"change-the-backup-type-from-incremental-to-compressed\">Change the backup type from incremental to compressed<\/h3>\n<p>If you are saving the backups for the large-sized account as an incremental backup type, you can change the backup type to compressed to use less disk space.<\/p>\n<div class=\"callout callout-info\">\n<div class=\"callout-heading\">Note:<\/div>\n<div class=\"callout-content\">\n<p>The rsync backup transport does <strong>not<\/strong> accept compressed backup files. If you enable backup compression, you <strong>must<\/strong> also change the destination type in your backup configuration to a destination that accepts compressed backup files.<\/p>\n<\/p><\/div>\n<\/div>\n<p>You can change the backup type and the destination type in WHM\u2019s <em>Backup User Selection<\/em> interface (<em>WHM<\/em> &gt;&gt; <em>Home<\/em> &gt;&gt; <em>Backup<\/em> &gt;&gt; <em>Backup User Selection<\/em>). You can also use the following WHM API 1 functions to update your backup configuration:<\/p>\n<ul>\n<li>\n<p><code>backup_config_set<\/code> \u2014 Sets the backup configuration options (use this to update the backup type).<\/p>\n<\/li>\n<li>\n<p><code>backup_destination_add<\/code> \u2014 Adds a backup destination.<\/p>\n<\/li>\n<li>\n<p><code>backup_destination_delete<\/code> \u2014 Removes a backup destination.<\/p>\n<\/li>\n<\/ul>\n<h3 id=\"the-backup-drive-is-too-slow\">The backup drive is too slow<\/h3>\n<p>The transport may produce an error if your remote backup location is too slow to process the transport pruning within the system-allotted time of 300 seconds. We recommend that you replace the existing remote backup location with a faster-processing remote backup location.<\/p>\n<h3 id=\"network-error\">Network error<\/h3>\n<p>The transport may produce an error if network issues occur. If this was the case, you can run the backup transport process again manually when the network works properly.<\/p>\n<p>To manually run a backup, run the following command as the <code>root<\/code> user:<\/p>\n<div class=\"highlight\">\n<pre style=\"color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4\"><code class=\"language-GO\" data-lang=\"GO\"><span style=\"color:#f92672\">\/<\/span><span style=\"color:#a6e22e\">usr<\/span><span style=\"color:#f92672\">\/<\/span><span style=\"color:#a6e22e\">local<\/span><span style=\"color:#f92672\">\/<\/span><span style=\"color:#a6e22e\">cpanel<\/span><span style=\"color:#f92672\">\/<\/span><span style=\"color:#a6e22e\">bin<\/span><span style=\"color:#f92672\">\/<\/span><span style=\"color:#a6e22e\">backup<\/span><\/code><\/pre>\n<\/div>\n<h3 id=\"permission-denied-error\">Permission denied error<\/h3>\n<p>The transport may produce an error if the following conditions exist on the server:<\/p>\n<ul>\n<li>A non-<code>root<\/code> user authenticates to an rsync backup destination.<\/li>\n<li>Files that the user does not possess write privileges to resides in a cPanel user\u2019s directory.<\/li>\n<\/ul>\n<p>We recommend that you manually delete the files that the system could not remove from the remote destination\u2019s backup.<\/p>\n<div class=\"callout callout-info\">\n<div class=\"callout-heading\">Note:<\/div>\n<div class=\"callout-content\">\n<p>You may need to allow write privileges to a file before you delete it. To do this, run the <code>chmod +w<\/code> file command, where <code>file<\/code> represents the file for which to update permissions.<\/p>\n<\/p><\/div>\n<\/div><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Overview Users who store remote backups may encounter an issue where the remote pruning process (deletion) does not complete within the system-allotted time limit. The maximum time limit is 300 seconds per transport process. This document offers solutions to troubleshoot the timeout problem. Warning: Make certain that your FTP server supports the MLSD (Machine List &hellip;<\/p>\n","protected":false},"author":1,"featured_media":238,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/ssdsunucum.com\/blog\/wp-json\/wp\/v2\/posts\/237"}],"collection":[{"href":"https:\/\/ssdsunucum.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ssdsunucum.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ssdsunucum.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ssdsunucum.com\/blog\/wp-json\/wp\/v2\/comments?post=237"}],"version-history":[{"count":0,"href":"https:\/\/ssdsunucum.com\/blog\/wp-json\/wp\/v2\/posts\/237\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ssdsunucum.com\/blog\/wp-json\/wp\/v2\/media\/238"}],"wp:attachment":[{"href":"https:\/\/ssdsunucum.com\/blog\/wp-json\/wp\/v2\/media?parent=237"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ssdsunucum.com\/blog\/wp-json\/wp\/v2\/categories?post=237"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ssdsunucum.com\/blog\/wp-json\/wp\/v2\/tags?post=237"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}