'Re: [unison-users] Large file synchronization issue...'

[prev in list] [next in list] [prev in thread] [next in thread] 

List:       unison-users
Subject:    Re: [unison-users] Large file synchronization issue...
From:       Jerome Vouillon <Jerome.Vouillon () pps ! jussieu ! fr>
Date:       2011-01-06 10:27:51
Message-ID: 20110106102751.GA28860 () pps ! jussieu ! fr
[Download RAW message or body]

Hello,

On Fri, Dec 24, 2010 at 10:24:05AM -0000, drsky1978 wrote:
> I am using 2.32.52-1ubuntu2 version of Unison. One of the demanding
> tasks I have set up is virtual machines hdd images
> synchronization. Most of the files are smaller than 10 GB, but there
> can be files as big as 30 GB.
>
> Unfortunately it takes AGES (20 hours) to replicate slightly
> modified file from one machine to second.

Could you try Unison 2.40?  It has an improved implementation of the
rsync algorithm, which should behave much better with large files.

-- Jerome

[Attachment #3 (text/html)]

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" \
"http://www.w3.org/TR/html4/strict.dtd"> <html>
<head>
</head>







<body style="background-color: #fff;">
<span style="display:none">&nbsp;</span>

<!--~-|**|PrettyHtmlStartT|**|-~-->
<div id="ygrp-mlmsg" style="position:relative;">
  <div id="ygrp-msg" style="z-index: 1;">
<!--~-|**|PrettyHtmlEndT|**|-~-->

    <div id="ygrp-text" >
      
      
      <p>Hello,<br>
<br>
On Fri, Dec 24, 2010 at 10:24:05AM -0000, drsky1978 wrote:<br>
&gt; I am using 2.32.52-1ubuntu2 version of Unison. One of the demanding<br>
&gt; tasks I have set up is virtual machines hdd images<br>
&gt; synchronization. Most of the files are smaller than 10 GB, but there<br>
&gt; can be files as big as 30 GB.<br>
&gt;<br>
&gt; Unfortunately it takes AGES (20 hours) to replicate slightly<br>
&gt; modified file from one machine to second.<br>
<br>
Could you try Unison 2.40?  It has an improved implementation of the<br>
rsync algorithm, which should behave much better with large files.<br>
<br>
-- Jerome<br>
</p>

    </div>
     

    <!--~-|**|PrettyHtmlStart|**|-~-->
    <div style="color: #fff; height: 0;">__._,_.___</div>

        
  
   
    <div id="ygrp-actbar" style="clear: both; margin-bottom: 10px; white-space: \
nowrap; color: #666; padding-top: 15px;">  <div>
        <a href="mailto:Jerome.Vouillon@pps.jussieu.fr?subject=Re%3A%20%5Bunison-users%5D%20Large%20file%20synchronization%20issue%2E%2E%2E" \
style="margin-right: 0; padding-right: 0;">  Reply to <span style="font-weight: \
                700;">sender</span></a> |
        <a href="mailto:unison-users@yahoogroups.com?subject=Re%3A%20%5Bunison-users%5D%20Large%20file%20synchronization%20issue%2E%2E%2E">
  Reply to <span style="font-weight: 700;">group</span></a> |
        	  <a href="http://groups.yahoo.com/group/unison-users/post;_ylc=X3oDMTJvZmg1M \
zQxBF9TAzk3MzU5NzE0BGdycElkAzQ3OTc2NwRncnBzcElkAzE3MDUwMDQ3MjYEbXNnSWQDOTUzNgRzZWMDZnRyBHNsawNycGx5BHN0aW1lAzEyOTQzMDk2ODU-?act=reply&messageNum=9536">Reply \
<span style="font-weight: 700;">via web post</span></a> |  <a \
href="http://groups.yahoo.com/group/unison-users/post;_ylc=X3oDMTJkN3Y3N3B0BF9TAzk3MzU \
5NzE0BGdycElkAzQ3OTc2NwRncnBzcElkAzE3MDUwMDQ3MjYEc2VjA2Z0cgRzbGsDbnRwYwRzdGltZQMxMjk0MzA5Njg1" \
style="font-weight: 700;">Start a New Topic</a>  </div>

                <a href="http://groups.yahoo.com/group/unison-users/message/9522;_ylc= \
X3oDMTMzbDdtcmFnBF9TAzk3MzU5NzE0BGdycElkAzQ3OTc2NwRncnBzcElkAzE3MDUwMDQ3MjYEbXNnSWQDOTUzNgRzZWMDZnRyBHNsawN2dHBjBHN0aW1lAzEyOTQzMDk2ODUEdHBjSWQDOTUyMg--">Messages \
in this topic</a>  (<span style="font-weight: 700;">7</span>)
          </div> 
<!------- Start Nav Bar ------>
<!-- |**|begin egp html banner|**| -->
<!-- |**|end egp html banner|**| -->

<!-- |**|begin egp html banner|**| -->
<div id="ygrp-vital" style="background-color: #e0ecee; font-family: Verdana; \
                font-size: 10px; margin-bottom: 10px; padding: 10px;">
      <span id="vithd" style="font-weight: bold; color: #333; text-transform: \
uppercase; ">Recent Activity:</span>

    <ul style="list-style-type: none; margin: 0; padding: 0; display: inline;">
            <li style="border-right: 1px solid #000; font-weight: 700; display: \
inline; padding: 0 5px; margin-left: 0;">  <span class="cat"><a \
href="http://groups.yahoo.com/group/unison-users/members;_ylc=X3oDMTJlNm04NGJpBF9TAzk3 \
MzU5NzE0BGdycElkAzQ3OTc2NwRncnBzcElkAzE3MDUwMDQ3MjYEc2VjA3Z0bARzbGsDdm1icnMEc3RpbWUDMTI5NDMwOTY4NQ--?o=6" \
style="text-decoration: none;">New Members</a></span>  <span class="ct" style="color: \
#ff7900;">5</span>  </li>
                                              </ul>
    
  <div style="clear: both; padding-top: 2px; color: #1e66ae;">
    <a href="http://groups.yahoo.com/group/unison-users;_ylc=X3oDMTJkNjkybTdjBF9TAzk3M \
zU5NzE0BGdycElkAzQ3OTc2NwRncnBzcElkAzE3MDUwMDQ3MjYEc2VjA3Z0bARzbGsDdmdocARzdGltZQMxMjk0MzA5Njg1" \
style="text-decoration: none;">Visit Your Group</a>  </div>
</div>

  
<div id="ft" style="font-family: Arial; font-size: 11px; margin-top: 5px; padding: 0 \
2px 0 0; clear: both;">  <a \
href="http://groups.yahoo.com/;_ylc=X3oDMTJjcGRxNmQ5BF9TAzk3MzU5NzE0BGdycElkAzQ3OTc2NwRncnBzcElkAzE3MDUwMDQ3MjYEc2VjA2Z0cgRzbGsDZ2ZwBHN0aW1lAzEyOTQzMDk2ODU-" \
style="float: left;"><img src="http://l.yimg.com/a/i/us/yg/logo/us.gif" height="15" \
width="137" alt="Yahoo! Groups" style="border: 0;"/></a>  <div style="color: #747575; \
float: right;">Switch to: <a \
href="mailto:unison-users-traditional@yahoogroups.com?subject=Change Delivery Format: \
Traditional" style="text-decoration: none;">Text-Only</a>, <a \
href="mailto:unison-users-digest@yahoogroups.com?subject=Email Delivery: Digest" \
class="margin-rt" style="text-decoration: none;">Daily Digest</a> &bull; <a \
href="mailto:unison-users-unsubscribe@yahoogroups.com?subject=Unsubscribe" \
style="text-decoration: none;">Unsubscribe</a> &bull; <a \
href="http://docs.yahoo.com/info/terms/" style="text-decoration: none;">Terms of \
Use</a></div> </div>

<!-- |**|end egp html banner|**| -->

  </div> <!-- ygrp-msg -->

  <!-- Sponsor -->
  <!-- |**|begin egp html banner|**| -->
  <div id="ygrp-sponsor" style="width:160px; float:right; clear:none; margin:0 0 25px \
0; background: #fff;">

<!-- Start Recommendations -->
<div id="ygrp-reco">
     </div>
<!-- End Recommendations -->



  </div>   <!-- |**|end egp html banner|**| -->

  <div style="clear:both; color: #FFF; font-size:1px;">.</div>
</div>

  <img src="http://geo.yahoo.com/serv?s=97359714/grpId=479767/grpspId=1705004726/msgId=9536/stime=1294309685/nc1=1/nc2=2/nc3=3" \
width="1" height="1"> <br>

<div style="color: #fff; height: 0;">__,_._,___</div>
<!--~-|**|PrettyHtmlEnd|**|-~-->

</body>

<!--~-|**|PrettyHtmlStart|**|-~-->
<head>
  <style type="text/css">
  <!--
  #ygrp-mkp {
  border: 1px solid #d8d8d8;
  font-family: Arial;
  margin: 10px 0;
  padding: 0 10px;
}

#ygrp-mkp hr {
  border: 1px solid #d8d8d8;
}

#ygrp-mkp #hd {
  color: #628c2a;
  font-size: 85%;
  font-weight: 700;
  line-height: 122%;
  margin: 10px 0;
}

#ygrp-mkp #ads {
  margin-bottom: 10px;
}

#ygrp-mkp .ad {
  padding: 0 0;
}

#ygrp-mkp .ad p {
  margin: 0;
}

#ygrp-mkp .ad a {
  color: #0000ff;
  text-decoration: none;
}
  #ygrp-sponsor #ygrp-lc {
  font-family: Arial;
}

#ygrp-sponsor #ygrp-lc #hd {
  margin: 10px 0px;
  font-weight: 700;
  font-size: 78%;
  line-height: 122%;
}

#ygrp-sponsor #ygrp-lc .ad {
  margin-bottom: 10px;
  padding: 0 0;
}

  a {
    color: #1e66ae;
  }

  #actions {
    font-family: Verdana;
    font-size: 11px;
    padding: 10px 0;
  }

  #activity {
    background-color: #e0ecee;
    float: left;
    font-family: Verdana;
    font-size: 10px;
    padding: 10px;
  }

  #activity span {
    font-weight: 700;
  }

  #activity span:first-child {
    text-transform: uppercase;
  }

  #activity span a {
    color: #5085b6;
    text-decoration: none;
  }

  #activity span span {
    color: #ff7900;
  }

  #activity span .underline {
    text-decoration: underline;
  }

  .attach {
    clear: both;
    display: table;
    font-family: Arial;
    font-size: 12px;
    padding: 10px 0;
    width: 400px;
  }

  .attach div a {
    text-decoration: none;
  }

  .attach img {
    border: none;
    padding-right: 5px;
  }

  .attach label {
    display: block;
    margin-bottom: 5px;
  }

  .attach label a {
    text-decoration: none;
  }
  
  blockquote {
    margin: 0 0 0 4px;
  }

  .bold {
    font-family: Arial;
    font-size: 13px;
    font-weight: 700;
  }

  .bold a {
    text-decoration: none;
  }

  dd.last p a {
    font-family: Verdana;
    font-weight: 700;
  }

  dd.last p span {
    margin-right: 10px;
    font-family: Verdana;
    font-weight: 700;
  }

  dd.last p span.yshortcuts {
    margin-right: 0;
  }

  div.attach-table div div a {
    text-decoration: none;
  }

  div.attach-table {
    width: 400px;
  }

  div.file-title a, div.file-title a:active, div.file-title a:hover, div.file-title \
a:visited {  text-decoration: none;
  }

  div.photo-title a, div.photo-title a:active, div.photo-title a:hover, \
div.photo-title a:visited {  text-decoration: none;
  }

  div#ygrp-mlmsg #ygrp-msg p a span.yshortcuts {
    font-family: Verdana;
    font-size: 10px;
    font-weight: normal;
  }

  .green {
    color: #628c2a;
  }

  .MsoNormal {
    margin: 0 0 0 0;
  }

  o {
    font-size: 0;
  }

  #photos div {
    float: left;
    width: 72px;
  }

  #photos div div {
    border: 1px solid #666666;
    height: 62px;
    overflow: hidden;
    width: 62px;
  }

  #photos div label {
    color: #666666;
    font-size: 10px;
    overflow: hidden;
    text-align: center;
    white-space: nowrap;
    width: 64px;
  }

  #reco-category {
    font-size: 77%;
  }

  #reco-desc {
    font-size: 77%;
  }

  .replbq {
    margin: 4px;
  }

  #ygrp-actbar div a:first-child {
   /* border-right: 0px solid #000;*/
    margin-right: 2px;
    padding-right: 5px;
  }

  #ygrp-mlmsg {
    font-size: 13px;
    font-family: Arial, helvetica,clean, sans-serif;
    *font-size: small;
    *font: x-small;
  }

  #ygrp-mlmsg table {
    font-size: inherit;
    font: 100%;
  }

  #ygrp-mlmsg select, input, textarea {
    font: 99% Arial, Helvetica, clean, sans-serif;
  }

  #ygrp-mlmsg pre, code {
    font:115% monospace;
    *font-size:100%;
  }

  #ygrp-mlmsg * {
    line-height: 1.22em;
  }

  #ygrp-mlmsg #logo {
    padding-bottom: 10px;
  }

  #ygrp-mlmsg a {
    color: #1E66AE;
  }

  #ygrp-msg p a {
    font-family: Verdana;
  }

  #ygrp-msg p#attach-count span {
    color: #1E66AE;
    font-weight: 700;
  }

  #ygrp-reco #reco-head {
    color: #ff7900;
    font-weight: 700;
  }

  #ygrp-reco {
    margin-bottom: 20px;
    padding: 0px;
  }

  #ygrp-sponsor #ov li a {
    font-size: 130%;
    text-decoration: none;
  }

  #ygrp-sponsor #ov li {
    font-size: 77%;
    list-style-type: square;
    padding: 6px 0;
  } 

  #ygrp-sponsor #ov ul {
    margin: 0;
    padding: 0 0 0 8px;
  }

  #ygrp-text {
    font-family: Georgia;
  }

  #ygrp-text p {
    margin: 0 0 1em 0;
  }

  #ygrp-text tt {
    font-size: 120%;
  }

  #ygrp-vital ul li:last-child {
    border-right: none !important; 
  } 
  -->
  </style>
</head>

<!--~-|**|PrettyHtmlEnd|**|-~-->
</html>
<!-- end group email -->



[prev in list] [next in list] [prev in thread] [next in thread]
Configure | About | News | Add a list | Sponsored by KoreLogic