[prev in list] [next in list] [prev in thread] [next in thread] 

List:       gentoo-dev
Subject:    Re: [gentoo-dev] Feature request: can "emerge sync"'s rsync	compression
From:       Ævar_Arnfjörð_Bjarmason
Date:       2004-01-26 1:41:19
Message-ID: 4014703F.5090609 () users ! sourceforge ! net
[Download RAW message or body]



Troy Dack wrote:
> On Mon, 2004-01-26 at 04:15, Ævar Arnfjörð Bjarmason wrote:
> 
>>Mike Frysinger wrote:
>>
>>>On Saturday 24 January 2004 19:16, Ævar Arnfjörð Bjarmason wrote:
>>>
>>>
>>>>This seems to be hardcoded at the moment, could a variable be added to
>>>>make.conf, perhaps
>>>>
>>>>SYNC_COMPRESSION="yes/no" to control this behavior
>>>
>>>
>>>i would say no ... i dont know of any reason why you would want to do that and 
>>>it would increase the load on our rsync servers ...
>>>-mike
>>
>>Some mirrors (mine) specifically ask people not to use -z, gentoo users doing 
>>so piss of the mirror admins which means gentoo wont be mirrored.
>>
> 
> 
> Could you elaborate on why you ask users not to use -z? 
> 
> Is the load on your hardware too great when using -z?  
> 
> If that is the case then disable compression on the server like is done
> with rsync1.us.gentoo.org (see http://www.gentoo.org/doc/en/rsync.xml)

Its not "mine" as in "i own it" but as in "i use it"


<quote>
$ rsync ftp.rhnet.is:

                Welcome to the RHnet Archive, Iceland

DISCLAIMER: RHnet is not liable for the use, storage or
transmission of any files stored on this archive.

Please email suggestions and questions to ftpadm@rhnet.is

Access our ftp area by anonymous rsync like

rsync -av rsync://ftp.rhnet.is/pub/path/below/ /your/path/

Please _don't_ use the '-z' option, as most of the files here are
already compressed, and running compression is CPU intensive thing
anyway.   Just _wait_, and the transfer will eventually complete.

This mirror archive is also known as:

ftp1.is.freebsd.org
ftp.is.debian.org
rsync2.is.gentoo.org

Module          Content                                     Size
----------------------------------------------------------------------

pub             Public ftp area (ftp://ftp.rhnet.is/pub)    (>800 GB)
FreeBSD         FreeBSD Mirror                               (>90 GB)
NetBSD          NetBSD Mirror                                (>55 GB)
OpenBSD         OpenBSD Mirror                               (>50 GB)
fedora          Fedora Linux Mirror                          (>32 GB)
redhat          RedHat Linux Mirror                          (>65 GB)
redhat-contrib  RedHat Contrib Mirror                          (7 GB)
debian          Debian Mirror                                (>90 GB)
debian-non-US   Debian non US Mirror                          (~2 GB)
slackware       Slackware Mirror                              (>8 GB)
suse            SuSE Mirror                                  (>40 GB)
gentoo          Gentoo Mirror                                (>30 GB)
gentoo-portage  Gentoo Linux Portage tree mirror             (~90 MB)
</quote>

The resons appear to be that they have more bandwidth than cpu, and perhaps do 
not like to disable -z completely because they know some users might need to 
use it sometimes, rather they ask that people dont use it.

I really dont think its fair to abuse this service we're getting for free from 
rhnet so im asking you to incorporate a small feature so that i and the rest of 
gentoo users in iceland can stop abusing our main mirror which is kindly 
provided to us.
We of course can just edit the source code but a make.conf optiton is better, 
its also alot simpler to provide new icelandic gentoo users with docs saying 
they should add one option rather than tell them to go edit the source code or 
provide a patch which needs to be kept up to date.

>>I think thats a valid reson,
>>Perhaps there could even be a SYNC_OPTIONS="" line where people could specify 
>>all options in case they need other uses.
>>
>>
>>>--
>>>gentoo-dev@gentoo.org mailing list
>>>
>>>
>>
>>--
>>gentoo-dev@gentoo.org mailing list

--
gentoo-dev@gentoo.org mailing list

[prev in list] [next in list] [prev in thread] [next in thread]