[prev in list] [next in list] [prev in thread] [next in thread] 

List:       rsync
Subject:    variable compression feature request
From:       griffin tucker via rsync <rsync () lists ! samba ! org>
Date:       2021-09-04 9:36:38
Message-ID: CAKJX5A5YtUJ2L_WQK6P-PRjrCdSiKK=MDyaKvh4ou3wffm3k7g () mail ! gmail ! com
[Download RAW message or body]

--compress or -z will compress during data transfer

what about a variable compression rate?

--optimal-compress or -za

monitor the speed of the transfer and the cpu throughput and
automatically find the optimum compression in almost-real-time with
the goal of reduced transfer time

i figure you'd have to mark the last block compressed/sent with extra
data indicating new blocks are using a different compression strength,
and it could work for using multiple algorithms, depending on the data

when decompressing, when detecting a new block, it will indicate
corruption in the archive, but the extra data will revert the error
indication - the `corruption' would only be up until the last block,
so the data remains intact, and the new rate/algo can begin after the
`failed' block

finding the type of data that can be compressed better/faster with
different algorithms will also be taken into account

just an idea

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[prev in list] [next in list] [prev in thread] [next in thread]