[prev in list] [next in list] [prev in thread] [next in thread] 

List:       pgsql-hackers
Subject:    Re: [Proposal] Page Compression for OLTP
From:       vignesh C <vignesh21 () gmail ! com>
Date:       2023-01-31 17:49:20
Message-ID: CALDaNm04RD4EJiS32VXQEyf4sHzgfzopmgykpSm4hOBQisCWMQ () mail ! gmail ! com
[Download RAW message or body]

On Fri, 4 Nov 2022 at 07:02, Ian Lawrence Barwick <barwick@gmail.com> wrote=
:
>
> 2022=E5=B9=B47=E6=9C=8827=E6=97=A5(=E6=B0=B4) 2:47 chenhj <chjischj@163.c=
om>:
> >
> > Hi hackers,
> >
> > I have rebase this patch and made some improvements.
> >
> >
> > 1. A header is added to each chunk in the pcd file, which records the c=
hunk of which block the chunk belongs to, and the checksum of the chunk.
> >
> >   Accordingly, all pages in a compressed relation are stored in compres=
sed format, even if the compressed page is larger than BLCKSZ.
> >
> >   The maximum space occupied by a compressed page is BLCKSZ + chunk_siz=
e (exceeding this range will report an error when writing the page).
> >
> > 2. Repair the pca file through the information recorded in the pcd when=
 recovering from a crash
> >
> > 3. For compressed relation, do not release the free blocks at the end o=
f the relation (just like what old_snapshot_threshold does), reducing the r=
isk of data inconsistency between pcd and pca file.
> >
> > 4. During backup, only check the checksum in the chunk header for the p=
cd file, and avoid assembling and decompressing chunks into the original pa=
ge.
> >
> > 5. bugfix, doc, code style and so on
> >
> >
> > And see src/backend/storage/smgr/README.compression for detail
> >
> >
> > Other
> >
> > 1. remove support of default compression option in tablespace, I'm not =
sure about the necessity of this feature, so don't support it for now.
> >
> > 2. pg_rewind currently does not support copying only changed blocks fro=
m pcd file. This feature is relatively independent and could be implemented=
 later.
>
> Hi
>
> cfbot reports the patch no longer applies.  As CommitFest 2022-11 is
> currently underway, this would be an excellent time to update the patch.

There has been no updates on this thread for some time, so this has
been switched as Returned with Feedback. Feel free to open it in the
next commitfest if you plan to continue on this.

Regards,
Vignesh


[prev in list] [next in list] [prev in thread] [next in thread]