[prev in list] [next in list] [prev in thread] [next in thread] 

List:       postgresql-admin
Subject:    Re: Insert 1 million data
From:       Olivier Gautherot <ogautherot () gautherot ! net>
Date:       2020-12-29 12:33:27
Message-ID: CAJ7S9TX0smQF6_hNf3EbcPGGeKYQpHwdUmyXsnFo7hhASiq3CA () mail ! gmail ! com
[Download RAW message or body]

Hi Sreejit,

On Tue, Dec 29, 2020 at 10:56 AM Sreejith P <sreejith@lifetrenz.com> wrote:

> Thanks Rohit.
>
>
>
> After upgrading volume getting following error. Almost same as previous
> one.
>
>
>
> We have increased backup volume and run the Job Again . When I reach 900
> thousand records,  getting almost similar error again.
>
>
>
>    - Do I need to turn off auto vaccum ?
>    - Shall increase maintance work mem ?
>
>
If you're tight on space, my recommendation would be to run the inserts in
small batches (say 10,000 at a time). Don't turn off autovaccum, ever :-)

That being said, if you're suffering this way when creating your database,
my inclination would be to move it with its logs to a disk with more space.
Your server has no scalability and you'll suffer more dramatic crashes very
quickly.

My cent worth...
--
Olivier Gautherot

[Attachment #3 (text/html)]

<div dir="ltr"><div dir="ltr">Hi Sreejit,</div><br><div class="gmail_quote"><div \
dir="ltr" class="gmail_attr">On Tue, Dec 29, 2020 at 10:56 AM Sreejith P &lt;<a \
href="mailto:sreejith@lifetrenz.com">sreejith@lifetrenz.com</a>&gt; \
wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px \
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">





<div lang="EN-IN" style="overflow-wrap: break-word;">
<div class="gmail-m_-1956215940114154117WordSection1">
<p class="MsoNormal"><span>Thanks Rohit.<u></u><u></u></span></p>
<p class="MsoNormal"><span><u></u>  <u></u></span></p>
<p class="MsoNormal"><span>After upgrading volume getting following error. Almost \
same as previous one.<u></u><u></u></span></p> <p class="MsoNormal"><span><u></u>  \
<u></u></span></p> <div \
style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid \
rgb(181,196,223);padding:3pt 0cm 0cm"> <p class="MsoNormal"><span \
style="color:black">We have increased backup volume and run the Job Again . When I \
reach 900 thousand records,   getting almost similar error again.  \
<u></u><u></u></span></p> <p class="MsoNormal"><span style="color:black">  \
<u></u><u></u></span></p> <ul style="margin-top:0cm" type="disc">
<li class="gmail-m_-1956215940114154117MsoListParagraph" \
style="color:black;margin-left:0cm"> Do I need to turn off auto vaccum \
?<u></u><u></u></li><li class="gmail-m_-1956215940114154117MsoListParagraph" \
style="color:black;margin-left:0cm"> Shall increase maintance work mem ?  \
</li></ul></div></div></div></blockquote><div><br></div><div>If you&#39;re tight on \
space, my recommendation would be to run the inserts in small batches (say 10,000 at \
a time). Don&#39;t turn off autovaccum, ever :-)</div><div><br></div><div>That being \
said, if you&#39;re suffering this way when creating your database, my inclination \
would be to move it with its logs to a disk with more space. Your server has no \
scalability and you&#39;ll suffer more dramatic crashes very \
quickly.</div><div><br></div><div>My cent worth...</div><div dir="ltr">--</div><div \
dir="ltr">Olivier Gautherot</div><div dir="ltr"></div><div>  </div></div></div>



[prev in list] [next in list] [prev in thread] [next in thread]