[prev in list] [next in list] [prev in thread] [next in thread]
List: postgis-users
Subject: Re: [postgis-users] parallel spatial calculation
From: David Haynes <haynesd2 () gmail ! com>
Date: 2018-08-24 19:13:42
Message-ID: CAM4C04qiPrkKatkaFPmCQxqsyhdVnsTHJ74QHXrqxKt4g=XF6A () mail ! gmail ! com
[Download RAW message or body]
[Attachment #2 (multipart/alternative)]
Thanks for the input.
My understanding of the parallel capabilities of PostgreSQL is somewhat
limited, but I believe the workers are done at the query level, without
partitioning. This likely result in different query performances compared
to a dataset that is partitioned. Also, the partitions scheme used on
spatial dataset can have a great effect on the performance of the spatial
query that you run. It is something I'm very interested in and I didn't
know if anyone in this group was working in this area.
On Thu, Aug 23, 2018 at 7:15 AM Cedric Duprez <Cedric.Duprez@ign.fr> wrote:
> Hi David,
>
> I remember two good posts on Paul Ramsey's blog explaining query
> parallelism and PostGIS :
>
> - http://blog.cleverelephant.ca/2017/10/parallel-postgis-2.html
> - http://blog.cleverelephant.ca/2017/11/parallel-postgis-2A.html
>
> I hope it helps you.
>
> Regards.
>
> Le 22/08/2018 à 22:09, David Haynes a écrit :
>
> Hello,
>
> I have a few questions regarding parallel spatial calculations.
>
> Since PostgreSQL 10 is allowing for multiple workers is there any work on
> allowing parallel spatial calculations? Is there anyone potentially looking
> at VoltDB as a potential place for testing any parallel spatial
> calculations. VoltDB's spatial capabilities are completely undeveloped but
> it might be a place to start.
>
>
> _______________________________________________
> postgis-users mailing \
> listpostgis-users@lists.osgeo.orghttps://lists.osgeo.org/mailman/listinfo/postgis-users
>
> ​
> _______________________________________________
> postgis-users mailing list
> postgis-users@lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/postgis-users
[Attachment #5 (text/html)]
<div dir="ltr">Thanks for the input. <div class="cye-lm-tag"><br><div \
class="cye-lm-tag">My understanding of the parallel capabilities of PostgreSQL is \
somewhat limited, but I believe the workers are done at the query level, without \
partitioning. This likely result in different query performances compared to a \
dataset that is partitioned. Also, the partitions scheme used on spatial dataset can \
have a great effect on the performance of the spatial query that you run. It is \
something I'm very interested in and I didn't know if anyone in this group \
was working in this area.</div><div class="cye-lm-tag"><br></div></div></div><br><div \
class="gmail_quote"><div dir="ltr">On Thu, Aug 23, 2018 at 7:15 AM Cedric Duprez \
<<a href="mailto:Cedric.Duprez@ign.fr">Cedric.Duprez@ign.fr</a>> \
wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 \
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF">
<div class="m_6408321556091094918markdown-here-wrapper">
<p style="margin:0px 0px 1.2em!important">Hi David,</p>
<p style="margin:0px 0px 1.2em!important">I remember two good posts on Paul Ramsey's \
blog explaining query parallelism and PostGIS :</p> <ul style="margin:1.2em \
0px;padding-left:2em"> <li style="margin:0.5em 0px"><a \
href="http://blog.cleverelephant.ca/2017/10/parallel-postgis-2.html" \
target="_blank">http://blog.cleverelephant.ca/2017/10/parallel-postgis-2.html</a> \
</li><li style="margin:0.5em 0px"><a \
href="http://blog.cleverelephant.ca/2017/11/parallel-postgis-2A.html" \
target="_blank">http://blog.cleverelephant.ca/2017/11/parallel-postgis-2A.html</a> \
</li></ul> <p style="margin:0px 0px 1.2em!important">I hope it helps you.</p>
<p style="margin:0px 0px 1.2em!important">Regards.</p>
<p style="margin:0px 0px 1.2em!important">Le 22/08/2018 Ã 22:09, David Haynes a \
écrit :</p> <p style="margin:0px 0px 1.2em!important"></p>
<div class="m_6408321556091094918markdown-here-exclude">
<p></p>
<blockquote type="cite">
<div dir="ltr">Hello,
<div><br>
</div>
<div>I have a few questions regarding parallel spatial calculations.</div>
<div class="m_6408321556091094918cye-lm-tag"><br>
</div>
<div class="m_6408321556091094918cye-lm-tag">Since PostgreSQL 10 is allowing for \
multiple workers is there any work on allowing parallel spatial calculations? Is \
there anyone potentially looking at VoltDB as a potential place for testing any \
parallel spatial calculations. VoltDB's spatial capabilities are completely \
undeveloped but it might be a place to start.</div> </div>
<br>
<fieldset class="m_6408321556091094918mimeAttachmentHeader"></fieldset> <br>
<pre>_______________________________________________
postgis-users mailing list
<a class="m_6408321556091094918moz-txt-link-abbreviated" \
href="mailto:postgis-users@lists.osgeo.org" \
target="_blank">postgis-users@lists.osgeo.org</a> <a \
class="m_6408321556091094918moz-txt-link-freetext" \
href="https://lists.osgeo.org/mailman/listinfo/postgis-users" \
target="_blank">https://lists.osgeo.org/mailman/listinfo/postgis-users</a></pre> \
</blockquote> <p></p>
</div>
<p style="margin:0px 0px 1.2em!important"></p>
<div title="MDH:SGkgRGF2aWQsPGJyPjxicj5JIHJlbWVtYmVyIHR3byBnb29kIHBvc3RzIG9uIFBhdWwgUm \
Ftc2V5J3MgYmxvZyBleHBsYWluaW5nIHF1ZXJ5IHBhcmFsbGVsaXNtIGFuZCBQb3N0R0lTIDo8YnI+KiBo \
dHRwOi8vYmxvZy5jbGV2ZXJlbGVwaGFudC5jYS8yMDE3LzEwL3BhcmFsbGVsLXBvc3RnaXMtMi5o \
dG1sPGJyPiogaHR0cDovL2Jsb2cuY2xldmVyZWxlcGhhbnQuY2EvMjAxNy8xMS9wYXJhbGxlbC1w \
b3N0Z2lzLTJBLmh0bWw8YnI+PGJyPkkgaG9wZSBpdCBoZWxwcyB5b3UuPGJyPjxicj5SZWdhcmRz \
Ljxicj48ZGl2IGNsYXNzPSJtb3otc2lnbmF0dXJlIj48YnI+PGJyPjwvZGl2PjxkaXYgY2xhc3M9 \
Im1vei1jaXRlLXByZWZpeCI+TGUgMjIvMDgvMjAxOCDDoCAyMjowOSwgRGF2aWQgSGF5bmVzIGEg \
w6ljcml0Jm5ic3A7Ojxicj48L2Rpdj48YmxvY2txdW90ZSB0eXBlPSJjaXRlIiBjaXRlPSJtaWQ6 \
Q0FNNEMwNHB3Qlg5cm44QWtLcXdOVjgyQzZuYzNCVTRUSHBnVFBRLTBMPU1LLUZGU3FRQG1haWwu \
Z21haWwuY29tIj48bWV0YSBodHRwLWVxdWl2PSJDb250ZW50LVR5cGUiIGNvbnRlbnQ9InRleHQv \
aHRtbDsgIj48ZGl2IGRpcj0ibHRyIj5IZWxsbyw8ZGl2Pjxicj48L2Rpdj48ZGl2PkkgaGF2ZSBh \
IGZldyBxdWVzdGlvbnMgcmVnYXJkaW5nIHBhcmFsbGVsIHNwYXRpYWwgY2FsY3VsYXRpb25zLjwv \
ZGl2PjxkaXYgY2xhc3M9ImN5ZS1sbS10YWciPjxicj48L2Rpdj48ZGl2IGNsYXNzPSJjeWUtbG0t \
dGFnIj5TaW5jZSBQb3N0Z3JlU1FMIDEwIGlzIGFsbG93aW5nIGZvciBtdWx0aXBsZSB3b3JrZXJz \
IGlzIHRoZXJlIGFueSB3b3JrIG9uIGFsbG93aW5nIHBhcmFsbGVsIHNwYXRpYWwgY2FsY3VsYXRp \
b25zPyBJcyB0aGVyZSBhbnlvbmUgcG90ZW50aWFsbHkgbG9va2luZyBhdCBWb2x0REIgYXMgYSBw \
b3RlbnRpYWwgcGxhY2UgZm9yIHRlc3RpbmcgYW55IHBhcmFsbGVsIHNwYXRpYWwgY2FsY3VsYXRp \
b25zLiBWb2x0REIncyBzcGF0aWFsIGNhcGFiaWxpdGllcyBhcmUgY29tcGxldGVseSB1bmRldmVs \
b3BlZCBidXQgaXQgbWlnaHQgYmUgYSBwbGFjZSB0byBzdGFydC48L2Rpdj48L2Rpdj4KCjxicj48 \
ZmllbGRzZXQgY2xhc3M9Im1pbWVBdHRhY2htZW50SGVhZGVyIj48L2ZpZWxkc2V0Pjxicj48cHJl \
IHdyYXA9IiI+X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18K \
cG9zdGdpcy11c2VycyBtYWlsaW5nIGxpc3QKcG9zdGdpcy11c2Vyc0BsaXN0cy5vc2dlby5vcmcK \
aHR0cHM6Ly9saXN0cy5vc2dlby5vcmcvbWFpbG1hbi9saXN0aW5mby9wb3N0Z2lzLXVzZXJzPC9w
cmU+Cgo8L2Jsb2NrcXVvdGU+PGJyPg==" \
style="height:0;width:0;max-height:0;max-width:0;overflow:hidden;font-size:0em;padding:0;margin:0">
​</div>
</div>
</div>
_______________________________________________<br>
postgis-users mailing list<br>
<a href="mailto:postgis-users@lists.osgeo.org" \
target="_blank">postgis-users@lists.osgeo.org</a><br> <a \
href="https://lists.osgeo.org/mailman/listinfo/postgis-users" rel="noreferrer" \
target="_blank">https://lists.osgeo.org/mailman/listinfo/postgis-users</a></blockquote></div>
[Attachment #6 (text/plain)]
_______________________________________________
postgis-users mailing list
postgis-users@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/postgis-users
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic