[prev in list] [next in list] [prev in thread] [next in thread] 

List:       sqlite-users
Subject:    Re: [sqlite] SQLite vs. Oracle (parallelized)
From:       python () bdurham ! com
Date:       2009-02-27 21:31:37
Message-ID: 1235770297.12817.1302798539 () webmail ! messagingengine ! com
[Download RAW message or body]

Alexey,

Thank you for your reply and for sharing your success with SQLite. I'm
excited by your results (60x faster). On an informal basis, we've been
going back and re-benchmarking some of our old, 'traditional'
(Oracle/Informatica) ETL/DW projects and we now believe the majority of
these systems could be simplified and made faster by using alternative
techniques based on in-memory data processing (definitely) and/or SQLite
(we still need to test). 

Your approach of splitting large data sets sounds similar to what other
SQLite users with large data sets seem to be doing. At a high level,
this sounds like how one would partition data using Oracle? I'm going to
start a new thread on this topic.

> With your hardware I think 100Gb dataset is not limit.

Good news. I'm looking forward to verifying this over the next month or
so.

Best regards,
Malcolm
_______________________________________________
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
[prev in list] [next in list] [prev in thread] [next in thread]