[prev in list] [next in list] [prev in thread] [next in thread]
List: kde-edu
Subject: Re: Replacing file-system by database in KStars
From: Vijay Dhameliya <vijay.atwork13 () gmail ! com>
Date: 2014-01-28 20:57:49
Message-ID: CAH-KMQijztGeMzrp2dw+gvMSkWaXEK9dXO9ihJr-kv7fSRXRTA () mail ! gmail ! com
[Download RAW message or body]
[Attachment #2 (multipart/alternative)]
Hi
HDF5 is sure faster and we can store scientific data in data object and
multidimensional array in it.
But when it comes to KStars, the data we are dealing with is not in such
formats and can be more easily dealt with in rational database system since
data of each type of Skyobject can be stored in corresponding table (each
skyobject as one record). So using sql database is more suitable option in
my opinion.
And is it good idea to store downloaded images in database instead of
appdata ?
Regards,
Vijay Dhameliya
On Wed, Jan 29, 2014 at 12:53 AM, Tomaz Canabrava <tcanabrava@kde.org>wrote:
> A Database is better than the HDF5 approach?
> HDF5 is designed to be a very fast file format for scientific data, kstars
> falls into that category.
>
>
> On Tue, Jan 28, 2014 at 7:03 AM, Vijay Dhameliya <vijay.atwork13@gmail.com
> > wrote:
>
>> Hi
>>
>> Thank you very much Macro for giving clue of the way to do it. I agree
>> with you that plan and diagram for workflow is must. I shall first plan and
>> start preparing diagram of database structure for KStars.
>>
>> I will soon prepare rough diagram of flow and share with you so you can
>> give your suggestion and so on. And we can improve it to level best as
>> KStars team give suggestions.
>>
>> BTW I have good experience with development of Database Managment in Qt
>> and I hope it will help us here :)
>>
>>
>> On Tue, Jan 28, 2014 at 2:14 PM, Marco Calignano <
>> marco.calignano@gmail.com> wrote:
>>
>>> HI!
>>>
>>> I also think a database is a better approach than a file base system.
>>> But you didn't address the first and biggest think to do. Before you can
>>> start coding you should really plan your database.
>>> To create a database it is a real big work. You need to plan in advance
>>> even for feature are not at the horizon yet. If you plan it correctly you
>>> can then include localization as well.
>>> I was thinking to jump on KStar to help, so maybe this is my cue. I will
>>> have to learn how the data are structured and I can help with the database
>>> development. But I would like to see some diagram here in the Kde-Edu list.
>>> So that all the KStar team can also have a look and give their opinion.
>>>
>>> Cheers
>>> Marco
>>>
>>>
>>> On Tue, Jan 28, 2014 at 4:39 AM, Alexander Wolf <alex.v.wolf@gmail.com>wrote:
>>>
>>>> Hi!
>>>>
>>>> 2014-01-28 Vijay Dhameliya <vijay.atwork13@gmail.com>
>>>>
>>>> Currently when KStars is launched, it reads data corresponding to
>>>>> different Skyobject from respective file in loaddata() methods. And I have
>>>>> tracked out all the classes where we are loading data by reading file.
>>>>>
>>>>> I researched bit on the topic and I found that loading data from
>>>>> database is always much better option then doing same from file.
>>>>>
>>>>> If we replace file system with QSql following are the Pros:
>>>>>
>>>>> 1) We will not have to ship so many files with Kstars
>>>>> 2) Loading from database is quicker than doing same from file
>>>>> 3) Code for load methods will be reduced in size
>>>>>
>>>>> Cons:
>>>>> 1) I will have to move all data from files into database by temporary
>>>>> methods
>>>>>
>>>>> So I am planning to start coding to replace file system by database on
>>>>> my local branch.
>>>>>
>>>>> Can you please give your views and suggestion regarding the same ? I
>>>>> am sure that It will be very helpful to me. :)
>>>>>
>>>>
>>>> What about localization support for strings (like names of DSO) from
>>>> those files?
>>>>
>>>> --
>>>> With best regards, Alexander
>>>>
>>>> _______________________________________________
>>>> kde-edu mailing list
>>>> kde-edu@mail.kde.org
>>>> https://mail.kde.org/mailman/listinfo/kde-edu
>>>>
>>>>
>>>
>>>
>>> --
>>> Life is short, so learn from your mistakes
>>> And stand behind, the choices that you make
>>>
>>> Face each day with both eyes open wide
>>> And try to give don't keep it all inside
>>>
>>> Dream Theater
>>>
>>>
>>> _______________________________________________
>>> kde-edu mailing list
>>> kde-edu@mail.kde.org
>>> https://mail.kde.org/mailman/listinfo/kde-edu
>>>
>>>
>>
>> _______________________________________________
>> kde-edu mailing list
>> kde-edu@mail.kde.org
>> https://mail.kde.org/mailman/listinfo/kde-edu
>>
>>
>
> _______________________________________________
> kde-edu mailing list
> kde-edu@mail.kde.org
> https://mail.kde.org/mailman/listinfo/kde-edu
>
>
[Attachment #5 (text/html)]
<div dir="ltr">Hi<div><br></div><div>HDF5 is sure faster and we can store scientific \
data in data object and multidimensional array in it. </div><div><br></div><div>But \
when it comes to KStars, the data we are dealing with is not in such formats and can \
be more easily dealt with in rational database system since data of each type of \
Skyobject can be stored in corresponding table (each skyobject as one record). So \
using sql database is more suitable option in my opinion.</div>
<div class="gmail_extra"><br></div><div class="gmail_extra">And is it good idea to \
store downloaded images in database instead of appdata ?<br><br></div><div \
class="gmail_extra">Regards,</div><div class="gmail_extra">Vijay Dhameliya</div> <div \
class="gmail_extra"><br><div class="gmail_quote">On Wed, Jan 29, 2014 at 12:53 AM, \
Tomaz Canabrava <span dir="ltr"><<a href="mailto:tcanabrava@kde.org" \
target="_blank">tcanabrava@kde.org</a>></span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"> <div dir="ltr"><div>A Database is better than the HDF5 \
approach?<br></div><div>HDF5 is designed to be a very fast file format for scientific \
data, kstars falls into that category.<br></div></div><div class="HOEnZb"><div \
class="h5"> <div class="gmail_extra"><br>
<br><div class="gmail_quote">On Tue, Jan 28, 2014 at 7:03 AM, Vijay Dhameliya <span \
dir="ltr"><<a href="mailto:vijay.atwork13@gmail.com" \
target="_blank">vijay.atwork13@gmail.com</a>></span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex">
<div dir="ltr">Hi<div><br></div><div>Thank you very much Macro for giving clue of the \
way to do it. I agree with you that plan and diagram for workflow is must. I shall \
first plan and start preparing diagram of database structure for KStars. </div>
<div><br></div><div>I will soon prepare rough diagram of flow and share with you so \
you can give your suggestion and so on. And we can improve it to level best as KStars \
team give suggestions.</div><div><br>BTW I have good experience with development of \
Database Managment in Qt and I hope it will help us here :)</div>
<div><div>
<div><br></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jan 28, \
2014 at 2:14 PM, Marco Calignano <span dir="ltr"><<a \
href="mailto:marco.calignano@gmail.com" \
target="_blank">marco.calignano@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div dir="ltr">HI!<div><br></div><div>I also think a database \
is a better approach than a file base system. But you didn't address the first \
and biggest think to do. Before you can start coding you should really plan your \
database.</div>
<div>To create a database it is a real big work. You need to plan in advance even for \
feature are not at the horizon yet. If you plan it correctly you can then include \
localization as well. </div><div>I was thinking to jump on KStar to help, so maybe \
this is my cue. I will have to learn how the data are structured and I can help with \
the database development. But I would like to see some diagram here in the Kde-Edu \
list.</div>
<div>So that all the KStar team can also have a look and give their \
opinion.</div><div><br></div><div>Cheers</div><div>Marco</div><div \
class="gmail_extra"><br><br><div class="gmail_quote"><div><div>On Tue, Jan 28, 2014 \
at 4:39 AM, Alexander Wolf <span dir="ltr"><<a href="mailto:alex.v.wolf@gmail.com" \
target="_blank">alex.v.wolf@gmail.com</a>></span> wrote:<br>
</div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px \
#ccc solid;padding-left:1ex"><div><div><div dir="ltr">Hi!<br><div \
class="gmail_extra"><br><div class="gmail_quote">2014-01-28 Vijay Dhameliya <span \
dir="ltr"><<a href="mailto:vijay.atwork13@gmail.com" \
target="_blank">vijay.atwork13@gmail.com</a>></span><div>
<div><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div dir="ltr">Currently when KStars is launched, it reads \
data corresponding to different Skyobject from respective file in loaddata() methods. \
And I have tracked out all the classes where we are loading data by reading file. \
<div><br></div><div>I researched bit on the topic and I found that loading data from \
database is always much better option then doing same from file. \
</div><div><br></div><div>If we replace file system with QSql following are the \
Pros:</div>
<div><br></div><div>1) We will not have to ship so many files with \
Kstars</div><div>2) Loading from database is quicker than doing same from \
file</div><div>3) Code for load methods will be reduced in size</div><div><br></div>
<div>Cons:</div><div>1) I will have to move all data from files into database by \
temporary methods </div><div><br></div><div>So I am planning to start coding to \
replace file system by database on my local branch. </div><div>
<br></div><div>Can you please give your views and suggestion regarding the same ? I \
am sure that It will be very helpful to me. \
:)</div></div></blockquote><div><br></div></div></div><div>What about localization \
support for strings (like names of DSO) from those files?</div>
<div><br></div><div>--</div><div>With best regards, Alexander \
</div></div></div></div> \
<br></div></div><div>_______________________________________________<br> kde-edu \
mailing list<br> <a href="mailto:kde-edu@mail.kde.org" \
target="_blank">kde-edu@mail.kde.org</a><br> <a \
href="https://mail.kde.org/mailman/listinfo/kde-edu" \
target="_blank">https://mail.kde.org/mailman/listinfo/kde-edu</a><br> \
<br></div></blockquote></div><span><font color="#888888"><br><br \
clear="all"><div><br></div>-- <br><div>Life is short, so learn from your mistakes \
</div><div>And stand behind, the choices that you make </div> \
<div><br></div><div>Face each day with both eyes open wide <br> </div><div>And try to \
give don't keep it all inside </div><div><br></div><div> \
Dream Theater</div><div><br></div> </font></span></div></div>
<br>_______________________________________________<br>
kde-edu mailing list<br>
<a href="mailto:kde-edu@mail.kde.org" target="_blank">kde-edu@mail.kde.org</a><br>
<a href="https://mail.kde.org/mailman/listinfo/kde-edu" \
target="_blank">https://mail.kde.org/mailman/listinfo/kde-edu</a><br> \
<br></blockquote></div><br></div></div></div></div> \
<br>_______________________________________________<br> kde-edu mailing list<br>
<a href="mailto:kde-edu@mail.kde.org" target="_blank">kde-edu@mail.kde.org</a><br>
<a href="https://mail.kde.org/mailman/listinfo/kde-edu" \
target="_blank">https://mail.kde.org/mailman/listinfo/kde-edu</a><br> \
<br></blockquote></div><br></div> \
</div></div><br>_______________________________________________<br> kde-edu mailing \
list<br> <a href="mailto:kde-edu@mail.kde.org">kde-edu@mail.kde.org</a><br>
<a href="https://mail.kde.org/mailman/listinfo/kde-edu" \
target="_blank">https://mail.kde.org/mailman/listinfo/kde-edu</a><br> \
<br></blockquote></div><br></div></div>
_______________________________________________
kde-edu mailing list
kde-edu@mail.kde.org
https://mail.kde.org/mailman/listinfo/kde-edu
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic