[prev in list] [next in list] [prev in thread] [next in thread] 

List:       quanta
Subject:    Re: [Quanta] Quanta and CPU/Memory consumption
From:       James Ellis <james.ellis () gmail ! com>
Date:       2008-05-21 6:09:35
Message-ID: 200805211609.35429.james () webqs ! com
[Download RAW message or body]

Hi

I agree that the project size could be an issue, unfortunately I don't have 
control over the size with some projects. Some have been inherited from 
another developer whose "logic" was one file per "task"... delete_foo.php, 
create_foo.php

As mentioned elsewhere I could divide up the projects in some of the larger 
cases, see if that assists with things.

I'll try the file extension mask to see if that helps things as well. I do 
know that one of my projects stores generated images without file extensions, 
though.

All my projects use Bazaar for version control and release management is done 
via Bazaar on a testing system then to a production system. For some projects 
where I am the only developer the bzr upload plugin is used to sync changed 
files with a site via FTP.

Thanks
James

On Wed, 21 May 2008 02:48:34 pm Eric Laffoon wrote:
> On Tuesday 20 May 2008 5:50:34 pm James Ellis wrote:
> > ok, here's some more info:
> >
> > Symptoms:
> > * Quanta uses between 50 and 99% of CPU and about 4-7% of memory on
> > startup, loading up medium to large projects (> 1000 files). The system
> > is fine at other times.
>
> As I mentioned, quite unusual... As was also mentioned 1000+ file projects
> are also not exactly common. I thought mine were bad with maybe 1000 and
> startup on my machine is about a second or two, taking the most time to
> load files from the last session.
>
> > * Running an strace on the pid shows Quanta is doing various filesystem
> > operations like fstat64, lstat64, chdir, stat64, open, readlink etc etc.
> > For large projects with symlinks this can take 5 to 10 minutes to
> > complete. Would it be correct to assume this is to populate the file
> > tree, among other things ?
>
> I would have to check with Andras as he is much more familiar with the
> code, or dig in myself. I don't have a lot of time for that, plus we're
> working onKDE4 versions. What I'd like to do is make sure not to port any
> problems first of all.
>
> > Projects:
> > * There are some projects I work on which I don't have control over the
> > amount of files
> > * Some projects are a split about 80/20 images/text
> > * Some projects have symlinks to other filesystem locations
> >
> > System:
> > * Intel(R) Pentium(R) M processor 1600MHz
> > * 1.2GB RAM
> > * Quanta 3.5.9
> > * KDE 3.5.9 / 4.0.4 (happens in both)
> > * Kubuntu 8.04, fully updated
> > Other software running at the same time (that use similar resources)
> > * Kontact, Xorg, Firefox.
> >
> > Ways I have tried to fix:
> > * reorganise any symlinks to avoid possible recursion
> > * alter the Project Properties to ignore symlinks and non text files
> > (never open jpg's in Quanta, anyway) but these options don't seem to be
> > available
>
> You can set file filters based on extentions.
>
> > * make sure no other processes are causing the problem, they aren't.
> >
> > My questions:
> > * Is it possible to ignore symlinks per project ? Some symlinks are
> > placeholders to other directories in the same project - to aid with web
> > server setup. Symlinks could then be just denoted in the tree view rather
> > than followed ?
> > * Is it possible to have an option like "include only text files" or
> > "exclude binary files" in the Project Properties, rather than the "Insert
> > only markup, script and image files" and "Insert files with the following
> > mask" in the New Project widget. Neither of the current options are valid
> > for me, especially as files may be named with various extensions.
> > * Could there be a minimal startup option - to just show files,
> > directories and symlinks in the tree. I don't really mind if the icons
> > are not correct for the file type or if the parser finds an error (I
> > handle parser errors in various other tests). As long as I can get a file
> > tree representation and click on the files to open them quickly, it's
> > good enough for me. I noticed there are some other treeview plugins for
> > Kate floating around the web - maybe one of those could be an option to
> > investigate ?
> >
> > Any other info needed, feel free to ask me.
> >
> > Thanks
> > james
>
> Another question would be your actual management of the project. For
> instance, are you using the upload management in Quanta or are you using an
> RCS or other system? The point being, if you are using SVN to manage your
> project then technically you could also use just the file tree with
> topfolders and skip the use of the project.
>
> In KDE4 one of the things I want to implement is the ability to set
> profiles that limit the exposure of files and interface components by user
> and task. These would be managed, so it would extend the abilities. In your
> case I suspect (and had from the start) it may be more an issue with the
> size of the project. It would be much faster for Andras to look at the
> code, and it's also possible things like the distribution internal
> selection of file management and configuration could be an issue. There are
> several programs that could be configured in a way to be redundant or
> create issues which would require a recompile, but I can't be at all sure
> if that's the case. Also the tree widget can begin to absorb resources and
> cycles with large data sets... However while this was in issue with
> Kommander and interfacing loops with QStrings it seems very unlikely it
> would be with Quanta.
>
> If Andras can give some feedback or test with large projects that would
> help. I'll also ask independent of this thread on the list.
>
_______________________________________________
Quanta mailing list
Quanta@mail.kde.org
https://mail.kde.org/mailman/listinfo/quanta
[prev in list] [next in list] [prev in thread] [next in thread]