[prev in list] [next in list] [prev in thread] [next in thread] 

List:       lucene-dev
Subject:    Re: ParallelReader
From:       Chuck Williams <chuck () allthingslocal ! com>
Date:       2005-04-28 21:54:10
Message-ID: 42715B82.1040702 () allthingslocal ! com
[Download RAW message or body]

Doug Cutting writes (4/28/2005 2:19 PM):

> Please find attached something I wrote today.  It has not been yet 
> tested extensively, and the documentation could be improved, but I 
> thought it would be good to get comments sooner rather than later.
>
> Would folks find this useful?

Yes, very useful, especially if you added one additional feature that 
looks straightforward from the code below.  That is a facility to append 
the stored fields from the non-storedFieldReaders to the Document 
on-demand.  This would solve a problem that has hit me several times, 
and that others on the list seemed to have encountered as well.  If a 
document contains a bunch of small stored meta-data fields that are used 
for categorization purposes, and one or a few large stored ontent 
fields, then it can be important to be able to scan a large number of 
results quickly for purposes of analyzing the categorical fields.  This 
is currently slowed down by the unnecessary loading of the content 
field(s).  The ability to ignore the stored fields in certain readers 
below solves this, but I didn't see a way to access those fields when 
they are needed (e.g.., for highlighting or browsing a result -- 
something done on much fewer of the results).

>
> Should it go into the core or in contrib?

Seems worth of the core to me.

Very cool,

Chuck


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org

[prev in list] [next in list] [prev in thread] [next in thread]