[prev in list] [next in list] [prev in thread] [next in thread] 

List:       avro-user
Subject:    Re: file format stable?
From:       Doug Cutting <cutting () apache ! org>
Date:       2010-03-12 18:56:50
Message-ID: 4B9A8E72.5060600 () apache ! org
[Download RAW message or body]

Scott Carey wrote:
> * Large records -- the final block size has to be known before writing, currently \
> this is done by buffering in memory while writing.

A back-compatible format extension that would help here is, if the block 
size is negative, then its absolute value is the size of the next chunk 
in the block.  In other words, a block would continue until a chunk is 
found whose length is positive.

Doug


[prev in list] [next in list] [prev in thread] [next in thread]