[prev in list] [next in list] [prev in thread] [next in thread] 

List:       avro-user
Subject:    Re: Map Reduce Jobs bound to "String" StringType
From:       Johannes Schulte <johannes.schulte () gmail ! com>
Date:       2013-08-13 20:31:45
Message-ID: CAKBEjTt9D9fi7gOwLX4qMJX5L-qd6J8cvNncg_3z8dLnLJt-Og () mail ! gmail ! com
[Download RAW message or body]

Doug, thanks for the response after such a long time. We're looking forward
to 1.7.5 and this feature.


On Tue, Aug 13, 2013 at 7:28 PM, Doug Cutting <cutting@apache.org> wrote:

> This is fixed in AVRO-1353 and will be in (soon to be released) 1.7.5.
>
> https://issues.apache.org/jira/browse/AVRO-1353
>
> Doug
>
> On Mon, Jun 3, 2013 at 9:18 AM, Johannes Schulte
> <johannes.schulte@gmail.com> wrote:
> > Hi,
> >
> > am I right with saying: When using the Map Reduce new API, there are
> always
> > Java Strings created for avro string types?
> >
> > I know about the "avro.string.type" property but even when leaving this
> > untouched, I get Strings.
> >
> > In AvroRecordReaderBase there is a ReflectDatumReader instantiated
> >
> >  mAvroFileReader = createAvroFileReader(seekableFileInput,
> >
> >         new ReflectDatumReader<T>(mReaderSchema));
> >
> >
> > and in this this method is always called:
> >
> >
> >   @Override
> >
> >   protected Object readString(Object old, Decoder in) throws IOException
> {
> >
> >     return super.readString(null, in).toString();
> >
> >   }
> >
> >
> > Is there a way to circumvent this and keep using Utf8?
> >
> >
> > Cheers,
> >
> >
> > Johannnes
> >
> >
> >
>

[Attachment #3 (text/html)]

<div dir="ltr">Doug, thanks for the response after such a long time. We&#39;re \
looking forward to 1.7.5 and this feature.</div><div class="gmail_extra"><br><br><div \
class="gmail_quote">On Tue, Aug 13, 2013 at 7:28 PM, Doug Cutting <span \
dir="ltr">&lt;<a href="mailto:cutting@apache.org" \
target="_blank">cutting@apache.org</a>&gt;</span> wrote:<br> <blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex">This is fixed in AVRO-1353 and will be in (soon to be \
released) 1.7.5.<br> <br>
<a href="https://issues.apache.org/jira/browse/AVRO-1353" \
target="_blank">https://issues.apache.org/jira/browse/AVRO-1353</a><br> <span \
class="HOEnZb"><font color="#888888"><br> Doug<br>
</font></span><div class="HOEnZb"><div class="h5"><br>
On Mon, Jun 3, 2013 at 9:18 AM, Johannes Schulte<br>
&lt;<a href="mailto:johannes.schulte@gmail.com">johannes.schulte@gmail.com</a>&gt; \
wrote:<br> &gt; Hi,<br>
&gt;<br>
&gt; am I right with saying: When using the Map Reduce new API, there are always<br>
&gt; Java Strings created for avro string types?<br>
&gt;<br>
&gt; I know about the &quot;avro.string.type&quot; property but even when leaving \
this<br> &gt; untouched, I get Strings.<br>
&gt;<br>
&gt; In AvroRecordReaderBase there is a ReflectDatumReader instantiated<br>
&gt;<br>
&gt;  mAvroFileReader = createAvroFileReader(seekableFileInput,<br>
&gt;<br>
&gt;         new ReflectDatumReader&lt;T&gt;(mReaderSchema));<br>
&gt;<br>
&gt;<br>
&gt; and in this this method is always called:<br>
&gt;<br>
&gt;<br>
&gt;   @Override<br>
&gt;<br>
&gt;   protected Object readString(Object old, Decoder in) throws IOException {<br>
&gt;<br>
&gt;     return super.readString(null, in).toString();<br>
&gt;<br>
&gt;   }<br>
&gt;<br>
&gt;<br>
&gt; Is there a way to circumvent this and keep using Utf8?<br>
&gt;<br>
&gt;<br>
&gt; Cheers,<br>
&gt;<br>
&gt;<br>
&gt; Johannnes<br>
&gt;<br>
&gt;<br>
&gt;<br>
</div></div></blockquote></div><br></div>



[prev in list] [next in list] [prev in thread] [next in thread]