[prev in list] [next in list] [prev in thread] [next in thread]
List: avro-user
Subject: Re: Avro sample/test files
From: Sam Groth <sgroth () yahoo-inc ! com>
Date: 2015-12-14 3:18:37
Message-ID: 135421678.537655.1450063117587.JavaMail.yahoo () mail ! yahoo ! com
[Download RAW message or body]
You can create avro files using the avro-tools.jar. All you need to do is write a \
schema. How to get the jar is documented here: \
http://avro.apache.org/docs/1.7.7/gettingstartedjava.html Then run something like \
"java -jar avro-tools-1.7.7.jar random --schema-file [your schema file] --count 10 \
data.avro" to generate data. Another approach, if you want to customize the data., \
would be to use the Avro python APIs which are really simple. See \
http://avro.apache.org/docs/1.7.7/gettingstartedpython.html
Hope this helps,Sam
On Sunday, December 13, 2015 4:30 PM, John Lilley <john.lilley@redpoint.net> \
wrote:
#yiv7703157095 #yiv7703157095 -- _filtered #yiv7703157095 {panose-1:2 4 5 3 5 4 6 3 \
2 4;} _filtered #yiv7703157095 {font-family:Calibri;panose-1:2 15 5 2 2 2 4 3 2 4;} \
_filtered #yiv7703157095 {panose-1:2 11 5 2 2 2 2 2 2 4;}#yiv7703157095 \
#yiv7703157095 p.yiv7703157095MsoNormal, #yiv7703157095 li.yiv7703157095MsoNormal, \
#yiv7703157095 div.yiv7703157095MsoNormal \
{margin:0in;margin-bottom:.0001pt;font-size:12.0pt;}#yiv7703157095 a:link, \
#yiv7703157095 span.yiv7703157095MsoHyperlink \
{color:blue;text-decoration:underline;}#yiv7703157095 a:visited, #yiv7703157095 \
span.yiv7703157095MsoHyperlinkFollowed \
{color:purple;text-decoration:underline;}#yiv7703157095 span.yiv7703157095hoenzb \
{}#yiv7703157095 span.yiv7703157095EmailStyle18 {color:#1F497D;}#yiv7703157095 \
.yiv7703157095MsoChpDefault {} _filtered #yiv7703157095 {margin:1.0in 1.0in 1.0in \
1.0in;}#yiv7703157095 div.yiv7703157095WordSection1 {}#yiv7703157095 Everything may \
be explained, which is of limited help to me. What I'm after is interop validation. \
I need files that others have written to ensure that our use of Avro is able to \
handle files written by other applications. Does anything like that exist for \
public consumption? Thanks, John Lilley From: Chris Miller \
[mailto:cmiller11101@gmail.com]
Sent: Sunday, December 13, 2015 10:14 AM
To: user@avro.apache.org
Subject: Re: Avro sample/test files It's really pretty simple. Everything is \
explained here with examples: http://avro.apache.org/docs/1.7.7/spec.html. That's \
what I used to figure out how to build my schema.
-- Chris Miller On Mon, Dec 14, 2015 at 1:09 AM, John Lilley \
<john.lilley@redpoint.net> wrote: Does anyone know of a website/repository for Avro \
sample or test files? I've crawled around the source folders and things seem to be \
fairly limited. Perhaps I'm missing something obvious and need to RTFM? Mostly I \
am looking for practical examples with multiple records, containing complex column \
types. If you have any Avro files that you can share, please do! John Lilley \
[Attachment #3 (text/html)]
<html><head></head><body><div style="color:#000; background-color:#fff; \
font-family:times new roman, new york, times, serif;font-size:16px"><div \
id="yui_3_16_0_1_1449606551972_1337338" dir="ltr"><span \
id="yui_3_16_0_1_1449606551972_1337340">You can create avro files using the \
avro-tools.jar. All you need to do is write a schema. How to get the jar is \
documented here: <a \
href="http://avro.apache.org/docs/1.7.7/gettingstartedjava.html" \
id="yui_3_16_0_1_1449606551972_1337361" \
class="edited-link-editor">http://avro.apache.org/docs/1.7.7/gettingstartedjava.html</a> Then \
run something like "</span>java -jar avro-tools-1.7.7.jar random --schema-file [your \
schema file] --count 10 data.avro" to generate data.</div><div \
id="yui_3_16_0_1_1449606551972_1337338" dir="ltr"><br></div><div \
id="yui_3_16_0_1_1449606551972_1337338" dir="ltr">Another approach, if you want to \
customize the data., would be to use the Avro python APIs which are really simple. \
See <a href="http://avro.apache.org/docs/1.7.7/gettingstartedpython.html" \
id="yui_3_16_0_1_1449606551972_1338004">http://avro.apache.org/docs/1.7.7/gettingstartedpython.html</a></div><div \
id="yui_3_16_0_1_1449606551972_1337338" dir="ltr"><br></div><div \
id="yui_3_16_0_1_1449606551972_1337338" dir="ltr"><br></div><div \
id="yui_3_16_0_1_1449606551972_1337338" dir="ltr">Hope this helps,</div><div \
id="yui_3_16_0_1_1449606551972_1337338" dir="ltr">Sam</div>
<div id="yui_3_16_0_1_1449606551972_1337338" dir="ltr"><br></div> <br><div \
class="qtdSeparateBR"><br><br></div><div class="yahoo_quoted" style="display: \
block;"> <div style="font-family: times new roman, new york, times, serif; font-size: \
16px;"> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, \
Lucida Grande, sans-serif; font-size: 16px;"> <div dir="ltr"><font size="2" \
face="Arial"> On Sunday, December 13, 2015 4:30 PM, John Lilley \
<john.lilley@redpoint.net> wrote:<br></font></div> <br><br> <div \
class="y_msg_container"><div id="yiv7703157095"><style>#yiv7703157095 #yiv7703157095 \
--
_filtered #yiv7703157095 {panose-1:2 4 5 3 5 4 6 3 2 4;}
_filtered #yiv7703157095 {font-family:Calibri;panose-1:2 15 5 2 2 2 4 3 2 4;}
_filtered #yiv7703157095 {panose-1:2 11 5 2 2 2 2 2 2 4;}
#yiv7703157095
#yiv7703157095 p.yiv7703157095MsoNormal, #yiv7703157095 li.yiv7703157095MsoNormal, \
#yiv7703157095 div.yiv7703157095MsoNormal \
{margin:0in;margin-bottom:.0001pt;font-size:12.0pt;} #yiv7703157095 a:link, \
#yiv7703157095 span.yiv7703157095MsoHyperlink \
{color:blue;text-decoration:underline;} #yiv7703157095 a:visited, #yiv7703157095 \
span.yiv7703157095MsoHyperlinkFollowed {color:purple;text-decoration:underline;}
#yiv7703157095 span.yiv7703157095hoenzb
{}
#yiv7703157095 span.yiv7703157095EmailStyle18
{color:#1F497D;}
#yiv7703157095 .yiv7703157095MsoChpDefault
{}
_filtered #yiv7703157095 {margin:1.0in 1.0in 1.0in 1.0in;}
#yiv7703157095 div.yiv7703157095WordSection1
{}
#yiv7703157095 </style><div>
<div class="yiv7703157095WordSection1">
<div class="yiv7703157095MsoNormal"><span style="font-size:11.0pt;">Everything may be \
explained, which is of limited help to me. What I'm after is interop \
validation. I need files that others have written to ensure that our use of \
Avro is able to handle files written by other applications. Does anything like \
that exist for public consumption?</span></div> <div \
class="yiv7703157095MsoNormal"><span style="font-size:11.0pt;">Thanks,</span></div> \
<div class="yiv7703157095MsoNormal"><b><span style="font-size:10.0pt;">John \
Lilley</span></b></div> <div class="yiv7703157095MsoNormal"><b><span \
style="font-size:10.0pt;"> </span></b></div> <div \
class="yiv7703157095yqt5281312293" id="yiv7703157095yqt01678"><div \
class="yiv7703157095MsoNormal"><b><span \
style="font-size:11.0pt;">From:</span></b><span style="font-size:11.0pt;"> Chris \
Miller [mailto:cmiller11101@gmail.com] <br clear="none">
<b>Sent:</b> Sunday, December 13, 2015 10:14 AM<br clear="none">
<b>To:</b> user@avro.apache.org<br clear="none">
<b>Subject:</b> Re: Avro sample/test files</span></div>
<div class="yiv7703157095MsoNormal"> </div>
<div>
<div class="yiv7703157095MsoNormal">It's really pretty simple. Everything is \
explained here with examples: <a rel="nofollow" shape="rect" target="_blank" \
href="http://avro.apache.org/docs/1.7.7/spec.html">http://avro.apache.org/docs/1.7.7/spec.html</a>. \
That's what I used to figure out how to build my schema.</div> <div>
<div class="yiv7703157095MsoNormal"> </div>
</div>
</div></div>
<div>
<div class="yiv7703157095yqt5281312293" id="yiv7703157095yqt25063"><div \
class="yiv7703157095MsoNormal"><br clear="all"> </div>
<div>
<div>
<div>
<div>
<div class="yiv7703157095MsoNormal">--</div>
</div>
<div>
<div class="yiv7703157095MsoNormal">Chris Miller</div>
</div>
</div>
</div>
</div>
<div class="yiv7703157095MsoNormal"> </div></div>
<div>
<div class="yiv7703157095yqt5281312293" id="yiv7703157095yqt45034"><div \
class="yiv7703157095MsoNormal">On Mon, Dec 14, 2015 at 1:09 AM, John Lilley <<a \
rel="nofollow" shape="rect" ymailto="mailto:john.lilley@redpoint.net" target="_blank" \
href="mailto:john.lilley@redpoint.net">john.lilley@redpoint.net</a>> \
wrote:</div></div> <blockquote style="border:none;border-left:solid #CCCCCC \
1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in;"> <div>
<div>
<div class="yiv7703157095yqt5281312293" id="yiv7703157095yqt31845"><div \
class="yiv7703157095MsoNormal" style="">Does anyone know of a website/repository for \
Avro sample or test files? I've crawled around the source folders and things \
seem to be fairly limited. Perhaps I'm missing something obvious and need to \
RTFM?</div> <div class="yiv7703157095MsoNormal" style=""> </div>
<div class="yiv7703157095MsoNormal" style="">Mostly I am looking for practical \
examples with multiple records, containing complex column types.</div> <div \
class="yiv7703157095MsoNormal" style=""> </div> <div \
class="yiv7703157095MsoNormal" style="">If you have any Avro files that you can \
share, please do!</div> <div class="yiv7703157095MsoNormal" style=""><span \
style="color:#888888;"> </span></div> <div class="yiv7703157095MsoNormal" \
style=""><b><span style="font-size:10.0pt;">John Lilley</span></b><span \
style="color:#888888;"> </span></div></div>
<div class="yiv7703157095MsoNormal" style=""><span \
style="color:#888888;"> </span></div> </div>
</div>
</blockquote>
</div>
<div class="yiv7703157095MsoNormal"> </div>
</div>
</div>
</div></div><br><br></div> </div> </div> </div></div></body></html>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic