[prev in list] [next in list] [prev in thread] [next in thread] 

List:       drill-user
Subject:    Re: create a huge size of parquet file
From:       YouPeng Yang <yypvsxf19870706 () gmail ! com>
Date:       2013-12-20 8:19:57
Message-ID: CAG1CohSTqtAMevwRU4vcvME_h-Ssbc6beMap9OuG2ZTGMJRNyA () mail ! gmail ! com
[Download RAW message or body]


Hi
  haa
  Thanks great. I have also find it by google

Regards

2013/12/20 Ted Dunning <ted.dunning@gmail.com>

> Oops.
>
> I forgot to include a link:
>
> https://github.com/tdunning/log-synth
>
>
>
> On Thu, Dec 19, 2013 at 11:32 PM, YouPeng Yang <yypvsxf19870706@gmail.com
> >wrote:
>
> > Hi Ted
> >
> >   Thank you very much for your reply.
> > I am considering to build a map-reduce version.
> >
> >
> > Regards
> >
> >
> > 2013/12/20 Ted Dunning <ted.dunning@gmail.com>
> >
> > > You could adapt the log-synth program to produce files in parquet.  At
> > the
> > > same time, I would recommend that you build a map-reduce version as
> well
> > so
> > > that you can generate much bigger files.
> > >
> > >
> > > On Thu, Dec 19, 2013 at 10:55 PM, YouPeng Yang <
> > yypvsxf19870706@gmail.com
> > > >wrote:
> > >
> > > > Hi
> > > >    I have complied the drill M1 with hadoop-2.2. And I have tested
> the
> > > > sample-data/region.parquet in HDFS.It goes well.
> > > >
> > > >   I want to make a deep test on the performance of dirll.
> > > >   First thing it need to create a huge size of parquet file. Is there
> > any
> > > > tools to convert my flat file or other format file to parquet file?
> > > >
> > > >
> > > >
> > > > Regards.
> > > >
> > >
> >
>


[prev in list] [next in list] [prev in thread] [next in thread]