[prev in list] [next in list] [prev in thread] [next in thread]
List: syslog-ng
Subject: Re: [syslog-ng] [GSoC] Project: Kafka source
From: md mehrab <md.mehrab () gmail ! com>
Date: 2016-03-10 13:28:39
Message-ID: CAGvBFZjs4GCf4itBwmF1Cx5rcPc0wGy2rbCAb2QtTSxHKMUKbQ () mail ! gmail ! com
[Download RAW message or body]
[Attachment #2 (multipart/alternative)]
I setup kafka server locally and test kafka consumer (example of librdkafka
<https://github.com/edenhill/librdkafka/blob/master/examples/rdkafka_consumer_example.c>)
with different property like group.id, auto.offset.reset etc.
Also read messages from kafka (i.e particular topic and particular
partition ) without duplicating them.
is there any task for me?
On Wed, Mar 9, 2016 at 6:41 PM, md mehrab <md.mehrab@gmail.com> wrote:
> ya sure,
> I am exploring C kafka binding (above repo link).
>
>
>
> On Wed, Mar 9, 2016 at 5:59 PM, Marc Falzon <m@baha.mu> wrote:
>
>> Hi
>>
>>
>> On Wednesday 9 March 2016 at 12:06, md mehrab wrote:
>>
>> >
>> > Hi all,
>> >
>> > I am currently 4th year undergraduate student at Faculty of
>> Engineering, Jamia Millia Islamia, New Delhi, India. I would like to
>> contribute to a GSoC 2016 project with open source community of syslog-ng.
>> >
>> > In last summer vacation i worked (as intern )for a company where i was
>> the part of data aggregator project (one of the core member of this project
>> ). Main idea of this project is to build scalable system so that it can
>> handle millions of request per minute. For this we used kafka messaging
>> system. Producer simply produce message to particular topic and consumer
>> get message from that topic and feed to async task (celery worker).
>> >
>> >
>> > I think I can contribute syslog-ng project kafka source.
>> > @Viktor Juhasz (https://github.com/juhaszviktor) (Mentor) kindly give
>> me suggestions.
>>
>>
>> That'd be a nice addition to the project IMHO. If I may suggest, could
>> you please opt for the C Kafka binding (
>> https://github.com/edenhill/librdkafka) rather than a Java-based one?
>>
>> Good luck,
>>
>> m.
>>
>> ______________________________________________________________________________
>> Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng
>> Documentation:
>> http://www.balabit.com/support/documentation/?product=syslog-ng
>> FAQ: http://www.balabit.com/wiki/syslog-ng-faq
>>
>>
>
>
> --
> Md Mehrab Alam
>
> https://www.linkedin.com/in/iammehrabalam
> https://github.com/iammehrabalam
>
--
Md Mehrab Alam
https://www.linkedin.com/in/iammehrabalam
https://github.com/iammehrabalam
[Attachment #5 (text/html)]
<div dir="ltr"><div>I setup kafka server locally and test kafka consumer (example of \
<a href="https://github.com/edenhill/librdkafka/blob/master/examples/rdkafka_consumer_example.c" \
target="_blank">librdkafka</a>) with different property like <a \
href="http://group.id">group.id</a>, auto.offset.reset etc.<br></div><div>Also read \
messages from kafka (i.e particular topic and particular partition ) without \
duplicating them.</div><div><br></div><div>is there any task for \
me?</div><div><br></div><div></div></div><div class="gmail_extra"><br><div \
class="gmail_quote">On Wed, Mar 9, 2016 at 6:41 PM, md mehrab <span dir="ltr"><<a \
href="mailto:md.mehrab@gmail.com" target="_blank">md.mehrab@gmail.com</a>></span> \
wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px \
#ccc solid;padding-left:1ex"><div dir="ltr">ya sure, <div>I am exploring C kafka \
binding (above repo link).</div><div><br></div><div><br></div></div><div \
class="gmail_extra"><div><div class="h5"><br><div class="gmail_quote">On Wed, Mar 9, \
2016 at 5:59 PM, Marc Falzon <span dir="ltr"><<a href="mailto:m@baha.mu" \
target="_blank">m@baha.mu</a>></span> wrote:<br><blockquote class="gmail_quote" \
style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi<br> \
<span><br> <br>
On Wednesday 9 March 2016 at 12:06, md mehrab wrote:<br>
<br>
><br>
> Hi all,<br>
><br>
> I am currently 4th year undergraduate student at Faculty of Engineering, Jamia \
Millia Islamia, New Delhi, India. I would like to contribute to a GSoC 2016 project \
with open source community of syslog-ng.<br> ><br>
> In last summer vacation i worked (as intern )for a company where i was the part \
of data aggregator project (one of the core member of this project ). Main idea of \
this project is to build scalable system so that it can handle millions of request \
per minute. For this we used kafka messaging system. Producer simply produce message \
to particular topic and consumer get message from that topic and feed to async task \
(celery worker).<br> ><br>
><br>
> I think I can contribute syslog-ng project kafka source.<br>
</span>> @Viktor Juhasz (<a href="https://github.com/juhaszviktor" \
rel="noreferrer" target="_blank">https://github.com/juhaszviktor</a>) (Mentor) kindly \
give me suggestions.<br> <br>
<br>
That'd be a nice addition to the project IMHO. If I may suggest, could you please \
opt for the C Kafka binding (<a href="https://github.com/edenhill/librdkafka" \
rel="noreferrer" target="_blank">https://github.com/edenhill/librdkafka</a>) rather \
than a Java-based one?<br> <br>
Good luck,<br>
<br>
m.<br>
______________________________________________________________________________<br>
Member info: <a href="https://lists.balabit.hu/mailman/listinfo/syslog-ng" \
rel="noreferrer" target="_blank">https://lists.balabit.hu/mailman/listinfo/syslog-ng</a><br>
Documentation: <a href="http://www.balabit.com/support/documentation/?product=syslog-ng" \
rel="noreferrer" target="_blank">http://www.balabit.com/support/documentation/?product=syslog-ng</a><br>
FAQ: <a href="http://www.balabit.com/wiki/syslog-ng-faq" rel="noreferrer" \
target="_blank">http://www.balabit.com/wiki/syslog-ng-faq</a><br> <br>
</blockquote></div><br><br clear="all"><div><br></div></div></div><span class="">-- \
<br><div><div dir="ltr"><div><div dir="ltr">Md Mehrab Alam<div><br></div><div><a \
href="https://www.linkedin.com/in/iammehrabalam" \
target="_blank">https://www.linkedin.com/in/iammehrabalam</a><br></div><div><a \
href="https://github.com/iammehrabalam" \
target="_blank">https://github.com/iammehrabalam</a><br></div></div></div></div></div>
</span></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div \
class="gmail_signature"><div dir="ltr"><div><div dir="ltr">Md Mehrab \
Alam<div><br></div><div><a href="https://www.linkedin.com/in/iammehrabalam" \
target="_blank">https://www.linkedin.com/in/iammehrabalam</a><br></div><div><a \
href="https://github.com/iammehrabalam" \
target="_blank">https://github.com/iammehrabalam</a><br></div></div></div></div></div>
</div>
______________________________________________________________________________
Member info: https://lists.balabit.hu/mailman/listinfo/syslog-ng
Documentation: http://www.balabit.com/support/documentation/?product=syslog-ng
FAQ: http://www.balabit.com/wiki/syslog-ng-faq
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic