[prev in list] [next in list] [prev in thread] [next in thread] 

List:       flume-dev
Subject:    [jira] [Commented] (FLUME-2870) Flume agent throw NULLPOINTEXCEPTION when use kakfa-source
From:       "Denes Arvay (JIRA)" <jira () apache ! org>
Date:       2016-06-30 8:16:10
Message-ID: JIRA.12934678.1453954666000.1797.1467274570286 () Atlassian ! JIRA
[Download RAW message or body]


    [ https://issues.apache.org/jira/browse/FLUME-2870?page=com.atlassian.jira.plugin. \
system.issuetabpanels:comment-tabpanel&focusedCommentId=15356714#comment-15356714 ] 

Denes Arvay commented on FLUME-2870:
------------------------------------

This one seems to be a duplicate of FLUME-2672, so if there are no objections I'd \
close it as duplicate.

> Flume agent throw NULLPOINTEXCEPTION when use kakfa-source
> ----------------------------------------------------------
> 
> Key: FLUME-2870
> URL: https://issues.apache.org/jira/browse/FLUME-2870
> Project: Flume
> Issue Type: Bug
> Components: Build
> Affects Versions: v1.6.0
> Environment: kafka source,es sink
> Reporter: justdebugit
> Assignee: Denes Arvay
> Labels: kafka-source
> Original Estimate: 12h
> Remaining Estimate: 12h
> 
> CONFIG:
> a1.sources = s1
> a1.channels = c1
> a1.sinks = k1
> a1.sources.s1.type = org.apache.flume.source.kafka.KafkaSource
> a1.sources.s1.channels = c1
> a1.sources.s1.zookeeperConnect = 10.xxx.xxx.160:5181,10.2x.xxx.203:5181/xxx/charge
> a1.sources.s1.topic = charge.log
> a1.sources.s1.groupId = flume
> #a1.channels.c1.type = memory
> #a1.channels.c1.capacity = 50000
> #a1.channels.c1.transactionCapacity = 100
> a1.channels.c1.type = file
> a1.channels.c1.checkpointDir = /home/xxxx/app/flume/checkpoint
> a1.channels.c1.dataDirs = /home/xxxxx/app/flume/data
> a1.channels.c1.capacity = 5000000
> a1.sinks.k1.type = com.frontier45.flume.sink.elasticsearch2.ElasticSearchSink
> a1.sinks.k1.hostNames = 127.0.0.1:9300
> a1.sinks.k1.indexName = xxx_charge_log
> a1.sinks.k1.indexType = logs
> a1.sinks.k1.clusterName = elasticsearch
> a1.sinks.k1.batchSize = 500
> a1.sinks.k1.ttl = 3d
> a1.sinks.k1.serializer = \
> com.frontier45.flume.sink.elasticsearch2.ElasticSearchLogStashEventSerializer \
> a1.sinks.k1.channel = c1 EXCEPTION:
> 28 Jan 2016 11:09:03,830 ERROR [PollableSourceRunner-KafkaSource-s1] \
> (org.apache.flume.source.kafka.KafkaSource.process:153)  - KafkaSource EXCEPTION, \
> {} java.lang.NullPointerException
> at org.apache.flume.instrumentation.MonitoredCounterGroup.increment(MonitoredCounterGroup.java:261)
>  at org.apache.flume.instrumentation.kafka.KafkaSourceCounter.incrementKafkaEmptyCount(KafkaSourceCounter.java:49)
>  at org.apache.flume.source.kafka.KafkaSource.process(KafkaSource.java:146)
> at org.apache.flume.source.PollableSourceRunner$PollingRunner.run(PollableSourceRunner.java:139)
>  at java.lang.Thread.run(Thread.java:745)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic