[prev in list] [next in list] [prev in thread] [next in thread]
List: flume-dev
Subject: [jira] [Commented] (FLUME-2870) Flume agent throw NULLPOINTEXCEPTION when use kakfa-source
From: "Denes Arvay (JIRA)" <jira () apache ! org>
Date: 2016-06-30 8:16:10
Message-ID: JIRA.12934678.1453954666000.1797.1467274570286 () Atlassian ! JIRA
[Download RAW message or body]
[ https://issues.apache.org/jira/browse/FLUME-2870?page=com.atlassian.jira.plugin. \
system.issuetabpanels:comment-tabpanel&focusedCommentId=15356714#comment-15356714 ]
Denes Arvay commented on FLUME-2870:
------------------------------------
This one seems to be a duplicate of FLUME-2672, so if there are no objections I'd \
close it as duplicate.
> Flume agent throw NULLPOINTEXCEPTION when use kakfa-source
> ----------------------------------------------------------
>
> Key: FLUME-2870
> URL: https://issues.apache.org/jira/browse/FLUME-2870
> Project: Flume
> Issue Type: Bug
> Components: Build
> Affects Versions: v1.6.0
> Environment: kafka source,es sink
> Reporter: justdebugit
> Assignee: Denes Arvay
> Labels: kafka-source
> Original Estimate: 12h
> Remaining Estimate: 12h
>
> CONFIG:
> a1.sources = s1
> a1.channels = c1
> a1.sinks = k1
> a1.sources.s1.type = org.apache.flume.source.kafka.KafkaSource
> a1.sources.s1.channels = c1
> a1.sources.s1.zookeeperConnect = 10.xxx.xxx.160:5181,10.2x.xxx.203:5181/xxx/charge
> a1.sources.s1.topic = charge.log
> a1.sources.s1.groupId = flume
> #a1.channels.c1.type = memory
> #a1.channels.c1.capacity = 50000
> #a1.channels.c1.transactionCapacity = 100
> a1.channels.c1.type = file
> a1.channels.c1.checkpointDir = /home/xxxx/app/flume/checkpoint
> a1.channels.c1.dataDirs = /home/xxxxx/app/flume/data
> a1.channels.c1.capacity = 5000000
> a1.sinks.k1.type = com.frontier45.flume.sink.elasticsearch2.ElasticSearchSink
> a1.sinks.k1.hostNames = 127.0.0.1:9300
> a1.sinks.k1.indexName = xxx_charge_log
> a1.sinks.k1.indexType = logs
> a1.sinks.k1.clusterName = elasticsearch
> a1.sinks.k1.batchSize = 500
> a1.sinks.k1.ttl = 3d
> a1.sinks.k1.serializer = \
> com.frontier45.flume.sink.elasticsearch2.ElasticSearchLogStashEventSerializer \
> a1.sinks.k1.channel = c1 EXCEPTION:
> 28 Jan 2016 11:09:03,830 ERROR [PollableSourceRunner-KafkaSource-s1] \
> (org.apache.flume.source.kafka.KafkaSource.process:153) - KafkaSource EXCEPTION, \
> {} java.lang.NullPointerException
> at org.apache.flume.instrumentation.MonitoredCounterGroup.increment(MonitoredCounterGroup.java:261)
> at org.apache.flume.instrumentation.kafka.KafkaSourceCounter.incrementKafkaEmptyCount(KafkaSourceCounter.java:49)
> at org.apache.flume.source.kafka.KafkaSource.process(KafkaSource.java:146)
> at org.apache.flume.source.PollableSourceRunner$PollingRunner.run(PollableSourceRunner.java:139)
> at java.lang.Thread.run(Thread.java:745)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic