Wednesday, November 9, 2016

Flume Opentsdb config

flume config for opentsdb with kafka topic:
===============================
opentsdbflume.sources = kafka-source
opentsdbflume.channels = http-channel
opentsdbflume.sinks = http-sink

opentsdbflume.sources.kafka-source.type = org.apache.flume.source.kafka.KafkaSource
opentsdbflume.sources.kafka-source.zookeeperConnect = 135.250.193.178:2181
opentsdbflume.sources.kafka-source.topic = airtel_ims_entity_cpu_opentsdb
opentsdbflume.sources.kafka-source.batchSize = 100
opentsdbflume.sources.kafka-source.batchDurationMillis = 200
opentsdbflume.sources.kafka-source.channels = http-channel

opentsdbflume.channels.http-channel.type = memory
opentsdbflume.channels.http-channel.transactionCapacity = 1000000
opentsdbflume.channels.http-channel.capacity = 10000000

opentsdbflume.sinks.http-sink.channel = http-channel
opentsdbflume.sinks.http-sink.type = org.apache.flume.sink.HttpSink
opentsdbflume.sinks.http-sink.endpoint = http://135.250.193.178
opentsdbflume.sinks.http-sink.port = 4241
opentsdbflume.sinks.http-sink.resource = /api/put

No comments: