To see Flume sink data consumtion. check LAG-
Just by looking at the metadata of a Consumer Group, we can determine a few key metrics: how many messages are being written to the partitions within the group, how many messages are being read from those partitions, and what is the difference? The difference is called Lag, and represents how far the Consumer Group application is behind the producers.
/opt/kafka/bin/kafka-consumer-groups.sh --describe --bootstrap-server localhost:9092 --group hive-sinks-group |grep -E "^GROUP|demo"
Just by looking at the metadata of a Consumer Group, we can determine a few key metrics: how many messages are being written to the partitions within the group, how many messages are being read from those partitions, and what is the difference? The difference is called Lag, and represents how far the Consumer Group application is behind the producers.
/opt/kafka/bin/kafka-consumer-groups.sh --describe --bootstrap-server localhost:9092 --group hive-sinks-group |grep -E "^GROUP|demo"
No comments:
Post a Comment