prometheus整合kafka_exporter_kafka-exporter

运行

二进制方式

kafka_exporter --kafka.server=kafka:9092

[–kafka.server=another-server …]

配置

此表格可使用不同的标志进行配置

布尔配置

每个以布尔值作为配置的都有一个附加参数:–和–no-.

例如:

如果您需要禁用sasl.handshake，您可以添加配置–no-sasl.handshake

指标

Brokers

指标详细信息

指标输出示例

# Kafka _ Brokers Kafka集群中的brokers数量。

# kafka_brokers指标

例如: kafka_brokers 3

Topics

Metrics****详细信息

指标输出示例

# HELP kafka_topic_partitions Number of partitions for this Topic

# TYPE kafka_topic_partitions gauge

kafka_topic_partitions{topic="__consumer_offsets"} 50

# HELP kafka_topic_partition_current_offset Current Offset of a Broker at Topic/Partition

# TYPE kafka_topic_partition_current_offset gauge

kafka_topic_partition_current_offset{partition=“0”,topic="__consumer_offsets"} 0

# HELP kafka_topic_partition_oldest_offset Oldest Offset of a Broker at Topic/Partition

# TYPE kafka_topic_partition_oldest_offset gauge

kafka_topic_partition_oldest_offset{partition=“0”,topic="__consumer_offsets"} 0

# HELP kafka_topic_partition_in_sync_replica Number of In-Sync Replicas for this Topic/Partition

# TYPE kafka_topic_partition_in_sync_replica gauge

kafka_topic_partition_in_sync_replica{partition=“0”,topic="__consumer_offsets"} 3

# HELP kafka_topic_partition_leader Leader Broker ID of this Topic/Partition

# TYPE kafka_topic_partition_leader gauge

kafka_topic_partition_leader{partition=“0”,topic="__consumer_offsets"} 0

# HELP kafka_topic_partition_leader_is_preferred 1 if Topic/Partition is using the Preferred Broker

# TYPE kafka_topic_partition_leader_is_preferred gauge

kafka_topic_partition_leader_is_preferred{partition=“0”,topic="__consumer_offsets"} 1

# HELP kafka_topic_partition_replicas Number of Replicas for this Topic/Partition

# TYPE kafka_topic_partition_replicas gauge

kafka_topic_partition_replicas{partition=“0”,topic="__consumer_offsets"} 3

# HELP kafka_topic_partition_under_replicated_partition 1 if Topic/Partition is under Replicated

# TYPE kafka_topic_partition_under_replicated_partition gauge

kafka_topic_partition_under_replicated_partition{partition=“0”,topic="__consumer_offsets"} 0

Consumer Groups

指标详细信息

重要说明

为了能够收集指标kafka_consumergroupzookeeper_lag_zookeeper，您必须设置以下标志:

• use.consumelag.zookeeper:启用从zookeeper收集消耗延迟
• zookeeper.server:连接到zookeeper的地址

输出示例

# HELP kafka_consumergroup_current_offset Current Offset of a ConsumerGroup at Topic/Partition

# TYPE kafka_consumergroup_current_offset gauge

kafka_consumergroup_current_offset{consumergroup=“KMOffsetCache-kafka-manager-3806276532-ml44w”,partition=“0”,topic="__consumer_offsets"} -1

# HELP kafka_consumergroup_lag Current Approximate Lag of a ConsumerGroup at Topic/Partition

# TYPE kafka_consumergroup_lag gauge

kafka_consumergroup_lag{consumergroup=“KMOffsetCache-kafka-manager-3806276532-ml44w”,partition=“0”,topic="__consumer_offsets"}

验证

http://ip:9308/metrics

on

# TYPE kafka_consumergroup_lag gauge

kafka_consumergroup_lag{consumergroup=“KMOffsetCache-kafka-manager-3806276532-ml44w”,partition=“0”,topic="__consumer_offsets"}

验证

http://ip:9308/metrics