Kafka客户端性能参数调优

调优方向：吞吐量
Producer:
• batch.size: increase to 100000–200000 (default 16384)
• linger.ms: increase to 10–100 (default 0)
• compression.type=lz4 (default none, i.e., no compression)
• acks=1 (default 1)
• buffer.memory: increase if there are a lot of partitions (default 33554432)
Consumer:
• fetch.min.bytes: increase to ~100000 (default 1)
调优方向：低延迟
Producer:
• linger.ms=0 (default 0)
• compression.type=none (default none, i.e., no compression)
• acks=1 (default 1)
Consumer:
• fetch.min.bytes=1 (default 1)
调优方向：持久性（消息不丢失）
replication.factor=3
• acks=all (default 1)
• enable.idempotence=true (default false), to prevent duplicate messages and out-of-order
messages
• max.in.flight.requests.per.connection=1 (default 5), to prevent out of order messages
when not using an idempotent producer
Consumer:
• enable.auto.commit=false (default true)
• isolation.level=read_committed (when using EOS transactions)

调优方向：可用性
Consumer:
• session.timeout.ms: increase (default 10000)
max.poll.records减少