zookeeper3.7.0 + kafka2.8.0 集群搭建干货_kafka3.7.0 zookeeper

一、资源下载

zookeeper 3.7  下载地址：https://mirrors.bfsu.edu.cn/apache/zookeeper/zookeeper-3.7.0/apache-zookeeper-3.7.0-bin.tar.gz

kafka 2.8 下载地址：https://mirrors.bfsu.edu.cn/apache/kafka/2.8.0/kafka_2.12-2.8.0.tgz

二、环境准备

准备3台centos8 虚拟机，并按一下操作进行配置

三、修改/etc/hostname 和/etc/hosts

# 第1台操作如下
# 修改 hostname
echo "node0" > /etc/hostname
# 修改 hosts
echo "192.164.4.123        node0" >> /etc/hosts
echo "192.164.4.124        node1" >> /etc/hosts
echo "192.164.4.125        node2" >> /etc/hosts
 
# 关闭防火墙
systemctl stop firewalld.service
systemctl disable firewalld.service
 
# 重启网络配置
systemctl restart NetworkManager.service
 
# 验证
hostname
ping node0
 

# 第2台操作如下
# 修改 hostname
echo "node1" > /etc/hostname
# 修改 hosts
echo "192.164.4.123        node0" >> /etc/hosts
echo "192.164.4.124        node1" >> /etc/hosts
echo "192.164.4.125        node2" >> /etc/hosts
 
# 关闭防火墙
systemctl stop firewalld.service
systemctl disable firewalld.service
 
# 重启网络配置
systemctl restart NetworkManager.service
 
# 验证
hostname
ping node1

# 第3台操作如下
# 修改 hostname
echo "node2" > /etc/hostname
# 修改 hosts
echo "192.164.4.123        node0" >> /etc/hosts
echo "192.164.4.124        node1" >> /etc/hosts
echo "192.164.4.125        node2" >> /etc/hosts
 
# 关闭防火墙
systemctl stop firewalld.service
systemctl disable firewalld.service
 
# 重启网络配置
systemctl restart NetworkManager.service
 
# 验证
hostname
ping node2

四、zookeeper 集群配置

下载zookeeper 并解压到 /obedu/zookeeper ,按以下操作配置完成配置

# 在第1台机器的 /obedu/zookeeper/config 目录创建 zoo.cfg 文件, 加入以下内容
# ---------------------------------------------------
clientPort=2181
clientPortAddress=0.0.0.0
maxClientCnxns=0
dataDir=/obaedu/zookeeper/data
dataLogDir=/obaedu/zookeeper/logs
tickTime=20000
initLimit=100
syncLimit=50
quorumListenOnAllIPs=true
leaderServes=yes
server.0=node0:2888:3888
server.1=node1:2888:3888
server.2=node2:2888:3888
# ---------------------------------------------------
 
 
# myid 配置
mkdir -p /obedu/zookeeper/data
echo "0" > /obedu/zookeeper/data/myid
 
 
# 启动
/obedu/zookeeper/bin/zkServer.sh restart
# 查看是否成功
/obedu/zookeeper/bin/zkServer.sh status

# 在第2台机器的 /obedu/zookeeper/config 目录创建 zoo.cfg 文件, 加入以下内容
# ---------------------------------------------------
clientPort=2181
clientPortAddress=0.0.0.0
maxClientCnxns=0
dataDir=/obaedu/zookeeper/data
dataLogDir=/obaedu/zookeeper/logs
tickTime=20000
initLimit=100
syncLimit=50
quorumListenOnAllIPs=true
leaderServes=yes
server.0=node0:2888:3888
server.1=node1:2888:3888
server.2=node2:2888:3888
# ---------------------------------------------------
 
 
# myid 配置
mkdir -p /obedu/zookeeper/data
echo "1" > /obedu/zookeeper/data/myid
 
# 启动
/obedu/zookeeper/bin/zkServer.sh restart
# 查看是否成功
/obedu/zookeeper/bin/zkServer.sh status

# 在第3台机器的 /obedu/zookeeper/config 目录创建 zoo.cfg 文件, 加入以下内容
# ---------------------------------------------------
clientPort=2181
clientPortAddress=0.0.0.0
maxClientCnxns=0
dataDir=/obaedu/zookeeper/data
dataLogDir=/obaedu/zookeeper/logs
tickTime=20000
initLimit=100
syncLimit=50
quorumListenOnAllIPs=true
leaderServes=yes
server.0=node0:2888:3888
server.1=node1:2888:3888
server.2=node2:2888:3888
# ---------------------------------------------------
 
 
# myid 配置
mkdir -p /obedu/zookeeper/data
echo "2" > /obedu/zookeeper/data/myid
 
# 启动
/obedu/zookeeper/bin/zkServer.sh restart
# 查看是否成功
/obedu/zookeeper/bin/zkServer.sh status

五、kafka集群配置

 kafka 集群配置的前提先完成 zookeeper 集群配置。

下载kafka 并解压到 /obedu/kafka ,按以下操作配置完成配置

# 第1台机器 vim /obedu/kafka/config/server.properties, 按以下内容修改
# ---------------------------------------------------------
broker.id=0
delete.topic.enable=true
auto.create.topics.enable=true
listeners=PLAINTEXT://192.168.4.123:9092
advertised.host.name=192.168.4.123
advertised.listeners=PLAINTEXT://192.168.4.123:9092
zookeeper.connect=node0:2181,node1:2181,node2:2181
zookeeper.connection.timeout.ms=6000
log.dirs=/obaedu/kafka/logs
# ---------------------------------------------------------
 
# 启动 kafka
/obaedu/kafka/bin/kafka-server-start.sh -daemon /obaedu/kafka/config/server.properties

# 第2台机器 vim /obedu/kafka/config/server.properties, 按以下内容修改
# ---------------------------------------------------------
broker.id=1
delete.topic.enable=true
auto.create.topics.enable=true
listeners=PLAINTEXT://192.168.4.124:9092
advertised.host.name=192.168.4.124
advertised.listeners=PLAINTEXT://192.168.4.124:9092
zookeeper.connect=node0:2181,node1:2181,node2:2181
zookeeper.connection.timeout.ms=6000
log.dirs=/obaedu/kafka/logs
# ---------------------------------------------------------
 
# 启动 kafka
/obaedu/kafka/bin/kafka-server-start.sh -daemon /obaedu/kafka/config/server.properties

# 第3台机器 vim /obedu/kafka/config/server.properties, 按以下内容修改
# ---------------------------------------------------------
broker.id=2
delete.topic.enable=true
auto.create.topics.enable=true
listeners=PLAINTEXT://192.168.4.125:9092
advertised.host.name=192.168.4.125
advertised.listeners=PLAINTEXT://192.168.4.125:9092
zookeeper.connect=node0:2181,node1:2181,node2:2181
zookeeper.connection.timeout.ms=6000
log.dirs=/obaedu/kafka/logs
# ---------------------------------------------------------
 
# 启动 kafka
/obaedu/kafka/bin/kafka-server-start.sh -daemon /obaedu/kafka/config/server.properties

到这里就完成了zookeeper+kafka集群搭建，如有问题可留言一起讨论！！！