3、Zookeeper集群部署(脚本部署)

原创

超人不姓超 2023-06-08 15:01:33 博主文章分类：Zookeeper ©著作权

文章标签 Zookeeper集群部署 Zookeeper集群选举 文章分类 运维 yyds干货盘点

©著作权归作者所有：来自51CTO博客作者超人不姓超的原创作品，请联系作者获取转载授权，否则将追究法律责任

zookeeper集群部署

ZooKeeper集群用于解决单点和单机性能及数据高可用等问题.

集群角色

序号	角色	职责描述
1	领导者（Leader）	负责处理写入请求的,事务请求的唯一调度和处理者,负责进行投票发起和决议,更新系统状态
2	跟随者（Follower）	接收客户请求并向客户端返回结果,在选Leader过程中参与投票
3	观察者（observer）	转交客户端写请求给leader节点,和同步leader状态和Follower唯一区别就是不参与Leader投票,也不参与写操作的"过半写成功"策略
4	学习者（Learner）	和leader进行状态同步的节点统称Learner,包括:Follower和Observer
5	客户端（client）	请求发起方

选举ID

ZXID:每个改变 Zookeeper状态的操作都会形成一个对应的zxid. ZXID最大的节点优先选为Leader
MYID:服务器的唯一标识(SID),通过配置 myid 文件指定,集群中唯一,当ZXID一样时,myid大的节 点优先选为Leader

对比投票,优先检查zxid,如果zxid不一样则zxid大的为leader,如果zxid相同则继续对比 myid,myid 大的一方为 leader

ZOOKEEPER集群部署

官方文档

https://zookeeper.apache.org/doc/r3.6.2/zookeeperAdmin.html#sc_zkMulitServerSetup

环境准备

三台ubuntu2004
10.0.0.100
10.0.0.101
10.0.0.102

在三个节点都安装JDK
apt -y install openjdk-11-jdk

在所有节点下载并解压缩 ZooKeeper 包文件

清华源下载
wget https://mirrors.tuna.tsinghua.edu.cn/apache/zookeeper/zookeeper-3.8.0/apache-zookeeper-3.8.0-bin.tar.gz
[root@node0 ~]#ls
apache-zookeeper-3.8.0-bin.tar.gz
解包
[root@node0 ~]#tar xf apache-zookeeper-3.8.0-bin.tar.gz -C /usr/local/
[root@node0 ~]#ls /usr/local/
apache-zookeeper-3.8.0-bin
创建软链接
[root@node0 ~]#ln -s /usr/local/apache-zookeeper-3.8.0-bin/ /usr/local/zookeeper
修改PATH变量，省的敲路径
echo 'PATH=/usr/local/zookeeper/bin:$PATH' > /etc/profile.d/zookeeper.sh
[root@node0 ~]#. /etc/profile.d/zookeeper.sh
把下载的包拷贝到101、102上并进行解包创建软链接更改PATH变量
[root@node0 ~]#scp apache-zookeeper-3.8.0-bin.tar.gz 10.0.0.101:
apache-zookeeper-3.8.0-bin.tar.gz                                                         
[root@node0 ~]#scp apache-zookeeper-3.8.0-bin.tar.gz 10.0.0.102:
apache-zookeeper-3.8.0-bin.tar.gz

准备配置文件

三个节点都要创建数据目录
[root@node0 ~]#mkdir /usr/local/zookeeper/data

基于模板配置文件生成配置文件
[root@node0 ~]#cp /usr/local/zookeeper/conf/zoo_sample.cfg /usr/local/zookeeper/conf/zoo.cfg
tickTime=2000
initLimit=10
syncLimit=5
dataDir=/usr/local/zookeeper/data
clientPort=2181
maxClientCnxns=128
autopurge.snapRetainCount=3
autopurge.purgeInterval=24
4lw.commands.whitelist=*  
server.1=10.0.0.100:2888:3888       #选举用的myid
server.2=10.0.0.101:2888:3888 
server.3=10.0.0.102:2888:3888

把配置文件拷贝到101、102节点
[root@node0 ~]#scp /usr/local/zookeeper/conf/zoo.cfg 10.0.0.101:/usr/local/zookeeper/conf/
[root@node0 ~]#scp /usr/local/zookeeper/conf/zoo.cfg 10.0.0.102:/usr/local/zookeeper/conf/

在各个节点生成ID文件

注意: 各个myid文件的内容要和zoo.cfg文件相匹配

[root@node0 ~]#echo 1 > /usr/local/zookeeper/data/myid 
[root@node1 ~]#echo 2 > /usr/local/zookeeper/data/myid 
[root@node2 ~]#echo 3 > /usr/local/zookeeper/data/myid

各服务器启动 zookeeper

#注意:在所有三个节点快速启动服务,否则会造成集群失败

[root@node0 ~]#zkServer.sh start
[root@node1 ~]#zkServer.sh start
[root@node2 ~]#zkServer.sh start

查看集群状态

[root@node0 ~]#
zkServer.sh status
/usr/bin/java
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper/bin/../conf/zoo.cfg
Client port found: 2181. Client address: localhost. Client SSL: false.
Mode: follower
[root@node1 ~]#
zkServer.sh status
/usr/bin/java
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper/bin/../conf/zoo.cfg
Client port found: 2181. Client address: localhost. Client SSL: false.
Mode: follower
[root@node2 ~]#zkServer.sh status
/usr/bin/java
ZooKeeper JMX enabled by default
Using config: /usr/local/zookeeper/bin/../conf/zoo.cfg
Client port found: 2181. Client address: localhost. Client SSL: false.
Mode: leader

zookeeper集群部署脚本（各机器分别执行脚本，提示输入myid）

[root@ubuntu2004 ~]#cat install_zookeeper_cluster.sh 
#!/bin/bash
ZK_VERSION=3.8.0
#ZK_VERSION=3.6.3
#3.5.0及以下版本下载链接
ZK_URL=https://mirrors.tuna.tsinghua.edu.cn/apache/zookeeper/zookeeper-${ZK_VERSION}/apache-zookeeper-${ZK_VERSION}-bin.tar.gz
#ZK_URL="https://mirrors.tuna.tsinghua.edu.cn/apache/zookeeper/stable/apache-zookeeper-${ZK_VERSION}-bin.tar.gz"
#ZK_URL=https://archive.apache.org/dist/zookeeper/zookeeper-${ZK_VERSION}/zookeeper-${ZK_VERSION}.bin.tar.gz

#ZK_VERSION=3.4.14
#3.5.0以下版本下载链接
#ZK_URL=https://archive.apache.org/dist/zookeeper/zookeeper-${ZK_VERSION}/zookeeper-${ZK_VERSION}.tar.gz


NODE1=10.0.0.100
NODE2=10.0.0.101
NODE3=10.0.0.102

.  /etc/os-release

HOST=`hostname -I|awk '{print $1}'`

color () {
    RES_COL=60
    MOVE_TO_COL="echo -en \\033[${RES_COL}G"
    SETCOLOR_SUCCESS="echo -en \\033[1;32m"
    SETCOLOR_FAILURE="echo -en \\033[1;31m"
    SETCOLOR_WARNING="echo -en \\033[1;33m"
    SETCOLOR_NORMAL="echo -en \E[0m"
    echo -n "$1" && $MOVE_TO_COL
    echo -n "["
    if [ $2 = "success" -o $2 = "0" ] ;then
        ${SETCOLOR_SUCCESS}
        echo -n $"  OK  "    
    elif [ $2 = "failure" -o $2 = "1"  ] ;then 
        ${SETCOLOR_FAILURE}
        echo -n $"FAILED"
    else
        ${SETCOLOR_WARNING}
        echo -n $"WARNING"
    fi
    ${SETCOLOR_NORMAL}
    echo -n "]"
    echo 
}

zk_myid () {
read -p "请输入node编号(默认为 1): " MYID

if [ -z "$MYID" ] ;then
    MYID=1
elif [[ ! "$MYID" =~ ^[0-9]+$ ]];then
    color  "请输入正确的node编号!" 1
    exit
else
    true
fi
}


install_jdk() {
    if [ $ID = 'centos' -o  $ID = 'rocky' ];then
        yum -y install java-1.8.0-openjdk-devel || { color "安装JDK失败!" 1; exit 1; }
    else
        apt update
        apt install openjdk-11-jdk -y || { color "安装JDK失败!" 1; exit 1; } 
        #apt install openjdk-8-jdk -y || { color "安装JDK失败!" 1; exit 1; } 
    fi
    java -version
}

install_zookeeper() {
    wget -P /usr/local/src/ $ZK_URL || { color  "下载失败!" 1 ;exit ; }
    tar xf /usr/local/src/${ZK_URL##*/} -C /usr/local
    ln -s /usr/local/apache-zookeeper-*-bin/ /usr/local/zookeeper
    echo 'PATH=/usr/local/zookeeper/bin:$PATH' >  /etc/profile.d/zookeeper.sh
    .  /etc/profile.d/zookeeper.sh
    
    mkdir -p /usr/local/zookeeper/data 
    echo $MYID > /usr/local/zookeeper/data/myid
    cat > /usr/local/zookeeper/conf/zoo.cfg <<EOF
tickTime=2000
initLimit=10
syncLimit=5
dataDir=/usr/local/zookeeper/data
clientPort=2181
maxClientCnxns=128
autopurge.snapRetainCount=3
autopurge.purgeInterval=24
server.1=${NODE1}:2888:3888
server.2=${NODE2}:2888:3888
server.3=${NODE3}:2888:3888
EOF
	cat > /lib/systemd/system/zookeeper.service <<EOF
[Unit]
Description=zookeeper.service
After=network.target

[Service]
Type=forking
#Environment=/usr/local/zookeeper
ExecStart=/usr/local/zookeeper/bin/zkServer.sh start
ExecStop=/usr/local/zookeeper/bin/zkServer.sh stop
ExecReload=/usr/local/zookeeper/bin/zkServer.sh restart

[Install]
WantedBy=multi-user.target
EOF
    systemctl daemon-reload
    systemctl enable --now  zookeeper.service
    systemctl is-active zookeeper.service
	if [ $? -eq 0 ] ;then 
        color "zookeeper 安装成功!" 0  
    else 
        color "zookeeper 安装失败!" 1
        exit 1
    fi   
}

zk_myid

install_jdk

install_zookeeper