Zookeeper （一）集群简单搭建

pfjia

2019-06-28

使用zookeeper-3.4.5版本为例，进行集群搭建的配置说明。

将conf目录下的zoo-sample.cfg重命名成zoo.cfg, 进行如下修改配置（集群包含zk01, zk02, zk03三个节点）

[parallels@zk01 conf]$ less zoo.cfg
# The number of milliseconds of each tick
tickTime=2000
# The number of ticks that the initial 
# synchronization phase can take
initLimit=10
# The number of ticks that can pass between 
# sending a request and getting an acknowledgement
syncLimit=5
# the directory where the snapshot is stored.
# do not use /tmp for storage, /tmp here is just 
# example sakes.
dataDir=/home/parallels/app/zookeeper-3.4.5/data
# the port at which the clients will connect
clientPort=2181
#
# Be sure to read the maintenance section of the 
# administrator guide before turning on autopurge.
#
# http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
#
# The number of snapshots to retain in dataDir
#autopurge.snapRetainCount=3
# Purge task interval in hours
# Set to "0" to disable auto purge feature
#autopurge.purgeInterval=1
server.1=zk01:2888:3888
server.2=zk02:2888:3888
server.3=zk03:2888:3888

然后根据配置在zookeeper-3.4.5目录下创建目录data，创建名为myid的文件，内容为配置文件中锁配置的server.id：

[parallels@zk01 data]$ less myid
1

其他两个节点zk02和zk03也如此配置。
进入每个节点的bin目录，依次启动zookeeper节点：

[parallels@zk01 bin]$ ./zkServer.sh start
JMX enabled by default
Using config: /home/parallels/app/zookeeper-3.4.5/bin/../conf/zoo.cfg

当节点未全部启动成功时，查看节点状态：

[parallels@zk01 bin]$ ./zkServer.sh status
JMX enabled by default
Using config: /home/parallels/app/zookeeper-3.4.5/bin/../conf/zoo.cfg
Error contacting service. It is probably not running.

全部节点启动完成后，查看节点状态：

[parallels@zk01 bin]$ ./zkServer.sh status
JMX enabled by default
Using config: /home/parallels/app/zookeeper-3.4.5/bin/../conf/zoo.cfg
Mode: follower

[parallels@zk02 bin]$ ./zkServer.sh status
JMX enabled by default
Using config: /home/parallels/app/zookeeper-3.4.5/bin/../conf/zoo.cfg
Mode: leader

[parallels@zk03 bin]$ ./zkServer.sh status
JMX enabled by default
Using config: /home/parallels/app/zookeeper-3.4.5/bin/../conf/zoo.cfg
Mode: follower

连接集群，发送数据

zookeeper管理客户所存放的数据采用的是类似于文件树的结构，每个节点叫做一个node。

[zk: localhost:2181(CONNECTED) 0] ls /
[zookeeper]
[zk: localhost:2181(CONNECTED) 1] create zkData 1000
Command failed: java.lang.IllegalArgumentException: Path must start with / character
[zk: localhost:2181(CONNECTED) 2] create /zkData 1000
Created /zkData
[zk: localhost:2181(CONNECTED) 3] ls /               
[zkData, zookeeper]
[zk: localhost:2181(CONNECTED) 4] get /zkData
1000
cZxid = 0x100000004
ctime = Sun Sep 30 09:43:11 CST 2018
mZxid = 0x100000004
mtime = Sun Sep 30 09:43:11 CST 2018
pZxid = 0x100000004
cversion = 0
dataVersion = 0
aclVersion = 0
ephemeralOwner = 0x0
dataLength = 4
numChildren = 0

此时登录另外两台集群节点查看数据，能看到数据已经同步：

[zk: localhost:2181(CONNECTED) 1] ls /
[zkData, zookeeper]
[zk: localhost:2181(CONNECTED) 2] get /zkData
1005
cZxid = 0x100000004
ctime = Sun Sep 30 09:43:11 CST 2018
mZxid = 0x100000005
mtime = Sun Sep 30 09:45:26 CST 2018
pZxid = 0x100000004
cversion = 0
dataVersion = 1
aclVersion = 0
ephemeralOwner = 0x0
dataLength = 4
numChildren = 0

其他数据操作命令：

[zk: localhost:2181(CONNECTED) 6] set /zkData 1005
cZxid = 0x100000004
ctime = Sun Sep 30 09:43:11 CST 2018
mZxid = 0x100000005
mtime = Sun Sep 30 09:45:26 CST 2018
pZxid = 0x100000004
cversion = 0
dataVersion = 1
aclVersion = 0
ephemeralOwner = 0x0
dataLength = 4
numChildren = 0
[zk: localhost:2181(CONNECTED) 7] get /zkData     
1005
cZxid = 0x100000004
ctime = Sun Sep 30 09:43:11 CST 2018
mZxid = 0x100000005
mtime = Sun Sep 30 09:45:26 CST 2018
pZxid = 0x100000004
cversion = 0
dataVersion = 1
aclVersion = 0
ephemeralOwner = 0x0
dataLength = 4
numChildren = 0
[zk: localhost:2181(CONNECTED) 8]

当我们在某一台节点对数据进行了更新，数据会实时同步到另外的集群节点中。

集群可靠性测试

当leader节点退出：

[parallels@zk02 bin]$ ./zkServer.sh status
JMX enabled by default
Using config: /home/parallels/app/zookeeper-3.4.5/bin/../conf/zoo.cfg
Mode: leader
[parallels@zk02 bin]$ jps
5176 Jps
31172 QuorumPeerMain
[parallels@zk02 bin]$ kill -9 31172

我们可以查看到其他节点被选举成为leader：

[parallels@zk03 bin]$ ./zkServer.sh status
JMX enabled by default
Using config: /home/parallels/app/zookeeper-3.4.5/bin/../conf/zoo.cfg
Mode: leader

但是如果集群中三个节点中的两个都退出（zk02, zk03），则集群将无法正常工作：

[parallels@zk01 bin]$ ./zkServer.sh status
JMX enabled by default
Using config: /home/parallels/app/zookeeper-3.4.5/bin/../conf/zoo.cfg
Error contacting service. It is probably not running.

集群要想正常工作，存活节点的数量必须大于集群节点数量的一半。

parallels zookeeper集群