spark 2.3.1 Standalone+zookeeper 集群
1. 修改spark-env.sh 文件加入zookeeper配置(http://spark.apache.org/docs/latest/configuration.html#deploy 具体配置说明)
export SPARK_DAEMON_JAVA_OPTS="-Dspark.deploy.recoveryMode=ZOOKEEPER -Dspark.deploy.zookeeper.url=sky1:2181,sky2:2181,sky3:2181"
修改完后,同步到其它节点
2. 修改spark 重master节点,(例 指定sky1为重master节点)
vim spark-env.sh
export SPARK_MASTER_HOST=sky1
3.启动重master节点
./sbin/start-master.sh
4. 查看重master节点服务状态 是否为 STANDBY
http://ip:8080
5. 测试
杀掉主master节点,等一段时间是否可自动切换到重master节点
相关推荐
Johnson0 2020-07-28
Hhanwen 2020-07-26
zhixingheyitian 2020-07-19
yanqianglifei 2020-07-07
Hhanwen 2020-07-05
Hhanwen 2020-06-25
rongwenbin 2020-06-15
sxyhetao 2020-06-12
hovermenu 2020-06-10
Oeljeklaus 2020-06-10
zhixingheyitian 2020-06-08
Johnson0 2020-06-08
zhixingheyitian 2020-06-01
xclxcl 2020-05-31
Hhanwen 2020-05-29
zhixingheyitian 2020-05-29
Oeljeklaus 2020-05-29