docker部署rabbitmq集群的实现方法

拉取rabbitmq management镜像

docker pull rabbitmq:3.7-rc-management

若不使用Rabbitmq的management功能，可以拉取镜像：rabbitmq:3.7-rc

参考： https://hub.docker.com/_/rabbitmq/

创建网络

创建rabbitmq私有网络

# docker network create rabbitmqnet
# docker network ls
NETWORK ID     NAME        DRIVER       SCOPE
65b44ea8847c    rabbitmqnet     bridge       local
...

创建节点

通过docker命令创建三个Rabbitmq nodes；

注意这里使用相同的 RABBITMQ_ERLANG_COOKIE 值

# docker run -d \
--name=rabbitmq1 \
-p 5672:5672 \
-p 15672:15672 \
-e RABBITMQ_NODENAME=rabbitmq1 \
-e RABBITMQ_ERLANG_COOKIE='YZSDHWMFSMKEMBDHSGGZ' \
-h rabbitmq1 \
--net=rabbitmqnet \
rabbitmq:3.7-rc-management

# docker run -d \
--name=rabbitmq2 \
-p 5673:5672 \
-p 15673:15672 \
-e RABBITMQ_NODENAME=rabbitmq2 \
-e RABBITMQ_ERLANG_COOKIE='YZSDHWMFSMKEMBDHSGGZ' \
-h rabbitmq2 \
--net=rabbitmqnet \
rabbitmq:3.7-rc-management

# docker run -d \
--name=rabbitmq3 \
-p 5674:5672 \
-p 15674:15672 \
-e RABBITMQ_NODENAME=rabbitmq3 \
-e RABBITMQ_ERLANG_COOKIE='YZSDHWMFSMKEMBDHSGGZ' \
-h rabbitmq3 \
--net=rabbitmqnet \
rabbitmq:3.7-rc-management

组建rabbitmq集群

登陆Rabbitmq的后两个节点，执行命令加入第一个Rabbitmq节点集群

### Disk Node
# docker exec rabbitmq2 bash -c \
"rabbitmqctl stop_app && \
rabbitmqctl reset && \
rabbitmqctl join_cluster rabbitmq1@rabbitmq1 && \
rabbitmqctl start_app"

### Ram Node
# docker exec rabbitmq3 bash -c \
"rabbitmqctl stop_app && \
rabbitmqctl reset && \
rabbitmqctl join_cluster --ram rabbitmq1@rabbitmq1 && \
rabbitmqctl start_app"

退出集群

# docker exec rabbitmq3 bash -c \
"rabbitmqctl stop_app && \
rabbitmqctl reset && \
rabbitmqctl start_app"

拉取haproxy镜像

拉取haproxy镜像

# docker pull haproxy

启动haproxy

# cat haproxy-create.sh
#! /bin/bash

docker run -d \
  --name rabbitmq-haproxy \
  -p 1080:80 -p 5677:5677 -p 8001:8001 \
  --net=rabbitmqnet \
  -v /root/rabbitmq/haproxy-etc:/usr/local/etc/haproxy:ro \
  haproxy:latest

haproxy的配置文件如下：

root@node0:~/rabbitmq# cat haproxy-etc/haproxy.cfg
# Simple configuration for an HTTP proxy listening on port 80 on all
# interfaces and forwarding requests to a single backend "servers" with a
# single server "server1" listening on 127.0.0.1:8000

global
  daemon
  maxconn 256

defaults
  mode http
  timeout connect 5000ms
  timeout client 5000ms
  timeout server 5000ms

listen rabbitmq_cluster
  bind 0.0.0.0:5677
  option tcplog
  mode tcp
  balance leastconn
  server rabbit1 rabbitmq1:5672 check inter 2s rise 2 fall 3
  server rabbit2 rabbitmq2:5672 check inter 2s rise 2 fall 3
  server rabbit3 rabbitmq3:5672 check inter 2s rise 2 fall 3

listen http_front
  bind 0.0.0.0:80
  stats uri /haproxy?stats

listen rabbitmq_admin
  bind 0.0.0.0:8001
  server rabbit1 rabbitmq1:15672
  server rabbit2 rabbitmq2:15672
  server rabbit3 rabbitmq3:15672

启动haproxy后，可以通过haproxy来访问rabbitmq集群：http://external-ip:8001

获取haproxy的状态：http://external-ip:1080/haproxy?stats

rabbitmq exporter部署

要收集rabbitmq的metrics给prometheus使用的话，可以使用开源的rabbitmq-exporter

参考如下：

https://github.com/kbudde/rabbitmq_exporter

https://hub.docker.com/r/kbudde/rabbitmq-exporter/

拉取镜像

# docker pull kbudde/rabbitmq-exporter

启动rabbitmq实例

代码如下：

# docker run -d --name=rabbitmq1 -p 5672:5672 -p 15672:15672 -e RABBITMQ_NODENAME=rabbitmq1 -e RABBITMQ_ERLANG_COOKIE='YZSDHWMFSMKEMBDHSGGZ' -h rabbitmq1 --net=rabbitmqnet -p 9090:9090 rabbitmq:3.7-rc-management

开启9090端口，这个是rabbitmq exporter的默认PUBLISH_PORT

启动rabbitmq exporter实例

# docker run -d --net=container:rabbitmq1 kbudde/rabbitmq-exporter

获取rabbitmq的metrics

# wget http://localhost:9090/metrics