Docker部署ES集群、ES负载均衡

部署步骤

初始化 es 配置文件

    -- 拉取 es 镜像
    docker pull elasticsearch:7.2.0
    --创建挂载目录[data:存放索引数据,plugins:存放 es 插件]
    mkdir -p  /esdata/elasticsearch
    mkdir -p  /esdata/elasticsearch/data
    mkdir -p  /esdata/elasticsearch/data/data1
    mkdir -p  /esdata/elasticsearch/data/data2
    mkdir -p  /esdata/elasticsearch/data/data3
    mkdir -p  /esdata/elasticsearch/plugins
    mkdir -p  /esdata/elasticsearch/plugins/plugins1
    mkdir -p  /esdata/elasticsearch/plugins/plugins2
    mkdir -p  /esdata/elasticsearch/plugins/plugins3
    
    -- 设置执行权限
    chmod 777 /esdata/elasticsearch/data/data1 
    chmod 777 /esdata/elasticsearch/data/data2 
    chmod 777 /esdata/elasticsearch/data/data3 
    
    --data1/data2/data3 分别创建 es.yml [network.publish_host:填写服务器 ip]
    vim /esdata/elasticsearch/config/es1.yml
    ->>
        cluster.name: elasticsearch-cluster 
        cluster.initial_master_nodes : es-node1
        node.name: es-node1 
        node.master: true 
        node.data: true  
        network.bind_host: 0.0.0.0 
        network.publish_host: 192.168.1.127 
        http.port: 9201 
        transport.tcp.port: 9301
        http.cors.enabled: true 
        http.cors.allow-origin: "*" 
        discovery.zen.ping.unicast.hosts:  ["192.168.1.127:9301","192.168.1.127:9302","192.168.1.127:9303"] 
       
    vim /esdata/elasticsearch/config/es2.yml
    ->>
        cluster.name: elasticsearch-cluster 
        node.name: es-node2
        node.master: false 
        node.data: true  
        network.bind_host: 0.0.0.0 
        network.publish_host: 192.168.1.127 
        http.port: 9202 
        transport.tcp.port: 9302 
        http.cors.enabled: true 
        http.cors.allow-origin: "*" 
        discovery.zen.ping.unicast.hosts:  ["192.168.1.127:9301","192.168.1.127:9302","192.168.1.127:9303"] 

        
    vim /esdata/elasticsearch/config/es3.yml
    ->>
        cluster.name: elasticsearch-cluster 
        node.name: es-node3
        node.master: false 
        node.data: true  
        network.bind_host: 0.0.0.0 
        network.publish_host: 192.168.1.127 
        http.port: 9203 
        transport.tcp.port: 9303
        http.cors.enabled: true 
        http.cors.allow-origin: "*" 
        discovery.zen.ping.unicast.hosts:  ["192.168.1.127:9300","192.168.1.127:9301","192.168.1.127:9302"]  

调高 JVM 线程数限制数量

vim /etc/sysctl.conf
->>
	vm.max_map_count=262144 
	
# 刷新配置
sysctl -p

 服务部署

es 集群部署

# 服务 1
 docker run -e ES_JAVA_OPTS="-Xms2048m -Xmx2048m" \
	-d -p 9201:9201 -p 9301:9301 \
	-e ES_MIN_MEM=128m \
	-e ES_MAX_MEM=4096m \
	-v /esdata/elasticsearch/config/es1.yml:/usr/share/elasticsearch/config/elasticsearch.yml \
	-v /esdata/elasticsearch/data/data1/:/usr/share/elasticsearch/data/ \
	-v /esdata/elasticsearch/plugins/plugins1/:/usr/share/elasticsearch/plugins  \
	--restart=always \
	--name ES01 \
	elasticsearch:7.2.0
# 服务 2
 docker run -e ES_JAVA_OPTS="-Xms2048m -Xmx2048m" \
	-d -p 9202:9202 -p 9302:9302 \
	-e ES_MIN_MEM=128m \
	-e ES_MAX_MEM=4096m \
	-v /esdata/elasticsearch/config/es2.yml:/usr/share/elasticsearch/config/elasticsearch.yml \
	-v /esdata/elasticsearch/data/data2/:/usr/share/elasticsearch/data/ \
	-v /esdata/elasticsearch/plugins/plugins2/:/usr/share/elasticsearch/plugins  \
	--restart=always \
	--name ES02 \
	elasticsearch:7.2.0
 # 服务 3
 docker run -e ES_JAVA_OPTS="-Xms2048m -Xmx2048m" \
	-d -p 9203:9203 -p 9303:9303 \
	-e ES_MIN_MEM=128m \
	-e ES_MAX_MEM=4096m \
	-v /esdata/elasticsearch/config/es3.yml:/usr/share/elasticsearch/config/elasticsearch.yml \
	-v /esdata/elasticsearch/data/data3/:/usr/share/elasticsearch/data/ \
	-v /esdata/elasticsearch/plugins/plugins3/:/usr/share/elasticsearch/plugins  \
	--restart=always \
	--name ES03 \
	elasticsearch:7.2.0

防火墙设置

    # 防火墙设置	
    firewall-cmd --add-port=9301/tcp
    firewall-cmd --add-port=9302/tcp 
    firewall-cmd --add-port=9303/tcp
    firewall-cmd --add-port=9200/tcp
    firewall-cmd --add-port=9201/tcp 
    firewall-cmd --add-port=9202/tcp 
    firewall-cmd --add-port=9203/tcp
    firewall-cmd --complete-reload

确认集群配置

在浏览器打开 http://192.168.1.127:9200/_cat/nodes?pretty

Docker 部署 ES 集群、ES 负载均衡

IK 分词器安装

    # 进入容器
    docker exec -it ES01 bash 
        # 在线安装
        elasticsearch-plugin install https://github.com/medcl/elasticsearch-analysis-ik/releases/download/v7.2.0/elasticsearch-analysis-ik-7.2.0.zip
    
    # 复制 es1 安装的插件到 es2 和 es3
    cp -rf  /esdata/elasticsearch/plugins/plugins1/analysis-ik /home/creationpoint/software/elasticsearch/config/plugins2/
    cp -rf  /esdata/elasticsearch/plugins/plugins1/analysis-ik /home/creationpoint/software/elasticsearch/config/plugins3/
    
    # 重启 es
    docker restart ES01 
    docker restart ES02 ES03  

esUI 部署

部署 elasticsearch-head 便于管理 es 数据

docker run -d \
    --name=elasticsearch-head \
    -p 9100:9100 \
    -m 512m \
    --memory-swap=1024m \
    mobz/elasticsearch-head:5

 

确认效果Docker 部署 ES 集群、ES 负载均衡

ES 负载均衡

nginx 配置 es负载均衡

修改 nginx 配置文件

#修改 nginx 配置文件
vim /home/jamelli/software/nginx/conf.d/default.conf
->>
   upstream es{
		least_conn;    #把请求转发给连接数较少的后端服务器
		server 192.168.1.127:9201;#ES 对应的 ip:port
        server 192.168.1.127:9202;
        server 192.168.1.127:9203;
    }
    
    server {
        listen       9210;
        server_name  localhost;
        underscores_in_headers on;
    
        location / {
            proxy_set_header   Host $host:$server_port;
            proxy_redirect off;
            proxy_set_header X-Real-IP $remote_addr;
            proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
            proxy_pass http://es;
        }
    }
	
	
# 重新加载 nginx 使生效(二选一)
docker restart nginx 
nginx -s reload

 

此刻访问服务器的 9210 端口会负载均衡到 es 集群上,测试一下。看下图可以看到已经可以轮询 es 了
Docker 部署 ES 集群、ES 负载均衡
Docker 部署 ES 集群、ES 负载均衡

 


来源:https://blog.csdn.net/Jamel_LiToo/article/details/110070741

© 版权声明

☆ END ☆
喜欢就点个赞吧
点赞0 分享
图片正在生成中,请稍后...