准备三台机器, 安装centos7系统。
配置Host:
192.168.137.131 gluster1
192.168.137.132 gluster2
192.168.137.133 gluster3
建议防火墙都先关闭,部署完成后再加上然后在看整个集群状态,如果正常,就可以了。
防火墙添加:iptables -I INPUT -p tcp –dport 24007 -j ACCEPT
三台上都安装:
yum install centos-release-gluster -y
yum install -y glusterfs glusterfs-server glusterfs-fuse glusterfs-rdma glusterfs-geo-replication glusterfs-devel
mkdir /opt/glusterd
sed -i ‘s/var\/lib/opt/g’ /etc/glusterfs/glusterd.vol
systemctl start glusterd.service
systemctl enable glusterd.service
systemctl status glusterd.service
创建存储目录:
mkdir /opt/gfs_data
添加节点,只需要在第一台上做,其它不需要,我用的是137.131这台.
gluster peer probe gluster2
gluster peer probe gluster3
gluster peer status
创建卷,其它模式请参考:http://www.cnblogs.com/jicki/p/5801712.html
gluster volume create k8s-volume transport tcp gluster1:/opt/gfs_data gluster2:/opt/gfs_data gluster3:/opt/gfs_data force
正式环境推荐用8台的条带+复制。
gluster volume info
gluster volume quota k8s-volume limit-usage / 3GB
gluster volume set k8s-volume performance.cache-size 500M
gluster volume set k8s-volume performance.cache-size 500MB
gluster volume set k8s-volume performance.io-thread-count 16
gluster volume set k8s-volume network.ping-timeout 10
gluster volume set k8s-volume performance.write-behind-window-size 200MB
gluster volume info
以上参数是我自己根据机器配置调的,另外的参考配置如下:
# 开启 指定 volume 的配额
$ gluster volume quota k8s-volume enable
# 限制 指定 volume 的配额
$ gluster volume quota k8s-volume limit-usage / 1TB
# 设置 cache 大小, 默认32MB
$ gluster volume set k8s-volume performance.cache-size 4GB
# 设置 io 线程, 太大会导致进程崩溃
$ gluster volume set k8s-volume performance.io-thread-count 16
# 设置 网络检测时间, 默认42s
$ gluster volume set k8s-volume network.ping-timeout 10
# 设置 写缓冲区的大小, 默认1M
$ gluster volume set k8s-volume performance.write-behind-window-size 1024MB
客户端安装:
yum install -y glusterfs glusterfs-fuse
配置host:
mount -t glusterfs gluster1:k8s-volume /mnt/
注意防火墙问题,可以用命令关闭防火墙:
systemctl stop firewalld.service