### 1、部署前實驗（現在是不同pod之間網絡是不通的） 首先，flannel利用Kubernetes API或者etcd用于存儲整個集群的網絡配置，其中最主要的內容為設置集群的網絡地址空間。例如，設定整個集群內所有容器的IP都取自網段“10.1.0.0/16”。 接著，flannel在每個主機中運行flanneld作為agent，它會為所在主機從集群的網絡地址空間中，獲取一個小的網段subnet，本主機內所有容器的IP地址都將從中分配。 然后，flanneld再將本主機獲取的subnet以及用于主機間通信的Public IP，同樣通過kubernetes API或者etcd存儲起來。 最后，flannel利用各種backend mechanism，例如udp，vxlan等等，跨主機轉發容器間的網絡流量，完成容器間的跨主機通信。 ### 2、flannel官方下載 https://github.com/coreos/flannel wget https://github.com/coreos/flannel/releases/download/v0.11.0/flannel-v0.11.0-linux-amd64.tar.gz ``` mkdir /opt/flannel-v0.11.0 tar xf flannel-v0.11.0-linux-amd64.tar.gz -C /opt/flannel-v0.11.0/ ln -s /opt/flannel-v0.11.0/ /opt/flannel cd /opt/flannel mkdir cert ``` #### 在HDSS-79機器上分發證書 ``` [root@hdss7-200 certs]# scp ca.pem client-key.pem client.pem hdss21-200:/opt/flannel/cert root@hdss7-200's password: ca.pem 100% 1350 1.3MB/s 00:00 client-key.pem 100% 1675 1.2MB/s 00:00 client.pem 100% 1371 1.8MB/s 00:00 ``` #### 創建配置 ``` [root@hdsss7-21 flannel]# pwd /opt/flannel [root@hdss7-21 flannel]# cat subnet.env FLANNEL_NETWORK=172.7.0.0/16 FLANNEL_SUBNET=172.7.21.1/24 FLANNEL_MTU=1500 FLANNEL_IPMASQ=false ``` #### 創建啟動腳本 ``` [root@hdss7-21 flannel]# vim flannel.sh #!/bin/sh ./flanneld \ --public-ip=10.4.7.21 \ --etcd-endpoints=https://10.4.7.12:2379,https://10.4.7.21:2379,https://10.4.7.22:2379 \ --etcd-keyfile=./cert/client-key.pem \ --etcd-certfile=./cert/client.pem \ --etcd-cafile=./cert/ca.pem \ --iface=eth0 \ --subnet-file=./subnet.env \ --healthz-port=2401 chmod +x /opt/flannel/flannel.sh mkdir -p /data/logs/flanneld ``` #### 操作etcd，增加host-gw 在HDSS7-21.host.com上操作： ``` /opt/etcd目錄下操作 [root@hdss7-21 etcd]# ./etcdctl set /coreos.com/network/config '{"Network": "172.7.0.0/16", "Backend": {"Type": "host-gw"}}' {"Network": "172.7.0.0/16", "Backend": {"Type": "host-gw"}} [root@hdss7-21 etcd]# ./etcdctl get /coreos.com/network/config {"Network": "172.7.0.0/16", "Backend": {"Type": "host-gw"}} ``` #### 啟動文件配置 ``` vi /etc/supervisord.d/flannel.ini [program:flanneld] command=/opt/flannel/flanneld.sh ; the program (relative uses PATH, can take args) numprocs=1 ; number of processes copies to start (def 1) directory=/opt/flannel ; directory to cwd to before exec (def no cwd) autostart=true ; start at supervisord start (default: true) autorestart=true ; retstart at unexpected quit (default: true) startsecs=30 ; number of secs prog must stay running (def. 1) startretries=3 ; max # of serial start failures (default 3) exitcodes=0,2 ; 'expected' exit codes for process (default 0,2) stopsignal=QUIT ; signal used to kill process (default TERM) stopwaitsecs=10 ; max num secs to wait b4 SIGKILL (default 10) user=root ; setuid to this UNIX account to run the program redirect_stderr=true ; redirect proc stderr to stdout (default false) stdout_logfile=/data/logs/flanneld/flanneld.stdout.log ; stderr log path, NONE for none; default AUTO stdout_logfile_maxbytes=64MB ; max # logfile bytes b4 rotation (default 50MB) stdout_logfile_backups=4 ; # of stdout logfile backups (default 10) stdout_capture_maxbytes=1MB ; number of bytes in 'capturemode' (default 0) stdout_events_enabled=false ; emit events on stdout writes (default false) ``` #### 更新配置查看啟動 ``` supervisorctl update supervisorctl status ``` #### 3、在回來測試現在可以ping通了  #### 為什么可以通其實就是添加了靜態路由