存儲節點cinder在云端上的作用是為計算節點提供塊存儲資源，為虛擬機實例提供一個存儲分區接入到虛擬機中，同時還能進行管理虛擬機卷快照和卷類型。 1）在controller1上創建數據庫用戶并賦予權限 ``` MariaDB [(none)]> CREATE DATABASE cinder; MariaDB [(none)]> GRANT ALL PRIVILEGES ON cinder.* TO 'cinder'@'localhost' IDENTIFIED BY 'yjscloud'; MariaDB [(none)]> GRANT ALL PRIVILEGES ON cinder.* TO 'cinder'@'%' IDENTIFIED BY 'yjscloud'; ``` 2）在controller1上創建cinder用戶并賦予admin權限 ``` source /root/admin-openrc openstack user create --domain default cinder --password yjscloud openstack role add --project service --user cinder admin ``` 3）在controller1上創建volume服務 ``` openstack service create --name cinder --description "OpenStack Block Storage" volume openstack service create --name cinderv2 --description "OpenStack Block Storage" volumev2 ``` 4）在controller1上創建endpoint ``` openstack endpoint create --region RegionOne volume public http://yjscloud.com:8776/v1/%\(tenant_id\)s openstack endpoint create --region RegionOne volume internal http://yjscloud.com:8776/v1/%\(tenant_id\)s openstack endpoint create --region RegionOne volume admin http://yjscloud.com:8776/v1/%\(tenant_id\)s openstack endpoint create --region RegionOne volumev2 public http://yjscloud.com:8776/v2/%\(tenant_id\)s openstack endpoint create --region RegionOne volumev2 internal http://yjscloud.com:8776/v2/%\(tenant_id\)s openstack endpoint create --region RegionOne volumev2 admin http://yjscloud.com:8776/v2/%\(tenant_id\)s ``` 5）在controller1、2、3上安裝cinder相關服務 ``` yum install openstack-cinder -y ``` 6）在controller1、2、3上配置cinder配置文件 ``` >/etc/cinder/cinder.conf openstack-config --set /etc/cinder/cinder.conf DEFAULT debug False openstack-config --set /etc/cinder/cinder.conf DEFAULT verbose True openstack-config --set /etc/cinder/cinder.conf DEFAULT my_ip 10.1.1.156 openstack-config --set /etc/cinder/cinder.conf DEFAULT osapi_volume_listen_port 8776 openstack-config --set /etc/cinder/cinder.conf DEFAULT auth_strategy keystone openstack-config --set /etc/cinder/cinder.conf DEFAULT enable_v1_api True openstack-config --set /etc/cinder/cinder.conf DEFAULT enable_v2_api True openstack-config --set /etc/cinder/cinder.conf DEFAULT enable_v3_api True openstack-config --set /etc/cinder/cinder.conf DEFAULT glance_api_servers http://yjscloud.com:9292 openstack-config --set /etc/cinder/cinder.conf DEFAULT glance_api_version 2 openstack-config --set /etc/cinder/cinder.conf DEFAULT storage_availability_zone nova openstack-config --set /etc/cinder/cinder.conf DEFAULT default_availability_zone nova openstack-config --set /etc/cinder/cinder.conf DEFAULT allow_availability_zone_fallback True openstack-config --set /etc/cinder/cinder.conf DEFAULT service_down_time 180 openstack-config --set /etc/cinder/cinder.conf DEFAULT report_interval 10 openstack-config --set /etc/cinder/cinder.conf DEFAULT osapi_volume_workers 4 openstack-config --set /etc/cinder/cinder.conf DEFAULT enable_force_upload True openstack-config --set /etc/cinder/cinder.conf DEFAULT rootwrap_config /etc/cinder/rootwrap.conf openstack-config --set /etc/cinder/cinder.conf database connection mysql+pymysql://cinder:yjscloud@yjscloud.com/cinder openstack-config --set /etc/cinder/cinder.conf database idle_timeout 3600 openstack-config --set /etc/cinder/cinder.conf database max_pool_size 30 openstack-config --set /etc/cinder/cinder.conf database max_retries -1 openstack-config --set /etc/cinder/cinder.conf database retry_interval 2 openstack-config --set /etc/cinder/cinder.conf database max_overflow 60 openstack-config --set /etc/cinder/cinder.conf oslo_messaging_rabbit rabbit_hosts controller1:5672,controller2:5672,controller3:5672 openstack-config --set /etc/cinder/cinder.conf oslo_messaging_rabbit rabbit_userid openstack openstack-config --set /etc/cinder/cinder.conf oslo_messaging_rabbit rabbit_password yjscloud openstack-config --set /etc/cinder/cinder.conf oslo_messaging_rabbit rabbit_ha_queues True openstack-config --set /etc/cinder/cinder.conf oslo_messaging_rabbit rabbit_use_ssl False openstack-config --set /etc/cinder/cinder.conf oslo_messaging_rabbit rabbit_retry_interval 1 openstack-config --set /etc/cinder/cinder.conf oslo_messaging_rabbit rabbit_retry_backoff 2 openstack-config --set /etc/cinder/cinder.conf oslo_messaging_rabbit rabbit_max_retries 0 openstack-config --set /etc/cinder/cinder.conf oslo_messaging_rabbit amqp_durable_queuesFalse openstack-config --set /etc/cinder/cinder.conf keystone_authtoken auth_uri http://yjscloud.com:5000 openstack-config --set /etc/cinder/cinder.conf keystone_authtoken auth_url http://yjscloud.com:35357 openstack-config --set /etc/cinder/cinder.conf keystone_authtoken memcached_servers controller1:11211,controller2:11211,controller3:11211 openstack-config --set /etc/cinder/cinder.conf keystone_authtoken auth_type password openstack-config --set /etc/cinder/cinder.conf keystone_authtoken project_domain_name default openstack-config --set /etc/cinder/cinder.conf keystone_authtoken user_domain_name default openstack-config --set /etc/cinder/cinder.conf keystone_authtoken project_name service openstack-config --set /etc/cinder/cinder.conf keystone_authtoken username cinder openstack-config --set /etc/cinder/cinder.conf keystone_authtoken password yjscloud openstack-config --set /etc/cinder/cinder.conf oslo_concurrency lock_path /var/lib/cinder/tmp ``` 7）在controller1上同步數據庫 ``` su -s /bin/sh -c "cinder-manage db sync" cinder ``` 8）在controller1、2、3上啟動cinder服務，并設置開機啟動 ``` systemctl enable openstack-cinder-api.service openstack-cinder-scheduler.service systemctl start openstack-cinder-api.service openstack-cinder-scheduler.service systemctl status openstack-cinder-api.service openstack-cinder-scheduler.service ``` **注意！！！其他controller2、3重復做5、6、8步即可** 11）安裝Cinder節點，Cinder節點這里我們需要額外的添加一個硬盤（/dev/sdb)用作cinder的存儲服務(注意！這一步是在cinder節點 操作的） ``` yum install lvm2 -y ``` 12）啟動服務并設置為開機自啟**（注意！這一步是在cinder節點操作的）** ``` systemctl enable lvm2-lvmetad.service systemctl start lvm2-lvmetad.service systemctl status lvm2-lvmetad.service ``` 13）創建lvm, 這里的/dev/sdb就是額外添加的硬盤**（注意！這一步是在cinder節點操作的）** ``` fdisk -l pvcreate /dev/sdb vgcreate cinder-volumes /dev/sdb ``` 14）編輯存儲節點lvm.conf文件**（注意！這一步是在cinder節點操作的）** ``` vim /etc/lvm/lvm.conf ``` ``` filter=[“a/sda/”,”a/sdb/”,”r/.*/*”] ``` ``` systemctl restart lvm2-lvmetad.service ``` 然后重啟下lvm2服務： ``` systemctl restart lvm2-lvmetad.service systemctl status lvm2-lvmetad.service ``` 15）安裝openstack-cinder、targetcli**（注意！這一步是在cinder節點操作的）** ``` yum install openstack-cinder openstack-utils targetcli python-keystone ntpdate scsi-target-utils -y ``` 16）配置cinder配置文件**（注意！這一步是在cinder節點操作的）** ``` cp /etc/cinder/cinder.conf /etc/cinder/cinder.conf.bak >/etc/cinder/cinder.conf openstack-config --set /etc/cinder/cinder.conf DEFAULT debug False openstack-config --set /etc/cinder/cinder.conf DEFAULT verbose True openstack-config --set /etc/cinder/cinder.conf DEFAULT auth_strategy keystone openstack-config --set /etc/cinder/cinder.conf DEFAULT my_ip 10.1.1.156 openstack-config --set /etc/cinder/cinder.conf DEFAULT enabled_backends lvm openstack-config --set /etc/cinder/cinder.conf DEFAULT glance_api_servers http://yjscloud.com:9292 openstack-config --set /etc/cinder/cinder.conf DEFAULT glance_api_version 2 openstack-config --set /etc/cinder/cinder.conf DEFAULT enable_v1_api True openstack-config --set /etc/cinder/cinder.conf DEFAULT enable_v2_api True openstack-config --set /etc/cinder/cinder.conf DEFAULT enable_v3_api True openstack-config --set /etc/cinder/cinder.conf DEFAULT storage_availability_zone nova openstack-config --set /etc/cinder/cinder.conf DEFAULT default_availability_zone nova openstack-config --set /etc/cinder/cinder.conf DEFAULT service_down_time 180 openstack-config --set /etc/cinder/cinder.conf DEFAULT report_interval 10 openstack-config --set /etc/cinder/cinder.conf DEFAULT osapi_volume_workers 4 openstack-config --set /etc/cinder/cinder.conf DEFAULT os_region_name RegionOne openstack-config --set /etc/cinder/cinder.conf DEFAULT api_paste_config /etc/cinder/api-paste.ini openstack-config --set /etc/cinder/cinder.conf oslo_messaging_rabbit rabbit_hosts controller1:5672,controller2:5672,controller3:5672 openstack-config --set /etc/cinder/cinder.conf oslo_messaging_rabbit rabbit_userid openstack openstack-config --set /etc/cinder/cinder.conf oslo_messaging_rabbit rabbit_password yjscloud openstack-config --set /etc/cinder/cinder.conf oslo_messaging_rabbit rabbit_ha_queues True openstack-config --set /etc/cinder/cinder.conf oslo_messaging_rabbit rabbit_use_ssl False openstack-config --set /etc/cinder/cinder.conf oslo_messaging_rabbit rabbit_retry_interval 1 openstack-config --set /etc/cinder/cinder.conf oslo_messaging_rabbit rabbit_retry_backoff 2 openstack-config --set /etc/cinder/cinder.conf oslo_messaging_rabbit rabbit_max_retries 0 openstack-config --set /etc/cinder/cinder.conf oslo_messaging_rabbit amqp_durable_queues False openstack-config --set /etc/cinder/cinder.conf database connection mysql+pymysql://cinder:yjscloud@yjscloud.com/cinder openstack-config --set /etc/cinder/cinder.conf database idle_timeout 3600 openstack-config --set /etc/cinder/cinder.conf database max_pool_size 30 openstack-config --set /etc/cinder/cinder.conf database max_retries -1 openstack-config --set /etc/cinder/cinder.conf database retry_interval 2 openstack-config --set /etc/cinder/cinder.conf database max_overflow 60 openstack-config --set /etc/cinder/cinder.conf keystone_authtoken auth_uri http://yjscloud.com:5000 openstack-config --set /etc/cinder/cinder.conf keystone_authtoken auth_url http://yjscloud.com:35357 openstack-config --set /etc/cinder/cinder.conf keystone_authtoken memcached_servers controller1:11211,controller2:11211,controller3:11211 openstack-config --set /etc/cinder/cinder.conf keystone_authtoken auth_type password openstack-config --set /etc/cinder/cinder.conf keystone_authtoken project_domain_name default openstack-config --set /etc/cinder/cinder.conf keystone_authtoken user_domain_name default openstack-config --set /etc/cinder/cinder.conf keystone_authtoken project_name service openstack-config --set /etc/cinder/cinder.conf keystone_authtoken username cinder openstack-config --set /etc/cinder/cinder.conf keystone_authtoken password yjscloud openstack-config --set /etc/cinder/cinder.conf lvm volume_driver cinder.volume.drivers.lvm.LVMVolumeDriver openstack-config --set /etc/cinder/cinder.conf lvm volume_group cinder-volumes openstack-config --set /etc/cinder/cinder.conf lvm iscsi_protocol iscsi openstack-config --set /etc/cinder/cinder.conf lvm iscsi_helper lioadm openstack-config --set /etc/cinder/cinder.conf oslo_convcurrency lock_path /var/lib/cinder/tmp ``` 17）啟動openstack-cinder-volume和target并設置開機啟動**（注意！這一步是在cinder節點操作的）** ``` systemctl enable openstack-cinder-volume.service target.service systemctl restart openstack-cinder-volume.service target.service systemctl status openstack-cinder-volume.service target.service ``` 18）在任意一個節點驗證cinder服務是否正常 ``` source /root/admin-openrc cinder service-list netstat -ntlp | grep 3260 ```