mongodb版本升級及優化 · 運維知識記錄

# mongod2.6升級3.0及優化方案先把大概步驟寫出來,背景和細節后續補充 ## 升級副本集的步驟為: 1.master節點執行命令從集群中剔除需要升級的副本節點 ``` goumin:PRIMARY> rs.remove("192.168.56.202:27017") ``` 2.剔除后在副本機器上停止mongo服務 ``` /etc/init.d/mongodb stop ``` 3.修改配置文件,去掉集群的配置 ``` vim /usr/local/mongodb/conf/mongo.conf ``` 4.重新啟動副本節點的mongo服務,驗證升級條件是否允許 /etc/init.d/mongodb start ``` >use admin >db.upgradeCheckAllDBs() ``` 如果最后返回true就是滿足升級的要求 5.檢測通過后停止mongo服務使用 ``` /etc/init.d/mongodb stop killall mongod ``` 6.使用3.0的bin文件替換2.0的bin文件 ``` wget http://downloads.mongodb.org/linux/mongodb-linux-x86_64-v3.0-latest.tgz tar zxf mongodb-linux-x86_64-v3.0-latest.tgz \cp -a mongodb-linux-x86_64-3.0.15-19-gb4172b9/bin/* /usr/local/mongodb/bin/ ``` 6.重新啟動Mongo查看是否正常 ``` /etc/init.d/mongodb start ``` 7.關閉mongo服務,修改配置文件新的引擎和新的數據目錄 ``` /etc/init.d/mongodb stop mkdir /data/mongov3 chown -R mongodb:mongodb /data/mongov3/ ``` 修改配置文件引擎為wiredTiger并且將數據目錄修改為新的目錄 ``` [root@mongodb-202 ~]# cat /usr/local/mongodb/conf/mongo.conf ##3.0數據目錄 dbpath = /data/mongov3 ##日志目錄 logpath = /usr/local/mongodb/logs/mongodb.log ##守護模式 fork=true ##pid file pidfilepath=/var/run/mongod.pid ##socket bind_ip=0.0.0.0 ## no password noauth=true oplogSize = 2048 #副本參數 replSet = vim26/172.16.1.202 :27017 #使用wiredTiger引擎 storageEngine=wiredTiger ``` 8.重新啟動副本的Mongo,并在主節點執行命令加入集群 ``` goumin:PRIMARY> rs.add("192.168.56.202:27017"); ``` 9.驗證寫入寫入數據同步是否正常主庫操作寫入測試數據 ``` goumin:PRIMARY> for(var i=0;i<10000;i++)db.d.insert({uid:i,uname:'osqlfan'+i}); WriteResult({ "nInserted" : 1 }) ``` 查看剛才寫入的數據 ``` goumin:PRIMARY> db.d.find().count(); 10000 ``` 副本操作,查看是否有剛才同步的數據,如果有,則同步正常 ``` goumin:SECONDARY> db.d.find().count(); 10000 ``` 10.相同操作完成所有副本 ``` #主庫操作 rs.remove("192.168.56.201:27017") #副本操作關閉數據庫 /etc/init.d/mongodb stop #修改副本的配置文件,注釋復制語句 sed -i 's@replSet@#replSet@' /usr/local/mongodb/conf/mongo.conf #啟動mongo服務,驗證升級條件是否允許 /etc/init.d/mongodb start >use admin >db.upgradeCheckAllDBs() #停止mongo服務,殺掉mongod進程 /etc/init.d/mongodb stop killall mongod #復制3.0的bin文件替換2.6 \cp -a mongodb-linux-x86_64-3.0.15-19-gb4172b9/bin/* /usr/local/mongodb/bin/ #恢復配置文件,添加引擎文件以及修改數據目錄配置 [root@mongodb-201 ~]# egrep "wiredTiger|dbpath" /usr/local/mongodb/conf/mongo.conf dbpath = /data/mongov3 storageEngine=wiredTiger #創建新的數據目錄 mkdir /data/mongov3 chown -R mongodb:mongodb /data/mongov3/ #重新啟動mongo服務 /etc/init.d/mongodb start #重新加入集群 goumin:PRIMARY> rs.add("192.168.56.201:27017"); { "down" : [ "192.168.56.201:27017" ], "ok" : 1 } #寫入數據檢查是否正常 ``` 11.副本升級完成后將master進行降級主庫進行降級 ``` goumin:PRIMARY> rs.stepDown() ``` 集群新主庫刪除主庫的節點 ``` rs.remove("192.168.56.201:27017") ``` 剩下的操作和從庫一樣 #參數調優 ## 升級3.0后提示的警告 ``` 2017-12-11T13:05:46.336+0800 I CONTROL [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended. 2017-12-11T13:05:46.336+0800 I CONTROL [initandlisten] 2017-12-11T13:05:46.337+0800 I CONTROL [initandlisten] 2017-12-11T13:05:46.337+0800 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. 2017-12-11T13:05:46.337+0800 I CONTROL [initandlisten] ** We suggest setting it to 'never' 2017-12-11T13:05:46.337+0800 I CONTROL [initandlisten] 2017-12-11T13:05:46.337+0800 I CONTROL [initandlisten] ** WARNING: soft rlimits too low. rlimits set to 7976 processes, 65536 files. Number of processes should be at least 32768 : 0.5 times number of files. 2017-12-08T06:20:07.343+0800 [initandlisten] ** WARNING: You are running on a NUMA machine. 2017-12-08T06:20:07.343+0800 [initandlisten] ** We suggest launching mongod like this to avoid performance problems: 2017-12-08T06:20:07.343+0800 [initandlisten] ** numactl --interleave=all mongod [other options] ``` ## 針對警告進行優化 1.如果條件允許的話,建議重新格式化磁盤為xfs格式 ``` apt-get install xfsprogs mkfs.xfs /dev/sdb mount -t xfs /dev/sdb /data/ ``` 2.優化大內存頁 ``` echo "never" > /sys/kernel/mm/transparent_hugepage/enabled echo "never" > /sys/kernel/mm/transparent_hugepage/defrag ``` 4.優化連接數 ``` vim /etc/profile ulimit -f unlimited ulimit -t unlimited ulimit -v unlimited ulimit -n 64000 ulimit -m unlimited ulimit -u 32000 ``` 5.關閉numa - 安裝numactl ``` apt-get install numactl ``` - 執行下面2條命令 ``` echo > /proc/sys/vm/zone_reclaim_mode sysctl -w vm.zone_reclaim_mode=0 ``` - 修改啟動命令,可以在啟動腳本里更改 ``` numactl --interleave=all /usr/local/mongodb/bin/mongod -f /usr/local/mongodb/conf/mongo.conf ``` # mongo相關博客地址非常全面的dba博客 http://blog.csdn.net/mchdba/article/category/1381536 mongodb2.6 replSet 升級到 mongodb3.0 http://blog.csdn.net/zhaowenzhong/article/details/50593363 官方對于numa的介紹和解決辦法 https://docs.mongodb.com/manual/administration/production-notes/#production-numa 官方對于ulimit的介紹 https://docs.mongodb.com/manual/reference/ulimit/ 官方升級3.0的介紹 https://docs.mongodb.com/manual/release-notes/3.0-upgrade/ mongodb關于ulimit優化操作 http://www.cppblog.com/changshoumeng/archive/2015/04/13/210327.html