[TOC] ### 環境展示 1. 查看運行的資源情況 ```shell $ kubectl -n jiaxzeng get pod,replicaset,deployment,configmap,persistentvolumeclaim NAME READY STATUS RESTARTS AGE pod/nginx-74b774f568-tz6wc 1/1 Running 0 15m NAME DESIRED CURRENT READY AGE replicaset.apps/nginx-74b774f568 1 1 1 15m NAME READY UP-TO-DATE AVAILABLE AGE deployment.apps/nginx 1/1 1 1 15m NAME DATA AGE configmap/nginx-config 1 15m NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS AGE persistentvolumeclaim/nginx-rbd Bound pvc-ce942a56-8fc9-4e6e-b1fc-69b2359d2ad9 1Gi RWO csi-rbd-sc 15m ``` 2. 查看pod的掛載情況 ```shell kubectl -n jiaxzeng get pod nginx-74b774f568-tz6wc -o jsonpath='{range .spec.volumes[*]}{.*}{"\n"}{end}' config map[defaultMode:420 items:[map[key:nginx.conf path:nginx.conf]] name:nginx-config] logs map[claimName:nginx-rbd] default-token-qzlsc map[defaultMode:420 secretName:default-token-qzlsc] ``` 3. 查看pvc是使用情況 ```shell $ kubectl -n jiaxzeng exec -it nginx-74b774f568-tz6wc -- cat /tmp/access.log 20.0.32.128 - - [11/Jul/2022:08:21:05 +0000] "GET / HTTP/1.1" 200 612 "-" "curl/7.29.0" "-" 20.0.122.128 - - [11/Jul/2022:08:21:40 +0000] "GET / HTTP/1.1" 200 612 "-" "curl/7.29.0" "-" ``` 4. 查看configmap的配置內容 ```shell $ kubectl -n jiaxzeng get configmap nginx-config -o jsonpath='{.data}{"\n"}' map[nginx.conf:user nginx; worker_processes auto; error_log /tmp/error.log notice; pid /var/run/nginx.pid; events { worker_connections 1024; } http { include /etc/nginx/mime.types; default_type application/octet-stream; log_format main '$remote_addr - $remote_user [$time_local] "$request" ' '$status $body_bytes_sent "$http_referer" ' '"$http_user_agent" "$http_x_forwarded_for"'; access_log /tmp/access.log main; sendfile on; #tcp_nopush on; keepalive_timeout 65; #gzip on; include /etc/nginx/conf.d/*.conf; }] ``` ### 創建備份 Velero 支持兩種發現需要使用 Restic 備份的 pod 卷的方法： 1. Opt-in 方法：包含要使用 Restic 備份的卷的每個 pod 都必須使用卷的名稱進行注釋。 2. Opt-out 方法：使用 Restic 備份所有 pod 卷，并能夠選擇退出任何不應備份的卷。 > 判斷 `Restic` 備份 pod 卷的方法，安裝 velero 是否有帶上 `--default-volumes-to-restic` 進行安裝。 > 根據上一章節安裝velero是選擇 `Opt-in` 方法，所以這里只說明 `Opt-in` 方法。 在 `Opt-in` 方法中，Velero 將使用 Restic 備份所有 pod 卷，但以下情況除外： - Volumes mounting the default service account token, kubernetes secrets, and config maps - Hostpath volumes 1. 備份jiaxzeng命名空間資源 ```shell $ velero create backup jiaxzeng0711 --include-namespaces jiaxzeng Backup request "jiaxzeng0711" submitted successfully. Run `velero backup describe jiaxzeng0711` or `velero backup logs jiaxzeng0711` for more details. ``` 2. 查看備份情況 ```shell $ velero backup describe jiaxzeng0711 Name: jiaxzeng0711 Namespace: velero Labels: velero.io/storage-location=default Annotations: velero.io/source-cluster-k8s-gitversion=v1.18.18 velero.io/source-cluster-k8s-major-version=1 velero.io/source-cluster-k8s-minor-version=18 Phase: Completed Errors: 0 Warnings: 0 Namespaces: Included: jiaxzeng Excluded: <none> Resources: Included: * Excluded: <none> Cluster-scoped: auto Label selector: <none> Storage Location: default Velero-Native Snapshot PVs: auto TTL: 720h0m0s Hooks: <none> Backup Format Version: 1.1.0 Started: 2022-07-11 17:13:25 +0800 CST Completed: 2022-07-11 17:13:34 +0800 CST Expiration: 2022-08-10 17:13:25 +0800 CST Total items to be backed up: 20 Items backed up: 20 Velero-Native Snapshots: <none included> Restic Backups (specify --details for more information): Completed: 1 ``` > 如果查看備份失敗，請查看詳細日志 ``   ### 恢復服務 1. 模擬故障 ```shell $ kubectl delete ns jiaxzeng namespace "jiaxzeng" deleted ``` 2. 恢復備份數據 ```shell $ velero create restore --from-backup jiaxzeng0711 Restore request "jiaxzeng0711-20220711171832" submitted successfully. Run `velero restore describe jiaxzeng0711-20220711171832` or `velero restore logs jiaxzeng0711-20220711171832` for more details. ``` 3. 查看恢復情況 ```shell $ velero restore describe jiaxzeng0711-20220711171832 Name: jiaxzeng0711-20220711171832 Namespace: velero Labels: <none> Annotations: <none> Phase: Completed Total items to be restored: 9 Items restored: 9 Started: 2022-07-11 17:18:32 +0800 CST Completed: 2022-07-11 17:18:51 +0800 CST Backup: jiaxzeng0711 Namespaces: Included: all namespaces found in the backup Excluded: <none> Resources: Included: * Excluded: nodes, events, events.events.k8s.io, backups.velero.io, restores.velero.io, resticrepositories.velero.io Cluster-scoped: auto Namespace mappings: <none> Label selector: <none> Restore PVs: auto Restic Restores (specify --details for more information): Completed: 1 Preserve Service NodePorts: auto ``` 4. 檢查恢復是否正常 ```shell $ kubectl get ns NAME STATUS AGE default Active 110d ingress-nginx Active 108d jiaxzeng Active 44s kube-mon Active 24d kube-node-lease Active 110d kube-public Active 110d kube-storage Active 25d kube-system Active 110d velero Active 5d2h $ kubectl -n jiaxzeng get pod,replicaset,deployment,configmap,persistentvolumeclaim NAME READY STATUS RESTARTS AGE pod/nginx-74b774f568-tz6wc 1/1 Running 0 72s NAME DESIRED CURRENT READY AGE replicaset.apps/nginx-74b774f568 1 1 1 72s NAME READY UP-TO-DATE AVAILABLE AGE deployment.apps/nginx 1/1 1 1 72s NAME DATA AGE configmap/nginx-config 1 73s NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS AGE persistentvolumeclaim/nginx-rbd Bound pvc-cf97efd9-e71a-42b9-aca5-ac47402c6f93 1Gi RWO csi-rbd-sc 73s $ kubectl -n jiaxzeng get pod nginx-74b774f568-tz6wc -o jsonpath='{range .spec.volumes[*]}{.*}{"\n"}' config map[defaultMode:420 items:[map[key:nginx.conf path:nginx.conf]] name:nginx-config] logs map[claimName:nginx-rbd] map[defaultMode:420 secretName:default-token-qzlsc] default-token-qzlsc $ kubectl -n jiaxzeng get configmap nginx-config -o jsonpath='{.data}{"\n"}' map[nginx.conf:user nginx; worker_processes auto; error_log /tmp/error.log notice; pid /var/run/nginx.pid; events { worker_connections 1024; } http { include /etc/nginx/mime.types; default_type application/octet-stream; log_format main '$remote_addr - $remote_user [$time_local] "$request" ' '$status $body_bytes_sent "$http_referer" ' '"$http_user_agent" "$http_x_forwarded_for"'; access_log /tmp/access.log main; sendfile on; #tcp_nopush on; keepalive_timeout 65; #gzip on; include /etc/nginx/conf.d/*.conf; }] ```