CodeCharge TAIWAN

http://zarr12steven.blogspot.tw/2017/04 ... oxmox.html

Proxmox Version
Proxmox 4.3
指令

查看 VM ID 可以使用 qm list
proxmox-1:/etc/pve# qm list
VMID NAME STATUS MEM(MB) BOOTDISK(GB) PID
10000 machine_name_1 running 1024 60.00 2305
10001 machine_name_2 running 8192 60.00 2079
10002 machine_name_3 running 4096 60.00 2114
10003 machine_name_4 running 4096 60.00 2148
10004 machine_name_5 running 4096 40.00 2263
10005 machine_name_6 running 512 40.00 3720
20002 machine_name_7 running 4096 70.00 2189
上傳的ISO檔是存放在 /var/lib/vz/template/iso
proxmox-1:/var/lib/vz/template/iso# ls
CentOS-7-x86_64-Minimal-1511.iso
vm的設定檔是存放在 /etc/pve/nodes/tpe-proxmox-1/qemu-server
proxmox-1:/etc/pve/nodes/tpe-proxmox-1/qemu-server# ls
10000.conf 10001.conf 10002.conf 10003.conf 10004.conf 10005.conf 20002.conf
vm的disk是放在 /dev/pve/vm-VMID-disk-1，要看的話需要下 lvdisplay
proxmox-2:/etc/pve# lvdisplay
--- Logical volume ---
LV Path /dev/pve/swap
LV Name swap
VG Name pve
LV UUID 73Qx1N-Bxw1-vv1c-zf3q-bkWr-HbTM-caJ71E
LV Write Access read/write
LV Creation host, time proxmox, 2017-04-20 19:22:44 +0800
LV Status available
# open 2
LV Size 8.00 GiB
Current LE 2048
Segments 1
Allocation inherit
Read ahead sectors auto
- currently set to 256
Block device 251:1

--- Logical volume ---
LV Path /dev/pve/root
LV Name root
VG Name pve
LV UUID 3ZaB0Y-ffOi-6wxA-thlb-w19u-qX2E-rPWbwv
LV Write Access read/write
LV Creation host, time proxmox, 2017-04-20 19:22:44 +0800
LV Status available
# open 1
LV Size 96.00 GiB
Current LE 24576
Segments 1
Allocation inherit
Read ahead sectors auto
- currently set to 256
Block device 251:0

--- Logical volume ---
LV Name data
VG Name pve
LV UUID e0xE6i-7hpe-KlQ3-BCgg-YVyx-mSIX-m9VveW
LV Write Access read/write
LV Creation host, time proxmox, 2017-04-20 19:22:45 +0800
LV Pool metadata data_tmeta
LV Pool data data_tdata
LV Status available
# open 2
LV Size 10.80 TiB
Allocated pool data 0.02%
Allocated metadata 0.44%
Current LE 2830400
Segments 1
Allocation inherit
Read ahead sectors auto
- currently set to 256
Block device 251:4

--- Logical volume ---
LV Path /dev/pve/vm-10005-disk-1
LV Name vm-10005-disk-1
VG Name pve
LV UUID JekYQS-ZJKd-vPFE-B8TX-jOIN-hkj2-5jQjeG
LV Write Access read/write
LV Creation host, time proxmox-2, 2017-04-24 17:43:36 +0800
LV Pool name data
LV Status available
# open 0
LV Size 40.00 GiB
Mapped size 5.78%
Current LE 10240
Segments 1
Allocation inherit
Read ahead sectors auto
- currently set to 256
Block device 251:6

搬移步驟
先把要搬移的vm給關機， proxmox-1 建立 /mnt/backup ，然後再執行
vzdump --mode stop --dumpdir /mnt/backup --compress lzo VMID
--mode stop : 會做較完整的備份，但會執行會比較久
--dumpdir : 指定檔案輸出的位置
--compress : 會做壓縮，目前有 gzip, lzo，預設是0
--bwlimit : 指定要寫入的IO (我沒有用)
proxmox-1:~# vzdump --mode stop --dumpdir /mnt/backup/ --compress lzo 10005
INFO: starting new backup job: vzdump 10005 --dumpdir /mnt/backup/ --compress lzo --mode stop
INFO: Starting Backup of VM 10005 (qemu)
INFO: status = stopped
INFO: update VM 10005: -lock backup
INFO: backup mode: stop
INFO: ionice priority: 7
INFO: VM Name: kemp-test
INFO: creating archive '/mnt/backup/vzdump-qemu-10005-2017_04_24-17_35_01.vma.lzo'
INFO: starting kvm to execute backup task
INFO: started backup task 'a4236601-35f5-4818-9bb3-f77dab8bbc3c'
INFO: status: 2% (1259012096/42949672960), sparse 2% (1080279040), duration 3, 419/59 MB/s
INFO: status: 4% (1735262208/42949672960), sparse 3% (1421692928), duration 6, 158/44 MB/s
INFO: status: 6% (2583560192/42949672960), sparse 4% (1978941440), duration 11, 169/58 MB/s
INFO: status: 27% (11932925952/42949672960), sparse 26% (11321421824), duration 14, 3116/2 MB/s
INFO: status: 28% (12094865408/42949672960), sparse 26% (11323588608), duration 17, 53/53 MB/s
INFO: status: 33% (14232780800/42949672960), sparse 30% (13294813184), duration 21, 534/41 MB/s
INFO: status: 51% (22285189120/42949672960), sparse 49% (21312892928), duration 24, 2684/11 MB/s
INFO: status: 52% (22508208128/42949672960), sparse 49% (21313822720), duration 27, 74/74 MB/s
INFO: status: 53% (22773825536/42949672960), sparse 49% (21314109440), duration 31, 66/66 MB/s
INFO: status: 58% (24997265408/42949672960), sparse 54% (23424589824), duration 34, 741/37 MB/s
INFO: status: 75% (32576110592/42949672960), sparse 72% (31003435008), duration 37, 2526/0 MB/s
INFO: status: 76% (32646955008/42949672960), sparse 72% (31003824128), duration 43, 11/11 MB/s
INFO: status: 77% (33113833472/42949672960), sparse 72% (31006666752), duration 51, 58/58 MB/s
INFO: status: 82% (35597189120/42949672960), sparse 77% (33232822272), duration 55, 620/64 MB/s
INFO: status: 100% (42949672960/42949672960), sparse 94% (40585306112), duration 58, 2450/0 MB/s
INFO: transferred 42949 MB in 58 seconds (740 MB/s)
INFO: stopping kvm after backup task
INFO: archive file size: 1.19GB
INFO: Finished Backup of VM 10005 (00:01:01)
INFO: Backup job finished successfully
跑完之後，就把 /mnt/backup 底下的檔案， scp 到 proxmox-2 ，再去執行 qmrestore vzdump-qemu-VMID-date.vma.lzo VMID
proxmox-2:~# qmrestore vzdump-qemu-10005-2017_04_24-17_35_01.vma.lzo 10005
restore vma archive: lzop -d -c /root/vzdump-qemu-10005-2017_04_24-17_35_01.vma.lzo|vma extract -v -r /var/tmp/vzdumptmp135251.fifo - /var/tmp/vzdumptmp135251
CFG: size: 359 name: qemu-server.conf
DEV: dev_id=1 size: 42949672960 devname: drive-virtio0
CTIME: Mon Apr 24 17:35:02 2017
Logical volume "vm-10005-disk-1" created.
new volume ID is 'local-lvm:vm-10005-disk-1'
map 'drive-virtio0' to '/dev/pve/vm-10005-disk-1' (write zeros = 0)
progress 1% (read 429522944 bytes, duration 1 sec)
progress 2% (read 859045888 bytes, duration 1 sec)
progress 3% (read 1288503296 bytes, duration 1 sec)
progress 4% (read 1718026240 bytes, duration 2 sec)
progress 5% (read 2147483648 bytes, duration 3 sec)
progress 6% (read 2577006592 bytes, duration 3 sec)
progress 7% (read 3006529536 bytes, duration 3 sec)
progress 8% (read 3435986944 bytes, duration 3 sec)
progress 9% (read 3865509888 bytes, duration 3 sec)
progress 10% (read 4294967296 bytes, duration 3 sec)
progress 11% (read 4724490240 bytes, duration 3 sec)
progress 12% (read 5154013184 bytes, duration 3 sec)
progress 13% (read 5583470592 bytes, duration 3 sec)
progress 14% (read 6012993536 bytes, duration 3 sec)
progress 15% (read 6442450944 bytes, duration 3 sec)
progress 16% (read 6871973888 bytes, duration 3 sec)
progress 17% (read 7301496832 bytes, duration 3 sec)
progress 18% (read 7730954240 bytes, duration 3 sec)
progress 19% (read 8160477184 bytes, duration 3 sec)
progress 20% (read 8589934592 bytes, duration 3 sec)
progress 21% (read 9019457536 bytes, duration 3 sec)
progress 22% (read 9448980480 bytes, duration 3 sec)
progress 23% (read 9878437888 bytes, duration 3 sec)
progress 24% (read 10307960832 bytes, duration 3 sec)
progress 25% (read 10737418240 bytes, duration 3 sec)
progress 26% (read 11166941184 bytes, duration 3 sec)
progress 27% (read 11596464128 bytes, duration 3 sec)
progress 28% (read 12025921536 bytes, duration 4 sec)
progress 29% (read 12455444480 bytes, duration 5 sec)
progress 30% (read 12884901888 bytes, duration 5 sec)
progress 31% (read 13314424832 bytes, duration 5 sec)
progress 32% (read 13743947776 bytes, duration 5 sec)
progress 33% (read 14173405184 bytes, duration 5 sec)
progress 34% (read 14602928128 bytes, duration 5 sec)
progress 35% (read 15032385536 bytes, duration 5 sec)
progress 36% (read 15461908480 bytes, duration 5 sec)
progress 37% (read 15891431424 bytes, duration 5 sec)
progress 38% (read 16320888832 bytes, duration 5 sec)
progress 39% (read 16750411776 bytes, duration 5 sec)
progress 40% (read 17179869184 bytes, duration 5 sec)
progress 41% (read 17609392128 bytes, duration 5 sec)
progress 42% (read 18038915072 bytes, duration 6 sec)
progress 43% (read 18468372480 bytes, duration 6 sec)
progress 44% (read 18897895424 bytes, duration 6 sec)
progress 45% (read 19327352832 bytes, duration 6 sec)
progress 46% (read 19756875776 bytes, duration 6 sec)
progress 47% (read 20186398720 bytes, duration 6 sec)
progress 48% (read 20615856128 bytes, duration 6 sec)
progress 49% (read 21045379072 bytes, duration 6 sec)
progress 50% (read 21474836480 bytes, duration 6 sec)
progress 51% (read 21904359424 bytes, duration 6 sec)
progress 52% (read 22333882368 bytes, duration 6 sec)
progress 53% (read 22763339776 bytes, duration 8 sec)
progress 54% (read 23192862720 bytes, duration 8 sec)
progress 55% (read 23622320128 bytes, duration 8 sec)
progress 56% (read 24051843072 bytes, duration 8 sec)
progress 57% (read 24481366016 bytes, duration 8 sec)
progress 58% (read 24910823424 bytes, duration 8 sec)
progress 59% (read 25340346368 bytes, duration 9 sec)
progress 60% (read 25769803776 bytes, duration 9 sec)
progress 61% (read 26199326720 bytes, duration 9 sec)
progress 62% (read 26628849664 bytes, duration 9 sec)
progress 63% (read 27058307072 bytes, duration 9 sec)
progress 64% (read 27487830016 bytes, duration 9 sec)
progress 65% (read 27917287424 bytes, duration 9 sec)
progress 66% (read 28346810368 bytes, duration 9 sec)
progress 67% (read 28776333312 bytes, duration 9 sec)
progress 68% (read 29205790720 bytes, duration 9 sec)
progress 69% (read 29635313664 bytes, duration 9 sec)
progress 70% (read 30064771072 bytes, duration 9 sec)
bootdisk: virtio0
progress 71% (read 30494294016 bytes, duration 9 sec)
progress 72% (read 30923816960 bytes, duration 9 sec)
progress 73% (read 31353274368 bytes, duration 9 sec)
progress 74% (read 31782797312 bytes, duration 9 sec)
progress 75% (read 32212254720 bytes, duration 9 sec)
progress 76% (read 32641777664 bytes, duration 9 sec)
progress 77% (read 33071300608 bytes, duration 11 sec)
progress 78% (read 33500758016 bytes, duration 13 sec)
progress 79% (read 33930280960 bytes, duration 13 sec)
progress 80% (read 34359738368 bytes, duration 13 sec)
progress 81% (read 34789261312 bytes, duration 13 sec)
progress 82% (read 35218784256 bytes, duration 13 sec)
progress 83% (read 35648241664 bytes, duration 13 sec)
progress 84% (read 36077764608 bytes, duration 13 sec)
progress 85% (read 36507222016 bytes, duration 13 sec)
progress 86% (read 36936744960 bytes, duration 13 sec)
progress 87% (read 37366267904 bytes, duration 13 sec)
progress 88% (read 37795725312 bytes, duration 13 sec)
progress 89% (read 38225248256 bytes, duration 13 sec)
progress 90% (read 38654705664 bytes, duration 13 sec)
progress 91% (read 39084228608 bytes, duration 13 sec)
progress 92% (read 39513751552 bytes, duration 13 sec)
progress 93% (read 39943208960 bytes, duration 13 sec)
progress 94% (read 40372731904 bytes, duration 13 sec)
progress 95% (read 40802189312 bytes, duration 13 sec)
progress 96% (read 41231712256 bytes, duration 13 sec)
progress 97% (read 41661235200 bytes, duration 13 sec)
progress 98% (read 42090692608 bytes, duration 13 sec)
progress 99% (read 42520215552 bytes, duration 13 sec)
progress 100% (read 42949672960 bytes, duration 13 sec)
total bytes read 42949672960, sparse bytes 40585306112 (94.5%)
space reduction due to 4K zero blocks 0.581%
這樣就跑完了，收工。
BTW 這是適合沒有做cluster的proxmox可以這樣做
Reference:
Backup - Restore - Live Migration
Proxmox VE differential backups
Clone/Back Up/Restore OpenVZ VMs With vzdump
How to backup and transfer a Proxmox VM to another Proxmox Node
vzdump – Backup a running Container