..
Extending Metadata Space of LVM Thin Provisioning
Firstly, expand RAID 5 by adding a new hard drive into it. It will take about 1 day to reconstruct the RAID, so please be patient.
root@pve2:~# pvresize -v /dev/mapper/36d0946603cb2db0024e931c9a882ced7
Wiping internal VG cache
Wiping cache of LVM-capable devices
Archiving volume group "pve" metadata (seqno 446).
Resizing volume "/dev/mapper/36d0946603cb2db0024e931c9a882ced7" to 10545266688 sectors.
No change to size of physical volume /dev /mapper/36d0946603cb2db0024e931c9a882ced7.
Updating phycal volume "/dev/mapper/36d0946603cb2db0024e931c9a882ced7"
Creating volume group backup "/etc/lvm/backup/pve" (seqno 447).
Physical volume "/dev/mapper/36d0946603cb2db0024e931c9a882ced7" changed
1 physical volume(s) resized / 0 physical volume(s) not resized
root@pve1:~# pvs
PV VG Fmt Attr PSize PFree
/dev/mapper/360014054018ff8ed35f0d4277da271d2 vms lvm2 a-- 1024.00g 896.00g
/dev/mapper/36001405a660c610d0d43d4ad7d80f6dd vms lvm2 a-- 1.50t 30.00g
/dev/mapper/36d094660267abf0024ff75e573972158 pve lvm2 a-- 4.91t 0
/dev/sde3 pve lvm2 a-- 445.75g 0
root@pve1:~# pvresize -v /dev/mapper/36d094660267abf0024ff75e573972158
Wiping internal VG cache
Wiping cache of LVM-capable devices
Archiving volume group "pve" metadata (seqno 218).
Resizing volume "/dev/mapper/36d094660267abf0024ff75e573972158" to 10545266688 sectors.
No change to size of physical volume /dev/mapper/36d094660267abf0024ff75e573972158.
Updating physical volume "/dev/mapper/36d094660267abf0024ff75e573972158"
Creating volume group backup "/etc/lvm/backup/pve" (seqno 219).
Physical volume "/dev/mapper/36d094660267abf0024ff75e573972158" changed
1 physical volume(s) resized / 0 physical volume(s) not resized
Reboot
root@pve1:~# pvresize -v /dev/mapper/36d094660267abf0024ff75e573972158
Wiping internal VG cache
Wiping cache of LVM-capable devices
Archiving volume group "pve" metadata (seqno 219).
Resizing volume "/dev/mapper/36d094660267abf0024ff75e573972158" to 14060355584 sectors.
Resizing physical volume /dev/mapper/36d094660267abf0024ff75e573972158 from 0 to 1716351 extents.
Updating physical volume "/dev/mapper/36d094660267abf0024ff75e573972158"
Creating volume group backup "/etc/lvm/backup/pve" (seqno 220).
Physical volume "/dev/mapper/36d094660267abf0024ff75e573972158" changed
1 physical volume(s) resized / 0 physical volume(s) not resized
root@pve1:~# vgs
VG #PV #LV #SN Attr VSize VFree
pve 2 13 0 wz--n- 6.98t 1.64t
vms 2 42 0 wz--n- 2.50t 925.99g
The following command will deactivate all LVs under LVM thin provisioning pool
data, so you won’t see them listed under /dev/mapper again. By doing this,
we minimize the impact to the thin provisioning pool while we’re resizing the
metadata space.
root@pve1:~# for lv in $(lvdisplay | grep -iE "lv pool name.*data" -B6 | grep -i "lv path" | awk '{print $3}' | xargs); do lvchange -an -v $lv; sleep 1; done
Deactivating logical volume pve/vm-106-disk-1.
Removing pve-vm--106--disk--1 (253:7)
Deactivating logical volume pve/vm-107-disk-1.
Removing pve-vm--107--disk--1 (253:8)
Deactivating logical volume pve/vm-109-disk-1.
Removing pve-vm--109--disk--1 (253:9)
Deactivating logical volume pve/vm-756-disk-1.
Removing pve-vm--756--disk--1 (253:10)
Deactivating logical volume pve/vm-762-disk-1.
Removing pve-vm--762--disk--1 (253:11)
Deactivating logical volume pve/vm-110-disk-1.
Removing pve-vm--110--disk--1 (253:12)
Deactivating logical volume pve/base-777-disk-1.
Deactivating logical volume pve/vm-201-disk-1.
Removing pve-vm--201--disk--1 (253:13)
Deactivating logical volume pve/vm-113-disk-1.
Removing pve-vm--113--disk--1 (253:14)
Deactivating logical volume pve/snap_vm-113-disk-1_clean_slate.
root@pve1:~# lvresize --poolmetadatasize +1G pve/data
Size of logical volume pve/data_tmeta changed from 84.00 MiB (21 extents) to 1.08 GiB (277 extents).
Logical volume pve/data_tmeta successfully resized.
root@pve1:~# lvchange -ay -v pve/data
Activating logical volume pve/data exclusively.
activation/volume_list configuration setting not defined: Checking only host tags for pve/data.
Creating pve-data_tmeta
Loading pve-data_tmeta table (253:3)
Resuming pve-data_tmeta (253:3)
Creating pve-data_tdata
Loading pve-data_tdata table (253:4)
Resuming pve-data_tdata (253:4)
Executing: /usr/sbin/thin_check -q --clear-needs-check-flag /dev/mapper/pve-data_tmeta
Creating pve-data-tpool
Loading pve-data-tpool table (253:5)
Resuming pve-data-tpool (253:5)
Creating pve-data
Loading pve-data table (253:6)
Resuming pve-data (253:6)
Monitoring pve/data
Activating all related LVs we that just deactivated:
root@pve1:~# lvchange -ay -v /dev/pve/vm-106-disk-1
Activating logical volume pve/vm-106-disk-1 exclusively.
activation/volume_list configuration setting not defined: Checking only host tags for pve/vm-106-disk-1.
Loading pve-data_tdata table (253:4)
Suppressed pve-data_tdata (253:4) identical table reload.
Loading pve-data_tmeta table (253:3)
Suppressed pve-data_tmeta (253:3) identical table reload.
Loading pve-data-tpool table (253:5)
Suppressed pve-data-tpool (253:5) identical table reload.
Creating pve-vm--106--disk--1
Loading pve-vm--106--disk--1 table (253:7)
Resuming pve-vm--106--disk--1 (253:7)
pve/data already monitored.
...
Reboot