Whenever we assign luns for host, they won't be visible to host. To make luns visible at host side we need to perform few things.
We can assume all these steps together as " host side scanning ".
Once host side scanning is performed, luns will be visible at OS level.
In one of our servers, we alloted 2 new luns. I want to add these luns to my DATA DG to increase it's size.
Now let us see what things need to be followed to make them visible at OS level.
root@mydbsrvr # bash
root@mydbsrvr #
root@mydbsrvr # df -kh /oracle
Filesystem size used avail capacity Mounted on
/dev/vx/dsk/DATA/oracle
408G 386G 22G 95% /oracle
root@mydbsrvr #
root@mydbsrvr # vxdisk -oalldgs list
DEVICE TYPE DISK GROUP STATUS
c1t0d0s2 auto:none - - online invalid
c1t1d0s2 auto:none - - online invalid
emcpower0s2 auto:sliced DATA0 DATA online
emcpower1s2 auto:sliced DATA1 DATA online
emcpower2s2 auto:sliced DATA2 DATA online
emcpower3s2 auto:sliced DATA3 DATA online
emcpower4s2 auto:sliced DATA4 DATA online
emcpower5s2 auto:sliced DATA5 DATA online
emcpower6s2 auto:sliced - (DATA_old) online
emcpower7s2 auto:sliced DATA_new0 DATA_new online
root@mydbsrvr #
Till now luns are not visible at veritas level, let us check in powerpath.
root@mydbsrvr # powermt display
Symmetrix logical device count=8
CLARiiON logical device count=0
Hitachi logical device count=0
Invista logical device count=0
HP xp logical device count=0
Ess logical device count=0
HP HSx logical device count=0
==============================================================================
----- Host Bus Adapters --------- ------ I/O Paths ----- ------ Stats ------
### HW Path Summary Total Dead IO/Sec Q-IOs Errors
==============================================================================
3072 pci@8,700000/QLGC,qlc@3/fp@0,0 optimal 8 0 - 0 0
3076 pci@8,700000/QLGC,qlc@2/fp@0,0 optimal 8 0 - 0 8
root@mydbsrvr #
We can see device count is 8, new luns not yet visible...
So now to make luns visible, we need to scan our host, which includes following steps :
1. Configure the controllers related to fibre channel.
root@mydbsrvr # cfgadm -al
Ap_Id Type Receptacle Occupant Condition
c0 scsi-bus connected configured unknown
c0::dsk/c0t0d0 CD-ROM connected configured unknown
c1 fc-private connected configured unknown
c1::500000e01821d261 disk connected configured unknown
c1::500000e01821f6c1 disk connected configured unknown
c2 fc-fabric connected configured unknown
c2::5006048452a85012 disk connected configured unknown
c3 fc connected unconfigured unknown
c6 fc-fabric connected configured unknown
c6::5006048452a8501d disk connected configured unknown
c7 fc connected unconfigured unknown
usb0/1 unknown empty unconfigured ok
usb0/2 unknown empty unconfigured ok
usb0/3 unknown empty unconfigured ok
usb0/4 unknown empty unconfigured ok
root@mydbsrvr #
root@mydbsrvr # cfgadm -c configure c2
root@mydbsrvr #
root@mydbsrvr # cfgadm -c configure c6
root@mydbsrvr #
2. Scanning at multipathing level.
root@mydbsrvr # powermt config
root@mydbsrvr #
root@mydbsrvr # powermt save
root@mydbsrvr #
root@mydbsrvr # powermt display
Symmetrix logical device count=10
CLARiiON logical device count=0
Hitachi logical device count=0
Invista logical device count=0
HP xp logical device count=0
Ess logical device count=0
HP HSx logical device count=0
==============================================================================
----- Host Bus Adapters --------- ------ I/O Paths ----- ------ Stats ------
### HW Path Summary Total Dead IO/Sec Q-IOs Errors
==============================================================================
3072 pci@8,700000/QLGC,qlc@3/fp@0,0 optimal 10 0 - 0 0
3076 pci@8,700000/QLGC,qlc@2/fp@0,0 optimal 10 0 - 0 8
root@mydbsrvr #
Sometimes If at this step luns are not visible go for step 3.
3. vxscandisks and vxdctl enable which helps to scan host at Veritas level.
Let us check now,
root@mydbsrvr # vxdisk -oalldgs list
DEVICE TYPE DISK GROUP STATUS
c1t0d0s2 auto:none - - online invalid
c1t1d0s2 auto:none - - online invalid
emcpower0s2 auto:sliced DATA0 DATA online
emcpower1s2 auto:sliced DATA1 DATA online
emcpower2s2 auto:sliced DATA2 DATA online
emcpower3s2 auto:sliced DATA3 DATA online
emcpower4s2 auto:sliced DATA4 DATA online
emcpower5s2 auto:sliced DATA5 DATA online
emcpower6s2 auto:sliced - (DATA_old) online
emcpower7s2 auto:sliced DATA_new0 DATA_new online
emcpower8s2 auto:none - - online invalid
emcpower9s2 auto:none - - online invalid
root@mydbsrvr #
Now we have to proceed initializing the disk to bring them under Veritas Control.
root@mydbsrvr # vxdisksetup -i emcpower8 format=sliced
root@mydbsrvr #
root@mydbsrvr # vxdisksetup -i emcpower9 format=sliced
root@mydbsrvr #
root@mydbsrvr # vxdisk -oalldgs list
DEVICE TYPE DISK GROUP STATUS
c1t0d0s2 auto:none - - online invalid
c1t1d0s2 auto:none - - online invalid
emcpower0s2 auto:sliced DATA0 DATA online
emcpower1s2 auto:sliced DATA1 DATA online
emcpower2s2 auto:sliced DATA2 DATA online
emcpower3s2 auto:sliced DATA3 DATA online
emcpower4s2 auto:sliced DATA4 DATA online
emcpower5s2 auto:sliced DATA5 DATA online
emcpower6s2 auto:sliced - (DATA_old) online
emcpower7s2 auto:sliced DATA_new0 DATA_new online
emcpower8s2 auto:sliced - - online
emcpower9s2 auto:sliced - - online
root@mydbsrvr #
Now luns are ready to add to DG.
root@mydbsrvr # vxdg list
NAME STATE ID
DATA enabled 1330684297.33.DATA
DATA_new enabled 1330684501.41.DATA_new
root@mydbsrvr #
root@mydbsrvr #
root@mydbsrvr # vxdg -g DATA adddisk DATA6=emcpower8
root@mydbsrvr #
root@mydbsrvr # vxdg -g DATA adddisk DATA7=emcpower9
root@mydbsrvr #
root@mydbsrvr # vxprint -htg DATA
dg DATA default default 18000 1330684297.33.DATA_old
dm DATA0 emcpower0s2 auto 68863 142690560 -
dm DATA1 emcpower1s2 auto 68863 142690560 -
dm DATA2 emcpower2s2 auto 68863 142690560 -
dm DATA3 emcpower3s2 auto 68863 142690560 -
dm DATA4 emcpower4s2 auto 68863 142690560 -
dm DATA5 emcpower5s2 auto 68863 142690560 -
dm DATA6 emcpower8s2 auto 68863 142690560 -
dm DATA7 emcpower9s2 auto 68863 142690560 -
v oracle - ENABLED ACTIVE 855638016 SELECT oracle-01 fsgen
pl oracle-01 oracle ENABLED ACTIVE 855638016 STRIPE 2/1024 RW
sd DATA0-01 oracle-01 DATA0 0 142690560 0/0 emcpower0 ENA
sd DATA2-01 oracle-01 DATA2 0 142690560 0/142690560 emcpower2 ENA
sd DATA4-01 oracle-01 DATA4 0 142437888 0/285381120 emcpower4 ENA
sd DATA1-01 oracle-01 DATA1 0 142690560 1/0 emcpower1 ENA
sd DATA3-01 oracle-01 DATA3 0 142690560 1/142690560 emcpower3 ENA
sd DATA5-01 oracle-01 DATA5 0 142437888 1/285381120 emcpower5 ENA
root@mydbsrvr #
root@mydbsrvr # vxdisk -oalldgs list
DEVICE TYPE DISK GROUP STATUS
c1t0d0s2 auto:none - - online invalid
c1t1d0s2 auto:none - - online invalid
emcpower0s2 auto:sliced DATA0 DATA online
emcpower1s2 auto:sliced DATA1 DATA online
emcpower2s2 auto:sliced DATA2 DATA online
emcpower3s2 auto:sliced DATA3 DATA online
emcpower4s2 auto:sliced DATA4 DATA online
emcpower5s2 auto:sliced DATA5 DATA online
emcpower6s2 auto:sliced - (DATA_old) online
emcpower7s2 auto:sliced DATA_new0 DATA_new online
emcpower8s2 auto:sliced DATA6 DATA online
emcpower9s2 auto:sliced DATA7 DATA online
root@mydbsrvr #
root@mydbsrvr # df -kh /oracle
Filesystem size used avail capacity Mounted on
/dev/vx/dsk/DATA/oracle
408G 386G 22G 95% /oracle
root@mydbsrvr #
Now we can resize the DG using these newly assigned luns,
root@mydbsrvr # vxassist -g DATA maxsize
Maximum volume size: 285886464 (139593Mb)
root@mydbsrvr #
root@mydbsrvr #
root@mydbsrvr # vxresize -g DATA oracle +130g
root@mydbsrvr #
root@mydbsrvr #
root@mydbsrvr # df -kh /oracle
Filesystem size used avail capacity Mounted on
/dev/vx/dsk/DATA/oracle
538G 386G 151G 72% /oracle
root@mydbsrvr #
After performing Host Scan luns are visibled to server and thus we increased the size of our DG.
################################################################################
We can assume all these steps together as " host side scanning ".
Once host side scanning is performed, luns will be visible at OS level.
In one of our servers, we alloted 2 new luns. I want to add these luns to my DATA DG to increase it's size.
Now let us see what things need to be followed to make them visible at OS level.
root@mydbsrvr # bash
root@mydbsrvr #
root@mydbsrvr # df -kh /oracle
Filesystem size used avail capacity Mounted on
/dev/vx/dsk/DATA/oracle
408G 386G 22G 95% /oracle
root@mydbsrvr #
root@mydbsrvr # vxdisk -oalldgs list
DEVICE TYPE DISK GROUP STATUS
c1t0d0s2 auto:none - - online invalid
c1t1d0s2 auto:none - - online invalid
emcpower0s2 auto:sliced DATA0 DATA online
emcpower1s2 auto:sliced DATA1 DATA online
emcpower2s2 auto:sliced DATA2 DATA online
emcpower3s2 auto:sliced DATA3 DATA online
emcpower4s2 auto:sliced DATA4 DATA online
emcpower5s2 auto:sliced DATA5 DATA online
emcpower6s2 auto:sliced - (DATA_old) online
emcpower7s2 auto:sliced DATA_new0 DATA_new online
root@mydbsrvr #
Till now luns are not visible at veritas level, let us check in powerpath.
root@mydbsrvr # powermt display
Symmetrix logical device count=8
CLARiiON logical device count=0
Hitachi logical device count=0
Invista logical device count=0
HP xp logical device count=0
Ess logical device count=0
HP HSx logical device count=0
==============================================================================
----- Host Bus Adapters --------- ------ I/O Paths ----- ------ Stats ------
### HW Path Summary Total Dead IO/Sec Q-IOs Errors
==============================================================================
3072 pci@8,700000/QLGC,qlc@3/fp@0,0 optimal 8 0 - 0 0
3076 pci@8,700000/QLGC,qlc@2/fp@0,0 optimal 8 0 - 0 8
root@mydbsrvr #
We can see device count is 8, new luns not yet visible...
So now to make luns visible, we need to scan our host, which includes following steps :
1. Configure the controllers related to fibre channel.
root@mydbsrvr # cfgadm -al
Ap_Id Type Receptacle Occupant Condition
c0 scsi-bus connected configured unknown
c0::dsk/c0t0d0 CD-ROM connected configured unknown
c1 fc-private connected configured unknown
c1::500000e01821d261 disk connected configured unknown
c1::500000e01821f6c1 disk connected configured unknown
c2 fc-fabric connected configured unknown
c2::5006048452a85012 disk connected configured unknown
c3 fc connected unconfigured unknown
c6 fc-fabric connected configured unknown
c6::5006048452a8501d disk connected configured unknown
c7 fc connected unconfigured unknown
usb0/1 unknown empty unconfigured ok
usb0/2 unknown empty unconfigured ok
usb0/3 unknown empty unconfigured ok
usb0/4 unknown empty unconfigured ok
root@mydbsrvr #
root@mydbsrvr # cfgadm -c configure c2
root@mydbsrvr #
root@mydbsrvr # cfgadm -c configure c6
root@mydbsrvr #
2. Scanning at multipathing level.
root@mydbsrvr # powermt config
root@mydbsrvr #
root@mydbsrvr # powermt save
root@mydbsrvr #
root@mydbsrvr # powermt display
Symmetrix logical device count=10
CLARiiON logical device count=0
Hitachi logical device count=0
Invista logical device count=0
HP xp logical device count=0
Ess logical device count=0
HP HSx logical device count=0
==============================================================================
----- Host Bus Adapters --------- ------ I/O Paths ----- ------ Stats ------
### HW Path Summary Total Dead IO/Sec Q-IOs Errors
==============================================================================
3072 pci@8,700000/QLGC,qlc@3/fp@0,0 optimal 10 0 - 0 0
3076 pci@8,700000/QLGC,qlc@2/fp@0,0 optimal 10 0 - 0 8
root@mydbsrvr #
Sometimes If at this step luns are not visible go for step 3.
3. vxscandisks and vxdctl enable which helps to scan host at Veritas level.
Let us check now,
root@mydbsrvr # vxdisk -oalldgs list
DEVICE TYPE DISK GROUP STATUS
c1t0d0s2 auto:none - - online invalid
c1t1d0s2 auto:none - - online invalid
emcpower0s2 auto:sliced DATA0 DATA online
emcpower1s2 auto:sliced DATA1 DATA online
emcpower2s2 auto:sliced DATA2 DATA online
emcpower3s2 auto:sliced DATA3 DATA online
emcpower4s2 auto:sliced DATA4 DATA online
emcpower5s2 auto:sliced DATA5 DATA online
emcpower6s2 auto:sliced - (DATA_old) online
emcpower7s2 auto:sliced DATA_new0 DATA_new online
emcpower8s2 auto:none - - online invalid
emcpower9s2 auto:none - - online invalid
root@mydbsrvr #
Now we have to proceed initializing the disk to bring them under Veritas Control.
root@mydbsrvr # vxdisksetup -i emcpower8 format=sliced
root@mydbsrvr #
root@mydbsrvr # vxdisksetup -i emcpower9 format=sliced
root@mydbsrvr #
root@mydbsrvr # vxdisk -oalldgs list
DEVICE TYPE DISK GROUP STATUS
c1t0d0s2 auto:none - - online invalid
c1t1d0s2 auto:none - - online invalid
emcpower0s2 auto:sliced DATA0 DATA online
emcpower1s2 auto:sliced DATA1 DATA online
emcpower2s2 auto:sliced DATA2 DATA online
emcpower3s2 auto:sliced DATA3 DATA online
emcpower4s2 auto:sliced DATA4 DATA online
emcpower5s2 auto:sliced DATA5 DATA online
emcpower6s2 auto:sliced - (DATA_old) online
emcpower7s2 auto:sliced DATA_new0 DATA_new online
emcpower8s2 auto:sliced - - online
emcpower9s2 auto:sliced - - online
root@mydbsrvr #
Now luns are ready to add to DG.
root@mydbsrvr # vxdg list
NAME STATE ID
DATA enabled 1330684297.33.DATA
DATA_new enabled 1330684501.41.DATA_new
root@mydbsrvr #
root@mydbsrvr #
root@mydbsrvr # vxdg -g DATA adddisk DATA6=emcpower8
root@mydbsrvr #
root@mydbsrvr # vxdg -g DATA adddisk DATA7=emcpower9
root@mydbsrvr #
root@mydbsrvr # vxprint -htg DATA
dg DATA default default 18000 1330684297.33.DATA_old
dm DATA0 emcpower0s2 auto 68863 142690560 -
dm DATA1 emcpower1s2 auto 68863 142690560 -
dm DATA2 emcpower2s2 auto 68863 142690560 -
dm DATA3 emcpower3s2 auto 68863 142690560 -
dm DATA4 emcpower4s2 auto 68863 142690560 -
dm DATA5 emcpower5s2 auto 68863 142690560 -
dm DATA6 emcpower8s2 auto 68863 142690560 -
dm DATA7 emcpower9s2 auto 68863 142690560 -
v oracle - ENABLED ACTIVE 855638016 SELECT oracle-01 fsgen
pl oracle-01 oracle ENABLED ACTIVE 855638016 STRIPE 2/1024 RW
sd DATA0-01 oracle-01 DATA0 0 142690560 0/0 emcpower0 ENA
sd DATA2-01 oracle-01 DATA2 0 142690560 0/142690560 emcpower2 ENA
sd DATA4-01 oracle-01 DATA4 0 142437888 0/285381120 emcpower4 ENA
sd DATA1-01 oracle-01 DATA1 0 142690560 1/0 emcpower1 ENA
sd DATA3-01 oracle-01 DATA3 0 142690560 1/142690560 emcpower3 ENA
sd DATA5-01 oracle-01 DATA5 0 142437888 1/285381120 emcpower5 ENA
root@mydbsrvr #
root@mydbsrvr # vxdisk -oalldgs list
DEVICE TYPE DISK GROUP STATUS
c1t0d0s2 auto:none - - online invalid
c1t1d0s2 auto:none - - online invalid
emcpower0s2 auto:sliced DATA0 DATA online
emcpower1s2 auto:sliced DATA1 DATA online
emcpower2s2 auto:sliced DATA2 DATA online
emcpower3s2 auto:sliced DATA3 DATA online
emcpower4s2 auto:sliced DATA4 DATA online
emcpower5s2 auto:sliced DATA5 DATA online
emcpower6s2 auto:sliced - (DATA_old) online
emcpower7s2 auto:sliced DATA_new0 DATA_new online
emcpower8s2 auto:sliced DATA6 DATA online
emcpower9s2 auto:sliced DATA7 DATA online
root@mydbsrvr #
root@mydbsrvr # df -kh /oracle
Filesystem size used avail capacity Mounted on
/dev/vx/dsk/DATA/oracle
408G 386G 22G 95% /oracle
root@mydbsrvr #
Now we can resize the DG using these newly assigned luns,
root@mydbsrvr # vxassist -g DATA maxsize
Maximum volume size: 285886464 (139593Mb)
root@mydbsrvr #
root@mydbsrvr #
root@mydbsrvr # vxresize -g DATA oracle +130g
root@mydbsrvr #
root@mydbsrvr #
root@mydbsrvr # df -kh /oracle
Filesystem size used avail capacity Mounted on
/dev/vx/dsk/DATA/oracle
538G 386G 151G 72% /oracle
root@mydbsrvr #
After performing Host Scan luns are visibled to server and thus we increased the size of our DG.
################################################################################