Need to have "Common Serial Number Mode" enabled/config'd on the Symm. Is DMP installed? modinfo | grep DMP to disable: vxdmpadm disable ctlr=/sbus@3,0/SUNW,socal@0,0/sf@1,0 to enable: vxdmpadm enable ctlr=/sbus@3,0/SUNW,socal@0,0/sf@1,0 use the following commands (not status) to verify: vxdmpadm listctlr all vxdmpadm listctlr ctlr=c6 vxdmpadm getsubpaths ctlr=c6 vxdmpadm listenclosure all vxdmpadm getdmpnode enclosure=EMC0 root@wolverine# vxdmpadm disable ctlr=c3 root@wolverine# vxdmpadm listctlr all CTLR-NAME ENCLR-TYPE STATE ENCLR-NAME ===================================================== c1 SEAGATE ENABLED seagate0 c3 EMC DISABLED emc0 c4 EMC ENABLED emc0 Sep 10 15:39:38 wolverine vxdmp: [ID 969440 kern.notice] NOTICE: vxvm:vxdmp: disabled controller /pci@8,700000/fibre-channel@2 connected to disk array 700037 root@wolverine# vxdmpadm enable ctlr=c3 root@wolverine# vxdmpadm listctlr all CTLR-NAME ENCLR-TYPE STATE ENCLR-NAME ===================================================== c1 SEAGATE ENABLED seagate0 c3 EMC ENABLED emc0 c4 EMC ENABLED emc0 ================================================================================ vxddladm listforeign vxddladm listsupport vxddladm listversion vxddladm listexclude vxddladm listjbod vxdmpadm gettune all vxdmpadm stat restored vxdmpadm stat errord vxdmpadm iostat show all vxdmpadm iostat show all interval=5 count=3 vxdmpadm iostat reset vxdmpadm iostat start vxdmpadm iostat stop vxdmpadm gettune all vxdmpadm settune dmp_probe_idle_lun=off vxdisk -e -o alldgs list; vxdisk -s list ================================================================================ Disabling DMP from running (either don't install it, or, if you have, disable by this means) - IN OLDER VERSION ONLY - MUST RUN IN NEWER VERSIONS -------------------------------------------------------------------------------- mv /kernel/drv/vxdmp /kernel/drv/vxdmp.old mv /kernel/drv/sparcv9/vxdmp /kernel/drv/sparcv9/vxdmp.old #comment out in /etc/system * forceload: dev/vxdmp #rename the DMP devices mv /dev/vx/rdmp /dev/vx/rdmp.old mv /dev/vx/dmp /dev/vx/dmp.old #relink devs ln -s /dev/dsk /dev/vx/dmp ln -s /dev/rdsk /dev/vx/rdmp #reconfigure reboot touch /reconfigure;init 6 ================================================================================ Preventing and suppressing disks and controllers from Dynamic MultiPathing in VERITAS Volume Manager 3.2 Turn off a path so DMP only uses a single path -------------------------------------------------------------------------------- Details: Disabling and enabling Dynamic Multipathing (DMP) It is possible to use vxdiskadm menu options 17 and 18 to disable or enable multipathing. These menu options also allow the excluding of devices from or including devices in the view of VERITAS Volume Manager (VxVM). The DMP driver cannot be removed and this procedure should be used to prevent/suppress DMP. Disabling multipathing and removing devices from the view of VxVM NOTE: Some of the operations described in this section require a reboot of the system. Select menu task 17 (prevent multipathing or suppress devices from VxVM's view) from the vxdiskadm main menu to prevent a device from being multipathed by the VxVM DMP driver (vxdmp), or to exclude a device from the view of VxVM: 1. At the following prompt, confirm that you want to continue: Exclude Devices Menu: VolumeManager/Disk/ExcludeDevices This operation might lead to some devices being suppressed from VxVM's view or preventing them from being multipathed by vxdmp NOTE: This operation can be reversed using the vxdiskadm command Do you want to continue ? [y,n,q,?] (default: y) 2. Select the operation to be performed from the displayed list: Exclude Devices Menu: VolumeManager/Disk/ExcludeDevices 1 Suppress all paths through a controller from VxVM's view 2 Suppress a path from VxVM's view 3 Suppress disks from VxVM's view by specifying a VID:PID combination 4 Suppress all but one paths to a disk 5 Prevent multipathing of all disks on a controller by VxVM 6 Prevent multipathing of a disk by VxVM 7 Prevent multipathing of disks by specifying a VID:PID combination 8 List currently suppressed/non-multipathed devices ? Display help about menu ??Display help about the menuing system q Exit from menus Select an operation to perform: Select option 1 to exclude all paths through the specified controller from the view of VxVM. These paths remain in the disabled state until the next reboot, or until the paths are re-included. Exclude controllers from VxVM Menu: VolumeManager/Disk/ExcludeDevices/CTLR-VxVM Use this operation to exclude all paths through a controller from VxVM. This operation can be reversed using the vxdiskadm command. It is possible to specify a controller name at the prompt. A controller name is of the form c#, example c3, c11 etc. Enter 'all' to exclude all paths on all the controllers on the host. To see the list of controllers on the system, type 'list'. Enter a controller name:[ctlr_name,all,list,list-exclude,q,?] Select option 2 to exclude specified paths from the view of VxVM. Exclude paths from VxVM Menu: VolumeManager/Disk/ExcludeDevices/PATH-VXVM Use this operation to exclude one or more paths from VxVM. As a result of this operation, the specified paths will be excluded from the view of VxVM. This operation can also be reversed using the vxdiskadm command. It is also possible to specify a path name or a pattern at the prompt. Here are some path selection examples: all: all paths c4t2:all paths on controller 4, target 2 c3t4d2:a single path list:list all paths on the system Enter a path name or pattern:[,all,list,list-exclude,q?] Select option 3 to exclude disks from the view of VxVM that match a specified Vendor ID and Product ID. NOTE: This option requires a reboot of the system. Exclude VID:PID from VxVM Menu: VolumeManager/Disk/ExcludeDevices/VIDPID-VxVM Use this operation to exclude disks returning a specified VendorID:ProductID combination from VxVM. As a result of this operation, all disks that return VendorID:ProductID matching the specified combination will be excluded from the view of VxVM. This operation can be reversed using the vxdiskadm command. The VendorID:ProductID pattern can also be specified at the prompt. The specification can be as follows : VID:PID where VID stands for Vendor ID PID stands for Product ID (The command vxdmpinq in /etc/vx/diag.d can be used to obtain the Vendor ID and Product ID) Both VID and PID can have an optional '*' (asterisk) following them. If an '*' follows VID it will result in the exclusion of all disks returning Vendor ID starting with the specified VID. The same is true for Product ID as well. Both VID and PID should be non NULL. The maximum allowed lengths for VendorID and ProductID are 8 and 16 characters respectively. Some examples of VID:PID specification are: all- Exclude all disks aaa:123- Exclude all disks having VID 'aaa' and PID '123' aaa*:123- Exclude all disks having VID starting with 'aaa' and PID '123' aaa:123*- Exclude all disks having VID 'aaa' and PID starting with '123' aaa:*- Exclude all disks having VID 'aaa' and any PID Enter a VID:PID combination:[,all,list-exclude,q,?] Select option 4 to define a path group for disks that are not multipathed by VxVM. (A path group explicitly defines alternate paths to the same disk.) Only one path is made visible to VxVM. Exclude all but one path to a disk Menu: VolumeManager/Disk/ExcludeDevices/PATHGROUP-VxVM Use this operation to exclude all but one path to a disk. In a case in which there are disks which are not multipathed by vxdmp, VxVM will see each path as a disk. In such cases, creating a path group of all paths to the disk will ensure that only one of the paths from the group is made visible to VxVM. The path group can be removed using the vxdiskadm command. Example: If c1t30d0 and c2t30d0 are paths to the same disk and both are seen by VxVM as separate disks, c1t30d0 and c2t30d0 can be put in a path group so that only one of these paths is visible to VxVM. The path group can be specified as a list of blank separated paths, for example, c1t30d0 c2t30d0. Enter path group: [,list,list-exclude,q,?] Select option 5 to disable multipathing for all disks on a specified controller. Exclude controllers from DMP Menu: VolumeManager/Disk/ExcludeDevices/CTLR-DMP Use this operation to exclude all disks on a controller from being multipathed by vxdmp. As a result of this operation, all disks having a path through the specified controller will be claimed in the OTHER_DISKS category and hence, not multipathed by vxdmp. This operation can be reversed using the vxdiskadm command. It is possible to specify a controller name at the prompt also. A controller name is of the form c#, example c3, c11 etc. Enter 'all' to exclude all paths on all the controllers on the host. To see the list of controllers on the system, type 'list'. Enter a controller name:[,all,list,list-exclude,q,?] Select option 6 to disable multipathing for specified paths. Exclude paths from DMP Menu: VolumeManager/Disk/ExcludeDevices/PATH-DMP Use this operation to exclude one or more disks from DMP. As a result of this operation, the disks corresponding to the specified paths will not be multipathed by DMP. This operation can be reversed using the vxdiskadm command. A path name or a pattern can also be specified at the prompt. Here are some path selection examples: all:all paths c4t2:all paths on controller 4, target 2 c3t4d2:a single path list:list all paths on the system Enter a path name or pattern :[,all,list,list-exclude,q,?] If a path is specified, the corresponding disk will be claimed in the OTHER_DISKS category and hence not multipathed. Select option 7 to disable multipathing for disks that match a specified Vendor ID and Product ID. NOTE: This option requires a reboot of the system. Exclude VID:PID from DMP Menu: VolumeManager/Disk/ExcludeDevices/VIDPID-DMP Use this operation to prevent vxdmp from multipathing disks, returning a specific VID:PID combination. As a result of this operation, all disks that return VendorID:ProductID matching the specified combination will be claimed in the OTHER DISKS category (i.e.they will not be multipathed by vxdmp).This operation can be reversed using the vxdiskadm command. It is possible to specify a VendorID:ProductID combination at the prompt. The specification can be as follows : VID:PID where VID stands for Vendor ID PID stands for Product ID (The command vxdmpinq in /etc/vx/diag.d can be used to obtain the Vendor ID and Product ID) Both VID and PID can have an optional '*' (asterisk) following them. If an '*' follows VID, it will result in the exclusion of all disks returning Vendor ID starting with the specified VID. The same is true for Product ID as well. Both VID and PID should be non NULL. The maximum allowed lengths for Vendor ID and Product ID are 8 and 16 characters respectively. Some examples of VID:PID specification are: all- Exclude all disks aaa:123- Exclude all disks having VID 'aaa' and PID '123' aaa*:123- Exclude all disks having VID starting with 'aaa' and PID '123' aaa:123*- Exclude all disks having VID 'aaa' and PID starting with '123' aaa:*- Exclude all disks having VID 'aaa' and any PID Enter a VID:PID combination:[,all,list,list-exclude,q,?] All disks returning the specified VID:PID combination will be claimed in OTHER_DISKS category and hence not multipathed. Enabling multipathing and making devices visible to VxVM NOTE: Some of the operations described in this section require a reboot of the system. Select menu item 18 (Allow multipathing/Unsuppress devices from VxVM's view) from the vxdiskadm main menu to re-enable multipathing for a device or to make a device visible to VxVM again. 1. At the following prompt, confirm that you want to continue: Include Devices Menu: VolumeManager/Disk/IncludeDevices The devices selected in this operation will become visible to VxVM and/or will be multipathed by vxdmp again. Only those devices which were previously excluded can be included again. Do you want to continue ? [y,n,q,?] (default: y) 2. Select the operation to be performed from the displayed list: Volume Manager Device Operations Menu: VolumeManager/Disk/IncludeDevices 1 Unsuppress all paths through a controller from VxVM's view 2 Unsuppress a path from VxVM's view 3 Unsuppress disks from VxVM's view by specifying a VID:PID combination 4 Remove a path group definition 5 Allow multipathing of all disks on a controller by VxVM 6 Allow multipathing of a disk by VxVM 7 Allow multipathing of disks by specifying a VID:PID combination 8 List currently suppressed/non-multipathed devices ? Display help about menu ??Display help about the menuing system q Exit from menus Select an operation to perform: Select option 1 to make all paths through a specified controller visible to VxVM. Re-include controllers in VxVM Menu: VolumeManager/Disk/IncludeDevices/CTLR-VxVM Use this operation to make all paths through a controller visible to VxVM again. As a result of this operation, all paths through the specified controller will be made visible to VxVM again. A controller name can be specified at the prompt. A controller name is of the form c#, example c3, c11 etc. Enter 'all' to include all paths on all controllers on the host. Enter a controller name:[,all,list,list-exclude,q,?] Select option 2 to make specified paths visible to VxVM. Re-include paths in VxVM Menu: VolumeManager/Disk/IncludeDevices/PATH-VXVM Use this operation to make one or more paths visible to VxVM again. As a result of this operation,the specified paths will become visible to VxVM again. It is also possible to specify a path name or a pattern at the prompt. Here are some path selection examples: all: all paths c4t2: all paths on controller 4, target 2 c3t4d2: a single path Enter a path name or pattern :[,all,list,list-exclude,q,?] Select option 3 to make disks visible to VxVM that match a specified Vendor ID and Product ID. NOTE: This option requires a reboot of the system. Make VID:PID visible to VxVM Menu: VolumeManager/Disk/IncludeDevices/VIDPID-VxVM Use this operation to make all disks returning a specified VendorID:ProductID combination visible to VxVM again. As a result of this operation, disks that return VendorID:ProductID matching the specified combination will be made visible to VxVM again. A VID:PID combination can also be specified at the prompt. The specification can be as follows : VID:PID where VID stands for Vendor ID PID stands for Product ID (The command vxdmpinq in /etc/vx/diag.d can be used to obtain the Vendor ID and Product ID) Both VID and PID can have an optional '*' (asterisk) following them. If an '*' follows VID, it will result in the inclusion of all disks returning Vendor ID starting with VID. The same is true for Product ID as well. Both VID and PID should be non NULL. The maximum allowed lengths for Vendor ID and Product ID are 8 and 16 characters respectively. Some examples of VID:PID specification are: all- Include all disks aaa:123- Include all disks having VID 'aaa' and PID '123' aaa*:123- Include all disks having VID starting with 'aaa' and PID '123' aaa:123*- Include all disks having VID 'aaa' and PID starting with '123' aaa:*- Include all disks having VID 'aaa' and any PID Enter a VID:PID combination:[,all,list,list-exclude,q,?] NOTE: All disks returning the specified Vendor ID and Product ID combination will be made visible to VxVM. Select option 4 to remove a path group definition. (A path group explicitly defines alternate paths to the same disk.) Once a path group has been removed, all paths that were defined in that path group become visible again. Remove a path group definition Menu: VolumeManager/Disk/IncludeDevices/PATHGROUP-VxVM Use this operation to remove the definition of path group. Specify the serial numbers of the path groups at the prompt. This can be obtained by typing list-exclude at the prompt. Enter path group number(s):[,list-exclude,q,?] Select option 5 to enable multipathing for all disks that have paths through the specified controller. NOTE: This option requires a reboot of the system. Re-include controllers in DMP Menu: VolumeManager/Disk/IncludeDevices/CTLR-DMP Use this operation to make vxdmp multipath all disks on a controller again. As a result of this operation, all disks having a path through the specified controller will be multipathed by vxdmp again. It is possible to specify a controller name at the prompt. A controller name is of the form c#, example c3, c11 etc. Enter 'all' to include all paths on all controllers on the host. Enter a controller name:[,all,list,list-exclude,q,?] Select option 6 to enable multipathing for specified paths. NOTE: This option requires a reboot of the system. Re-include paths in DMP Menu: VolumeManager/Disk/IncludeDevices/PATH-DMP Use this operation to make vxdmp multipath one or more disks again. As a result of this operation, all disks corresponding to the specified paths will be multipathed by vxdmp again. A path name or a pattern can also be specified at the prompt. Here are some path selection examples: all: all paths c4t2: all paths on controller 4, target 2 c3t4d2: a single path Enter a path name or pattern :[,all,list,list-exclude,q,?] Select option 7 to enable multipathing for disks that match a specified Vendor ID and Product ID. NOTE: This option requires a reboot of the system. Make VID:PID visible to DMP Menu: VolumeManager/Disk/IncludeDevices/VIDPID-DMP Use this operation to make vxdmp multipath disks returning a specified VendorID:ProductID combination again. As a result of this operation, all disks that return VID:PID matching the specified combination will be multipathed by vxdmp again. It is possible to specify a VID:PID combination at the prompt. The specification can be as follows : VID:PID where VID stands for Vendor ID PID stands for Product ID (The command vxdmpinq in /etc/vx/diag.d can be used to obtain the Vendor ID and Product ID) Both VID and PID can have an optional '*' (asterisk) following them. If an '*' follows VID, it will result in the inclusion of all disks returning Vendor ID starting with the specified VID. The same is true for Product ID as well. Both VID and PID should be non NULL. The maximum allowed lengths for Vendor ID and Product ID are 8 and 16 characters respectively. Some examples of VID:PID specification are: all- Include all disks aaa:123- Include all disks having VID 'aaa' and PID '123' aaa*:123- Include all disks having VID starting with 'aaa' and PID '123' aaa:123*- Include all disks having VID 'aaa' and PID starting with '123' aaa:*- Include all disks having VID 'aaa' and any PID Enter a VID:PID combination:[,all,list-exclude,q,?] ================================================================================