MISCELLANOUS EMC REFERENCE

Acronyms
Root Profile
Start Poller
Start symmConsole
symmConsole Trending Colors
Symm Sizes
Symm Models
Symm Microcode
Symm Serial Numbers
Symm Devices: Protection & Types
Device Paths
Gatekeepers
Powerpath
Veritas DMP
EMC Unix Directories
EMC Supported HBAs
Miscellaneous Info

You will find the EMC support matrix (versions, h/w, etc) on powerlink.emc.com

EMC Acronyms
Acronym Meaning Description
BCV Business Continuity Volume Timefinder Volumes
BE Back End The back side of the Symmetrix where the disks and disk director are.
DMSP Dynamic Mirror Service Policy Determines which volume will be read from in a mirrored enviroment.
DD Disk Director The interface between the Symm Cache and the disks.
FA Fiber Adapter Where the fiber from the SAN connects to the Symm.
HVE Hyper Volume Extension A logical device to EMC, presented as a physical to Unix.
FE Front End The front side of the Symmetrix where the Fiber Adapter are.
SDR Symmetrix Disk Reallocation Allows customers to make dynamic configuration changes to the symm. Done in NVRAM; must have FE apply it to the bin file.
SRDF Symmetrix Remote Data Facility Mirror between symms.

Root Profile

You should define the symmID in root's profile (if have only one symm). If sh/ksh do:

export SYMCLI_SID;SYMCLI_SID=000184700037

Add this to root PATH

/usr/symcli/bin
/usr/emc/ECC/bin
/usr/emc/ESN_Manager

Add this to root MANPATH

/usr/symcli/man

Add this to root's cron

0 5 * * * /usr/symcli/bin/symcfg discover > /dev/null 2>&1

Starting the Poller

Find file in ~mbaker/src/rc3/S93symmpoll

PATH=$PATH:/usr/symcli/bin
. /usr/emc/ECC/symmappsrc.sh

 SYMMLIST=$(/usr/symcli/bin/symcfg list | awk '/Local/ {print $1}')

        for SYMM in $SYMMLIST
        do
            # this is poor, but must strip of leading zeros, don't know how
                # many there may be

                value=true
                while [[ $value = "true" ]]
                do
                        if [[ "$(echo $SYMM | cut -c1)" == 0 ]]
                        then
                                SYMM="$(echo $SYMM | cut -c2-)"
                        else
                                value=false
                        fi
                done

                echo "Starting Symmetrix Poller for $SYMM ..."
                /usr/emc/ECC/bin/symmpoll $SYMM &
        done

Starting the symmConsole (GUI)

The poller should be running, or you can start it within the GUI.
Source in /usr/emc/ECC/symmappsrc.sh
Run the console symmConsle

Go into preferences (Window->Preferences)

  1. Change "Symmetrix Name" to contain the site/location (EMC 900 DC 18470037).
  2. Select "Enable E-Mail on Error" and insert an email-address that all errors/messages should go to.
  3. Set "Start Polling on Startup.
  4. Also you should change the "IO/Second graph increment to 1000 (or close to).

You can use a '-k' to kill a running symmconsole prior to starting the GUI. You can use a '-f' to refresh the database (needed only when changes have been done to a symm. The database file for GUI preferences is in /usr/emc/ECC/data/$SymmID/symmWin.config, where $SymmID is that last 2 digits of the SymmID.
Symm Console Trending Colors Meaning
Check Box Measurement color Meaning
Short Term I/O I/Os per second yellow Average number of I/O operations per second accumulated in a sliding window of 4-8 minutes, controlled by Symmetrix.
Short Term Hit Ratio Percent green Percentage of cahce hits (r/w) out of all I/O requests accumulated in a sliding widnow of 4-8 minutes, controlled by Symmetrix.
Short Term Write Ratio Percent white Percentage of writes out of all I/O requests accumulated in a sliding widnow of 4-8 minutes, controlled by Symmetrix.
Long Term I/O I/Os per second wheat Averate number of I/Os per second accumulated since the last reset of the long term statistics counter in Symmetrix Manager.
Long Term Hit Ratio Percent orange Percentage of cache hits (r/w) out of all I/Os requests accumulated since the last reset of the long term statistics counter in Symmetrix Manager.
Long Term Write Ratio Percent blue Percentage of writes out of all I/Os requests accumulated since the last reset of the long term statistics counter in Symmetrix Manager.

Symmetrix Size Configs

A disk track in a symmetrix is 64 sectors.

An 8730 can contain:

32 - 384 quantity of disks
18,032 GB of Disk Capacity
2 - 32 GB of Cache

An 8430 can contain:

8 - 96 quantity of disks
6,008 GB of Disk Capacity
2 - 32 GB of Cache

The 8X30 series can have: 18, 36, 72, 181 GB disk drives.

A Fiber Channel (FC) can have max 256 Logical Volumes.

A disk can have max 32 Logical Volumes (Symmetrix partitions).

A symm can have max 4096 Logical Volumes.

Symmetrix Model Number Explained

The sym model number tells you alot about the symm.

Symm 5.0

The first digit is either an 8 (open systems and mainframe).
The second digit tells you the number of bays: 7=3 bays, 4=1 bay.
The third digit tells you the size of disk: 3=3.5", 0=5.25".
The fourth digit tells you nothing - it is always a 0.

A 8730 is:

open and mainframe systems
3 bays
with 3.5" drives.

Symm 4.0

The first digit is either a 3 (open systems - unix &| WNT) or a 5 (closed - mainframe).
The second digit tells you the number of bays: 9=3 bays, 8=1 bay, 6-.5 bay.
The third digit tells you the size of disk: 3=3.5", 0=5.0".
The fourth digit tells you nothing - it is always a 0.

A 3930 is:

open systems
3 bays
with 3.5" drives.

Microcode

Microcode fields: i.e. 5556
First digit is Microcode line.
Second digit tells Symm line: 0=sym3, 2=sym4, 5=sym5.
Third and Fourth digits are Microcode Family.

Symmetrix Microcode (2nd digit in Model Num) To Bay Number Matrix
  5.0 4.8 4.0 3.0
3 Bays 7 9 7 5
1 Bay 4 8 4 2
1/5 Bay 3 6 3 1

Disk Serial Number Explained

Output from syminq for a device is: 73012150

73 is last 2 digits of the symm
012 is the symm dev number for that device
15 is the host adapter number
0|1 is the hostside, C|D is the disk side
For Veritas DMP to work, the last 3 digits must be 000 (i.e. the 150 in this example).

Files & Directories

Some Major EMC Directories

Files are preceeded with a dash ('-').

/opt/emc
  -emc_var_path
  -emc_key_file
  -start_symm
  EMC__SM
  ECCagent
  SDR
  SInquiry
  SOpt
  SRDF_TFinder_GUI
  logs (Install)
  SYMCLI
    V4.X
      bin
      doc
      install
      man
        man1
      shlib
        sql
          IBMUDB
          INFORMIX
          ORACLE
          SYBASE

/usr/emc
  API
    symapi
      config
        README.xxx
        netcnfg
        symapi_licenses.dat
        symapinlck
        symapislck
      db
        symapi_db.bin  #database created by "symcfg discover", can safely
                        be removed and recreated.
      log
        symapi-XXXXXX.log
  ECC
    -EMCversion.log
    bin
    bitmaps
    data
      000XXXXXXXX #symm ID
      XXXXXXXX #symm ID
        many files - please see 
      README
      config
      -ECCAgent.log
      -WLAagent.bin
      -WLAagent.log
      -eccagent
      -eccagents
      -emc.mib
      -fa_wwn_info.HOSTNAME
      group
      -hba_wwn_info.HOSTNAME
      -host_stats_file
      -miboids.txt
      -obj_tbl
      -poller.mib
      swdata
      -symagent
      -wlaagent
    -eccagents
    man
      cat1
      man1
    -symmappsrc.csh
    -symmappsrc.sh
  ESN_Manager
    backups
    doc
      -LOTS OF HTML FILES
    -esnmgr.sh
    etc
      -autopath.ini
      -fzone.ini
      -pathman.ini
      -plugin.ini
      -vcm.ini
      -vcmDevices.ini
      -view.ini
      -wwn.ini
    jre
      1.2
      1.3
    lib
      ECC-Images
      SunOS
        -libfzApi.so
        -libvcmApi.so
      -design_pro.jar
      -esnm.jar
      -fzone.jar
      -jviewsall.jar
      resources
        -PathManager.properties
        -autopath.properties
        -defaults.properties
        -fzone.properties
        -help.html
        -images.properties
        -oui.idx
        -oui.txt
        -plugin.properties
        -testobject.properties
        -today.html
        -vcm.properties
        -wwn.properties
      -shared.jar
      -vlogix.jar
      -xreport_pro.jar
      -xtools.jar
    logs
      -esnm.log
      -messages
    -uninstall.class
    -uninstall.sh
  FibreZone
    -README
    bin
    db
      -configs
      -libs
      lock
      -members
      tmp
      -units
      vlib
      -zones
    -fz_unix_uninstall.sh
    lib
      -libzmgr.a
      -libzmgr.so
    log
      -api
      -cmdln
      -fz_unix_install.log
      -libi
    sbin
    -setup.cshrc
    -setup.profile
  VolumeLogix
    -README
    -error_list
    -fcompare
    -fconfig
    -fpath
    -libsil.a
    -libvcm.a
    -libvcm.so
    -libvcm_sil.so
    log
      -vcm_unix_install.log
    -report
    -rofpath
    -setup.cshrc
    -setup.profile
    -vcm_unix_uninstall.sh
    -vcmaudit
    -vcmfind

/usr/symcli -> /opt/emc/SYMCLI/V4.X

The database file for GUI preferences is in /usr/emc/ECC/data/##/SymmWin.Config.

Locations of Files

The database file for GUI preferences is in /usr/emc/ECC/data/##/SymmWin.Config.
The database file for licenses is in /var/symapi/db/symapi_db.bin.
The database file for BCVs is in /usr/symmapps/data/group/class.bcv.

Devices

Protection Levels

A symm device can have 4 mirror positions:  - i.e. 1,2,3,4 = M1,M2,M3,M4
NP    - No Protection
M1    - device itself
MR/M2 - two way mirror: standard EMC h/w mirror
M3    - three way mirror or a BCV
M4    - four way mirror or a BCV
V4    - BCV Copy
R1    - SRDF source device
R2    - SRDF target device
R3    - SRDF linked to another Symm
RP    - RAID Parity
RS    - RAID-S
RM    - RAID-S plus mirror
FN    - RDF with no local protection
FM    - RDF and local mirror
FR    - RDF and local RAID-S

Device Types

Regular
BCV (non-mirrored)
RFD1 (SRDF group 1 - source)
RFD2 (SRDF group 2 - target)
Device References
Reference Parameter Example Description
pd PdevName /dev/rdsk/c0t0d0s0 Physical Name
dev SymDevName 038 Symmetrix Name
ld LdevName DEV001 Logical Name

Device Paths

If the FE shows 2 paths then it is using powerpath or DMP.
If the FE shows no paths then it is a spare.
The BE always shows two paths.

Power Path

To reread powerpath devices:
powercf -q
powermt config

Veritas DMP

root# vxdmpadm disable ctlr=c3
root# vxdmpadm listctlr all
CTLR-NAME       ENCLR-TYPE      STATE      ENCLR-NAME
=====================================================
c1              SEAGATE         ENABLED    seagate0
c3              EMC             DISABLED   emc0
c4              EMC             ENABLED    emc0

Sep 10 15:39:38 HOSTNAME vxdmp: [ID 969440 kern.notice] NOTICE: vxvm:vxdmp: disabled controller /pci@8,700000/fibre-channel@2 connected to disk array 700037

root# vxdmpadm enable ctlr=c3
root# vxdmpadm listctlr all  
CTLR-NAME       ENCLR-TYPE      STATE      ENCLR-NAME
=====================================================
c1              SEAGATE         ENABLED    seagate0
c3              EMC             ENABLED    emc0
c4              EMC             ENABLED    emc0

Gatekeepers

A gatekeeper is an actual 6-10 cylinders in size just so that the host has a device that it can send an EMC request to (a tag, a path, a means to do listings that are not tied to a device). It is used to access the cache. It is recommended to have multiple gatekeepers to avoid deadlocks between syncronous commands.

Define a gatekeeper with VolumeLogix

How to add Gatekeepers to a host with  VolumeLogix

	On ESN Manger/Volume Logix Master do the following:

		sympd list | grep WD
	
		PATH=$PATH:/usr/emc/VolumeLogix
		VCM=/dev/rdsk/c6t14d0s2
	
		EITHER:
			fpath lsdb -d $VCM
			fpath lsdb -d $VCM > /tmp/fpath
			fpath lssymmdev -d $VCM > /tmp/fpath_symmdev
		
			#
			# Here you will add the Gatekeeper devices
			#
			# -w is the WWN of the host on the FA (from fpath_symmdev)
			# -f is the FA you are working with
			# -r is the gatekeeper Symdev
			#
	
			vi  /tmp/fpath
				search for hostname
				then search backward to get the WWN of FA its on
					do this for both hostname instances
	
			vi /tmp/fpath_symmdev
				search for the FA (skip any devices that have same pattern)
				get the DEVICE NUMBER of a 0.003 device (this is a gatekeeper)
		    OR
			cd /usr/emc/VolumeLogix; ./vcmfind

			grep hostname /tmp/fpath, these are the two WWN you will
				use when you do the fpath commands

		DONE
	
		#
		# now add for each FA
		#
		#IGNORE error about "vcmapi could not open the error_list message file."
		#
		#  the -w 2000xxxx is the WWN of the HBA
		#
		fpath adddev -d $VCM -w 200000e069415510 -f 5b -r "009"
		fpath adddev -d $VCM -w 200000e069415771 -f 14a -r "00e"
	
		fpath refresh -d $VCM
		fpath lsdb -d $VCM > /tmp/fpath_new


	On the source node needing the gatekeeprs do:

		symcfg discover

		drvconfig;disks

		symcfg discover

		sympd list | grep 3$

		symgate define pd /dev/rdsk/cXtXdXsX

		format cXtXdXsX 
			label

done with adding gatekeepers via VolumeLogix



HBAs

To list driver versions for Emulex/LP: pkginfo lpfc
To list firmware versions for Emulex/LP: (as root) /usr/sbin/lpfc/lputil
Then select firmware, then display flash load list

To list driver versions for JNI/FCAW : pkginfo -l JNIfcaw
To list firmware versions for JNI/FCAW : grep -i fcaw /var/adm/dmesg* | grep -i fcode

Release SDR lock (if abnormally shutdown)

USE only if you caused the issue (rebooted host when SDR was open, or killed window manager when in SDR), do not use to release an CE initiated SDR or Bin file lock.

/usr/symcli/bin/symcfg -sid 62 -lockn 15 -force release

Save the VCM Database

cd /usr/emc/VolumeLogix
./vcmfind
use one of the VCM devices to backup the database
./fpath backupdb -d /dev/rdsk/c6t14d0s2 -o backup-vcmdb-20020305

See if it was a good backup: should see the same output as an "fpath -d /dev/rdsk/c6t14d0s2
./fpath lsbackup -o backup-vcmdb-20020305