================================================================================ get tapes from offsite or alternate datacenter NOTE: *** select the write protect tab the tape(s) *** Inject tape(s) ~netbackup/bin/goodies/MEDIA/INJECT.ksh edit the 'mail' file and note the tape slots - they are in order and you will take the first x number based on your quantity of tapes you are inserting Update library /usr/openv/volmgr/bin/vmadm s r 1 (appropriate library) u If tapes were suspended, then unfreeze them: (The state should be 'IMPORTED') bpmedialist -U -m ID bpmedia -unfreeze -m ID Import tape(s) one at a time, start with the primary volume first (if known) Follow documentation import phase I import phase II Add host that needs restore as a client list policies bppllists add client bpplclients POLICY -add CLIENT.domain HARDWARE OS bpplclients addhoc_backups -add myserver.com Solaris Solaris8 Do the restore select proper server, client and restore client watch date selections NOTE: set alternate restore directory if needed/desired When finished, eject tape(s) ~netbackup/bin/goodies/MEDIA/EJECT.ksh edit the 'slots' file and put in the slots that were noted from the injecting process Update library /usr/openv/volmgr/bin/vma s r 1 (appropriate library) u unselect the write protect tab the tape(s) send tape back ================================================================================ server recovery: windows: sysprep NBU: restore OS doc and solaris books OS CD's and jumpstart/FLAR and RDP stuff (vendor and ours) DR: iron mountain - need common global contact ================================================================================ NOTE: Iron Mountain access/authorization Getting Started: Disaster Recovery Planning Without Destroying Your Budget Large and small disasters happen all the time. Events ranging from purely local disasters such as local flooding caused by a fire down the block, to a city-wide flu epidemic, or a region-wide blizzard, all have the potential to put companies out of business. In our disaster planning work with many different types of organizations, we have seen that too many of them make the recovery process harder for themselves - or even impossible - by not planning ahead for disaster recovery. While they may take steps to try to prevent disasters, they ignore the reality that prevention won't always work. As a result, these organizations fail to take prudent and inexpensive preparatory actions to facilitate the recovery of their business operations. DISASTER CATEGORIES The first of two fundamental hurdles to overcome when planning for disaster recovery is to realize that the seemingly large variety of possible disasters can actually be reduced to a manageable number. In point of fact, all disasters can be grouped into one or more of only three categories. These are: loss of information, loss of access, loss of personnel. RECOVERY TIME PERIODS The second hurdle to overcome is in accepting the fact that "business-as-usual" will be suspended at the time of the disaster. In fact, the people who are usually in charge may not even be available! For example, several years ago, there was a gas line explosion at a bank in the midwest. In the explosion, all employees were either killed or injured, the president was among those killed, and the executive vice president was left to try to manage the recovery from his hospital bed. What you have to accept is that there will be two time periods which must be planned for following a disaster. First will be the immediate, disorganized, "limited-operation" time span, which will then be followed by a period of "makeshift-operations," which can be quite lengthy until normal operations can be resumed. Typically, following a physical disaster, the limited-operations time span can extend for up to a week or more, while the makeshiftoperations time span can last for several months until normal operations are restored. This need to recover in phases is typically very difficult for management to accept. Often, when asked to prioritize among the organization's services or products, our clients' first reactions are to consider them all equal. Following that, people are often unrealistic in their estimation of how fast departments can accomplish their tasks. In one of our client situations, the organization had planned to relocate a key department to a hotsite four hours away - without realizing that most of the affected people were single parents, who couldn't possibly go there! Once management has a proper mind-set to build upon, the objective of the planning process is to systematically sort out the various issues and priorities so that a cost-effective plan can be developed which is in perspective to the level of loss exposure which the organization is risking. The process itself can be summarized in the following steps: provide top-management guidelines, identify serious risks, prioritize the operations to be maintained and how to maintain them, assign the disaster team, take a complete inventory, know where to get help, document the plan, review with key employees, test the plan, and train all employees. Each of these is discussed below. Top management guidelines: Input from top management is required to keep the planning process in perspective and to insure participation by everyone within the organization. Top management also has to indicate the length of time during which time the organization is willing to accept disrupted service and the amount of money the organization is willing to invest in procuring standby equipment, paper forms, testing, etc. as part of being prepared for an emergency. Input from management is also important in assigning priorities to which operations will be maintained during the limited-operations time span and which will be recovered later. Our experience has been that even though employees thought they knew the answers which management would give regarding these priorities, invariably this stage in planning produces the most surprises and shows how little communication often occurs between management levels. Identifying serious risks: This is a "brainstorming" process, which is best accomplished working with the employees themselves during department or group meetings. It serves the dual role of starting to build the awareness of the employees to the issue of disaster planning as well as surfacing potential risk areas about which management may not have been aware. For example, one of our clients who performs extensive money wire transfers, discovered that in the event of telephone service interruption, the emergency "callback" number they had given to their wire-transfer service agency was in the same building as their normal telephone number. Obviously, in a disaster, neither line would be available. The client immediately had the number changed to one in another building - but would never have known of the problem without going through the process with lower-level employees. Prioritize the operations: Most managers never think about it, but for the typical organization, the highest priority is payroll. Even if this is performed by an outside service, there is usually a terminal for remote input of the payroll data. So, in the event that there is a disruption, either at the source of the data, or at the payroll processor, there must be a delegation of authority to someone (remember, the president, owner, etc. may well not be available) to be able to issue substitute manual advance checks. In general, top management will have to decide, depending on the kind of organization, how long they are willing to operate without being able to perform each of their daily operations, such as accepting customer credit applications, receiving deliveries, etc., in addition to their more obvious operations such as buying and selling. Banks need policies on accessing safe deposit boxes, sending out mortgage bills, commercial night depository, etc., in additions to just worrying about deposits and withdrawals. Based on these priorities, the organization can plan out how long to suspend each operation, and designate either a manual backup mode or a longer lead-time approach for each function. These priorities also guide the organization in setting the frequency of off-site storage of backup files. For example, in order to meet emergency requirements, some files which might normally be stored off-site on a weekly basis might instead be stored on a more frequent basis. Assign the disaster team: Disasters always seem to happen at the worst possible times, when the fewest personnel are available. Therefore, it is crucial that as part of the disaster plan, management appoint one person in charge of recovery, and one person as second-in-command. Following this, as many specific tasks as possible within the plan should be pre-assigned. In the wake of hurricane Hugo, with most telephone service knocked out, one company in South Carolina which had not preassigned tasks, reported that it took four days just to assemble their key personnel. That is certainly not the way to endear yourself to your customers or clients! The best basic rule of thumb is that when disaster occurs, employees should know what they are responsible for, and are not responsible for, who is in charge, and who is the designated alternate in charge. Inventory: While most organizations have records covering the make and model numbers of their equipment, at the time of purchase, they are usually not updated and almost never kept off-site. Taking inventory should include emergency vendor contacts for all equipment (including microfilmers, specialty mailing and other equipment - not just computer hardware and software), descriptions and formats of all data files, and copies of all business forms used, along with the vendor contact for each. Know where to get help: Actively collect any additional names of service or equipment providers as you come across them. Documentation: The plan should be written down - remembering that if the core document is longer than 15-20 pages it will never be read or used, along with the various assignments, updated inventory, and all key phone numbers. Key personnel should have a copy of this documentation at home. Review, Training, and Testing: After completion, the plan needs to be reviewed with all employees on a regular basis. This does not have to be a lengthy procedure, and it offers a first-level "blink test" as to the reasonableness of the plan - as our client with the staff of single parents found out. Basic training also does not have to be time-consuming, although employees should at least know where the fire extinguishers are located and have seen a demo on how to use them. More extensive training may be required in the event that there has not been enough cross-training to allow employees to replace a missing co-worker. With respect to testing, a full-blown test of the plan may not be feasible, although moves, relocations, or unplanned shutdowns should be treated and evaluated as tests of your recovery ability. To conclude, all of these activities can basically be characterized as "in-advance decision-making." Their cost is very little, yet they yield the immediate benefits of: improving communications within the organization, highlighting vulnerable points in the organization's operations, ensuring that the organization has its best possible chances of surviving disaster. Finally, the underlying philosophy in our approach to disaster recovery planning it is that you can get a lot done without a lot of expense, that you can benefit greatly by thinking through as much as possible beforehand, and that you should assign responsibilities and make management decisions now - rather than wait until you're in your parking lot, leaning against a fire engine in the middle of the night! Preparing the Disaster-Recovery / Business-Continuation Plan Remember, a disaster plan is never a fixed finished document - it evolves and gets better as time goes by. Therefore, it doesn't have to be perfect the first time you do it - the important thing is to get started on it! Be systematic in your plan - don't try to outguess Nature and plan for a flood, a hurricane, a fire, etc. Instead, look at the common elements in any disaster: loss of information, loss of access to information & facilities, loss of people. Make a matrix, with these three as the columns, and each of your activities as a row. (Beyond the obvious, your activities include things like "accounts receivable," "payroll," "real estate management," etc., depending on your situation.) Then figure out how you would respond to loss of information, access, and/or personnel for each function. Appoint a second in command. If the person normally in charge is injured in the disaster or not available, the second in command should be named in the plan, and delegated full authority in this situation. If you can't name someone, you have already pinpointed one of your greatest vulnerabilities! List individual responsibilities ahead of time, and assign specific people to each task. Again, beyond the obvious, this includes tasks such as notifying your suppliers where to deliver, calling your most important customers to tell them what has happened, calling your Board members, etc. Protect critical paper records. Even in a fully automated organization, there can be vulnerable records - such as "pending" contracts, advertising, research, loan applications, etc. - which only exist on paper. Set clear priorities among your activities. After a disaster, you will not return everything to normal at the same time. Decide beforehand the longest amount of time you are willing to be "dead in the water" for each of your activities. Have a backup connection to your main computer. Make sure that your main computer (either at your service bureau, your main office, or your hotsite) can "dial out" in the event that your leased-lines are lost, or in the event that you must relocate to a different site. Make sure that employees can exit without a key. This may sound obvious, but in many organizatons, once the doors are locked at the end of the day to keep the customers out, employees staying late to process work are locked in. Keep copies of all of your forms off site. This includes extra checks so that you can buy the emergency supplies you need. Keep a copy of your disaster plan at home. Make sure it includes the home phone numbers of the service people you rely on: your insurance agent, plumber, electrician, etc. Disaster Recovery Planning - Have You FORGOTTEN...?? In preparing for disaster recovery, most organizations follow variants of the basic steps listed below: provide top-management guidelines, identify serious risks, prioritize the operations to be maintained and how to maintain them, assign the disaster team, take a complete inventory, document the plan, train employees, test the plan, review with all employees. As we have worked with organizations ranging from Retailers to Banks to Dairies, we have found that even following the basic steps, there are "small but crucial" points which are often overlooked, and simply "add insult to injury" when disaster occurs. We provide a list of them here in the hope that it may help to lessen the disaster's impact. Do you have an alternate person with full authority for disaster recovery, in the event that the usual person in charge is not available? Do the Fire and Police departments servicing each of your locations have the phone number of both your person in charge and your alternate? Do you keep your backups where you can always get to them (not in a timed vault, etc.)? Have you tested that you can actually read and restore your computer and PC backup files? Do your alarms work without power (do they have battery back-up)? Are your safes fireproof or only "tool-resistent?" Do you have a binder off-site with a copy of every form you use,and the phone number of where you get them? Do you have the after-hours contact numbers for your insurance agents? Do you have at least one telephone at each location which works when your central PBX loses power or breaks? Is your payroll function cross-trained - often for reasons of privacy it is not. Are your personnel records safe from fire - typically they are among the files which are not. Do you know the street addresses of your local radio stations, in the event that telephones are not working and you must get there in person to submit announcements. Are your telephone and electrical service "rooms" protected from "falling" water - most are not, and represent a major cause of disaster downtime. Does someone have a list of all employees' voice-mail passwords - in order to retrieve messages when an employee is suddenly ill or incapacitated. Do each of your locations have "emergency cabinets," containing at least: candles, matches, flashlights with extra batteries, a radio with extra batteries, coins for vending machines, and a first-aid kit? Do all your locations have at least one exit which can be used without a key - in some industries up to 30% of sites literally "lock in" their employees after public hours are over. Search Storage Mountain Go to advanced search (Formerly known as BackupCentral.com) Storage software Storage hardware Storage books Free storage software Free storage info Although the old domain name will still work, BackupCentral.com has now become StorageMountain.com. This name better symbolizes our storage-centric content that is no longer just about backup and recovery. Be sure to check out our new storage integrator and disk array directories. Home Privacy Policy Contact Us Disaster Recovery Yellow Pages Detailed Table of Contents (The DRYP is now available exclusively online at this web site.) This table of contents has five sections: Section I - Services Section II - Hotsites, Warmsites, Coldsites, Mobile Buildings & Teller Facilities Section III - Disaster Prevention & Recovery Equipment, New, Used, Rental Section IV - Software for Planning, Analysis, Data Recovery, etc. Section V - Associations, Films, Materials, Publications, Supplies, Trade Shows, Training, misc. Section VI - Alphabetic Listings (To order the Disaster Recovery Yellow Pages, send mail to dryp@datablast.com.) Section I - Services air ambulance evacuation audio tape & record restoration & preservation ballast recyclers building materials, bulk quantity brokers certification for disaster planners & emergency managers clean-up & restoration cleaning companies, data processing site specialists cleaning companies, disaster specialists, electronic equip. cleaning companies, insurance/disaster specialists cleaning companies, medical cleanup: post-crime/post trauma concrete & masonry repair decontamination equipment, portable disposal, electrical equip. disposal, hazardous waste drying & dehumidification environmental clean-up facilities preparation for data processing equip fire & water damage restoration flood damage restoration food, lodging & sanitary services, emergency full-service general contractors: restoration & reconstruction glass board-up jewelry, fire damage repair jewelry, replacement office furniture restoration referral service, disaster cleanup site remediation smoke & odor counteracting services turnkey data processing site & service restoration videotape restoration water damage restoration computer repair specialists: banking equip. repair dec equip. repair hard disk repair personal computer repair: all types of personal computer repair ibm pc's & compatibles macintosh sun equip. repair misc. peripherals repair: laser printer repair printer repair - general tape drive repair conservation: art, library, & museum construction, emergency consulting services: actuaries appraisers architectural/engineering services burgler & fire alarm, consultation & design business continuation services business development plans - following disaster business impact analysis business recovery planning crisis management disaster avoidance disaster recovery planning & emergency preparedness - general disaster recovery planning & emergency preparedness - for law firms earthquake emergency & crisis management environmental risk equipment restoration expert witness & investigation, burglar & fire alarm fire protection flood zone research insurance item processing loss prevention & investigation network recovery & recovery planning office equipment repair outside evaluation audit of disaster plan adequacy power protection & continuity public relations records management risk analysis, management, & control risk analysis: potential loss estimating - earthquake, flood, windstorm, fire, etc. security - general security - eavesdropping detection telecommunications training, education, & awareness workplace violence cooling services crisis management services data distribution service data & records recovery: data recovery from broken hard disks data recovery from damaged media, misc. data recovery from damaged tape data recovery from optical disks microfilm drying & re-wash service recover water-damaged books & documents detective agencies education, training & awareness emergency response logistics food, lodging, & sanitary services - mobile forensic accountants forensic engineers government services guard services heating services housing, temporary information management & protection insurance adjusters, independent insurance adjusters, public insurance, special situations legal issues, environmental legal issues, insurance life support services & supplies lighting, emergency lighting, solar generated liquidators/salvage mailing, printing & inserting services maintenance services, computer/networks, telecommunications, specialty and nationwide-coverage microfilm drying & re-wash microfilming & record copying museum services notification & dispatch services, phone, fax, pagers, etc. offsite record & hard-copy storage offsite tape, film, optical, etc. data storage outside audit of disaster plan adequacy overspray removal services printing, emergency - business & bank forms psychological services: crisis management - human factors trauma counseling recruiting/employment - disaster recovery, risk management, & security professionals remediation restoration: audio materials restoration: video materials salvage & surplus buyers satellite dishes, mobile scrap computer & banking equipment - buyers scrap fluorescent lamps & ballasts - buyers scrap hard drives - buyers search & rescue secretarial services, temporary security systems - repair & replacement site remediation stolen computer equip, registry telephone answering telephone supply transportation, specialized trucking underground rescue videotape restoration warning systems weather forecasting wrapping, protective: buildings & structures Section II - Hotsites, Warmsites, Coldsites, Mobile Buildings & Teller Facilities bank buildings & interiors hotsites, warmsites & coldsites check processing, bank, all vendors data general dec hewlett-packard honeywell - bull hn ibm large systems ibm - midrange (system/3x, as400, etc.) ibm - rs6000 ncr networks & pc's prime/computervision sequent sun tandem telecommunications, misc. unisys versyss wang misc. hotsite/warmsite/coldsite services: client-specified hardware/software configurations cold site services office/voice recovery sites housing, temporary mobile administrative offices & command centers mobile bank branches mobile cargo storage space mobile classrooms mobile computer rooms & data centers mobile computers, delivered on site: client-specified configurations hewlett packard ibm - midrange wang mobile disaster response trailers mobile homes mobile satellite communication dishes, emergency mobile security units mobile vsat modular buildings recovery trailers shelters, portable trading room recovery sites misc. other mobile units Section III - Disaster Prevention & Recovery Equipment, New, Used, Rental access flooring air cleaning equip air testing equip alarms, earthquake alarms, fire alarms, hydrogen chloride gas detection alarms, water alarms & warning systems, misc. boilers, mobile cable testers cash registers & point-of-sale devices channel extension equipment computer & electronic equipment, used: bought, sold, rented misc. - all computer equipment 3-com equip. apple atm's (automated teller machines) at&t basic-4 bull hn check processing equip data general dataproducts printers dec hewlett-packard honeywell ibm - large systems ibm - midrange (system/3x, as4xx, etc.) ibm - point-of-sale equip ibm - rs/6000 isc teller equipment & branch controllers lan/wan network equipment macintosh mailing equipment microfilm modems, misc. communications equip. modems, wireless ncr network equipment: lan/wan nixdorf olivetti pc's (ibm & compatibles) perkin-elmer point-of-sale equipment, misc. prime/computervision printers, plotters, misc. silicon graphics sun tandem telephone systems teller equipment, misc. texas instruments (ti) unisys/burroughs wang wyse zenith continuous-up-time computers cooling equipment, mobile copying & converting equipment for document & data storage - tape & optical decontamination equipment, portable disaster avoidance system - tape dispatch systems drying & dehumidification equipment environmental clean-up equipment, rental environmental controls environmental monitoring & site control equipment & tools, misc. evacuation equipment fault-tolerant communications fault-tolerant computers fireproof safes, files, & containers furniture rental: commercial & residential furniture replacement generators, electric-rental/purchase halon replacement systems heating equipment, mobile keyboards, ruggedized & specialty lighting, emergency lightning protection & grounding microwave equip., temporary network backup/recovery equipment network/communications equipment network monitoring & analyzing equipment office furniture, replacement office panel systems, refurbished power line analyzers & monitors power on/off - remote telephone control power protection & continuation devices radiation detectors radios & walkie-talkies sandbag-filling equipment satellite-based products security & authentication systems security hardware for computers shut-off systems, automatic site control smoke & odor counteracting products steam cleaners & pressure washers surge protectors surplus computer equipment buyers surplus computer equipment: charitable donations accepted switches, ruggedized & specialty tanks, storage tape backup units tape backup units - portable telecommunications & fiber optics telephone dialing equip., automated transformers, electric ups - uninterruptible power supplies water testing equip misc., other emergency preparedness & response tools & equipment: temporary water chillers, air cond., elect.heaters, dehumidifiers Section IV - Software for Planning, Analysis, Data Recovery, etc. bank contingency planning software business-impact analysis software business resumption planning software continuous availability software credit union business recovery/contingency planning software databases: security products & services disaster recovery planning software: running on ibm as400 running on ibm pc's & compatibles running on ibm system/370 architecture running on macintosh disk access control dispatch software electronic vaulting emergency information location emergency management software emergency staffing software erased & damaged file recovery utilities: ibm as400 ibm-pc & compatibles ibm system/36 macintosh wang file & data backup/recovery software dec hewlett-packard ibm as400 ibm large systems ibm pc & compatibles ibm system/3x macintosh networks sun unix file transfer: as400-sun macintosh-ibm as400 pc-hewlett-packard pc-ibm large-systems pc-macintosh pc-unix misc., multiple systems hazardous material management software incident management & planning software information integrity verification software log-off, automatic mirror-imaging software/hardware running on ibm as400 running on ibm - large systems running on ibm pc's & compatibles running on lan's running on unix-based systems running on vax missing source-code, recovery network backup/recovery software network census & inventory software network problem analysis & management online software backup/recovery password management & recovery utilities power-loss-detect-&-shutdown utility software remote-operation software: data general ibm as400 ibm pc & compatibles macintosh risk analysis software security & access control - general security & access control - unix security policies tape library management systems tape (cartridge) testing systems virus detection/prevention/recovery: hardware-encoded ibm pc & compatibles-based macintosh-based weather-tracking software, pc-based year-2000-software-problems: analysis & solutions Section V - Associations, Films, Materials, Publications, Supplies, Trade Shows, Training, misc. associations cleaning & restoration associations computer security associations emergency preparedness & disaster recovery associations insurance associations insurance adjusters associations offsite information storage associations public information & awareness records & information management associations risk management associations trauma/counselor associations associations, misc. films/video's: production: films/video's rental & sale: films/video's materials: crisis response kits planning & "how-to" manuals training materials publications: books, manuals, journals, newsletters, etc. supplies business forms coatings, protective containers: contamination storage - hazmat contamination storage - medical magnetic media storage containers water-soaked-files, containers for cots, beds, blankets, tents, etc. covers: computer keyboard & control-panel switch covers moisture-proof equipment covers, fabric waterproof emergency covers, custom-fit escape ladders & devices fasteners: earthquake-proof fasteners: security fireproof containers & bags food, water, in emergency rations id badges, self-expiring kits: emergency/disaster survival lighting medical supplies sanitation search & rescue kits & supplies smoke hoods, personal trade shows & conferences training: certification for disaster planners, risk managers, & emergency managers disaster planning, & emergency management training earthquake engineering training environmental problems & safety training industrial & public safety training security training spanish training for emergency responders telecommunications training workplace violence control, training Section VI - Alphabetic Listings ================================================================================