Recovering from a Complete Server Failure

Because hardware occasionally fails and, in the real world, operating systems do have problems, a server-recovery plan is essential, even though it might never be used. The last thing any administrator wants is for a server failure to occur and to end up on the phone with Microsoft technical support asking for the server to be restored from backup when no plan is in place. To keep from being caught unprepared, the administrator should have a recovery plan for every possible failure associated with Windows Server 2003 systems.

Restoring Versus Rebuilding

When a complete system failure occurs, whether it is due to a site outage , a hardware component failure, or a software corruption problem, the method of recovery depends on the administrator's major goal. The goal is to get the server up and running, of course, but behind the scenes, many more questions should be answered before the restore is started:

• How long will it take to restore the server from a full backup?

• If the server failed due to software corruption, will restoring the server from backup also restore the corruption that actually caused the failure?

• Will reloading the operating system and Exchange manually followed by restoring the system state be faster than doing a full restore?

Loading the Windows Server 2003 operating system and Exchange Server 2003 software can be a relatively quick process. This ensures that all the correct files and drivers are loaded correctly and all that needs to follow is a system state restore to recover the server configuration and restore the data. One of the problems that can occur is that, upon installation, some applications generate Registry keys based on the system's computer name , which can change if a system state restore is performed.

Exchange Server 2003 has a setup /disasterrecovery installation option and does not need the server's system state restorejust the original computer name and domain membership, as long as computer and user certificates are not being used.

The key to choosing whether to rebuild or restore from backup is understanding the dependencies of the applications and services to the operating system, and having confidence in the server's stability at the time of the previous backups . The worst situation is attempting a restore from backup that takes several hours, only to find that the problem has been restored as well.

Manually Recovering a Server

When a complete server system failure is encountered and the state of the operating system or an application is in question, the operating system can be recovered manually. Locating the system's original configuration settings is the first step. This information is normally stored in a server build document or wherever server configuration information is kept.

Because each system is different, as a general guideline for restoring a system manually, perform the following steps:

1. Install a new operating system on the original system hardware and disk volume, or one as close to the original configuration as possible. Be sure to install the same operating system versionfor example, Windows Server 2003 Enterprise or Standard Server.

2. During installation, name the system using the name of the original server, but do not join a domain.

3. Do not install additional services during installation, and proceed by performing a basic installation.

4. When the operating system completes installation, install any additional hardware drivers as necessary and update the operating system to the service pack and security patches that the failed server was expected to have installed. To reduce compatibility problems, install the service packs and updates as outlined in the server build document to ensure that any installed applications will function as desired. During a restore is not the time to roll out additional system changes. The goal is to get the system back online, not to upgrade it.

5. Using the Disk Management console, create and format disk volumes and assign the correct drive letters as recorded in the server build document.

6. If the server was originally part of a domain, join the domain using the original server name. Because many Windows Server 2003 services use the server name or require the service to be authorized in a domain, perform this step before installing any additional services or applications.

7. Install any additional Windows Server 2003 services as defined in the server build document.

8. Install Exchange Server 2003 using the same version of Exchange (Standard or Enterprise) that was originally installed. Apply any Exchange Service Packs and updates that were expected to be on the original server as well. When installing Exchange, use the setup /disasterrecovery installation process that will install Exchange but will not add new databases.

9. Restore Exchange data to the new server.

10. Test functionality, add this system to the backup schedule, and start a full backup.

NOTE

If certificates were issued to the previous server, the new server must enroll with the Certificate Authority (CA) for a new certificate before encrypted communication can occur.

Restoring a Server Using a System State Restore

The restoration of an Exchange Server 2003 system into an existing Active Directory domain does not require the installation of the system state because the procedures covered in the previous section will recover the server and database for the server replacement. However, if the failure of Exchange also included the loss of the Active Directory Global Catalog and there is no other Global Catalog in the organization, a system state restore of the Global Catalog needs to be performed before Exchange can be restored.

Exchange Server 2003 requires a valid Active Directory to be in place. This process might be required if the Exchange server was the only server in the network and, thus, the loss of the Exchange server also meant the loss of the only Global Catalog server. This also might be the case if there was a site failure and all servers, including the Exchange Server and Active Directory Global Catalog server, were lost.

To recover the system state, follow these steps:

1. Shut down the original server or build a new server hardware system.

2. Install a new copy of Windows 2003 on the system hardware and disk volume, or one as close to the original configuration as possible. Be sure to install the same operating system versionfor example, Windows Server 2003 Enterprise or Standard Server.

3. During installation, name the system using the name of the original server, but do not join a domain.

   NOTE

   If the machine is joined to the original domain during the clean installation, a new security identifier (SID) will be generated for the machine account. A system state restore after this restores an invalid computer SID, and many services and applications will fail.

4. Do not install additional services during installation, and proceed by performing a basic installation.

5. When the operating system completes installation, install any additional hardware drivers as necessary and update the operating system to the latest service pack and security patches. To reduce compatibility problems, install the service packs and updates as outlined in the server build document, to ensure that any installed applications will function as desired.

6. Using the Disk Management console, create and format disk volumes and assign the correct drive letters as recorded in the server build document.

7. After the installation, restore any necessary drivers or updates to match the original configuration. This information should be gathered from a server configuration document (server build document). Then reboot as necessary.

After all the updates have been installed, restore the previously backed -up system state data; afterward, restore any additional application or user data.

System State Restore

This section outlines how to restore the system state to a member or standalone Windows Server 2003 system. To restore the system state, perform the following steps:

1. Click Start, All Programs, Accessories, System Tools, Backup.

2. If this is the first time you've run Backup, it opens in Wizard mode. Choose to run it in Advanced mode by clicking the Advanced Mode hyperlink.

3. Click the Restore Wizard (Advanced) button to start the Restore Wizard.

4. Click Next on the Restore Wizard welcome screen to continue.

5. On the What to Restore page, select the appropriate cataloged backup medium, expand the catalog selection, and check System State. Click Next to continue.

6. If the correct tape or file backup medium does not appear in this window, cancel the restore process. Then, from the Restore Wizard, locate and catalog the appropriate medium and return to the restore process from step 1.

7. On the Completing the Restore Wizard page, click Finish to start the restore. The restore will look something similar to Figure 32.2.

   Figure 32.2. Performing a system state restore on an Exchange server.

   

8. When the restore is complete, review the backup log for detailed information and click Close on the Restore Progress window when finished.

9. Reboot the system as prompted.

10. When the system restarts, log in using an account with Local and/or Domain Administrator rights, as necessary.

11. After the system state is restored, Exchange Server 2003 can be installed.

Restoring a System Using an Automated System Recovery Restore

When a system has failed and all other recovery options have been exhausted, an Automated System Recovery (ASR) restore can be performed, provided that an ASR backup has been previously performed. The ASR restore will restore all disk and volume configurations, including redefining volumes and formatting them. This means that the data stored on all volumes needs to be restored after the ASR restore is complete. This restore brings a failed system back to complete server operation, except for certain applications that require special configurations after the restore. For example, the Remote Storage service data needs to be restored separately.

NOTE

An ASR restore re-creates all disk volumes, but if a new or alternate system is being used, each disk must be of equal or greater size to the disks on the original server. Otherwise , the ASR restore will fail.

To perform an ASR restore, follow these steps:

1. Locate the ASR floppy created for the failed node, or create the floppy from the files saved in the ASR backup medium. For information on creating the ASR floppy from the ASR backup medium, refer to Help and Support from any Windows Server 2003 Help and Support tool.

2. Insert the Windows Server 2003 operating system medium in the CD-ROM drive of the server you are restoring to, and start the installation from this CD.

3. When prompted, press F6 to install any third-party storage device drivers, if necessary. This includes any third-party disks or tape controllers that Windows Server 2003 will not natively recognize.

4. Press F2 when prompted to perform an Automated System Recovery.

5. Insert the ASR floppy disk into the floppy drive and press Enter when prompted. If the system does not have a local floppy drive, one must temporarily be added; otherwise, an ASR restore cannot be performed.

6. The operating system installation proceeds by restoring disk volume information and reformatting the volumes associated with the operating system. When this process is complete, the operating system will restart after a short countdown, the graphic-based OS installation will begin, and the ASR backup will attempt to reconnect to the backup medium automatically. If the backup medium is on a network drive, the ASR backup reconnection will fail. If it fails, specify the network location of the backup medium using a UNC path , and enter authentication information, if prompted.

7. When the medium is located, open the medium and click Next and then Finish to begin recovering the remaining ASR data.

8. When the ASR restore is complete, if any local disk data was not restored with the ASR restore, restore all local disks.

9. Click Start, All Programs, Accessories, System Tools, Backup.

10. If this is the first time you've run Backup, it opens in Wizard mode. Choose to run it in Advanced mode by clicking the Advanced Mode hyperlink.

11. Click the Restore Wizard (Advanced) button to start the Restore Wizard.

12. Click Next on the Restore Wizard welcome screen to continue.

13. On the What to Restore page, select the appropriate cataloged backup medium, expand the catalog selection, and check the desired data on each local drive. Click Next to continue.

14. On the Completing the Restore Wizard page, click Finish to start the restore. Because you want to restore only what ASR did not, you do not need to make any advanced restore configuration changes.

15. When the restore is complete, reboot the server, if prompted.

16. After the reboot is complete, log on to the restored server and check server configuration and functionality.

17. If everything is working properly, perform a full backup and log off the server.

Restoring the Boot Loader File

When a Windows Server 2003 system is recovered using an ASR restore, the boot.ini file might not be restored. This file contains the options for booting into different operating systems on multiboot systems and booting into the Recovery Console if it was previously installed. To restore this file, simply restore it from backup to an alternate folder or drive. Delete the boot.ini file from the C:\ root folder and move the restored file from the alternate location to C:\ or whichever drive the boot.ini file previously was located on.