Settings for Crawling Web Sites on the Internet

If you want SharePoint Portal Server to crawl Web sites on the Internet, it is recommended that you modify the time-out settings both for connecting to a Web site or server and for waiting for request acknowledgment. Specify 60 seconds for the wait time for connecting to a Web site or server, and specify 30 seconds for the wait time for request acknowledgment from a Web site or server. You can modify these settings from SharePoint Portal Server Administration.

If you have a proxy server that requires authentication to access the Internet from your intranet, SharePoint Portal Server cannot crawl sites on the Internet.

To modify the time-out settings:

1. On the Start menu, point to Programs, point to Administrative Tools, and then click SharePoint Portal Server Administration.
2. In the console tree, select SharePoint Portal Server computer.
3. On the Action menu, click Properties. You can also right-click the server name, and then click Properties on the shortcut menu.
4. Click the Load tab.
5. In Number of seconds to wait for a connection, type 60.
6. In Number of seconds to wait for request acknowledgment, type 30.
7. Click Apply.

Depending on the connection speed and other factors, such as Internet loss, Internet latency, and Internet jitter, you may need to increase the previous settings.