| < Day Day Up > |
|
Microsoft introduced incremental crawling with Site Server 3.0, which uses time-stamp comparisons to include only documents that have changed since the previous update of the index.
Incremental updates reduce the amount of indexing work involved in repeated crawls but do not eliminate the need to inspect the time stamp of each document previously crawled each time a crawl occurs. Adaptive crawling goes one step further. During crawls, the algorithm for adaptive crawling gathers statistics about the rate of change for each document. In subsequent adaptive crawls, the algorithm targets only documents that are likely to have changed.
| < Day Day Up > |
|