SHEN Wen-qin~1, LI Qing-chao~2, SHAO Zhi-qing~. Incremental Crawling and Shadowing Update Strategy in Search Engines[J]. Journal of East China University of Science and Technology, 2004, (3): 284-287.
Citation:
SHEN Wen-qin~1, LI Qing-chao~2, SHAO Zhi-qing~. Incremental Crawling and Shadowing Update Strategy in Search Engines[J]. Journal of East China University of Science and Technology, 2004, (3): 284-287.
SHEN Wen-qin~1, LI Qing-chao~2, SHAO Zhi-qing~. Incremental Crawling and Shadowing Update Strategy in Search Engines[J]. Journal of East China University of Science and Technology, 2004, (3): 284-287.
Citation:
SHEN Wen-qin~1, LI Qing-chao~2, SHAO Zhi-qing~. Incremental Crawling and Shadowing Update Strategy in Search Engines[J]. Journal of East China University of Science and Technology, 2004, (3): 284-287.
Incremental Crawling and Shadowing Update Strategy in Search Engines
This paper analyses the general architecture of search engine, especially the design and (implementation) technology of the crawling and update strategy, the crawler can download "high quality" Web pages incrementally and maintain the "freshness" of the Web repository.
DownLoad: