林业主题爬虫的算法研究与设计

针对目前通用搜索引擎对林业主题信息覆盖率和查准率较低的不足,提出了一种基于Shark-Search算法的林业主题爬虫设计方案。详细讨论了该主题爬虫的爬行策略、算法描述及实现,并通过实践构建了林业主题搜索引擎"搜林"。实验结果表明,相对于通用搜索引擎,"搜林"减少了搜索结果的信息量,提高了林业主题信息搜索的准确率。

Algorithm research and design of forestry focused web crawler

In order to improve that when people searching forestry information,general search engines often return too much but non-relevance information,an forestry information focused web crawler is proposed based on Shark-Search.It's crawling strategy,algorithm and implementation is discussed,then a forestry domain specific search engine Search Forestry is constructed.The experimental results show that compared to general search engines,Search Forestry reduced redundant information and improved accuracy greatly.