| 基于农业领域的网络爬虫 |
| |
| 引用本文： | 吴菊英,贾炅昊,冯秀芳.基于农业领域的网络爬虫[J].电脑开发与应用,2012,25(8):30-32. |
| |
| 作者姓名： | 吴菊英 贾炅昊 冯秀芳 |
| |
| 作者单位： | 太原理工大学计算机科学与技术学院,太原,030024 |
| |
| 基金项目： | 山西省科技基础条件平台建设项目，太原理工大学大学生创新项目 |
| |
| 摘 要： | 以农业环境为背景,在搜索引擎基础而又非常重要的部分——网络爬虫的基础上,提出了改进的爬虫设计,其中采用了主题相关性判断和网页选择器筛选的方法,并且通过建立对应的农产品词库,结果表明在农业领域的搜索相关性上有大幅度的提高。
|
| 关 键 词： | 网络爬虫 URL过滤 农业搜索 主题相关性 聚焦模型 |
Web Crawler Based on Agricultural Sector |
| |
| WU Ju-ying
,
JIA Jiong-hao
,
FENG Xiu-fang.Web Crawler Based on Agricultural Sector[J].Computer Development & Applications,2012,25(8):30-32. |
| |
| Authors: | WU Ju-ying JIA Jiong-hao FENG Xiu-fang |
| |
| Affiliation: | (College of Computer Science and Technology,Taiyuan University of Technology,Taiyuan 030024,China) |
| |
| Abstract: | Using the agricultural environment as the background,propose the improving web crawler design based on the the search engine-based and very important part-the web crawler.It uses theme-related web pages to determine the nature of judgments and screening method selector,and the establishment of the thesaurus of agricultural products.The corresponding results show that the search in the agricultural sector on the relevance of a substantial increase. |
| |
| Keywords: | web crawler URL filtering agricultural search theme correlation focus model |
| 本文献已被 CNKI 维普 万方数据 等数据库收录！ |
