基于Heritrix的视频垂直搜索引擎

针对目前精品课程网站视频信息多、分布散的特点，通过lucene与heritrix，设计了专门针对视频信息的垂直搜索引擎，使用BKDRHash算法，实现了对视频信息的针对性搜索. 搜索时将网页抓取、内容筛选和建立索引的过程结合在一起，大大减少了系统的开销，改变了以往传统搜索引擎网页全文收录的做法，筛选了无用信息，对页面信息的提取，以及播放链接的提取过程具有一定的创新性.

Video Vertical Search Engine Based on Heritrix

As to the vast video information and its loose distribution, a vertical search engine is especially designed for video information through lucene and heritrix. With BKDRHash algorithm, a pointed video research is implemented. Web pages capture, content filtering and index set-up are integrated to greatly decrease the consumption the system, changes the traditional method to capture the whole page by the search engine, filter the useless information. It is creative in picking up page information and picking process of playing linking.