一种基于集成学习的钓鱼网站检测方法

针对钓鱼攻击者常用的伪造HTTPS网站以及其他混淆技术，借鉴了目前主流基于机器学习以及规则匹配的检测钓鱼网站的方法RMLR和PhishDef，增加对网页文本关键字和网页子链接等信息进行特征提取的过程，提出了Nmap-RF分类方法。Nmap-RF是基于规则匹配和随机森林方法的集成钓鱼网站检测方法。根据网页协议对网站进行预过滤，若判定其为钓鱼网站则省略后续特征提取步骤。否则以文本关键字置信度，网页子链接置信度，钓鱼类词汇相似度以及网页PageRank作为关键特征，以常见URL、Whois、DNS信息和网页标签信息作为辅助特征，经过随机森林分类模型判断后给出最终的分类结果。实验证明，Nmap-RF集成方法可以在平均9~10 μs的时间内对钓鱼网页进行检测，且可以过滤掉98.4%的不合法页面，平均总精度可达99.6%。

Phishing Website Detection Method Based on Integrated Learning

In view of the fake HTTPS websites commonly used by phishing attackers and other obfuscation techniques, this paper draws on the current mainstream methods of detecting phishing websites based on machine learning and rule matching, RMLR and PhishDef, and adds features such as web page text keywords and web page sub-links. The Nmap-RF classification method is proposed. Nmap-RF is an integrated phishing website detection method based on rule matching and random forest method. The website is pre-filtered according to the webpage protocol, and if it is determined to be a phishing website, the subsequent feature extraction step is omitted. Otherwise, the text keyword confidence, the page sub-link confidence, the phishing vocabulary similarity and the page PageRank are taken as key features. The common URL, Whois, DNS information and web page tag information are used as auxiliary features, and are judged by the random forest classification model. Experiments show that the Nmap-RF integration method can detect phishing pages in an average of 9~10 μs, and can filter out 98.4% of illegal pages. The average total accuracy is 99.6%.