大规模移动应用第三方库自动检测和分类方法

移动应用中广泛使用第三方库来帮助开发和增强应用功能.很多关于移动应用分析以及访问控制的研究工作，需要在分析之前对第三方库进行检测、过滤或者对其进行功能分类.当前大部分研究工作都使用白名单的方式来检测第三方库或者对其功能进行分类.然而，通过白名单检测第三方库不完善且不准确，其原因包括：（1）第三方库的种类和数量很大，（2）常见的代码混淆或者第三方库伪装等技术使得白名单方法不能准确的识别第三方库.本文提出一种第三方库自动检测和分类方法，包括基于多级聚类技术准确识别第三方库，以及基于机器学习对第三方库的功能进行准确分类.实验对超过130，000个Android应用进行分析，验证所提出方法的有效性.实验总共检测到4，916个不同的第三方库.在人工标记的数据集上，通过十折交叉验证，对第三方库分类的准确率达到84.28%.将训练好的分类器应用于全部4，916个检测到的第三方库，人工进行抽样验证的准确率达到75%.

Automated Detection and Classification of Third-Party Libraries in Large Scale Android Apps

Third-party libraries are widely used in mobile applications such as Android apps. Much research on app analysis or access control needs to detect or classify third-party librariesfirst in order to provide accurate results.Most previous studies use a whitelist to identify third-partylibraries and manually categorize them. However, itis impossible to build a complete whitelist of third-party libraries and classify thembecause:(1) there are too many of them, and (2) widelyused techniques such as library obfuscation and librarymasquerading cannot be handled with a whitelist.In this paper, we propose an automated approach to detectand classify frequently-used third-party libraries in Android apps. We propose a multi-level clustering based methodto identify third-party libraries, and a machine learning basedtechnique to classify them. Experiments on more than 130,000apps show that we could detect 4,916 third-party librarieswithout prior knowledge. The classification resultof 10-folds cross validation on sampled libraries is 84.28%.With the trained classifier, we areable to classify more than 75% of the 4,916 libraries into six categories with an accuracy of 75%.