Android IoT Lifelog System and Its Application to Motion Inference

In social science, health care, digital therapeutics, etc., smartphone data have played important roles to infer users’ daily lives. However, smartphone data collection systems could not be used effectively and widely because they did not exploit any Internet of Things (IoT) standards (e.g., oneM2M) and class labeling methods for machine learning (ML) services. Therefore, in this paper, we propose a novel Android IoT lifelog system complying with oneM2M standards to collect various lifelog data in smartphones and provide two manual and automated class labeling methods for inference of users’ daily lives. The proposed system consists of an Android IoT client application, an oneM2M-compliant IoT server, and an ML server whose high-level functional architecture was carefully designed to be open, accessible, and internationally recognized in accordance with the oneM2M standards. In particular, we explain implementation details of activity diagrams for the Android IoT client application, the primary component of the proposed system. Experimental results verified that this application could work with the oneM2M-compliant IoT server normally and provide corresponding class labels properly. As an application of the proposed system, we also propose motion inference based on three multi-class ML classifiers (i.e., k nearest neighbors, Naive Bayes, and support vector machine) which were created by using only motion and location data (i.e., acceleration force, gyroscope rate of rotation, and speed) and motion class labels (i.e., driving, cycling, running, walking, and stilling). When compared with confusion matrices of the ML classifiers, the k nearest neighbors classifier outperformed the other two overall. Furthermore, we evaluated its output quality by analyzing the receiver operating characteristic (ROC) curves with area under the curve (AUC) values. The AUC values of the ROC curves for all motion classes were more than 0.9, and the macro-average and micro-average ROC curves achieved very high AUC values of 0.96 and 0.99, respectively.