Performance Analysis of Machine Learning Methods with Class Imbalance Problem in Android Malware Detection

Performance Analysis of Machine Learning Methods with Class Imbalance Problem in Android Malware Detection

Android

Malware detection

Machine learning

Data sampling

Due to the exponential rise of mobile technology, a slew of new mobile security concerns has surfaced recently. To address the hazards connected with malware, many approaches have been developed. Signature-based detection is the most widely used approach for detecting Android malware. This approach has the disadvantage of being unable to identify unknown malware. As a result of this issue, machine learning (ML) for identifying and categorising malware apps was created. Conventional ML methods are concerned with increasing classification accuracy. However, the standard classification method performs poorly in recognising malware applications due to the unbalanced real-world datasets. In this study, an empirical analysis of the detection performance of ML methods in the presence of class imbalance is conducted. Specifically, eleven (11) ML methods with diverse computational complexities were investigated. Also, a synthetic minority oversampling technique (SMOTE) and random undersampling (RUS) are deployed to address the class imbalance in the Android malware datasets. The experimented ML methods are tested using the Malgenome and Drebin Android malware datasets that contain features gathered from both static and dynamic malware approaches. According to the experimental findings, the performance of each experimented ML method varies across the datasets. Moreover, the presence of class imbalance deteriorated the performance of the ML methods as their performances were amplified with the deployment of data sampling methods (SMOTE and RUS) used to alleviate the class imbalance problem. Besides, ML models with SMOTE technique are superior to other experimented methods. It is therefore recommended to address the inherent class imbalance problem in Android Malware detection.

Akintola, Abimbola Ganiyat

Balogun, Abdullateef

Mojeed, Hammed Adeleke

Usman-Hamza, Fatima

Salihu, Shakirat Aderonke

Adewole, Kayode Sakariyau

Balogun, Ghaniyyat Bolanale

Sadiku, Peter Ogirima

International Journal of Interactive Mobile Technologies (iJIM); Vol. 16 No. 10 (2022); pp. 140-162

1865-7923

International Association of Online Engineering (IAOE), Vienna, Austria

2022-05-24

Copyright (c) 2022 Abdullateef Balogun, Abimbola Ganiyat Akintola, Hammed Adeleke Mojeed, Fatima Usman-Hamza, Shakirat Aderonke Salihu, Ghaniyyat Bolanale Balogun, Peter Ogirima Sadiku, Kayode Sakariyau Adewole

https://creativecommons.org/licenses/by/4.0

application/pdf

eng

info:eu-repo/semantics/article

info:eu-repo/semantics/publishedVersion

Peer-reviewed Article