Thu, Apr 18, 2024
[Archive]
Volume 11, Issue 3 (9-2019)
2019, 11(3): 42-48 |
Back to browse issues page
Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
Harimi M, Shayegan M J. A Method for Anomaly Detection in Big Data based on Support Vector Machine. International Journal of Information and Communication Technology Research 2019; 11 (3) :42-48
URL: http://ijict.itrc.ac.ir/article-1-442-en.html
URL: http://ijict.itrc.ac.ir/article-1-442-en.html
1- Department of Computer Engineering University of Science and Culture , msdharimi@gmail.com
2- epartment of Computer Engineering University of Science and Culture
2- epartment of Computer Engineering University of Science and Culture
Abstract: (1471 Views)
In recent years, data mining has played an essential role in computer system performance, helping to improve system functionality. One of the most critical and influential data mining algorithms is anomaly detection. Anomaly detection is a process in detecting system abnormality that helps with finding system problems and troubleshooting. Intrusion and fraud detection services used by credit card companies are some examples of anomaly detection in the real world. According to the increasing volumes of the datasets that creates big data, traditional data mining approaches do not have efficient enough results. Various platforms, frameworks, and algorithms for big data mining have been presented to account for this deficiency. For instance, Hadoop and Spark are some of the most used frameworks in this field. Support Vector Machine (SVM) is one of the most popular approaches in anomaly detection, which—according to its distributed and parallel extensions—is widely used in big data mining. In this research, Mutual Information is used for feature selection. Besides, the kernel function of the one-class support vector machine has been improved; thus, the performance of the anomaly detection improved. This approach is implemented using Spark. The NSL-KDD dataset is used, and an accuracy of more than 80 percent is achieved. Compared to the other similar approaches in anomaly detection, the results are improved.
Keywords: detection, support vector machine, big data, improvement of anomaly detection, one-class support vector machine, Mutual Information
Type of Study: Research |
Subject:
Information Technology
Send email to the article author
| Rights and permissions | |
 | This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. |
