Development of an Intrusion Detection System based on Big Data for Detecting Unknown Attacks

Abstract: Today Cyber-attacks are increasing because the existing security technologies are not capable of detecting it.Previous cyber-attacks were having simple motive of hacking and damaging the system.But today the motive has changed from attacking the system or network to attacking the large scale systems such as organizations or national agencies.. In other words, existing security technologies to counter these attacks are based on pattern matching methods which are very limited. Because of this fact, in the presence of new and previously unknown attacks, detection rate becomes very low and false negative increases.For this reason,a new model has been proposed based on Big Data for detecting unknown attacks.Big Data can extract information from variety of sources to detect future attacks.We expect our model to be the basis of the future Advanced Persistent Threat (APT) detection and prevention system implementations.

Keywords: Intrusion detection, Data mining,Hadoop, Map Reduce,Targeted Attacks.