Visible to the public Enhancing the Naive Bayes Spam Filter Through Intelligent Text Modification Detection

TitleEnhancing the Naive Bayes Spam Filter Through Intelligent Text Modification Detection
Publication TypeConference Paper
Year of Publication2018
AuthorsPeng, W., Huang, L., Jia, J., Ingram, E.
Conference Name2018 17th IEEE International Conference On Trust, Security And Privacy In Computing And Communications/ 12th IEEE International Conference On Big Data Science And Engineering (TrustCom/BigDataSE)
Date Publishedaug
KeywordsBayes methods, Bayes Spam Filter, Bayesian Poisoning, computer security, e-mail filters, Email, email communication, feature extraction, Human Behavior, intelligent text modification detection, Internet based information exchange venues, learning (artificial intelligence), machine learning, machine learning algorithm, machine learning algorithms, Metrics, naïve Bayes classifier, Naive Bayes Spam Filter, pattern classification, pubcrawl, Python algorithm, Scalability, social networks, spam, spam classification, spam detection, spam emails, spam filter, spam score, Spamassassin, Testing, text analysis, text classification, text modifications, unsolicited e-mail, Unsolicited electronic mail
Abstract

Spam emails have been a chronic issue in computer security. They are very costly economically and extremely dangerous for computers and networks. Despite of the emergence of social networks and other Internet based information exchange venues, dependence on email communication has increased over the years and this dependence has resulted in an urgent need to improve spam filters. Although many spam filters have been created to help prevent these spam emails from entering a user's inbox, there is a lack or research focusing on text modifications. Currently, Naive Bayes is one of the most popular methods of spam classification because of its simplicity and efficiency. Naive Bayes is also very accurate; however, it is unable to correctly classify emails when they contain leetspeak or diacritics. Thus, in this proposes, we implemented a novel algorithm for enhancing the accuracy of the Naive Bayes Spam Filter so that it can detect text modifications and correctly classify the email as spam or ham. Our Python algorithm combines semantic based, keyword based, and machine learning algorithms to increase the accuracy of Naive Bayes compared to Spamassassin by over two hundred percent. Additionally, we have discovered a relationship between the length of the email and the spam score, indicating that Bayesian Poisoning, a controversial topic, is actually a real phenomenon and utilized by spammers.

URLhttps://ieeexplore.ieee.org/document/8455990
DOI10.1109/TrustCom/BigDataSE.2018.00122
Citation Keypeng_enhancing_2018