| Title | Hybrid Focused Crawling for Homemade Explosives Discovery on Surface and Dark Web |
| Publication Type | Conference Paper |
| Year of Publication | 2016 |
| Authors | Iliou, C., Kalpakis, G., Tsikrika, T., Vrochidis, S., Kompatsiaris, I. |
| Conference Name | 2016 11th International Conference on Availability, Reliability and Security (ARES) |
| Keywords | classifier-guided hyperlink selection strategy, Context, Crawlers, dark web, Darknets, explosives, focused crawling, Freenet, government data processing, homemade explosives discovery, Human Behavior, human factors, hybrid focused crawling, I2P, information retrieval, Internet, pubcrawl, search engines, surface Web, Terrorism, Tor, Uniform resource locators, Web pages, Web resource discovery |
| Abstract | This work proposes a generic focused crawling framework for discovering resources on any given topic that reside on the Surface or the Dark Web. The proposed crawler is able to seamlessly traverse the Surface Web and several darknets present in the Dark Web (i.e. Tor, I2P and Freenet) during a single crawl by automatically adapting its crawling behavior and its classifier-guided hyperlink selection strategy based on the network type. This hybrid focused crawler is demonstrated for the discovery of Web resources containing recipes for producing homemade explosives. The evaluation experiments indicate the effectiveness of the proposed ap-proach both for the Surface and the Dark Web. |
| DOI | 10.1109/ARES.2016.66 |
| Citation Key | iliou_hybrid_2016 |
Hybrid Focused Crawling for Homemade Explosives Discovery on Surface and Dark Web