D-miner: A framework for mining, searching, visualizing, and alerting on darknet events
Heather Lawrence, Andrew Hughes, Robert Tonic, Cliff Changchun Zou · 2017
Darknet resources are mined for their data in order to provide possible cyber threat intelligence to network operators. Network operators, however, often have limited resources with which to search the darknet for threats. Previous work in this area has failed to address this use case instead focusing on sales volumes, vendor characteristics, and identifying the sale of zero day exploits. In this paper we present D-miner: a modular framework designed to mine data from websites, specializing in darknet sites, and parse the data into JSON objects for searching, visualizations, and alerts. This open source solution to darknet mining is intended to make it easier for network shareholders to monitor the darknet for potential threats. We show how D-miner is customizable for multiple use cases and how it can be used to visualize data to aid analysis.