Web Scraper Application for Extracting Scientific Journals Data
Wahaj Alkaberi, Reem Hamed Aljuhani, Huda Alamoudi · The 5th International Conference on Future Networks & Distributed Systems · 2021
Searching for certain subjects of articles that are disseminated throughout scientific journals would be a time-consuming task, as it would necessitate scouring many digital libraries or journal websites. This process can be performed efficiently by utilizing web scraping technology, in which a scraper is used to extract web page content into more organized and structured datasets. This paper proposes a customized web scraper called ”Research Scraper” that will extract content from scientific journal websites, allowing users to access all results from a single search interface. The proposed technique is simple to use and can help with the process of analyzing publications in a specific field. This paper presents and explains the development steps, system design, and technologies that will be used in the implementation phase.