IMPLEMENTATION OF WEB SCRAPING FOR E-COMMERCE WEBSITE
Rohit Kumar Yadav, Kaushal Parmar, Datta Supekar, Praful Gaikwad · Journal of Emerging Technologies and Innovative Research · 2021
In this emerging world of the internet, there is lots of data present and retrieving this data becomes very complicated. As a result web scraping is one of the important method of data gathering. Web scraping is a technique of extracting data from various websites and depending on the tool end-users can access the data in several formats such as spreadsheet, csv, json, xml and database. Web scraping is used in many fields like e-commerce, market research, brand monitoring and etc. Our system proposes a method of fetching product data from e-commerce websites and comparing them. For extracting data different tools are used such as BeautifulSoup, Selenium, etc. Our system uses BeautifulSoup for extracting data. After extraction data is stored into MySQL database. This data is then displayed in a comparable format on our web-app. Visiting websites one by one and comparing product details is time consuming, so to overcome this our system will display all the product details from various websites, which will help the end-user to compare the products