Web2Vec: A python library for website-to-vector transformation
Damian Frąszczak, Edyta Frąszczak · SoftwareX · 2025
Web2Vec is a Python library designed to simplify website analysis by converting websites into vector representations through feature extraction from their content and structure. Utilizing Scrapy-based web crawlers, it automates data collection and supports both single-page analysis and large-scale crawling. This flexibility allows users to adapt the library to their specific needs, whether for quick, focused analysis or systematic data collection. Integrating over 200 website parameters into a single, easy-to-use framework, Web2Vec simplifies analytical tasks, making it a valuable resource across various fields. By serving as a centralized code repository for researchers, it eliminates the need to repeatedly implement similar code, providing an all-in-one integrator to streamline workflows and save time.