The implementation of an automatic web-driven data analysis framework
Chun-Hsiung Tseng, Yung‐Hui Chen, Yan Ru Jiang · International Journal of Social and Humanistic Computing · 2017
Containing a huge amount of data, the web is undoubtedly a very good source of information. However, performing analysis against data fetched from the web is not an easy task. First, the web is designed to be document-centric rather than data-centric. The former refers to websites that are designed for presenting documents only while the latter refers to websites that are designed for rendering datasets. As a result, reading data shown on web pages is comfortable but collecting data is difficult. Imagine repeating the copy-paste procedure for thousands of web pages. Second, the diversity of the presentation style of web pages makes data normalisation essential but difficult. Last but not the least, data analysis itself demands high statistics skill and sometimes may even require domain expertise. In this research, the researchers would like to address these issues by designing a data analysis tool for the web.