Method for calculating entropy of web information block

Yong-Hong Zhou · Jisuanji gongcheng yu sheji · 2010

To solve the topic drift problem in web information extraction effectively,a new computation of entropy based on web page is proposed.The information within local page and same information distribution between websites are considered completely to greatly guarantee improving the precision.Calculating entropy of web information block in web information extraction is used to verify this al-gorithm and the result of simulation,which is compared to other well-known algorithms,indicated that this algorithm is better than several other algorithms in both precision of calculating entropy and distinguishing between related information blocks and unrelated in-formation blocks.

Read the paper · More papers on PaperTik