Freshness tuning in focused crawler
Swati Mali, S. Ninoriya, B. B. Meshram · 2011
The dynamic web keeps on changing and unnoticing an important event makes the result incomplete. All of the web pages do not change. Even if some of them change, they do not do the same with same frequency. So, having the same revisit frequency for all earlier visited pages merely creates overheads and does not contribute positively to the result. Here's a proposal of a focused crawler that talks about the strategy of how and when to revisit the earlier visited sites.