Architecture for a parallel focused crawler for clickstream analysis

The tremendous growth of the Web poses many challenges for all-purpose single-process crawlers including the presence of some irrelevant answers among search results and the coverage and scaling issues regarding the enormous dimension of the World Wide Web. Meanwhile, more enhanced and convincing al...

Full description

Bibliographic Details
Main Authors: Selamat, Ali, Ahmadi-Abkenari, Fatemeh
Format: Conference or Workshop Item
Published: 2011