Architecture for a parallel focused crawler for clickstream analysis
The tremendous growth of the Web poses many challenges for all-purpose single-process crawlers including the presence of some irrelevant answers among search results and the coverage and scaling issues regarding the enormous dimension of the World Wide Web. Meanwhile, more enhanced and convincing al...
Main Authors: | , |
---|---|
Format: | Conference or Workshop Item |
Published: |
2011
|