doi dblp Effective web-scale crawling through website analysis Iván Gonzlez | Adam Marcus | Daniel N. Meredith | Linda A. Nguyen Proceedings of the 15th international conference on World Wide Web, WWW 2006, Edinburgh, Scotland, UK, May 23-26, 2006