On Bots is a fascinating report on a large scale experiment to see how web search bots would explore an almost limitless set of linked pages. Whether or not the results generalize (or are still applicable), it's got a bunch of pretty pictures.

(From Tim Bray , rather belatedly.)