Busquedas en internet
10.7.04
 
Google indexa archivos no linkeados

Now I'm seeing the Googlebot request /about/ pages relative to known blogs
that don't have any links to any /about/ URI. The last time the Googlebot
flailed around like this it was fun to watch for a little bit and wonder
what they had cooking in the labs, but then it got annoying. I don't know
if there are rules of bot etiquette, but requesting imagined unlinked
resources while spidering can't be a best practice


En href="http://photomatt.net/2004/07/09/more-googlebot-flailing/">photomatt.net