If there is no robots.txt file...

[chaneguye]

Can it be predicted how deep Googlebot will crawl a site if there is no robots.txt file? I failed to make sure there was a robots.txt file on two sites I recently worked on. ops: Now, looking at the dance, it appears that NONE of the new pages I added have been crawled. On both sites all the new pages are at least three clicks deep into the site. The new pages are not pigs because they were submitted to Inktomi using paid inclusion and they rank fairly well.