Nameslot is a .com-only forum – membership is free with full access; upgrades offer extras like banner ads and newsletter spots. ✅ Signature links are free. No AI-generated posts – share your own insights or risk account removal.
  • Welcome to NamesLot.com Domain Name Forum

    NamesLot.com Domain Name Forum offers a fully open forum to discuss domain industry news and a 0% commission marketplace for you to buy and sell domain names.

    We have reorganized our Marketplace so now it is easier to get attention to your domain while it is also easier for buyers to find the right domain name.

    If you want us to add more threads to our marketplace, please contact us! Listing on our marketplace as always, 100% free! Register NOW or Login HERE!

If there is no robots.txt file...

Status
Not open for further replies.

chaneguye

New Member
Can it be predicted how deep Googlebot will crawl a site if there is no robots.txt file? I failed to make sure there was a robots.txt file on two sites I recently worked on. ops: Now, looking at the dance, it appears that NONE of the new pages I added have been crawled. On both sites all the new pages are at least three clicks deep into the site. The new pages are not pigs because they were submitted to Inktomi using paid inclusion and they rank fairly well.
 
Status
Not open for further replies.

Members online

No members online now.

Forum statistics

Threads
20,673
Messages
70,678
Members
44,664
Latest member
thrivehealthsystems
Active members today
2
New members today
0
New threads today
16
New posts today
16

Latest Listings

Follow NamesLot on Twitter!

NamesLot proudly supported by

NamesLot proudly supported by

Top