Do you know What is robots.txt

[ganeshind123]

Hello What is Robots.txt and how to use of the in any link for robots.txt tell me your suggest me.Thanks.

 

[chrishray1097]

robot.txt is a text file through which you can instruct the search engine which page you have to be cache in your site.

 

[Jacksrichard14]

If you are not looking to scrawl any site URL then you will submit a robots.txt file.If you will scrawl all urls and images ,it is not necessary to submit robots.txt file.

 

[prywordpress]

As I know Robots.txt is a text file you put on your site to tell search robots which pages you would like them not to visit. A file written and stored in the root directory of a website that restricts the Search Engine spiders from indexing certain pages of the website.

 

[Freddyaiken]

Robot.txt is one type of text file which is beneficial to instruct the search engine's robot for crawling the pages.if you don't want to crawl your page in search engine then you can just put the link of your page and submit it.

 

[markslatter]

Robots.txt is a text file you put on your site to tell search robots which pages you would like them not to visit.

 

[danialbrown]

sorry i don't have any idea about it..
thanks for sharing here now i can get idea about it..