What is a robots.txt file?

Answer Posted / nashiinformaticssolutions

Search engine bots can be instructed on how to crawl and index a website and its pages by using the Robots.txt file.

Because this file is in the.txt format, it contains simply text and no HTML code. Its function is to prevent search engine bots from visiting the website needlessly. This is typically the first file that crawlers see on the website.

Is This Answer Correct ?    0 Yes 0 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

what happens when an advertiser sets a daily budget lower than the recommended amount, using the standard delivery method?

5


When do the Submission appear on the engines? - SEO

1206


What is press release submission?

483


Do you know what are paid results?

507


How do we determine if we should manage search engine marketing activities in-house or outsource to an sem vendor?

511






What is google panda algorithms?

577


Explain distinct types of seo practice?

558


What are the different techniques used in offpage seo?

521


Tell us what will you do, for the company website you are working for, decides to move all the contents to new domain?

512


which best describes the optimize ad rotation setting in adwords?

5


What is a website or what do you understand by a website?

473


which of the following items is not a component of quality score?

5


What is mobilegeddon (mobile-friendly update)?

507


What is Page Authority?

551


What is crawling?

537