What is a robots.txt file, and how do you use it?
- 1 Answers
- 82 Views
- I also Faced
- E-Mail Answers
Answer / nashiinformaticssolutions
Search engine crawlers are told which pages or sections of a website to crawl and which to avoid using a robots.txt file. It is employed to stop sensitive or duplicate content from being indexed.
| Is This Answer Correct ? | 0 Yes | 0 No |
Where can I purchase search engine visibility?
Does the spider program run through all links on a web page?
Explain what is 301 redirect?
Tell me what is canonical url?
How many characters limits in & Meta Description tag?
Have new web technologies like XHTML, CSS, Flash, and XML changed the SEO game or the ways search engines work?
Tell me how do you separate words in url?
What goes into seo?
What is the syntax of the robots meta tag?
What is the definition of url?
What is Page Rank or PR?
Tell me can you optimize the website which has pages in millions?
HTML DHTML 
