What will the following robots.txt file do?
User-agent:Googlebot
Disallow:/*?
User-agent:Scooter
Disallow:
► a. It will allow Google to crawl any of the dynamically generated pages. It will also allow the AltaVista scooter bot to access every page
► b. It will disallow Google from crawling any of the dynamically generated pages. It will also disallow the AltaVista scooter bot from accessing any page
► c. It will disallow Google from crawling any of the dynamically generated pages. It will allow the AltaVista scooter bot to access every page
► d. None of the above
Answer Posted / chaitanya
c. It will disallow Google from crawling any of the dynamically generated pages. It will allow the AltaVista scooter bot to access every page
| Is This Answer Correct ? | 2 Yes | 1 No |
Post New Answer View All Answers
How can you see where the visitors are clicking most on your website?
What is the difference between 404 & soft 404 errors?
which are required components of an ad group running on the search network?
Explain how does ad rank impact cost-per-click?
What are the limitations of the title and description tags?
When a campaign is showing as pending within adwords, what is it?
Do you know what are outbound links?
nadia manages a local gym and is running an ad to drive more free trial memberships. What could she include in her ad text?
What is Canonical issue? How will you resolve them?
State the difference between ‘nofollow’ and ‘dofollow’ link
What is link popularity?
What is the maximum number of campaigns and ad groups you can create in adwords?
What is the difference between bounce rate & pogo sticking?
What is exit rate in analytics?
Do you know how backlink tools work?