What will the following robots.txt file do?
User-agent:Googlebot
Disallow:/*?
User-agent:Scooter
Disallow:
► a. It will allow Google to crawl any of the dynamically generated pages. It will also allow the AltaVista scooter bot to access every page
► b. It will disallow Google from crawling any of the dynamically generated pages. It will also disallow the AltaVista scooter bot from accessing any page
► c. It will disallow Google from crawling any of the dynamically generated pages. It will allow the AltaVista scooter bot to access every page
► d. None of the above
Answer / chaitanya
c. It will disallow Google from crawling any of the dynamically generated pages. It will allow the AltaVista scooter bot to access every page
| Is This Answer Correct ? | 2 Yes | 1 No |
What do you mean by spider?
Explain what do you understand by frames in html?
When is reinclusion applied in a search engine's index?
What is google?
What are the steps would you follow to optimize a website?
Explain link popularity.
What is google hummingbird algorithms?
What is the difference between clicks and visits in google analytics?
Do you know what methods would you apply for decreasing the loading time of a website?
What is the Role of Social Media in SEO?
What types of links are no-follow?
What is the difference between the broad match and narrow match?