What will the following robots.txt file do?
User-agent:Googlebot
Disallow:/*?
User-agent:Scooter
Disallow:
► a. It will allow Google to crawl any of the dynamically generated pages. It will also allow the AltaVista scooter bot to access every page
► b. It will disallow Google from crawling any of the dynamically generated pages. It will also disallow the AltaVista scooter bot from accessing any page
► c. It will disallow Google from crawling any of the dynamically generated pages. It will allow the AltaVista scooter bot to access every page
► d. None of the above
Answer / chaitanya
c. It will disallow Google from crawling any of the dynamically generated pages. It will allow the AltaVista scooter bot to access every page
| Is This Answer Correct ? | 2 Yes | 1 No |
What is a robots.txt file?
What is an SEO package?
How can you define seo?
Which of the following statements about FFA pages are true? ► a. They are greatly beneficial to SEO ► b. They are also called link farms ► c. They are paid listings ► d. They contain numerous inbound links
What is duplicate content?
Can you include my website with google preferential program?
How can I get google to crawl my site?
How will you increase the pagerank of a page?
When do the Submission appear on the engines? - SEO
How to optimize for rankbrain?
What is directory submission?
What is pirate 2.0 update?